[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:13:24.836601  2843 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.198.254:46137
I20260709 13:13:24.838460  2843 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:13:24.839741  2843 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:24.859495  2852 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:24.859485  2850 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:24.860597  2849 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:24.861073  2843 server_base.cc:1061] running on GCE node
I20260709 13:13:26.082326  2843 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:26.082659  2843 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:26.082885  2843 hybrid_clock.cc:648] HybridClock initialized: now 1783602806082862 us; error 0 us; skew 500 ppm
I20260709 13:13:26.083886  2843 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:26.090111  2843 webserver.cc:533] Webserver started at http://127.2.198.254:43611/ using document root <none> and password file <none>
I20260709 13:13:26.091143  2843 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:26.091416  2843 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:26.091971  2843 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:26.098529  2843 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602804652623-2843-0/minicluster-data/master-0-root/instance:
uuid: "ca239762827c4fab8e3fc3b7027923ea"
format_stamp: "Formatted at 2026-07-09 13:13:26 on dist-test-slave-fc6v"
I20260709 13:13:26.107219  2843 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.010s	sys 0.000s
I20260709 13:13:26.113585  2858 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:26.115042  2843 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:13:26.115499  2843 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602804652623-2843-0/minicluster-data/master-0-root
uuid: "ca239762827c4fab8e3fc3b7027923ea"
format_stamp: "Formatted at 2026-07-09 13:13:26 on dist-test-slave-fc6v"
I20260709 13:13:26.115980  2843 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602804652623-2843-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602804652623-2843-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602804652623-2843-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:26.175004  2843 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:26.176962  2843 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:13:26.177508  2843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:26.263903  2843 rpc_server.cc:307] RPC server started. Bound to: 127.2.198.254:46137
I20260709 13:13:26.263971  2909 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.198.254:46137 every 8 connection(s)
I20260709 13:13:26.272966  2910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.297044  2910 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca239762827c4fab8e3fc3b7027923ea: Bootstrap starting.
I20260709 13:13:26.304051  2910 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ca239762827c4fab8e3fc3b7027923ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:26.306254  2910 log.cc:826] T 00000000000000000000000000000000 P ca239762827c4fab8e3fc3b7027923ea: Log is configured to *not* fsync() on all Append() calls
I20260709 13:13:26.311525  2910 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca239762827c4fab8e3fc3b7027923ea: No bootstrap required, opened a new log
I20260709 13:13:26.334124  2910 raft_consensus.cc:359] T 00000000000000000000000000000000 P ca239762827c4fab8e3fc3b7027923ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca239762827c4fab8e3fc3b7027923ea" member_type: VOTER }
I20260709 13:13:26.334782  2910 raft_consensus.cc:385] T 00000000000000000000000000000000 P ca239762827c4fab8e3fc3b7027923ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.335005  2910 raft_consensus.cc:740] T 00000000000000000000000000000000 P ca239762827c4fab8e3fc3b7027923ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca239762827c4fab8e3fc3b7027923ea, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.336107  2910 consensus_queue.cc:260] T 00000000000000000000000000000000 P ca239762827c4fab8e3fc3b7027923ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca239762827c4fab8e3fc3b7027923ea" member_type: VOTER }
I20260709 13:13:26.336676  2910 raft_consensus.cc:399] T 00000000000000000000000000000000 P ca239762827c4fab8e3fc3b7027923ea [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:13:26.336946  2910 raft_consensus.cc:493] T 00000000000000000000000000000000 P ca239762827c4fab8e3fc3b7027923ea [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:13:26.337260  2910 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ca239762827c4fab8e3fc3b7027923ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.341902  2910 raft_consensus.cc:515] T 00000000000000000000000000000000 P ca239762827c4fab8e3fc3b7027923ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca239762827c4fab8e3fc3b7027923ea" member_type: VOTER }
I20260709 13:13:26.342744  2910 leader_election.cc:304] T 00000000000000000000000000000000 P ca239762827c4fab8e3fc3b7027923ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ca239762827c4fab8e3fc3b7027923ea; no voters: 
I20260709 13:13:26.344771  2910 leader_election.cc:290] T 00000000000000000000000000000000 P ca239762827c4fab8e3fc3b7027923ea [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:13:26.345134  2913 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ca239762827c4fab8e3fc3b7027923ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:26.347827  2913 raft_consensus.cc:697] T 00000000000000000000000000000000 P ca239762827c4fab8e3fc3b7027923ea [term 1 LEADER]: Becoming Leader. State: Replica: ca239762827c4fab8e3fc3b7027923ea, State: Running, Role: LEADER
I20260709 13:13:26.348909  2913 consensus_queue.cc:237] T 00000000000000000000000000000000 P ca239762827c4fab8e3fc3b7027923ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca239762827c4fab8e3fc3b7027923ea" member_type: VOTER }
I20260709 13:13:26.350080  2910 sys_catalog.cc:565] T 00000000000000000000000000000000 P ca239762827c4fab8e3fc3b7027923ea [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:13:26.361792  2914 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca239762827c4fab8e3fc3b7027923ea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ca239762827c4fab8e3fc3b7027923ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca239762827c4fab8e3fc3b7027923ea" member_type: VOTER } }
I20260709 13:13:26.362645  2914 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca239762827c4fab8e3fc3b7027923ea [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:26.364219  2915 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca239762827c4fab8e3fc3b7027923ea [sys.catalog]: SysCatalogTable state changed. Reason: New leader ca239762827c4fab8e3fc3b7027923ea. Latest consensus state: current_term: 1 leader_uuid: "ca239762827c4fab8e3fc3b7027923ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca239762827c4fab8e3fc3b7027923ea" member_type: VOTER } }
I20260709 13:13:26.364976  2915 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca239762827c4fab8e3fc3b7027923ea [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:26.367257  2919 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:13:26.381752  2919 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:13:26.386679  2843 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:13:26.404300  2919 catalog_manager.cc:1383] Generated new cluster ID: 36de89478fcc44a79e714100763a0073
I20260709 13:13:26.404641  2919 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:13:26.436813  2919 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:13:26.438540  2919 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:13:26.457271  2919 catalog_manager.cc:6070] T 00000000000000000000000000000000 P ca239762827c4fab8e3fc3b7027923ea: Generated new TSK 0
I20260709 13:13:26.458436  2919 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:13:26.518221  2843 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:26.528178  2932 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:26.529361  2933 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:26.533977  2843 server_base.cc:1061] running on GCE node
W20260709 13:13:26.534058  2936 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:26.535071  2843 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:26.535379  2843 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:26.535600  2843 hybrid_clock.cc:648] HybridClock initialized: now 1783602806535579 us; error 0 us; skew 500 ppm
I20260709 13:13:26.536252  2843 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:26.541200  2843 webserver.cc:533] Webserver started at http://127.2.198.193:36411/ using document root <none> and password file <none>
I20260709 13:13:26.541791  2843 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:26.542040  2843 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:26.542374  2843 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:26.543658  2843 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602804652623-2843-0/minicluster-data/ts-0-root/instance:
uuid: "59527545ee964f0389247722525b5134"
format_stamp: "Formatted at 2026-07-09 13:13:26 on dist-test-slave-fc6v"
I20260709 13:13:26.549772  2843 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.001s	sys 0.005s
I20260709 13:13:26.554911  2940 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:26.555991  2843 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.002s
I20260709 13:13:26.556301  2843 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602804652623-2843-0/minicluster-data/ts-0-root
uuid: "59527545ee964f0389247722525b5134"
format_stamp: "Formatted at 2026-07-09 13:13:26 on dist-test-slave-fc6v"
I20260709 13:13:26.556591  2843 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602804652623-2843-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602804652623-2843-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602804652623-2843-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:26.584409  2843 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:26.585973  2843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:26.589118  2843 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:26.593652  2843 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:26.593914  2843 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:26.594262  2843 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:26.594421  2843 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:26.713205  2843 rpc_server.cc:307] RPC server started. Bound to: 127.2.198.193:40443
I20260709 13:13:26.713265  3002 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.198.193:40443 every 8 connection(s)
I20260709 13:13:26.721738  2843 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:26.736222  3007 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:26.739570  3008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:26.748733  3010 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:26.750379  2843 server_base.cc:1061] running on GCE node
I20260709 13:13:26.751613  2843 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:26.752027  2843 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:26.752305  2843 hybrid_clock.cc:648] HybridClock initialized: now 1783602806752281 us; error 0 us; skew 500 ppm
I20260709 13:13:26.753149  2843 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:26.755669  3003 heartbeater.cc:344] Connected to a master server at 127.2.198.254:46137
I20260709 13:13:26.756228  3003 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:26.757829  3003 heartbeater.cc:507] Master 127.2.198.254:46137 requested a full tablet report, sending...
I20260709 13:13:26.758821  2843 webserver.cc:533] Webserver started at http://127.2.198.194:40499/ using document root <none> and password file <none>
I20260709 13:13:26.759635  2843 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:26.759905  2843 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:26.760281  2843 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:26.762080  2843 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602804652623-2843-0/minicluster-data/ts-1-root/instance:
uuid: "7007c802f3424951bd47a1d364907f0d"
format_stamp: "Formatted at 2026-07-09 13:13:26 on dist-test-slave-fc6v"
I20260709 13:13:26.762127  2875 ts_manager.cc:194] Registered new tserver with Master: 59527545ee964f0389247722525b5134 (127.2.198.193:40443)
I20260709 13:13:26.765663  2875 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39218
I20260709 13:13:26.770665  2843 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.005s	sys 0.005s
I20260709 13:13:26.776695  3015 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:26.777837  2843 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:26.778190  2843 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602804652623-2843-0/minicluster-data/ts-1-root
uuid: "7007c802f3424951bd47a1d364907f0d"
format_stamp: "Formatted at 2026-07-09 13:13:26 on dist-test-slave-fc6v"
I20260709 13:13:26.778501  2843 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602804652623-2843-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602804652623-2843-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602804652623-2843-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:26.807175  2843 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:26.808779  2843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:26.810671  2843 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:26.814390  2843 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:26.814620  2843 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:26.814910  2843 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:26.815078  2843 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:26.931599  2843 rpc_server.cc:307] RPC server started. Bound to: 127.2.198.194:37497
I20260709 13:13:26.931712  3077 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.198.194:37497 every 8 connection(s)
I20260709 13:13:26.941808  2843 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:26.951175  3081 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:26.954276  3078 heartbeater.cc:344] Connected to a master server at 127.2.198.254:46137
I20260709 13:13:26.954730  3078 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:26.956051  3078 heartbeater.cc:507] Master 127.2.198.254:46137 requested a full tablet report, sending...
I20260709 13:13:26.957723  2843 server_base.cc:1061] running on GCE node
W20260709 13:13:26.958715  3082 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:26.959161  2875 ts_manager.cc:194] Registered new tserver with Master: 7007c802f3424951bd47a1d364907f0d (127.2.198.194:37497)
W20260709 13:13:26.959297  3084 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:26.960578  2843 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:26.960892  2843 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:26.961135  2843 hybrid_clock.cc:648] HybridClock initialized: now 1783602806961113 us; error 0 us; skew 500 ppm
I20260709 13:13:26.961321  2875 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39230
I20260709 13:13:26.961963  2843 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:26.965157  2843 webserver.cc:533] Webserver started at http://127.2.198.195:41913/ using document root <none> and password file <none>
I20260709 13:13:26.965703  2843 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:26.965919  2843 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:26.966229  2843 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:26.967365  2843 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602804652623-2843-0/minicluster-data/ts-2-root/instance:
uuid: "43a7e3222d3940738dd6a4bc910c4493"
format_stamp: "Formatted at 2026-07-09 13:13:26 on dist-test-slave-fc6v"
I20260709 13:13:26.972421  2843 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:13:26.976063  3089 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:26.976895  2843 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
I20260709 13:13:26.977207  2843 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602804652623-2843-0/minicluster-data/ts-2-root
uuid: "43a7e3222d3940738dd6a4bc910c4493"
format_stamp: "Formatted at 2026-07-09 13:13:26 on dist-test-slave-fc6v"
I20260709 13:13:26.977532  2843 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602804652623-2843-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602804652623-2843-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602804652623-2843-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:26.993976  2843 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:26.995385  2843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:26.997334  2843 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:27.001140  2843 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:27.001333  2843 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:27.001641  2843 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:27.001802  2843 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:27.112509  2843 rpc_server.cc:307] RPC server started. Bound to: 127.2.198.195:34467
I20260709 13:13:27.112603  3151 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.198.195:34467 every 8 connection(s)
I20260709 13:13:27.132865  3152 heartbeater.cc:344] Connected to a master server at 127.2.198.254:46137
I20260709 13:13:27.133322  3152 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:27.134346  3152 heartbeater.cc:507] Master 127.2.198.254:46137 requested a full tablet report, sending...
I20260709 13:13:27.136636  2875 ts_manager.cc:194] Registered new tserver with Master: 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195:34467)
I20260709 13:13:27.137398  2843 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.018444043s
I20260709 13:13:27.138212  2875 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39238
I20260709 13:13:27.198961  2875 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39240:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:27.203191  2875 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:27.324784  3043 tablet_service.cc:1511] Processing CreateTablet for tablet 83ec256629ea4d6e897bb86ac0e5edf9 (DEFAULT_TABLE table=test-workload [id=2448a4d0619744c1915b86ab20f79f75]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:27.326051  3040 tablet_service.cc:1511] Processing CreateTablet for tablet 25b690c4505a418ea5cc5872d5f3c024 (DEFAULT_TABLE table=test-workload [id=2448a4d0619744c1915b86ab20f79f75]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:27.327082  3043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83ec256629ea4d6e897bb86ac0e5edf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.329152  3041 tablet_service.cc:1511] Processing CreateTablet for tablet 444aad91fdd848f4bfa98cb2169fead6 (DEFAULT_TABLE table=test-workload [id=2448a4d0619744c1915b86ab20f79f75]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:27.329222  3039 tablet_service.cc:1511] Processing CreateTablet for tablet b986642580bd45599def5ca69a30b340 (DEFAULT_TABLE table=test-workload [id=2448a4d0619744c1915b86ab20f79f75]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:27.330768  3042 tablet_service.cc:1511] Processing CreateTablet for tablet b058a362644348f9bc4f6b34dd84a2f6 (DEFAULT_TABLE table=test-workload [id=2448a4d0619744c1915b86ab20f79f75]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:27.331735  3038 tablet_service.cc:1511] Processing CreateTablet for tablet ace31b01377e4d8c8cd691d1cca7212c (DEFAULT_TABLE table=test-workload [id=2448a4d0619744c1915b86ab20f79f75]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:27.335983  3042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b058a362644348f9bc4f6b34dd84a2f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.337653  3038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ace31b01377e4d8c8cd691d1cca7212c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.338779  3037 tablet_service.cc:1511] Processing CreateTablet for tablet f20668f7380e4e87a6ae970612dd3a20 (DEFAULT_TABLE table=test-workload [id=2448a4d0619744c1915b86ab20f79f75]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:27.340385  3037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f20668f7380e4e87a6ae970612dd3a20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.344012  3039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b986642580bd45599def5ca69a30b340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.347003  3036 tablet_service.cc:1511] Processing CreateTablet for tablet 1bd75affab0f45fe8e66f22aa2142a9b (DEFAULT_TABLE table=test-workload [id=2448a4d0619744c1915b86ab20f79f75]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:27.348626  3036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bd75affab0f45fe8e66f22aa2142a9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.353175  3035 tablet_service.cc:1511] Processing CreateTablet for tablet c1b86f88c52644e9abd09601beab6e58 (DEFAULT_TABLE table=test-workload [id=2448a4d0619744c1915b86ab20f79f75]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:27.354992  3035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1b86f88c52644e9abd09601beab6e58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.355957  3041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 444aad91fdd848f4bfa98cb2169fead6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.359943  3040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25b690c4505a418ea5cc5872d5f3c024. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:13:27.373565  2923 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:27.381130  3116 tablet_service.cc:1511] Processing CreateTablet for tablet b058a362644348f9bc4f6b34dd84a2f6 (DEFAULT_TABLE table=test-workload [id=2448a4d0619744c1915b86ab20f79f75]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:27.382748  3116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b058a362644348f9bc4f6b34dd84a2f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.385011  3115 tablet_service.cc:1511] Processing CreateTablet for tablet 444aad91fdd848f4bfa98cb2169fead6 (DEFAULT_TABLE table=test-workload [id=2448a4d0619744c1915b86ab20f79f75]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:27.378993  3117 tablet_service.cc:1511] Processing CreateTablet for tablet 83ec256629ea4d6e897bb86ac0e5edf9 (DEFAULT_TABLE table=test-workload [id=2448a4d0619744c1915b86ab20f79f75]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:27.388576  3170 tablet_bootstrap.cc:492] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d: Bootstrap starting.
I20260709 13:13:27.395483  3111 tablet_service.cc:1511] Processing CreateTablet for tablet f20668f7380e4e87a6ae970612dd3a20 (DEFAULT_TABLE table=test-workload [id=2448a4d0619744c1915b86ab20f79f75]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:27.404781  3110 tablet_service.cc:1511] Processing CreateTablet for tablet 1bd75affab0f45fe8e66f22aa2142a9b (DEFAULT_TABLE table=test-workload [id=2448a4d0619744c1915b86ab20f79f75]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:27.406549  3115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 444aad91fdd848f4bfa98cb2169fead6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.406152  3114 tablet_service.cc:1511] Processing CreateTablet for tablet 25b690c4505a418ea5cc5872d5f3c024 (DEFAULT_TABLE table=test-workload [id=2448a4d0619744c1915b86ab20f79f75]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:27.416931  3117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83ec256629ea4d6e897bb86ac0e5edf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.401774  3112 tablet_service.cc:1511] Processing CreateTablet for tablet ace31b01377e4d8c8cd691d1cca7212c (DEFAULT_TABLE table=test-workload [id=2448a4d0619744c1915b86ab20f79f75]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:27.423439  3109 tablet_service.cc:1511] Processing CreateTablet for tablet c1b86f88c52644e9abd09601beab6e58 (DEFAULT_TABLE table=test-workload [id=2448a4d0619744c1915b86ab20f79f75]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:27.419806  3113 tablet_service.cc:1511] Processing CreateTablet for tablet b986642580bd45599def5ca69a30b340 (DEFAULT_TABLE table=test-workload [id=2448a4d0619744c1915b86ab20f79f75]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:27.427935  3110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bd75affab0f45fe8e66f22aa2142a9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.440167  3112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ace31b01377e4d8c8cd691d1cca7212c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.431702  2968 tablet_service.cc:1511] Processing CreateTablet for tablet 83ec256629ea4d6e897bb86ac0e5edf9 (DEFAULT_TABLE table=test-workload [id=2448a4d0619744c1915b86ab20f79f75]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:27.437692  2965 tablet_service.cc:1511] Processing CreateTablet for tablet 25b690c4505a418ea5cc5872d5f3c024 (DEFAULT_TABLE table=test-workload [id=2448a4d0619744c1915b86ab20f79f75]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:27.456873  2965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25b690c4505a418ea5cc5872d5f3c024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.441695  2967 tablet_service.cc:1511] Processing CreateTablet for tablet b058a362644348f9bc4f6b34dd84a2f6 (DEFAULT_TABLE table=test-workload [id=2448a4d0619744c1915b86ab20f79f75]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:27.458143  2964 tablet_service.cc:1511] Processing CreateTablet for tablet b986642580bd45599def5ca69a30b340 (DEFAULT_TABLE table=test-workload [id=2448a4d0619744c1915b86ab20f79f75]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:27.453815  3111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f20668f7380e4e87a6ae970612dd3a20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.439303  2966 tablet_service.cc:1511] Processing CreateTablet for tablet 444aad91fdd848f4bfa98cb2169fead6 (DEFAULT_TABLE table=test-workload [id=2448a4d0619744c1915b86ab20f79f75]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:27.454769  2963 tablet_service.cc:1511] Processing CreateTablet for tablet ace31b01377e4d8c8cd691d1cca7212c (DEFAULT_TABLE table=test-workload [id=2448a4d0619744c1915b86ab20f79f75]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:27.463488  2967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b058a362644348f9bc4f6b34dd84a2f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.464128  2962 tablet_service.cc:1511] Processing CreateTablet for tablet f20668f7380e4e87a6ae970612dd3a20 (DEFAULT_TABLE table=test-workload [id=2448a4d0619744c1915b86ab20f79f75]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:27.472427  2961 tablet_service.cc:1511] Processing CreateTablet for tablet 1bd75affab0f45fe8e66f22aa2142a9b (DEFAULT_TABLE table=test-workload [id=2448a4d0619744c1915b86ab20f79f75]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:27.480556  2968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83ec256629ea4d6e897bb86ac0e5edf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.483570  2960 tablet_service.cc:1511] Processing CreateTablet for tablet c1b86f88c52644e9abd09601beab6e58 (DEFAULT_TABLE table=test-workload [id=2448a4d0619744c1915b86ab20f79f75]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:27.483568  2962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f20668f7380e4e87a6ae970612dd3a20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.494868  2961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bd75affab0f45fe8e66f22aa2142a9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.489732  3109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1b86f88c52644e9abd09601beab6e58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.497736  3114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25b690c4505a418ea5cc5872d5f3c024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.499387  2960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1b86f88c52644e9abd09601beab6e58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.508035  2963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ace31b01377e4d8c8cd691d1cca7212c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.506693  3113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b986642580bd45599def5ca69a30b340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.526237  3170 tablet_bootstrap.cc:654] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:27.532821  2964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b986642580bd45599def5ca69a30b340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.544234  2966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 444aad91fdd848f4bfa98cb2169fead6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.638403  3170 tablet_bootstrap.cc:492] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d: No bootstrap required, opened a new log
I20260709 13:13:27.638967  3170 ts_tablet_manager.cc:1403] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d: Time spent bootstrapping tablet: real 0.252s	user 0.020s	sys 0.016s
I20260709 13:13:27.653421  3172 tablet_bootstrap.cc:492] T 83ec256629ea4d6e897bb86ac0e5edf9 P 43a7e3222d3940738dd6a4bc910c4493: Bootstrap starting.
I20260709 13:13:27.677078  3170 raft_consensus.cc:359] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:27.677966  3170 raft_consensus.cc:385] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:27.678296  3170 raft_consensus.cc:740] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7007c802f3424951bd47a1d364907f0d, State: Initialized, Role: FOLLOWER
I20260709 13:13:27.679946  3170 consensus_queue.cc:260] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:27.694072  3173 tablet_bootstrap.cc:492] T b058a362644348f9bc4f6b34dd84a2f6 P 59527545ee964f0389247722525b5134: Bootstrap starting.
I20260709 13:13:27.698836  3078 heartbeater.cc:499] Master 127.2.198.254:46137 was elected leader, sending a full tablet report...
I20260709 13:13:27.709628  3170 ts_tablet_manager.cc:1434] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d: Time spent starting tablet: real 0.070s	user 0.003s	sys 0.018s
I20260709 13:13:27.710719  3170 tablet_bootstrap.cc:492] T ace31b01377e4d8c8cd691d1cca7212c P 7007c802f3424951bd47a1d364907f0d: Bootstrap starting.
I20260709 13:13:27.712461  3172 tablet_bootstrap.cc:654] T 83ec256629ea4d6e897bb86ac0e5edf9 P 43a7e3222d3940738dd6a4bc910c4493: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:27.715505  3173 tablet_bootstrap.cc:654] T b058a362644348f9bc4f6b34dd84a2f6 P 59527545ee964f0389247722525b5134: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:27.721176  3170 tablet_bootstrap.cc:654] T ace31b01377e4d8c8cd691d1cca7212c P 7007c802f3424951bd47a1d364907f0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:27.735406  3173 tablet_bootstrap.cc:492] T b058a362644348f9bc4f6b34dd84a2f6 P 59527545ee964f0389247722525b5134: No bootstrap required, opened a new log
I20260709 13:13:27.736119  3173 ts_tablet_manager.cc:1403] T b058a362644348f9bc4f6b34dd84a2f6 P 59527545ee964f0389247722525b5134: Time spent bootstrapping tablet: real 0.044s	user 0.012s	sys 0.011s
I20260709 13:13:27.740830  3173 raft_consensus.cc:359] T b058a362644348f9bc4f6b34dd84a2f6 P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:27.741887  3173 raft_consensus.cc:385] T b058a362644348f9bc4f6b34dd84a2f6 P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:27.742264  3173 raft_consensus.cc:740] T b058a362644348f9bc4f6b34dd84a2f6 P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59527545ee964f0389247722525b5134, State: Initialized, Role: FOLLOWER
I20260709 13:13:27.743222  3173 consensus_queue.cc:260] T b058a362644348f9bc4f6b34dd84a2f6 P 59527545ee964f0389247722525b5134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:27.747622  3170 tablet_bootstrap.cc:492] T ace31b01377e4d8c8cd691d1cca7212c P 7007c802f3424951bd47a1d364907f0d: No bootstrap required, opened a new log
I20260709 13:13:27.748303  3170 ts_tablet_manager.cc:1403] T ace31b01377e4d8c8cd691d1cca7212c P 7007c802f3424951bd47a1d364907f0d: Time spent bootstrapping tablet: real 0.038s	user 0.017s	sys 0.013s
I20260709 13:13:27.752770  3170 raft_consensus.cc:359] T ace31b01377e4d8c8cd691d1cca7212c P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:27.753880  3170 raft_consensus.cc:385] T ace31b01377e4d8c8cd691d1cca7212c P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:27.754359  3170 raft_consensus.cc:740] T ace31b01377e4d8c8cd691d1cca7212c P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7007c802f3424951bd47a1d364907f0d, State: Initialized, Role: FOLLOWER
I20260709 13:13:27.755750  3172 tablet_bootstrap.cc:492] T 83ec256629ea4d6e897bb86ac0e5edf9 P 43a7e3222d3940738dd6a4bc910c4493: No bootstrap required, opened a new log
I20260709 13:13:27.755434  3170 consensus_queue.cc:260] T ace31b01377e4d8c8cd691d1cca7212c P 7007c802f3424951bd47a1d364907f0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:27.756850  3172 ts_tablet_manager.cc:1403] T 83ec256629ea4d6e897bb86ac0e5edf9 P 43a7e3222d3940738dd6a4bc910c4493: Time spent bootstrapping tablet: real 0.105s	user 0.015s	sys 0.007s
I20260709 13:13:27.758966  3170 ts_tablet_manager.cc:1434] T ace31b01377e4d8c8cd691d1cca7212c P 7007c802f3424951bd47a1d364907f0d: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.002s
I20260709 13:13:27.760550  3170 tablet_bootstrap.cc:492] T c1b86f88c52644e9abd09601beab6e58 P 7007c802f3424951bd47a1d364907f0d: Bootstrap starting.
I20260709 13:13:27.770473  3170 tablet_bootstrap.cc:654] T c1b86f88c52644e9abd09601beab6e58 P 7007c802f3424951bd47a1d364907f0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:27.770432  3003 heartbeater.cc:499] Master 127.2.198.254:46137 was elected leader, sending a full tablet report...
I20260709 13:13:27.772436  3172 raft_consensus.cc:359] T 83ec256629ea4d6e897bb86ac0e5edf9 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } } peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } }
I20260709 13:13:27.773283  3172 raft_consensus.cc:385] T 83ec256629ea4d6e897bb86ac0e5edf9 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:27.773666  3172 raft_consensus.cc:740] T 83ec256629ea4d6e897bb86ac0e5edf9 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43a7e3222d3940738dd6a4bc910c4493, State: Initialized, Role: FOLLOWER
I20260709 13:13:27.774523  3172 consensus_queue.cc:260] T 83ec256629ea4d6e897bb86ac0e5edf9 P 43a7e3222d3940738dd6a4bc910c4493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } } peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } }
I20260709 13:13:27.794279  3173 ts_tablet_manager.cc:1434] T b058a362644348f9bc4f6b34dd84a2f6 P 59527545ee964f0389247722525b5134: Time spent starting tablet: real 0.058s	user 0.014s	sys 0.035s
I20260709 13:13:27.794538  3152 heartbeater.cc:499] Master 127.2.198.254:46137 was elected leader, sending a full tablet report...
I20260709 13:13:27.795640  3172 ts_tablet_manager.cc:1434] T 83ec256629ea4d6e897bb86ac0e5edf9 P 43a7e3222d3940738dd6a4bc910c4493: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.001s
I20260709 13:13:27.796767  3173 tablet_bootstrap.cc:492] T 1bd75affab0f45fe8e66f22aa2142a9b P 59527545ee964f0389247722525b5134: Bootstrap starting.
I20260709 13:13:27.798573  3172 tablet_bootstrap.cc:492] T 1bd75affab0f45fe8e66f22aa2142a9b P 43a7e3222d3940738dd6a4bc910c4493: Bootstrap starting.
I20260709 13:13:27.802675  3170 tablet_bootstrap.cc:492] T c1b86f88c52644e9abd09601beab6e58 P 7007c802f3424951bd47a1d364907f0d: No bootstrap required, opened a new log
I20260709 13:13:27.803251  3170 ts_tablet_manager.cc:1403] T c1b86f88c52644e9abd09601beab6e58 P 7007c802f3424951bd47a1d364907f0d: Time spent bootstrapping tablet: real 0.043s	user 0.018s	sys 0.019s
I20260709 13:13:27.804991  3173 tablet_bootstrap.cc:654] T 1bd75affab0f45fe8e66f22aa2142a9b P 59527545ee964f0389247722525b5134: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:27.806066  3172 tablet_bootstrap.cc:654] T 1bd75affab0f45fe8e66f22aa2142a9b P 43a7e3222d3940738dd6a4bc910c4493: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:27.806702  3170 raft_consensus.cc:359] T c1b86f88c52644e9abd09601beab6e58 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:27.807559  3170 raft_consensus.cc:385] T c1b86f88c52644e9abd09601beab6e58 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:27.807881  3170 raft_consensus.cc:740] T c1b86f88c52644e9abd09601beab6e58 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7007c802f3424951bd47a1d364907f0d, State: Initialized, Role: FOLLOWER
I20260709 13:13:27.808862  3170 consensus_queue.cc:260] T c1b86f88c52644e9abd09601beab6e58 P 7007c802f3424951bd47a1d364907f0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:27.812227  3170 ts_tablet_manager.cc:1434] T c1b86f88c52644e9abd09601beab6e58 P 7007c802f3424951bd47a1d364907f0d: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:13:27.813555  3170 tablet_bootstrap.cc:492] T b058a362644348f9bc4f6b34dd84a2f6 P 7007c802f3424951bd47a1d364907f0d: Bootstrap starting.
I20260709 13:13:27.817404  3173 tablet_bootstrap.cc:492] T 1bd75affab0f45fe8e66f22aa2142a9b P 59527545ee964f0389247722525b5134: No bootstrap required, opened a new log
I20260709 13:13:27.817998  3173 ts_tablet_manager.cc:1403] T 1bd75affab0f45fe8e66f22aa2142a9b P 59527545ee964f0389247722525b5134: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.004s
I20260709 13:13:27.821871  3170 tablet_bootstrap.cc:654] T b058a362644348f9bc4f6b34dd84a2f6 P 7007c802f3424951bd47a1d364907f0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:27.822132  3173 raft_consensus.cc:359] T 1bd75affab0f45fe8e66f22aa2142a9b P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:27.822942  3173 raft_consensus.cc:385] T 1bd75affab0f45fe8e66f22aa2142a9b P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:27.823262  3173 raft_consensus.cc:740] T 1bd75affab0f45fe8e66f22aa2142a9b P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59527545ee964f0389247722525b5134, State: Initialized, Role: FOLLOWER
I20260709 13:13:27.824008  3173 consensus_queue.cc:260] T 1bd75affab0f45fe8e66f22aa2142a9b P 59527545ee964f0389247722525b5134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:27.826586  3173 ts_tablet_manager.cc:1434] T 1bd75affab0f45fe8e66f22aa2142a9b P 59527545ee964f0389247722525b5134: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:13:27.827664  3173 tablet_bootstrap.cc:492] T ace31b01377e4d8c8cd691d1cca7212c P 59527545ee964f0389247722525b5134: Bootstrap starting.
I20260709 13:13:27.838346  3173 tablet_bootstrap.cc:654] T ace31b01377e4d8c8cd691d1cca7212c P 59527545ee964f0389247722525b5134: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:27.847209  3173 tablet_bootstrap.cc:492] T ace31b01377e4d8c8cd691d1cca7212c P 59527545ee964f0389247722525b5134: No bootstrap required, opened a new log
I20260709 13:13:27.847812  3173 ts_tablet_manager.cc:1403] T ace31b01377e4d8c8cd691d1cca7212c P 59527545ee964f0389247722525b5134: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.002s
I20260709 13:13:27.848474  3172 tablet_bootstrap.cc:492] T 1bd75affab0f45fe8e66f22aa2142a9b P 43a7e3222d3940738dd6a4bc910c4493: No bootstrap required, opened a new log
I20260709 13:13:27.848963  3172 ts_tablet_manager.cc:1403] T 1bd75affab0f45fe8e66f22aa2142a9b P 43a7e3222d3940738dd6a4bc910c4493: Time spent bootstrapping tablet: real 0.051s	user 0.010s	sys 0.004s
I20260709 13:13:27.845726  3170 tablet_bootstrap.cc:492] T b058a362644348f9bc4f6b34dd84a2f6 P 7007c802f3424951bd47a1d364907f0d: No bootstrap required, opened a new log
I20260709 13:13:27.850764  3170 ts_tablet_manager.cc:1403] T b058a362644348f9bc4f6b34dd84a2f6 P 7007c802f3424951bd47a1d364907f0d: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.011s
I20260709 13:13:27.851102  3173 raft_consensus.cc:359] T ace31b01377e4d8c8cd691d1cca7212c P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:27.852137  3173 raft_consensus.cc:385] T ace31b01377e4d8c8cd691d1cca7212c P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:27.851873  3172 raft_consensus.cc:359] T 1bd75affab0f45fe8e66f22aa2142a9b P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:27.852478  3173 raft_consensus.cc:740] T ace31b01377e4d8c8cd691d1cca7212c P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59527545ee964f0389247722525b5134, State: Initialized, Role: FOLLOWER
I20260709 13:13:27.852612  3172 raft_consensus.cc:385] T 1bd75affab0f45fe8e66f22aa2142a9b P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:27.852978  3172 raft_consensus.cc:740] T 1bd75affab0f45fe8e66f22aa2142a9b P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43a7e3222d3940738dd6a4bc910c4493, State: Initialized, Role: FOLLOWER
I20260709 13:13:27.853456  3173 consensus_queue.cc:260] T ace31b01377e4d8c8cd691d1cca7212c P 59527545ee964f0389247722525b5134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:27.853783  3172 consensus_queue.cc:260] T 1bd75affab0f45fe8e66f22aa2142a9b P 43a7e3222d3940738dd6a4bc910c4493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:27.854364  3170 raft_consensus.cc:359] T b058a362644348f9bc4f6b34dd84a2f6 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:27.855170  3170 raft_consensus.cc:385] T b058a362644348f9bc4f6b34dd84a2f6 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:27.855485  3170 raft_consensus.cc:740] T b058a362644348f9bc4f6b34dd84a2f6 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7007c802f3424951bd47a1d364907f0d, State: Initialized, Role: FOLLOWER
I20260709 13:13:27.856545  3173 ts_tablet_manager.cc:1434] T ace31b01377e4d8c8cd691d1cca7212c P 59527545ee964f0389247722525b5134: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:13:27.856289  3170 consensus_queue.cc:260] T b058a362644348f9bc4f6b34dd84a2f6 P 7007c802f3424951bd47a1d364907f0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:27.857635  3173 tablet_bootstrap.cc:492] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134: Bootstrap starting.
I20260709 13:13:27.860949  3178 raft_consensus.cc:493] T ace31b01377e4d8c8cd691d1cca7212c P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.861580  3178 raft_consensus.cc:515] T ace31b01377e4d8c8cd691d1cca7212c P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:27.863518  3170 ts_tablet_manager.cc:1434] T b058a362644348f9bc4f6b34dd84a2f6 P 7007c802f3424951bd47a1d364907f0d: Time spent starting tablet: real 0.012s	user 0.000s	sys 0.007s
I20260709 13:13:27.864612  3170 tablet_bootstrap.cc:492] T 83ec256629ea4d6e897bb86ac0e5edf9 P 7007c802f3424951bd47a1d364907f0d: Bootstrap starting.
W20260709 13:13:27.871569  3153 tablet.cc:2406] T 83ec256629ea4d6e897bb86ac0e5edf9 P 43a7e3222d3940738dd6a4bc910c4493: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:13:27.872558  3178 leader_election.cc:290] T ace31b01377e4d8c8cd691d1cca7212c P 59527545ee964f0389247722525b5134 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7007c802f3424951bd47a1d364907f0d (127.2.198.194:37497), 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195:34467)
I20260709 13:13:27.875222  3172 ts_tablet_manager.cc:1434] T 1bd75affab0f45fe8e66f22aa2142a9b P 43a7e3222d3940738dd6a4bc910c4493: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:13:27.880204  3174 raft_consensus.cc:493] T ace31b01377e4d8c8cd691d1cca7212c P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.880884  3174 raft_consensus.cc:515] T ace31b01377e4d8c8cd691d1cca7212c P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:27.882786  3172 tablet_bootstrap.cc:492] T ace31b01377e4d8c8cd691d1cca7212c P 43a7e3222d3940738dd6a4bc910c4493: Bootstrap starting.
I20260709 13:13:27.890177  3172 tablet_bootstrap.cc:654] T ace31b01377e4d8c8cd691d1cca7212c P 43a7e3222d3940738dd6a4bc910c4493: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:27.898450  3173 tablet_bootstrap.cc:654] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:27.900399  3174 leader_election.cc:290] T ace31b01377e4d8c8cd691d1cca7212c P 7007c802f3424951bd47a1d364907f0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59527545ee964f0389247722525b5134 (127.2.198.193:40443), 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195:34467)
I20260709 13:13:27.918174  3170 tablet_bootstrap.cc:654] T 83ec256629ea4d6e897bb86ac0e5edf9 P 7007c802f3424951bd47a1d364907f0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:27.941847  3053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace31b01377e4d8c8cd691d1cca7212c" candidate_uuid: "59527545ee964f0389247722525b5134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7007c802f3424951bd47a1d364907f0d" is_pre_election: true
I20260709 13:13:27.942899  3053 raft_consensus.cc:2468] T ace31b01377e4d8c8cd691d1cca7212c P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59527545ee964f0389247722525b5134 in term 0.
I20260709 13:13:27.949219  3173 tablet_bootstrap.cc:492] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134: No bootstrap required, opened a new log
I20260709 13:13:27.949862  3173 ts_tablet_manager.cc:1403] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134: Time spent bootstrapping tablet: real 0.092s	user 0.017s	sys 0.011s
I20260709 13:13:27.947952  2942 leader_election.cc:304] T ace31b01377e4d8c8cd691d1cca7212c P 59527545ee964f0389247722525b5134 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59527545ee964f0389247722525b5134, 7007c802f3424951bd47a1d364907f0d; no voters: 
I20260709 13:13:27.951592  3178 raft_consensus.cc:2804] T ace31b01377e4d8c8cd691d1cca7212c P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:27.951994  3178 raft_consensus.cc:493] T ace31b01377e4d8c8cd691d1cca7212c P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:27.952364  3178 raft_consensus.cc:3060] T ace31b01377e4d8c8cd691d1cca7212c P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:27.956432  3180 raft_consensus.cc:493] T 1bd75affab0f45fe8e66f22aa2142a9b P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.957587  3180 raft_consensus.cc:515] T 1bd75affab0f45fe8e66f22aa2142a9b P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:27.962082  3172 tablet_bootstrap.cc:492] T ace31b01377e4d8c8cd691d1cca7212c P 43a7e3222d3940738dd6a4bc910c4493: No bootstrap required, opened a new log
I20260709 13:13:27.962122  3170 tablet_bootstrap.cc:492] T 83ec256629ea4d6e897bb86ac0e5edf9 P 7007c802f3424951bd47a1d364907f0d: No bootstrap required, opened a new log
I20260709 13:13:27.963027  3170 ts_tablet_manager.cc:1403] T 83ec256629ea4d6e897bb86ac0e5edf9 P 7007c802f3424951bd47a1d364907f0d: Time spent bootstrapping tablet: real 0.099s	user 0.016s	sys 0.002s
I20260709 13:13:27.963675  3172 ts_tablet_manager.cc:1403] T ace31b01377e4d8c8cd691d1cca7212c P 43a7e3222d3940738dd6a4bc910c4493: Time spent bootstrapping tablet: real 0.081s	user 0.022s	sys 0.009s
I20260709 13:13:27.971431  3180 leader_election.cc:290] T 1bd75affab0f45fe8e66f22aa2142a9b P 43a7e3222d3940738dd6a4bc910c4493 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59527545ee964f0389247722525b5134 (127.2.198.193:40443), 7007c802f3424951bd47a1d364907f0d (127.2.198.194:37497)
I20260709 13:13:27.981371  3173 raft_consensus.cc:359] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:27.984019  3173 raft_consensus.cc:385] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:27.986310  3173 raft_consensus.cc:740] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59527545ee964f0389247722525b5134, State: Initialized, Role: FOLLOWER
I20260709 13:13:27.988471  3172 raft_consensus.cc:359] T ace31b01377e4d8c8cd691d1cca7212c P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:27.995033  3173 consensus_queue.cc:260] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:27.993889  3172 raft_consensus.cc:385] T ace31b01377e4d8c8cd691d1cca7212c P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:27.997169  3172 raft_consensus.cc:740] T ace31b01377e4d8c8cd691d1cca7212c P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43a7e3222d3940738dd6a4bc910c4493, State: Initialized, Role: FOLLOWER
I20260709 13:13:27.999711  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace31b01377e4d8c8cd691d1cca7212c" candidate_uuid: "59527545ee964f0389247722525b5134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43a7e3222d3940738dd6a4bc910c4493" is_pre_election: true
I20260709 13:13:27.998606  3178 raft_consensus.cc:515] T ace31b01377e4d8c8cd691d1cca7212c P 59527545ee964f0389247722525b5134 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:27.999984  3172 consensus_queue.cc:260] T ace31b01377e4d8c8cd691d1cca7212c P 43a7e3222d3940738dd6a4bc910c4493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.004537  3178 leader_election.cc:290] T ace31b01377e4d8c8cd691d1cca7212c P 59527545ee964f0389247722525b5134 [CANDIDATE]: Term 1 election: Requested vote from peers 7007c802f3424951bd47a1d364907f0d (127.2.198.194:37497), 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195:34467)
I20260709 13:13:28.005028  3172 ts_tablet_manager.cc:1434] T ace31b01377e4d8c8cd691d1cca7212c P 43a7e3222d3940738dd6a4bc910c4493: Time spent starting tablet: real 0.034s	user 0.004s	sys 0.004s
I20260709 13:13:28.003041  3127 raft_consensus.cc:2468] T ace31b01377e4d8c8cd691d1cca7212c P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59527545ee964f0389247722525b5134 in term 0.
I20260709 13:13:28.009289  3172 tablet_bootstrap.cc:492] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493: Bootstrap starting.
I20260709 13:13:28.006758  2978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace31b01377e4d8c8cd691d1cca7212c" candidate_uuid: "7007c802f3424951bd47a1d364907f0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59527545ee964f0389247722525b5134" is_pre_election: true
I20260709 13:13:28.012486  3053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace31b01377e4d8c8cd691d1cca7212c" candidate_uuid: "59527545ee964f0389247722525b5134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7007c802f3424951bd47a1d364907f0d"
I20260709 13:13:28.013114  3053 raft_consensus.cc:3060] T ace31b01377e4d8c8cd691d1cca7212c P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:28.012713  2978 raft_consensus.cc:2393] T ace31b01377e4d8c8cd691d1cca7212c P 59527545ee964f0389247722525b5134 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7007c802f3424951bd47a1d364907f0d in current term 1: Already voted for candidate 59527545ee964f0389247722525b5134 in this term.
I20260709 13:13:28.014655  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace31b01377e4d8c8cd691d1cca7212c" candidate_uuid: "59527545ee964f0389247722525b5134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43a7e3222d3940738dd6a4bc910c4493"
I20260709 13:13:28.015934  3126 raft_consensus.cc:3060] T ace31b01377e4d8c8cd691d1cca7212c P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:28.017762  3170 raft_consensus.cc:359] T 83ec256629ea4d6e897bb86ac0e5edf9 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } } peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } }
I20260709 13:13:28.026958  3170 raft_consensus.cc:385] T 83ec256629ea4d6e897bb86ac0e5edf9 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:28.027287  3170 raft_consensus.cc:740] T 83ec256629ea4d6e897bb86ac0e5edf9 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7007c802f3424951bd47a1d364907f0d, State: Initialized, Role: FOLLOWER
I20260709 13:13:28.039660  3053 raft_consensus.cc:2468] T ace31b01377e4d8c8cd691d1cca7212c P 7007c802f3424951bd47a1d364907f0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59527545ee964f0389247722525b5134 in term 1.
I20260709 13:13:28.032860  3170 consensus_queue.cc:260] T 83ec256629ea4d6e897bb86ac0e5edf9 P 7007c802f3424951bd47a1d364907f0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } } peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } }
I20260709 13:13:28.047816  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace31b01377e4d8c8cd691d1cca7212c" candidate_uuid: "7007c802f3424951bd47a1d364907f0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43a7e3222d3940738dd6a4bc910c4493" is_pre_election: true
I20260709 13:13:28.047461  3052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bd75affab0f45fe8e66f22aa2142a9b" candidate_uuid: "43a7e3222d3940738dd6a4bc910c4493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7007c802f3424951bd47a1d364907f0d" is_pre_election: true
I20260709 13:13:28.051215  2942 leader_election.cc:304] T ace31b01377e4d8c8cd691d1cca7212c P 59527545ee964f0389247722525b5134 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59527545ee964f0389247722525b5134, 7007c802f3424951bd47a1d364907f0d; no voters: 
I20260709 13:13:28.051779  3170 ts_tablet_manager.cc:1434] T 83ec256629ea4d6e897bb86ac0e5edf9 P 7007c802f3424951bd47a1d364907f0d: Time spent starting tablet: real 0.088s	user 0.010s	sys 0.004s
I20260709 13:13:28.055265  3019 leader_election.cc:304] T ace31b01377e4d8c8cd691d1cca7212c P 7007c802f3424951bd47a1d364907f0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7007c802f3424951bd47a1d364907f0d; no voters: 43a7e3222d3940738dd6a4bc910c4493, 59527545ee964f0389247722525b5134
I20260709 13:13:28.056193  3174 raft_consensus.cc:2749] T ace31b01377e4d8c8cd691d1cca7212c P 7007c802f3424951bd47a1d364907f0d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:28.056421  3172 tablet_bootstrap.cc:654] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:28.056639  3198 raft_consensus.cc:2804] T ace31b01377e4d8c8cd691d1cca7212c P 59527545ee964f0389247722525b5134 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:28.057183  3198 raft_consensus.cc:697] T ace31b01377e4d8c8cd691d1cca7212c P 59527545ee964f0389247722525b5134 [term 1 LEADER]: Becoming Leader. State: Replica: 59527545ee964f0389247722525b5134, State: Running, Role: LEADER
I20260709 13:13:28.054629  3170 tablet_bootstrap.cc:492] T f20668f7380e4e87a6ae970612dd3a20 P 7007c802f3424951bd47a1d364907f0d: Bootstrap starting.
W20260709 13:13:28.059906  3091 leader_election.cc:343] T 1bd75affab0f45fe8e66f22aa2142a9b P 43a7e3222d3940738dd6a4bc910c4493 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7007c802f3424951bd47a1d364907f0d (127.2.198.194:37497): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:28.064239  3173 ts_tablet_manager.cc:1434] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134: Time spent starting tablet: real 0.114s	user 0.012s	sys 0.005s
I20260709 13:13:28.062768  3198 consensus_queue.cc:237] T ace31b01377e4d8c8cd691d1cca7212c P 59527545ee964f0389247722525b5134 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.073228  3126 raft_consensus.cc:2468] T ace31b01377e4d8c8cd691d1cca7212c P 43a7e3222d3940738dd6a4bc910c4493 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59527545ee964f0389247722525b5134 in term 1.
I20260709 13:13:28.072384  3173 tablet_bootstrap.cc:492] T b986642580bd45599def5ca69a30b340 P 59527545ee964f0389247722525b5134: Bootstrap starting.
I20260709 13:13:28.085920  3170 tablet_bootstrap.cc:654] T f20668f7380e4e87a6ae970612dd3a20 P 7007c802f3424951bd47a1d364907f0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:28.092394  3172 tablet_bootstrap.cc:492] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493: No bootstrap required, opened a new log
I20260709 13:13:28.093058  3172 ts_tablet_manager.cc:1403] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493: Time spent bootstrapping tablet: real 0.087s	user 0.012s	sys 0.014s
I20260709 13:13:28.093653  3170 tablet_bootstrap.cc:492] T f20668f7380e4e87a6ae970612dd3a20 P 7007c802f3424951bd47a1d364907f0d: No bootstrap required, opened a new log
I20260709 13:13:28.094159  3170 ts_tablet_manager.cc:1403] T f20668f7380e4e87a6ae970612dd3a20 P 7007c802f3424951bd47a1d364907f0d: Time spent bootstrapping tablet: real 0.041s	user 0.014s	sys 0.000s
I20260709 13:13:28.097182  3170 raft_consensus.cc:359] T f20668f7380e4e87a6ae970612dd3a20 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.097250  3172 raft_consensus.cc:359] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.098035  3170 raft_consensus.cc:385] T f20668f7380e4e87a6ae970612dd3a20 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:28.098276  3172 raft_consensus.cc:385] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:28.098398  3170 raft_consensus.cc:740] T f20668f7380e4e87a6ae970612dd3a20 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7007c802f3424951bd47a1d364907f0d, State: Initialized, Role: FOLLOWER
I20260709 13:13:28.098775  3172 raft_consensus.cc:740] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43a7e3222d3940738dd6a4bc910c4493, State: Initialized, Role: FOLLOWER
I20260709 13:13:28.100066  3173 tablet_bootstrap.cc:654] T b986642580bd45599def5ca69a30b340 P 59527545ee964f0389247722525b5134: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:28.099300  3170 consensus_queue.cc:260] T f20668f7380e4e87a6ae970612dd3a20 P 7007c802f3424951bd47a1d364907f0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.101032  2978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bd75affab0f45fe8e66f22aa2142a9b" candidate_uuid: "43a7e3222d3940738dd6a4bc910c4493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59527545ee964f0389247722525b5134" is_pre_election: true
I20260709 13:13:28.101794  2978 raft_consensus.cc:2468] T 1bd75affab0f45fe8e66f22aa2142a9b P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43a7e3222d3940738dd6a4bc910c4493 in term 0.
I20260709 13:13:28.103479  3092 leader_election.cc:304] T 1bd75affab0f45fe8e66f22aa2142a9b P 43a7e3222d3940738dd6a4bc910c4493 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43a7e3222d3940738dd6a4bc910c4493, 59527545ee964f0389247722525b5134; no voters: 7007c802f3424951bd47a1d364907f0d
I20260709 13:13:28.104547  3180 raft_consensus.cc:2804] T 1bd75affab0f45fe8e66f22aa2142a9b P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:28.105079  3180 raft_consensus.cc:493] T 1bd75affab0f45fe8e66f22aa2142a9b P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.104523  3172 consensus_queue.cc:260] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.105418  3180 raft_consensus.cc:3060] T 1bd75affab0f45fe8e66f22aa2142a9b P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:28.112123  3172 ts_tablet_manager.cc:1434] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493: Time spent starting tablet: real 0.019s	user 0.011s	sys 0.001s
I20260709 13:13:28.113097  3172 tablet_bootstrap.cc:492] T 444aad91fdd848f4bfa98cb2169fead6 P 43a7e3222d3940738dd6a4bc910c4493: Bootstrap starting.
I20260709 13:13:28.113384  3180 raft_consensus.cc:515] T 1bd75affab0f45fe8e66f22aa2142a9b P 43a7e3222d3940738dd6a4bc910c4493 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.115770  2875 catalog_manager.cc:5697] T ace31b01377e4d8c8cd691d1cca7212c P 59527545ee964f0389247722525b5134 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59527545ee964f0389247722525b5134 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "59527545ee964f0389247722525b5134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:28.116719  3052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bd75affab0f45fe8e66f22aa2142a9b" candidate_uuid: "43a7e3222d3940738dd6a4bc910c4493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7007c802f3424951bd47a1d364907f0d"
W20260709 13:13:28.118933  3091 leader_election.cc:343] T 1bd75affab0f45fe8e66f22aa2142a9b P 43a7e3222d3940738dd6a4bc910c4493 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7007c802f3424951bd47a1d364907f0d (127.2.198.194:37497): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:28.119781  3170 ts_tablet_manager.cc:1434] T f20668f7380e4e87a6ae970612dd3a20 P 7007c802f3424951bd47a1d364907f0d: Time spent starting tablet: real 0.025s	user 0.011s	sys 0.000s
I20260709 13:13:28.120937  3170 tablet_bootstrap.cc:492] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d: Bootstrap starting.
I20260709 13:13:28.124714  3173 tablet_bootstrap.cc:492] T b986642580bd45599def5ca69a30b340 P 59527545ee964f0389247722525b5134: No bootstrap required, opened a new log
I20260709 13:13:28.125272  3173 ts_tablet_manager.cc:1403] T b986642580bd45599def5ca69a30b340 P 59527545ee964f0389247722525b5134: Time spent bootstrapping tablet: real 0.058s	user 0.006s	sys 0.010s
I20260709 13:13:28.116622  2978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bd75affab0f45fe8e66f22aa2142a9b" candidate_uuid: "43a7e3222d3940738dd6a4bc910c4493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59527545ee964f0389247722525b5134"
I20260709 13:13:28.127677  3180 leader_election.cc:290] T 1bd75affab0f45fe8e66f22aa2142a9b P 43a7e3222d3940738dd6a4bc910c4493 [CANDIDATE]: Term 1 election: Requested vote from peers 59527545ee964f0389247722525b5134 (127.2.198.193:40443), 7007c802f3424951bd47a1d364907f0d (127.2.198.194:37497)
I20260709 13:13:28.128017  2978 raft_consensus.cc:3060] T 1bd75affab0f45fe8e66f22aa2142a9b P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:28.128583  3173 raft_consensus.cc:359] T b986642580bd45599def5ca69a30b340 P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.129375  3173 raft_consensus.cc:385] T b986642580bd45599def5ca69a30b340 P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:28.129695  3173 raft_consensus.cc:740] T b986642580bd45599def5ca69a30b340 P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59527545ee964f0389247722525b5134, State: Initialized, Role: FOLLOWER
I20260709 13:13:28.130477  3173 consensus_queue.cc:260] T b986642580bd45599def5ca69a30b340 P 59527545ee964f0389247722525b5134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.133459  3170 tablet_bootstrap.cc:654] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:28.133669  3172 tablet_bootstrap.cc:654] T 444aad91fdd848f4bfa98cb2169fead6 P 43a7e3222d3940738dd6a4bc910c4493: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:28.135717  3173 ts_tablet_manager.cc:1434] T b986642580bd45599def5ca69a30b340 P 59527545ee964f0389247722525b5134: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:13:28.137095  3173 tablet_bootstrap.cc:492] T c1b86f88c52644e9abd09601beab6e58 P 59527545ee964f0389247722525b5134: Bootstrap starting.
I20260709 13:13:28.137555  2978 raft_consensus.cc:2468] T 1bd75affab0f45fe8e66f22aa2142a9b P 59527545ee964f0389247722525b5134 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43a7e3222d3940738dd6a4bc910c4493 in term 1.
I20260709 13:13:28.139110  3092 leader_election.cc:304] T 1bd75affab0f45fe8e66f22aa2142a9b P 43a7e3222d3940738dd6a4bc910c4493 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43a7e3222d3940738dd6a4bc910c4493, 59527545ee964f0389247722525b5134; no voters: 7007c802f3424951bd47a1d364907f0d
I20260709 13:13:28.146018  3173 tablet_bootstrap.cc:654] T c1b86f88c52644e9abd09601beab6e58 P 59527545ee964f0389247722525b5134: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:28.148015  3203 raft_consensus.cc:2804] T 1bd75affab0f45fe8e66f22aa2142a9b P 43a7e3222d3940738dd6a4bc910c4493 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:28.148995  3203 raft_consensus.cc:697] T 1bd75affab0f45fe8e66f22aa2142a9b P 43a7e3222d3940738dd6a4bc910c4493 [term 1 LEADER]: Becoming Leader. State: Replica: 43a7e3222d3940738dd6a4bc910c4493, State: Running, Role: LEADER
I20260709 13:13:28.150774  3172 tablet_bootstrap.cc:492] T 444aad91fdd848f4bfa98cb2169fead6 P 43a7e3222d3940738dd6a4bc910c4493: No bootstrap required, opened a new log
I20260709 13:13:28.150090  3203 consensus_queue.cc:237] T 1bd75affab0f45fe8e66f22aa2142a9b P 43a7e3222d3940738dd6a4bc910c4493 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.151620  3172 ts_tablet_manager.cc:1403] T 444aad91fdd848f4bfa98cb2169fead6 P 43a7e3222d3940738dd6a4bc910c4493: Time spent bootstrapping tablet: real 0.039s	user 0.006s	sys 0.010s
I20260709 13:13:28.154425  3170 tablet_bootstrap.cc:492] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d: No bootstrap required, opened a new log
I20260709 13:13:28.155318  3170 ts_tablet_manager.cc:1403] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.001s
I20260709 13:13:28.156621  3172 raft_consensus.cc:359] T 444aad91fdd848f4bfa98cb2169fead6 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.157477  3172 raft_consensus.cc:385] T 444aad91fdd848f4bfa98cb2169fead6 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:28.157730  3180 raft_consensus.cc:493] T 83ec256629ea4d6e897bb86ac0e5edf9 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.157856  3172 raft_consensus.cc:740] T 444aad91fdd848f4bfa98cb2169fead6 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43a7e3222d3940738dd6a4bc910c4493, State: Initialized, Role: FOLLOWER
I20260709 13:13:28.158532  3180 raft_consensus.cc:515] T 83ec256629ea4d6e897bb86ac0e5edf9 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } } peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } }
I20260709 13:13:28.158859  3170 raft_consensus.cc:359] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.159667  3170 raft_consensus.cc:385] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:28.159233  3172 consensus_queue.cc:260] T 444aad91fdd848f4bfa98cb2169fead6 P 43a7e3222d3940738dd6a4bc910c4493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.159978  3170 raft_consensus.cc:740] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7007c802f3424951bd47a1d364907f0d, State: Initialized, Role: FOLLOWER
I20260709 13:13:28.160792  3170 consensus_queue.cc:260] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.162590  3052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ec256629ea4d6e897bb86ac0e5edf9" candidate_uuid: "43a7e3222d3940738dd6a4bc910c4493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7007c802f3424951bd47a1d364907f0d" is_pre_election: true
I20260709 13:13:28.163004  3180 leader_election.cc:290] T 83ec256629ea4d6e897bb86ac0e5edf9 P 43a7e3222d3940738dd6a4bc910c4493 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7007c802f3424951bd47a1d364907f0d (127.2.198.194:37497), 59527545ee964f0389247722525b5134 (127.2.198.193:40443)
I20260709 13:13:28.163281  3052 raft_consensus.cc:2468] T 83ec256629ea4d6e897bb86ac0e5edf9 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43a7e3222d3940738dd6a4bc910c4493 in term 0.
I20260709 13:13:28.164304  2978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ec256629ea4d6e897bb86ac0e5edf9" candidate_uuid: "43a7e3222d3940738dd6a4bc910c4493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59527545ee964f0389247722525b5134" is_pre_election: true
I20260709 13:13:28.164553  3091 leader_election.cc:304] T 83ec256629ea4d6e897bb86ac0e5edf9 P 43a7e3222d3940738dd6a4bc910c4493 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43a7e3222d3940738dd6a4bc910c4493, 7007c802f3424951bd47a1d364907f0d; no voters: 
W20260709 13:13:28.166069  3092 leader_election.cc:343] T 83ec256629ea4d6e897bb86ac0e5edf9 P 43a7e3222d3940738dd6a4bc910c4493 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59527545ee964f0389247722525b5134 (127.2.198.193:40443): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:28.166220  3180 raft_consensus.cc:2804] T 83ec256629ea4d6e897bb86ac0e5edf9 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:28.166749  3180 raft_consensus.cc:493] T 83ec256629ea4d6e897bb86ac0e5edf9 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.167152  3180 raft_consensus.cc:3060] T 83ec256629ea4d6e897bb86ac0e5edf9 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:28.167613  3170 ts_tablet_manager.cc:1434] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.003s
I20260709 13:13:28.168731  3170 tablet_bootstrap.cc:492] T 25b690c4505a418ea5cc5872d5f3c024 P 7007c802f3424951bd47a1d364907f0d: Bootstrap starting.
I20260709 13:13:28.172267  3174 raft_consensus.cc:493] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.172863  3174 raft_consensus.cc:515] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.176834  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b986642580bd45599def5ca69a30b340" candidate_uuid: "7007c802f3424951bd47a1d364907f0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43a7e3222d3940738dd6a4bc910c4493" is_pre_election: true
W20260709 13:13:28.178576  3019 leader_election.cc:343] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195:34467): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:28.179610  2978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b986642580bd45599def5ca69a30b340" candidate_uuid: "7007c802f3424951bd47a1d364907f0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59527545ee964f0389247722525b5134" is_pre_election: true
I20260709 13:13:28.180327  2978 raft_consensus.cc:2468] T b986642580bd45599def5ca69a30b340 P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7007c802f3424951bd47a1d364907f0d in term 0.
I20260709 13:13:28.181598  3174 leader_election.cc:290] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59527545ee964f0389247722525b5134 (127.2.198.193:40443), 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195:34467)
I20260709 13:13:28.183755  3018 leader_election.cc:304] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59527545ee964f0389247722525b5134, 7007c802f3424951bd47a1d364907f0d; no voters: 43a7e3222d3940738dd6a4bc910c4493
I20260709 13:13:28.184682  3174 raft_consensus.cc:2804] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:28.184947  3170 tablet_bootstrap.cc:654] T 25b690c4505a418ea5cc5872d5f3c024 P 7007c802f3424951bd47a1d364907f0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:28.185078  3174 raft_consensus.cc:493] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.185451  3174 raft_consensus.cc:3060] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:28.185801  3172 ts_tablet_manager.cc:1434] T 444aad91fdd848f4bfa98cb2169fead6 P 43a7e3222d3940738dd6a4bc910c4493: Time spent starting tablet: real 0.033s	user 0.002s	sys 0.009s
I20260709 13:13:28.186936  3172 tablet_bootstrap.cc:492] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493: Bootstrap starting.
I20260709 13:13:28.193389  3174 raft_consensus.cc:515] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.197111  3172 tablet_bootstrap.cc:654] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:28.197428  2873 catalog_manager.cc:5697] T 1bd75affab0f45fe8e66f22aa2142a9b P 43a7e3222d3940738dd6a4bc910c4493 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195). New cstate: current_term: 1 leader_uuid: "43a7e3222d3940738dd6a4bc910c4493" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:28.200011  2978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b986642580bd45599def5ca69a30b340" candidate_uuid: "7007c802f3424951bd47a1d364907f0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59527545ee964f0389247722525b5134"
I20260709 13:13:28.200645  2978 raft_consensus.cc:3060] T b986642580bd45599def5ca69a30b340 P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:28.198693  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b986642580bd45599def5ca69a30b340" candidate_uuid: "7007c802f3424951bd47a1d364907f0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43a7e3222d3940738dd6a4bc910c4493"
W20260709 13:13:28.209112  3019 leader_election.cc:343] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195:34467): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:28.195251  3180 raft_consensus.cc:515] T 83ec256629ea4d6e897bb86ac0e5edf9 P 43a7e3222d3940738dd6a4bc910c4493 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } } peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } }
I20260709 13:13:28.210383  3209 raft_consensus.cc:493] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.210887  3209 raft_consensus.cc:515] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.211905  2978 raft_consensus.cc:2468] T b986642580bd45599def5ca69a30b340 P 59527545ee964f0389247722525b5134 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7007c802f3424951bd47a1d364907f0d in term 1.
I20260709 13:13:28.213109  3180 leader_election.cc:290] T 83ec256629ea4d6e897bb86ac0e5edf9 P 43a7e3222d3940738dd6a4bc910c4493 [CANDIDATE]: Term 1 election: Requested vote from peers 7007c802f3424951bd47a1d364907f0d (127.2.198.194:37497), 59527545ee964f0389247722525b5134 (127.2.198.193:40443)
I20260709 13:13:28.213440  3209 leader_election.cc:290] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59527545ee964f0389247722525b5134 (127.2.198.193:40443), 7007c802f3424951bd47a1d364907f0d (127.2.198.194:37497)
I20260709 13:13:28.199175  3174 leader_election.cc:290] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d [CANDIDATE]: Term 1 election: Requested vote from peers 59527545ee964f0389247722525b5134 (127.2.198.193:40443), 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195:34467)
I20260709 13:13:28.214398  3052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ec256629ea4d6e897bb86ac0e5edf9" candidate_uuid: "43a7e3222d3940738dd6a4bc910c4493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7007c802f3424951bd47a1d364907f0d"
I20260709 13:13:28.214552  3174 raft_consensus.cc:493] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.214998  3052 raft_consensus.cc:3060] T 83ec256629ea4d6e897bb86ac0e5edf9 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:28.215022  3174 raft_consensus.cc:515] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.217813  3174 leader_election.cc:290] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59527545ee964f0389247722525b5134 (127.2.198.193:40443), 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195:34467)
I20260709 13:13:28.221494  2977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ec256629ea4d6e897bb86ac0e5edf9" candidate_uuid: "43a7e3222d3940738dd6a4bc910c4493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59527545ee964f0389247722525b5134"
I20260709 13:13:28.223177  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444aad91fdd848f4bfa98cb2169fead6" candidate_uuid: "7007c802f3424951bd47a1d364907f0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43a7e3222d3940738dd6a4bc910c4493" is_pre_election: true
I20260709 13:13:28.223836  3126 raft_consensus.cc:2468] T 444aad91fdd848f4bfa98cb2169fead6 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7007c802f3424951bd47a1d364907f0d in term 0.
I20260709 13:13:28.225687  3170 tablet_bootstrap.cc:492] T 25b690c4505a418ea5cc5872d5f3c024 P 7007c802f3424951bd47a1d364907f0d: No bootstrap required, opened a new log
I20260709 13:13:28.226162  3170 ts_tablet_manager.cc:1403] T 25b690c4505a418ea5cc5872d5f3c024 P 7007c802f3424951bd47a1d364907f0d: Time spent bootstrapping tablet: real 0.058s	user 0.009s	sys 0.004s
I20260709 13:13:28.227592  3053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b058a362644348f9bc4f6b34dd84a2f6" candidate_uuid: "43a7e3222d3940738dd6a4bc910c4493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7007c802f3424951bd47a1d364907f0d" is_pre_election: true
I20260709 13:13:28.228709  3053 raft_consensus.cc:2468] T b058a362644348f9bc4f6b34dd84a2f6 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43a7e3222d3940738dd6a4bc910c4493 in term 0.
W20260709 13:13:28.229413  3092 leader_election.cc:343] T 83ec256629ea4d6e897bb86ac0e5edf9 P 43a7e3222d3940738dd6a4bc910c4493 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 59527545ee964f0389247722525b5134 (127.2.198.193:40443): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:28.227682  3019 leader_election.cc:304] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43a7e3222d3940738dd6a4bc910c4493, 7007c802f3424951bd47a1d364907f0d; no voters: 
I20260709 13:13:28.230042  3170 raft_consensus.cc:359] T 25b690c4505a418ea5cc5872d5f3c024 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.230786  3170 raft_consensus.cc:385] T 25b690c4505a418ea5cc5872d5f3c024 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:28.230816  3091 leader_election.cc:304] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43a7e3222d3940738dd6a4bc910c4493, 7007c802f3424951bd47a1d364907f0d; no voters: 
I20260709 13:13:28.221201  2978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b058a362644348f9bc4f6b34dd84a2f6" candidate_uuid: "43a7e3222d3940738dd6a4bc910c4493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59527545ee964f0389247722525b5134" is_pre_election: true
I20260709 13:13:28.231218  3170 raft_consensus.cc:740] T 25b690c4505a418ea5cc5872d5f3c024 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7007c802f3424951bd47a1d364907f0d, State: Initialized, Role: FOLLOWER
I20260709 13:13:28.232411  3174 raft_consensus.cc:2804] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:28.233090  3174 raft_consensus.cc:493] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.233444  3174 raft_consensus.cc:3060] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:28.233232  3170 consensus_queue.cc:260] T 25b690c4505a418ea5cc5872d5f3c024 P 7007c802f3424951bd47a1d364907f0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.234227  3180 raft_consensus.cc:2804] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:28.235194  3180 raft_consensus.cc:493] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.235595  3180 raft_consensus.cc:3060] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:28.237041  2978 raft_consensus.cc:2468] T b058a362644348f9bc4f6b34dd84a2f6 P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43a7e3222d3940738dd6a4bc910c4493 in term 0.
I20260709 13:13:28.240852  3173 tablet_bootstrap.cc:492] T c1b86f88c52644e9abd09601beab6e58 P 59527545ee964f0389247722525b5134: No bootstrap required, opened a new log
I20260709 13:13:28.241480  3198 raft_consensus.cc:493] T b058a362644348f9bc4f6b34dd84a2f6 P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.243844  3198 raft_consensus.cc:515] T b058a362644348f9bc4f6b34dd84a2f6 P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.245021  3052 raft_consensus.cc:2468] T 83ec256629ea4d6e897bb86ac0e5edf9 P 7007c802f3424951bd47a1d364907f0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43a7e3222d3940738dd6a4bc910c4493 in term 1.
I20260709 13:13:28.247769  3170 ts_tablet_manager.cc:1434] T 25b690c4505a418ea5cc5872d5f3c024 P 7007c802f3424951bd47a1d364907f0d: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.001s
I20260709 13:13:28.246685  3091 leader_election.cc:304] T 83ec256629ea4d6e897bb86ac0e5edf9 P 43a7e3222d3940738dd6a4bc910c4493 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43a7e3222d3940738dd6a4bc910c4493, 7007c802f3424951bd47a1d364907f0d; no voters: 59527545ee964f0389247722525b5134
I20260709 13:13:28.249886  3170 tablet_bootstrap.cc:492] T 1bd75affab0f45fe8e66f22aa2142a9b P 7007c802f3424951bd47a1d364907f0d: Bootstrap starting.
I20260709 13:13:28.250113  3209 raft_consensus.cc:2804] T 83ec256629ea4d6e897bb86ac0e5edf9 P 43a7e3222d3940738dd6a4bc910c4493 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:28.250592  3209 raft_consensus.cc:697] T 83ec256629ea4d6e897bb86ac0e5edf9 P 43a7e3222d3940738dd6a4bc910c4493 [term 1 LEADER]: Becoming Leader. State: Replica: 43a7e3222d3940738dd6a4bc910c4493, State: Running, Role: LEADER
I20260709 13:13:28.251425  3209 consensus_queue.cc:237] T 83ec256629ea4d6e897bb86ac0e5edf9 P 43a7e3222d3940738dd6a4bc910c4493 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } } peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } }
I20260709 13:13:28.248799  3173 ts_tablet_manager.cc:1403] T c1b86f88c52644e9abd09601beab6e58 P 59527545ee964f0389247722525b5134: Time spent bootstrapping tablet: real 0.110s	user 0.017s	sys 0.016s
I20260709 13:13:28.258167  3198 leader_election.cc:290] T b058a362644348f9bc4f6b34dd84a2f6 P 59527545ee964f0389247722525b5134 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7007c802f3424951bd47a1d364907f0d (127.2.198.194:37497), 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195:34467)
I20260709 13:13:28.261943  3172 tablet_bootstrap.cc:492] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493: No bootstrap required, opened a new log
I20260709 13:13:28.262506  3172 ts_tablet_manager.cc:1403] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493: Time spent bootstrapping tablet: real 0.076s	user 0.017s	sys 0.008s
I20260709 13:13:28.263047  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b058a362644348f9bc4f6b34dd84a2f6" candidate_uuid: "59527545ee964f0389247722525b5134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43a7e3222d3940738dd6a4bc910c4493" is_pre_election: true
I20260709 13:13:28.264117  3198 raft_consensus.cc:493] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.264678  3198 raft_consensus.cc:515] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.262493  3173 raft_consensus.cc:359] T c1b86f88c52644e9abd09601beab6e58 P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.266556  3173 raft_consensus.cc:385] T c1b86f88c52644e9abd09601beab6e58 P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:28.266386  3172 raft_consensus.cc:359] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.266921  3173 raft_consensus.cc:740] T c1b86f88c52644e9abd09601beab6e58 P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59527545ee964f0389247722525b5134, State: Initialized, Role: FOLLOWER
I20260709 13:13:28.267186  3172 raft_consensus.cc:385] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:28.267820  3198 leader_election.cc:290] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7007c802f3424951bd47a1d364907f0d (127.2.198.194:37497), 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195:34467)
I20260709 13:13:28.267716  3053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444aad91fdd848f4bfa98cb2169fead6" candidate_uuid: "59527545ee964f0389247722525b5134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7007c802f3424951bd47a1d364907f0d" is_pre_election: true
I20260709 13:13:28.268064  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444aad91fdd848f4bfa98cb2169fead6" candidate_uuid: "59527545ee964f0389247722525b5134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43a7e3222d3940738dd6a4bc910c4493" is_pre_election: true
I20260709 13:13:28.259735  3018 leader_election.cc:304] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59527545ee964f0389247722525b5134, 7007c802f3424951bd47a1d364907f0d; no voters: 43a7e3222d3940738dd6a4bc910c4493
I20260709 13:13:28.267997  3173 consensus_queue.cc:260] T c1b86f88c52644e9abd09601beab6e58 P 59527545ee964f0389247722525b5134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.269966  3127 raft_consensus.cc:2468] T 444aad91fdd848f4bfa98cb2169fead6 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59527545ee964f0389247722525b5134 in term 0.
I20260709 13:13:28.268831  3052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b058a362644348f9bc4f6b34dd84a2f6" candidate_uuid: "59527545ee964f0389247722525b5134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7007c802f3424951bd47a1d364907f0d" is_pre_election: true
I20260709 13:13:28.270823  3052 raft_consensus.cc:2468] T b058a362644348f9bc4f6b34dd84a2f6 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59527545ee964f0389247722525b5134 in term 0.
I20260709 13:13:28.269157  2978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444aad91fdd848f4bfa98cb2169fead6" candidate_uuid: "7007c802f3424951bd47a1d364907f0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59527545ee964f0389247722525b5134" is_pre_election: true
I20260709 13:13:28.272395  2942 leader_election.cc:304] T b058a362644348f9bc4f6b34dd84a2f6 P 59527545ee964f0389247722525b5134 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59527545ee964f0389247722525b5134, 7007c802f3424951bd47a1d364907f0d; no voters: 
I20260709 13:13:28.272665  3173 ts_tablet_manager.cc:1434] T c1b86f88c52644e9abd09601beab6e58 P 59527545ee964f0389247722525b5134: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.004s
I20260709 13:13:28.272708  2978 raft_consensus.cc:2468] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7007c802f3424951bd47a1d364907f0d in term 0.
I20260709 13:13:28.269330  3172 raft_consensus.cc:740] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43a7e3222d3940738dd6a4bc910c4493, State: Initialized, Role: FOLLOWER
I20260709 13:13:28.269311  3174 raft_consensus.cc:515] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.272040  2944 leader_election.cc:304] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43a7e3222d3940738dd6a4bc910c4493, 59527545ee964f0389247722525b5134; no voters: 
I20260709 13:13:28.275976  3214 raft_consensus.cc:2804] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:28.277820  3180 raft_consensus.cc:515] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.279686  3053 raft_consensus.cc:2393] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59527545ee964f0389247722525b5134 in current term 1: Already voted for candidate 7007c802f3424951bd47a1d364907f0d in this term.
I20260709 13:13:28.279913  3172 consensus_queue.cc:260] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.279156  3178 raft_consensus.cc:2804] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:28.273850  3173 tablet_bootstrap.cc:492] T 25b690c4505a418ea5cc5872d5f3c024 P 59527545ee964f0389247722525b5134: Bootstrap starting.
I20260709 13:13:28.279407  3198 raft_consensus.cc:2804] T b058a362644348f9bc4f6b34dd84a2f6 P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:28.284526  3198 raft_consensus.cc:493] T b058a362644348f9bc4f6b34dd84a2f6 P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.285202  3174 leader_election.cc:290] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d [CANDIDATE]: Term 1 election: Requested vote from peers 59527545ee964f0389247722525b5134 (127.2.198.193:40443), 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195:34467)
I20260709 13:13:28.285230  3198 raft_consensus.cc:3060] T b058a362644348f9bc4f6b34dd84a2f6 P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:28.285837  3174 raft_consensus.cc:493] T 25b690c4505a418ea5cc5872d5f3c024 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.286306  3174 raft_consensus.cc:515] T 25b690c4505a418ea5cc5872d5f3c024 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.286584  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444aad91fdd848f4bfa98cb2169fead6" candidate_uuid: "7007c802f3424951bd47a1d364907f0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43a7e3222d3940738dd6a4bc910c4493"
I20260709 13:13:28.283087  3178 raft_consensus.cc:493] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.288095  3178 raft_consensus.cc:3060] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:28.287205  3127 raft_consensus.cc:3060] T 444aad91fdd848f4bfa98cb2169fead6 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:28.291234  3126 raft_consensus.cc:2393] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59527545ee964f0389247722525b5134 in current term 1: Already voted for candidate 43a7e3222d3940738dd6a4bc910c4493 in this term.
I20260709 13:13:28.293279  3170 tablet_bootstrap.cc:654] T 1bd75affab0f45fe8e66f22aa2142a9b P 7007c802f3424951bd47a1d364907f0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:28.299939  3053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b058a362644348f9bc4f6b34dd84a2f6" candidate_uuid: "43a7e3222d3940738dd6a4bc910c4493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7007c802f3424951bd47a1d364907f0d"
I20260709 13:13:28.300583  3053 raft_consensus.cc:3060] T b058a362644348f9bc4f6b34dd84a2f6 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:28.299228  3180 leader_election.cc:290] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493 [CANDIDATE]: Term 1 election: Requested vote from peers 59527545ee964f0389247722525b5134 (127.2.198.193:40443), 7007c802f3424951bd47a1d364907f0d (127.2.198.194:37497)
I20260709 13:13:28.306989  2978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b058a362644348f9bc4f6b34dd84a2f6" candidate_uuid: "43a7e3222d3940738dd6a4bc910c4493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59527545ee964f0389247722525b5134"
I20260709 13:13:28.315814  2977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444aad91fdd848f4bfa98cb2169fead6" candidate_uuid: "7007c802f3424951bd47a1d364907f0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59527545ee964f0389247722525b5134"
I20260709 13:13:28.318317  2873 catalog_manager.cc:5697] T 83ec256629ea4d6e897bb86ac0e5edf9 P 43a7e3222d3940738dd6a4bc910c4493 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195). New cstate: current_term: 1 leader_uuid: "43a7e3222d3940738dd6a4bc910c4493" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:28.321787  3053 raft_consensus.cc:2468] T b058a362644348f9bc4f6b34dd84a2f6 P 7007c802f3424951bd47a1d364907f0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43a7e3222d3940738dd6a4bc910c4493 in term 1.
I20260709 13:13:28.324517  3091 leader_election.cc:304] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43a7e3222d3940738dd6a4bc910c4493, 7007c802f3424951bd47a1d364907f0d; no voters: 
I20260709 13:13:28.325621  3180 raft_consensus.cc:2804] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:28.327368  3180 raft_consensus.cc:697] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493 [term 1 LEADER]: Becoming Leader. State: Replica: 43a7e3222d3940738dd6a4bc910c4493, State: Running, Role: LEADER
I20260709 13:13:28.328316  3180 consensus_queue.cc:237] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.328832  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25b690c4505a418ea5cc5872d5f3c024" candidate_uuid: "7007c802f3424951bd47a1d364907f0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43a7e3222d3940738dd6a4bc910c4493" is_pre_election: true
W20260709 13:13:28.330446  3019 leader_election.cc:343] T 25b690c4505a418ea5cc5872d5f3c024 P 7007c802f3424951bd47a1d364907f0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195:34467): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:28.330523  3178 raft_consensus.cc:515] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.330946  3127 raft_consensus.cc:2468] T 444aad91fdd848f4bfa98cb2169fead6 P 43a7e3222d3940738dd6a4bc910c4493 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7007c802f3424951bd47a1d364907f0d in term 1.
I20260709 13:13:28.333175  2977 raft_consensus.cc:2393] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7007c802f3424951bd47a1d364907f0d in current term 1: Already voted for candidate 59527545ee964f0389247722525b5134 in this term.
I20260709 13:13:28.333864  3019 leader_election.cc:304] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43a7e3222d3940738dd6a4bc910c4493, 7007c802f3424951bd47a1d364907f0d; no voters: 
I20260709 13:13:28.326773  3214 raft_consensus.cc:697] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d [term 1 LEADER]: Becoming Leader. State: Replica: 7007c802f3424951bd47a1d364907f0d, State: Running, Role: LEADER
I20260709 13:13:28.334535  2976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25b690c4505a418ea5cc5872d5f3c024" candidate_uuid: "7007c802f3424951bd47a1d364907f0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59527545ee964f0389247722525b5134" is_pre_election: true
W20260709 13:13:28.336766  3018 leader_election.cc:343] T 25b690c4505a418ea5cc5872d5f3c024 P 7007c802f3424951bd47a1d364907f0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59527545ee964f0389247722525b5134 (127.2.198.193:40443): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:28.337239  3018 leader_election.cc:304] T 25b690c4505a418ea5cc5872d5f3c024 P 7007c802f3424951bd47a1d364907f0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7007c802f3424951bd47a1d364907f0d; no voters: 43a7e3222d3940738dd6a4bc910c4493, 59527545ee964f0389247722525b5134
I20260709 13:13:28.331440  3174 leader_election.cc:290] T 25b690c4505a418ea5cc5872d5f3c024 P 7007c802f3424951bd47a1d364907f0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59527545ee964f0389247722525b5134 (127.2.198.193:40443), 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195:34467)
I20260709 13:13:28.339716  3174 raft_consensus.cc:2804] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:28.340862  3172 ts_tablet_manager.cc:1434] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493: Time spent starting tablet: real 0.078s	user 0.008s	sys 0.002s
I20260709 13:13:28.340593  3214 consensus_queue.cc:237] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.343708  3172 tablet_bootstrap.cc:492] T c1b86f88c52644e9abd09601beab6e58 P 43a7e3222d3940738dd6a4bc910c4493: Bootstrap starting.
I20260709 13:13:28.344713  3198 raft_consensus.cc:515] T b058a362644348f9bc4f6b34dd84a2f6 P 59527545ee964f0389247722525b5134 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.345479  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444aad91fdd848f4bfa98cb2169fead6" candidate_uuid: "59527545ee964f0389247722525b5134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43a7e3222d3940738dd6a4bc910c4493"
I20260709 13:13:28.345642  3053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444aad91fdd848f4bfa98cb2169fead6" candidate_uuid: "59527545ee964f0389247722525b5134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7007c802f3424951bd47a1d364907f0d"
I20260709 13:13:28.346236  3127 raft_consensus.cc:2393] T 444aad91fdd848f4bfa98cb2169fead6 P 43a7e3222d3940738dd6a4bc910c4493 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 59527545ee964f0389247722525b5134 in current term 1: Already voted for candidate 7007c802f3424951bd47a1d364907f0d in this term.
I20260709 13:13:28.346575  2978 raft_consensus.cc:2393] T b058a362644348f9bc4f6b34dd84a2f6 P 59527545ee964f0389247722525b5134 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 43a7e3222d3940738dd6a4bc910c4493 in current term 1: Already voted for candidate 59527545ee964f0389247722525b5134 in this term.
I20260709 13:13:28.346876  3198 leader_election.cc:290] T b058a362644348f9bc4f6b34dd84a2f6 P 59527545ee964f0389247722525b5134 [CANDIDATE]: Term 1 election: Requested vote from peers 7007c802f3424951bd47a1d364907f0d (127.2.198.194:37497), 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195:34467)
I20260709 13:13:28.347733  3052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b058a362644348f9bc4f6b34dd84a2f6" candidate_uuid: "59527545ee964f0389247722525b5134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7007c802f3424951bd47a1d364907f0d"
I20260709 13:13:28.340915  3174 raft_consensus.cc:697] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d [term 1 LEADER]: Becoming Leader. State: Replica: 7007c802f3424951bd47a1d364907f0d, State: Running, Role: LEADER
I20260709 13:13:28.343235  3178 leader_election.cc:290] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134 [CANDIDATE]: Term 1 election: Requested vote from peers 7007c802f3424951bd47a1d364907f0d (127.2.198.194:37497), 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195:34467)
I20260709 13:13:28.350117  3052 raft_consensus.cc:2393] T b058a362644348f9bc4f6b34dd84a2f6 P 7007c802f3424951bd47a1d364907f0d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 59527545ee964f0389247722525b5134 in current term 1: Already voted for candidate 43a7e3222d3940738dd6a4bc910c4493 in this term.
I20260709 13:13:28.349067  3217 raft_consensus.cc:493] T c1b86f88c52644e9abd09601beab6e58 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.353510  3218 raft_consensus.cc:2749] T 25b690c4505a418ea5cc5872d5f3c024 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:28.354533  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b058a362644348f9bc4f6b34dd84a2f6" candidate_uuid: "59527545ee964f0389247722525b5134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43a7e3222d3940738dd6a4bc910c4493"
I20260709 13:13:28.357836  2944 leader_election.cc:304] T b058a362644348f9bc4f6b34dd84a2f6 P 59527545ee964f0389247722525b5134 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59527545ee964f0389247722525b5134; no voters: 43a7e3222d3940738dd6a4bc910c4493, 7007c802f3424951bd47a1d364907f0d
I20260709 13:13:28.358990  3178 raft_consensus.cc:2749] T b058a362644348f9bc4f6b34dd84a2f6 P 59527545ee964f0389247722525b5134 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:28.360370  3217 raft_consensus.cc:515] T c1b86f88c52644e9abd09601beab6e58 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.371758  3172 tablet_bootstrap.cc:654] T c1b86f88c52644e9abd09601beab6e58 P 43a7e3222d3940738dd6a4bc910c4493: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:28.367923  3174 consensus_queue.cc:237] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.372790  2875 catalog_manager.cc:5697] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7007c802f3424951bd47a1d364907f0d (127.2.198.194). New cstate: current_term: 1 leader_uuid: "7007c802f3424951bd47a1d364907f0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:28.380931  3217 leader_election.cc:290] T c1b86f88c52644e9abd09601beab6e58 P 7007c802f3424951bd47a1d364907f0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59527545ee964f0389247722525b5134 (127.2.198.193:40443), 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195:34467)
I20260709 13:13:28.387377  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b86f88c52644e9abd09601beab6e58" candidate_uuid: "7007c802f3424951bd47a1d364907f0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43a7e3222d3940738dd6a4bc910c4493" is_pre_election: true
I20260709 13:13:28.389837  2978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b86f88c52644e9abd09601beab6e58" candidate_uuid: "7007c802f3424951bd47a1d364907f0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59527545ee964f0389247722525b5134" is_pre_election: true
I20260709 13:13:28.390662  2978 raft_consensus.cc:2468] T c1b86f88c52644e9abd09601beab6e58 P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7007c802f3424951bd47a1d364907f0d in term 0.
W20260709 13:13:28.391607  2923 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:13:28.391786  3019 leader_election.cc:343] T c1b86f88c52644e9abd09601beab6e58 P 7007c802f3424951bd47a1d364907f0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195:34467): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:28.392565  3018 leader_election.cc:304] T c1b86f88c52644e9abd09601beab6e58 P 7007c802f3424951bd47a1d364907f0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59527545ee964f0389247722525b5134, 7007c802f3424951bd47a1d364907f0d; no voters: 43a7e3222d3940738dd6a4bc910c4493
I20260709 13:13:28.395421  3217 raft_consensus.cc:2804] T c1b86f88c52644e9abd09601beab6e58 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:28.396095  3217 raft_consensus.cc:493] T c1b86f88c52644e9abd09601beab6e58 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.396487  3217 raft_consensus.cc:3060] T c1b86f88c52644e9abd09601beab6e58 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:28.396721  2873 catalog_manager.cc:5697] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195). New cstate: current_term: 1 leader_uuid: "43a7e3222d3940738dd6a4bc910c4493" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:28.400547  3170 tablet_bootstrap.cc:492] T 1bd75affab0f45fe8e66f22aa2142a9b P 7007c802f3424951bd47a1d364907f0d: No bootstrap required, opened a new log
I20260709 13:13:28.401202  3170 ts_tablet_manager.cc:1403] T 1bd75affab0f45fe8e66f22aa2142a9b P 7007c802f3424951bd47a1d364907f0d: Time spent bootstrapping tablet: real 0.152s	user 0.015s	sys 0.004s
I20260709 13:13:28.413740  3173 tablet_bootstrap.cc:654] T 25b690c4505a418ea5cc5872d5f3c024 P 59527545ee964f0389247722525b5134: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:28.420511  3217 raft_consensus.cc:515] T c1b86f88c52644e9abd09601beab6e58 P 7007c802f3424951bd47a1d364907f0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.423667  2942 leader_election.cc:304] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59527545ee964f0389247722525b5134; no voters: 43a7e3222d3940738dd6a4bc910c4493, 7007c802f3424951bd47a1d364907f0d
I20260709 13:13:28.424985  3178 raft_consensus.cc:2749] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:28.430073  3170 raft_consensus.cc:359] T 1bd75affab0f45fe8e66f22aa2142a9b P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.430473  2978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b86f88c52644e9abd09601beab6e58" candidate_uuid: "7007c802f3424951bd47a1d364907f0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59527545ee964f0389247722525b5134"
I20260709 13:13:28.430902  3170 raft_consensus.cc:385] T 1bd75affab0f45fe8e66f22aa2142a9b P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:28.431135  2978 raft_consensus.cc:3060] T c1b86f88c52644e9abd09601beab6e58 P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:28.431245  3170 raft_consensus.cc:740] T 1bd75affab0f45fe8e66f22aa2142a9b P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7007c802f3424951bd47a1d364907f0d, State: Initialized, Role: FOLLOWER
I20260709 13:13:28.432440  3173 tablet_bootstrap.cc:492] T 25b690c4505a418ea5cc5872d5f3c024 P 59527545ee964f0389247722525b5134: No bootstrap required, opened a new log
I20260709 13:13:28.432252  3170 consensus_queue.cc:260] T 1bd75affab0f45fe8e66f22aa2142a9b P 7007c802f3424951bd47a1d364907f0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.433367  3173 ts_tablet_manager.cc:1403] T 25b690c4505a418ea5cc5872d5f3c024 P 59527545ee964f0389247722525b5134: Time spent bootstrapping tablet: real 0.160s	user 0.024s	sys 0.014s
I20260709 13:13:28.435065  3170 ts_tablet_manager.cc:1434] T 1bd75affab0f45fe8e66f22aa2142a9b P 7007c802f3424951bd47a1d364907f0d: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.003s
I20260709 13:13:28.437088  3173 raft_consensus.cc:359] T 25b690c4505a418ea5cc5872d5f3c024 P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.433112  3172 tablet_bootstrap.cc:492] T c1b86f88c52644e9abd09601beab6e58 P 43a7e3222d3940738dd6a4bc910c4493: No bootstrap required, opened a new log
I20260709 13:13:28.438975  2978 raft_consensus.cc:2468] T c1b86f88c52644e9abd09601beab6e58 P 59527545ee964f0389247722525b5134 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7007c802f3424951bd47a1d364907f0d in term 1.
I20260709 13:13:28.440348  3217 leader_election.cc:290] T c1b86f88c52644e9abd09601beab6e58 P 7007c802f3424951bd47a1d364907f0d [CANDIDATE]: Term 1 election: Requested vote from peers 59527545ee964f0389247722525b5134 (127.2.198.193:40443), 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195:34467)
I20260709 13:13:28.440711  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b86f88c52644e9abd09601beab6e58" candidate_uuid: "7007c802f3424951bd47a1d364907f0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43a7e3222d3940738dd6a4bc910c4493"
I20260709 13:13:28.441179  3018 leader_election.cc:304] T c1b86f88c52644e9abd09601beab6e58 P 7007c802f3424951bd47a1d364907f0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59527545ee964f0389247722525b5134, 7007c802f3424951bd47a1d364907f0d; no voters: 
W20260709 13:13:28.442045  3019 leader_election.cc:343] T c1b86f88c52644e9abd09601beab6e58 P 7007c802f3424951bd47a1d364907f0d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195:34467): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:28.442960  3217 raft_consensus.cc:2804] T c1b86f88c52644e9abd09601beab6e58 P 7007c802f3424951bd47a1d364907f0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:28.443706  3217 raft_consensus.cc:697] T c1b86f88c52644e9abd09601beab6e58 P 7007c802f3424951bd47a1d364907f0d [term 1 LEADER]: Becoming Leader. State: Replica: 7007c802f3424951bd47a1d364907f0d, State: Running, Role: LEADER
I20260709 13:13:28.438062  3173 raft_consensus.cc:385] T 25b690c4505a418ea5cc5872d5f3c024 P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:28.448273  3172 ts_tablet_manager.cc:1403] T c1b86f88c52644e9abd09601beab6e58 P 43a7e3222d3940738dd6a4bc910c4493: Time spent bootstrapping tablet: real 0.106s	user 0.009s	sys 0.014s
I20260709 13:13:28.443825  2873 catalog_manager.cc:5697] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7007c802f3424951bd47a1d364907f0d (127.2.198.194). New cstate: current_term: 1 leader_uuid: "7007c802f3424951bd47a1d364907f0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:28.449234  3173 raft_consensus.cc:740] T 25b690c4505a418ea5cc5872d5f3c024 P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59527545ee964f0389247722525b5134, State: Initialized, Role: FOLLOWER
I20260709 13:13:28.448967  3217 consensus_queue.cc:237] T c1b86f88c52644e9abd09601beab6e58 P 7007c802f3424951bd47a1d364907f0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.450253  3173 consensus_queue.cc:260] T 25b690c4505a418ea5cc5872d5f3c024 P 59527545ee964f0389247722525b5134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.456676  3172 raft_consensus.cc:359] T c1b86f88c52644e9abd09601beab6e58 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.457427  3172 raft_consensus.cc:385] T c1b86f88c52644e9abd09601beab6e58 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:28.453055  3173 ts_tablet_manager.cc:1434] T 25b690c4505a418ea5cc5872d5f3c024 P 59527545ee964f0389247722525b5134: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:13:28.457767  3172 raft_consensus.cc:740] T c1b86f88c52644e9abd09601beab6e58 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43a7e3222d3940738dd6a4bc910c4493, State: Initialized, Role: FOLLOWER
I20260709 13:13:28.458848  3173 tablet_bootstrap.cc:492] T 83ec256629ea4d6e897bb86ac0e5edf9 P 59527545ee964f0389247722525b5134: Bootstrap starting.
I20260709 13:13:28.458564  3172 consensus_queue.cc:260] T c1b86f88c52644e9abd09601beab6e58 P 43a7e3222d3940738dd6a4bc910c4493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.462567  3172 ts_tablet_manager.cc:1434] T c1b86f88c52644e9abd09601beab6e58 P 43a7e3222d3940738dd6a4bc910c4493: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:13:28.463583  3172 tablet_bootstrap.cc:492] T 25b690c4505a418ea5cc5872d5f3c024 P 43a7e3222d3940738dd6a4bc910c4493: Bootstrap starting.
I20260709 13:13:28.466980  3178 consensus_queue.cc:1048] T ace31b01377e4d8c8cd691d1cca7212c P 59527545ee964f0389247722525b5134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:28.470700  3172 tablet_bootstrap.cc:654] T 25b690c4505a418ea5cc5872d5f3c024 P 43a7e3222d3940738dd6a4bc910c4493: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:28.473332  3198 consensus_queue.cc:1048] T ace31b01377e4d8c8cd691d1cca7212c P 59527545ee964f0389247722525b5134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:28.492596  3174 raft_consensus.cc:493] T f20668f7380e4e87a6ae970612dd3a20 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.493243  3174 raft_consensus.cc:515] T f20668f7380e4e87a6ae970612dd3a20 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.497263  3221 raft_consensus.cc:493] T 1bd75affab0f45fe8e66f22aa2142a9b P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.497815  3221 raft_consensus.cc:515] T 1bd75affab0f45fe8e66f22aa2142a9b P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.501308  2978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20668f7380e4e87a6ae970612dd3a20" candidate_uuid: "7007c802f3424951bd47a1d364907f0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59527545ee964f0389247722525b5134" is_pre_election: true
I20260709 13:13:28.503484  3180 raft_consensus.cc:493] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.504106  3180 raft_consensus.cc:515] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
W20260709 13:13:28.504650  3018 leader_election.cc:343] T f20668f7380e4e87a6ae970612dd3a20 P 7007c802f3424951bd47a1d364907f0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59527545ee964f0389247722525b5134 (127.2.198.193:40443): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:28.506094  2978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bd75affab0f45fe8e66f22aa2142a9b" candidate_uuid: "7007c802f3424951bd47a1d364907f0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59527545ee964f0389247722525b5134" is_pre_election: true
I20260709 13:13:28.506618  3180 leader_election.cc:290] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59527545ee964f0389247722525b5134 (127.2.198.193:40443), 7007c802f3424951bd47a1d364907f0d (127.2.198.194:37497)
I20260709 13:13:28.506985  2978 raft_consensus.cc:2393] T 1bd75affab0f45fe8e66f22aa2142a9b P 59527545ee964f0389247722525b5134 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7007c802f3424951bd47a1d364907f0d in current term 1: Already voted for candidate 43a7e3222d3940738dd6a4bc910c4493 in this term.
I20260709 13:13:28.503480  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bd75affab0f45fe8e66f22aa2142a9b" candidate_uuid: "7007c802f3424951bd47a1d364907f0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43a7e3222d3940738dd6a4bc910c4493" is_pre_election: true
I20260709 13:13:28.509359  3221 leader_election.cc:290] T 1bd75affab0f45fe8e66f22aa2142a9b P 7007c802f3424951bd47a1d364907f0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59527545ee964f0389247722525b5134 (127.2.198.193:40443), 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195:34467)
I20260709 13:13:28.510398  2978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b986642580bd45599def5ca69a30b340" candidate_uuid: "43a7e3222d3940738dd6a4bc910c4493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59527545ee964f0389247722525b5134" is_pre_election: true
I20260709 13:13:28.510637  3019 leader_election.cc:304] T 1bd75affab0f45fe8e66f22aa2142a9b P 7007c802f3424951bd47a1d364907f0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7007c802f3424951bd47a1d364907f0d; no voters: 43a7e3222d3940738dd6a4bc910c4493, 59527545ee964f0389247722525b5134
I20260709 13:13:28.511324  2978 raft_consensus.cc:2393] T b986642580bd45599def5ca69a30b340 P 59527545ee964f0389247722525b5134 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43a7e3222d3940738dd6a4bc910c4493 in current term 1: Already voted for candidate 7007c802f3424951bd47a1d364907f0d in this term.
I20260709 13:13:28.512682  3174 leader_election.cc:290] T f20668f7380e4e87a6ae970612dd3a20 P 7007c802f3424951bd47a1d364907f0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59527545ee964f0389247722525b5134 (127.2.198.193:40443), 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195:34467)
I20260709 13:13:28.512611  3052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b986642580bd45599def5ca69a30b340" candidate_uuid: "43a7e3222d3940738dd6a4bc910c4493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7007c802f3424951bd47a1d364907f0d" is_pre_election: true
I20260709 13:13:28.513564  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20668f7380e4e87a6ae970612dd3a20" candidate_uuid: "7007c802f3424951bd47a1d364907f0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43a7e3222d3940738dd6a4bc910c4493" is_pre_election: true
I20260709 13:13:28.514354  3221 raft_consensus.cc:3060] T 1bd75affab0f45fe8e66f22aa2142a9b P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:28.526888  3091 leader_election.cc:304] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43a7e3222d3940738dd6a4bc910c4493; no voters: 59527545ee964f0389247722525b5134, 7007c802f3424951bd47a1d364907f0d
I20260709 13:13:28.528128  3180 raft_consensus.cc:3060] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:28.530329  3221 raft_consensus.cc:2749] T 1bd75affab0f45fe8e66f22aa2142a9b P 7007c802f3424951bd47a1d364907f0d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:28.539855  3173 tablet_bootstrap.cc:654] T 83ec256629ea4d6e897bb86ac0e5edf9 P 59527545ee964f0389247722525b5134: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:28.550457  3019 leader_election.cc:343] T f20668f7380e4e87a6ae970612dd3a20 P 7007c802f3424951bd47a1d364907f0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195:34467): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:28.552109  3019 leader_election.cc:304] T f20668f7380e4e87a6ae970612dd3a20 P 7007c802f3424951bd47a1d364907f0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7007c802f3424951bd47a1d364907f0d; no voters: 43a7e3222d3940738dd6a4bc910c4493, 59527545ee964f0389247722525b5134
I20260709 13:13:28.553124  3221 raft_consensus.cc:2749] T f20668f7380e4e87a6ae970612dd3a20 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:28.562134  3172 tablet_bootstrap.cc:492] T 25b690c4505a418ea5cc5872d5f3c024 P 43a7e3222d3940738dd6a4bc910c4493: No bootstrap required, opened a new log
I20260709 13:13:28.562609  3172 ts_tablet_manager.cc:1403] T 25b690c4505a418ea5cc5872d5f3c024 P 43a7e3222d3940738dd6a4bc910c4493: Time spent bootstrapping tablet: real 0.099s	user 0.030s	sys 0.054s
I20260709 13:13:28.565454  3173 tablet_bootstrap.cc:492] T 83ec256629ea4d6e897bb86ac0e5edf9 P 59527545ee964f0389247722525b5134: No bootstrap required, opened a new log
I20260709 13:13:28.565833  3180 raft_consensus.cc:2749] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:28.566047  3173 ts_tablet_manager.cc:1403] T 83ec256629ea4d6e897bb86ac0e5edf9 P 59527545ee964f0389247722525b5134: Time spent bootstrapping tablet: real 0.107s	user 0.010s	sys 0.005s
I20260709 13:13:28.565340  2875 catalog_manager.cc:5697] T c1b86f88c52644e9abd09601beab6e58 P 7007c802f3424951bd47a1d364907f0d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7007c802f3424951bd47a1d364907f0d (127.2.198.194). New cstate: current_term: 1 leader_uuid: "7007c802f3424951bd47a1d364907f0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:28.565929  3172 raft_consensus.cc:359] T 25b690c4505a418ea5cc5872d5f3c024 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.566901  3172 raft_consensus.cc:385] T 25b690c4505a418ea5cc5872d5f3c024 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:28.567305  3172 raft_consensus.cc:740] T 25b690c4505a418ea5cc5872d5f3c024 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43a7e3222d3940738dd6a4bc910c4493, State: Initialized, Role: FOLLOWER
I20260709 13:13:28.568173  3172 consensus_queue.cc:260] T 25b690c4505a418ea5cc5872d5f3c024 P 43a7e3222d3940738dd6a4bc910c4493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.569006  3173 raft_consensus.cc:359] T 83ec256629ea4d6e897bb86ac0e5edf9 P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } } peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } }
I20260709 13:13:28.569638  3173 raft_consensus.cc:385] T 83ec256629ea4d6e897bb86ac0e5edf9 P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:28.569883  3173 raft_consensus.cc:740] T 83ec256629ea4d6e897bb86ac0e5edf9 P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59527545ee964f0389247722525b5134, State: Initialized, Role: FOLLOWER
I20260709 13:13:28.570204  3172 ts_tablet_manager.cc:1434] T 25b690c4505a418ea5cc5872d5f3c024 P 43a7e3222d3940738dd6a4bc910c4493: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:28.571106  3172 tablet_bootstrap.cc:492] T f20668f7380e4e87a6ae970612dd3a20 P 43a7e3222d3940738dd6a4bc910c4493: Bootstrap starting.
I20260709 13:13:28.570551  3173 consensus_queue.cc:260] T 83ec256629ea4d6e897bb86ac0e5edf9 P 59527545ee964f0389247722525b5134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } } peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } }
I20260709 13:13:28.577294  3172 tablet_bootstrap.cc:654] T f20668f7380e4e87a6ae970612dd3a20 P 43a7e3222d3940738dd6a4bc910c4493: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:28.578651  3173 ts_tablet_manager.cc:1434] T 83ec256629ea4d6e897bb86ac0e5edf9 P 59527545ee964f0389247722525b5134: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:13:28.579798  3173 tablet_bootstrap.cc:492] T f20668f7380e4e87a6ae970612dd3a20 P 59527545ee964f0389247722525b5134: Bootstrap starting.
I20260709 13:13:28.590893  3172 tablet_bootstrap.cc:492] T f20668f7380e4e87a6ae970612dd3a20 P 43a7e3222d3940738dd6a4bc910c4493: No bootstrap required, opened a new log
I20260709 13:13:28.591428  3172 ts_tablet_manager.cc:1403] T f20668f7380e4e87a6ae970612dd3a20 P 43a7e3222d3940738dd6a4bc910c4493: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.006s
I20260709 13:13:28.594305  3172 raft_consensus.cc:359] T f20668f7380e4e87a6ae970612dd3a20 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.595031  3172 raft_consensus.cc:385] T f20668f7380e4e87a6ae970612dd3a20 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:28.595345  3172 raft_consensus.cc:740] T f20668f7380e4e87a6ae970612dd3a20 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43a7e3222d3940738dd6a4bc910c4493, State: Initialized, Role: FOLLOWER
I20260709 13:13:28.596040  3172 consensus_queue.cc:260] T f20668f7380e4e87a6ae970612dd3a20 P 43a7e3222d3940738dd6a4bc910c4493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.598496  3172 ts_tablet_manager.cc:1434] T f20668f7380e4e87a6ae970612dd3a20 P 43a7e3222d3940738dd6a4bc910c4493: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:28.602290  3173 tablet_bootstrap.cc:654] T f20668f7380e4e87a6ae970612dd3a20 P 59527545ee964f0389247722525b5134: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:28.610961  3173 tablet_bootstrap.cc:492] T f20668f7380e4e87a6ae970612dd3a20 P 59527545ee964f0389247722525b5134: No bootstrap required, opened a new log
I20260709 13:13:28.611467  3173 ts_tablet_manager.cc:1403] T f20668f7380e4e87a6ae970612dd3a20 P 59527545ee964f0389247722525b5134: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.000s
I20260709 13:13:28.613588  3180 raft_consensus.cc:493] T f20668f7380e4e87a6ae970612dd3a20 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.614101  3180 raft_consensus.cc:515] T f20668f7380e4e87a6ae970612dd3a20 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.614617  3173 raft_consensus.cc:359] T f20668f7380e4e87a6ae970612dd3a20 P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.615360  3173 raft_consensus.cc:385] T f20668f7380e4e87a6ae970612dd3a20 P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:28.615664  3173 raft_consensus.cc:740] T f20668f7380e4e87a6ae970612dd3a20 P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59527545ee964f0389247722525b5134, State: Initialized, Role: FOLLOWER
I20260709 13:13:28.616288  3180 leader_election.cc:290] T f20668f7380e4e87a6ae970612dd3a20 P 43a7e3222d3940738dd6a4bc910c4493 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59527545ee964f0389247722525b5134 (127.2.198.193:40443), 7007c802f3424951bd47a1d364907f0d (127.2.198.194:37497)
I20260709 13:13:28.616366  3173 consensus_queue.cc:260] T f20668f7380e4e87a6ae970612dd3a20 P 59527545ee964f0389247722525b5134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.617726  3178 raft_consensus.cc:493] T 25b690c4505a418ea5cc5872d5f3c024 P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.618168  3178 raft_consensus.cc:515] T 25b690c4505a418ea5cc5872d5f3c024 P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.618743  3173 ts_tablet_manager.cc:1434] T f20668f7380e4e87a6ae970612dd3a20 P 59527545ee964f0389247722525b5134: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:13:28.619557  3053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20668f7380e4e87a6ae970612dd3a20" candidate_uuid: "43a7e3222d3940738dd6a4bc910c4493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7007c802f3424951bd47a1d364907f0d" is_pre_election: true
I20260709 13:13:28.620347  3053 raft_consensus.cc:2468] T f20668f7380e4e87a6ae970612dd3a20 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43a7e3222d3940738dd6a4bc910c4493 in term 0.
I20260709 13:13:28.620441  2978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20668f7380e4e87a6ae970612dd3a20" candidate_uuid: "43a7e3222d3940738dd6a4bc910c4493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59527545ee964f0389247722525b5134" is_pre_election: true
I20260709 13:13:28.621073  2978 raft_consensus.cc:2468] T f20668f7380e4e87a6ae970612dd3a20 P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43a7e3222d3940738dd6a4bc910c4493 in term 0.
I20260709 13:13:28.622113  3092 leader_election.cc:304] T f20668f7380e4e87a6ae970612dd3a20 P 43a7e3222d3940738dd6a4bc910c4493 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43a7e3222d3940738dd6a4bc910c4493, 59527545ee964f0389247722525b5134; no voters: 
I20260709 13:13:28.622262  3209 consensus_queue.cc:1048] T 1bd75affab0f45fe8e66f22aa2142a9b P 43a7e3222d3940738dd6a4bc910c4493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:28.623008  3180 raft_consensus.cc:2804] T f20668f7380e4e87a6ae970612dd3a20 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:28.623380  3180 raft_consensus.cc:493] T f20668f7380e4e87a6ae970612dd3a20 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.623793  3180 raft_consensus.cc:3060] T f20668f7380e4e87a6ae970612dd3a20 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:28.623914  3053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25b690c4505a418ea5cc5872d5f3c024" candidate_uuid: "59527545ee964f0389247722525b5134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7007c802f3424951bd47a1d364907f0d" is_pre_election: true
I20260709 13:13:28.624612  3053 raft_consensus.cc:2468] T 25b690c4505a418ea5cc5872d5f3c024 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59527545ee964f0389247722525b5134 in term 0.
I20260709 13:13:28.625803  2942 leader_election.cc:304] T 25b690c4505a418ea5cc5872d5f3c024 P 59527545ee964f0389247722525b5134 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59527545ee964f0389247722525b5134, 7007c802f3424951bd47a1d364907f0d; no voters: 
I20260709 13:13:28.626662  3198 raft_consensus.cc:2804] T 25b690c4505a418ea5cc5872d5f3c024 P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:28.627022  3198 raft_consensus.cc:493] T 25b690c4505a418ea5cc5872d5f3c024 P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.627363  3198 raft_consensus.cc:3060] T 25b690c4505a418ea5cc5872d5f3c024 P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:28.628441  3209 raft_consensus.cc:493] T 25b690c4505a418ea5cc5872d5f3c024 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.628913  3209 raft_consensus.cc:515] T 25b690c4505a418ea5cc5872d5f3c024 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.631209  3209 leader_election.cc:290] T 25b690c4505a418ea5cc5872d5f3c024 P 43a7e3222d3940738dd6a4bc910c4493 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59527545ee964f0389247722525b5134 (127.2.198.193:40443), 7007c802f3424951bd47a1d364907f0d (127.2.198.194:37497)
I20260709 13:13:28.632551  3178 leader_election.cc:290] T 25b690c4505a418ea5cc5872d5f3c024 P 59527545ee964f0389247722525b5134 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7007c802f3424951bd47a1d364907f0d (127.2.198.194:37497), 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195:34467)
I20260709 13:13:28.634110  2978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25b690c4505a418ea5cc5872d5f3c024" candidate_uuid: "43a7e3222d3940738dd6a4bc910c4493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59527545ee964f0389247722525b5134" is_pre_election: true
I20260709 13:13:28.636294  3053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25b690c4505a418ea5cc5872d5f3c024" candidate_uuid: "43a7e3222d3940738dd6a4bc910c4493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7007c802f3424951bd47a1d364907f0d" is_pre_election: true
I20260709 13:13:28.636952  3053 raft_consensus.cc:2468] T 25b690c4505a418ea5cc5872d5f3c024 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43a7e3222d3940738dd6a4bc910c4493 in term 0.
I20260709 13:13:28.637811  3198 raft_consensus.cc:515] T 25b690c4505a418ea5cc5872d5f3c024 P 59527545ee964f0389247722525b5134 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.638622  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25b690c4505a418ea5cc5872d5f3c024" candidate_uuid: "59527545ee964f0389247722525b5134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43a7e3222d3940738dd6a4bc910c4493" is_pre_election: true
I20260709 13:13:28.638721  3091 leader_election.cc:304] T 25b690c4505a418ea5cc5872d5f3c024 P 43a7e3222d3940738dd6a4bc910c4493 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43a7e3222d3940738dd6a4bc910c4493, 7007c802f3424951bd47a1d364907f0d; no voters: 
I20260709 13:13:28.639067  2978 raft_consensus.cc:2393] T 25b690c4505a418ea5cc5872d5f3c024 P 59527545ee964f0389247722525b5134 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43a7e3222d3940738dd6a4bc910c4493 in current term 1: Already voted for candidate 59527545ee964f0389247722525b5134 in this term.
I20260709 13:13:28.639328  3126 raft_consensus.cc:2468] T 25b690c4505a418ea5cc5872d5f3c024 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59527545ee964f0389247722525b5134 in term 0.
I20260709 13:13:28.639981  3209 raft_consensus.cc:2804] T 25b690c4505a418ea5cc5872d5f3c024 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:28.640358  3209 raft_consensus.cc:493] T 25b690c4505a418ea5cc5872d5f3c024 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.640697  3209 raft_consensus.cc:3060] T 25b690c4505a418ea5cc5872d5f3c024 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:28.632614  3180 raft_consensus.cc:515] T f20668f7380e4e87a6ae970612dd3a20 P 43a7e3222d3940738dd6a4bc910c4493 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.644534  2978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20668f7380e4e87a6ae970612dd3a20" candidate_uuid: "43a7e3222d3940738dd6a4bc910c4493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59527545ee964f0389247722525b5134"
I20260709 13:13:28.645100  2978 raft_consensus.cc:3060] T f20668f7380e4e87a6ae970612dd3a20 P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:28.648038  3209 raft_consensus.cc:515] T 25b690c4505a418ea5cc5872d5f3c024 P 43a7e3222d3940738dd6a4bc910c4493 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.651268  3209 leader_election.cc:290] T 25b690c4505a418ea5cc5872d5f3c024 P 43a7e3222d3940738dd6a4bc910c4493 [CANDIDATE]: Term 1 election: Requested vote from peers 59527545ee964f0389247722525b5134 (127.2.198.193:40443), 7007c802f3424951bd47a1d364907f0d (127.2.198.194:37497)
I20260709 13:13:28.652902  2977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25b690c4505a418ea5cc5872d5f3c024" candidate_uuid: "43a7e3222d3940738dd6a4bc910c4493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59527545ee964f0389247722525b5134"
I20260709 13:13:28.653733  2977 raft_consensus.cc:2393] T 25b690c4505a418ea5cc5872d5f3c024 P 59527545ee964f0389247722525b5134 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 43a7e3222d3940738dd6a4bc910c4493 in current term 1: Already voted for candidate 59527545ee964f0389247722525b5134 in this term.
I20260709 13:13:28.654872  3209 consensus_queue.cc:1048] T 1bd75affab0f45fe8e66f22aa2142a9b P 43a7e3222d3940738dd6a4bc910c4493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:28.661749  3052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25b690c4505a418ea5cc5872d5f3c024" candidate_uuid: "59527545ee964f0389247722525b5134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7007c802f3424951bd47a1d364907f0d"
I20260709 13:13:28.662091  3180 leader_election.cc:290] T f20668f7380e4e87a6ae970612dd3a20 P 43a7e3222d3940738dd6a4bc910c4493 [CANDIDATE]: Term 1 election: Requested vote from peers 59527545ee964f0389247722525b5134 (127.2.198.193:40443), 7007c802f3424951bd47a1d364907f0d (127.2.198.194:37497)
I20260709 13:13:28.662388  3052 raft_consensus.cc:3060] T 25b690c4505a418ea5cc5872d5f3c024 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:28.663938  3198 leader_election.cc:290] T 25b690c4505a418ea5cc5872d5f3c024 P 59527545ee964f0389247722525b5134 [CANDIDATE]: Term 1 election: Requested vote from peers 7007c802f3424951bd47a1d364907f0d (127.2.198.194:37497), 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195:34467)
I20260709 13:13:28.658212  2978 raft_consensus.cc:2468] T f20668f7380e4e87a6ae970612dd3a20 P 59527545ee964f0389247722525b5134 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43a7e3222d3940738dd6a4bc910c4493 in term 1.
I20260709 13:13:28.665663  3092 leader_election.cc:304] T f20668f7380e4e87a6ae970612dd3a20 P 43a7e3222d3940738dd6a4bc910c4493 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43a7e3222d3940738dd6a4bc910c4493, 59527545ee964f0389247722525b5134; no voters: 
I20260709 13:13:28.666785  3180 raft_consensus.cc:2804] T f20668f7380e4e87a6ae970612dd3a20 P 43a7e3222d3940738dd6a4bc910c4493 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:28.667366  3180 raft_consensus.cc:697] T f20668f7380e4e87a6ae970612dd3a20 P 43a7e3222d3940738dd6a4bc910c4493 [term 1 LEADER]: Becoming Leader. State: Replica: 43a7e3222d3940738dd6a4bc910c4493, State: Running, Role: LEADER
I20260709 13:13:28.668850  3180 consensus_queue.cc:237] T f20668f7380e4e87a6ae970612dd3a20 P 43a7e3222d3940738dd6a4bc910c4493 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.669701  3052 raft_consensus.cc:2468] T 25b690c4505a418ea5cc5872d5f3c024 P 7007c802f3424951bd47a1d364907f0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59527545ee964f0389247722525b5134 in term 1.
I20260709 13:13:28.671012  2942 leader_election.cc:304] T 25b690c4505a418ea5cc5872d5f3c024 P 59527545ee964f0389247722525b5134 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59527545ee964f0389247722525b5134, 7007c802f3424951bd47a1d364907f0d; no voters: 
I20260709 13:13:28.672263  3198 raft_consensus.cc:2804] T 25b690c4505a418ea5cc5872d5f3c024 P 59527545ee964f0389247722525b5134 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:28.673029  3198 raft_consensus.cc:697] T 25b690c4505a418ea5cc5872d5f3c024 P 59527545ee964f0389247722525b5134 [term 1 LEADER]: Becoming Leader. State: Replica: 59527545ee964f0389247722525b5134, State: Running, Role: LEADER
I20260709 13:13:28.674342  3198 consensus_queue.cc:237] T 25b690c4505a418ea5cc5872d5f3c024 P 59527545ee964f0389247722525b5134 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.687999  3052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25b690c4505a418ea5cc5872d5f3c024" candidate_uuid: "43a7e3222d3940738dd6a4bc910c4493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7007c802f3424951bd47a1d364907f0d"
I20260709 13:13:28.688848  3052 raft_consensus.cc:2393] T 25b690c4505a418ea5cc5872d5f3c024 P 7007c802f3424951bd47a1d364907f0d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 43a7e3222d3940738dd6a4bc910c4493 in current term 1: Already voted for candidate 59527545ee964f0389247722525b5134 in this term.
I20260709 13:13:28.690907  3052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20668f7380e4e87a6ae970612dd3a20" candidate_uuid: "43a7e3222d3940738dd6a4bc910c4493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7007c802f3424951bd47a1d364907f0d"
I20260709 13:13:28.691495  3052 raft_consensus.cc:3060] T f20668f7380e4e87a6ae970612dd3a20 P 7007c802f3424951bd47a1d364907f0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:28.694928  2873 catalog_manager.cc:5697] T f20668f7380e4e87a6ae970612dd3a20 P 43a7e3222d3940738dd6a4bc910c4493 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195). New cstate: current_term: 1 leader_uuid: "43a7e3222d3940738dd6a4bc910c4493" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:28.697026  2875 catalog_manager.cc:5697] T 25b690c4505a418ea5cc5872d5f3c024 P 59527545ee964f0389247722525b5134 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59527545ee964f0389247722525b5134 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "59527545ee964f0389247722525b5134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:28.702728  2977 raft_consensus.cc:3060] T 83ec256629ea4d6e897bb86ac0e5edf9 P 59527545ee964f0389247722525b5134 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:28.707840  3052 raft_consensus.cc:2468] T f20668f7380e4e87a6ae970612dd3a20 P 7007c802f3424951bd47a1d364907f0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43a7e3222d3940738dd6a4bc910c4493 in term 1.
I20260709 13:13:28.712182  3180 consensus_queue.cc:1048] T 83ec256629ea4d6e897bb86ac0e5edf9 P 43a7e3222d3940738dd6a4bc910c4493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:28.721637  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25b690c4505a418ea5cc5872d5f3c024" candidate_uuid: "59527545ee964f0389247722525b5134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43a7e3222d3940738dd6a4bc910c4493"
I20260709 13:13:28.722625  3126 raft_consensus.cc:2393] T 25b690c4505a418ea5cc5872d5f3c024 P 43a7e3222d3940738dd6a4bc910c4493 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 59527545ee964f0389247722525b5134 in current term 1: Already voted for candidate 43a7e3222d3940738dd6a4bc910c4493 in this term.
I20260709 13:13:28.724326  3091 leader_election.cc:304] T 25b690c4505a418ea5cc5872d5f3c024 P 43a7e3222d3940738dd6a4bc910c4493 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43a7e3222d3940738dd6a4bc910c4493; no voters: 59527545ee964f0389247722525b5134, 7007c802f3424951bd47a1d364907f0d
I20260709 13:13:28.725360  3180 raft_consensus.cc:2749] T 25b690c4505a418ea5cc5872d5f3c024 P 43a7e3222d3940738dd6a4bc910c4493 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:28.728303  3180 consensus_queue.cc:1048] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:28.741688  3239 consensus_queue.cc:1048] T 83ec256629ea4d6e897bb86ac0e5edf9 P 43a7e3222d3940738dd6a4bc910c4493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:28.755065  3180 consensus_queue.cc:1048] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:28.767355  3180 raft_consensus.cc:493] T c1b86f88c52644e9abd09601beab6e58 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.767988  3180 raft_consensus.cc:515] T c1b86f88c52644e9abd09601beab6e58 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.771407  2977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b86f88c52644e9abd09601beab6e58" candidate_uuid: "43a7e3222d3940738dd6a4bc910c4493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59527545ee964f0389247722525b5134" is_pre_election: true
I20260709 13:13:28.772281  2977 raft_consensus.cc:2393] T c1b86f88c52644e9abd09601beab6e58 P 59527545ee964f0389247722525b5134 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43a7e3222d3940738dd6a4bc910c4493 in current term 1: Already voted for candidate 7007c802f3424951bd47a1d364907f0d in this term.
I20260709 13:13:28.772403  3180 leader_election.cc:290] T c1b86f88c52644e9abd09601beab6e58 P 43a7e3222d3940738dd6a4bc910c4493 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59527545ee964f0389247722525b5134 (127.2.198.193:40443), 7007c802f3424951bd47a1d364907f0d (127.2.198.194:37497)
I20260709 13:13:28.773849  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b86f88c52644e9abd09601beab6e58" candidate_uuid: "43a7e3222d3940738dd6a4bc910c4493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7007c802f3424951bd47a1d364907f0d" is_pre_election: true
I20260709 13:13:28.775897  3091 leader_election.cc:304] T c1b86f88c52644e9abd09601beab6e58 P 43a7e3222d3940738dd6a4bc910c4493 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43a7e3222d3940738dd6a4bc910c4493; no voters: 59527545ee964f0389247722525b5134, 7007c802f3424951bd47a1d364907f0d
I20260709 13:13:28.777060  3180 raft_consensus.cc:3060] T c1b86f88c52644e9abd09601beab6e58 P 43a7e3222d3940738dd6a4bc910c4493 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:28.782943  3180 raft_consensus.cc:2749] T c1b86f88c52644e9abd09601beab6e58 P 43a7e3222d3940738dd6a4bc910c4493 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:28.804404  3126 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83ec256629ea4d6e897bb86ac0e5edf9"
dest_uuid: "43a7e3222d3940738dd6a4bc910c4493"
mode: GRACEFUL
new_leader_uuid: "59527545ee964f0389247722525b5134"
 from {username='slave'} at 127.0.0.1:47150
I20260709 13:13:28.805154  3126 raft_consensus.cc:606] T 83ec256629ea4d6e897bb86ac0e5edf9 P 43a7e3222d3940738dd6a4bc910c4493 [term 1 LEADER]: Received request to transfer leadership to TS 59527545ee964f0389247722525b5134
I20260709 13:13:28.811422  3126 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b058a362644348f9bc4f6b34dd84a2f6"
dest_uuid: "43a7e3222d3940738dd6a4bc910c4493"
mode: GRACEFUL
new_leader_uuid: "59527545ee964f0389247722525b5134"
 from {username='slave'} at 127.0.0.1:47150
I20260709 13:13:28.812098  3126 raft_consensus.cc:606] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493 [term 1 LEADER]: Received request to transfer leadership to TS 59527545ee964f0389247722525b5134
I20260709 13:13:28.816375  3217 consensus_queue.cc:1048] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:28.831746  3221 consensus_queue.cc:1048] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:28.833806  3052 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "444aad91fdd848f4bfa98cb2169fead6"
dest_uuid: "7007c802f3424951bd47a1d364907f0d"
mode: GRACEFUL
new_leader_uuid: "59527545ee964f0389247722525b5134"
 from {username='slave'} at 127.0.0.1:49792
I20260709 13:13:28.836457  3052 raft_consensus.cc:606] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d [term 1 LEADER]: Received request to transfer leadership to TS 59527545ee964f0389247722525b5134
I20260709 13:13:28.854863  3221 consensus_queue.cc:1048] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:28.870324  2978 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ace31b01377e4d8c8cd691d1cca7212c"
dest_uuid: "59527545ee964f0389247722525b5134"
mode: GRACEFUL
new_leader_uuid: "7007c802f3424951bd47a1d364907f0d"
 from {username='slave'} at 127.0.0.1:58538
I20260709 13:13:28.871022  2978 raft_consensus.cc:606] T ace31b01377e4d8c8cd691d1cca7212c P 59527545ee964f0389247722525b5134 [term 1 LEADER]: Received request to transfer leadership to TS 7007c802f3424951bd47a1d364907f0d
I20260709 13:13:28.880990  3214 consensus_queue.cc:1048] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:28.881273  3126 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f20668f7380e4e87a6ae970612dd3a20"
dest_uuid: "43a7e3222d3940738dd6a4bc910c4493"
mode: GRACEFUL
new_leader_uuid: "7007c802f3424951bd47a1d364907f0d"
 from {username='slave'} at 127.0.0.1:47150
I20260709 13:13:28.895810  3126 raft_consensus.cc:606] T f20668f7380e4e87a6ae970612dd3a20 P 43a7e3222d3940738dd6a4bc910c4493 [term 1 LEADER]: Received request to transfer leadership to TS 7007c802f3424951bd47a1d364907f0d
I20260709 13:13:28.903290  3126 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1bd75affab0f45fe8e66f22aa2142a9b"
dest_uuid: "43a7e3222d3940738dd6a4bc910c4493"
mode: GRACEFUL
new_leader_uuid: "7007c802f3424951bd47a1d364907f0d"
 from {username='slave'} at 127.0.0.1:47150
I20260709 13:13:28.903751  3214 consensus_queue.cc:1048] T c1b86f88c52644e9abd09601beab6e58 P 7007c802f3424951bd47a1d364907f0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:28.904062  3126 raft_consensus.cc:606] T 1bd75affab0f45fe8e66f22aa2142a9b P 43a7e3222d3940738dd6a4bc910c4493 [term 1 LEADER]: Received request to transfer leadership to TS 7007c802f3424951bd47a1d364907f0d
I20260709 13:13:28.911607  3052 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1b86f88c52644e9abd09601beab6e58"
dest_uuid: "7007c802f3424951bd47a1d364907f0d"
mode: GRACEFUL
new_leader_uuid: "43a7e3222d3940738dd6a4bc910c4493"
 from {username='slave'} at 127.0.0.1:49792
I20260709 13:13:28.912263  3052 raft_consensus.cc:606] T c1b86f88c52644e9abd09601beab6e58 P 7007c802f3424951bd47a1d364907f0d [term 1 LEADER]: Received request to transfer leadership to TS 43a7e3222d3940738dd6a4bc910c4493
I20260709 13:13:28.927767  3174 consensus_queue.cc:1048] T c1b86f88c52644e9abd09601beab6e58 P 7007c802f3424951bd47a1d364907f0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:28.940368  3221 raft_consensus.cc:993] T c1b86f88c52644e9abd09601beab6e58 P 7007c802f3424951bd47a1d364907f0d: : Instructing follower 43a7e3222d3940738dd6a4bc910c4493 to start an election
I20260709 13:13:28.940924  3174 raft_consensus.cc:1081] T c1b86f88c52644e9abd09601beab6e58 P 7007c802f3424951bd47a1d364907f0d [term 1 LEADER]: Signalling peer 43a7e3222d3940738dd6a4bc910c4493 to start an election
I20260709 13:13:28.943120  3126 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c1b86f88c52644e9abd09601beab6e58"
dest_uuid: "43a7e3222d3940738dd6a4bc910c4493"
 from {username='slave'} at 127.0.0.1:47142
I20260709 13:13:28.943821  3126 raft_consensus.cc:493] T c1b86f88c52644e9abd09601beab6e58 P 43a7e3222d3940738dd6a4bc910c4493 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:28.944242  3126 raft_consensus.cc:3060] T c1b86f88c52644e9abd09601beab6e58 P 43a7e3222d3940738dd6a4bc910c4493 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:28.951831  3126 raft_consensus.cc:515] T c1b86f88c52644e9abd09601beab6e58 P 43a7e3222d3940738dd6a4bc910c4493 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.955070  3126 leader_election.cc:290] T c1b86f88c52644e9abd09601beab6e58 P 43a7e3222d3940738dd6a4bc910c4493 [CANDIDATE]: Term 2 election: Requested vote from peers 59527545ee964f0389247722525b5134 (127.2.198.193:40443), 7007c802f3424951bd47a1d364907f0d (127.2.198.194:37497)
I20260709 13:13:28.955350  2977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b86f88c52644e9abd09601beab6e58" candidate_uuid: "43a7e3222d3940738dd6a4bc910c4493" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59527545ee964f0389247722525b5134"
I20260709 13:13:28.955350  3052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b86f88c52644e9abd09601beab6e58" candidate_uuid: "43a7e3222d3940738dd6a4bc910c4493" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7007c802f3424951bd47a1d364907f0d"
I20260709 13:13:28.956231  2977 raft_consensus.cc:3060] T c1b86f88c52644e9abd09601beab6e58 P 59527545ee964f0389247722525b5134 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:28.956589  3052 raft_consensus.cc:3055] T c1b86f88c52644e9abd09601beab6e58 P 7007c802f3424951bd47a1d364907f0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:28.956945  3052 raft_consensus.cc:740] T c1b86f88c52644e9abd09601beab6e58 P 7007c802f3424951bd47a1d364907f0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7007c802f3424951bd47a1d364907f0d, State: Running, Role: LEADER
I20260709 13:13:28.957901  3052 consensus_queue.cc:260] T c1b86f88c52644e9abd09601beab6e58 P 7007c802f3424951bd47a1d364907f0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.959623  3052 raft_consensus.cc:3060] T c1b86f88c52644e9abd09601beab6e58 P 7007c802f3424951bd47a1d364907f0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:28.964579  2977 raft_consensus.cc:2468] T c1b86f88c52644e9abd09601beab6e58 P 59527545ee964f0389247722525b5134 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43a7e3222d3940738dd6a4bc910c4493 in term 2.
I20260709 13:13:28.966135  3092 leader_election.cc:304] T c1b86f88c52644e9abd09601beab6e58 P 43a7e3222d3940738dd6a4bc910c4493 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43a7e3222d3940738dd6a4bc910c4493, 59527545ee964f0389247722525b5134; no voters: 
I20260709 13:13:28.967177  3180 raft_consensus.cc:2804] T c1b86f88c52644e9abd09601beab6e58 P 43a7e3222d3940738dd6a4bc910c4493 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:28.967803  3180 raft_consensus.cc:697] T c1b86f88c52644e9abd09601beab6e58 P 43a7e3222d3940738dd6a4bc910c4493 [term 2 LEADER]: Becoming Leader. State: Replica: 43a7e3222d3940738dd6a4bc910c4493, State: Running, Role: LEADER
I20260709 13:13:28.967844  3052 raft_consensus.cc:2468] T c1b86f88c52644e9abd09601beab6e58 P 7007c802f3424951bd47a1d364907f0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43a7e3222d3940738dd6a4bc910c4493 in term 2.
I20260709 13:13:28.968959  3180 consensus_queue.cc:237] T c1b86f88c52644e9abd09601beab6e58 P 43a7e3222d3940738dd6a4bc910c4493 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:28.976717  2873 catalog_manager.cc:5697] T c1b86f88c52644e9abd09601beab6e58 P 43a7e3222d3940738dd6a4bc910c4493 reported cstate change: term changed from 1 to 2, leader changed from 7007c802f3424951bd47a1d364907f0d (127.2.198.194) to 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195). New cstate: current_term: 2 leader_uuid: "43a7e3222d3940738dd6a4bc910c4493" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:28.996143  3178 raft_consensus.cc:993] T ace31b01377e4d8c8cd691d1cca7212c P 59527545ee964f0389247722525b5134: : Instructing follower 7007c802f3424951bd47a1d364907f0d to start an election
I20260709 13:13:28.996784  3198 raft_consensus.cc:1081] T ace31b01377e4d8c8cd691d1cca7212c P 59527545ee964f0389247722525b5134 [term 1 LEADER]: Signalling peer 7007c802f3424951bd47a1d364907f0d to start an election
I20260709 13:13:28.998601  3052 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ace31b01377e4d8c8cd691d1cca7212c"
dest_uuid: "7007c802f3424951bd47a1d364907f0d"
 from {username='slave'} at 127.0.0.1:49770
I20260709 13:13:28.999197  3052 raft_consensus.cc:493] T ace31b01377e4d8c8cd691d1cca7212c P 7007c802f3424951bd47a1d364907f0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:28.999576  3052 raft_consensus.cc:3060] T ace31b01377e4d8c8cd691d1cca7212c P 7007c802f3424951bd47a1d364907f0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.004807  3052 raft_consensus.cc:515] T ace31b01377e4d8c8cd691d1cca7212c P 7007c802f3424951bd47a1d364907f0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:29.006728  3052 leader_election.cc:290] T ace31b01377e4d8c8cd691d1cca7212c P 7007c802f3424951bd47a1d364907f0d [CANDIDATE]: Term 2 election: Requested vote from peers 59527545ee964f0389247722525b5134 (127.2.198.193:40443), 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195:34467)
I20260709 13:13:29.007853  2977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace31b01377e4d8c8cd691d1cca7212c" candidate_uuid: "7007c802f3424951bd47a1d364907f0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59527545ee964f0389247722525b5134"
I20260709 13:13:29.008085  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace31b01377e4d8c8cd691d1cca7212c" candidate_uuid: "7007c802f3424951bd47a1d364907f0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "43a7e3222d3940738dd6a4bc910c4493"
I20260709 13:13:29.008564  2977 raft_consensus.cc:3055] T ace31b01377e4d8c8cd691d1cca7212c P 59527545ee964f0389247722525b5134 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:29.008776  3126 raft_consensus.cc:3060] T ace31b01377e4d8c8cd691d1cca7212c P 43a7e3222d3940738dd6a4bc910c4493 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.008973  2977 raft_consensus.cc:740] T ace31b01377e4d8c8cd691d1cca7212c P 59527545ee964f0389247722525b5134 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 59527545ee964f0389247722525b5134, State: Running, Role: LEADER
I20260709 13:13:29.009907  2977 consensus_queue.cc:260] T ace31b01377e4d8c8cd691d1cca7212c P 59527545ee964f0389247722525b5134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:29.011272  2977 raft_consensus.cc:3060] T ace31b01377e4d8c8cd691d1cca7212c P 59527545ee964f0389247722525b5134 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.014541  3126 raft_consensus.cc:2468] T ace31b01377e4d8c8cd691d1cca7212c P 43a7e3222d3940738dd6a4bc910c4493 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7007c802f3424951bd47a1d364907f0d in term 2.
I20260709 13:13:29.015772  3019 leader_election.cc:304] T ace31b01377e4d8c8cd691d1cca7212c P 7007c802f3424951bd47a1d364907f0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43a7e3222d3940738dd6a4bc910c4493, 7007c802f3424951bd47a1d364907f0d; no voters: 
I20260709 13:13:29.016570  3221 raft_consensus.cc:2804] T ace31b01377e4d8c8cd691d1cca7212c P 7007c802f3424951bd47a1d364907f0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:29.017066  3221 raft_consensus.cc:697] T ace31b01377e4d8c8cd691d1cca7212c P 7007c802f3424951bd47a1d364907f0d [term 2 LEADER]: Becoming Leader. State: Replica: 7007c802f3424951bd47a1d364907f0d, State: Running, Role: LEADER
I20260709 13:13:29.018239  2977 raft_consensus.cc:2468] T ace31b01377e4d8c8cd691d1cca7212c P 59527545ee964f0389247722525b5134 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7007c802f3424951bd47a1d364907f0d in term 2.
I20260709 13:13:29.018080  3221 consensus_queue.cc:237] T ace31b01377e4d8c8cd691d1cca7212c P 7007c802f3424951bd47a1d364907f0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:29.025537  2873 catalog_manager.cc:5697] T ace31b01377e4d8c8cd691d1cca7212c P 7007c802f3424951bd47a1d364907f0d reported cstate change: term changed from 1 to 2, leader changed from 59527545ee964f0389247722525b5134 (127.2.198.193) to 7007c802f3424951bd47a1d364907f0d (127.2.198.194). New cstate: current_term: 2 leader_uuid: "7007c802f3424951bd47a1d364907f0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:29.098198  3198 consensus_queue.cc:1048] T 25b690c4505a418ea5cc5872d5f3c024 P 59527545ee964f0389247722525b5134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:29.110019  3198 consensus_queue.cc:1048] T 25b690c4505a418ea5cc5872d5f3c024 P 59527545ee964f0389247722525b5134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:29.193253  3203 consensus_queue.cc:1048] T f20668f7380e4e87a6ae970612dd3a20 P 43a7e3222d3940738dd6a4bc910c4493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:29.206969  3180 consensus_queue.cc:1048] T f20668f7380e4e87a6ae970612dd3a20 P 43a7e3222d3940738dd6a4bc910c4493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:29.220145  3209 raft_consensus.cc:993] T f20668f7380e4e87a6ae970612dd3a20 P 43a7e3222d3940738dd6a4bc910c4493: : Instructing follower 7007c802f3424951bd47a1d364907f0d to start an election
I20260709 13:13:29.220702  3209 raft_consensus.cc:1081] T f20668f7380e4e87a6ae970612dd3a20 P 43a7e3222d3940738dd6a4bc910c4493 [term 1 LEADER]: Signalling peer 7007c802f3424951bd47a1d364907f0d to start an election
I20260709 13:13:29.224169  3053 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f20668f7380e4e87a6ae970612dd3a20"
dest_uuid: "7007c802f3424951bd47a1d364907f0d"
 from {username='slave'} at 127.0.0.1:49780
I20260709 13:13:29.224856  3053 raft_consensus.cc:493] T f20668f7380e4e87a6ae970612dd3a20 P 7007c802f3424951bd47a1d364907f0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:29.225287  3053 raft_consensus.cc:3060] T f20668f7380e4e87a6ae970612dd3a20 P 7007c802f3424951bd47a1d364907f0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.226192  3209 raft_consensus.cc:993] T 1bd75affab0f45fe8e66f22aa2142a9b P 43a7e3222d3940738dd6a4bc910c4493: : Instructing follower 7007c802f3424951bd47a1d364907f0d to start an election
I20260709 13:13:29.226676  3209 raft_consensus.cc:1081] T 1bd75affab0f45fe8e66f22aa2142a9b P 43a7e3222d3940738dd6a4bc910c4493 [term 1 LEADER]: Signalling peer 7007c802f3424951bd47a1d364907f0d to start an election
I20260709 13:13:29.229328  3052 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1bd75affab0f45fe8e66f22aa2142a9b"
dest_uuid: "7007c802f3424951bd47a1d364907f0d"
 from {username='slave'} at 127.0.0.1:49780
I20260709 13:13:29.229930  3052 raft_consensus.cc:493] T 1bd75affab0f45fe8e66f22aa2142a9b P 7007c802f3424951bd47a1d364907f0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:29.230365  3052 raft_consensus.cc:3060] T 1bd75affab0f45fe8e66f22aa2142a9b P 7007c802f3424951bd47a1d364907f0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.232049  3053 raft_consensus.cc:515] T f20668f7380e4e87a6ae970612dd3a20 P 7007c802f3424951bd47a1d364907f0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:29.235131  2977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20668f7380e4e87a6ae970612dd3a20" candidate_uuid: "7007c802f3424951bd47a1d364907f0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59527545ee964f0389247722525b5134"
I20260709 13:13:29.235790  2977 raft_consensus.cc:3060] T f20668f7380e4e87a6ae970612dd3a20 P 59527545ee964f0389247722525b5134 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.237805  3052 raft_consensus.cc:515] T 1bd75affab0f45fe8e66f22aa2142a9b P 7007c802f3424951bd47a1d364907f0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:29.240903  2978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bd75affab0f45fe8e66f22aa2142a9b" candidate_uuid: "7007c802f3424951bd47a1d364907f0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59527545ee964f0389247722525b5134"
I20260709 13:13:29.241540  2978 raft_consensus.cc:3060] T 1bd75affab0f45fe8e66f22aa2142a9b P 59527545ee964f0389247722525b5134 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.244593  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bd75affab0f45fe8e66f22aa2142a9b" candidate_uuid: "7007c802f3424951bd47a1d364907f0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "43a7e3222d3940738dd6a4bc910c4493"
I20260709 13:13:29.245296  3126 raft_consensus.cc:3055] T 1bd75affab0f45fe8e66f22aa2142a9b P 43a7e3222d3940738dd6a4bc910c4493 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:29.245332  3053 leader_election.cc:290] T f20668f7380e4e87a6ae970612dd3a20 P 7007c802f3424951bd47a1d364907f0d [CANDIDATE]: Term 2 election: Requested vote from peers 59527545ee964f0389247722525b5134 (127.2.198.193:40443), 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195:34467)
I20260709 13:13:29.245783  3126 raft_consensus.cc:740] T 1bd75affab0f45fe8e66f22aa2142a9b P 43a7e3222d3940738dd6a4bc910c4493 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 43a7e3222d3940738dd6a4bc910c4493, State: Running, Role: LEADER
I20260709 13:13:29.246685  3126 consensus_queue.cc:260] T 1bd75affab0f45fe8e66f22aa2142a9b P 43a7e3222d3940738dd6a4bc910c4493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:29.250046  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20668f7380e4e87a6ae970612dd3a20" candidate_uuid: "7007c802f3424951bd47a1d364907f0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "43a7e3222d3940738dd6a4bc910c4493"
I20260709 13:13:29.250643  2978 raft_consensus.cc:2468] T 1bd75affab0f45fe8e66f22aa2142a9b P 59527545ee964f0389247722525b5134 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7007c802f3424951bd47a1d364907f0d in term 2.
I20260709 13:13:29.250674  3127 raft_consensus.cc:3055] T f20668f7380e4e87a6ae970612dd3a20 P 43a7e3222d3940738dd6a4bc910c4493 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:29.251757  3127 raft_consensus.cc:740] T f20668f7380e4e87a6ae970612dd3a20 P 43a7e3222d3940738dd6a4bc910c4493 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 43a7e3222d3940738dd6a4bc910c4493, State: Running, Role: LEADER
I20260709 13:13:29.252535  3018 leader_election.cc:304] T 1bd75affab0f45fe8e66f22aa2142a9b P 7007c802f3424951bd47a1d364907f0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59527545ee964f0389247722525b5134, 7007c802f3424951bd47a1d364907f0d; no voters: 
I20260709 13:13:29.252835  3217 raft_consensus.cc:993] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d: : Instructing follower 59527545ee964f0389247722525b5134 to start an election
I20260709 13:13:29.252592  3127 consensus_queue.cc:260] T f20668f7380e4e87a6ae970612dd3a20 P 43a7e3222d3940738dd6a4bc910c4493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:29.253420  3174 raft_consensus.cc:1081] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d [term 1 LEADER]: Signalling peer 59527545ee964f0389247722525b5134 to start an election
I20260709 13:13:29.254045  3127 raft_consensus.cc:3060] T f20668f7380e4e87a6ae970612dd3a20 P 43a7e3222d3940738dd6a4bc910c4493 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.254436  3174 raft_consensus.cc:2804] T 1bd75affab0f45fe8e66f22aa2142a9b P 7007c802f3424951bd47a1d364907f0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:29.254956  3174 raft_consensus.cc:697] T 1bd75affab0f45fe8e66f22aa2142a9b P 7007c802f3424951bd47a1d364907f0d [term 2 LEADER]: Becoming Leader. State: Replica: 7007c802f3424951bd47a1d364907f0d, State: Running, Role: LEADER
I20260709 13:13:29.256171  3126 raft_consensus.cc:3060] T 1bd75affab0f45fe8e66f22aa2142a9b P 43a7e3222d3940738dd6a4bc910c4493 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.255878  3174 consensus_queue.cc:237] T 1bd75affab0f45fe8e66f22aa2142a9b P 7007c802f3424951bd47a1d364907f0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:29.256760  2978 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "444aad91fdd848f4bfa98cb2169fead6"
dest_uuid: "59527545ee964f0389247722525b5134"
 from {username='slave'} at 127.0.0.1:58518
I20260709 13:13:29.257395  2978 raft_consensus.cc:493] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:29.257829  2978 raft_consensus.cc:3060] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.264318  2978 raft_consensus.cc:515] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:29.244634  2977 raft_consensus.cc:2468] T f20668f7380e4e87a6ae970612dd3a20 P 59527545ee964f0389247722525b5134 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7007c802f3424951bd47a1d364907f0d in term 2.
I20260709 13:13:29.266391  3052 leader_election.cc:290] T 1bd75affab0f45fe8e66f22aa2142a9b P 7007c802f3424951bd47a1d364907f0d [CANDIDATE]: Term 2 election: Requested vote from peers 59527545ee964f0389247722525b5134 (127.2.198.193:40443), 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195:34467)
I20260709 13:13:29.266904  3018 leader_election.cc:304] T f20668f7380e4e87a6ae970612dd3a20 P 7007c802f3424951bd47a1d364907f0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59527545ee964f0389247722525b5134, 7007c802f3424951bd47a1d364907f0d; no voters: 
I20260709 13:13:29.267776  3174 raft_consensus.cc:2804] T f20668f7380e4e87a6ae970612dd3a20 P 7007c802f3424951bd47a1d364907f0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:29.267374  2872 catalog_manager.cc:5697] T 1bd75affab0f45fe8e66f22aa2142a9b P 7007c802f3424951bd47a1d364907f0d reported cstate change: term changed from 1 to 2, leader changed from 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195) to 7007c802f3424951bd47a1d364907f0d (127.2.198.194). New cstate: current_term: 2 leader_uuid: "7007c802f3424951bd47a1d364907f0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:29.269678  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444aad91fdd848f4bfa98cb2169fead6" candidate_uuid: "59527545ee964f0389247722525b5134" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "43a7e3222d3940738dd6a4bc910c4493"
I20260709 13:13:29.270390  3125 raft_consensus.cc:3060] T 444aad91fdd848f4bfa98cb2169fead6 P 43a7e3222d3940738dd6a4bc910c4493 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.269549  3174 raft_consensus.cc:697] T f20668f7380e4e87a6ae970612dd3a20 P 7007c802f3424951bd47a1d364907f0d [term 2 LEADER]: Becoming Leader. State: Replica: 7007c802f3424951bd47a1d364907f0d, State: Running, Role: LEADER
I20260709 13:13:29.269735  3053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444aad91fdd848f4bfa98cb2169fead6" candidate_uuid: "59527545ee964f0389247722525b5134" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7007c802f3424951bd47a1d364907f0d"
I20260709 13:13:29.271629  3053 raft_consensus.cc:3055] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:29.271956  3053 raft_consensus.cc:740] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7007c802f3424951bd47a1d364907f0d, State: Running, Role: LEADER
I20260709 13:13:29.268471  2978 leader_election.cc:290] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134 [CANDIDATE]: Term 2 election: Requested vote from peers 7007c802f3424951bd47a1d364907f0d (127.2.198.194:37497), 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195:34467)
I20260709 13:13:29.271981  3174 consensus_queue.cc:237] T f20668f7380e4e87a6ae970612dd3a20 P 7007c802f3424951bd47a1d364907f0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:29.272938  3053 consensus_queue.cc:260] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:29.274006  3126 raft_consensus.cc:2468] T 1bd75affab0f45fe8e66f22aa2142a9b P 43a7e3222d3940738dd6a4bc910c4493 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7007c802f3424951bd47a1d364907f0d in term 2.
I20260709 13:13:29.275276  3127 raft_consensus.cc:2468] T f20668f7380e4e87a6ae970612dd3a20 P 43a7e3222d3940738dd6a4bc910c4493 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7007c802f3424951bd47a1d364907f0d in term 2.
I20260709 13:13:29.282089  3125 raft_consensus.cc:2468] T 444aad91fdd848f4bfa98cb2169fead6 P 43a7e3222d3940738dd6a4bc910c4493 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59527545ee964f0389247722525b5134 in term 2.
I20260709 13:13:29.282229  3053 raft_consensus.cc:3060] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.284453  2944 leader_election.cc:304] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43a7e3222d3940738dd6a4bc910c4493, 59527545ee964f0389247722525b5134; no voters: 
I20260709 13:13:29.285362  3178 raft_consensus.cc:2804] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:29.285859  3178 raft_consensus.cc:697] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134 [term 2 LEADER]: Becoming Leader. State: Replica: 59527545ee964f0389247722525b5134, State: Running, Role: LEADER
I20260709 13:13:29.286780  3178 consensus_queue.cc:237] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:29.289882  2872 catalog_manager.cc:5697] T f20668f7380e4e87a6ae970612dd3a20 P 7007c802f3424951bd47a1d364907f0d reported cstate change: term changed from 1 to 2, leader changed from 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195) to 7007c802f3424951bd47a1d364907f0d (127.2.198.194). New cstate: current_term: 2 leader_uuid: "7007c802f3424951bd47a1d364907f0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:29.291685  3053 raft_consensus.cc:2468] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59527545ee964f0389247722525b5134 in term 2.
I20260709 13:13:29.295356  2873 catalog_manager.cc:5697] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134 reported cstate change: term changed from 1 to 2, leader changed from 7007c802f3424951bd47a1d364907f0d (127.2.198.194) to 59527545ee964f0389247722525b5134 (127.2.198.193). New cstate: current_term: 2 leader_uuid: "59527545ee964f0389247722525b5134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:29.304306  3209 raft_consensus.cc:993] T 83ec256629ea4d6e897bb86ac0e5edf9 P 43a7e3222d3940738dd6a4bc910c4493: : Instructing follower 59527545ee964f0389247722525b5134 to start an election
I20260709 13:13:29.304898  3203 raft_consensus.cc:1081] T 83ec256629ea4d6e897bb86ac0e5edf9 P 43a7e3222d3940738dd6a4bc910c4493 [term 1 LEADER]: Signalling peer 59527545ee964f0389247722525b5134 to start an election
I20260709 13:13:29.306418  2978 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "83ec256629ea4d6e897bb86ac0e5edf9"
dest_uuid: "59527545ee964f0389247722525b5134"
 from {username='slave'} at 127.0.0.1:58534
I20260709 13:13:29.306912  2978 raft_consensus.cc:493] T 83ec256629ea4d6e897bb86ac0e5edf9 P 59527545ee964f0389247722525b5134 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:29.307227  2978 raft_consensus.cc:3060] T 83ec256629ea4d6e897bb86ac0e5edf9 P 59527545ee964f0389247722525b5134 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.312278  2978 raft_consensus.cc:515] T 83ec256629ea4d6e897bb86ac0e5edf9 P 59527545ee964f0389247722525b5134 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } } peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } }
I20260709 13:13:29.313952  2978 leader_election.cc:290] T 83ec256629ea4d6e897bb86ac0e5edf9 P 59527545ee964f0389247722525b5134 [CANDIDATE]: Term 2 election: Requested vote from peers 7007c802f3424951bd47a1d364907f0d (127.2.198.194:37497), 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195:34467)
I20260709 13:13:29.314924  3053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ec256629ea4d6e897bb86ac0e5edf9" candidate_uuid: "59527545ee964f0389247722525b5134" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7007c802f3424951bd47a1d364907f0d"
I20260709 13:13:29.315079  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ec256629ea4d6e897bb86ac0e5edf9" candidate_uuid: "59527545ee964f0389247722525b5134" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "43a7e3222d3940738dd6a4bc910c4493"
I20260709 13:13:29.315517  3053 raft_consensus.cc:3060] T 83ec256629ea4d6e897bb86ac0e5edf9 P 7007c802f3424951bd47a1d364907f0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.315724  3125 raft_consensus.cc:3055] T 83ec256629ea4d6e897bb86ac0e5edf9 P 43a7e3222d3940738dd6a4bc910c4493 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:29.316115  3125 raft_consensus.cc:740] T 83ec256629ea4d6e897bb86ac0e5edf9 P 43a7e3222d3940738dd6a4bc910c4493 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 43a7e3222d3940738dd6a4bc910c4493, State: Running, Role: LEADER
I20260709 13:13:29.316844  3125 consensus_queue.cc:260] T 83ec256629ea4d6e897bb86ac0e5edf9 P 43a7e3222d3940738dd6a4bc910c4493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } } peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } }
I20260709 13:13:29.317811  3125 raft_consensus.cc:3060] T 83ec256629ea4d6e897bb86ac0e5edf9 P 43a7e3222d3940738dd6a4bc910c4493 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.322518  3125 raft_consensus.cc:2468] T 83ec256629ea4d6e897bb86ac0e5edf9 P 43a7e3222d3940738dd6a4bc910c4493 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59527545ee964f0389247722525b5134 in term 2.
I20260709 13:13:29.322542  3053 raft_consensus.cc:2468] T 83ec256629ea4d6e897bb86ac0e5edf9 P 7007c802f3424951bd47a1d364907f0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59527545ee964f0389247722525b5134 in term 2.
I20260709 13:13:29.323792  2944 leader_election.cc:304] T 83ec256629ea4d6e897bb86ac0e5edf9 P 59527545ee964f0389247722525b5134 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43a7e3222d3940738dd6a4bc910c4493, 59527545ee964f0389247722525b5134; no voters: 
I20260709 13:13:29.324536  3178 raft_consensus.cc:2804] T 83ec256629ea4d6e897bb86ac0e5edf9 P 59527545ee964f0389247722525b5134 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:29.325037  3178 raft_consensus.cc:697] T 83ec256629ea4d6e897bb86ac0e5edf9 P 59527545ee964f0389247722525b5134 [term 2 LEADER]: Becoming Leader. State: Replica: 59527545ee964f0389247722525b5134, State: Running, Role: LEADER
I20260709 13:13:29.325888  3178 consensus_queue.cc:237] T 83ec256629ea4d6e897bb86ac0e5edf9 P 59527545ee964f0389247722525b5134 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } } peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } }
I20260709 13:13:29.332777  2873 catalog_manager.cc:5697] T 83ec256629ea4d6e897bb86ac0e5edf9 P 59527545ee964f0389247722525b5134 reported cstate change: term changed from 1 to 2, leader changed from 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195) to 59527545ee964f0389247722525b5134 (127.2.198.193). New cstate: current_term: 2 leader_uuid: "59527545ee964f0389247722525b5134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:29.368940  3209 raft_consensus.cc:993] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493: : Instructing follower 59527545ee964f0389247722525b5134 to start an election
I20260709 13:13:29.369498  3203 raft_consensus.cc:1081] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493 [term 1 LEADER]: Signalling peer 59527545ee964f0389247722525b5134 to start an election
I20260709 13:13:29.371094  2978 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b058a362644348f9bc4f6b34dd84a2f6"
dest_uuid: "59527545ee964f0389247722525b5134"
 from {username='slave'} at 127.0.0.1:58534
I20260709 13:13:29.371726  2978 raft_consensus.cc:493] T b058a362644348f9bc4f6b34dd84a2f6 P 59527545ee964f0389247722525b5134 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:29.372123  2978 raft_consensus.cc:3060] T b058a362644348f9bc4f6b34dd84a2f6 P 59527545ee964f0389247722525b5134 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.377518  2978 raft_consensus.cc:515] T b058a362644348f9bc4f6b34dd84a2f6 P 59527545ee964f0389247722525b5134 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:29.379841  2978 leader_election.cc:290] T b058a362644348f9bc4f6b34dd84a2f6 P 59527545ee964f0389247722525b5134 [CANDIDATE]: Term 2 election: Requested vote from peers 7007c802f3424951bd47a1d364907f0d (127.2.198.194:37497), 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195:34467)
I20260709 13:13:29.380339  3053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b058a362644348f9bc4f6b34dd84a2f6" candidate_uuid: "59527545ee964f0389247722525b5134" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7007c802f3424951bd47a1d364907f0d"
I20260709 13:13:29.380491  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b058a362644348f9bc4f6b34dd84a2f6" candidate_uuid: "59527545ee964f0389247722525b5134" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "43a7e3222d3940738dd6a4bc910c4493"
I20260709 13:13:29.381269  3053 raft_consensus.cc:3060] T b058a362644348f9bc4f6b34dd84a2f6 P 7007c802f3424951bd47a1d364907f0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.381361  3125 raft_consensus.cc:3055] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:29.382032  3125 raft_consensus.cc:740] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 43a7e3222d3940738dd6a4bc910c4493, State: Running, Role: LEADER
I20260709 13:13:29.382812  3125 consensus_queue.cc:260] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:29.383826  3125 raft_consensus.cc:3060] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.388543  3125 raft_consensus.cc:2468] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59527545ee964f0389247722525b5134 in term 2.
I20260709 13:13:29.388729  3053 raft_consensus.cc:2468] T b058a362644348f9bc4f6b34dd84a2f6 P 7007c802f3424951bd47a1d364907f0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59527545ee964f0389247722525b5134 in term 2.
I20260709 13:13:29.389672  2944 leader_election.cc:304] T b058a362644348f9bc4f6b34dd84a2f6 P 59527545ee964f0389247722525b5134 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43a7e3222d3940738dd6a4bc910c4493, 59527545ee964f0389247722525b5134; no voters: 
I20260709 13:13:29.390558  3178 raft_consensus.cc:2804] T b058a362644348f9bc4f6b34dd84a2f6 P 59527545ee964f0389247722525b5134 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:29.391040  3178 raft_consensus.cc:697] T b058a362644348f9bc4f6b34dd84a2f6 P 59527545ee964f0389247722525b5134 [term 2 LEADER]: Becoming Leader. State: Replica: 59527545ee964f0389247722525b5134, State: Running, Role: LEADER
I20260709 13:13:29.391907  3178 consensus_queue.cc:237] T b058a362644348f9bc4f6b34dd84a2f6 P 59527545ee964f0389247722525b5134 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:29.400069  2873 catalog_manager.cc:5697] T b058a362644348f9bc4f6b34dd84a2f6 P 59527545ee964f0389247722525b5134 reported cstate change: term changed from 1 to 2, leader changed from 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195) to 59527545ee964f0389247722525b5134 (127.2.198.193). New cstate: current_term: 2 leader_uuid: "59527545ee964f0389247722525b5134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:29.493095  2978 raft_consensus.cc:1275] T ace31b01377e4d8c8cd691d1cca7212c P 59527545ee964f0389247722525b5134 [term 2 FOLLOWER]: Refusing update from remote peer 7007c802f3424951bd47a1d364907f0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:29.493095  3053 raft_consensus.cc:1275] T c1b86f88c52644e9abd09601beab6e58 P 7007c802f3424951bd47a1d364907f0d [term 2 FOLLOWER]: Refusing update from remote peer 43a7e3222d3940738dd6a4bc910c4493: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:29.494875  3174 consensus_queue.cc:1048] T ace31b01377e4d8c8cd691d1cca7212c P 7007c802f3424951bd47a1d364907f0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:29.494932  3203 consensus_queue.cc:1048] T c1b86f88c52644e9abd09601beab6e58 P 43a7e3222d3940738dd6a4bc910c4493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:29.504673  2976 raft_consensus.cc:1275] T c1b86f88c52644e9abd09601beab6e58 P 59527545ee964f0389247722525b5134 [term 2 FOLLOWER]: Refusing update from remote peer 43a7e3222d3940738dd6a4bc910c4493: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:29.506297  3180 consensus_queue.cc:1048] T c1b86f88c52644e9abd09601beab6e58 P 43a7e3222d3940738dd6a4bc910c4493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:29.517623  3125 raft_consensus.cc:1275] T ace31b01377e4d8c8cd691d1cca7212c P 43a7e3222d3940738dd6a4bc910c4493 [term 2 FOLLOWER]: Refusing update from remote peer 7007c802f3424951bd47a1d364907f0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:29.519027  3174 consensus_queue.cc:1048] T ace31b01377e4d8c8cd691d1cca7212c P 7007c802f3424951bd47a1d364907f0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:29.716125  3053 raft_consensus.cc:1275] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d [term 2 FOLLOWER]: Refusing update from remote peer 59527545ee964f0389247722525b5134: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:29.717504  3178 consensus_queue.cc:1048] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:29.725739  3125 raft_consensus.cc:1275] T 444aad91fdd848f4bfa98cb2169fead6 P 43a7e3222d3940738dd6a4bc910c4493 [term 2 FOLLOWER]: Refusing update from remote peer 59527545ee964f0389247722525b5134: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:29.729780  3198 consensus_queue.cc:1048] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:29.739912  3125 raft_consensus.cc:1275] T 83ec256629ea4d6e897bb86ac0e5edf9 P 43a7e3222d3940738dd6a4bc910c4493 [term 2 FOLLOWER]: Refusing update from remote peer 59527545ee964f0389247722525b5134: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:29.741250  3198 consensus_queue.cc:1048] T 83ec256629ea4d6e897bb86ac0e5edf9 P 59527545ee964f0389247722525b5134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:29.749639  3053 raft_consensus.cc:1275] T 83ec256629ea4d6e897bb86ac0e5edf9 P 7007c802f3424951bd47a1d364907f0d [term 2 FOLLOWER]: Refusing update from remote peer 59527545ee964f0389247722525b5134: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:29.751384  3178 consensus_queue.cc:1048] T 83ec256629ea4d6e897bb86ac0e5edf9 P 59527545ee964f0389247722525b5134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:29.760284  3125 raft_consensus.cc:1275] T f20668f7380e4e87a6ae970612dd3a20 P 43a7e3222d3940738dd6a4bc910c4493 [term 2 FOLLOWER]: Refusing update from remote peer 7007c802f3424951bd47a1d364907f0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:29.761776  3174 consensus_queue.cc:1048] T f20668f7380e4e87a6ae970612dd3a20 P 7007c802f3424951bd47a1d364907f0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:29.770555  2976 raft_consensus.cc:1275] T f20668f7380e4e87a6ae970612dd3a20 P 59527545ee964f0389247722525b5134 [term 2 FOLLOWER]: Refusing update from remote peer 7007c802f3424951bd47a1d364907f0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:29.772272  3174 consensus_queue.cc:1048] T f20668f7380e4e87a6ae970612dd3a20 P 7007c802f3424951bd47a1d364907f0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:29.795113  3125 raft_consensus.cc:1275] T 1bd75affab0f45fe8e66f22aa2142a9b P 43a7e3222d3940738dd6a4bc910c4493 [term 2 FOLLOWER]: Refusing update from remote peer 7007c802f3424951bd47a1d364907f0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:29.796486  3174 consensus_queue.cc:1048] T 1bd75affab0f45fe8e66f22aa2142a9b P 7007c802f3424951bd47a1d364907f0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:29.805354  2976 raft_consensus.cc:1275] T 1bd75affab0f45fe8e66f22aa2142a9b P 59527545ee964f0389247722525b5134 [term 2 FOLLOWER]: Refusing update from remote peer 7007c802f3424951bd47a1d364907f0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:29.807461  3174 consensus_queue.cc:1048] T 1bd75affab0f45fe8e66f22aa2142a9b P 7007c802f3424951bd47a1d364907f0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:29.895335  3125 raft_consensus.cc:1275] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493 [term 2 FOLLOWER]: Refusing update from remote peer 59527545ee964f0389247722525b5134: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:29.896763  3178 consensus_queue.cc:1048] T b058a362644348f9bc4f6b34dd84a2f6 P 59527545ee964f0389247722525b5134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:29.907037  3053 raft_consensus.cc:1275] T b058a362644348f9bc4f6b34dd84a2f6 P 7007c802f3424951bd47a1d364907f0d [term 2 FOLLOWER]: Refusing update from remote peer 59527545ee964f0389247722525b5134: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:29.908833  3258 consensus_queue.cc:1048] T b058a362644348f9bc4f6b34dd84a2f6 P 59527545ee964f0389247722525b5134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:31.944734  2843 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:13:31.945595  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:31.971004  2976 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b058a362644348f9bc4f6b34dd84a2f6"
dest_uuid: "59527545ee964f0389247722525b5134"
mode: GRACEFUL
new_leader_uuid: "43a7e3222d3940738dd6a4bc910c4493"
 from {username='slave'} at 127.0.0.1:44796
I20260709 13:13:31.971750  2976 raft_consensus.cc:606] T b058a362644348f9bc4f6b34dd84a2f6 P 59527545ee964f0389247722525b5134 [term 2 LEADER]: Received request to transfer leadership to TS 43a7e3222d3940738dd6a4bc910c4493
I20260709 13:13:31.983361  3053 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b986642580bd45599def5ca69a30b340"
dest_uuid: "7007c802f3424951bd47a1d364907f0d"
mode: GRACEFUL
new_leader_uuid: "43a7e3222d3940738dd6a4bc910c4493"
 from {username='slave'} at 127.0.0.1:57532
I20260709 13:13:31.984019  3053 raft_consensus.cc:606] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d [term 1 LEADER]: Received request to transfer leadership to TS 43a7e3222d3940738dd6a4bc910c4493
I20260709 13:13:31.985234  2843 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:13:31.985689  2843 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:32.374414  3174 raft_consensus.cc:993] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d: : Instructing follower 43a7e3222d3940738dd6a4bc910c4493 to start an election
I20260709 13:13:32.374917  3272 raft_consensus.cc:1081] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d [term 1 LEADER]: Signalling peer 43a7e3222d3940738dd6a4bc910c4493 to start an election
I20260709 13:13:32.376606  3125 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b986642580bd45599def5ca69a30b340"
dest_uuid: "43a7e3222d3940738dd6a4bc910c4493"
 from {username='slave'} at 127.0.0.1:47142
I20260709 13:13:32.377156  3125 raft_consensus.cc:493] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:32.377473  3125 raft_consensus.cc:3060] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:32.384299  3125 raft_consensus.cc:515] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:32.386667  3125 leader_election.cc:290] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493 [CANDIDATE]: Term 2 election: Requested vote from peers 59527545ee964f0389247722525b5134 (127.2.198.193:40443), 7007c802f3424951bd47a1d364907f0d (127.2.198.194:37497)
I20260709 13:13:32.389127  2976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b986642580bd45599def5ca69a30b340" candidate_uuid: "43a7e3222d3940738dd6a4bc910c4493" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59527545ee964f0389247722525b5134"
I20260709 13:13:32.389873  2976 raft_consensus.cc:3060] T b986642580bd45599def5ca69a30b340 P 59527545ee964f0389247722525b5134 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:32.389128  3053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b986642580bd45599def5ca69a30b340" candidate_uuid: "43a7e3222d3940738dd6a4bc910c4493" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7007c802f3424951bd47a1d364907f0d"
I20260709 13:13:32.392210  3053 raft_consensus.cc:3055] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:32.392606  3053 raft_consensus.cc:740] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7007c802f3424951bd47a1d364907f0d, State: Running, Role: LEADER
I20260709 13:13:32.393472  3053 consensus_queue.cc:260] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:32.394682  3053 raft_consensus.cc:3060] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:32.398051  2976 raft_consensus.cc:2468] T b986642580bd45599def5ca69a30b340 P 59527545ee964f0389247722525b5134 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43a7e3222d3940738dd6a4bc910c4493 in term 2.
I20260709 13:13:32.400050  3273 raft_consensus.cc:993] T b058a362644348f9bc4f6b34dd84a2f6 P 59527545ee964f0389247722525b5134: : Instructing follower 43a7e3222d3940738dd6a4bc910c4493 to start an election
I20260709 13:13:32.399984  3092 leader_election.cc:304] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43a7e3222d3940738dd6a4bc910c4493, 59527545ee964f0389247722525b5134; no voters: 
I20260709 13:13:32.400674  3273 raft_consensus.cc:1081] T b058a362644348f9bc4f6b34dd84a2f6 P 59527545ee964f0389247722525b5134 [term 2 LEADER]: Signalling peer 43a7e3222d3940738dd6a4bc910c4493 to start an election
I20260709 13:13:32.401190  3268 raft_consensus.cc:2804] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:32.403108  3125 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b058a362644348f9bc4f6b34dd84a2f6"
dest_uuid: "43a7e3222d3940738dd6a4bc910c4493"
 from {username='slave'} at 127.0.0.1:47136
I20260709 13:13:32.404156  3268 raft_consensus.cc:697] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493 [term 2 LEADER]: Becoming Leader. State: Replica: 43a7e3222d3940738dd6a4bc910c4493, State: Running, Role: LEADER
I20260709 13:13:32.403980  3125 raft_consensus.cc:493] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:32.404021  3053 raft_consensus.cc:2468] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43a7e3222d3940738dd6a4bc910c4493 in term 2.
I20260709 13:13:32.404881  3125 raft_consensus.cc:3060] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:32.405278  3268 consensus_queue.cc:237] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:32.414183  3125 raft_consensus.cc:515] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:32.416497  3125 leader_election.cc:290] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493 [CANDIDATE]: Term 3 election: Requested vote from peers 59527545ee964f0389247722525b5134 (127.2.198.193:40443), 7007c802f3424951bd47a1d364907f0d (127.2.198.194:37497)
I20260709 13:13:32.417538  2976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b058a362644348f9bc4f6b34dd84a2f6" candidate_uuid: "43a7e3222d3940738dd6a4bc910c4493" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "59527545ee964f0389247722525b5134"
I20260709 13:13:32.418390  2976 raft_consensus.cc:3055] T b058a362644348f9bc4f6b34dd84a2f6 P 59527545ee964f0389247722525b5134 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:32.418727  2976 raft_consensus.cc:740] T b058a362644348f9bc4f6b34dd84a2f6 P 59527545ee964f0389247722525b5134 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 59527545ee964f0389247722525b5134, State: Running, Role: LEADER
I20260709 13:13:32.419589  2976 consensus_queue.cc:260] T b058a362644348f9bc4f6b34dd84a2f6 P 59527545ee964f0389247722525b5134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:32.420770  2976 raft_consensus.cc:3060] T b058a362644348f9bc4f6b34dd84a2f6 P 59527545ee964f0389247722525b5134 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:32.421861  3053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b058a362644348f9bc4f6b34dd84a2f6" candidate_uuid: "43a7e3222d3940738dd6a4bc910c4493" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7007c802f3424951bd47a1d364907f0d"
I20260709 13:13:32.422442  3053 raft_consensus.cc:3060] T b058a362644348f9bc4f6b34dd84a2f6 P 7007c802f3424951bd47a1d364907f0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:32.422420  2873 catalog_manager.cc:5697] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493 reported cstate change: term changed from 1 to 2, leader changed from 7007c802f3424951bd47a1d364907f0d (127.2.198.194) to 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195). New cstate: current_term: 2 leader_uuid: "43a7e3222d3940738dd6a4bc910c4493" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:32.428436  2976 raft_consensus.cc:2468] T b058a362644348f9bc4f6b34dd84a2f6 P 59527545ee964f0389247722525b5134 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43a7e3222d3940738dd6a4bc910c4493 in term 3.
I20260709 13:13:32.429908  3092 leader_election.cc:304] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43a7e3222d3940738dd6a4bc910c4493, 59527545ee964f0389247722525b5134; no voters: 
I20260709 13:13:32.430475  3053 raft_consensus.cc:2468] T b058a362644348f9bc4f6b34dd84a2f6 P 7007c802f3424951bd47a1d364907f0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43a7e3222d3940738dd6a4bc910c4493 in term 3.
I20260709 13:13:32.430999  3268 raft_consensus.cc:2804] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:32.431872  3268 raft_consensus.cc:697] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493 [term 3 LEADER]: Becoming Leader. State: Replica: 43a7e3222d3940738dd6a4bc910c4493, State: Running, Role: LEADER
I20260709 13:13:32.432696  3268 consensus_queue.cc:237] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:32.442062  2873 catalog_manager.cc:5697] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493 reported cstate change: term changed from 2 to 3, leader changed from 59527545ee964f0389247722525b5134 (127.2.198.193) to 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195). New cstate: current_term: 3 leader_uuid: "43a7e3222d3940738dd6a4bc910c4493" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:32.922151  2976 raft_consensus.cc:1275] T b986642580bd45599def5ca69a30b340 P 59527545ee964f0389247722525b5134 [term 2 FOLLOWER]: Refusing update from remote peer 43a7e3222d3940738dd6a4bc910c4493: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:32.922610  3053 raft_consensus.cc:1275] T b058a362644348f9bc4f6b34dd84a2f6 P 7007c802f3424951bd47a1d364907f0d [term 3 FOLLOWER]: Refusing update from remote peer 43a7e3222d3940738dd6a4bc910c4493: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:32.923580  3268 consensus_queue.cc:1048] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:32.924016  3274 consensus_queue.cc:1048] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:32.942458  3053 raft_consensus.cc:1275] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d [term 2 FOLLOWER]: Refusing update from remote peer 43a7e3222d3940738dd6a4bc910c4493: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:32.949852  3286 consensus_queue.cc:1048] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:32.950183  2978 raft_consensus.cc:1275] T b058a362644348f9bc4f6b34dd84a2f6 P 59527545ee964f0389247722525b5134 [term 3 FOLLOWER]: Refusing update from remote peer 43a7e3222d3940738dd6a4bc910c4493: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:32.953123  3289 consensus_queue.cc:1048] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:13:32.986482  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:32.996567  2976 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83ec256629ea4d6e897bb86ac0e5edf9"
dest_uuid: "59527545ee964f0389247722525b5134"
mode: GRACEFUL
new_leader_uuid: "7007c802f3424951bd47a1d364907f0d"
 from {username='slave'} at 127.0.0.1:58538
I20260709 13:13:32.997186  2976 raft_consensus.cc:606] T 83ec256629ea4d6e897bb86ac0e5edf9 P 59527545ee964f0389247722525b5134 [term 2 LEADER]: Received request to transfer leadership to TS 7007c802f3424951bd47a1d364907f0d
I20260709 13:13:33.002339  3125 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b058a362644348f9bc4f6b34dd84a2f6"
dest_uuid: "43a7e3222d3940738dd6a4bc910c4493"
mode: GRACEFUL
new_leader_uuid: "7007c802f3424951bd47a1d364907f0d"
 from {username='slave'} at 127.0.0.1:47150
I20260709 13:13:33.002972  3125 raft_consensus.cc:606] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493 [term 3 LEADER]: Received request to transfer leadership to TS 7007c802f3424951bd47a1d364907f0d
I20260709 13:13:33.008481  2976 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "444aad91fdd848f4bfa98cb2169fead6"
dest_uuid: "59527545ee964f0389247722525b5134"
mode: GRACEFUL
new_leader_uuid: "7007c802f3424951bd47a1d364907f0d"
 from {username='slave'} at 127.0.0.1:58538
I20260709 13:13:33.009038  2976 raft_consensus.cc:606] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134 [term 2 LEADER]: Received request to transfer leadership to TS 7007c802f3424951bd47a1d364907f0d
I20260709 13:13:33.013546  2976 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25b690c4505a418ea5cc5872d5f3c024"
dest_uuid: "59527545ee964f0389247722525b5134"
mode: GRACEFUL
new_leader_uuid: "7007c802f3424951bd47a1d364907f0d"
 from {username='slave'} at 127.0.0.1:58538
I20260709 13:13:33.014108  2976 raft_consensus.cc:606] T 25b690c4505a418ea5cc5872d5f3c024 P 59527545ee964f0389247722525b5134 [term 1 LEADER]: Received request to transfer leadership to TS 7007c802f3424951bd47a1d364907f0d
I20260709 13:13:33.018532  3125 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b986642580bd45599def5ca69a30b340"
dest_uuid: "43a7e3222d3940738dd6a4bc910c4493"
mode: GRACEFUL
new_leader_uuid: "7007c802f3424951bd47a1d364907f0d"
 from {username='slave'} at 127.0.0.1:47150
I20260709 13:13:33.019094  3125 raft_consensus.cc:606] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493 [term 2 LEADER]: Received request to transfer leadership to TS 7007c802f3424951bd47a1d364907f0d
I20260709 13:13:33.172941  3293 raft_consensus.cc:993] T 25b690c4505a418ea5cc5872d5f3c024 P 59527545ee964f0389247722525b5134: : Instructing follower 7007c802f3424951bd47a1d364907f0d to start an election
I20260709 13:13:33.173477  3258 raft_consensus.cc:1081] T 25b690c4505a418ea5cc5872d5f3c024 P 59527545ee964f0389247722525b5134 [term 1 LEADER]: Signalling peer 7007c802f3424951bd47a1d364907f0d to start an election
I20260709 13:13:33.175209  3053 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25b690c4505a418ea5cc5872d5f3c024"
dest_uuid: "7007c802f3424951bd47a1d364907f0d"
 from {username='slave'} at 127.0.0.1:49770
I20260709 13:13:33.175750  3053 raft_consensus.cc:493] T 25b690c4505a418ea5cc5872d5f3c024 P 7007c802f3424951bd47a1d364907f0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:33.176057  3053 raft_consensus.cc:3060] T 25b690c4505a418ea5cc5872d5f3c024 P 7007c802f3424951bd47a1d364907f0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:33.180986  3053 raft_consensus.cc:515] T 25b690c4505a418ea5cc5872d5f3c024 P 7007c802f3424951bd47a1d364907f0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:33.182771  3053 leader_election.cc:290] T 25b690c4505a418ea5cc5872d5f3c024 P 7007c802f3424951bd47a1d364907f0d [CANDIDATE]: Term 2 election: Requested vote from peers 59527545ee964f0389247722525b5134 (127.2.198.193:40443), 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195:34467)
I20260709 13:13:33.183725  2976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25b690c4505a418ea5cc5872d5f3c024" candidate_uuid: "7007c802f3424951bd47a1d364907f0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59527545ee964f0389247722525b5134"
I20260709 13:13:33.184062  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25b690c4505a418ea5cc5872d5f3c024" candidate_uuid: "7007c802f3424951bd47a1d364907f0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "43a7e3222d3940738dd6a4bc910c4493"
I20260709 13:13:33.184408  2976 raft_consensus.cc:3055] T 25b690c4505a418ea5cc5872d5f3c024 P 59527545ee964f0389247722525b5134 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:33.184680  3125 raft_consensus.cc:3060] T 25b690c4505a418ea5cc5872d5f3c024 P 43a7e3222d3940738dd6a4bc910c4493 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:33.184784  2976 raft_consensus.cc:740] T 25b690c4505a418ea5cc5872d5f3c024 P 59527545ee964f0389247722525b5134 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 59527545ee964f0389247722525b5134, State: Running, Role: LEADER
I20260709 13:13:33.185711  2976 consensus_queue.cc:260] T 25b690c4505a418ea5cc5872d5f3c024 P 59527545ee964f0389247722525b5134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:33.187034  2976 raft_consensus.cc:3060] T 25b690c4505a418ea5cc5872d5f3c024 P 59527545ee964f0389247722525b5134 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:33.192556  3125 raft_consensus.cc:2468] T 25b690c4505a418ea5cc5872d5f3c024 P 43a7e3222d3940738dd6a4bc910c4493 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7007c802f3424951bd47a1d364907f0d in term 2.
I20260709 13:13:33.193986  3019 leader_election.cc:304] T 25b690c4505a418ea5cc5872d5f3c024 P 7007c802f3424951bd47a1d364907f0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43a7e3222d3940738dd6a4bc910c4493, 7007c802f3424951bd47a1d364907f0d; no voters: 
I20260709 13:13:33.194455  2976 raft_consensus.cc:2468] T 25b690c4505a418ea5cc5872d5f3c024 P 59527545ee964f0389247722525b5134 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7007c802f3424951bd47a1d364907f0d in term 2.
I20260709 13:13:33.194947  3272 raft_consensus.cc:2804] T 25b690c4505a418ea5cc5872d5f3c024 P 7007c802f3424951bd47a1d364907f0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:33.196321  3272 raft_consensus.cc:697] T 25b690c4505a418ea5cc5872d5f3c024 P 7007c802f3424951bd47a1d364907f0d [term 2 LEADER]: Becoming Leader. State: Replica: 7007c802f3424951bd47a1d364907f0d, State: Running, Role: LEADER
I20260709 13:13:33.197129  3272 consensus_queue.cc:237] T 25b690c4505a418ea5cc5872d5f3c024 P 7007c802f3424951bd47a1d364907f0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:33.203771  2875 catalog_manager.cc:5697] T 25b690c4505a418ea5cc5872d5f3c024 P 7007c802f3424951bd47a1d364907f0d reported cstate change: term changed from 1 to 2, leader changed from 59527545ee964f0389247722525b5134 (127.2.198.193) to 7007c802f3424951bd47a1d364907f0d (127.2.198.194). New cstate: current_term: 2 leader_uuid: "7007c802f3424951bd47a1d364907f0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:33.382467  3284 raft_consensus.cc:993] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493: : Instructing follower 7007c802f3424951bd47a1d364907f0d to start an election
I20260709 13:13:33.382942  3286 raft_consensus.cc:1081] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493 [term 2 LEADER]: Signalling peer 7007c802f3424951bd47a1d364907f0d to start an election
I20260709 13:13:33.384608  3053 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b986642580bd45599def5ca69a30b340"
dest_uuid: "7007c802f3424951bd47a1d364907f0d"
 from {username='slave'} at 127.0.0.1:49780
I20260709 13:13:33.385118  3053 raft_consensus.cc:493] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:33.385474  3053 raft_consensus.cc:3060] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:33.390022  3053 raft_consensus.cc:515] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:33.391522  3053 leader_election.cc:290] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d [CANDIDATE]: Term 3 election: Requested vote from peers 59527545ee964f0389247722525b5134 (127.2.198.193:40443), 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195:34467)
I20260709 13:13:33.392660  2976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b986642580bd45599def5ca69a30b340" candidate_uuid: "7007c802f3424951bd47a1d364907f0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "59527545ee964f0389247722525b5134"
I20260709 13:13:33.392660  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b986642580bd45599def5ca69a30b340" candidate_uuid: "7007c802f3424951bd47a1d364907f0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "43a7e3222d3940738dd6a4bc910c4493"
I20260709 13:13:33.393456  2976 raft_consensus.cc:3060] T b986642580bd45599def5ca69a30b340 P 59527545ee964f0389247722525b5134 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:33.393481  3125 raft_consensus.cc:3055] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:33.394014  3125 raft_consensus.cc:740] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 43a7e3222d3940738dd6a4bc910c4493, State: Running, Role: LEADER
I20260709 13:13:33.394866  3125 consensus_queue.cc:260] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:33.396128  3125 raft_consensus.cc:3060] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:33.400880  2976 raft_consensus.cc:2468] T b986642580bd45599def5ca69a30b340 P 59527545ee964f0389247722525b5134 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7007c802f3424951bd47a1d364907f0d in term 3.
I20260709 13:13:33.402134  3018 leader_election.cc:304] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59527545ee964f0389247722525b5134, 7007c802f3424951bd47a1d364907f0d; no voters: 
I20260709 13:13:33.402856  3272 raft_consensus.cc:2804] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:33.403090  3125 raft_consensus.cc:2468] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7007c802f3424951bd47a1d364907f0d in term 3.
I20260709 13:13:33.403435  3272 raft_consensus.cc:697] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d [term 3 LEADER]: Becoming Leader. State: Replica: 7007c802f3424951bd47a1d364907f0d, State: Running, Role: LEADER
I20260709 13:13:33.404361  3272 consensus_queue.cc:237] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:33.410636  2875 catalog_manager.cc:5697] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d reported cstate change: term changed from 2 to 3, leader changed from 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195) to 7007c802f3424951bd47a1d364907f0d (127.2.198.194). New cstate: current_term: 3 leader_uuid: "7007c802f3424951bd47a1d364907f0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:33.433301  3293 raft_consensus.cc:993] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134: : Instructing follower 7007c802f3424951bd47a1d364907f0d to start an election
I20260709 13:13:33.433854  3258 raft_consensus.cc:1081] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134 [term 2 LEADER]: Signalling peer 7007c802f3424951bd47a1d364907f0d to start an election
I20260709 13:13:33.435249  3053 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "444aad91fdd848f4bfa98cb2169fead6"
dest_uuid: "7007c802f3424951bd47a1d364907f0d"
 from {username='slave'} at 127.0.0.1:49770
I20260709 13:13:33.435798  3053 raft_consensus.cc:493] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:33.436093  3053 raft_consensus.cc:3060] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:33.440630  3053 raft_consensus.cc:515] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:33.442162  3053 leader_election.cc:290] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d [CANDIDATE]: Term 3 election: Requested vote from peers 59527545ee964f0389247722525b5134 (127.2.198.193:40443), 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195:34467)
I20260709 13:13:33.443089  2976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444aad91fdd848f4bfa98cb2169fead6" candidate_uuid: "7007c802f3424951bd47a1d364907f0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "59527545ee964f0389247722525b5134"
I20260709 13:13:33.443301  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444aad91fdd848f4bfa98cb2169fead6" candidate_uuid: "7007c802f3424951bd47a1d364907f0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "43a7e3222d3940738dd6a4bc910c4493"
I20260709 13:13:33.443699  2976 raft_consensus.cc:3055] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:33.443858  3125 raft_consensus.cc:3060] T 444aad91fdd848f4bfa98cb2169fead6 P 43a7e3222d3940738dd6a4bc910c4493 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:33.444150  2976 raft_consensus.cc:740] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 59527545ee964f0389247722525b5134, State: Running, Role: LEADER
I20260709 13:13:33.444978  2976 consensus_queue.cc:260] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:33.446164  2976 raft_consensus.cc:3060] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:33.450651  3125 raft_consensus.cc:2468] T 444aad91fdd848f4bfa98cb2169fead6 P 43a7e3222d3940738dd6a4bc910c4493 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7007c802f3424951bd47a1d364907f0d in term 3.
I20260709 13:13:33.451918  3019 leader_election.cc:304] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43a7e3222d3940738dd6a4bc910c4493, 7007c802f3424951bd47a1d364907f0d; no voters: 
I20260709 13:13:33.452828  3272 raft_consensus.cc:2804] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:33.453353  3272 raft_consensus.cc:697] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d [term 3 LEADER]: Becoming Leader. State: Replica: 7007c802f3424951bd47a1d364907f0d, State: Running, Role: LEADER
I20260709 13:13:33.453248  2976 raft_consensus.cc:2468] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7007c802f3424951bd47a1d364907f0d in term 3.
I20260709 13:13:33.454273  3272 consensus_queue.cc:237] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:33.461741  2875 catalog_manager.cc:5697] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d reported cstate change: term changed from 2 to 3, leader changed from 59527545ee964f0389247722525b5134 (127.2.198.193) to 7007c802f3424951bd47a1d364907f0d (127.2.198.194). New cstate: current_term: 3 leader_uuid: "7007c802f3424951bd47a1d364907f0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:33.492216  3293 raft_consensus.cc:993] T 83ec256629ea4d6e897bb86ac0e5edf9 P 59527545ee964f0389247722525b5134: : Instructing follower 7007c802f3424951bd47a1d364907f0d to start an election
I20260709 13:13:33.492715  3258 raft_consensus.cc:1081] T 83ec256629ea4d6e897bb86ac0e5edf9 P 59527545ee964f0389247722525b5134 [term 2 LEADER]: Signalling peer 7007c802f3424951bd47a1d364907f0d to start an election
I20260709 13:13:33.494258  3053 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "83ec256629ea4d6e897bb86ac0e5edf9"
dest_uuid: "7007c802f3424951bd47a1d364907f0d"
 from {username='slave'} at 127.0.0.1:49770
I20260709 13:13:33.494748  3053 raft_consensus.cc:493] T 83ec256629ea4d6e897bb86ac0e5edf9 P 7007c802f3424951bd47a1d364907f0d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:33.495033  3053 raft_consensus.cc:3060] T 83ec256629ea4d6e897bb86ac0e5edf9 P 7007c802f3424951bd47a1d364907f0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:33.499406  3053 raft_consensus.cc:515] T 83ec256629ea4d6e897bb86ac0e5edf9 P 7007c802f3424951bd47a1d364907f0d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } } peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } }
I20260709 13:13:33.500864  3053 leader_election.cc:290] T 83ec256629ea4d6e897bb86ac0e5edf9 P 7007c802f3424951bd47a1d364907f0d [CANDIDATE]: Term 3 election: Requested vote from peers 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195:34467), 59527545ee964f0389247722525b5134 (127.2.198.193:40443)
I20260709 13:13:33.501770  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ec256629ea4d6e897bb86ac0e5edf9" candidate_uuid: "7007c802f3424951bd47a1d364907f0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "43a7e3222d3940738dd6a4bc910c4493"
I20260709 13:13:33.501965  2976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ec256629ea4d6e897bb86ac0e5edf9" candidate_uuid: "7007c802f3424951bd47a1d364907f0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "59527545ee964f0389247722525b5134"
I20260709 13:13:33.502254  3125 raft_consensus.cc:3060] T 83ec256629ea4d6e897bb86ac0e5edf9 P 43a7e3222d3940738dd6a4bc910c4493 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:33.502521  2976 raft_consensus.cc:3055] T 83ec256629ea4d6e897bb86ac0e5edf9 P 59527545ee964f0389247722525b5134 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:33.502825  2976 raft_consensus.cc:740] T 83ec256629ea4d6e897bb86ac0e5edf9 P 59527545ee964f0389247722525b5134 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 59527545ee964f0389247722525b5134, State: Running, Role: LEADER
I20260709 13:13:33.503582  2976 consensus_queue.cc:260] T 83ec256629ea4d6e897bb86ac0e5edf9 P 59527545ee964f0389247722525b5134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } } peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } }
I20260709 13:13:33.504567  2976 raft_consensus.cc:3060] T 83ec256629ea4d6e897bb86ac0e5edf9 P 59527545ee964f0389247722525b5134 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:33.506680  3125 raft_consensus.cc:2468] T 83ec256629ea4d6e897bb86ac0e5edf9 P 43a7e3222d3940738dd6a4bc910c4493 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7007c802f3424951bd47a1d364907f0d in term 3.
I20260709 13:13:33.507762  3019 leader_election.cc:304] T 83ec256629ea4d6e897bb86ac0e5edf9 P 7007c802f3424951bd47a1d364907f0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43a7e3222d3940738dd6a4bc910c4493, 7007c802f3424951bd47a1d364907f0d; no voters: 
I20260709 13:13:33.508504  3272 raft_consensus.cc:2804] T 83ec256629ea4d6e897bb86ac0e5edf9 P 7007c802f3424951bd47a1d364907f0d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:33.508937  3272 raft_consensus.cc:697] T 83ec256629ea4d6e897bb86ac0e5edf9 P 7007c802f3424951bd47a1d364907f0d [term 3 LEADER]: Becoming Leader. State: Replica: 7007c802f3424951bd47a1d364907f0d, State: Running, Role: LEADER
I20260709 13:13:33.509807  2976 raft_consensus.cc:2468] T 83ec256629ea4d6e897bb86ac0e5edf9 P 59527545ee964f0389247722525b5134 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7007c802f3424951bd47a1d364907f0d in term 3.
I20260709 13:13:33.509675  3272 consensus_queue.cc:237] T 83ec256629ea4d6e897bb86ac0e5edf9 P 7007c802f3424951bd47a1d364907f0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } } peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } }
I20260709 13:13:33.516911  2875 catalog_manager.cc:5697] T 83ec256629ea4d6e897bb86ac0e5edf9 P 7007c802f3424951bd47a1d364907f0d reported cstate change: term changed from 2 to 3, leader changed from 59527545ee964f0389247722525b5134 (127.2.198.193) to 7007c802f3424951bd47a1d364907f0d (127.2.198.194). New cstate: current_term: 3 leader_uuid: "7007c802f3424951bd47a1d364907f0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:33.523244  3284 raft_consensus.cc:993] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493: : Instructing follower 7007c802f3424951bd47a1d364907f0d to start an election
I20260709 13:13:33.523752  3286 raft_consensus.cc:1081] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493 [term 3 LEADER]: Signalling peer 7007c802f3424951bd47a1d364907f0d to start an election
I20260709 13:13:33.525487  3053 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b058a362644348f9bc4f6b34dd84a2f6"
dest_uuid: "7007c802f3424951bd47a1d364907f0d"
 from {username='slave'} at 127.0.0.1:49780
I20260709 13:13:33.526077  3053 raft_consensus.cc:493] T b058a362644348f9bc4f6b34dd84a2f6 P 7007c802f3424951bd47a1d364907f0d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:33.526438  3053 raft_consensus.cc:3060] T b058a362644348f9bc4f6b34dd84a2f6 P 7007c802f3424951bd47a1d364907f0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:33.530840  3053 raft_consensus.cc:515] T b058a362644348f9bc4f6b34dd84a2f6 P 7007c802f3424951bd47a1d364907f0d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:33.532318  3053 leader_election.cc:290] T b058a362644348f9bc4f6b34dd84a2f6 P 7007c802f3424951bd47a1d364907f0d [CANDIDATE]: Term 4 election: Requested vote from peers 59527545ee964f0389247722525b5134 (127.2.198.193:40443), 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195:34467)
I20260709 13:13:33.533172  2976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b058a362644348f9bc4f6b34dd84a2f6" candidate_uuid: "7007c802f3424951bd47a1d364907f0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "59527545ee964f0389247722525b5134"
I20260709 13:13:33.533291  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b058a362644348f9bc4f6b34dd84a2f6" candidate_uuid: "7007c802f3424951bd47a1d364907f0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "43a7e3222d3940738dd6a4bc910c4493"
I20260709 13:13:33.533933  2976 raft_consensus.cc:3060] T b058a362644348f9bc4f6b34dd84a2f6 P 59527545ee964f0389247722525b5134 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:33.533970  3125 raft_consensus.cc:3055] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:33.534423  3125 raft_consensus.cc:740] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 43a7e3222d3940738dd6a4bc910c4493, State: Running, Role: LEADER
I20260709 13:13:33.535189  3125 consensus_queue.cc:260] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:33.536360  3125 raft_consensus.cc:3060] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:33.541181  2976 raft_consensus.cc:2468] T b058a362644348f9bc4f6b34dd84a2f6 P 59527545ee964f0389247722525b5134 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7007c802f3424951bd47a1d364907f0d in term 4.
I20260709 13:13:33.542433  3018 leader_election.cc:304] T b058a362644348f9bc4f6b34dd84a2f6 P 7007c802f3424951bd47a1d364907f0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59527545ee964f0389247722525b5134, 7007c802f3424951bd47a1d364907f0d; no voters: 
I20260709 13:13:33.543032  3125 raft_consensus.cc:2468] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7007c802f3424951bd47a1d364907f0d in term 4.
I20260709 13:13:33.543390  3272 raft_consensus.cc:2804] T b058a362644348f9bc4f6b34dd84a2f6 P 7007c802f3424951bd47a1d364907f0d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:33.544201  3272 raft_consensus.cc:697] T b058a362644348f9bc4f6b34dd84a2f6 P 7007c802f3424951bd47a1d364907f0d [term 4 LEADER]: Becoming Leader. State: Replica: 7007c802f3424951bd47a1d364907f0d, State: Running, Role: LEADER
I20260709 13:13:33.544993  3272 consensus_queue.cc:237] T b058a362644348f9bc4f6b34dd84a2f6 P 7007c802f3424951bd47a1d364907f0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:33.550925  2875 catalog_manager.cc:5697] T b058a362644348f9bc4f6b34dd84a2f6 P 7007c802f3424951bd47a1d364907f0d reported cstate change: term changed from 3 to 4, leader changed from 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195) to 7007c802f3424951bd47a1d364907f0d (127.2.198.194). New cstate: current_term: 4 leader_uuid: "7007c802f3424951bd47a1d364907f0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:33.646821  3125 raft_consensus.cc:1275] T 25b690c4505a418ea5cc5872d5f3c024 P 43a7e3222d3940738dd6a4bc910c4493 [term 2 FOLLOWER]: Refusing update from remote peer 7007c802f3424951bd47a1d364907f0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:33.648061  3272 consensus_queue.cc:1048] T 25b690c4505a418ea5cc5872d5f3c024 P 7007c802f3424951bd47a1d364907f0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:33.660377  2976 raft_consensus.cc:1275] T 25b690c4505a418ea5cc5872d5f3c024 P 59527545ee964f0389247722525b5134 [term 2 FOLLOWER]: Refusing update from remote peer 7007c802f3424951bd47a1d364907f0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:33.662634  3303 consensus_queue.cc:1048] T 25b690c4505a418ea5cc5872d5f3c024 P 7007c802f3424951bd47a1d364907f0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:33.801923  2976 raft_consensus.cc:1275] T b986642580bd45599def5ca69a30b340 P 59527545ee964f0389247722525b5134 [term 3 FOLLOWER]: Refusing update from remote peer 7007c802f3424951bd47a1d364907f0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:33.803526  3303 consensus_queue.cc:1048] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:33.812233  3125 raft_consensus.cc:1275] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493 [term 3 FOLLOWER]: Refusing update from remote peer 7007c802f3424951bd47a1d364907f0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:33.814602  3272 consensus_queue.cc:1048] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:33.969076  3127 raft_consensus.cc:1275] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493 [term 4 FOLLOWER]: Refusing update from remote peer 7007c802f3424951bd47a1d364907f0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:33.970389  3272 consensus_queue.cc:1048] T b058a362644348f9bc4f6b34dd84a2f6 P 7007c802f3424951bd47a1d364907f0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:33.973829  3125 raft_consensus.cc:1275] T 444aad91fdd848f4bfa98cb2169fead6 P 43a7e3222d3940738dd6a4bc910c4493 [term 3 FOLLOWER]: Refusing update from remote peer 7007c802f3424951bd47a1d364907f0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:33.975503  3272 consensus_queue.cc:1048] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:33.981801  2976 raft_consensus.cc:1275] T b058a362644348f9bc4f6b34dd84a2f6 P 59527545ee964f0389247722525b5134 [term 4 FOLLOWER]: Refusing update from remote peer 7007c802f3424951bd47a1d364907f0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:33.985118  3294 consensus_queue.cc:1048] T b058a362644348f9bc4f6b34dd84a2f6 P 7007c802f3424951bd47a1d364907f0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:33.991868  2978 raft_consensus.cc:1275] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134 [term 3 FOLLOWER]: Refusing update from remote peer 7007c802f3424951bd47a1d364907f0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:33.997293  3272 consensus_queue.cc:1048] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:34.064888  2976 raft_consensus.cc:1275] T 83ec256629ea4d6e897bb86ac0e5edf9 P 59527545ee964f0389247722525b5134 [term 3 FOLLOWER]: Refusing update from remote peer 7007c802f3424951bd47a1d364907f0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:34.066171  3272 consensus_queue.cc:1048] T 83ec256629ea4d6e897bb86ac0e5edf9 P 7007c802f3424951bd47a1d364907f0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:34.075102  3127 raft_consensus.cc:1275] T 83ec256629ea4d6e897bb86ac0e5edf9 P 43a7e3222d3940738dd6a4bc910c4493 [term 3 FOLLOWER]: Refusing update from remote peer 7007c802f3424951bd47a1d364907f0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:34.077153  3303 consensus_queue.cc:1048] T 83ec256629ea4d6e897bb86ac0e5edf9 P 7007c802f3424951bd47a1d364907f0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:36.031785  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:36.039527  3053 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25b690c4505a418ea5cc5872d5f3c024"
dest_uuid: "7007c802f3424951bd47a1d364907f0d"
mode: GRACEFUL
new_leader_uuid: "43a7e3222d3940738dd6a4bc910c4493"
 from {username='slave'} at 127.0.0.1:57532
I20260709 13:13:36.040572  3053 raft_consensus.cc:606] T 25b690c4505a418ea5cc5872d5f3c024 P 7007c802f3424951bd47a1d364907f0d [term 2 LEADER]: Received request to transfer leadership to TS 43a7e3222d3940738dd6a4bc910c4493
I20260709 13:13:36.043695  3053 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "444aad91fdd848f4bfa98cb2169fead6"
dest_uuid: "7007c802f3424951bd47a1d364907f0d"
mode: GRACEFUL
new_leader_uuid: "59527545ee964f0389247722525b5134"
 from {username='slave'} at 127.0.0.1:57532
I20260709 13:13:36.044246  3053 raft_consensus.cc:606] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d [term 3 LEADER]: Received request to transfer leadership to TS 59527545ee964f0389247722525b5134
I20260709 13:13:36.046633  3053 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83ec256629ea4d6e897bb86ac0e5edf9"
dest_uuid: "7007c802f3424951bd47a1d364907f0d"
mode: GRACEFUL
new_leader_uuid: "59527545ee964f0389247722525b5134"
 from {username='slave'} at 127.0.0.1:57532
I20260709 13:13:36.047061  3053 raft_consensus.cc:606] T 83ec256629ea4d6e897bb86ac0e5edf9 P 7007c802f3424951bd47a1d364907f0d [term 3 LEADER]: Received request to transfer leadership to TS 59527545ee964f0389247722525b5134
I20260709 13:13:36.049436  3053 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ace31b01377e4d8c8cd691d1cca7212c"
dest_uuid: "7007c802f3424951bd47a1d364907f0d"
mode: GRACEFUL
new_leader_uuid: "59527545ee964f0389247722525b5134"
 from {username='slave'} at 127.0.0.1:57532
I20260709 13:13:36.049861  3053 raft_consensus.cc:606] T ace31b01377e4d8c8cd691d1cca7212c P 7007c802f3424951bd47a1d364907f0d [term 2 LEADER]: Received request to transfer leadership to TS 59527545ee964f0389247722525b5134
I20260709 13:13:36.051960  3053 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b986642580bd45599def5ca69a30b340"
dest_uuid: "7007c802f3424951bd47a1d364907f0d"
mode: GRACEFUL
new_leader_uuid: "43a7e3222d3940738dd6a4bc910c4493"
 from {username='slave'} at 127.0.0.1:57532
I20260709 13:13:36.052371  3053 raft_consensus.cc:606] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d [term 3 LEADER]: Received request to transfer leadership to TS 43a7e3222d3940738dd6a4bc910c4493
I20260709 13:13:36.053354  2843 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:13:36.053938  2843 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:36.098801  3315 raft_consensus.cc:993] T ace31b01377e4d8c8cd691d1cca7212c P 7007c802f3424951bd47a1d364907f0d: : Instructing follower 59527545ee964f0389247722525b5134 to start an election
I20260709 13:13:36.099436  3315 raft_consensus.cc:1081] T ace31b01377e4d8c8cd691d1cca7212c P 7007c802f3424951bd47a1d364907f0d [term 2 LEADER]: Signalling peer 59527545ee964f0389247722525b5134 to start an election
I20260709 13:13:36.101301  2976 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ace31b01377e4d8c8cd691d1cca7212c"
dest_uuid: "59527545ee964f0389247722525b5134"
 from {username='slave'} at 127.0.0.1:58518
I20260709 13:13:36.101742  2976 raft_consensus.cc:493] T ace31b01377e4d8c8cd691d1cca7212c P 59527545ee964f0389247722525b5134 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:36.102133  2976 raft_consensus.cc:3060] T ace31b01377e4d8c8cd691d1cca7212c P 59527545ee964f0389247722525b5134 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:36.108321  2976 raft_consensus.cc:515] T ace31b01377e4d8c8cd691d1cca7212c P 59527545ee964f0389247722525b5134 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:36.109889  2976 leader_election.cc:290] T ace31b01377e4d8c8cd691d1cca7212c P 59527545ee964f0389247722525b5134 [CANDIDATE]: Term 3 election: Requested vote from peers 7007c802f3424951bd47a1d364907f0d (127.2.198.194:37497), 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195:34467)
I20260709 13:13:36.111027  3053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace31b01377e4d8c8cd691d1cca7212c" candidate_uuid: "59527545ee964f0389247722525b5134" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7007c802f3424951bd47a1d364907f0d"
I20260709 13:13:36.111141  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace31b01377e4d8c8cd691d1cca7212c" candidate_uuid: "59527545ee964f0389247722525b5134" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "43a7e3222d3940738dd6a4bc910c4493"
I20260709 13:13:36.111719  3053 raft_consensus.cc:3055] T ace31b01377e4d8c8cd691d1cca7212c P 7007c802f3424951bd47a1d364907f0d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:36.111716  3125 raft_consensus.cc:3060] T ace31b01377e4d8c8cd691d1cca7212c P 43a7e3222d3940738dd6a4bc910c4493 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:36.112033  3053 raft_consensus.cc:740] T ace31b01377e4d8c8cd691d1cca7212c P 7007c802f3424951bd47a1d364907f0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7007c802f3424951bd47a1d364907f0d, State: Running, Role: LEADER
I20260709 13:13:36.112739  3053 consensus_queue.cc:260] T ace31b01377e4d8c8cd691d1cca7212c P 7007c802f3424951bd47a1d364907f0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:36.113706  3053 raft_consensus.cc:3060] T ace31b01377e4d8c8cd691d1cca7212c P 7007c802f3424951bd47a1d364907f0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:36.116997  3125 raft_consensus.cc:2468] T ace31b01377e4d8c8cd691d1cca7212c P 43a7e3222d3940738dd6a4bc910c4493 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59527545ee964f0389247722525b5134 in term 3.
I20260709 13:13:36.118420  2944 leader_election.cc:304] T ace31b01377e4d8c8cd691d1cca7212c P 59527545ee964f0389247722525b5134 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43a7e3222d3940738dd6a4bc910c4493, 59527545ee964f0389247722525b5134; no voters: 
I20260709 13:13:36.119654  3053 raft_consensus.cc:2468] T ace31b01377e4d8c8cd691d1cca7212c P 7007c802f3424951bd47a1d364907f0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59527545ee964f0389247722525b5134 in term 3.
I20260709 13:13:36.120559  3316 raft_consensus.cc:2804] T ace31b01377e4d8c8cd691d1cca7212c P 59527545ee964f0389247722525b5134 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:36.121615  3316 raft_consensus.cc:697] T ace31b01377e4d8c8cd691d1cca7212c P 59527545ee964f0389247722525b5134 [term 3 LEADER]: Becoming Leader. State: Replica: 59527545ee964f0389247722525b5134, State: Running, Role: LEADER
I20260709 13:13:36.122563  3316 consensus_queue.cc:237] T ace31b01377e4d8c8cd691d1cca7212c P 59527545ee964f0389247722525b5134 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:36.130630  2875 catalog_manager.cc:5697] T ace31b01377e4d8c8cd691d1cca7212c P 59527545ee964f0389247722525b5134 reported cstate change: term changed from 2 to 3, leader changed from 7007c802f3424951bd47a1d364907f0d (127.2.198.194) to 59527545ee964f0389247722525b5134 (127.2.198.193). New cstate: current_term: 3 leader_uuid: "59527545ee964f0389247722525b5134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:36.187767  3308 raft_consensus.cc:993] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d: : Instructing follower 59527545ee964f0389247722525b5134 to start an election
I20260709 13:13:36.188231  3315 raft_consensus.cc:1081] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d [term 3 LEADER]: Signalling peer 59527545ee964f0389247722525b5134 to start an election
I20260709 13:13:36.189612  2976 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "444aad91fdd848f4bfa98cb2169fead6"
dest_uuid: "59527545ee964f0389247722525b5134"
 from {username='slave'} at 127.0.0.1:58518
I20260709 13:13:36.190078  2976 raft_consensus.cc:493] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:36.190352  2976 raft_consensus.cc:3060] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:36.194882  2976 raft_consensus.cc:515] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:36.196532  2976 leader_election.cc:290] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134 [CANDIDATE]: Term 4 election: Requested vote from peers 7007c802f3424951bd47a1d364907f0d (127.2.198.194:37497), 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195:34467)
I20260709 13:13:36.197384  3053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444aad91fdd848f4bfa98cb2169fead6" candidate_uuid: "59527545ee964f0389247722525b5134" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7007c802f3424951bd47a1d364907f0d"
I20260709 13:13:36.197993  3053 raft_consensus.cc:3055] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:36.198180  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444aad91fdd848f4bfa98cb2169fead6" candidate_uuid: "59527545ee964f0389247722525b5134" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "43a7e3222d3940738dd6a4bc910c4493"
I20260709 13:13:36.198329  3053 raft_consensus.cc:740] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7007c802f3424951bd47a1d364907f0d, State: Running, Role: LEADER
I20260709 13:13:36.198774  3127 raft_consensus.cc:3060] T 444aad91fdd848f4bfa98cb2169fead6 P 43a7e3222d3940738dd6a4bc910c4493 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:36.199224  3053 consensus_queue.cc:260] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:36.200477  3053 raft_consensus.cc:3060] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:36.206139  3127 raft_consensus.cc:2468] T 444aad91fdd848f4bfa98cb2169fead6 P 43a7e3222d3940738dd6a4bc910c4493 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59527545ee964f0389247722525b5134 in term 4.
I20260709 13:13:36.207324  3053 raft_consensus.cc:2468] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59527545ee964f0389247722525b5134 in term 4.
I20260709 13:13:36.207278  2944 leader_election.cc:304] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43a7e3222d3940738dd6a4bc910c4493, 59527545ee964f0389247722525b5134; no voters: 
I20260709 13:13:36.208240  3316 raft_consensus.cc:2804] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:36.208715  3316 raft_consensus.cc:697] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134 [term 4 LEADER]: Becoming Leader. State: Replica: 59527545ee964f0389247722525b5134, State: Running, Role: LEADER
I20260709 13:13:36.209547  3316 consensus_queue.cc:237] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:36.216145  2875 catalog_manager.cc:5697] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134 reported cstate change: term changed from 3 to 4, leader changed from 7007c802f3424951bd47a1d364907f0d (127.2.198.194) to 59527545ee964f0389247722525b5134 (127.2.198.193). New cstate: current_term: 4 leader_uuid: "59527545ee964f0389247722525b5134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:36.408857  3308 raft_consensus.cc:993] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d: : Instructing follower 43a7e3222d3940738dd6a4bc910c4493 to start an election
I20260709 13:13:36.409570  3315 raft_consensus.cc:1081] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d [term 3 LEADER]: Signalling peer 43a7e3222d3940738dd6a4bc910c4493 to start an election
I20260709 13:13:36.411128  3127 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b986642580bd45599def5ca69a30b340"
dest_uuid: "43a7e3222d3940738dd6a4bc910c4493"
 from {username='slave'} at 127.0.0.1:47142
I20260709 13:13:36.411685  3127 raft_consensus.cc:493] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:36.412003  3127 raft_consensus.cc:3060] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:36.416986  3127 raft_consensus.cc:515] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:36.418725  3127 leader_election.cc:290] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493 [CANDIDATE]: Term 4 election: Requested vote from peers 59527545ee964f0389247722525b5134 (127.2.198.193:40443), 7007c802f3424951bd47a1d364907f0d (127.2.198.194:37497)
I20260709 13:13:36.419623  2976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b986642580bd45599def5ca69a30b340" candidate_uuid: "43a7e3222d3940738dd6a4bc910c4493" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "59527545ee964f0389247722525b5134"
I20260709 13:13:36.419772  3053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b986642580bd45599def5ca69a30b340" candidate_uuid: "43a7e3222d3940738dd6a4bc910c4493" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7007c802f3424951bd47a1d364907f0d"
I20260709 13:13:36.420251  2976 raft_consensus.cc:3060] T b986642580bd45599def5ca69a30b340 P 59527545ee964f0389247722525b5134 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:36.420354  3053 raft_consensus.cc:3055] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:36.420724  3053 raft_consensus.cc:740] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7007c802f3424951bd47a1d364907f0d, State: Running, Role: LEADER
I20260709 13:13:36.421361  3053 consensus_queue.cc:260] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:36.422256  3053 raft_consensus.cc:3060] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:36.424858  2976 raft_consensus.cc:2468] T b986642580bd45599def5ca69a30b340 P 59527545ee964f0389247722525b5134 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43a7e3222d3940738dd6a4bc910c4493 in term 4.
I20260709 13:13:36.426116  3092 leader_election.cc:304] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43a7e3222d3940738dd6a4bc910c4493, 59527545ee964f0389247722525b5134; no voters: 
I20260709 13:13:36.427042  3286 raft_consensus.cc:2804] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:36.427109  3053 raft_consensus.cc:2468] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43a7e3222d3940738dd6a4bc910c4493 in term 4.
I20260709 13:13:36.428634  3286 raft_consensus.cc:697] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493 [term 4 LEADER]: Becoming Leader. State: Replica: 43a7e3222d3940738dd6a4bc910c4493, State: Running, Role: LEADER
I20260709 13:13:36.429575  3286 consensus_queue.cc:237] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:36.437167  2875 catalog_manager.cc:5697] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493 reported cstate change: term changed from 3 to 4, leader changed from 7007c802f3424951bd47a1d364907f0d (127.2.198.194) to 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195). New cstate: current_term: 4 leader_uuid: "43a7e3222d3940738dd6a4bc910c4493" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:36.452836  3324 raft_consensus.cc:993] T 83ec256629ea4d6e897bb86ac0e5edf9 P 7007c802f3424951bd47a1d364907f0d: : Instructing follower 59527545ee964f0389247722525b5134 to start an election
I20260709 13:13:36.453337  3324 raft_consensus.cc:1081] T 83ec256629ea4d6e897bb86ac0e5edf9 P 7007c802f3424951bd47a1d364907f0d [term 3 LEADER]: Signalling peer 59527545ee964f0389247722525b5134 to start an election
I20260709 13:13:36.454756  2976 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "83ec256629ea4d6e897bb86ac0e5edf9"
dest_uuid: "59527545ee964f0389247722525b5134"
 from {username='slave'} at 127.0.0.1:58518
I20260709 13:13:36.455263  2976 raft_consensus.cc:493] T 83ec256629ea4d6e897bb86ac0e5edf9 P 59527545ee964f0389247722525b5134 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:36.455621  2976 raft_consensus.cc:3060] T 83ec256629ea4d6e897bb86ac0e5edf9 P 59527545ee964f0389247722525b5134 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:36.461537  2976 raft_consensus.cc:515] T 83ec256629ea4d6e897bb86ac0e5edf9 P 59527545ee964f0389247722525b5134 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } } peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } }
I20260709 13:13:36.462844  2976 leader_election.cc:290] T 83ec256629ea4d6e897bb86ac0e5edf9 P 59527545ee964f0389247722525b5134 [CANDIDATE]: Term 4 election: Requested vote from peers 7007c802f3424951bd47a1d364907f0d (127.2.198.194:37497), 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195:34467)
I20260709 13:13:36.463747  3053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ec256629ea4d6e897bb86ac0e5edf9" candidate_uuid: "59527545ee964f0389247722525b5134" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7007c802f3424951bd47a1d364907f0d"
I20260709 13:13:36.463892  3127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ec256629ea4d6e897bb86ac0e5edf9" candidate_uuid: "59527545ee964f0389247722525b5134" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "43a7e3222d3940738dd6a4bc910c4493"
I20260709 13:13:36.464242  3053 raft_consensus.cc:3055] T 83ec256629ea4d6e897bb86ac0e5edf9 P 7007c802f3424951bd47a1d364907f0d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:36.464423  3127 raft_consensus.cc:3060] T 83ec256629ea4d6e897bb86ac0e5edf9 P 43a7e3222d3940738dd6a4bc910c4493 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:36.464547  3053 raft_consensus.cc:740] T 83ec256629ea4d6e897bb86ac0e5edf9 P 7007c802f3424951bd47a1d364907f0d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7007c802f3424951bd47a1d364907f0d, State: Running, Role: LEADER
I20260709 13:13:36.465255  3053 consensus_queue.cc:260] T 83ec256629ea4d6e897bb86ac0e5edf9 P 7007c802f3424951bd47a1d364907f0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } } peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } }
I20260709 13:13:36.466090  3053 raft_consensus.cc:3060] T 83ec256629ea4d6e897bb86ac0e5edf9 P 7007c802f3424951bd47a1d364907f0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:36.469700  3127 raft_consensus.cc:2468] T 83ec256629ea4d6e897bb86ac0e5edf9 P 43a7e3222d3940738dd6a4bc910c4493 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59527545ee964f0389247722525b5134 in term 4.
I20260709 13:13:36.470615  3053 raft_consensus.cc:2468] T 83ec256629ea4d6e897bb86ac0e5edf9 P 7007c802f3424951bd47a1d364907f0d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59527545ee964f0389247722525b5134 in term 4.
I20260709 13:13:36.470728  2944 leader_election.cc:304] T 83ec256629ea4d6e897bb86ac0e5edf9 P 59527545ee964f0389247722525b5134 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43a7e3222d3940738dd6a4bc910c4493, 59527545ee964f0389247722525b5134; no voters: 
I20260709 13:13:36.471644  3316 raft_consensus.cc:2804] T 83ec256629ea4d6e897bb86ac0e5edf9 P 59527545ee964f0389247722525b5134 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:36.472110  3316 raft_consensus.cc:697] T 83ec256629ea4d6e897bb86ac0e5edf9 P 59527545ee964f0389247722525b5134 [term 4 LEADER]: Becoming Leader. State: Replica: 59527545ee964f0389247722525b5134, State: Running, Role: LEADER
I20260709 13:13:36.472846  3316 consensus_queue.cc:237] T 83ec256629ea4d6e897bb86ac0e5edf9 P 59527545ee964f0389247722525b5134 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } } peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } }
I20260709 13:13:36.480607  2875 catalog_manager.cc:5697] T 83ec256629ea4d6e897bb86ac0e5edf9 P 59527545ee964f0389247722525b5134 reported cstate change: term changed from 3 to 4, leader changed from 7007c802f3424951bd47a1d364907f0d (127.2.198.194) to 59527545ee964f0389247722525b5134 (127.2.198.193). New cstate: current_term: 4 leader_uuid: "59527545ee964f0389247722525b5134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:36.490896  3315 raft_consensus.cc:993] T 25b690c4505a418ea5cc5872d5f3c024 P 7007c802f3424951bd47a1d364907f0d: : Instructing follower 43a7e3222d3940738dd6a4bc910c4493 to start an election
I20260709 13:13:36.491416  3315 raft_consensus.cc:1081] T 25b690c4505a418ea5cc5872d5f3c024 P 7007c802f3424951bd47a1d364907f0d [term 2 LEADER]: Signalling peer 43a7e3222d3940738dd6a4bc910c4493 to start an election
I20260709 13:13:36.492980  3127 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25b690c4505a418ea5cc5872d5f3c024"
dest_uuid: "43a7e3222d3940738dd6a4bc910c4493"
 from {username='slave'} at 127.0.0.1:47142
I20260709 13:13:36.493552  3127 raft_consensus.cc:493] T 25b690c4505a418ea5cc5872d5f3c024 P 43a7e3222d3940738dd6a4bc910c4493 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:36.493984  3127 raft_consensus.cc:3060] T 25b690c4505a418ea5cc5872d5f3c024 P 43a7e3222d3940738dd6a4bc910c4493 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:36.501230  3127 raft_consensus.cc:515] T 25b690c4505a418ea5cc5872d5f3c024 P 43a7e3222d3940738dd6a4bc910c4493 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:36.503242  3127 leader_election.cc:290] T 25b690c4505a418ea5cc5872d5f3c024 P 43a7e3222d3940738dd6a4bc910c4493 [CANDIDATE]: Term 3 election: Requested vote from peers 59527545ee964f0389247722525b5134 (127.2.198.193:40443), 7007c802f3424951bd47a1d364907f0d (127.2.198.194:37497)
I20260709 13:13:36.504123  2976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25b690c4505a418ea5cc5872d5f3c024" candidate_uuid: "43a7e3222d3940738dd6a4bc910c4493" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "59527545ee964f0389247722525b5134"
I20260709 13:13:36.504257  3053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25b690c4505a418ea5cc5872d5f3c024" candidate_uuid: "43a7e3222d3940738dd6a4bc910c4493" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7007c802f3424951bd47a1d364907f0d"
I20260709 13:13:36.504700  2976 raft_consensus.cc:3060] T 25b690c4505a418ea5cc5872d5f3c024 P 59527545ee964f0389247722525b5134 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:36.504808  3053 raft_consensus.cc:3055] T 25b690c4505a418ea5cc5872d5f3c024 P 7007c802f3424951bd47a1d364907f0d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:36.505177  3053 raft_consensus.cc:740] T 25b690c4505a418ea5cc5872d5f3c024 P 7007c802f3424951bd47a1d364907f0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7007c802f3424951bd47a1d364907f0d, State: Running, Role: LEADER
I20260709 13:13:36.505870  3053 consensus_queue.cc:260] T 25b690c4505a418ea5cc5872d5f3c024 P 7007c802f3424951bd47a1d364907f0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:36.506696  3053 raft_consensus.cc:3060] T 25b690c4505a418ea5cc5872d5f3c024 P 7007c802f3424951bd47a1d364907f0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:36.509224  2976 raft_consensus.cc:2468] T 25b690c4505a418ea5cc5872d5f3c024 P 59527545ee964f0389247722525b5134 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43a7e3222d3940738dd6a4bc910c4493 in term 3.
I20260709 13:13:36.510107  3092 leader_election.cc:304] T 25b690c4505a418ea5cc5872d5f3c024 P 43a7e3222d3940738dd6a4bc910c4493 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43a7e3222d3940738dd6a4bc910c4493, 59527545ee964f0389247722525b5134; no voters: 
I20260709 13:13:36.510833  3286 raft_consensus.cc:2804] T 25b690c4505a418ea5cc5872d5f3c024 P 43a7e3222d3940738dd6a4bc910c4493 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:36.511227  3286 raft_consensus.cc:697] T 25b690c4505a418ea5cc5872d5f3c024 P 43a7e3222d3940738dd6a4bc910c4493 [term 3 LEADER]: Becoming Leader. State: Replica: 43a7e3222d3940738dd6a4bc910c4493, State: Running, Role: LEADER
I20260709 13:13:36.511490  3053 raft_consensus.cc:2468] T 25b690c4505a418ea5cc5872d5f3c024 P 7007c802f3424951bd47a1d364907f0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43a7e3222d3940738dd6a4bc910c4493 in term 3.
I20260709 13:13:36.512089  3286 consensus_queue.cc:237] T 25b690c4505a418ea5cc5872d5f3c024 P 43a7e3222d3940738dd6a4bc910c4493 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } }
I20260709 13:13:36.519069  2875 catalog_manager.cc:5697] T 25b690c4505a418ea5cc5872d5f3c024 P 43a7e3222d3940738dd6a4bc910c4493 reported cstate change: term changed from 2 to 3, leader changed from 7007c802f3424951bd47a1d364907f0d (127.2.198.194) to 43a7e3222d3940738dd6a4bc910c4493 (127.2.198.195). New cstate: current_term: 3 leader_uuid: "43a7e3222d3940738dd6a4bc910c4493" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:36.581262  3053 raft_consensus.cc:1275] T ace31b01377e4d8c8cd691d1cca7212c P 7007c802f3424951bd47a1d364907f0d [term 3 FOLLOWER]: Refusing update from remote peer 59527545ee964f0389247722525b5134: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:36.582814  3316 consensus_queue.cc:1048] T ace31b01377e4d8c8cd691d1cca7212c P 59527545ee964f0389247722525b5134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:36.594133  3127 raft_consensus.cc:1275] T ace31b01377e4d8c8cd691d1cca7212c P 43a7e3222d3940738dd6a4bc910c4493 [term 3 FOLLOWER]: Refusing update from remote peer 59527545ee964f0389247722525b5134: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:36.597223  3317 consensus_queue.cc:1048] T ace31b01377e4d8c8cd691d1cca7212c P 59527545ee964f0389247722525b5134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:36.668710  3053 raft_consensus.cc:1275] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d [term 4 FOLLOWER]: Refusing update from remote peer 59527545ee964f0389247722525b5134: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:36.670076  3317 consensus_queue.cc:1048] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:36.679667  3127 raft_consensus.cc:1275] T 444aad91fdd848f4bfa98cb2169fead6 P 43a7e3222d3940738dd6a4bc910c4493 [term 4 FOLLOWER]: Refusing update from remote peer 59527545ee964f0389247722525b5134: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:36.681387  3316 consensus_queue.cc:1048] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:36.902359  2978 raft_consensus.cc:1275] T b986642580bd45599def5ca69a30b340 P 59527545ee964f0389247722525b5134 [term 4 FOLLOWER]: Refusing update from remote peer 43a7e3222d3940738dd6a4bc910c4493: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:36.903755  3325 consensus_queue.cc:1048] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:36.913460  3053 raft_consensus.cc:1275] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d [term 4 FOLLOWER]: Refusing update from remote peer 43a7e3222d3940738dd6a4bc910c4493: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:36.916170  3325 consensus_queue.cc:1048] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:36.994457  2978 raft_consensus.cc:1275] T 25b690c4505a418ea5cc5872d5f3c024 P 59527545ee964f0389247722525b5134 [term 3 FOLLOWER]: Refusing update from remote peer 43a7e3222d3940738dd6a4bc910c4493: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:36.995994  3325 consensus_queue.cc:1048] T 25b690c4505a418ea5cc5872d5f3c024 P 43a7e3222d3940738dd6a4bc910c4493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59527545ee964f0389247722525b5134" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 40443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:37.006297  3053 raft_consensus.cc:1275] T 25b690c4505a418ea5cc5872d5f3c024 P 7007c802f3424951bd47a1d364907f0d [term 3 FOLLOWER]: Refusing update from remote peer 43a7e3222d3940738dd6a4bc910c4493: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:37.007786  3286 consensus_queue.cc:1048] T 25b690c4505a418ea5cc5872d5f3c024 P 43a7e3222d3940738dd6a4bc910c4493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:37.033809  3127 raft_consensus.cc:1275] T 83ec256629ea4d6e897bb86ac0e5edf9 P 43a7e3222d3940738dd6a4bc910c4493 [term 4 FOLLOWER]: Refusing update from remote peer 59527545ee964f0389247722525b5134: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:37.035300  3316 consensus_queue.cc:1048] T 83ec256629ea4d6e897bb86ac0e5edf9 P 59527545ee964f0389247722525b5134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43a7e3222d3940738dd6a4bc910c4493" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:37.044708  3053 raft_consensus.cc:1275] T 83ec256629ea4d6e897bb86ac0e5edf9 P 7007c802f3424951bd47a1d364907f0d [term 4 FOLLOWER]: Refusing update from remote peer 59527545ee964f0389247722525b5134: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:37.046475  3335 consensus_queue.cc:1048] T 83ec256629ea4d6e897bb86ac0e5edf9 P 59527545ee964f0389247722525b5134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7007c802f3424951bd47a1d364907f0d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:37.054864  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:37.063277  2843 tablet_server.cc:179] TabletServer@127.2.198.193:0 shutting down...
I20260709 13:13:37.102229  2843 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:37.102994  2843 tablet_replica.cc:333] T 25b690c4505a418ea5cc5872d5f3c024 P 59527545ee964f0389247722525b5134: stopping tablet replica
I20260709 13:13:37.103937  2843 raft_consensus.cc:2243] T 25b690c4505a418ea5cc5872d5f3c024 P 59527545ee964f0389247722525b5134 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.104502  2843 raft_consensus.cc:2272] T 25b690c4505a418ea5cc5872d5f3c024 P 59527545ee964f0389247722525b5134 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.107434  2843 tablet_replica.cc:333] T c1b86f88c52644e9abd09601beab6e58 P 59527545ee964f0389247722525b5134: stopping tablet replica
I20260709 13:13:37.108091  2843 raft_consensus.cc:2243] T c1b86f88c52644e9abd09601beab6e58 P 59527545ee964f0389247722525b5134 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.108532  2843 raft_consensus.cc:2272] T c1b86f88c52644e9abd09601beab6e58 P 59527545ee964f0389247722525b5134 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.110247  2843 tablet_replica.cc:333] T b986642580bd45599def5ca69a30b340 P 59527545ee964f0389247722525b5134: stopping tablet replica
I20260709 13:13:37.110808  2843 raft_consensus.cc:2243] T b986642580bd45599def5ca69a30b340 P 59527545ee964f0389247722525b5134 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.111245  2843 raft_consensus.cc:2272] T b986642580bd45599def5ca69a30b340 P 59527545ee964f0389247722525b5134 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.113274  2843 tablet_replica.cc:333] T b058a362644348f9bc4f6b34dd84a2f6 P 59527545ee964f0389247722525b5134: stopping tablet replica
I20260709 13:13:37.113863  2843 raft_consensus.cc:2243] T b058a362644348f9bc4f6b34dd84a2f6 P 59527545ee964f0389247722525b5134 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.114315  2843 raft_consensus.cc:2272] T b058a362644348f9bc4f6b34dd84a2f6 P 59527545ee964f0389247722525b5134 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.116110  2843 tablet_replica.cc:333] T ace31b01377e4d8c8cd691d1cca7212c P 59527545ee964f0389247722525b5134: stopping tablet replica
I20260709 13:13:37.116621  2843 raft_consensus.cc:2243] T ace31b01377e4d8c8cd691d1cca7212c P 59527545ee964f0389247722525b5134 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:37.117399  2843 raft_consensus.cc:2272] T ace31b01377e4d8c8cd691d1cca7212c P 59527545ee964f0389247722525b5134 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.119407  2843 tablet_replica.cc:333] T f20668f7380e4e87a6ae970612dd3a20 P 59527545ee964f0389247722525b5134: stopping tablet replica
I20260709 13:13:37.119943  2843 raft_consensus.cc:2243] T f20668f7380e4e87a6ae970612dd3a20 P 59527545ee964f0389247722525b5134 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.120357  2843 raft_consensus.cc:2272] T f20668f7380e4e87a6ae970612dd3a20 P 59527545ee964f0389247722525b5134 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.122112  2843 tablet_replica.cc:333] T 83ec256629ea4d6e897bb86ac0e5edf9 P 59527545ee964f0389247722525b5134: stopping tablet replica
I20260709 13:13:37.122610  2843 raft_consensus.cc:2243] T 83ec256629ea4d6e897bb86ac0e5edf9 P 59527545ee964f0389247722525b5134 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:13:37.123381  2843 raft_consensus.cc:2272] T 83ec256629ea4d6e897bb86ac0e5edf9 P 59527545ee964f0389247722525b5134 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.125288  2843 tablet_replica.cc:333] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134: stopping tablet replica
I20260709 13:13:37.125771  2843 raft_consensus.cc:2243] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:13:37.126509  2843 raft_consensus.cc:2272] T 444aad91fdd848f4bfa98cb2169fead6 P 59527545ee964f0389247722525b5134 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.128298  2843 tablet_replica.cc:333] T 1bd75affab0f45fe8e66f22aa2142a9b P 59527545ee964f0389247722525b5134: stopping tablet replica
I20260709 13:13:37.128750  2843 raft_consensus.cc:2243] T 1bd75affab0f45fe8e66f22aa2142a9b P 59527545ee964f0389247722525b5134 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.129166  2843 raft_consensus.cc:2272] T 1bd75affab0f45fe8e66f22aa2142a9b P 59527545ee964f0389247722525b5134 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:37.231395  3092 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.198.193:40443: connect: Connection refused (error 111)
I20260709 13:13:37.235320  2843 tablet_server.cc:196] TabletServer@127.2.198.193:0 shutdown complete.
W20260709 13:13:37.235909  3092 consensus_peers.cc:597] T c1b86f88c52644e9abd09601beab6e58 P 43a7e3222d3940738dd6a4bc910c4493 -> Peer 59527545ee964f0389247722525b5134 (127.2.198.193:40443): Couldn't send request to peer 59527545ee964f0389247722525b5134. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:40443: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:37.257486  2843 tablet_server.cc:179] TabletServer@127.2.198.194:0 shutting down...
I20260709 13:13:37.283735  2843 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:37.284471  2843 tablet_replica.cc:333] T 1bd75affab0f45fe8e66f22aa2142a9b P 7007c802f3424951bd47a1d364907f0d: stopping tablet replica
I20260709 13:13:37.285099  2843 raft_consensus.cc:2243] T 1bd75affab0f45fe8e66f22aa2142a9b P 7007c802f3424951bd47a1d364907f0d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:37.285961  2843 raft_consensus.cc:2272] T 1bd75affab0f45fe8e66f22aa2142a9b P 7007c802f3424951bd47a1d364907f0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.287952  2843 tablet_replica.cc:333] T 25b690c4505a418ea5cc5872d5f3c024 P 7007c802f3424951bd47a1d364907f0d: stopping tablet replica
I20260709 13:13:37.288491  2843 raft_consensus.cc:2243] T 25b690c4505a418ea5cc5872d5f3c024 P 7007c802f3424951bd47a1d364907f0d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.288924  2843 raft_consensus.cc:2272] T 25b690c4505a418ea5cc5872d5f3c024 P 7007c802f3424951bd47a1d364907f0d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.291059  2843 tablet_replica.cc:333] T ace31b01377e4d8c8cd691d1cca7212c P 7007c802f3424951bd47a1d364907f0d: stopping tablet replica
I20260709 13:13:37.291702  2843 raft_consensus.cc:2243] T ace31b01377e4d8c8cd691d1cca7212c P 7007c802f3424951bd47a1d364907f0d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.292135  2843 raft_consensus.cc:2272] T ace31b01377e4d8c8cd691d1cca7212c P 7007c802f3424951bd47a1d364907f0d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.294446  2843 tablet_replica.cc:333] T b058a362644348f9bc4f6b34dd84a2f6 P 7007c802f3424951bd47a1d364907f0d: stopping tablet replica
I20260709 13:13:37.294989  2843 raft_consensus.cc:2243] T b058a362644348f9bc4f6b34dd84a2f6 P 7007c802f3424951bd47a1d364907f0d [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:13:37.295921  2843 raft_consensus.cc:2272] T b058a362644348f9bc4f6b34dd84a2f6 P 7007c802f3424951bd47a1d364907f0d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.297673  2843 tablet_replica.cc:333] T c1b86f88c52644e9abd09601beab6e58 P 7007c802f3424951bd47a1d364907f0d: stopping tablet replica
I20260709 13:13:37.298221  2843 raft_consensus.cc:2243] T c1b86f88c52644e9abd09601beab6e58 P 7007c802f3424951bd47a1d364907f0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.298662  2843 raft_consensus.cc:2272] T c1b86f88c52644e9abd09601beab6e58 P 7007c802f3424951bd47a1d364907f0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.300446  2843 tablet_replica.cc:333] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d: stopping tablet replica
I20260709 13:13:37.301000  2843 raft_consensus.cc:2243] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.301399  2843 raft_consensus.cc:2272] T 444aad91fdd848f4bfa98cb2169fead6 P 7007c802f3424951bd47a1d364907f0d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.303680  2843 tablet_replica.cc:333] T f20668f7380e4e87a6ae970612dd3a20 P 7007c802f3424951bd47a1d364907f0d: stopping tablet replica
I20260709 13:13:37.304191  2843 raft_consensus.cc:2243] T f20668f7380e4e87a6ae970612dd3a20 P 7007c802f3424951bd47a1d364907f0d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:37.305001  2843 raft_consensus.cc:2272] T f20668f7380e4e87a6ae970612dd3a20 P 7007c802f3424951bd47a1d364907f0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.306682  2843 tablet_replica.cc:333] T 83ec256629ea4d6e897bb86ac0e5edf9 P 7007c802f3424951bd47a1d364907f0d: stopping tablet replica
I20260709 13:13:37.307168  2843 raft_consensus.cc:2243] T 83ec256629ea4d6e897bb86ac0e5edf9 P 7007c802f3424951bd47a1d364907f0d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.307614  2843 raft_consensus.cc:2272] T 83ec256629ea4d6e897bb86ac0e5edf9 P 7007c802f3424951bd47a1d364907f0d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.309805  2843 tablet_replica.cc:333] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d: stopping tablet replica
I20260709 13:13:37.310271  2843 raft_consensus.cc:2243] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.310662  2843 raft_consensus.cc:2272] T b986642580bd45599def5ca69a30b340 P 7007c802f3424951bd47a1d364907f0d [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:37.320665  3091 consensus_peers.cc:597] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493 -> Peer 7007c802f3424951bd47a1d364907f0d (127.2.198.194:37497): Couldn't send request to peer 7007c802f3424951bd47a1d364907f0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:37.342100  2843 tablet_server.cc:196] TabletServer@127.2.198.194:0 shutdown complete.
W20260709 13:13:37.348470  3092 consensus_peers.cc:597] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493 -> Peer 59527545ee964f0389247722525b5134 (127.2.198.193:40443): Couldn't send request to peer 59527545ee964f0389247722525b5134. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:40443: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:37.362857  2843 tablet_server.cc:179] TabletServer@127.2.198.195:0 shutting down...
W20260709 13:13:37.390411  3092 consensus_peers.cc:597] T 25b690c4505a418ea5cc5872d5f3c024 P 43a7e3222d3940738dd6a4bc910c4493 -> Peer 59527545ee964f0389247722525b5134 (127.2.198.193:40443): Couldn't send request to peer 59527545ee964f0389247722525b5134. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:40443: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:37.391819  2843 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:37.392458  2843 tablet_replica.cc:333] T 25b690c4505a418ea5cc5872d5f3c024 P 43a7e3222d3940738dd6a4bc910c4493: stopping tablet replica
I20260709 13:13:37.393147  2843 raft_consensus.cc:2243] T 25b690c4505a418ea5cc5872d5f3c024 P 43a7e3222d3940738dd6a4bc910c4493 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:37.394012  2843 raft_consensus.cc:2272] T 25b690c4505a418ea5cc5872d5f3c024 P 43a7e3222d3940738dd6a4bc910c4493 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.396180  2843 tablet_replica.cc:333] T c1b86f88c52644e9abd09601beab6e58 P 43a7e3222d3940738dd6a4bc910c4493: stopping tablet replica
I20260709 13:13:37.396739  2843 raft_consensus.cc:2243] T c1b86f88c52644e9abd09601beab6e58 P 43a7e3222d3940738dd6a4bc910c4493 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:37.397486  2843 raft_consensus.cc:2272] T c1b86f88c52644e9abd09601beab6e58 P 43a7e3222d3940738dd6a4bc910c4493 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.399201  2843 tablet_replica.cc:333] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493: stopping tablet replica
I20260709 13:13:37.399809  2843 raft_consensus.cc:2243] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:13:37.400553  2843 raft_consensus.cc:2272] T b986642580bd45599def5ca69a30b340 P 43a7e3222d3940738dd6a4bc910c4493 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.403122  2843 tablet_replica.cc:333] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493: stopping tablet replica
I20260709 13:13:37.403779  2843 raft_consensus.cc:2243] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.404220  2843 raft_consensus.cc:2272] T b058a362644348f9bc4f6b34dd84a2f6 P 43a7e3222d3940738dd6a4bc910c4493 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.405889  2843 tablet_replica.cc:333] T ace31b01377e4d8c8cd691d1cca7212c P 43a7e3222d3940738dd6a4bc910c4493: stopping tablet replica
I20260709 13:13:37.406394  2843 raft_consensus.cc:2243] T ace31b01377e4d8c8cd691d1cca7212c P 43a7e3222d3940738dd6a4bc910c4493 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.406807  2843 raft_consensus.cc:2272] T ace31b01377e4d8c8cd691d1cca7212c P 43a7e3222d3940738dd6a4bc910c4493 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.408865  2843 tablet_replica.cc:333] T f20668f7380e4e87a6ae970612dd3a20 P 43a7e3222d3940738dd6a4bc910c4493: stopping tablet replica
I20260709 13:13:37.409376  2843 raft_consensus.cc:2243] T f20668f7380e4e87a6ae970612dd3a20 P 43a7e3222d3940738dd6a4bc910c4493 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.409861  2843 raft_consensus.cc:2272] T f20668f7380e4e87a6ae970612dd3a20 P 43a7e3222d3940738dd6a4bc910c4493 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.411490  2843 tablet_replica.cc:333] T 83ec256629ea4d6e897bb86ac0e5edf9 P 43a7e3222d3940738dd6a4bc910c4493: stopping tablet replica
I20260709 13:13:37.412034  2843 raft_consensus.cc:2243] T 83ec256629ea4d6e897bb86ac0e5edf9 P 43a7e3222d3940738dd6a4bc910c4493 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.412493  2843 raft_consensus.cc:2272] T 83ec256629ea4d6e897bb86ac0e5edf9 P 43a7e3222d3940738dd6a4bc910c4493 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.414521  2843 tablet_replica.cc:333] T 444aad91fdd848f4bfa98cb2169fead6 P 43a7e3222d3940738dd6a4bc910c4493: stopping tablet replica
I20260709 13:13:37.415014  2843 raft_consensus.cc:2243] T 444aad91fdd848f4bfa98cb2169fead6 P 43a7e3222d3940738dd6a4bc910c4493 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.415395  2843 raft_consensus.cc:2272] T 444aad91fdd848f4bfa98cb2169fead6 P 43a7e3222d3940738dd6a4bc910c4493 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.417313  2843 tablet_replica.cc:333] T 1bd75affab0f45fe8e66f22aa2142a9b P 43a7e3222d3940738dd6a4bc910c4493: stopping tablet replica
I20260709 13:13:37.417788  2843 raft_consensus.cc:2243] T 1bd75affab0f45fe8e66f22aa2142a9b P 43a7e3222d3940738dd6a4bc910c4493 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.418186  2843 raft_consensus.cc:2272] T 1bd75affab0f45fe8e66f22aa2142a9b P 43a7e3222d3940738dd6a4bc910c4493 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.445842  2843 tablet_server.cc:196] TabletServer@127.2.198.195:0 shutdown complete.
I20260709 13:13:37.465553  2843 master.cc:562] Master@127.2.198.254:46137 shutting down...
I20260709 13:13:37.690416  2843 raft_consensus.cc:2243] T 00000000000000000000000000000000 P ca239762827c4fab8e3fc3b7027923ea [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:37.691037  2843 raft_consensus.cc:2272] T 00000000000000000000000000000000 P ca239762827c4fab8e3fc3b7027923ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.691350  2843 tablet_replica.cc:333] T 00000000000000000000000000000000 P ca239762827c4fab8e3fc3b7027923ea: stopping tablet replica
I20260709 13:13:37.710927  2843 master.cc:584] Master@127.2.198.254:46137 shutdown complete.
43a7e3222d3940738dd6a4bc910c4493  1
59527545ee964f0389247722525b5134  4
7007c802f3424951bd47a1d364907f0d  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (12922 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:13:37.754464  2843 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.198.254:46749
I20260709 13:13:37.755813  2843 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:37.761945  3346 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:37.762107  3347 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:37.763034  3349 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:37.764469  2843 server_base.cc:1061] running on GCE node
I20260709 13:13:37.765343  2843 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:37.765517  2843 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:37.765722  2843 hybrid_clock.cc:648] HybridClock initialized: now 1783602817765685 us; error 0 us; skew 500 ppm
I20260709 13:13:37.766287  2843 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:37.768909  2843 webserver.cc:533] Webserver started at http://127.2.198.254:42419/ using document root <none> and password file <none>
I20260709 13:13:37.769423  2843 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:37.769629  2843 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:37.769927  2843 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:37.771133  2843 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602804652623-2843-0/minicluster-data/master-0-root/instance:
uuid: "7f922d8000cf45ec94648a96fcc922af"
format_stamp: "Formatted at 2026-07-09 13:13:37 on dist-test-slave-fc6v"
I20260709 13:13:37.775729  2843 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 13:13:37.779105  3354 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:37.779871  2843 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:13:37.780158  2843 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602804652623-2843-0/minicluster-data/master-0-root
uuid: "7f922d8000cf45ec94648a96fcc922af"
format_stamp: "Formatted at 2026-07-09 13:13:37 on dist-test-slave-fc6v"
I20260709 13:13:37.780432  2843 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602804652623-2843-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602804652623-2843-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602804652623-2843-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:37.814846  2843 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:37.816303  2843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:37.859117  2843 rpc_server.cc:307] RPC server started. Bound to: 127.2.198.254:46749
I20260709 13:13:37.859251  3405 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.198.254:46749 every 8 connection(s)
I20260709 13:13:37.863462  3406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.873920  3406 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f922d8000cf45ec94648a96fcc922af: Bootstrap starting.
I20260709 13:13:37.879070  3406 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7f922d8000cf45ec94648a96fcc922af: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.883657  3406 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f922d8000cf45ec94648a96fcc922af: No bootstrap required, opened a new log
I20260709 13:13:37.885949  3406 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7f922d8000cf45ec94648a96fcc922af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f922d8000cf45ec94648a96fcc922af" member_type: VOTER }
I20260709 13:13:37.886389  3406 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7f922d8000cf45ec94648a96fcc922af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.886577  3406 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7f922d8000cf45ec94648a96fcc922af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f922d8000cf45ec94648a96fcc922af, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.887101  3406 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7f922d8000cf45ec94648a96fcc922af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f922d8000cf45ec94648a96fcc922af" member_type: VOTER }
I20260709 13:13:37.887521  3406 raft_consensus.cc:399] T 00000000000000000000000000000000 P 7f922d8000cf45ec94648a96fcc922af [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:13:37.887817  3406 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7f922d8000cf45ec94648a96fcc922af [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:13:37.888055  3406 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7f922d8000cf45ec94648a96fcc922af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.892457  3406 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7f922d8000cf45ec94648a96fcc922af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f922d8000cf45ec94648a96fcc922af" member_type: VOTER }
I20260709 13:13:37.892966  3406 leader_election.cc:304] T 00000000000000000000000000000000 P 7f922d8000cf45ec94648a96fcc922af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7f922d8000cf45ec94648a96fcc922af; no voters: 
I20260709 13:13:37.894147  3406 leader_election.cc:290] T 00000000000000000000000000000000 P 7f922d8000cf45ec94648a96fcc922af [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:13:37.894579  3409 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7f922d8000cf45ec94648a96fcc922af [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:37.896045  3409 raft_consensus.cc:697] T 00000000000000000000000000000000 P 7f922d8000cf45ec94648a96fcc922af [term 1 LEADER]: Becoming Leader. State: Replica: 7f922d8000cf45ec94648a96fcc922af, State: Running, Role: LEADER
I20260709 13:13:37.896654  3409 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7f922d8000cf45ec94648a96fcc922af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f922d8000cf45ec94648a96fcc922af" member_type: VOTER }
I20260709 13:13:37.897354  3406 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7f922d8000cf45ec94648a96fcc922af [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:13:37.901544  3410 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f922d8000cf45ec94648a96fcc922af [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7f922d8000cf45ec94648a96fcc922af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f922d8000cf45ec94648a96fcc922af" member_type: VOTER } }
I20260709 13:13:37.903280  3410 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f922d8000cf45ec94648a96fcc922af [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:37.902642  3411 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f922d8000cf45ec94648a96fcc922af [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7f922d8000cf45ec94648a96fcc922af. Latest consensus state: current_term: 1 leader_uuid: "7f922d8000cf45ec94648a96fcc922af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f922d8000cf45ec94648a96fcc922af" member_type: VOTER } }
I20260709 13:13:37.904434  3411 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f922d8000cf45ec94648a96fcc922af [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:37.906255  3417 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:13:37.914376  3417 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:13:37.915387  2843 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:13:37.923388  3417 catalog_manager.cc:1383] Generated new cluster ID: 3e5573910b564e80b4a8d9e2e32548ac
I20260709 13:13:37.923734  3417 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:13:37.947114  3417 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:13:37.948532  3417 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:13:37.964092  3417 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 7f922d8000cf45ec94648a96fcc922af: Generated new TSK 0
I20260709 13:13:37.964807  3417 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:13:37.981910  2843 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:37.988538  3427 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:37.989768  3428 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:37.991211  3430 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:37.991710  2843 server_base.cc:1061] running on GCE node
I20260709 13:13:37.992605  2843 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:37.992795  2843 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:37.992930  2843 hybrid_clock.cc:648] HybridClock initialized: now 1783602817992912 us; error 0 us; skew 500 ppm
I20260709 13:13:37.993412  2843 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:37.995900  2843 webserver.cc:533] Webserver started at http://127.2.198.193:36151/ using document root <none> and password file <none>
I20260709 13:13:37.996402  2843 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:37.996567  2843 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:37.996790  2843 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:37.997865  2843 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602804652623-2843-0/minicluster-data/ts-0-root/instance:
uuid: "6b0316ac722f4603bd53197367ed1c4d"
format_stamp: "Formatted at 2026-07-09 13:13:37 on dist-test-slave-fc6v"
I20260709 13:13:38.002667  2843 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.005s
I20260709 13:13:38.006238  3435 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:38.007025  2843 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:13:38.007329  2843 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602804652623-2843-0/minicluster-data/ts-0-root
uuid: "6b0316ac722f4603bd53197367ed1c4d"
format_stamp: "Formatted at 2026-07-09 13:13:37 on dist-test-slave-fc6v"
I20260709 13:13:38.007701  2843 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602804652623-2843-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602804652623-2843-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602804652623-2843-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:38.024185  2843 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:38.025637  2843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:38.027294  2843 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:38.029763  2843 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:38.029994  2843 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:38.030254  2843 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:38.030448  2843 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:38.075474  2843 rpc_server.cc:307] RPC server started. Bound to: 127.2.198.193:44435
I20260709 13:13:38.075613  3497 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.198.193:44435 every 8 connection(s)
I20260709 13:13:38.081001  2843 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:38.089507  3502 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:38.091003  3503 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:38.094333  2843 server_base.cc:1061] running on GCE node
W20260709 13:13:38.094902  3505 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:38.095656  3498 heartbeater.cc:344] Connected to a master server at 127.2.198.254:46749
I20260709 13:13:38.096004  2843 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:13:38.096042  3498 heartbeater.cc:461] Registering TS with master...
W20260709 13:13:38.096339  2843 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:38.096544  2843 hybrid_clock.cc:648] HybridClock initialized: now 1783602818096511 us; error 0 us; skew 500 ppm
I20260709 13:13:38.097131  2843 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:38.097072  3498 heartbeater.cc:507] Master 127.2.198.254:46749 requested a full tablet report, sending...
I20260709 13:13:38.099784  3371 ts_manager.cc:194] Registered new tserver with Master: 6b0316ac722f4603bd53197367ed1c4d (127.2.198.193:44435)
I20260709 13:13:38.100050  2843 webserver.cc:533] Webserver started at http://127.2.198.194:42945/ using document root <none> and password file <none>
I20260709 13:13:38.100637  2843 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:38.100840  2843 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:38.101121  2843 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:38.102010  3371 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39922
I20260709 13:13:38.102380  2843 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602804652623-2843-0/minicluster-data/ts-1-root/instance:
uuid: "0ce4927ed21e494fa47cd82d743826c7"
format_stamp: "Formatted at 2026-07-09 13:13:38 on dist-test-slave-fc6v"
I20260709 13:13:38.107409  2843 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 13:13:38.111038  3510 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:38.111912  2843 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:13:38.112217  2843 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602804652623-2843-0/minicluster-data/ts-1-root
uuid: "0ce4927ed21e494fa47cd82d743826c7"
format_stamp: "Formatted at 2026-07-09 13:13:38 on dist-test-slave-fc6v"
I20260709 13:13:38.112529  2843 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602804652623-2843-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602804652623-2843-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602804652623-2843-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:38.141582  2843 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:38.143013  2843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:38.144695  2843 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:38.147264  2843 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:38.147505  2843 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:38.147806  2843 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:38.147992  2843 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:38.194525  2843 rpc_server.cc:307] RPC server started. Bound to: 127.2.198.194:45581
I20260709 13:13:38.194639  3572 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.198.194:45581 every 8 connection(s)
I20260709 13:13:38.199826  2843 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:38.208166  3576 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:38.208777  3577 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:38.212551  3579 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:38.213174  2843 server_base.cc:1061] running on GCE node
I20260709 13:13:38.214133  2843 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:38.214452  2843 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:38.214529  3573 heartbeater.cc:344] Connected to a master server at 127.2.198.254:46749
I20260709 13:13:38.214679  2843 hybrid_clock.cc:648] HybridClock initialized: now 1783602818214658 us; error 0 us; skew 500 ppm
I20260709 13:13:38.215097  3573 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:38.215435  2843 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:38.216192  3573 heartbeater.cc:507] Master 127.2.198.254:46749 requested a full tablet report, sending...
I20260709 13:13:38.218844  3371 ts_manager.cc:194] Registered new tserver with Master: 0ce4927ed21e494fa47cd82d743826c7 (127.2.198.194:45581)
I20260709 13:13:38.219141  2843 webserver.cc:533] Webserver started at http://127.2.198.195:40147/ using document root <none> and password file <none>
I20260709 13:13:38.219928  2843 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:38.220201  2843 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:38.220590  2843 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:38.221257  3371 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39928
I20260709 13:13:38.222463  2843 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602804652623-2843-0/minicluster-data/ts-2-root/instance:
uuid: "0b4332b9c1a84bde9278052eb2b32835"
format_stamp: "Formatted at 2026-07-09 13:13:38 on dist-test-slave-fc6v"
I20260709 13:13:38.227897  2843 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.005s
I20260709 13:13:38.231338  3584 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:38.232196  2843 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:13:38.232512  2843 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602804652623-2843-0/minicluster-data/ts-2-root
uuid: "0b4332b9c1a84bde9278052eb2b32835"
format_stamp: "Formatted at 2026-07-09 13:13:38 on dist-test-slave-fc6v"
I20260709 13:13:38.232832  2843 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602804652623-2843-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602804652623-2843-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602804652623-2843-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:38.247036  2843 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:38.248415  2843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:38.249981  2843 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:38.252362  2843 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:38.252592  2843 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:38.252846  2843 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:38.253026  2843 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:38.298897  2843 rpc_server.cc:307] RPC server started. Bound to: 127.2.198.195:33933
I20260709 13:13:38.299036  3646 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.198.195:33933 every 8 connection(s)
I20260709 13:13:38.313683  3647 heartbeater.cc:344] Connected to a master server at 127.2.198.254:46749
I20260709 13:13:38.314184  3647 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:38.315048  3647 heartbeater.cc:507] Master 127.2.198.254:46749 requested a full tablet report, sending...
I20260709 13:13:38.317126  3371 ts_manager.cc:194] Registered new tserver with Master: 0b4332b9c1a84bde9278052eb2b32835 (127.2.198.195:33933)
I20260709 13:13:38.317869  2843 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015570371s
I20260709 13:13:38.318887  3371 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39936
I20260709 13:13:38.344950  3371 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39940:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:38.348060  3371 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:38.426658  3538 tablet_service.cc:1511] Processing CreateTablet for tablet d5950c15e891492695358c32b92f10d0 (DEFAULT_TABLE table=test-workload [id=1d6478fdf0614aafae7a59d869adf9c1]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:13:38.428610  3538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5950c15e891492695358c32b92f10d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.427348  3537 tablet_service.cc:1511] Processing CreateTablet for tablet 7a59cf3c416745258673b8c3cebf93c4 (DEFAULT_TABLE table=test-workload [id=1d6478fdf0614aafae7a59d869adf9c1]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:13:38.430254  3537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a59cf3c416745258673b8c3cebf93c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.432572  3463 tablet_service.cc:1511] Processing CreateTablet for tablet d5950c15e891492695358c32b92f10d0 (DEFAULT_TABLE table=test-workload [id=1d6478fdf0614aafae7a59d869adf9c1]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:13:38.434006  3463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5950c15e891492695358c32b92f10d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.428694  3536 tablet_service.cc:1511] Processing CreateTablet for tablet a1b40b6f843b4e68b03b9286ad71384f (DEFAULT_TABLE table=test-workload [id=1d6478fdf0614aafae7a59d869adf9c1]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:13:38.436007  3462 tablet_service.cc:1511] Processing CreateTablet for tablet 7a59cf3c416745258673b8c3cebf93c4 (DEFAULT_TABLE table=test-workload [id=1d6478fdf0614aafae7a59d869adf9c1]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:13:38.436751  3536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1b40b6f843b4e68b03b9286ad71384f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.437367  3462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a59cf3c416745258673b8c3cebf93c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.444989  3460 tablet_service.cc:1511] Processing CreateTablet for tablet e5d5f35ac8584926a75208edc395f0d6 (DEFAULT_TABLE table=test-workload [id=1d6478fdf0614aafae7a59d869adf9c1]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:13:38.446476  3460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5d5f35ac8584926a75208edc395f0d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.448535  3461 tablet_service.cc:1511] Processing CreateTablet for tablet a1b40b6f843b4e68b03b9286ad71384f (DEFAULT_TABLE table=test-workload [id=1d6478fdf0614aafae7a59d869adf9c1]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:13:38.450358  3461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1b40b6f843b4e68b03b9286ad71384f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.452380  3535 tablet_service.cc:1511] Processing CreateTablet for tablet e5d5f35ac8584926a75208edc395f0d6 (DEFAULT_TABLE table=test-workload [id=1d6478fdf0614aafae7a59d869adf9c1]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:13:38.454236  3535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5d5f35ac8584926a75208edc395f0d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.472352  3459 tablet_service.cc:1511] Processing CreateTablet for tablet 6e13df989df94dae888a9c7b79470112 (DEFAULT_TABLE table=test-workload [id=1d6478fdf0614aafae7a59d869adf9c1]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:13:38.473994  3459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e13df989df94dae888a9c7b79470112. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.483062  3612 tablet_service.cc:1511] Processing CreateTablet for tablet d5950c15e891492695358c32b92f10d0 (DEFAULT_TABLE table=test-workload [id=1d6478fdf0614aafae7a59d869adf9c1]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:13:38.484556  3612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5950c15e891492695358c32b92f10d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.488660  3608 tablet_service.cc:1511] Processing CreateTablet for tablet 6e13df989df94dae888a9c7b79470112 (DEFAULT_TABLE table=test-workload [id=1d6478fdf0614aafae7a59d869adf9c1]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:13:38.490164  3608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e13df989df94dae888a9c7b79470112. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.490031  3458 tablet_service.cc:1511] Processing CreateTablet for tablet 708d5be49a784b86aa09af32b0f7efd9 (DEFAULT_TABLE table=test-workload [id=1d6478fdf0614aafae7a59d869adf9c1]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:13:38.491429  3458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 708d5be49a784b86aa09af32b0f7efd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.492295  3607 tablet_service.cc:1511] Processing CreateTablet for tablet 708d5be49a784b86aa09af32b0f7efd9 (DEFAULT_TABLE table=test-workload [id=1d6478fdf0614aafae7a59d869adf9c1]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:13:38.493876  3607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 708d5be49a784b86aa09af32b0f7efd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.494956  3662 tablet_bootstrap.cc:492] T d5950c15e891492695358c32b92f10d0 P 0ce4927ed21e494fa47cd82d743826c7: Bootstrap starting.
I20260709 13:13:38.496894  3611 tablet_service.cc:1511] Processing CreateTablet for tablet 7a59cf3c416745258673b8c3cebf93c4 (DEFAULT_TABLE table=test-workload [id=1d6478fdf0614aafae7a59d869adf9c1]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:13:38.498245  3611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a59cf3c416745258673b8c3cebf93c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.500710  3609 tablet_service.cc:1511] Processing CreateTablet for tablet e5d5f35ac8584926a75208edc395f0d6 (DEFAULT_TABLE table=test-workload [id=1d6478fdf0614aafae7a59d869adf9c1]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:13:38.502351  3609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5d5f35ac8584926a75208edc395f0d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.505895  3534 tablet_service.cc:1511] Processing CreateTablet for tablet 708d5be49a784b86aa09af32b0f7efd9 (DEFAULT_TABLE table=test-workload [id=1d6478fdf0614aafae7a59d869adf9c1]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:13:38.508404  3534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 708d5be49a784b86aa09af32b0f7efd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.510728  3610 tablet_service.cc:1511] Processing CreateTablet for tablet a1b40b6f843b4e68b03b9286ad71384f (DEFAULT_TABLE table=test-workload [id=1d6478fdf0614aafae7a59d869adf9c1]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:13:38.512450  3610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1b40b6f843b4e68b03b9286ad71384f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.516325  3457 tablet_service.cc:1511] Processing CreateTablet for tablet bde0fa9eb0a643ce81bf46013ef6a572 (DEFAULT_TABLE table=test-workload [id=1d6478fdf0614aafae7a59d869adf9c1]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:13:38.517738  3457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bde0fa9eb0a643ce81bf46013ef6a572. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.519682  3606 tablet_service.cc:1511] Processing CreateTablet for tablet bde0fa9eb0a643ce81bf46013ef6a572 (DEFAULT_TABLE table=test-workload [id=1d6478fdf0614aafae7a59d869adf9c1]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:13:38.521536  3533 tablet_service.cc:1511] Processing CreateTablet for tablet bde0fa9eb0a643ce81bf46013ef6a572 (DEFAULT_TABLE table=test-workload [id=1d6478fdf0614aafae7a59d869adf9c1]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:13:38.522945  3533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bde0fa9eb0a643ce81bf46013ef6a572. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.526726  3456 tablet_service.cc:1511] Processing CreateTablet for tablet 6b9fa52d1dd94e6db840e2f48bf4f92f (DEFAULT_TABLE table=test-workload [id=1d6478fdf0614aafae7a59d869adf9c1]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:13:38.533748  3456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b9fa52d1dd94e6db840e2f48bf4f92f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.532161  3532 tablet_service.cc:1511] Processing CreateTablet for tablet 6b9fa52d1dd94e6db840e2f48bf4f92f (DEFAULT_TABLE table=test-workload [id=1d6478fdf0614aafae7a59d869adf9c1]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:13:38.540551  3532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b9fa52d1dd94e6db840e2f48bf4f92f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.541014  3605 tablet_service.cc:1511] Processing CreateTablet for tablet 6b9fa52d1dd94e6db840e2f48bf4f92f (DEFAULT_TABLE table=test-workload [id=1d6478fdf0614aafae7a59d869adf9c1]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:13:38.542742  3606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bde0fa9eb0a643ce81bf46013ef6a572. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.544277  3605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b9fa52d1dd94e6db840e2f48bf4f92f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.565164  3455 tablet_service.cc:1511] Processing CreateTablet for tablet a288028b1ba44234b32168b0fea601f9 (DEFAULT_TABLE table=test-workload [id=1d6478fdf0614aafae7a59d869adf9c1]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:13:38.566871  3455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a288028b1ba44234b32168b0fea601f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.571466  3531 tablet_service.cc:1511] Processing CreateTablet for tablet a288028b1ba44234b32168b0fea601f9 (DEFAULT_TABLE table=test-workload [id=1d6478fdf0614aafae7a59d869adf9c1]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:13:38.573256  3531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a288028b1ba44234b32168b0fea601f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.574122  3604 tablet_service.cc:1511] Processing CreateTablet for tablet a288028b1ba44234b32168b0fea601f9 (DEFAULT_TABLE table=test-workload [id=1d6478fdf0614aafae7a59d869adf9c1]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:13:38.576083  3604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a288028b1ba44234b32168b0fea601f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.586611  3662 tablet_bootstrap.cc:654] T d5950c15e891492695358c32b92f10d0 P 0ce4927ed21e494fa47cd82d743826c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.588790  3538 tablet_service.cc:1511] Processing CreateTablet for tablet 6e13df989df94dae888a9c7b79470112 (DEFAULT_TABLE table=test-workload [id=1d6478fdf0614aafae7a59d869adf9c1]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:13:38.590646  3538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e13df989df94dae888a9c7b79470112. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.602560  3530 tablet_service.cc:1511] Processing CreateTablet for tablet 9ab238772b3f4d1f9fe46f75ae91b0bc (DEFAULT_TABLE table=test-workload [id=1d6478fdf0614aafae7a59d869adf9c1]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:13:38.605536  3603 tablet_service.cc:1511] Processing CreateTablet for tablet 9ab238772b3f4d1f9fe46f75ae91b0bc (DEFAULT_TABLE table=test-workload [id=1d6478fdf0614aafae7a59d869adf9c1]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:13:38.606997  3603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ab238772b3f4d1f9fe46f75ae91b0bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.635908  3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ab238772b3f4d1f9fe46f75ae91b0bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.635846  3461 tablet_service.cc:1511] Processing CreateTablet for tablet 9ab238772b3f4d1f9fe46f75ae91b0bc (DEFAULT_TABLE table=test-workload [id=1d6478fdf0614aafae7a59d869adf9c1]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:13:38.641018  3461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ab238772b3f4d1f9fe46f75ae91b0bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.727279  3664 tablet_bootstrap.cc:492] T 7a59cf3c416745258673b8c3cebf93c4 P 0b4332b9c1a84bde9278052eb2b32835: Bootstrap starting.
I20260709 13:13:38.731117  3662 tablet_bootstrap.cc:492] T d5950c15e891492695358c32b92f10d0 P 0ce4927ed21e494fa47cd82d743826c7: No bootstrap required, opened a new log
I20260709 13:13:38.731773  3662 ts_tablet_manager.cc:1403] T d5950c15e891492695358c32b92f10d0 P 0ce4927ed21e494fa47cd82d743826c7: Time spent bootstrapping tablet: real 0.237s	user 0.019s	sys 0.009s
I20260709 13:13:38.735124  3662 raft_consensus.cc:359] T d5950c15e891492695358c32b92f10d0 P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:38.735947  3662 raft_consensus.cc:385] T d5950c15e891492695358c32b92f10d0 P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.736276  3662 raft_consensus.cc:740] T d5950c15e891492695358c32b92f10d0 P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ce4927ed21e494fa47cd82d743826c7, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.737138  3662 consensus_queue.cc:260] T d5950c15e891492695358c32b92f10d0 P 0ce4927ed21e494fa47cd82d743826c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:38.730557  3663 tablet_bootstrap.cc:492] T 6e13df989df94dae888a9c7b79470112 P 6b0316ac722f4603bd53197367ed1c4d: Bootstrap starting.
I20260709 13:13:38.750320  3664 tablet_bootstrap.cc:654] T 7a59cf3c416745258673b8c3cebf93c4 P 0b4332b9c1a84bde9278052eb2b32835: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.750509  3663 tablet_bootstrap.cc:654] T 6e13df989df94dae888a9c7b79470112 P 6b0316ac722f4603bd53197367ed1c4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.752942  3573 heartbeater.cc:499] Master 127.2.198.254:46749 was elected leader, sending a full tablet report...
I20260709 13:13:38.753515  3662 ts_tablet_manager.cc:1434] T d5950c15e891492695358c32b92f10d0 P 0ce4927ed21e494fa47cd82d743826c7: Time spent starting tablet: real 0.021s	user 0.013s	sys 0.008s
I20260709 13:13:38.754562  3662 tablet_bootstrap.cc:492] T a1b40b6f843b4e68b03b9286ad71384f P 0ce4927ed21e494fa47cd82d743826c7: Bootstrap starting.
I20260709 13:13:38.755966  3663 tablet_bootstrap.cc:492] T 6e13df989df94dae888a9c7b79470112 P 6b0316ac722f4603bd53197367ed1c4d: No bootstrap required, opened a new log
I20260709 13:13:38.756376  3663 ts_tablet_manager.cc:1403] T 6e13df989df94dae888a9c7b79470112 P 6b0316ac722f4603bd53197367ed1c4d: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.008s
I20260709 13:13:38.759150  3663 raft_consensus.cc:359] T 6e13df989df94dae888a9c7b79470112 P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:38.759981  3663 raft_consensus.cc:385] T 6e13df989df94dae888a9c7b79470112 P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.760290  3663 raft_consensus.cc:740] T 6e13df989df94dae888a9c7b79470112 P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0316ac722f4603bd53197367ed1c4d, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.761132  3663 consensus_queue.cc:260] T 6e13df989df94dae888a9c7b79470112 P 6b0316ac722f4603bd53197367ed1c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:38.762323  3662 tablet_bootstrap.cc:654] T a1b40b6f843b4e68b03b9286ad71384f P 0ce4927ed21e494fa47cd82d743826c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.769914  3664 tablet_bootstrap.cc:492] T 7a59cf3c416745258673b8c3cebf93c4 P 0b4332b9c1a84bde9278052eb2b32835: No bootstrap required, opened a new log
I20260709 13:13:38.769822  3498 heartbeater.cc:499] Master 127.2.198.254:46749 was elected leader, sending a full tablet report...
I20260709 13:13:38.770931  3663 ts_tablet_manager.cc:1434] T 6e13df989df94dae888a9c7b79470112 P 6b0316ac722f4603bd53197367ed1c4d: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.003s
I20260709 13:13:38.772297  3663 tablet_bootstrap.cc:492] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d: Bootstrap starting.
I20260709 13:13:38.778812  3663 tablet_bootstrap.cc:654] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.782363  3664 ts_tablet_manager.cc:1403] T 7a59cf3c416745258673b8c3cebf93c4 P 0b4332b9c1a84bde9278052eb2b32835: Time spent bootstrapping tablet: real 0.056s	user 0.009s	sys 0.012s
I20260709 13:13:38.785323  3662 tablet_bootstrap.cc:492] T a1b40b6f843b4e68b03b9286ad71384f P 0ce4927ed21e494fa47cd82d743826c7: No bootstrap required, opened a new log
I20260709 13:13:38.785890  3662 ts_tablet_manager.cc:1403] T a1b40b6f843b4e68b03b9286ad71384f P 0ce4927ed21e494fa47cd82d743826c7: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.017s
I20260709 13:13:38.785727  3664 raft_consensus.cc:359] T 7a59cf3c416745258673b8c3cebf93c4 P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:38.786568  3664 raft_consensus.cc:385] T 7a59cf3c416745258673b8c3cebf93c4 P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.786913  3664 raft_consensus.cc:740] T 7a59cf3c416745258673b8c3cebf93c4 P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b4332b9c1a84bde9278052eb2b32835, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.787750  3664 consensus_queue.cc:260] T 7a59cf3c416745258673b8c3cebf93c4 P 0b4332b9c1a84bde9278052eb2b32835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:38.790441  3647 heartbeater.cc:499] Master 127.2.198.254:46749 was elected leader, sending a full tablet report...
I20260709 13:13:38.790823  3664 ts_tablet_manager.cc:1434] T 7a59cf3c416745258673b8c3cebf93c4 P 0b4332b9c1a84bde9278052eb2b32835: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:13:38.789433  3662 raft_consensus.cc:359] T a1b40b6f843b4e68b03b9286ad71384f P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:38.791338  3662 raft_consensus.cc:385] T a1b40b6f843b4e68b03b9286ad71384f P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.791693  3662 raft_consensus.cc:740] T a1b40b6f843b4e68b03b9286ad71384f P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ce4927ed21e494fa47cd82d743826c7, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.791864  3664 tablet_bootstrap.cc:492] T a288028b1ba44234b32168b0fea601f9 P 0b4332b9c1a84bde9278052eb2b32835: Bootstrap starting.
I20260709 13:13:38.792563  3662 consensus_queue.cc:260] T a1b40b6f843b4e68b03b9286ad71384f P 0ce4927ed21e494fa47cd82d743826c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:38.795650  3662 ts_tablet_manager.cc:1434] T a1b40b6f843b4e68b03b9286ad71384f P 0ce4927ed21e494fa47cd82d743826c7: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.005s
I20260709 13:13:38.796821  3662 tablet_bootstrap.cc:492] T 708d5be49a784b86aa09af32b0f7efd9 P 0ce4927ed21e494fa47cd82d743826c7: Bootstrap starting.
I20260709 13:13:38.799400  3664 tablet_bootstrap.cc:654] T a288028b1ba44234b32168b0fea601f9 P 0b4332b9c1a84bde9278052eb2b32835: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.804276  3662 tablet_bootstrap.cc:654] T 708d5be49a784b86aa09af32b0f7efd9 P 0ce4927ed21e494fa47cd82d743826c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.810657  3663 tablet_bootstrap.cc:492] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d: No bootstrap required, opened a new log
I20260709 13:13:38.811229  3663 ts_tablet_manager.cc:1403] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d: Time spent bootstrapping tablet: real 0.039s	user 0.011s	sys 0.005s
I20260709 13:13:38.816171  3663 raft_consensus.cc:359] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:38.817019  3663 raft_consensus.cc:385] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.817340  3663 raft_consensus.cc:740] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0316ac722f4603bd53197367ed1c4d, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.818323  3663 consensus_queue.cc:260] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:38.824074  3663 ts_tablet_manager.cc:1434] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.002s
I20260709 13:13:38.825074  3663 tablet_bootstrap.cc:492] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 6b0316ac722f4603bd53197367ed1c4d: Bootstrap starting.
I20260709 13:13:38.831281  3669 raft_consensus.cc:493] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.831681  3663 tablet_bootstrap.cc:654] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 6b0316ac722f4603bd53197367ed1c4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.831885  3669 raft_consensus.cc:515] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:38.832943  3664 tablet_bootstrap.cc:492] T a288028b1ba44234b32168b0fea601f9 P 0b4332b9c1a84bde9278052eb2b32835: No bootstrap required, opened a new log
I20260709 13:13:38.833727  3664 ts_tablet_manager.cc:1403] T a288028b1ba44234b32168b0fea601f9 P 0b4332b9c1a84bde9278052eb2b32835: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.015s
I20260709 13:13:38.839461  3664 raft_consensus.cc:359] T a288028b1ba44234b32168b0fea601f9 P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:38.840193  3662 tablet_bootstrap.cc:492] T 708d5be49a784b86aa09af32b0f7efd9 P 0ce4927ed21e494fa47cd82d743826c7: No bootstrap required, opened a new log
I20260709 13:13:38.840327  3664 raft_consensus.cc:385] T a288028b1ba44234b32168b0fea601f9 P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.840744  3662 ts_tablet_manager.cc:1403] T 708d5be49a784b86aa09af32b0f7efd9 P 0ce4927ed21e494fa47cd82d743826c7: Time spent bootstrapping tablet: real 0.044s	user 0.025s	sys 0.017s
I20260709 13:13:38.841806  3669 leader_election.cc:290] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ce4927ed21e494fa47cd82d743826c7 (127.2.198.194:45581), 0b4332b9c1a84bde9278052eb2b32835 (127.2.198.195:33933)
I20260709 13:13:38.840760  3664 raft_consensus.cc:740] T a288028b1ba44234b32168b0fea601f9 P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b4332b9c1a84bde9278052eb2b32835, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.844005  3662 raft_consensus.cc:359] T 708d5be49a784b86aa09af32b0f7efd9 P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:38.844236  3664 consensus_queue.cc:260] T a288028b1ba44234b32168b0fea601f9 P 0b4332b9c1a84bde9278052eb2b32835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:38.844774  3662 raft_consensus.cc:385] T 708d5be49a784b86aa09af32b0f7efd9 P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.845211  3662 raft_consensus.cc:740] T 708d5be49a784b86aa09af32b0f7efd9 P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ce4927ed21e494fa47cd82d743826c7, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.846012  3662 consensus_queue.cc:260] T 708d5be49a784b86aa09af32b0f7efd9 P 0ce4927ed21e494fa47cd82d743826c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:38.846781  3664 ts_tablet_manager.cc:1434] T a288028b1ba44234b32168b0fea601f9 P 0b4332b9c1a84bde9278052eb2b32835: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:13:38.848606  3662 ts_tablet_manager.cc:1434] T 708d5be49a784b86aa09af32b0f7efd9 P 0ce4927ed21e494fa47cd82d743826c7: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:13:38.849720  3662 tablet_bootstrap.cc:492] T e5d5f35ac8584926a75208edc395f0d6 P 0ce4927ed21e494fa47cd82d743826c7: Bootstrap starting.
I20260709 13:13:38.856983  3662 tablet_bootstrap.cc:654] T e5d5f35ac8584926a75208edc395f0d6 P 0ce4927ed21e494fa47cd82d743826c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.864287  3663 tablet_bootstrap.cc:492] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 6b0316ac722f4603bd53197367ed1c4d: No bootstrap required, opened a new log
I20260709 13:13:38.864982  3663 ts_tablet_manager.cc:1403] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 6b0316ac722f4603bd53197367ed1c4d: Time spent bootstrapping tablet: real 0.040s	user 0.003s	sys 0.014s
I20260709 13:13:38.865031  3664 tablet_bootstrap.cc:492] T bde0fa9eb0a643ce81bf46013ef6a572 P 0b4332b9c1a84bde9278052eb2b32835: Bootstrap starting.
I20260709 13:13:38.864998  3672 raft_consensus.cc:493] T 7a59cf3c416745258673b8c3cebf93c4 P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.868911  3548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1b40b6f843b4e68b03b9286ad71384f" candidate_uuid: "6b0316ac722f4603bd53197367ed1c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce4927ed21e494fa47cd82d743826c7" is_pre_election: true
I20260709 13:13:38.869611  3548 raft_consensus.cc:2468] T a1b40b6f843b4e68b03b9286ad71384f P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b0316ac722f4603bd53197367ed1c4d in term 0.
I20260709 13:13:38.871039  3436 leader_election.cc:304] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ce4927ed21e494fa47cd82d743826c7, 6b0316ac722f4603bd53197367ed1c4d; no voters: 
I20260709 13:13:38.872176  3669 raft_consensus.cc:2804] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:38.872542  3669 raft_consensus.cc:493] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:38.872920  3669 raft_consensus.cc:3060] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:38.874164  3662 tablet_bootstrap.cc:492] T e5d5f35ac8584926a75208edc395f0d6 P 0ce4927ed21e494fa47cd82d743826c7: No bootstrap required, opened a new log
I20260709 13:13:38.874656  3662 ts_tablet_manager.cc:1403] T e5d5f35ac8584926a75208edc395f0d6 P 0ce4927ed21e494fa47cd82d743826c7: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.004s
I20260709 13:13:38.875504  3663 raft_consensus.cc:359] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:38.879719  3663 raft_consensus.cc:385] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.880096  3663 raft_consensus.cc:740] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0316ac722f4603bd53197367ed1c4d, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.876914  3664 tablet_bootstrap.cc:654] T bde0fa9eb0a643ce81bf46013ef6a572 P 0b4332b9c1a84bde9278052eb2b32835: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.881109  3663 consensus_queue.cc:260] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 6b0316ac722f4603bd53197367ed1c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:38.881732  3622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1b40b6f843b4e68b03b9286ad71384f" candidate_uuid: "6b0316ac722f4603bd53197367ed1c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b4332b9c1a84bde9278052eb2b32835" is_pre_election: true
W20260709 13:13:38.884059  3437 leader_election.cc:343] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b4332b9c1a84bde9278052eb2b32835 (127.2.198.195:33933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.877945  3662 raft_consensus.cc:359] T e5d5f35ac8584926a75208edc395f0d6 P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:38.868644  3672 raft_consensus.cc:515] T 7a59cf3c416745258673b8c3cebf93c4 P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:38.884900  3662 raft_consensus.cc:385] T e5d5f35ac8584926a75208edc395f0d6 P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.885356  3662 raft_consensus.cc:740] T e5d5f35ac8584926a75208edc395f0d6 P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ce4927ed21e494fa47cd82d743826c7, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.886458  3662 consensus_queue.cc:260] T e5d5f35ac8584926a75208edc395f0d6 P 0ce4927ed21e494fa47cd82d743826c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:38.894729  3672 leader_election.cc:290] T 7a59cf3c416745258673b8c3cebf93c4 P 0b4332b9c1a84bde9278052eb2b32835 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b0316ac722f4603bd53197367ed1c4d (127.2.198.193:44435), 0ce4927ed21e494fa47cd82d743826c7 (127.2.198.194:45581)
I20260709 13:13:38.880613  3669 raft_consensus.cc:515] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:38.900246  3548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1b40b6f843b4e68b03b9286ad71384f" candidate_uuid: "6b0316ac722f4603bd53197367ed1c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce4927ed21e494fa47cd82d743826c7"
I20260709 13:13:38.900893  3548 raft_consensus.cc:3060] T a1b40b6f843b4e68b03b9286ad71384f P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:38.892319  3662 ts_tablet_manager.cc:1434] T e5d5f35ac8584926a75208edc395f0d6 P 0ce4927ed21e494fa47cd82d743826c7: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.000s
W20260709 13:13:38.908452  3419 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:38.910982  3548 raft_consensus.cc:2468] T a1b40b6f843b4e68b03b9286ad71384f P 0ce4927ed21e494fa47cd82d743826c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0316ac722f4603bd53197367ed1c4d in term 1.
I20260709 13:13:38.912314  3436 leader_election.cc:304] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ce4927ed21e494fa47cd82d743826c7, 6b0316ac722f4603bd53197367ed1c4d; no voters: 
I20260709 13:13:38.914640  3473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a59cf3c416745258673b8c3cebf93c4" candidate_uuid: "0b4332b9c1a84bde9278052eb2b32835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0316ac722f4603bd53197367ed1c4d" is_pre_election: true
I20260709 13:13:38.915699  3662 tablet_bootstrap.cc:492] T a288028b1ba44234b32168b0fea601f9 P 0ce4927ed21e494fa47cd82d743826c7: Bootstrap starting.
W20260709 13:13:38.916949  3588 leader_election.cc:343] T 7a59cf3c416745258673b8c3cebf93c4 P 0b4332b9c1a84bde9278052eb2b32835 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b0316ac722f4603bd53197367ed1c4d (127.2.198.193:44435): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.922849  3622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1b40b6f843b4e68b03b9286ad71384f" candidate_uuid: "6b0316ac722f4603bd53197367ed1c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b4332b9c1a84bde9278052eb2b32835"
W20260709 13:13:38.924332  3437 leader_election.cc:343] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0b4332b9c1a84bde9278052eb2b32835 (127.2.198.195:33933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.925136  3662 tablet_bootstrap.cc:654] T a288028b1ba44234b32168b0fea601f9 P 0ce4927ed21e494fa47cd82d743826c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.929952  3669 leader_election.cc:290] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d [CANDIDATE]: Term 1 election: Requested vote from peers 0ce4927ed21e494fa47cd82d743826c7 (127.2.198.194:45581), 0b4332b9c1a84bde9278052eb2b32835 (127.2.198.195:33933)
I20260709 13:13:38.930972  3669 raft_consensus.cc:493] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.931526  3669 raft_consensus.cc:515] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:38.937570  3664 tablet_bootstrap.cc:492] T bde0fa9eb0a643ce81bf46013ef6a572 P 0b4332b9c1a84bde9278052eb2b32835: No bootstrap required, opened a new log
I20260709 13:13:38.933463  3685 raft_consensus.cc:2804] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:38.938217  3664 ts_tablet_manager.cc:1403] T bde0fa9eb0a643ce81bf46013ef6a572 P 0b4332b9c1a84bde9278052eb2b32835: Time spent bootstrapping tablet: real 0.074s	user 0.018s	sys 0.009s
I20260709 13:13:38.938292  3685 raft_consensus.cc:697] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d [term 1 LEADER]: Becoming Leader. State: Replica: 6b0316ac722f4603bd53197367ed1c4d, State: Running, Role: LEADER
I20260709 13:13:38.938639  3547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9fa52d1dd94e6db840e2f48bf4f92f" candidate_uuid: "6b0316ac722f4603bd53197367ed1c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce4927ed21e494fa47cd82d743826c7" is_pre_election: true
I20260709 13:13:38.937306  3548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a59cf3c416745258673b8c3cebf93c4" candidate_uuid: "0b4332b9c1a84bde9278052eb2b32835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce4927ed21e494fa47cd82d743826c7" is_pre_election: true
I20260709 13:13:38.939616  3685 consensus_queue.cc:237] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
W20260709 13:13:38.941020  3436 leader_election.cc:343] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 6b0316ac722f4603bd53197367ed1c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ce4927ed21e494fa47cd82d743826c7 (127.2.198.194:45581): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:38.942097  3585 leader_election.cc:343] T 7a59cf3c416745258673b8c3cebf93c4 P 0b4332b9c1a84bde9278052eb2b32835 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ce4927ed21e494fa47cd82d743826c7 (127.2.198.194:45581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.942013  3664 raft_consensus.cc:359] T bde0fa9eb0a643ce81bf46013ef6a572 P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:38.942637  3585 leader_election.cc:304] T 7a59cf3c416745258673b8c3cebf93c4 P 0b4332b9c1a84bde9278052eb2b32835 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b4332b9c1a84bde9278052eb2b32835; no voters: 0ce4927ed21e494fa47cd82d743826c7, 6b0316ac722f4603bd53197367ed1c4d
I20260709 13:13:38.932138  3662 tablet_bootstrap.cc:492] T a288028b1ba44234b32168b0fea601f9 P 0ce4927ed21e494fa47cd82d743826c7: No bootstrap required, opened a new log
I20260709 13:13:38.943007  3664 raft_consensus.cc:385] T bde0fa9eb0a643ce81bf46013ef6a572 P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.943498  3664 raft_consensus.cc:740] T bde0fa9eb0a643ce81bf46013ef6a572 P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b4332b9c1a84bde9278052eb2b32835, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.943745  3662 ts_tablet_manager.cc:1403] T a288028b1ba44234b32168b0fea601f9 P 0ce4927ed21e494fa47cd82d743826c7: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.000s
I20260709 13:13:38.944084  3672 raft_consensus.cc:2749] T 7a59cf3c416745258673b8c3cebf93c4 P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:38.944643  3664 consensus_queue.cc:260] T bde0fa9eb0a643ce81bf46013ef6a572 P 0b4332b9c1a84bde9278052eb2b32835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:38.947003  3664 ts_tablet_manager.cc:1434] T bde0fa9eb0a643ce81bf46013ef6a572 P 0b4332b9c1a84bde9278052eb2b32835: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:13:38.948252  3664 tablet_bootstrap.cc:492] T 6e13df989df94dae888a9c7b79470112 P 0b4332b9c1a84bde9278052eb2b32835: Bootstrap starting.
I20260709 13:13:38.947904  3662 raft_consensus.cc:359] T a288028b1ba44234b32168b0fea601f9 P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:38.948928  3662 raft_consensus.cc:385] T a288028b1ba44234b32168b0fea601f9 P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.949407  3662 raft_consensus.cc:740] T a288028b1ba44234b32168b0fea601f9 P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ce4927ed21e494fa47cd82d743826c7, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.950400  3662 consensus_queue.cc:260] T a288028b1ba44234b32168b0fea601f9 P 0ce4927ed21e494fa47cd82d743826c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:38.953666  3669 leader_election.cc:290] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 6b0316ac722f4603bd53197367ed1c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ce4927ed21e494fa47cd82d743826c7 (127.2.198.194:45581), 0b4332b9c1a84bde9278052eb2b32835 (127.2.198.195:33933)
I20260709 13:13:38.955718  3622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9fa52d1dd94e6db840e2f48bf4f92f" candidate_uuid: "6b0316ac722f4603bd53197367ed1c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b4332b9c1a84bde9278052eb2b32835" is_pre_election: true
I20260709 13:13:38.956347  3664 tablet_bootstrap.cc:654] T 6e13df989df94dae888a9c7b79470112 P 0b4332b9c1a84bde9278052eb2b32835: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:38.957551  3437 leader_election.cc:343] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 6b0316ac722f4603bd53197367ed1c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b4332b9c1a84bde9278052eb2b32835 (127.2.198.195:33933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.958048  3437 leader_election.cc:304] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 6b0316ac722f4603bd53197367ed1c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b0316ac722f4603bd53197367ed1c4d; no voters: 0b4332b9c1a84bde9278052eb2b32835, 0ce4927ed21e494fa47cd82d743826c7
I20260709 13:13:38.959514  3680 raft_consensus.cc:2749] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:38.960536  3663 ts_tablet_manager.cc:1434] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 6b0316ac722f4603bd53197367ed1c4d: Time spent starting tablet: real 0.095s	user 0.023s	sys 0.026s
I20260709 13:13:38.962699  3672 raft_consensus.cc:493] T a288028b1ba44234b32168b0fea601f9 P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.963337  3672 raft_consensus.cc:515] T a288028b1ba44234b32168b0fea601f9 P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:38.967501  3662 ts_tablet_manager.cc:1434] T a288028b1ba44234b32168b0fea601f9 P 0ce4927ed21e494fa47cd82d743826c7: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 13:13:38.967823  3663 tablet_bootstrap.cc:492] T d5950c15e891492695358c32b92f10d0 P 6b0316ac722f4603bd53197367ed1c4d: Bootstrap starting.
I20260709 13:13:38.968681  3662 tablet_bootstrap.cc:492] T 7a59cf3c416745258673b8c3cebf93c4 P 0ce4927ed21e494fa47cd82d743826c7: Bootstrap starting.
I20260709 13:13:38.968581  3473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a288028b1ba44234b32168b0fea601f9" candidate_uuid: "0b4332b9c1a84bde9278052eb2b32835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0316ac722f4603bd53197367ed1c4d" is_pre_election: true
W20260709 13:13:38.970647  3588 leader_election.cc:343] T a288028b1ba44234b32168b0fea601f9 P 0b4332b9c1a84bde9278052eb2b32835 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b0316ac722f4603bd53197367ed1c4d (127.2.198.193:44435): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.975239  3663 tablet_bootstrap.cc:654] T d5950c15e891492695358c32b92f10d0 P 6b0316ac722f4603bd53197367ed1c4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.978008  3548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a288028b1ba44234b32168b0fea601f9" candidate_uuid: "0b4332b9c1a84bde9278052eb2b32835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce4927ed21e494fa47cd82d743826c7" is_pre_election: true
I20260709 13:13:38.979632  3548 raft_consensus.cc:2468] T a288028b1ba44234b32168b0fea601f9 P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b4332b9c1a84bde9278052eb2b32835 in term 0.
I20260709 13:13:38.981313  3585 leader_election.cc:304] T a288028b1ba44234b32168b0fea601f9 P 0b4332b9c1a84bde9278052eb2b32835 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b4332b9c1a84bde9278052eb2b32835, 0ce4927ed21e494fa47cd82d743826c7; no voters: 6b0316ac722f4603bd53197367ed1c4d
I20260709 13:13:38.981767  3662 tablet_bootstrap.cc:654] T 7a59cf3c416745258673b8c3cebf93c4 P 0ce4927ed21e494fa47cd82d743826c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.982520  3679 raft_consensus.cc:2804] T a288028b1ba44234b32168b0fea601f9 P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:38.979005  3672 leader_election.cc:290] T a288028b1ba44234b32168b0fea601f9 P 0b4332b9c1a84bde9278052eb2b32835 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b0316ac722f4603bd53197367ed1c4d (127.2.198.193:44435), 0ce4927ed21e494fa47cd82d743826c7 (127.2.198.194:45581)
I20260709 13:13:38.982944  3679 raft_consensus.cc:493] T a288028b1ba44234b32168b0fea601f9 P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:38.983309  3679 raft_consensus.cc:3060] T a288028b1ba44234b32168b0fea601f9 P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:38.977372  3368 catalog_manager.cc:5697] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b0316ac722f4603bd53197367ed1c4d (127.2.198.193). New cstate: current_term: 1 leader_uuid: "6b0316ac722f4603bd53197367ed1c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:38.992616  3663 tablet_bootstrap.cc:492] T d5950c15e891492695358c32b92f10d0 P 6b0316ac722f4603bd53197367ed1c4d: No bootstrap required, opened a new log
I20260709 13:13:38.992341  3679 raft_consensus.cc:515] T a288028b1ba44234b32168b0fea601f9 P 0b4332b9c1a84bde9278052eb2b32835 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:38.993252  3663 ts_tablet_manager.cc:1403] T d5950c15e891492695358c32b92f10d0 P 6b0316ac722f4603bd53197367ed1c4d: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.007s
I20260709 13:13:38.996376  3473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a288028b1ba44234b32168b0fea601f9" candidate_uuid: "0b4332b9c1a84bde9278052eb2b32835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0316ac722f4603bd53197367ed1c4d"
I20260709 13:13:38.997008  3663 raft_consensus.cc:359] T d5950c15e891492695358c32b92f10d0 P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:38.998112  3663 raft_consensus.cc:385] T d5950c15e891492695358c32b92f10d0 P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:13:38.998531  3588 leader_election.cc:343] T a288028b1ba44234b32168b0fea601f9 P 0b4332b9c1a84bde9278052eb2b32835 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b0316ac722f4603bd53197367ed1c4d (127.2.198.193:44435): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.998550  3663 raft_consensus.cc:740] T d5950c15e891492695358c32b92f10d0 P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0316ac722f4603bd53197367ed1c4d, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.000284  3663 consensus_queue.cc:260] T d5950c15e891492695358c32b92f10d0 P 6b0316ac722f4603bd53197367ed1c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.001868  3664 tablet_bootstrap.cc:492] T 6e13df989df94dae888a9c7b79470112 P 0b4332b9c1a84bde9278052eb2b32835: No bootstrap required, opened a new log
I20260709 13:13:39.003813  3663 ts_tablet_manager.cc:1434] T d5950c15e891492695358c32b92f10d0 P 6b0316ac722f4603bd53197367ed1c4d: Time spent starting tablet: real 0.010s	user 0.011s	sys 0.000s
I20260709 13:13:39.002550  3664 ts_tablet_manager.cc:1403] T 6e13df989df94dae888a9c7b79470112 P 0b4332b9c1a84bde9278052eb2b32835: Time spent bootstrapping tablet: real 0.055s	user 0.014s	sys 0.018s
I20260709 13:13:39.005004  3548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a288028b1ba44234b32168b0fea601f9" candidate_uuid: "0b4332b9c1a84bde9278052eb2b32835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce4927ed21e494fa47cd82d743826c7"
I20260709 13:13:39.005774  3548 raft_consensus.cc:3060] T a288028b1ba44234b32168b0fea601f9 P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.009442  3679 leader_election.cc:290] T a288028b1ba44234b32168b0fea601f9 P 0b4332b9c1a84bde9278052eb2b32835 [CANDIDATE]: Term 1 election: Requested vote from peers 6b0316ac722f4603bd53197367ed1c4d (127.2.198.193:44435), 0ce4927ed21e494fa47cd82d743826c7 (127.2.198.194:45581)
I20260709 13:13:39.010190  3662 tablet_bootstrap.cc:492] T 7a59cf3c416745258673b8c3cebf93c4 P 0ce4927ed21e494fa47cd82d743826c7: No bootstrap required, opened a new log
I20260709 13:13:39.010833  3662 ts_tablet_manager.cc:1403] T 7a59cf3c416745258673b8c3cebf93c4 P 0ce4927ed21e494fa47cd82d743826c7: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.005s
I20260709 13:13:39.011618  3664 raft_consensus.cc:359] T 6e13df989df94dae888a9c7b79470112 P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.012451  3664 raft_consensus.cc:385] T 6e13df989df94dae888a9c7b79470112 P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.012816  3664 raft_consensus.cc:740] T 6e13df989df94dae888a9c7b79470112 P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b4332b9c1a84bde9278052eb2b32835, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.014789  3548 raft_consensus.cc:2468] T a288028b1ba44234b32168b0fea601f9 P 0ce4927ed21e494fa47cd82d743826c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b4332b9c1a84bde9278052eb2b32835 in term 1.
I20260709 13:13:39.014607  3662 raft_consensus.cc:359] T 7a59cf3c416745258673b8c3cebf93c4 P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.015458  3662 raft_consensus.cc:385] T 7a59cf3c416745258673b8c3cebf93c4 P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.004997  3663 tablet_bootstrap.cc:492] T 7a59cf3c416745258673b8c3cebf93c4 P 6b0316ac722f4603bd53197367ed1c4d: Bootstrap starting.
I20260709 13:13:39.015857  3662 raft_consensus.cc:740] T 7a59cf3c416745258673b8c3cebf93c4 P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ce4927ed21e494fa47cd82d743826c7, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.016129  3585 leader_election.cc:304] T a288028b1ba44234b32168b0fea601f9 P 0b4332b9c1a84bde9278052eb2b32835 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b4332b9c1a84bde9278052eb2b32835, 0ce4927ed21e494fa47cd82d743826c7; no voters: 6b0316ac722f4603bd53197367ed1c4d
I20260709 13:13:39.016022  3664 consensus_queue.cc:260] T 6e13df989df94dae888a9c7b79470112 P 0b4332b9c1a84bde9278052eb2b32835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.017491  3679 raft_consensus.cc:2804] T a288028b1ba44234b32168b0fea601f9 P 0b4332b9c1a84bde9278052eb2b32835 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:39.017006  3662 consensus_queue.cc:260] T 7a59cf3c416745258673b8c3cebf93c4 P 0ce4927ed21e494fa47cd82d743826c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.019025  3664 ts_tablet_manager.cc:1434] T 6e13df989df94dae888a9c7b79470112 P 0b4332b9c1a84bde9278052eb2b32835: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:13:39.020460  3664 tablet_bootstrap.cc:492] T d5950c15e891492695358c32b92f10d0 P 0b4332b9c1a84bde9278052eb2b32835: Bootstrap starting.
I20260709 13:13:39.024614  3663 tablet_bootstrap.cc:654] T 7a59cf3c416745258673b8c3cebf93c4 P 6b0316ac722f4603bd53197367ed1c4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.029090  3662 ts_tablet_manager.cc:1434] T 7a59cf3c416745258673b8c3cebf93c4 P 0ce4927ed21e494fa47cd82d743826c7: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:13:39.029431  3664 tablet_bootstrap.cc:654] T d5950c15e891492695358c32b92f10d0 P 0b4332b9c1a84bde9278052eb2b32835: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.035791  3662 tablet_bootstrap.cc:492] T bde0fa9eb0a643ce81bf46013ef6a572 P 0ce4927ed21e494fa47cd82d743826c7: Bootstrap starting.
I20260709 13:13:39.037426  3663 tablet_bootstrap.cc:492] T 7a59cf3c416745258673b8c3cebf93c4 P 6b0316ac722f4603bd53197367ed1c4d: No bootstrap required, opened a new log
I20260709 13:13:39.038007  3663 ts_tablet_manager.cc:1403] T 7a59cf3c416745258673b8c3cebf93c4 P 6b0316ac722f4603bd53197367ed1c4d: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.004s
I20260709 13:13:39.039829  3666 raft_consensus.cc:493] T d5950c15e891492695358c32b92f10d0 P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.040414  3666 raft_consensus.cc:515] T d5950c15e891492695358c32b92f10d0 P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.041464  3685 raft_consensus.cc:493] T 6e13df989df94dae888a9c7b79470112 P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.042021  3685 raft_consensus.cc:515] T 6e13df989df94dae888a9c7b79470112 P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.044502  3685 leader_election.cc:290] T 6e13df989df94dae888a9c7b79470112 P 6b0316ac722f4603bd53197367ed1c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ce4927ed21e494fa47cd82d743826c7 (127.2.198.194:45581), 0b4332b9c1a84bde9278052eb2b32835 (127.2.198.195:33933)
I20260709 13:13:39.045689  3663 raft_consensus.cc:359] T 7a59cf3c416745258673b8c3cebf93c4 P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.046554  3666 leader_election.cc:290] T d5950c15e891492695358c32b92f10d0 P 0ce4927ed21e494fa47cd82d743826c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b0316ac722f4603bd53197367ed1c4d (127.2.198.193:44435), 0b4332b9c1a84bde9278052eb2b32835 (127.2.198.195:33933)
I20260709 13:13:39.046945  3548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e13df989df94dae888a9c7b79470112" candidate_uuid: "6b0316ac722f4603bd53197367ed1c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce4927ed21e494fa47cd82d743826c7" is_pre_election: true
I20260709 13:13:39.047731  3663 raft_consensus.cc:385] T 7a59cf3c416745258673b8c3cebf93c4 P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.052708  3663 raft_consensus.cc:740] T 7a59cf3c416745258673b8c3cebf93c4 P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0316ac722f4603bd53197367ed1c4d, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.049492  3622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e13df989df94dae888a9c7b79470112" candidate_uuid: "6b0316ac722f4603bd53197367ed1c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b4332b9c1a84bde9278052eb2b32835" is_pre_election: true
I20260709 13:13:39.053992  3622 raft_consensus.cc:2468] T 6e13df989df94dae888a9c7b79470112 P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b0316ac722f4603bd53197367ed1c4d in term 0.
I20260709 13:13:39.055533  3437 leader_election.cc:304] T 6e13df989df94dae888a9c7b79470112 P 6b0316ac722f4603bd53197367ed1c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b4332b9c1a84bde9278052eb2b32835, 6b0316ac722f4603bd53197367ed1c4d; no voters: 
I20260709 13:13:39.055783  3679 raft_consensus.cc:697] T a288028b1ba44234b32168b0fea601f9 P 0b4332b9c1a84bde9278052eb2b32835 [term 1 LEADER]: Becoming Leader. State: Replica: 0b4332b9c1a84bde9278052eb2b32835, State: Running, Role: LEADER
I20260709 13:13:39.056699  3685 raft_consensus.cc:2804] T 6e13df989df94dae888a9c7b79470112 P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:39.057168  3685 raft_consensus.cc:493] T 6e13df989df94dae888a9c7b79470112 P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.057793  3685 raft_consensus.cc:3060] T 6e13df989df94dae888a9c7b79470112 P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.057117  3679 consensus_queue.cc:237] T a288028b1ba44234b32168b0fea601f9 P 0b4332b9c1a84bde9278052eb2b32835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.063903  3663 consensus_queue.cc:260] T 7a59cf3c416745258673b8c3cebf93c4 P 6b0316ac722f4603bd53197367ed1c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.067098  3663 ts_tablet_manager.cc:1434] T 7a59cf3c416745258673b8c3cebf93c4 P 6b0316ac722f4603bd53197367ed1c4d: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.003s
I20260709 13:13:39.068341  3663 tablet_bootstrap.cc:492] T bde0fa9eb0a643ce81bf46013ef6a572 P 6b0316ac722f4603bd53197367ed1c4d: Bootstrap starting.
I20260709 13:13:39.074204  3662 tablet_bootstrap.cc:654] T bde0fa9eb0a643ce81bf46013ef6a572 P 0ce4927ed21e494fa47cd82d743826c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.075627  3685 raft_consensus.cc:515] T 6e13df989df94dae888a9c7b79470112 P 6b0316ac722f4603bd53197367ed1c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
W20260709 13:13:39.079310  3436 leader_election.cc:343] T 6e13df989df94dae888a9c7b79470112 P 6b0316ac722f4603bd53197367ed1c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ce4927ed21e494fa47cd82d743826c7 (127.2.198.194:45581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:39.082020  3680 raft_consensus.cc:493] T 7a59cf3c416745258673b8c3cebf93c4 P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.082486  3548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e13df989df94dae888a9c7b79470112" candidate_uuid: "6b0316ac722f4603bd53197367ed1c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce4927ed21e494fa47cd82d743826c7"
I20260709 13:13:39.082643  3680 raft_consensus.cc:515] T 7a59cf3c416745258673b8c3cebf93c4 P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.084203  3666 raft_consensus.cc:493] T 708d5be49a784b86aa09af32b0f7efd9 P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:39.084599  3436 leader_election.cc:343] T 6e13df989df94dae888a9c7b79470112 P 6b0316ac722f4603bd53197367ed1c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0ce4927ed21e494fa47cd82d743826c7 (127.2.198.194:45581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:39.084746  3666 raft_consensus.cc:515] T 708d5be49a784b86aa09af32b0f7efd9 P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.086932  3622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a59cf3c416745258673b8c3cebf93c4" candidate_uuid: "6b0316ac722f4603bd53197367ed1c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b4332b9c1a84bde9278052eb2b32835" is_pre_election: true
I20260709 13:13:39.088418  3622 raft_consensus.cc:2468] T 7a59cf3c416745258673b8c3cebf93c4 P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b0316ac722f4603bd53197367ed1c4d in term 0.
I20260709 13:13:39.086987  3548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a59cf3c416745258673b8c3cebf93c4" candidate_uuid: "6b0316ac722f4603bd53197367ed1c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce4927ed21e494fa47cd82d743826c7" is_pre_election: true
I20260709 13:13:39.089540  3548 raft_consensus.cc:2468] T 7a59cf3c416745258673b8c3cebf93c4 P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b0316ac722f4603bd53197367ed1c4d in term 0.
I20260709 13:13:39.087719  3680 leader_election.cc:290] T 7a59cf3c416745258673b8c3cebf93c4 P 6b0316ac722f4603bd53197367ed1c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ce4927ed21e494fa47cd82d743826c7 (127.2.198.194:45581), 0b4332b9c1a84bde9278052eb2b32835 (127.2.198.195:33933)
I20260709 13:13:39.087221  3666 leader_election.cc:290] T 708d5be49a784b86aa09af32b0f7efd9 P 0ce4927ed21e494fa47cd82d743826c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b0316ac722f4603bd53197367ed1c4d (127.2.198.193:44435), 0b4332b9c1a84bde9278052eb2b32835 (127.2.198.195:33933)
I20260709 13:13:39.090039  3437 leader_election.cc:304] T 7a59cf3c416745258673b8c3cebf93c4 P 6b0316ac722f4603bd53197367ed1c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b4332b9c1a84bde9278052eb2b32835, 6b0316ac722f4603bd53197367ed1c4d; no voters: 
I20260709 13:13:39.091017  3680 raft_consensus.cc:2804] T 7a59cf3c416745258673b8c3cebf93c4 P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:39.091403  3680 raft_consensus.cc:493] T 7a59cf3c416745258673b8c3cebf93c4 P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.091773  3680 raft_consensus.cc:3060] T 7a59cf3c416745258673b8c3cebf93c4 P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.097920  3371 catalog_manager.cc:5697] T a288028b1ba44234b32168b0fea601f9 P 0b4332b9c1a84bde9278052eb2b32835 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b4332b9c1a84bde9278052eb2b32835 (127.2.198.195). New cstate: current_term: 1 leader_uuid: "0b4332b9c1a84bde9278052eb2b32835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:39.100360  3664 tablet_bootstrap.cc:492] T d5950c15e891492695358c32b92f10d0 P 0b4332b9c1a84bde9278052eb2b32835: No bootstrap required, opened a new log
I20260709 13:13:39.100266  3473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5950c15e891492695358c32b92f10d0" candidate_uuid: "0ce4927ed21e494fa47cd82d743826c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0316ac722f4603bd53197367ed1c4d" is_pre_election: true
I20260709 13:13:39.101066  3473 raft_consensus.cc:2468] T d5950c15e891492695358c32b92f10d0 P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ce4927ed21e494fa47cd82d743826c7 in term 0.
I20260709 13:13:39.101500  3663 tablet_bootstrap.cc:654] T bde0fa9eb0a643ce81bf46013ef6a572 P 6b0316ac722f4603bd53197367ed1c4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.102205  3622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e13df989df94dae888a9c7b79470112" candidate_uuid: "6b0316ac722f4603bd53197367ed1c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b4332b9c1a84bde9278052eb2b32835"
I20260709 13:13:39.102948  3622 raft_consensus.cc:3060] T 6e13df989df94dae888a9c7b79470112 P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.101066  3685 leader_election.cc:290] T 6e13df989df94dae888a9c7b79470112 P 6b0316ac722f4603bd53197367ed1c4d [CANDIDATE]: Term 1 election: Requested vote from peers 0ce4927ed21e494fa47cd82d743826c7 (127.2.198.194:45581), 0b4332b9c1a84bde9278052eb2b32835 (127.2.198.195:33933)
I20260709 13:13:39.103427  3514 leader_election.cc:304] T d5950c15e891492695358c32b92f10d0 P 0ce4927ed21e494fa47cd82d743826c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ce4927ed21e494fa47cd82d743826c7, 6b0316ac722f4603bd53197367ed1c4d; no voters: 
I20260709 13:13:39.104524  3666 raft_consensus.cc:2804] T d5950c15e891492695358c32b92f10d0 P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:39.104952  3666 raft_consensus.cc:493] T d5950c15e891492695358c32b92f10d0 P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.105331  3666 raft_consensus.cc:3060] T d5950c15e891492695358c32b92f10d0 P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.102300  3472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708d5be49a784b86aa09af32b0f7efd9" candidate_uuid: "0ce4927ed21e494fa47cd82d743826c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0316ac722f4603bd53197367ed1c4d" is_pre_election: true
I20260709 13:13:39.110713  3621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5950c15e891492695358c32b92f10d0" candidate_uuid: "0ce4927ed21e494fa47cd82d743826c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b4332b9c1a84bde9278052eb2b32835" is_pre_election: true
I20260709 13:13:39.111024  3620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708d5be49a784b86aa09af32b0f7efd9" candidate_uuid: "0ce4927ed21e494fa47cd82d743826c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b4332b9c1a84bde9278052eb2b32835" is_pre_election: true
I20260709 13:13:39.111222  3680 raft_consensus.cc:515] T 7a59cf3c416745258673b8c3cebf93c4 P 6b0316ac722f4603bd53197367ed1c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
W20260709 13:13:39.112910  3512 leader_election.cc:343] T d5950c15e891492695358c32b92f10d0 P 0ce4927ed21e494fa47cd82d743826c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b4332b9c1a84bde9278052eb2b32835 (127.2.198.195:33933): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:39.114079  3512 leader_election.cc:343] T 708d5be49a784b86aa09af32b0f7efd9 P 0ce4927ed21e494fa47cd82d743826c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b4332b9c1a84bde9278052eb2b32835 (127.2.198.195:33933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:39.114316  3680 leader_election.cc:290] T 7a59cf3c416745258673b8c3cebf93c4 P 6b0316ac722f4603bd53197367ed1c4d [CANDIDATE]: Term 1 election: Requested vote from peers 0ce4927ed21e494fa47cd82d743826c7 (127.2.198.194:45581), 0b4332b9c1a84bde9278052eb2b32835 (127.2.198.195:33933)
W20260709 13:13:39.115602  3514 leader_election.cc:343] T 708d5be49a784b86aa09af32b0f7efd9 P 0ce4927ed21e494fa47cd82d743826c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b0316ac722f4603bd53197367ed1c4d (127.2.198.193:44435): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:39.115480  3620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a59cf3c416745258673b8c3cebf93c4" candidate_uuid: "6b0316ac722f4603bd53197367ed1c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b4332b9c1a84bde9278052eb2b32835"
I20260709 13:13:39.115507  3548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a59cf3c416745258673b8c3cebf93c4" candidate_uuid: "6b0316ac722f4603bd53197367ed1c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce4927ed21e494fa47cd82d743826c7"
I20260709 13:13:39.116286  3620 raft_consensus.cc:3060] T 7a59cf3c416745258673b8c3cebf93c4 P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.116372  3548 raft_consensus.cc:3060] T 7a59cf3c416745258673b8c3cebf93c4 P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.116168  3514 leader_election.cc:304] T 708d5be49a784b86aa09af32b0f7efd9 P 0ce4927ed21e494fa47cd82d743826c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ce4927ed21e494fa47cd82d743826c7; no voters: 0b4332b9c1a84bde9278052eb2b32835, 6b0316ac722f4603bd53197367ed1c4d
I20260709 13:13:39.106208  3664 ts_tablet_manager.cc:1403] T d5950c15e891492695358c32b92f10d0 P 0b4332b9c1a84bde9278052eb2b32835: Time spent bootstrapping tablet: real 0.086s	user 0.032s	sys 0.025s
I20260709 13:13:39.131701  3666 raft_consensus.cc:515] T d5950c15e891492695358c32b92f10d0 P 0ce4927ed21e494fa47cd82d743826c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.133528  3664 raft_consensus.cc:359] T d5950c15e891492695358c32b92f10d0 P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.134405  3664 raft_consensus.cc:385] T d5950c15e891492695358c32b92f10d0 P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.134930  3664 raft_consensus.cc:740] T d5950c15e891492695358c32b92f10d0 P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b4332b9c1a84bde9278052eb2b32835, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.135848  3666 leader_election.cc:290] T d5950c15e891492695358c32b92f10d0 P 0ce4927ed21e494fa47cd82d743826c7 [CANDIDATE]: Term 1 election: Requested vote from peers 6b0316ac722f4603bd53197367ed1c4d (127.2.198.193:44435), 0b4332b9c1a84bde9278052eb2b32835 (127.2.198.195:33933)
I20260709 13:13:39.135941  3548 raft_consensus.cc:2468] T 7a59cf3c416745258673b8c3cebf93c4 P 0ce4927ed21e494fa47cd82d743826c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0316ac722f4603bd53197367ed1c4d in term 1.
I20260709 13:13:39.136449  3666 raft_consensus.cc:2749] T 708d5be49a784b86aa09af32b0f7efd9 P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:39.137265  3621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5950c15e891492695358c32b92f10d0" candidate_uuid: "0ce4927ed21e494fa47cd82d743826c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b4332b9c1a84bde9278052eb2b32835"
I20260709 13:13:39.137825  3662 tablet_bootstrap.cc:492] T bde0fa9eb0a643ce81bf46013ef6a572 P 0ce4927ed21e494fa47cd82d743826c7: No bootstrap required, opened a new log
I20260709 13:13:39.138792  3436 leader_election.cc:304] T 7a59cf3c416745258673b8c3cebf93c4 P 6b0316ac722f4603bd53197367ed1c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ce4927ed21e494fa47cd82d743826c7, 6b0316ac722f4603bd53197367ed1c4d; no voters: 
I20260709 13:13:39.138574  3664 consensus_queue.cc:260] T d5950c15e891492695358c32b92f10d0 P 0b4332b9c1a84bde9278052eb2b32835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.139324  3662 ts_tablet_manager.cc:1403] T bde0fa9eb0a643ce81bf46013ef6a572 P 0ce4927ed21e494fa47cd82d743826c7: Time spent bootstrapping tablet: real 0.104s	user 0.024s	sys 0.004s
I20260709 13:13:39.139501  3663 tablet_bootstrap.cc:492] T bde0fa9eb0a643ce81bf46013ef6a572 P 6b0316ac722f4603bd53197367ed1c4d: No bootstrap required, opened a new log
I20260709 13:13:39.139739  3621 raft_consensus.cc:3060] T d5950c15e891492695358c32b92f10d0 P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.140105  3663 ts_tablet_manager.cc:1403] T bde0fa9eb0a643ce81bf46013ef6a572 P 6b0316ac722f4603bd53197367ed1c4d: Time spent bootstrapping tablet: real 0.072s	user 0.017s	sys 0.011s
I20260709 13:13:39.139917  3472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5950c15e891492695358c32b92f10d0" candidate_uuid: "0ce4927ed21e494fa47cd82d743826c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0316ac722f4603bd53197367ed1c4d"
I20260709 13:13:39.140645  3472 raft_consensus.cc:3060] T d5950c15e891492695358c32b92f10d0 P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.142882  3680 raft_consensus.cc:2804] T 7a59cf3c416745258673b8c3cebf93c4 P 6b0316ac722f4603bd53197367ed1c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:39.142743  3662 raft_consensus.cc:359] T bde0fa9eb0a643ce81bf46013ef6a572 P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.138515  3620 raft_consensus.cc:2468] T 7a59cf3c416745258673b8c3cebf93c4 P 0b4332b9c1a84bde9278052eb2b32835 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0316ac722f4603bd53197367ed1c4d in term 1.
I20260709 13:13:39.143383  3680 raft_consensus.cc:697] T 7a59cf3c416745258673b8c3cebf93c4 P 6b0316ac722f4603bd53197367ed1c4d [term 1 LEADER]: Becoming Leader. State: Replica: 6b0316ac722f4603bd53197367ed1c4d, State: Running, Role: LEADER
I20260709 13:13:39.144047  3662 raft_consensus.cc:385] T bde0fa9eb0a643ce81bf46013ef6a572 P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.143769  3663 raft_consensus.cc:359] T bde0fa9eb0a643ce81bf46013ef6a572 P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.144414  3662 raft_consensus.cc:740] T bde0fa9eb0a643ce81bf46013ef6a572 P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ce4927ed21e494fa47cd82d743826c7, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.144584  3663 raft_consensus.cc:385] T bde0fa9eb0a643ce81bf46013ef6a572 P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.144308  3680 consensus_queue.cc:237] T 7a59cf3c416745258673b8c3cebf93c4 P 6b0316ac722f4603bd53197367ed1c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.144979  3663 raft_consensus.cc:740] T bde0fa9eb0a643ce81bf46013ef6a572 P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0316ac722f4603bd53197367ed1c4d, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.145366  3662 consensus_queue.cc:260] T bde0fa9eb0a643ce81bf46013ef6a572 P 0ce4927ed21e494fa47cd82d743826c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.145972  3663 consensus_queue.cc:260] T bde0fa9eb0a643ce81bf46013ef6a572 P 6b0316ac722f4603bd53197367ed1c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.148113  3662 ts_tablet_manager.cc:1434] T bde0fa9eb0a643ce81bf46013ef6a572 P 0ce4927ed21e494fa47cd82d743826c7: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:13:39.148599  3663 ts_tablet_manager.cc:1434] T bde0fa9eb0a643ce81bf46013ef6a572 P 6b0316ac722f4603bd53197367ed1c4d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:13:39.131644  3622 raft_consensus.cc:2468] T 6e13df989df94dae888a9c7b79470112 P 0b4332b9c1a84bde9278052eb2b32835 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0316ac722f4603bd53197367ed1c4d in term 1.
I20260709 13:13:39.150885  3663 tablet_bootstrap.cc:492] T e5d5f35ac8584926a75208edc395f0d6 P 6b0316ac722f4603bd53197367ed1c4d: Bootstrap starting.
I20260709 13:13:39.157804  3621 raft_consensus.cc:2468] T d5950c15e891492695358c32b92f10d0 P 0b4332b9c1a84bde9278052eb2b32835 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ce4927ed21e494fa47cd82d743826c7 in term 1.
I20260709 13:13:39.158680  3663 tablet_bootstrap.cc:654] T e5d5f35ac8584926a75208edc395f0d6 P 6b0316ac722f4603bd53197367ed1c4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.159075  3437 leader_election.cc:304] T 6e13df989df94dae888a9c7b79470112 P 6b0316ac722f4603bd53197367ed1c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b4332b9c1a84bde9278052eb2b32835, 6b0316ac722f4603bd53197367ed1c4d; no voters: 0ce4927ed21e494fa47cd82d743826c7
I20260709 13:13:39.160149  3685 raft_consensus.cc:2804] T 6e13df989df94dae888a9c7b79470112 P 6b0316ac722f4603bd53197367ed1c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:39.160704  3685 raft_consensus.cc:697] T 6e13df989df94dae888a9c7b79470112 P 6b0316ac722f4603bd53197367ed1c4d [term 1 LEADER]: Becoming Leader. State: Replica: 6b0316ac722f4603bd53197367ed1c4d, State: Running, Role: LEADER
I20260709 13:13:39.164315  3662 tablet_bootstrap.cc:492] T 6e13df989df94dae888a9c7b79470112 P 0ce4927ed21e494fa47cd82d743826c7: Bootstrap starting.
I20260709 13:13:39.161639  3685 consensus_queue.cc:237] T 6e13df989df94dae888a9c7b79470112 P 6b0316ac722f4603bd53197367ed1c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.168587  3472 raft_consensus.cc:2468] T d5950c15e891492695358c32b92f10d0 P 6b0316ac722f4603bd53197367ed1c4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ce4927ed21e494fa47cd82d743826c7 in term 1.
I20260709 13:13:39.170754  3514 leader_election.cc:304] T d5950c15e891492695358c32b92f10d0 P 0ce4927ed21e494fa47cd82d743826c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ce4927ed21e494fa47cd82d743826c7, 6b0316ac722f4603bd53197367ed1c4d; no voters: 
I20260709 13:13:39.172210  3702 raft_consensus.cc:2804] T d5950c15e891492695358c32b92f10d0 P 0ce4927ed21e494fa47cd82d743826c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:39.176625  3368 catalog_manager.cc:5697] T 7a59cf3c416745258673b8c3cebf93c4 P 6b0316ac722f4603bd53197367ed1c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b0316ac722f4603bd53197367ed1c4d (127.2.198.193). New cstate: current_term: 1 leader_uuid: "6b0316ac722f4603bd53197367ed1c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:39.178251  3662 tablet_bootstrap.cc:654] T 6e13df989df94dae888a9c7b79470112 P 0ce4927ed21e494fa47cd82d743826c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.192734  3702 raft_consensus.cc:697] T d5950c15e891492695358c32b92f10d0 P 0ce4927ed21e494fa47cd82d743826c7 [term 1 LEADER]: Becoming Leader. State: Replica: 0ce4927ed21e494fa47cd82d743826c7, State: Running, Role: LEADER
I20260709 13:13:39.193428  3663 tablet_bootstrap.cc:492] T e5d5f35ac8584926a75208edc395f0d6 P 6b0316ac722f4603bd53197367ed1c4d: No bootstrap required, opened a new log
I20260709 13:13:39.194033  3663 ts_tablet_manager.cc:1403] T e5d5f35ac8584926a75208edc395f0d6 P 6b0316ac722f4603bd53197367ed1c4d: Time spent bootstrapping tablet: real 0.043s	user 0.016s	sys 0.020s
I20260709 13:13:39.193874  3702 consensus_queue.cc:237] T d5950c15e891492695358c32b92f10d0 P 0ce4927ed21e494fa47cd82d743826c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.198415  3664 ts_tablet_manager.cc:1434] T d5950c15e891492695358c32b92f10d0 P 0b4332b9c1a84bde9278052eb2b32835: Time spent starting tablet: real 0.074s	user 0.013s	sys 0.000s
I20260709 13:13:39.200273  3663 raft_consensus.cc:359] T e5d5f35ac8584926a75208edc395f0d6 P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.201116  3663 raft_consensus.cc:385] T e5d5f35ac8584926a75208edc395f0d6 P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.201432  3663 raft_consensus.cc:740] T e5d5f35ac8584926a75208edc395f0d6 P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0316ac722f4603bd53197367ed1c4d, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.201668  3662 tablet_bootstrap.cc:492] T 6e13df989df94dae888a9c7b79470112 P 0ce4927ed21e494fa47cd82d743826c7: No bootstrap required, opened a new log
I20260709 13:13:39.202296  3662 ts_tablet_manager.cc:1403] T 6e13df989df94dae888a9c7b79470112 P 0ce4927ed21e494fa47cd82d743826c7: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.002s
I20260709 13:13:39.202258  3663 consensus_queue.cc:260] T e5d5f35ac8584926a75208edc395f0d6 P 6b0316ac722f4603bd53197367ed1c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.204885  3663 ts_tablet_manager.cc:1434] T e5d5f35ac8584926a75208edc395f0d6 P 6b0316ac722f4603bd53197367ed1c4d: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 13:13:39.205899  3664 tablet_bootstrap.cc:492] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0b4332b9c1a84bde9278052eb2b32835: Bootstrap starting.
I20260709 13:13:39.205899  3663 tablet_bootstrap.cc:492] T 708d5be49a784b86aa09af32b0f7efd9 P 6b0316ac722f4603bd53197367ed1c4d: Bootstrap starting.
I20260709 13:13:39.205988  3662 raft_consensus.cc:359] T 6e13df989df94dae888a9c7b79470112 P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.209841  3662 raft_consensus.cc:385] T 6e13df989df94dae888a9c7b79470112 P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.210141  3662 raft_consensus.cc:740] T 6e13df989df94dae888a9c7b79470112 P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ce4927ed21e494fa47cd82d743826c7, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.211002  3662 consensus_queue.cc:260] T 6e13df989df94dae888a9c7b79470112 P 0ce4927ed21e494fa47cd82d743826c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.213254  3662 ts_tablet_manager.cc:1434] T 6e13df989df94dae888a9c7b79470112 P 0ce4927ed21e494fa47cd82d743826c7: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:13:39.214478  3662 tablet_bootstrap.cc:492] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0ce4927ed21e494fa47cd82d743826c7: Bootstrap starting.
I20260709 13:13:39.216712  3663 tablet_bootstrap.cc:654] T 708d5be49a784b86aa09af32b0f7efd9 P 6b0316ac722f4603bd53197367ed1c4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.217147  3371 catalog_manager.cc:5697] T 6e13df989df94dae888a9c7b79470112 P 6b0316ac722f4603bd53197367ed1c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b0316ac722f4603bd53197367ed1c4d (127.2.198.193). New cstate: current_term: 1 leader_uuid: "6b0316ac722f4603bd53197367ed1c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:39.221195  3662 tablet_bootstrap.cc:654] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0ce4927ed21e494fa47cd82d743826c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.224537  3664 tablet_bootstrap.cc:654] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0b4332b9c1a84bde9278052eb2b32835: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.226927  3663 tablet_bootstrap.cc:492] T 708d5be49a784b86aa09af32b0f7efd9 P 6b0316ac722f4603bd53197367ed1c4d: No bootstrap required, opened a new log
I20260709 13:13:39.227610  3663 ts_tablet_manager.cc:1403] T 708d5be49a784b86aa09af32b0f7efd9 P 6b0316ac722f4603bd53197367ed1c4d: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.004s
I20260709 13:13:39.228677  3369 catalog_manager.cc:5697] T d5950c15e891492695358c32b92f10d0 P 0ce4927ed21e494fa47cd82d743826c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ce4927ed21e494fa47cd82d743826c7 (127.2.198.194). New cstate: current_term: 1 leader_uuid: "0ce4927ed21e494fa47cd82d743826c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:39.230819  3663 raft_consensus.cc:359] T 708d5be49a784b86aa09af32b0f7efd9 P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.231659  3663 raft_consensus.cc:385] T 708d5be49a784b86aa09af32b0f7efd9 P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.232049  3663 raft_consensus.cc:740] T 708d5be49a784b86aa09af32b0f7efd9 P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0316ac722f4603bd53197367ed1c4d, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.232204  3662 tablet_bootstrap.cc:492] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0ce4927ed21e494fa47cd82d743826c7: No bootstrap required, opened a new log
I20260709 13:13:39.232908  3662 ts_tablet_manager.cc:1403] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0ce4927ed21e494fa47cd82d743826c7: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.003s
I20260709 13:13:39.232997  3663 consensus_queue.cc:260] T 708d5be49a784b86aa09af32b0f7efd9 P 6b0316ac722f4603bd53197367ed1c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.235527  3663 ts_tablet_manager.cc:1434] T 708d5be49a784b86aa09af32b0f7efd9 P 6b0316ac722f4603bd53197367ed1c4d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:13:39.236814  3663 tablet_bootstrap.cc:492] T a288028b1ba44234b32168b0fea601f9 P 6b0316ac722f4603bd53197367ed1c4d: Bootstrap starting.
I20260709 13:13:39.237066  3662 raft_consensus.cc:359] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.238057  3662 raft_consensus.cc:385] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.238449  3662 raft_consensus.cc:740] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ce4927ed21e494fa47cd82d743826c7, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.239791  3662 consensus_queue.cc:260] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0ce4927ed21e494fa47cd82d743826c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.242281  3662 ts_tablet_manager.cc:1434] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0ce4927ed21e494fa47cd82d743826c7: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:13:39.242463  3685 raft_consensus.cc:493] T e5d5f35ac8584926a75208edc395f0d6 P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.243294  3662 tablet_bootstrap.cc:492] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 0ce4927ed21e494fa47cd82d743826c7: Bootstrap starting.
I20260709 13:13:39.243036  3685 raft_consensus.cc:515] T e5d5f35ac8584926a75208edc395f0d6 P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.244923  3663 tablet_bootstrap.cc:654] T a288028b1ba44234b32168b0fea601f9 P 6b0316ac722f4603bd53197367ed1c4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.246783  3621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5d5f35ac8584926a75208edc395f0d6" candidate_uuid: "6b0316ac722f4603bd53197367ed1c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b4332b9c1a84bde9278052eb2b32835" is_pre_election: true
I20260709 13:13:39.247007  3664 tablet_bootstrap.cc:492] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0b4332b9c1a84bde9278052eb2b32835: No bootstrap required, opened a new log
I20260709 13:13:39.247704  3664 ts_tablet_manager.cc:1403] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0b4332b9c1a84bde9278052eb2b32835: Time spent bootstrapping tablet: real 0.042s	user 0.026s	sys 0.000s
W20260709 13:13:39.248535  3437 leader_election.cc:343] T e5d5f35ac8584926a75208edc395f0d6 P 6b0316ac722f4603bd53197367ed1c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b4332b9c1a84bde9278052eb2b32835 (127.2.198.195:33933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:39.250463  3662 tablet_bootstrap.cc:654] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 0ce4927ed21e494fa47cd82d743826c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.250886  3664 raft_consensus.cc:359] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.251220  3548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5d5f35ac8584926a75208edc395f0d6" candidate_uuid: "6b0316ac722f4603bd53197367ed1c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce4927ed21e494fa47cd82d743826c7" is_pre_election: true
I20260709 13:13:39.251783  3664 raft_consensus.cc:385] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.252143  3664 raft_consensus.cc:740] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b4332b9c1a84bde9278052eb2b32835, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.252130  3548 raft_consensus.cc:2468] T e5d5f35ac8584926a75208edc395f0d6 P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b0316ac722f4603bd53197367ed1c4d in term 0.
I20260709 13:13:39.253510  3664 consensus_queue.cc:260] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0b4332b9c1a84bde9278052eb2b32835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.254307  3436 leader_election.cc:304] T e5d5f35ac8584926a75208edc395f0d6 P 6b0316ac722f4603bd53197367ed1c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ce4927ed21e494fa47cd82d743826c7, 6b0316ac722f4603bd53197367ed1c4d; no voters: 0b4332b9c1a84bde9278052eb2b32835
I20260709 13:13:39.255513  3680 raft_consensus.cc:2804] T e5d5f35ac8584926a75208edc395f0d6 P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:39.256064  3680 raft_consensus.cc:493] T e5d5f35ac8584926a75208edc395f0d6 P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.256515  3680 raft_consensus.cc:3060] T e5d5f35ac8584926a75208edc395f0d6 P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.267690  3664 ts_tablet_manager.cc:1434] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0b4332b9c1a84bde9278052eb2b32835: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.002s
I20260709 13:13:39.269464  3685 leader_election.cc:290] T e5d5f35ac8584926a75208edc395f0d6 P 6b0316ac722f4603bd53197367ed1c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ce4927ed21e494fa47cd82d743826c7 (127.2.198.194:45581), 0b4332b9c1a84bde9278052eb2b32835 (127.2.198.195:33933)
I20260709 13:13:39.275400  3680 raft_consensus.cc:515] T e5d5f35ac8584926a75208edc395f0d6 P 6b0316ac722f4603bd53197367ed1c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.278209  3548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5d5f35ac8584926a75208edc395f0d6" candidate_uuid: "6b0316ac722f4603bd53197367ed1c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce4927ed21e494fa47cd82d743826c7"
I20260709 13:13:39.278769  3548 raft_consensus.cc:3060] T e5d5f35ac8584926a75208edc395f0d6 P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.280340  3664 tablet_bootstrap.cc:492] T a1b40b6f843b4e68b03b9286ad71384f P 0b4332b9c1a84bde9278052eb2b32835: Bootstrap starting.
I20260709 13:13:39.286353  3548 raft_consensus.cc:2468] T e5d5f35ac8584926a75208edc395f0d6 P 0ce4927ed21e494fa47cd82d743826c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0316ac722f4603bd53197367ed1c4d in term 1.
I20260709 13:13:39.283003  3663 tablet_bootstrap.cc:492] T a288028b1ba44234b32168b0fea601f9 P 6b0316ac722f4603bd53197367ed1c4d: No bootstrap required, opened a new log
I20260709 13:13:39.287264  3663 ts_tablet_manager.cc:1403] T a288028b1ba44234b32168b0fea601f9 P 6b0316ac722f4603bd53197367ed1c4d: Time spent bootstrapping tablet: real 0.051s	user 0.014s	sys 0.018s
I20260709 13:13:39.287858  3436 leader_election.cc:304] T e5d5f35ac8584926a75208edc395f0d6 P 6b0316ac722f4603bd53197367ed1c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ce4927ed21e494fa47cd82d743826c7, 6b0316ac722f4603bd53197367ed1c4d; no voters: 
I20260709 13:13:39.288741  3685 raft_consensus.cc:2804] T e5d5f35ac8584926a75208edc395f0d6 P 6b0316ac722f4603bd53197367ed1c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:39.289199  3685 raft_consensus.cc:697] T e5d5f35ac8584926a75208edc395f0d6 P 6b0316ac722f4603bd53197367ed1c4d [term 1 LEADER]: Becoming Leader. State: Replica: 6b0316ac722f4603bd53197367ed1c4d, State: Running, Role: LEADER
I20260709 13:13:39.290015  3685 consensus_queue.cc:237] T e5d5f35ac8584926a75208edc395f0d6 P 6b0316ac722f4603bd53197367ed1c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.290359  3663 raft_consensus.cc:359] T a288028b1ba44234b32168b0fea601f9 P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.290979  3663 raft_consensus.cc:385] T a288028b1ba44234b32168b0fea601f9 P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.291260  3663 raft_consensus.cc:740] T a288028b1ba44234b32168b0fea601f9 P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0316ac722f4603bd53197367ed1c4d, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.292991  3663 consensus_queue.cc:260] T a288028b1ba44234b32168b0fea601f9 P 6b0316ac722f4603bd53197367ed1c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.294914  3680 leader_election.cc:290] T e5d5f35ac8584926a75208edc395f0d6 P 6b0316ac722f4603bd53197367ed1c4d [CANDIDATE]: Term 1 election: Requested vote from peers 0ce4927ed21e494fa47cd82d743826c7 (127.2.198.194:45581), 0b4332b9c1a84bde9278052eb2b32835 (127.2.198.195:33933)
I20260709 13:13:39.296198  3621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5d5f35ac8584926a75208edc395f0d6" candidate_uuid: "6b0316ac722f4603bd53197367ed1c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b4332b9c1a84bde9278052eb2b32835"
I20260709 13:13:39.297778  3663 ts_tablet_manager.cc:1434] T a288028b1ba44234b32168b0fea601f9 P 6b0316ac722f4603bd53197367ed1c4d: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
W20260709 13:13:39.298110  3437 leader_election.cc:343] T e5d5f35ac8584926a75208edc395f0d6 P 6b0316ac722f4603bd53197367ed1c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0b4332b9c1a84bde9278052eb2b32835 (127.2.198.195:33933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:39.298590  3664 tablet_bootstrap.cc:654] T a1b40b6f843b4e68b03b9286ad71384f P 0b4332b9c1a84bde9278052eb2b32835: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.298951  3663 tablet_bootstrap.cc:492] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 6b0316ac722f4603bd53197367ed1c4d: Bootstrap starting.
I20260709 13:13:39.303403  3662 tablet_bootstrap.cc:492] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 0ce4927ed21e494fa47cd82d743826c7: No bootstrap required, opened a new log
I20260709 13:13:39.303939  3662 ts_tablet_manager.cc:1403] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 0ce4927ed21e494fa47cd82d743826c7: Time spent bootstrapping tablet: real 0.061s	user 0.023s	sys 0.032s
I20260709 13:13:39.305492  3663 tablet_bootstrap.cc:654] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 6b0316ac722f4603bd53197367ed1c4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.306838  3662 raft_consensus.cc:359] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.307860  3662 raft_consensus.cc:385] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.308254  3662 raft_consensus.cc:740] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ce4927ed21e494fa47cd82d743826c7, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.309355  3702 raft_consensus.cc:493] T bde0fa9eb0a643ce81bf46013ef6a572 P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.305470  3370 catalog_manager.cc:5697] T e5d5f35ac8584926a75208edc395f0d6 P 6b0316ac722f4603bd53197367ed1c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b0316ac722f4603bd53197367ed1c4d (127.2.198.193). New cstate: current_term: 1 leader_uuid: "6b0316ac722f4603bd53197367ed1c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:39.309844  3702 raft_consensus.cc:515] T bde0fa9eb0a643ce81bf46013ef6a572 P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.309556  3662 consensus_queue.cc:260] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 0ce4927ed21e494fa47cd82d743826c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.312448  3702 leader_election.cc:290] T bde0fa9eb0a643ce81bf46013ef6a572 P 0ce4927ed21e494fa47cd82d743826c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b0316ac722f4603bd53197367ed1c4d (127.2.198.193:44435), 0b4332b9c1a84bde9278052eb2b32835 (127.2.198.195:33933)
I20260709 13:13:39.314179  3472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bde0fa9eb0a643ce81bf46013ef6a572" candidate_uuid: "0ce4927ed21e494fa47cd82d743826c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0316ac722f4603bd53197367ed1c4d" is_pre_election: true
I20260709 13:13:39.314875  3472 raft_consensus.cc:2468] T bde0fa9eb0a643ce81bf46013ef6a572 P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ce4927ed21e494fa47cd82d743826c7 in term 0.
I20260709 13:13:39.317261  3514 leader_election.cc:304] T bde0fa9eb0a643ce81bf46013ef6a572 P 0ce4927ed21e494fa47cd82d743826c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ce4927ed21e494fa47cd82d743826c7, 6b0316ac722f4603bd53197367ed1c4d; no voters: 
I20260709 13:13:39.318558  3621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bde0fa9eb0a643ce81bf46013ef6a572" candidate_uuid: "0ce4927ed21e494fa47cd82d743826c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b4332b9c1a84bde9278052eb2b32835" is_pre_election: true
I20260709 13:13:39.319242  3621 raft_consensus.cc:2468] T bde0fa9eb0a643ce81bf46013ef6a572 P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ce4927ed21e494fa47cd82d743826c7 in term 0.
I20260709 13:13:39.321470  3707 raft_consensus.cc:2804] T bde0fa9eb0a643ce81bf46013ef6a572 P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:39.321841  3707 raft_consensus.cc:493] T bde0fa9eb0a643ce81bf46013ef6a572 P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.322068  3662 ts_tablet_manager.cc:1434] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 0ce4927ed21e494fa47cd82d743826c7: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:13:39.322189  3707 raft_consensus.cc:3060] T bde0fa9eb0a643ce81bf46013ef6a572 P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.327790  3664 tablet_bootstrap.cc:492] T a1b40b6f843b4e68b03b9286ad71384f P 0b4332b9c1a84bde9278052eb2b32835: No bootstrap required, opened a new log
I20260709 13:13:39.328325  3664 ts_tablet_manager.cc:1403] T a1b40b6f843b4e68b03b9286ad71384f P 0b4332b9c1a84bde9278052eb2b32835: Time spent bootstrapping tablet: real 0.048s	user 0.010s	sys 0.011s
I20260709 13:13:39.328920  3663 tablet_bootstrap.cc:492] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 6b0316ac722f4603bd53197367ed1c4d: No bootstrap required, opened a new log
I20260709 13:13:39.329499  3663 ts_tablet_manager.cc:1403] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 6b0316ac722f4603bd53197367ed1c4d: Time spent bootstrapping tablet: real 0.031s	user 0.007s	sys 0.019s
I20260709 13:13:39.332146  3663 raft_consensus.cc:359] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.332226  3664 raft_consensus.cc:359] T a1b40b6f843b4e68b03b9286ad71384f P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.333380  3664 raft_consensus.cc:385] T a1b40b6f843b4e68b03b9286ad71384f P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.333631  3664 raft_consensus.cc:740] T a1b40b6f843b4e68b03b9286ad71384f P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b4332b9c1a84bde9278052eb2b32835, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.334561  3664 consensus_queue.cc:260] T a1b40b6f843b4e68b03b9286ad71384f P 0b4332b9c1a84bde9278052eb2b32835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.333025  3663 raft_consensus.cc:385] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.337402  3663 raft_consensus.cc:740] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0316ac722f4603bd53197367ed1c4d, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.337188  3707 raft_consensus.cc:515] T bde0fa9eb0a643ce81bf46013ef6a572 P 0ce4927ed21e494fa47cd82d743826c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.338260  3663 consensus_queue.cc:260] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 6b0316ac722f4603bd53197367ed1c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.340258  3472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bde0fa9eb0a643ce81bf46013ef6a572" candidate_uuid: "0ce4927ed21e494fa47cd82d743826c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0316ac722f4603bd53197367ed1c4d"
I20260709 13:13:39.340632  3621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bde0fa9eb0a643ce81bf46013ef6a572" candidate_uuid: "0ce4927ed21e494fa47cd82d743826c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b4332b9c1a84bde9278052eb2b32835"
I20260709 13:13:39.340921  3663 ts_tablet_manager.cc:1434] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 6b0316ac722f4603bd53197367ed1c4d: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:13:39.340875  3472 raft_consensus.cc:3060] T bde0fa9eb0a643ce81bf46013ef6a572 P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.341241  3621 raft_consensus.cc:3060] T bde0fa9eb0a643ce81bf46013ef6a572 P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.343750  3702 raft_consensus.cc:493] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.344237  3702 raft_consensus.cc:515] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.346508  3702 leader_election.cc:290] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0ce4927ed21e494fa47cd82d743826c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b0316ac722f4603bd53197367ed1c4d (127.2.198.193:44435), 0b4332b9c1a84bde9278052eb2b32835 (127.2.198.195:33933)
I20260709 13:13:39.348852  3472 raft_consensus.cc:2468] T bde0fa9eb0a643ce81bf46013ef6a572 P 6b0316ac722f4603bd53197367ed1c4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ce4927ed21e494fa47cd82d743826c7 in term 1.
I20260709 13:13:39.349256  3473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9fa52d1dd94e6db840e2f48bf4f92f" candidate_uuid: "0ce4927ed21e494fa47cd82d743826c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0316ac722f4603bd53197367ed1c4d" is_pre_election: true
I20260709 13:13:39.349974  3473 raft_consensus.cc:2468] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ce4927ed21e494fa47cd82d743826c7 in term 0.
I20260709 13:13:39.348269  3622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9fa52d1dd94e6db840e2f48bf4f92f" candidate_uuid: "0ce4927ed21e494fa47cd82d743826c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b4332b9c1a84bde9278052eb2b32835" is_pre_election: true
I20260709 13:13:39.351030  3664 ts_tablet_manager.cc:1434] T a1b40b6f843b4e68b03b9286ad71384f P 0b4332b9c1a84bde9278052eb2b32835: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:13:39.350996  3622 raft_consensus.cc:2468] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ce4927ed21e494fa47cd82d743826c7 in term 0.
I20260709 13:13:39.351900  3514 leader_election.cc:304] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0ce4927ed21e494fa47cd82d743826c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ce4927ed21e494fa47cd82d743826c7, 6b0316ac722f4603bd53197367ed1c4d; no voters: 
I20260709 13:13:39.352321  3664 tablet_bootstrap.cc:492] T e5d5f35ac8584926a75208edc395f0d6 P 0b4332b9c1a84bde9278052eb2b32835: Bootstrap starting.
I20260709 13:13:39.353215  3514 leader_election.cc:304] T bde0fa9eb0a643ce81bf46013ef6a572 P 0ce4927ed21e494fa47cd82d743826c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ce4927ed21e494fa47cd82d743826c7, 6b0316ac722f4603bd53197367ed1c4d; no voters: 
I20260709 13:13:39.354020  3666 raft_consensus.cc:2804] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:39.354089  3702 raft_consensus.cc:2804] T bde0fa9eb0a643ce81bf46013ef6a572 P 0ce4927ed21e494fa47cd82d743826c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:39.354507  3666 raft_consensus.cc:493] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.354887  3666 raft_consensus.cc:3060] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.360038  3664 tablet_bootstrap.cc:654] T e5d5f35ac8584926a75208edc395f0d6 P 0b4332b9c1a84bde9278052eb2b32835: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.364894  3707 leader_election.cc:290] T bde0fa9eb0a643ce81bf46013ef6a572 P 0ce4927ed21e494fa47cd82d743826c7 [CANDIDATE]: Term 1 election: Requested vote from peers 6b0316ac722f4603bd53197367ed1c4d (127.2.198.193:44435), 0b4332b9c1a84bde9278052eb2b32835 (127.2.198.195:33933)
I20260709 13:13:39.365687  3664 tablet_bootstrap.cc:492] T e5d5f35ac8584926a75208edc395f0d6 P 0b4332b9c1a84bde9278052eb2b32835: No bootstrap required, opened a new log
I20260709 13:13:39.365773  3621 raft_consensus.cc:2468] T bde0fa9eb0a643ce81bf46013ef6a572 P 0b4332b9c1a84bde9278052eb2b32835 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ce4927ed21e494fa47cd82d743826c7 in term 1.
I20260709 13:13:39.366338  3664 ts_tablet_manager.cc:1403] T e5d5f35ac8584926a75208edc395f0d6 P 0b4332b9c1a84bde9278052eb2b32835: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.005s
I20260709 13:13:39.369405  3666 raft_consensus.cc:515] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0ce4927ed21e494fa47cd82d743826c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.369385  3664 raft_consensus.cc:359] T e5d5f35ac8584926a75208edc395f0d6 P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.370712  3664 raft_consensus.cc:385] T e5d5f35ac8584926a75208edc395f0d6 P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.371925  3664 raft_consensus.cc:740] T e5d5f35ac8584926a75208edc395f0d6 P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b4332b9c1a84bde9278052eb2b32835, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.371318  3702 raft_consensus.cc:697] T bde0fa9eb0a643ce81bf46013ef6a572 P 0ce4927ed21e494fa47cd82d743826c7 [term 1 LEADER]: Becoming Leader. State: Replica: 0ce4927ed21e494fa47cd82d743826c7, State: Running, Role: LEADER
I20260709 13:13:39.372872  3473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9fa52d1dd94e6db840e2f48bf4f92f" candidate_uuid: "0ce4927ed21e494fa47cd82d743826c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0316ac722f4603bd53197367ed1c4d"
I20260709 13:13:39.373342  3621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9fa52d1dd94e6db840e2f48bf4f92f" candidate_uuid: "0ce4927ed21e494fa47cd82d743826c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b4332b9c1a84bde9278052eb2b32835"
I20260709 13:13:39.373515  3473 raft_consensus.cc:3060] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.373095  3702 consensus_queue.cc:237] T bde0fa9eb0a643ce81bf46013ef6a572 P 0ce4927ed21e494fa47cd82d743826c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.374001  3621 raft_consensus.cc:3060] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.374027  3666 leader_election.cc:290] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0ce4927ed21e494fa47cd82d743826c7 [CANDIDATE]: Term 1 election: Requested vote from peers 6b0316ac722f4603bd53197367ed1c4d (127.2.198.193:44435), 0b4332b9c1a84bde9278052eb2b32835 (127.2.198.195:33933)
I20260709 13:13:39.373142  3664 consensus_queue.cc:260] T e5d5f35ac8584926a75208edc395f0d6 P 0b4332b9c1a84bde9278052eb2b32835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.381596  3621 raft_consensus.cc:2468] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0b4332b9c1a84bde9278052eb2b32835 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ce4927ed21e494fa47cd82d743826c7 in term 1.
I20260709 13:13:39.381596  3473 raft_consensus.cc:2468] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 6b0316ac722f4603bd53197367ed1c4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ce4927ed21e494fa47cd82d743826c7 in term 1.
I20260709 13:13:39.383404  3512 leader_election.cc:304] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0ce4927ed21e494fa47cd82d743826c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b4332b9c1a84bde9278052eb2b32835, 0ce4927ed21e494fa47cd82d743826c7; no voters: 
I20260709 13:13:39.384374  3666 raft_consensus.cc:2804] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0ce4927ed21e494fa47cd82d743826c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:39.384984  3666 raft_consensus.cc:697] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0ce4927ed21e494fa47cd82d743826c7 [term 1 LEADER]: Becoming Leader. State: Replica: 0ce4927ed21e494fa47cd82d743826c7, State: Running, Role: LEADER
I20260709 13:13:39.386655  3666 consensus_queue.cc:237] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0ce4927ed21e494fa47cd82d743826c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.396983  3664 ts_tablet_manager.cc:1434] T e5d5f35ac8584926a75208edc395f0d6 P 0b4332b9c1a84bde9278052eb2b32835: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.010s
I20260709 13:13:39.398698  3664 tablet_bootstrap.cc:492] T 708d5be49a784b86aa09af32b0f7efd9 P 0b4332b9c1a84bde9278052eb2b32835: Bootstrap starting.
I20260709 13:13:39.402117  3371 catalog_manager.cc:5697] T bde0fa9eb0a643ce81bf46013ef6a572 P 0ce4927ed21e494fa47cd82d743826c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ce4927ed21e494fa47cd82d743826c7 (127.2.198.194). New cstate: current_term: 1 leader_uuid: "0ce4927ed21e494fa47cd82d743826c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:39.408028  3664 tablet_bootstrap.cc:654] T 708d5be49a784b86aa09af32b0f7efd9 P 0b4332b9c1a84bde9278052eb2b32835: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.409663  3666 raft_consensus.cc:493] T 6e13df989df94dae888a9c7b79470112 P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.410179  3666 raft_consensus.cc:515] T 6e13df989df94dae888a9c7b79470112 P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.412356  3666 leader_election.cc:290] T 6e13df989df94dae888a9c7b79470112 P 0ce4927ed21e494fa47cd82d743826c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b0316ac722f4603bd53197367ed1c4d (127.2.198.193:44435), 0b4332b9c1a84bde9278052eb2b32835 (127.2.198.195:33933)
I20260709 13:13:39.413354  3473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e13df989df94dae888a9c7b79470112" candidate_uuid: "0ce4927ed21e494fa47cd82d743826c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0316ac722f4603bd53197367ed1c4d" is_pre_election: true
I20260709 13:13:39.413829  3621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e13df989df94dae888a9c7b79470112" candidate_uuid: "0ce4927ed21e494fa47cd82d743826c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b4332b9c1a84bde9278052eb2b32835" is_pre_election: true
I20260709 13:13:39.414719  3621 raft_consensus.cc:2393] T 6e13df989df94dae888a9c7b79470112 P 0b4332b9c1a84bde9278052eb2b32835 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ce4927ed21e494fa47cd82d743826c7 in current term 1: Already voted for candidate 6b0316ac722f4603bd53197367ed1c4d in this term.
I20260709 13:13:39.416786  3512 leader_election.cc:304] T 6e13df989df94dae888a9c7b79470112 P 0ce4927ed21e494fa47cd82d743826c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ce4927ed21e494fa47cd82d743826c7; no voters: 0b4332b9c1a84bde9278052eb2b32835, 6b0316ac722f4603bd53197367ed1c4d
I20260709 13:13:39.417721  3666 raft_consensus.cc:3060] T 6e13df989df94dae888a9c7b79470112 P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.418869  3664 tablet_bootstrap.cc:492] T 708d5be49a784b86aa09af32b0f7efd9 P 0b4332b9c1a84bde9278052eb2b32835: No bootstrap required, opened a new log
I20260709 13:13:39.418123  3371 catalog_manager.cc:5697] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0ce4927ed21e494fa47cd82d743826c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ce4927ed21e494fa47cd82d743826c7 (127.2.198.194). New cstate: current_term: 1 leader_uuid: "0ce4927ed21e494fa47cd82d743826c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:39.419341  3664 ts_tablet_manager.cc:1403] T 708d5be49a784b86aa09af32b0f7efd9 P 0b4332b9c1a84bde9278052eb2b32835: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.002s
I20260709 13:13:39.422874  3664 raft_consensus.cc:359] T 708d5be49a784b86aa09af32b0f7efd9 P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.423600  3664 raft_consensus.cc:385] T 708d5be49a784b86aa09af32b0f7efd9 P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.423882  3664 raft_consensus.cc:740] T 708d5be49a784b86aa09af32b0f7efd9 P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b4332b9c1a84bde9278052eb2b32835, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.423962  3666 raft_consensus.cc:2749] T 6e13df989df94dae888a9c7b79470112 P 0ce4927ed21e494fa47cd82d743826c7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:39.424641  3664 consensus_queue.cc:260] T 708d5be49a784b86aa09af32b0f7efd9 P 0b4332b9c1a84bde9278052eb2b32835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.426733  3664 ts_tablet_manager.cc:1434] T 708d5be49a784b86aa09af32b0f7efd9 P 0b4332b9c1a84bde9278052eb2b32835: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:13:39.427708  3664 tablet_bootstrap.cc:492] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 0b4332b9c1a84bde9278052eb2b32835: Bootstrap starting.
I20260709 13:13:39.432684  3664 tablet_bootstrap.cc:654] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 0b4332b9c1a84bde9278052eb2b32835: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.437709  3664 tablet_bootstrap.cc:492] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 0b4332b9c1a84bde9278052eb2b32835: No bootstrap required, opened a new log
I20260709 13:13:39.438158  3664 ts_tablet_manager.cc:1403] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 0b4332b9c1a84bde9278052eb2b32835: Time spent bootstrapping tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:13:39.440274  3664 raft_consensus.cc:359] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.440776  3664 raft_consensus.cc:385] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.440986  3664 raft_consensus.cc:740] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b4332b9c1a84bde9278052eb2b32835, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.441591  3664 consensus_queue.cc:260] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 0b4332b9c1a84bde9278052eb2b32835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.443171  3664 ts_tablet_manager.cc:1434] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 0b4332b9c1a84bde9278052eb2b32835: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:13:39.444738  3685 raft_consensus.cc:493] T 708d5be49a784b86aa09af32b0f7efd9 P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.445217  3685 raft_consensus.cc:515] T 708d5be49a784b86aa09af32b0f7efd9 P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.446990  3685 leader_election.cc:290] T 708d5be49a784b86aa09af32b0f7efd9 P 6b0316ac722f4603bd53197367ed1c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ce4927ed21e494fa47cd82d743826c7 (127.2.198.194:45581), 0b4332b9c1a84bde9278052eb2b32835 (127.2.198.195:33933)
I20260709 13:13:39.447829  3548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708d5be49a784b86aa09af32b0f7efd9" candidate_uuid: "6b0316ac722f4603bd53197367ed1c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce4927ed21e494fa47cd82d743826c7" is_pre_election: true
I20260709 13:13:39.448302  3621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708d5be49a784b86aa09af32b0f7efd9" candidate_uuid: "6b0316ac722f4603bd53197367ed1c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b4332b9c1a84bde9278052eb2b32835" is_pre_election: true
I20260709 13:13:39.448541  3548 raft_consensus.cc:2468] T 708d5be49a784b86aa09af32b0f7efd9 P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b0316ac722f4603bd53197367ed1c4d in term 0.
I20260709 13:13:39.449105  3621 raft_consensus.cc:2468] T 708d5be49a784b86aa09af32b0f7efd9 P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b0316ac722f4603bd53197367ed1c4d in term 0.
I20260709 13:13:39.449718  3436 leader_election.cc:304] T 708d5be49a784b86aa09af32b0f7efd9 P 6b0316ac722f4603bd53197367ed1c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ce4927ed21e494fa47cd82d743826c7, 6b0316ac722f4603bd53197367ed1c4d; no voters: 
I20260709 13:13:39.450614  3685 raft_consensus.cc:2804] T 708d5be49a784b86aa09af32b0f7efd9 P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:39.450999  3685 raft_consensus.cc:493] T 708d5be49a784b86aa09af32b0f7efd9 P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.451342  3685 raft_consensus.cc:3060] T 708d5be49a784b86aa09af32b0f7efd9 P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.456707  3685 raft_consensus.cc:515] T 708d5be49a784b86aa09af32b0f7efd9 P 6b0316ac722f4603bd53197367ed1c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.458606  3685 leader_election.cc:290] T 708d5be49a784b86aa09af32b0f7efd9 P 6b0316ac722f4603bd53197367ed1c4d [CANDIDATE]: Term 1 election: Requested vote from peers 0ce4927ed21e494fa47cd82d743826c7 (127.2.198.194:45581), 0b4332b9c1a84bde9278052eb2b32835 (127.2.198.195:33933)
I20260709 13:13:39.459842  3548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708d5be49a784b86aa09af32b0f7efd9" candidate_uuid: "6b0316ac722f4603bd53197367ed1c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce4927ed21e494fa47cd82d743826c7"
I20260709 13:13:39.459859  3621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708d5be49a784b86aa09af32b0f7efd9" candidate_uuid: "6b0316ac722f4603bd53197367ed1c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b4332b9c1a84bde9278052eb2b32835"
I20260709 13:13:39.460534  3548 raft_consensus.cc:3060] T 708d5be49a784b86aa09af32b0f7efd9 P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.460620  3621 raft_consensus.cc:3060] T 708d5be49a784b86aa09af32b0f7efd9 P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.465741  3621 raft_consensus.cc:2468] T 708d5be49a784b86aa09af32b0f7efd9 P 0b4332b9c1a84bde9278052eb2b32835 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0316ac722f4603bd53197367ed1c4d in term 1.
I20260709 13:13:39.465741  3548 raft_consensus.cc:2468] T 708d5be49a784b86aa09af32b0f7efd9 P 0ce4927ed21e494fa47cd82d743826c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0316ac722f4603bd53197367ed1c4d in term 1.
I20260709 13:13:39.467008  3436 leader_election.cc:304] T 708d5be49a784b86aa09af32b0f7efd9 P 6b0316ac722f4603bd53197367ed1c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ce4927ed21e494fa47cd82d743826c7, 6b0316ac722f4603bd53197367ed1c4d; no voters: 
I20260709 13:13:39.467793  3685 raft_consensus.cc:2804] T 708d5be49a784b86aa09af32b0f7efd9 P 6b0316ac722f4603bd53197367ed1c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:39.468194  3685 raft_consensus.cc:697] T 708d5be49a784b86aa09af32b0f7efd9 P 6b0316ac722f4603bd53197367ed1c4d [term 1 LEADER]: Becoming Leader. State: Replica: 6b0316ac722f4603bd53197367ed1c4d, State: Running, Role: LEADER
I20260709 13:13:39.469029  3685 consensus_queue.cc:237] T 708d5be49a784b86aa09af32b0f7efd9 P 6b0316ac722f4603bd53197367ed1c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.471939  3621 raft_consensus.cc:3060] T a1b40b6f843b4e68b03b9286ad71384f P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.476580  3371 catalog_manager.cc:5697] T 708d5be49a784b86aa09af32b0f7efd9 P 6b0316ac722f4603bd53197367ed1c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b0316ac722f4603bd53197367ed1c4d (127.2.198.193). New cstate: current_term: 1 leader_uuid: "6b0316ac722f4603bd53197367ed1c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:39.479460  3685 consensus_queue.cc:1048] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:39.480928  3685 raft_consensus.cc:493] T a288028b1ba44234b32168b0fea601f9 P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.481408  3685 raft_consensus.cc:515] T a288028b1ba44234b32168b0fea601f9 P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.483471  3685 leader_election.cc:290] T a288028b1ba44234b32168b0fea601f9 P 6b0316ac722f4603bd53197367ed1c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ce4927ed21e494fa47cd82d743826c7 (127.2.198.194:45581), 0b4332b9c1a84bde9278052eb2b32835 (127.2.198.195:33933)
I20260709 13:13:39.484184  3548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a288028b1ba44234b32168b0fea601f9" candidate_uuid: "6b0316ac722f4603bd53197367ed1c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce4927ed21e494fa47cd82d743826c7" is_pre_election: true
I20260709 13:13:39.485093  3548 raft_consensus.cc:2393] T a288028b1ba44234b32168b0fea601f9 P 0ce4927ed21e494fa47cd82d743826c7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b0316ac722f4603bd53197367ed1c4d in current term 1: Already voted for candidate 0b4332b9c1a84bde9278052eb2b32835 in this term.
I20260709 13:13:39.485025  3622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a288028b1ba44234b32168b0fea601f9" candidate_uuid: "6b0316ac722f4603bd53197367ed1c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b4332b9c1a84bde9278052eb2b32835" is_pre_election: true
I20260709 13:13:39.487012  3437 leader_election.cc:304] T a288028b1ba44234b32168b0fea601f9 P 6b0316ac722f4603bd53197367ed1c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b0316ac722f4603bd53197367ed1c4d; no voters: 0b4332b9c1a84bde9278052eb2b32835, 0ce4927ed21e494fa47cd82d743826c7
I20260709 13:13:39.488314  3685 raft_consensus.cc:3060] T a288028b1ba44234b32168b0fea601f9 P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.496927  3685 raft_consensus.cc:2749] T a288028b1ba44234b32168b0fea601f9 P 6b0316ac722f4603bd53197367ed1c4d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:39.503412  3685 consensus_queue.cc:1048] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:39.541790  3679 consensus_queue.cc:1048] T a288028b1ba44234b32168b0fea601f9 P 0b4332b9c1a84bde9278052eb2b32835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:39.553982  3693 consensus_queue.cc:1048] T a288028b1ba44234b32168b0fea601f9 P 0b4332b9c1a84bde9278052eb2b32835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:39.613570  3669 raft_consensus.cc:493] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.614316  3669 raft_consensus.cc:515] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.616811  3669 leader_election.cc:290] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 6b0316ac722f4603bd53197367ed1c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ce4927ed21e494fa47cd82d743826c7 (127.2.198.194:45581), 0b4332b9c1a84bde9278052eb2b32835 (127.2.198.195:33933)
I20260709 13:13:39.618005  3621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab238772b3f4d1f9fe46f75ae91b0bc" candidate_uuid: "6b0316ac722f4603bd53197367ed1c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b4332b9c1a84bde9278052eb2b32835" is_pre_election: true
I20260709 13:13:39.618754  3621 raft_consensus.cc:2468] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b0316ac722f4603bd53197367ed1c4d in term 0.
I20260709 13:13:39.617918  3548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab238772b3f4d1f9fe46f75ae91b0bc" candidate_uuid: "6b0316ac722f4603bd53197367ed1c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce4927ed21e494fa47cd82d743826c7" is_pre_election: true
I20260709 13:13:39.619726  3548 raft_consensus.cc:2468] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b0316ac722f4603bd53197367ed1c4d in term 0.
I20260709 13:13:39.620811  3436 leader_election.cc:304] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 6b0316ac722f4603bd53197367ed1c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ce4927ed21e494fa47cd82d743826c7, 6b0316ac722f4603bd53197367ed1c4d; no voters: 
I20260709 13:13:39.621135  3666 consensus_queue.cc:1048] T d5950c15e891492695358c32b92f10d0 P 0ce4927ed21e494fa47cd82d743826c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:39.621637  3669 raft_consensus.cc:2804] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:39.622053  3669 raft_consensus.cc:493] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.622373  3669 raft_consensus.cc:3060] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 6b0316ac722f4603bd53197367ed1c4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.629459  3669 raft_consensus.cc:515] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 6b0316ac722f4603bd53197367ed1c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.631565  3669 leader_election.cc:290] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 6b0316ac722f4603bd53197367ed1c4d [CANDIDATE]: Term 1 election: Requested vote from peers 0ce4927ed21e494fa47cd82d743826c7 (127.2.198.194:45581), 0b4332b9c1a84bde9278052eb2b32835 (127.2.198.195:33933)
I20260709 13:13:39.632648  3548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab238772b3f4d1f9fe46f75ae91b0bc" candidate_uuid: "6b0316ac722f4603bd53197367ed1c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce4927ed21e494fa47cd82d743826c7"
I20260709 13:13:39.633273  3548 raft_consensus.cc:3060] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 0ce4927ed21e494fa47cd82d743826c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.634589  3666 consensus_queue.cc:1048] T d5950c15e891492695358c32b92f10d0 P 0ce4927ed21e494fa47cd82d743826c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:39.638422  3622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab238772b3f4d1f9fe46f75ae91b0bc" candidate_uuid: "6b0316ac722f4603bd53197367ed1c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b4332b9c1a84bde9278052eb2b32835"
I20260709 13:13:39.638571  3685 consensus_queue.cc:1048] T 6e13df989df94dae888a9c7b79470112 P 6b0316ac722f4603bd53197367ed1c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:39.639043  3622 raft_consensus.cc:3060] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.646930  3622 raft_consensus.cc:2468] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 0b4332b9c1a84bde9278052eb2b32835 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0316ac722f4603bd53197367ed1c4d in term 1.
I20260709 13:13:39.648551  3437 leader_election.cc:304] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 6b0316ac722f4603bd53197367ed1c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b4332b9c1a84bde9278052eb2b32835, 6b0316ac722f4603bd53197367ed1c4d; no voters: 
I20260709 13:13:39.649524  3685 raft_consensus.cc:2804] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 6b0316ac722f4603bd53197367ed1c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:39.650018  3685 raft_consensus.cc:697] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 6b0316ac722f4603bd53197367ed1c4d [term 1 LEADER]: Becoming Leader. State: Replica: 6b0316ac722f4603bd53197367ed1c4d, State: Running, Role: LEADER
I20260709 13:13:39.650918  3685 consensus_queue.cc:237] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 6b0316ac722f4603bd53197367ed1c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.653102  3548 raft_consensus.cc:2468] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 0ce4927ed21e494fa47cd82d743826c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0316ac722f4603bd53197367ed1c4d in term 1.
I20260709 13:13:39.665059  3685 consensus_queue.cc:1048] T 6e13df989df94dae888a9c7b79470112 P 6b0316ac722f4603bd53197367ed1c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:13:39.676900  3622 raft_consensus.cc:3060] T e5d5f35ac8584926a75208edc395f0d6 P 0b4332b9c1a84bde9278052eb2b32835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.679467  3371 catalog_manager.cc:5697] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 6b0316ac722f4603bd53197367ed1c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b0316ac722f4603bd53197367ed1c4d (127.2.198.193). New cstate: current_term: 1 leader_uuid: "6b0316ac722f4603bd53197367ed1c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:39.685611  3727 consensus_queue.cc:1048] T e5d5f35ac8584926a75208edc395f0d6 P 6b0316ac722f4603bd53197367ed1c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:39.703503  3680 consensus_queue.cc:1048] T 7a59cf3c416745258673b8c3cebf93c4 P 6b0316ac722f4603bd53197367ed1c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:39.704265  3685 consensus_queue.cc:1048] T e5d5f35ac8584926a75208edc395f0d6 P 6b0316ac722f4603bd53197367ed1c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:39.723340  3669 consensus_queue.cc:1048] T 7a59cf3c416745258673b8c3cebf93c4 P 6b0316ac722f4603bd53197367ed1c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:39.769816  3666 consensus_queue.cc:1048] T bde0fa9eb0a643ce81bf46013ef6a572 P 0ce4927ed21e494fa47cd82d743826c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:39.781915  3702 consensus_queue.cc:1048] T bde0fa9eb0a643ce81bf46013ef6a572 P 0ce4927ed21e494fa47cd82d743826c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:39.814324  3702 consensus_queue.cc:1048] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0ce4927ed21e494fa47cd82d743826c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:39.827781  3548 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5950c15e891492695358c32b92f10d0"
dest_uuid: "0ce4927ed21e494fa47cd82d743826c7"
mode: GRACEFUL
new_leader_uuid: "6b0316ac722f4603bd53197367ed1c4d"
 from {username='slave'} at 127.0.0.1:56960
I20260709 13:13:39.828470  3548 raft_consensus.cc:606] T d5950c15e891492695358c32b92f10d0 P 0ce4927ed21e494fa47cd82d743826c7 [term 1 LEADER]: Received request to transfer leadership to TS 6b0316ac722f4603bd53197367ed1c4d
I20260709 13:13:39.830005  3717 consensus_queue.cc:1048] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0ce4927ed21e494fa47cd82d743826c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:39.852394  3669 consensus_queue.cc:1048] T 708d5be49a784b86aa09af32b0f7efd9 P 6b0316ac722f4603bd53197367ed1c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:39.861173  3473 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "708d5be49a784b86aa09af32b0f7efd9"
dest_uuid: "6b0316ac722f4603bd53197367ed1c4d"
mode: GRACEFUL
new_leader_uuid: "0ce4927ed21e494fa47cd82d743826c7"
 from {username='slave'} at 127.0.0.1:53350
I20260709 13:13:39.861864  3473 raft_consensus.cc:606] T 708d5be49a784b86aa09af32b0f7efd9 P 6b0316ac722f4603bd53197367ed1c4d [term 1 LEADER]: Received request to transfer leadership to TS 0ce4927ed21e494fa47cd82d743826c7
I20260709 13:13:39.868449  3685 raft_consensus.cc:993] T 708d5be49a784b86aa09af32b0f7efd9 P 6b0316ac722f4603bd53197367ed1c4d: : Instructing follower 0ce4927ed21e494fa47cd82d743826c7 to start an election
I20260709 13:13:39.868577  3727 consensus_queue.cc:1048] T 708d5be49a784b86aa09af32b0f7efd9 P 6b0316ac722f4603bd53197367ed1c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:39.868968  3685 raft_consensus.cc:1081] T 708d5be49a784b86aa09af32b0f7efd9 P 6b0316ac722f4603bd53197367ed1c4d [term 1 LEADER]: Signalling peer 0ce4927ed21e494fa47cd82d743826c7 to start an election
I20260709 13:13:39.873054  3548 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "708d5be49a784b86aa09af32b0f7efd9"
dest_uuid: "0ce4927ed21e494fa47cd82d743826c7"
 from {username='slave'} at 127.0.0.1:56942
I20260709 13:13:39.873674  3548 raft_consensus.cc:493] T 708d5be49a784b86aa09af32b0f7efd9 P 0ce4927ed21e494fa47cd82d743826c7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:39.874109  3548 raft_consensus.cc:3060] T 708d5be49a784b86aa09af32b0f7efd9 P 0ce4927ed21e494fa47cd82d743826c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:39.879904  3548 raft_consensus.cc:515] T 708d5be49a784b86aa09af32b0f7efd9 P 0ce4927ed21e494fa47cd82d743826c7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.882756  3473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708d5be49a784b86aa09af32b0f7efd9" candidate_uuid: "0ce4927ed21e494fa47cd82d743826c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6b0316ac722f4603bd53197367ed1c4d"
I20260709 13:13:39.883435  3473 raft_consensus.cc:3055] T 708d5be49a784b86aa09af32b0f7efd9 P 6b0316ac722f4603bd53197367ed1c4d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:39.883848  3473 raft_consensus.cc:740] T 708d5be49a784b86aa09af32b0f7efd9 P 6b0316ac722f4603bd53197367ed1c4d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b0316ac722f4603bd53197367ed1c4d, State: Running, Role: LEADER
I20260709 13:13:39.884608  3548 leader_election.cc:290] T 708d5be49a784b86aa09af32b0f7efd9 P 0ce4927ed21e494fa47cd82d743826c7 [CANDIDATE]: Term 2 election: Requested vote from peers 6b0316ac722f4603bd53197367ed1c4d (127.2.198.193:44435), 0b4332b9c1a84bde9278052eb2b32835 (127.2.198.195:33933)
I20260709 13:13:39.884696  3473 consensus_queue.cc:260] T 708d5be49a784b86aa09af32b0f7efd9 P 6b0316ac722f4603bd53197367ed1c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.885754  3473 raft_consensus.cc:3060] T 708d5be49a784b86aa09af32b0f7efd9 P 6b0316ac722f4603bd53197367ed1c4d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:39.886981  3622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708d5be49a784b86aa09af32b0f7efd9" candidate_uuid: "0ce4927ed21e494fa47cd82d743826c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b4332b9c1a84bde9278052eb2b32835"
I20260709 13:13:39.896327  3473 raft_consensus.cc:2468] T 708d5be49a784b86aa09af32b0f7efd9 P 6b0316ac722f4603bd53197367ed1c4d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ce4927ed21e494fa47cd82d743826c7 in term 2.
I20260709 13:13:39.897600  3514 leader_election.cc:304] T 708d5be49a784b86aa09af32b0f7efd9 P 0ce4927ed21e494fa47cd82d743826c7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ce4927ed21e494fa47cd82d743826c7, 6b0316ac722f4603bd53197367ed1c4d; no voters: 0b4332b9c1a84bde9278052eb2b32835
I20260709 13:13:39.898582  3717 raft_consensus.cc:2804] T 708d5be49a784b86aa09af32b0f7efd9 P 0ce4927ed21e494fa47cd82d743826c7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:39.899135  3717 raft_consensus.cc:697] T 708d5be49a784b86aa09af32b0f7efd9 P 0ce4927ed21e494fa47cd82d743826c7 [term 2 LEADER]: Becoming Leader. State: Replica: 0ce4927ed21e494fa47cd82d743826c7, State: Running, Role: LEADER
I20260709 13:13:39.900055  3717 consensus_queue.cc:237] T 708d5be49a784b86aa09af32b0f7efd9 P 0ce4927ed21e494fa47cd82d743826c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:39.905853  3621 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a288028b1ba44234b32168b0fea601f9"
dest_uuid: "0b4332b9c1a84bde9278052eb2b32835"
mode: GRACEFUL
new_leader_uuid: "0ce4927ed21e494fa47cd82d743826c7"
 from {username='slave'} at 127.0.0.1:56338
I20260709 13:13:39.906621  3621 raft_consensus.cc:606] T a288028b1ba44234b32168b0fea601f9 P 0b4332b9c1a84bde9278052eb2b32835 [term 1 LEADER]: Received request to transfer leadership to TS 0ce4927ed21e494fa47cd82d743826c7
I20260709 13:13:39.908526  3369 catalog_manager.cc:5697] T 708d5be49a784b86aa09af32b0f7efd9 P 0ce4927ed21e494fa47cd82d743826c7 reported cstate change: term changed from 1 to 2, leader changed from 6b0316ac722f4603bd53197367ed1c4d (127.2.198.193) to 0ce4927ed21e494fa47cd82d743826c7 (127.2.198.194). New cstate: current_term: 2 leader_uuid: "0ce4927ed21e494fa47cd82d743826c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:39.915571  3473 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ab238772b3f4d1f9fe46f75ae91b0bc"
dest_uuid: "6b0316ac722f4603bd53197367ed1c4d"
mode: GRACEFUL
new_leader_uuid: "0b4332b9c1a84bde9278052eb2b32835"
 from {username='slave'} at 127.0.0.1:53350
I20260709 13:13:39.916309  3473 raft_consensus.cc:606] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 6b0316ac722f4603bd53197367ed1c4d [term 1 LEADER]: Received request to transfer leadership to TS 0b4332b9c1a84bde9278052eb2b32835
I20260709 13:13:40.050149  3679 raft_consensus.cc:993] T a288028b1ba44234b32168b0fea601f9 P 0b4332b9c1a84bde9278052eb2b32835: : Instructing follower 0ce4927ed21e494fa47cd82d743826c7 to start an election
I20260709 13:13:40.050817  3693 raft_consensus.cc:1081] T a288028b1ba44234b32168b0fea601f9 P 0b4332b9c1a84bde9278052eb2b32835 [term 1 LEADER]: Signalling peer 0ce4927ed21e494fa47cd82d743826c7 to start an election
I20260709 13:13:40.052618  3548 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a288028b1ba44234b32168b0fea601f9"
dest_uuid: "0ce4927ed21e494fa47cd82d743826c7"
 from {username='slave'} at 127.0.0.1:56944
I20260709 13:13:40.053176  3548 raft_consensus.cc:493] T a288028b1ba44234b32168b0fea601f9 P 0ce4927ed21e494fa47cd82d743826c7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:40.053521  3548 raft_consensus.cc:3060] T a288028b1ba44234b32168b0fea601f9 P 0ce4927ed21e494fa47cd82d743826c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:40.058736  3548 raft_consensus.cc:515] T a288028b1ba44234b32168b0fea601f9 P 0ce4927ed21e494fa47cd82d743826c7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:40.060725  3548 leader_election.cc:290] T a288028b1ba44234b32168b0fea601f9 P 0ce4927ed21e494fa47cd82d743826c7 [CANDIDATE]: Term 2 election: Requested vote from peers 6b0316ac722f4603bd53197367ed1c4d (127.2.198.193:44435), 0b4332b9c1a84bde9278052eb2b32835 (127.2.198.195:33933)
I20260709 13:13:40.061683  3473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a288028b1ba44234b32168b0fea601f9" candidate_uuid: "0ce4927ed21e494fa47cd82d743826c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6b0316ac722f4603bd53197367ed1c4d"
I20260709 13:13:40.061949  3621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a288028b1ba44234b32168b0fea601f9" candidate_uuid: "0ce4927ed21e494fa47cd82d743826c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b4332b9c1a84bde9278052eb2b32835"
I20260709 13:13:40.062352  3473 raft_consensus.cc:3060] T a288028b1ba44234b32168b0fea601f9 P 6b0316ac722f4603bd53197367ed1c4d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:40.062533  3621 raft_consensus.cc:3055] T a288028b1ba44234b32168b0fea601f9 P 0b4332b9c1a84bde9278052eb2b32835 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:40.062880  3621 raft_consensus.cc:740] T a288028b1ba44234b32168b0fea601f9 P 0b4332b9c1a84bde9278052eb2b32835 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b4332b9c1a84bde9278052eb2b32835, State: Running, Role: LEADER
I20260709 13:13:40.063664  3621 consensus_queue.cc:260] T a288028b1ba44234b32168b0fea601f9 P 0b4332b9c1a84bde9278052eb2b32835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:40.064636  3621 raft_consensus.cc:3060] T a288028b1ba44234b32168b0fea601f9 P 0b4332b9c1a84bde9278052eb2b32835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:40.068109  3473 raft_consensus.cc:2468] T a288028b1ba44234b32168b0fea601f9 P 6b0316ac722f4603bd53197367ed1c4d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ce4927ed21e494fa47cd82d743826c7 in term 2.
I20260709 13:13:40.069399  3514 leader_election.cc:304] T a288028b1ba44234b32168b0fea601f9 P 0ce4927ed21e494fa47cd82d743826c7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ce4927ed21e494fa47cd82d743826c7, 6b0316ac722f4603bd53197367ed1c4d; no voters: 
I20260709 13:13:40.070390  3717 raft_consensus.cc:2804] T a288028b1ba44234b32168b0fea601f9 P 0ce4927ed21e494fa47cd82d743826c7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:40.070513  3621 raft_consensus.cc:2468] T a288028b1ba44234b32168b0fea601f9 P 0b4332b9c1a84bde9278052eb2b32835 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ce4927ed21e494fa47cd82d743826c7 in term 2.
I20260709 13:13:40.070926  3717 raft_consensus.cc:697] T a288028b1ba44234b32168b0fea601f9 P 0ce4927ed21e494fa47cd82d743826c7 [term 2 LEADER]: Becoming Leader. State: Replica: 0ce4927ed21e494fa47cd82d743826c7, State: Running, Role: LEADER
I20260709 13:13:40.071954  3717 consensus_queue.cc:237] T a288028b1ba44234b32168b0fea601f9 P 0ce4927ed21e494fa47cd82d743826c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:40.078704  3369 catalog_manager.cc:5697] T a288028b1ba44234b32168b0fea601f9 P 0ce4927ed21e494fa47cd82d743826c7 reported cstate change: term changed from 1 to 2, leader changed from 0b4332b9c1a84bde9278052eb2b32835 (127.2.198.195) to 0ce4927ed21e494fa47cd82d743826c7 (127.2.198.194). New cstate: current_term: 2 leader_uuid: "0ce4927ed21e494fa47cd82d743826c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:40.113106  3707 raft_consensus.cc:993] T d5950c15e891492695358c32b92f10d0 P 0ce4927ed21e494fa47cd82d743826c7: : Instructing follower 6b0316ac722f4603bd53197367ed1c4d to start an election
I20260709 13:13:40.113677  3717 raft_consensus.cc:1081] T d5950c15e891492695358c32b92f10d0 P 0ce4927ed21e494fa47cd82d743826c7 [term 1 LEADER]: Signalling peer 6b0316ac722f4603bd53197367ed1c4d to start an election
I20260709 13:13:40.115358  3473 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d5950c15e891492695358c32b92f10d0"
dest_uuid: "6b0316ac722f4603bd53197367ed1c4d"
 from {username='slave'} at 127.0.0.1:53346
I20260709 13:13:40.115960  3473 raft_consensus.cc:493] T d5950c15e891492695358c32b92f10d0 P 6b0316ac722f4603bd53197367ed1c4d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:40.116287  3473 raft_consensus.cc:3060] T d5950c15e891492695358c32b92f10d0 P 6b0316ac722f4603bd53197367ed1c4d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:40.121621  3473 raft_consensus.cc:515] T d5950c15e891492695358c32b92f10d0 P 6b0316ac722f4603bd53197367ed1c4d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:40.123451  3473 leader_election.cc:290] T d5950c15e891492695358c32b92f10d0 P 6b0316ac722f4603bd53197367ed1c4d [CANDIDATE]: Term 2 election: Requested vote from peers 0ce4927ed21e494fa47cd82d743826c7 (127.2.198.194:45581), 0b4332b9c1a84bde9278052eb2b32835 (127.2.198.195:33933)
I20260709 13:13:40.124414  3548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5950c15e891492695358c32b92f10d0" candidate_uuid: "6b0316ac722f4603bd53197367ed1c4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ce4927ed21e494fa47cd82d743826c7"
I20260709 13:13:40.124585  3621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5950c15e891492695358c32b92f10d0" candidate_uuid: "6b0316ac722f4603bd53197367ed1c4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b4332b9c1a84bde9278052eb2b32835"
I20260709 13:13:40.125085  3548 raft_consensus.cc:3055] T d5950c15e891492695358c32b92f10d0 P 0ce4927ed21e494fa47cd82d743826c7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:40.125085  3621 raft_consensus.cc:3060] T d5950c15e891492695358c32b92f10d0 P 0b4332b9c1a84bde9278052eb2b32835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:40.125605  3548 raft_consensus.cc:740] T d5950c15e891492695358c32b92f10d0 P 0ce4927ed21e494fa47cd82d743826c7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ce4927ed21e494fa47cd82d743826c7, State: Running, Role: LEADER
I20260709 13:13:40.126468  3548 consensus_queue.cc:260] T d5950c15e891492695358c32b92f10d0 P 0ce4927ed21e494fa47cd82d743826c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:40.127775  3548 raft_consensus.cc:3060] T d5950c15e891492695358c32b92f10d0 P 0ce4927ed21e494fa47cd82d743826c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:40.132926  3621 raft_consensus.cc:2468] T d5950c15e891492695358c32b92f10d0 P 0b4332b9c1a84bde9278052eb2b32835 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0316ac722f4603bd53197367ed1c4d in term 2.
I20260709 13:13:40.134248  3437 leader_election.cc:304] T d5950c15e891492695358c32b92f10d0 P 6b0316ac722f4603bd53197367ed1c4d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b4332b9c1a84bde9278052eb2b32835, 6b0316ac722f4603bd53197367ed1c4d; no voters: 
I20260709 13:13:40.135059  3680 raft_consensus.cc:2804] T d5950c15e891492695358c32b92f10d0 P 6b0316ac722f4603bd53197367ed1c4d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:40.135000  3548 raft_consensus.cc:2468] T d5950c15e891492695358c32b92f10d0 P 0ce4927ed21e494fa47cd82d743826c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0316ac722f4603bd53197367ed1c4d in term 2.
I20260709 13:13:40.135672  3680 raft_consensus.cc:697] T d5950c15e891492695358c32b92f10d0 P 6b0316ac722f4603bd53197367ed1c4d [term 2 LEADER]: Becoming Leader. State: Replica: 6b0316ac722f4603bd53197367ed1c4d, State: Running, Role: LEADER
I20260709 13:13:40.136564  3680 consensus_queue.cc:237] T d5950c15e891492695358c32b92f10d0 P 6b0316ac722f4603bd53197367ed1c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:40.143535  3369 catalog_manager.cc:5697] T d5950c15e891492695358c32b92f10d0 P 6b0316ac722f4603bd53197367ed1c4d reported cstate change: term changed from 1 to 2, leader changed from 0ce4927ed21e494fa47cd82d743826c7 (127.2.198.194) to 6b0316ac722f4603bd53197367ed1c4d (127.2.198.193). New cstate: current_term: 2 leader_uuid: "6b0316ac722f4603bd53197367ed1c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:40.172071  3680 consensus_queue.cc:1048] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 6b0316ac722f4603bd53197367ed1c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:40.178839  3669 raft_consensus.cc:993] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 6b0316ac722f4603bd53197367ed1c4d: : Instructing follower 0b4332b9c1a84bde9278052eb2b32835 to start an election
I20260709 13:13:40.179332  3727 raft_consensus.cc:1081] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 6b0316ac722f4603bd53197367ed1c4d [term 1 LEADER]: Signalling peer 0b4332b9c1a84bde9278052eb2b32835 to start an election
I20260709 13:13:40.181972  3621 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ab238772b3f4d1f9fe46f75ae91b0bc"
dest_uuid: "0b4332b9c1a84bde9278052eb2b32835"
 from {username='slave'} at 127.0.0.1:56326
I20260709 13:13:40.184144  3621 raft_consensus.cc:493] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 0b4332b9c1a84bde9278052eb2b32835 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:40.184556  3621 raft_consensus.cc:3060] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 0b4332b9c1a84bde9278052eb2b32835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:40.185392  3680 consensus_queue.cc:1048] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 6b0316ac722f4603bd53197367ed1c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:40.192545  3621 raft_consensus.cc:515] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 0b4332b9c1a84bde9278052eb2b32835 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:40.196226  3621 leader_election.cc:290] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 0b4332b9c1a84bde9278052eb2b32835 [CANDIDATE]: Term 2 election: Requested vote from peers 6b0316ac722f4603bd53197367ed1c4d (127.2.198.193:44435), 0ce4927ed21e494fa47cd82d743826c7 (127.2.198.194:45581)
I20260709 13:13:40.196944  3473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab238772b3f4d1f9fe46f75ae91b0bc" candidate_uuid: "0b4332b9c1a84bde9278052eb2b32835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6b0316ac722f4603bd53197367ed1c4d"
I20260709 13:13:40.197561  3473 raft_consensus.cc:3055] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 6b0316ac722f4603bd53197367ed1c4d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:40.197901  3473 raft_consensus.cc:740] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 6b0316ac722f4603bd53197367ed1c4d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b0316ac722f4603bd53197367ed1c4d, State: Running, Role: LEADER
I20260709 13:13:40.198081  3548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab238772b3f4d1f9fe46f75ae91b0bc" candidate_uuid: "0b4332b9c1a84bde9278052eb2b32835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ce4927ed21e494fa47cd82d743826c7"
I20260709 13:13:40.198768  3548 raft_consensus.cc:3060] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 0ce4927ed21e494fa47cd82d743826c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:40.198733  3473 consensus_queue.cc:260] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 6b0316ac722f4603bd53197367ed1c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:40.200012  3473 raft_consensus.cc:3060] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 6b0316ac722f4603bd53197367ed1c4d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:40.204918  3548 raft_consensus.cc:2468] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 0ce4927ed21e494fa47cd82d743826c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b4332b9c1a84bde9278052eb2b32835 in term 2.
I20260709 13:13:40.204913  3473 raft_consensus.cc:2468] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 6b0316ac722f4603bd53197367ed1c4d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b4332b9c1a84bde9278052eb2b32835 in term 2.
I20260709 13:13:40.206159  3588 leader_election.cc:304] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 0b4332b9c1a84bde9278052eb2b32835 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b4332b9c1a84bde9278052eb2b32835, 6b0316ac722f4603bd53197367ed1c4d; no voters: 
I20260709 13:13:40.206900  3693 raft_consensus.cc:2804] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 0b4332b9c1a84bde9278052eb2b32835 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:40.207434  3693 raft_consensus.cc:697] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 0b4332b9c1a84bde9278052eb2b32835 [term 2 LEADER]: Becoming Leader. State: Replica: 0b4332b9c1a84bde9278052eb2b32835, State: Running, Role: LEADER
I20260709 13:13:40.208196  3693 consensus_queue.cc:237] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 0b4332b9c1a84bde9278052eb2b32835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:40.214986  3371 catalog_manager.cc:5697] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 0b4332b9c1a84bde9278052eb2b32835 reported cstate change: term changed from 1 to 2, leader changed from 6b0316ac722f4603bd53197367ed1c4d (127.2.198.193) to 0b4332b9c1a84bde9278052eb2b32835 (127.2.198.195). New cstate: current_term: 2 leader_uuid: "0b4332b9c1a84bde9278052eb2b32835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:40.415463  3621 raft_consensus.cc:3060] T 708d5be49a784b86aa09af32b0f7efd9 P 0b4332b9c1a84bde9278052eb2b32835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:40.421015  3621 raft_consensus.cc:1275] T 708d5be49a784b86aa09af32b0f7efd9 P 0b4332b9c1a84bde9278052eb2b32835 [term 2 FOLLOWER]: Refusing update from remote peer 0ce4927ed21e494fa47cd82d743826c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:40.422521  3707 consensus_queue.cc:1048] T 708d5be49a784b86aa09af32b0f7efd9 P 0ce4927ed21e494fa47cd82d743826c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:40.430497  3473 raft_consensus.cc:1275] T 708d5be49a784b86aa09af32b0f7efd9 P 6b0316ac722f4603bd53197367ed1c4d [term 2 FOLLOWER]: Refusing update from remote peer 0ce4927ed21e494fa47cd82d743826c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:40.432148  3717 consensus_queue.cc:1048] T 708d5be49a784b86aa09af32b0f7efd9 P 0ce4927ed21e494fa47cd82d743826c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:40.552403  3621 raft_consensus.cc:1275] T d5950c15e891492695358c32b92f10d0 P 0b4332b9c1a84bde9278052eb2b32835 [term 2 FOLLOWER]: Refusing update from remote peer 6b0316ac722f4603bd53197367ed1c4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:40.553829  3727 consensus_queue.cc:1048] T d5950c15e891492695358c32b92f10d0 P 6b0316ac722f4603bd53197367ed1c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:40.562288  3548 raft_consensus.cc:1275] T d5950c15e891492695358c32b92f10d0 P 0ce4927ed21e494fa47cd82d743826c7 [term 2 FOLLOWER]: Refusing update from remote peer 6b0316ac722f4603bd53197367ed1c4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:40.564267  3680 consensus_queue.cc:1048] T d5950c15e891492695358c32b92f10d0 P 6b0316ac722f4603bd53197367ed1c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:40.617391  3473 raft_consensus.cc:1275] T a288028b1ba44234b32168b0fea601f9 P 6b0316ac722f4603bd53197367ed1c4d [term 2 FOLLOWER]: Refusing update from remote peer 0ce4927ed21e494fa47cd82d743826c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:40.618988  3717 consensus_queue.cc:1048] T a288028b1ba44234b32168b0fea601f9 P 0ce4927ed21e494fa47cd82d743826c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:40.631062  3621 raft_consensus.cc:1275] T a288028b1ba44234b32168b0fea601f9 P 0b4332b9c1a84bde9278052eb2b32835 [term 2 FOLLOWER]: Refusing update from remote peer 0ce4927ed21e494fa47cd82d743826c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:40.632992  3755 consensus_queue.cc:1048] T a288028b1ba44234b32168b0fea601f9 P 0ce4927ed21e494fa47cd82d743826c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:40.793887  3473 raft_consensus.cc:1275] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 6b0316ac722f4603bd53197367ed1c4d [term 2 FOLLOWER]: Refusing update from remote peer 0b4332b9c1a84bde9278052eb2b32835: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:40.795141  3693 consensus_queue.cc:1048] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 0b4332b9c1a84bde9278052eb2b32835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:40.805127  3548 raft_consensus.cc:1275] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 0ce4927ed21e494fa47cd82d743826c7 [term 2 FOLLOWER]: Refusing update from remote peer 0b4332b9c1a84bde9278052eb2b32835: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:40.806699  3758 consensus_queue.cc:1048] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 0b4332b9c1a84bde9278052eb2b32835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:42.949321  2843 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:13:42.950084  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:42.972970  3473 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1b40b6f843b4e68b03b9286ad71384f"
dest_uuid: "6b0316ac722f4603bd53197367ed1c4d"
mode: GRACEFUL
new_leader_uuid: "0b4332b9c1a84bde9278052eb2b32835"
 from {username='slave'} at 127.0.0.1:36116
I20260709 13:13:42.973740  3473 raft_consensus.cc:606] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d [term 1 LEADER]: Received request to transfer leadership to TS 0b4332b9c1a84bde9278052eb2b32835
I20260709 13:13:42.976483  3473 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5950c15e891492695358c32b92f10d0"
dest_uuid: "6b0316ac722f4603bd53197367ed1c4d"
mode: GRACEFUL
new_leader_uuid: "0b4332b9c1a84bde9278052eb2b32835"
 from {username='slave'} at 127.0.0.1:36116
I20260709 13:13:42.976963  3473 raft_consensus.cc:606] T d5950c15e891492695358c32b92f10d0 P 6b0316ac722f4603bd53197367ed1c4d [term 2 LEADER]: Received request to transfer leadership to TS 0b4332b9c1a84bde9278052eb2b32835
I20260709 13:13:42.977988  2843 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:13:42.978492  2843 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:43.104363  3727 raft_consensus.cc:993] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d: : Instructing follower 0b4332b9c1a84bde9278052eb2b32835 to start an election
I20260709 13:13:43.104918  3761 raft_consensus.cc:1081] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d [term 1 LEADER]: Signalling peer 0b4332b9c1a84bde9278052eb2b32835 to start an election
I20260709 13:13:43.106709  3621 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a1b40b6f843b4e68b03b9286ad71384f"
dest_uuid: "0b4332b9c1a84bde9278052eb2b32835"
 from {username='slave'} at 127.0.0.1:56326
I20260709 13:13:43.107367  3621 raft_consensus.cc:493] T a1b40b6f843b4e68b03b9286ad71384f P 0b4332b9c1a84bde9278052eb2b32835 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:43.107775  3621 raft_consensus.cc:3060] T a1b40b6f843b4e68b03b9286ad71384f P 0b4332b9c1a84bde9278052eb2b32835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:43.113657  3621 raft_consensus.cc:515] T a1b40b6f843b4e68b03b9286ad71384f P 0b4332b9c1a84bde9278052eb2b32835 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:43.115592  3621 leader_election.cc:290] T a1b40b6f843b4e68b03b9286ad71384f P 0b4332b9c1a84bde9278052eb2b32835 [CANDIDATE]: Term 2 election: Requested vote from peers 6b0316ac722f4603bd53197367ed1c4d (127.2.198.193:44435), 0ce4927ed21e494fa47cd82d743826c7 (127.2.198.194:45581)
I20260709 13:13:43.116688  3548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1b40b6f843b4e68b03b9286ad71384f" candidate_uuid: "0b4332b9c1a84bde9278052eb2b32835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ce4927ed21e494fa47cd82d743826c7"
I20260709 13:13:43.116853  3473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1b40b6f843b4e68b03b9286ad71384f" candidate_uuid: "0b4332b9c1a84bde9278052eb2b32835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6b0316ac722f4603bd53197367ed1c4d"
I20260709 13:13:43.117275  3548 raft_consensus.cc:3060] T a1b40b6f843b4e68b03b9286ad71384f P 0ce4927ed21e494fa47cd82d743826c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:43.117468  3473 raft_consensus.cc:3055] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:43.117831  3473 raft_consensus.cc:740] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b0316ac722f4603bd53197367ed1c4d, State: Running, Role: LEADER
I20260709 13:13:43.118584  3473 consensus_queue.cc:260] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:43.119659  3473 raft_consensus.cc:3060] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:43.121901  3548 raft_consensus.cc:2468] T a1b40b6f843b4e68b03b9286ad71384f P 0ce4927ed21e494fa47cd82d743826c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b4332b9c1a84bde9278052eb2b32835 in term 2.
I20260709 13:13:43.122949  3585 leader_election.cc:304] T a1b40b6f843b4e68b03b9286ad71384f P 0b4332b9c1a84bde9278052eb2b32835 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b4332b9c1a84bde9278052eb2b32835, 0ce4927ed21e494fa47cd82d743826c7; no voters: 
I20260709 13:13:43.123672  3758 raft_consensus.cc:2804] T a1b40b6f843b4e68b03b9286ad71384f P 0b4332b9c1a84bde9278052eb2b32835 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:43.125044  3758 raft_consensus.cc:697] T a1b40b6f843b4e68b03b9286ad71384f P 0b4332b9c1a84bde9278052eb2b32835 [term 2 LEADER]: Becoming Leader. State: Replica: 0b4332b9c1a84bde9278052eb2b32835, State: Running, Role: LEADER
I20260709 13:13:43.125717  3473 raft_consensus.cc:2468] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b4332b9c1a84bde9278052eb2b32835 in term 2.
I20260709 13:13:43.125972  3758 consensus_queue.cc:237] T a1b40b6f843b4e68b03b9286ad71384f P 0b4332b9c1a84bde9278052eb2b32835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:43.133876  3369 catalog_manager.cc:5697] T a1b40b6f843b4e68b03b9286ad71384f P 0b4332b9c1a84bde9278052eb2b32835 reported cstate change: term changed from 1 to 2, leader changed from 6b0316ac722f4603bd53197367ed1c4d (127.2.198.193) to 0b4332b9c1a84bde9278052eb2b32835 (127.2.198.195). New cstate: current_term: 2 leader_uuid: "0b4332b9c1a84bde9278052eb2b32835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:43.337865  3727 raft_consensus.cc:993] T d5950c15e891492695358c32b92f10d0 P 6b0316ac722f4603bd53197367ed1c4d: : Instructing follower 0b4332b9c1a84bde9278052eb2b32835 to start an election
I20260709 13:13:43.338382  3761 raft_consensus.cc:1081] T d5950c15e891492695358c32b92f10d0 P 6b0316ac722f4603bd53197367ed1c4d [term 2 LEADER]: Signalling peer 0b4332b9c1a84bde9278052eb2b32835 to start an election
I20260709 13:13:43.339747  3622 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d5950c15e891492695358c32b92f10d0"
dest_uuid: "0b4332b9c1a84bde9278052eb2b32835"
 from {username='slave'} at 127.0.0.1:56326
I20260709 13:13:43.340209  3622 raft_consensus.cc:493] T d5950c15e891492695358c32b92f10d0 P 0b4332b9c1a84bde9278052eb2b32835 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:43.340492  3622 raft_consensus.cc:3060] T d5950c15e891492695358c32b92f10d0 P 0b4332b9c1a84bde9278052eb2b32835 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:43.345674  3622 raft_consensus.cc:515] T d5950c15e891492695358c32b92f10d0 P 0b4332b9c1a84bde9278052eb2b32835 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:43.347452  3622 leader_election.cc:290] T d5950c15e891492695358c32b92f10d0 P 0b4332b9c1a84bde9278052eb2b32835 [CANDIDATE]: Term 3 election: Requested vote from peers 0ce4927ed21e494fa47cd82d743826c7 (127.2.198.194:45581), 6b0316ac722f4603bd53197367ed1c4d (127.2.198.193:44435)
I20260709 13:13:43.348438  3548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5950c15e891492695358c32b92f10d0" candidate_uuid: "0b4332b9c1a84bde9278052eb2b32835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0ce4927ed21e494fa47cd82d743826c7"
I20260709 13:13:43.348826  3473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5950c15e891492695358c32b92f10d0" candidate_uuid: "0b4332b9c1a84bde9278052eb2b32835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6b0316ac722f4603bd53197367ed1c4d"
I20260709 13:13:43.349033  3548 raft_consensus.cc:3060] T d5950c15e891492695358c32b92f10d0 P 0ce4927ed21e494fa47cd82d743826c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:43.349455  3473 raft_consensus.cc:3055] T d5950c15e891492695358c32b92f10d0 P 6b0316ac722f4603bd53197367ed1c4d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:43.349830  3473 raft_consensus.cc:740] T d5950c15e891492695358c32b92f10d0 P 6b0316ac722f4603bd53197367ed1c4d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b0316ac722f4603bd53197367ed1c4d, State: Running, Role: LEADER
I20260709 13:13:43.350644  3473 consensus_queue.cc:260] T d5950c15e891492695358c32b92f10d0 P 6b0316ac722f4603bd53197367ed1c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:43.351933  3473 raft_consensus.cc:3060] T d5950c15e891492695358c32b92f10d0 P 6b0316ac722f4603bd53197367ed1c4d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:43.354628  3548 raft_consensus.cc:2468] T d5950c15e891492695358c32b92f10d0 P 0ce4927ed21e494fa47cd82d743826c7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b4332b9c1a84bde9278052eb2b32835 in term 3.
I20260709 13:13:43.355679  3585 leader_election.cc:304] T d5950c15e891492695358c32b92f10d0 P 0b4332b9c1a84bde9278052eb2b32835 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b4332b9c1a84bde9278052eb2b32835, 0ce4927ed21e494fa47cd82d743826c7; no voters: 
I20260709 13:13:43.356419  3758 raft_consensus.cc:2804] T d5950c15e891492695358c32b92f10d0 P 0b4332b9c1a84bde9278052eb2b32835 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:43.356920  3758 raft_consensus.cc:697] T d5950c15e891492695358c32b92f10d0 P 0b4332b9c1a84bde9278052eb2b32835 [term 3 LEADER]: Becoming Leader. State: Replica: 0b4332b9c1a84bde9278052eb2b32835, State: Running, Role: LEADER
I20260709 13:13:43.357887  3473 raft_consensus.cc:2468] T d5950c15e891492695358c32b92f10d0 P 6b0316ac722f4603bd53197367ed1c4d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b4332b9c1a84bde9278052eb2b32835 in term 3.
I20260709 13:13:43.357786  3758 consensus_queue.cc:237] T d5950c15e891492695358c32b92f10d0 P 0b4332b9c1a84bde9278052eb2b32835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:43.368263  3369 catalog_manager.cc:5697] T d5950c15e891492695358c32b92f10d0 P 0b4332b9c1a84bde9278052eb2b32835 reported cstate change: term changed from 2 to 3, leader changed from 6b0316ac722f4603bd53197367ed1c4d (127.2.198.193) to 0b4332b9c1a84bde9278052eb2b32835 (127.2.198.195). New cstate: current_term: 3 leader_uuid: "0b4332b9c1a84bde9278052eb2b32835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:43.665155  3472 raft_consensus.cc:1275] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d [term 2 FOLLOWER]: Refusing update from remote peer 0b4332b9c1a84bde9278052eb2b32835: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:43.666476  3758 consensus_queue.cc:1048] T a1b40b6f843b4e68b03b9286ad71384f P 0b4332b9c1a84bde9278052eb2b32835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:43.677742  3548 raft_consensus.cc:1275] T a1b40b6f843b4e68b03b9286ad71384f P 0ce4927ed21e494fa47cd82d743826c7 [term 2 FOLLOWER]: Refusing update from remote peer 0b4332b9c1a84bde9278052eb2b32835: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:43.679188  3758 consensus_queue.cc:1048] T a1b40b6f843b4e68b03b9286ad71384f P 0b4332b9c1a84bde9278052eb2b32835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:43.848394  3548 raft_consensus.cc:1275] T d5950c15e891492695358c32b92f10d0 P 0ce4927ed21e494fa47cd82d743826c7 [term 3 FOLLOWER]: Refusing update from remote peer 0b4332b9c1a84bde9278052eb2b32835: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:43.849632  3758 consensus_queue.cc:1048] T d5950c15e891492695358c32b92f10d0 P 0b4332b9c1a84bde9278052eb2b32835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:43.859705  3472 raft_consensus.cc:1275] T d5950c15e891492695358c32b92f10d0 P 6b0316ac722f4603bd53197367ed1c4d [term 3 FOLLOWER]: Refusing update from remote peer 0b4332b9c1a84bde9278052eb2b32835: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:43.861289  3779 consensus_queue.cc:1048] T d5950c15e891492695358c32b92f10d0 P 0b4332b9c1a84bde9278052eb2b32835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:43.979357  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:43.990579  3622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5950c15e891492695358c32b92f10d0"
dest_uuid: "0b4332b9c1a84bde9278052eb2b32835"
mode: GRACEFUL
new_leader_uuid: "6b0316ac722f4603bd53197367ed1c4d"
 from {username='slave'} at 127.0.0.1:56338
I20260709 13:13:43.991164  3622 raft_consensus.cc:606] T d5950c15e891492695358c32b92f10d0 P 0b4332b9c1a84bde9278052eb2b32835 [term 3 LEADER]: Received request to transfer leadership to TS 6b0316ac722f4603bd53197367ed1c4d
I20260709 13:13:43.998371  3622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1b40b6f843b4e68b03b9286ad71384f"
dest_uuid: "0b4332b9c1a84bde9278052eb2b32835"
mode: GRACEFUL
new_leader_uuid: "6b0316ac722f4603bd53197367ed1c4d"
 from {username='slave'} at 127.0.0.1:56338
I20260709 13:13:43.998984  3622 raft_consensus.cc:606] T a1b40b6f843b4e68b03b9286ad71384f P 0b4332b9c1a84bde9278052eb2b32835 [term 2 LEADER]: Received request to transfer leadership to TS 6b0316ac722f4603bd53197367ed1c4d
I20260709 13:13:44.008257  3548 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "708d5be49a784b86aa09af32b0f7efd9"
dest_uuid: "0ce4927ed21e494fa47cd82d743826c7"
mode: GRACEFUL
new_leader_uuid: "6b0316ac722f4603bd53197367ed1c4d"
 from {username='slave'} at 127.0.0.1:56960
I20260709 13:13:44.008780  3548 raft_consensus.cc:606] T 708d5be49a784b86aa09af32b0f7efd9 P 0ce4927ed21e494fa47cd82d743826c7 [term 2 LEADER]: Received request to transfer leadership to TS 6b0316ac722f4603bd53197367ed1c4d
I20260709 13:13:44.013258  3548 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bde0fa9eb0a643ce81bf46013ef6a572"
dest_uuid: "0ce4927ed21e494fa47cd82d743826c7"
mode: GRACEFUL
new_leader_uuid: "6b0316ac722f4603bd53197367ed1c4d"
 from {username='slave'} at 127.0.0.1:56960
I20260709 13:13:44.013715  3548 raft_consensus.cc:606] T bde0fa9eb0a643ce81bf46013ef6a572 P 0ce4927ed21e494fa47cd82d743826c7 [term 1 LEADER]: Received request to transfer leadership to TS 6b0316ac722f4603bd53197367ed1c4d
I20260709 13:13:44.018795  3548 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b9fa52d1dd94e6db840e2f48bf4f92f"
dest_uuid: "0ce4927ed21e494fa47cd82d743826c7"
mode: GRACEFUL
new_leader_uuid: "6b0316ac722f4603bd53197367ed1c4d"
 from {username='slave'} at 127.0.0.1:56960
I20260709 13:13:44.019320  3548 raft_consensus.cc:606] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0ce4927ed21e494fa47cd82d743826c7 [term 1 LEADER]: Received request to transfer leadership to TS 6b0316ac722f4603bd53197367ed1c4d
I20260709 13:13:44.151252  3765 raft_consensus.cc:993] T a1b40b6f843b4e68b03b9286ad71384f P 0b4332b9c1a84bde9278052eb2b32835: : Instructing follower 6b0316ac722f4603bd53197367ed1c4d to start an election
I20260709 13:13:44.152179  3779 raft_consensus.cc:1081] T a1b40b6f843b4e68b03b9286ad71384f P 0b4332b9c1a84bde9278052eb2b32835 [term 2 LEADER]: Signalling peer 6b0316ac722f4603bd53197367ed1c4d to start an election
I20260709 13:13:44.153745  3472 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a1b40b6f843b4e68b03b9286ad71384f"
dest_uuid: "6b0316ac722f4603bd53197367ed1c4d"
 from {username='slave'} at 127.0.0.1:53342
I20260709 13:13:44.154265  3472 raft_consensus.cc:493] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:44.154582  3472 raft_consensus.cc:3060] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:44.161887  3472 raft_consensus.cc:515] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:44.164261  3472 leader_election.cc:290] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d [CANDIDATE]: Term 3 election: Requested vote from peers 0ce4927ed21e494fa47cd82d743826c7 (127.2.198.194:45581), 0b4332b9c1a84bde9278052eb2b32835 (127.2.198.195:33933)
I20260709 13:13:44.165022  3548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1b40b6f843b4e68b03b9286ad71384f" candidate_uuid: "6b0316ac722f4603bd53197367ed1c4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0ce4927ed21e494fa47cd82d743826c7"
I20260709 13:13:44.165441  3622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1b40b6f843b4e68b03b9286ad71384f" candidate_uuid: "6b0316ac722f4603bd53197367ed1c4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0b4332b9c1a84bde9278052eb2b32835"
I20260709 13:13:44.165674  3548 raft_consensus.cc:3060] T a1b40b6f843b4e68b03b9286ad71384f P 0ce4927ed21e494fa47cd82d743826c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:44.166034  3622 raft_consensus.cc:3055] T a1b40b6f843b4e68b03b9286ad71384f P 0b4332b9c1a84bde9278052eb2b32835 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:44.166309  3622 raft_consensus.cc:740] T a1b40b6f843b4e68b03b9286ad71384f P 0b4332b9c1a84bde9278052eb2b32835 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0b4332b9c1a84bde9278052eb2b32835, State: Running, Role: LEADER
I20260709 13:13:44.166972  3622 consensus_queue.cc:260] T a1b40b6f843b4e68b03b9286ad71384f P 0b4332b9c1a84bde9278052eb2b32835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:44.167972  3622 raft_consensus.cc:3060] T a1b40b6f843b4e68b03b9286ad71384f P 0b4332b9c1a84bde9278052eb2b32835 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:44.170876  3548 raft_consensus.cc:2468] T a1b40b6f843b4e68b03b9286ad71384f P 0ce4927ed21e494fa47cd82d743826c7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0316ac722f4603bd53197367ed1c4d in term 3.
I20260709 13:13:44.172041  3436 leader_election.cc:304] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ce4927ed21e494fa47cd82d743826c7, 6b0316ac722f4603bd53197367ed1c4d; no voters: 
I20260709 13:13:44.172791  3761 raft_consensus.cc:2804] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:44.173368  3622 raft_consensus.cc:2468] T a1b40b6f843b4e68b03b9286ad71384f P 0b4332b9c1a84bde9278052eb2b32835 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0316ac722f4603bd53197367ed1c4d in term 3.
I20260709 13:13:44.173813  3761 raft_consensus.cc:697] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d [term 3 LEADER]: Becoming Leader. State: Replica: 6b0316ac722f4603bd53197367ed1c4d, State: Running, Role: LEADER
I20260709 13:13:44.174741  3761 consensus_queue.cc:237] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:44.182025  3369 catalog_manager.cc:5697] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d reported cstate change: term changed from 2 to 3, leader changed from 0b4332b9c1a84bde9278052eb2b32835 (127.2.198.195) to 6b0316ac722f4603bd53197367ed1c4d (127.2.198.193). New cstate: current_term: 3 leader_uuid: "6b0316ac722f4603bd53197367ed1c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:44.297966  3760 raft_consensus.cc:993] T 708d5be49a784b86aa09af32b0f7efd9 P 0ce4927ed21e494fa47cd82d743826c7: : Instructing follower 6b0316ac722f4603bd53197367ed1c4d to start an election
I20260709 13:13:44.298488  3785 raft_consensus.cc:1081] T 708d5be49a784b86aa09af32b0f7efd9 P 0ce4927ed21e494fa47cd82d743826c7 [term 2 LEADER]: Signalling peer 6b0316ac722f4603bd53197367ed1c4d to start an election
I20260709 13:13:44.300083  3472 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "708d5be49a784b86aa09af32b0f7efd9"
dest_uuid: "6b0316ac722f4603bd53197367ed1c4d"
 from {username='slave'} at 127.0.0.1:53346
I20260709 13:13:44.300632  3472 raft_consensus.cc:493] T 708d5be49a784b86aa09af32b0f7efd9 P 6b0316ac722f4603bd53197367ed1c4d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:44.300985  3472 raft_consensus.cc:3060] T 708d5be49a784b86aa09af32b0f7efd9 P 6b0316ac722f4603bd53197367ed1c4d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:44.306063  3472 raft_consensus.cc:515] T 708d5be49a784b86aa09af32b0f7efd9 P 6b0316ac722f4603bd53197367ed1c4d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:44.307916  3472 leader_election.cc:290] T 708d5be49a784b86aa09af32b0f7efd9 P 6b0316ac722f4603bd53197367ed1c4d [CANDIDATE]: Term 3 election: Requested vote from peers 0ce4927ed21e494fa47cd82d743826c7 (127.2.198.194:45581), 0b4332b9c1a84bde9278052eb2b32835 (127.2.198.195:33933)
I20260709 13:13:44.308846  3548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708d5be49a784b86aa09af32b0f7efd9" candidate_uuid: "6b0316ac722f4603bd53197367ed1c4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0ce4927ed21e494fa47cd82d743826c7"
I20260709 13:13:44.308979  3622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708d5be49a784b86aa09af32b0f7efd9" candidate_uuid: "6b0316ac722f4603bd53197367ed1c4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0b4332b9c1a84bde9278052eb2b32835"
I20260709 13:13:44.309526  3548 raft_consensus.cc:3055] T 708d5be49a784b86aa09af32b0f7efd9 P 0ce4927ed21e494fa47cd82d743826c7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:44.309602  3622 raft_consensus.cc:3060] T 708d5be49a784b86aa09af32b0f7efd9 P 0b4332b9c1a84bde9278052eb2b32835 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:44.309913  3548 raft_consensus.cc:740] T 708d5be49a784b86aa09af32b0f7efd9 P 0ce4927ed21e494fa47cd82d743826c7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0ce4927ed21e494fa47cd82d743826c7, State: Running, Role: LEADER
I20260709 13:13:44.310561  3548 consensus_queue.cc:260] T 708d5be49a784b86aa09af32b0f7efd9 P 0ce4927ed21e494fa47cd82d743826c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:44.311437  3548 raft_consensus.cc:3060] T 708d5be49a784b86aa09af32b0f7efd9 P 0ce4927ed21e494fa47cd82d743826c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:44.315016  3622 raft_consensus.cc:2468] T 708d5be49a784b86aa09af32b0f7efd9 P 0b4332b9c1a84bde9278052eb2b32835 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0316ac722f4603bd53197367ed1c4d in term 3.
I20260709 13:13:44.316202  3548 raft_consensus.cc:2468] T 708d5be49a784b86aa09af32b0f7efd9 P 0ce4927ed21e494fa47cd82d743826c7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0316ac722f4603bd53197367ed1c4d in term 3.
I20260709 13:13:44.316165  3437 leader_election.cc:304] T 708d5be49a784b86aa09af32b0f7efd9 P 6b0316ac722f4603bd53197367ed1c4d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b4332b9c1a84bde9278052eb2b32835, 6b0316ac722f4603bd53197367ed1c4d; no voters: 
I20260709 13:13:44.317124  3761 raft_consensus.cc:2804] T 708d5be49a784b86aa09af32b0f7efd9 P 6b0316ac722f4603bd53197367ed1c4d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:44.317610  3761 raft_consensus.cc:697] T 708d5be49a784b86aa09af32b0f7efd9 P 6b0316ac722f4603bd53197367ed1c4d [term 3 LEADER]: Becoming Leader. State: Replica: 6b0316ac722f4603bd53197367ed1c4d, State: Running, Role: LEADER
I20260709 13:13:44.318295  3761 consensus_queue.cc:237] T 708d5be49a784b86aa09af32b0f7efd9 P 6b0316ac722f4603bd53197367ed1c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:44.325799  3369 catalog_manager.cc:5697] T 708d5be49a784b86aa09af32b0f7efd9 P 6b0316ac722f4603bd53197367ed1c4d reported cstate change: term changed from 2 to 3, leader changed from 0ce4927ed21e494fa47cd82d743826c7 (127.2.198.194) to 6b0316ac722f4603bd53197367ed1c4d (127.2.198.193). New cstate: current_term: 3 leader_uuid: "6b0316ac722f4603bd53197367ed1c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:44.394423  3760 raft_consensus.cc:993] T bde0fa9eb0a643ce81bf46013ef6a572 P 0ce4927ed21e494fa47cd82d743826c7: : Instructing follower 6b0316ac722f4603bd53197367ed1c4d to start an election
I20260709 13:13:44.394939  3785 raft_consensus.cc:1081] T bde0fa9eb0a643ce81bf46013ef6a572 P 0ce4927ed21e494fa47cd82d743826c7 [term 1 LEADER]: Signalling peer 6b0316ac722f4603bd53197367ed1c4d to start an election
I20260709 13:13:44.396474  3472 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bde0fa9eb0a643ce81bf46013ef6a572"
dest_uuid: "6b0316ac722f4603bd53197367ed1c4d"
 from {username='slave'} at 127.0.0.1:53346
I20260709 13:13:44.396991  3472 raft_consensus.cc:493] T bde0fa9eb0a643ce81bf46013ef6a572 P 6b0316ac722f4603bd53197367ed1c4d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:44.397382  3472 raft_consensus.cc:3060] T bde0fa9eb0a643ce81bf46013ef6a572 P 6b0316ac722f4603bd53197367ed1c4d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:44.402943  3472 raft_consensus.cc:515] T bde0fa9eb0a643ce81bf46013ef6a572 P 6b0316ac722f4603bd53197367ed1c4d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:44.404733  3472 leader_election.cc:290] T bde0fa9eb0a643ce81bf46013ef6a572 P 6b0316ac722f4603bd53197367ed1c4d [CANDIDATE]: Term 2 election: Requested vote from peers 0ce4927ed21e494fa47cd82d743826c7 (127.2.198.194:45581), 0b4332b9c1a84bde9278052eb2b32835 (127.2.198.195:33933)
I20260709 13:13:44.405601  3548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bde0fa9eb0a643ce81bf46013ef6a572" candidate_uuid: "6b0316ac722f4603bd53197367ed1c4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ce4927ed21e494fa47cd82d743826c7"
I20260709 13:13:44.405762  3622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bde0fa9eb0a643ce81bf46013ef6a572" candidate_uuid: "6b0316ac722f4603bd53197367ed1c4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b4332b9c1a84bde9278052eb2b32835"
I20260709 13:13:44.406175  3548 raft_consensus.cc:3055] T bde0fa9eb0a643ce81bf46013ef6a572 P 0ce4927ed21e494fa47cd82d743826c7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:44.406375  3622 raft_consensus.cc:3060] T bde0fa9eb0a643ce81bf46013ef6a572 P 0b4332b9c1a84bde9278052eb2b32835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:44.406497  3548 raft_consensus.cc:740] T bde0fa9eb0a643ce81bf46013ef6a572 P 0ce4927ed21e494fa47cd82d743826c7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ce4927ed21e494fa47cd82d743826c7, State: Running, Role: LEADER
I20260709 13:13:44.407402  3548 consensus_queue.cc:260] T bde0fa9eb0a643ce81bf46013ef6a572 P 0ce4927ed21e494fa47cd82d743826c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:44.408694  3548 raft_consensus.cc:3060] T bde0fa9eb0a643ce81bf46013ef6a572 P 0ce4927ed21e494fa47cd82d743826c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:44.411427  3760 raft_consensus.cc:993] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0ce4927ed21e494fa47cd82d743826c7: : Instructing follower 6b0316ac722f4603bd53197367ed1c4d to start an election
I20260709 13:13:44.411936  3785 raft_consensus.cc:1081] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0ce4927ed21e494fa47cd82d743826c7 [term 1 LEADER]: Signalling peer 6b0316ac722f4603bd53197367ed1c4d to start an election
I20260709 13:13:44.413395  3472 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b9fa52d1dd94e6db840e2f48bf4f92f"
dest_uuid: "6b0316ac722f4603bd53197367ed1c4d"
 from {username='slave'} at 127.0.0.1:53346
I20260709 13:13:44.413600  3622 raft_consensus.cc:2468] T bde0fa9eb0a643ce81bf46013ef6a572 P 0b4332b9c1a84bde9278052eb2b32835 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0316ac722f4603bd53197367ed1c4d in term 2.
I20260709 13:13:44.413931  3472 raft_consensus.cc:493] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 6b0316ac722f4603bd53197367ed1c4d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:44.414458  3472 raft_consensus.cc:3060] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 6b0316ac722f4603bd53197367ed1c4d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:44.414887  3437 leader_election.cc:304] T bde0fa9eb0a643ce81bf46013ef6a572 P 6b0316ac722f4603bd53197367ed1c4d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b4332b9c1a84bde9278052eb2b32835, 6b0316ac722f4603bd53197367ed1c4d; no voters: 
I20260709 13:13:44.415729  3781 raft_consensus.cc:2804] T bde0fa9eb0a643ce81bf46013ef6a572 P 6b0316ac722f4603bd53197367ed1c4d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:44.415812  3548 raft_consensus.cc:2468] T bde0fa9eb0a643ce81bf46013ef6a572 P 0ce4927ed21e494fa47cd82d743826c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0316ac722f4603bd53197367ed1c4d in term 2.
I20260709 13:13:44.416322  3781 raft_consensus.cc:697] T bde0fa9eb0a643ce81bf46013ef6a572 P 6b0316ac722f4603bd53197367ed1c4d [term 2 LEADER]: Becoming Leader. State: Replica: 6b0316ac722f4603bd53197367ed1c4d, State: Running, Role: LEADER
I20260709 13:13:44.417238  3781 consensus_queue.cc:237] T bde0fa9eb0a643ce81bf46013ef6a572 P 6b0316ac722f4603bd53197367ed1c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:44.421845  3472 raft_consensus.cc:515] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 6b0316ac722f4603bd53197367ed1c4d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:44.424309  3472 leader_election.cc:290] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 6b0316ac722f4603bd53197367ed1c4d [CANDIDATE]: Term 2 election: Requested vote from peers 0ce4927ed21e494fa47cd82d743826c7 (127.2.198.194:45581), 0b4332b9c1a84bde9278052eb2b32835 (127.2.198.195:33933)
I20260709 13:13:44.424698  3548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9fa52d1dd94e6db840e2f48bf4f92f" candidate_uuid: "6b0316ac722f4603bd53197367ed1c4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ce4927ed21e494fa47cd82d743826c7"
I20260709 13:13:44.425037  3622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9fa52d1dd94e6db840e2f48bf4f92f" candidate_uuid: "6b0316ac722f4603bd53197367ed1c4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b4332b9c1a84bde9278052eb2b32835"
I20260709 13:13:44.425333  3548 raft_consensus.cc:3055] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0ce4927ed21e494fa47cd82d743826c7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:44.425714  3548 raft_consensus.cc:740] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0ce4927ed21e494fa47cd82d743826c7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ce4927ed21e494fa47cd82d743826c7, State: Running, Role: LEADER
I20260709 13:13:44.425714  3622 raft_consensus.cc:3060] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0b4332b9c1a84bde9278052eb2b32835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:44.426239  3369 catalog_manager.cc:5697] T bde0fa9eb0a643ce81bf46013ef6a572 P 6b0316ac722f4603bd53197367ed1c4d reported cstate change: term changed from 1 to 2, leader changed from 0ce4927ed21e494fa47cd82d743826c7 (127.2.198.194) to 6b0316ac722f4603bd53197367ed1c4d (127.2.198.193). New cstate: current_term: 2 leader_uuid: "6b0316ac722f4603bd53197367ed1c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:44.426787  3548 consensus_queue.cc:260] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0ce4927ed21e494fa47cd82d743826c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:44.427951  3548 raft_consensus.cc:3060] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0ce4927ed21e494fa47cd82d743826c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:44.431861  3622 raft_consensus.cc:2468] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0b4332b9c1a84bde9278052eb2b32835 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0316ac722f4603bd53197367ed1c4d in term 2.
I20260709 13:13:44.433094  3437 leader_election.cc:304] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 6b0316ac722f4603bd53197367ed1c4d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b4332b9c1a84bde9278052eb2b32835, 6b0316ac722f4603bd53197367ed1c4d; no voters: 
I20260709 13:13:44.433897  3781 raft_consensus.cc:2804] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 6b0316ac722f4603bd53197367ed1c4d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:44.433985  3548 raft_consensus.cc:2468] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0ce4927ed21e494fa47cd82d743826c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0316ac722f4603bd53197367ed1c4d in term 2.
I20260709 13:13:44.434399  3781 raft_consensus.cc:697] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 6b0316ac722f4603bd53197367ed1c4d [term 2 LEADER]: Becoming Leader. State: Replica: 6b0316ac722f4603bd53197367ed1c4d, State: Running, Role: LEADER
I20260709 13:13:44.435336  3781 consensus_queue.cc:237] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 6b0316ac722f4603bd53197367ed1c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:44.441949  3369 catalog_manager.cc:5697] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 6b0316ac722f4603bd53197367ed1c4d reported cstate change: term changed from 1 to 2, leader changed from 0ce4927ed21e494fa47cd82d743826c7 (127.2.198.194) to 6b0316ac722f4603bd53197367ed1c4d (127.2.198.193). New cstate: current_term: 2 leader_uuid: "6b0316ac722f4603bd53197367ed1c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:44.478052  3779 raft_consensus.cc:993] T d5950c15e891492695358c32b92f10d0 P 0b4332b9c1a84bde9278052eb2b32835: : Instructing follower 6b0316ac722f4603bd53197367ed1c4d to start an election
I20260709 13:13:44.478576  3758 raft_consensus.cc:1081] T d5950c15e891492695358c32b92f10d0 P 0b4332b9c1a84bde9278052eb2b32835 [term 3 LEADER]: Signalling peer 6b0316ac722f4603bd53197367ed1c4d to start an election
I20260709 13:13:44.480150  3472 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d5950c15e891492695358c32b92f10d0"
dest_uuid: "6b0316ac722f4603bd53197367ed1c4d"
 from {username='slave'} at 127.0.0.1:53342
I20260709 13:13:44.480813  3472 raft_consensus.cc:493] T d5950c15e891492695358c32b92f10d0 P 6b0316ac722f4603bd53197367ed1c4d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:44.481150  3472 raft_consensus.cc:3060] T d5950c15e891492695358c32b92f10d0 P 6b0316ac722f4603bd53197367ed1c4d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:44.486390  3472 raft_consensus.cc:515] T d5950c15e891492695358c32b92f10d0 P 6b0316ac722f4603bd53197367ed1c4d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:44.488235  3472 leader_election.cc:290] T d5950c15e891492695358c32b92f10d0 P 6b0316ac722f4603bd53197367ed1c4d [CANDIDATE]: Term 4 election: Requested vote from peers 0ce4927ed21e494fa47cd82d743826c7 (127.2.198.194:45581), 0b4332b9c1a84bde9278052eb2b32835 (127.2.198.195:33933)
I20260709 13:13:44.489032  3548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5950c15e891492695358c32b92f10d0" candidate_uuid: "6b0316ac722f4603bd53197367ed1c4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0ce4927ed21e494fa47cd82d743826c7"
I20260709 13:13:44.489419  3622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5950c15e891492695358c32b92f10d0" candidate_uuid: "6b0316ac722f4603bd53197367ed1c4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0b4332b9c1a84bde9278052eb2b32835"
I20260709 13:13:44.489562  3548 raft_consensus.cc:3060] T d5950c15e891492695358c32b92f10d0 P 0ce4927ed21e494fa47cd82d743826c7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:44.489969  3622 raft_consensus.cc:3055] T d5950c15e891492695358c32b92f10d0 P 0b4332b9c1a84bde9278052eb2b32835 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:44.490257  3622 raft_consensus.cc:740] T d5950c15e891492695358c32b92f10d0 P 0b4332b9c1a84bde9278052eb2b32835 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0b4332b9c1a84bde9278052eb2b32835, State: Running, Role: LEADER
I20260709 13:13:44.490972  3622 consensus_queue.cc:260] T d5950c15e891492695358c32b92f10d0 P 0b4332b9c1a84bde9278052eb2b32835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:44.491972  3622 raft_consensus.cc:3060] T d5950c15e891492695358c32b92f10d0 P 0b4332b9c1a84bde9278052eb2b32835 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:44.494410  3548 raft_consensus.cc:2468] T d5950c15e891492695358c32b92f10d0 P 0ce4927ed21e494fa47cd82d743826c7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0316ac722f4603bd53197367ed1c4d in term 4.
I20260709 13:13:44.495402  3436 leader_election.cc:304] T d5950c15e891492695358c32b92f10d0 P 6b0316ac722f4603bd53197367ed1c4d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ce4927ed21e494fa47cd82d743826c7, 6b0316ac722f4603bd53197367ed1c4d; no voters: 
I20260709 13:13:44.496170  3781 raft_consensus.cc:2804] T d5950c15e891492695358c32b92f10d0 P 6b0316ac722f4603bd53197367ed1c4d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:44.496593  3781 raft_consensus.cc:697] T d5950c15e891492695358c32b92f10d0 P 6b0316ac722f4603bd53197367ed1c4d [term 4 LEADER]: Becoming Leader. State: Replica: 6b0316ac722f4603bd53197367ed1c4d, State: Running, Role: LEADER
I20260709 13:13:44.497221  3622 raft_consensus.cc:2468] T d5950c15e891492695358c32b92f10d0 P 0b4332b9c1a84bde9278052eb2b32835 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0316ac722f4603bd53197367ed1c4d in term 4.
I20260709 13:13:44.497355  3781 consensus_queue.cc:237] T d5950c15e891492695358c32b92f10d0 P 6b0316ac722f4603bd53197367ed1c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:44.503731  3369 catalog_manager.cc:5697] T d5950c15e891492695358c32b92f10d0 P 6b0316ac722f4603bd53197367ed1c4d reported cstate change: term changed from 3 to 4, leader changed from 0b4332b9c1a84bde9278052eb2b32835 (127.2.198.195) to 6b0316ac722f4603bd53197367ed1c4d (127.2.198.193). New cstate: current_term: 4 leader_uuid: "6b0316ac722f4603bd53197367ed1c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:44.759156  3622 raft_consensus.cc:1275] T a1b40b6f843b4e68b03b9286ad71384f P 0b4332b9c1a84bde9278052eb2b32835 [term 3 FOLLOWER]: Refusing update from remote peer 6b0316ac722f4603bd53197367ed1c4d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:44.760490  3781 consensus_queue.cc:1048] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:44.769582  3548 raft_consensus.cc:1275] T a1b40b6f843b4e68b03b9286ad71384f P 0ce4927ed21e494fa47cd82d743826c7 [term 3 FOLLOWER]: Refusing update from remote peer 6b0316ac722f4603bd53197367ed1c4d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:44.776182  3791 consensus_queue.cc:1048] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:44.883612  3622 raft_consensus.cc:1275] T 708d5be49a784b86aa09af32b0f7efd9 P 0b4332b9c1a84bde9278052eb2b32835 [term 3 FOLLOWER]: Refusing update from remote peer 6b0316ac722f4603bd53197367ed1c4d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:44.884976  3791 consensus_queue.cc:1048] T 708d5be49a784b86aa09af32b0f7efd9 P 6b0316ac722f4603bd53197367ed1c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:44.896930  3548 raft_consensus.cc:1275] T 708d5be49a784b86aa09af32b0f7efd9 P 0ce4927ed21e494fa47cd82d743826c7 [term 3 FOLLOWER]: Refusing update from remote peer 6b0316ac722f4603bd53197367ed1c4d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:44.899984  3548 raft_consensus.cc:1275] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0ce4927ed21e494fa47cd82d743826c7 [term 2 FOLLOWER]: Refusing update from remote peer 6b0316ac722f4603bd53197367ed1c4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:44.940336  3761 consensus_queue.cc:1048] T 708d5be49a784b86aa09af32b0f7efd9 P 6b0316ac722f4603bd53197367ed1c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:13:44.941656  3622 raft_consensus.cc:1275] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0b4332b9c1a84bde9278052eb2b32835 [term 2 FOLLOWER]: Refusing update from remote peer 6b0316ac722f4603bd53197367ed1c4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:44.945261  3621 raft_consensus.cc:1275] T bde0fa9eb0a643ce81bf46013ef6a572 P 0b4332b9c1a84bde9278052eb2b32835 [term 2 FOLLOWER]: Refusing update from remote peer 6b0316ac722f4603bd53197367ed1c4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:44.946504  3781 consensus_queue.cc:1048] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 6b0316ac722f4603bd53197367ed1c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:44.947531  3620 raft_consensus.cc:1275] T d5950c15e891492695358c32b92f10d0 P 0b4332b9c1a84bde9278052eb2b32835 [term 4 FOLLOWER]: Refusing update from remote peer 6b0316ac722f4603bd53197367ed1c4d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:44.947885  3761 consensus_queue.cc:1048] T bde0fa9eb0a643ce81bf46013ef6a572 P 6b0316ac722f4603bd53197367ed1c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:44.952088  3797 consensus_queue.cc:1048] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 6b0316ac722f4603bd53197367ed1c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:44.953861  3797 consensus_queue.cc:1048] T d5950c15e891492695358c32b92f10d0 P 6b0316ac722f4603bd53197367ed1c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:44.954959  3548 raft_consensus.cc:1275] T bde0fa9eb0a643ce81bf46013ef6a572 P 0ce4927ed21e494fa47cd82d743826c7 [term 2 FOLLOWER]: Refusing update from remote peer 6b0316ac722f4603bd53197367ed1c4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:44.968226  3781 consensus_queue.cc:1048] T bde0fa9eb0a643ce81bf46013ef6a572 P 6b0316ac722f4603bd53197367ed1c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:45.011794  3548 raft_consensus.cc:1275] T d5950c15e891492695358c32b92f10d0 P 0ce4927ed21e494fa47cd82d743826c7 [term 4 FOLLOWER]: Refusing update from remote peer 6b0316ac722f4603bd53197367ed1c4d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:45.023351  3761 consensus_queue.cc:1048] T d5950c15e891492695358c32b92f10d0 P 6b0316ac722f4603bd53197367ed1c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:47.053252  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:47.062975  3472 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b9fa52d1dd94e6db840e2f48bf4f92f"
dest_uuid: "6b0316ac722f4603bd53197367ed1c4d"
mode: GRACEFUL
new_leader_uuid: "0b4332b9c1a84bde9278052eb2b32835"
 from {username='slave'} at 127.0.0.1:36116
I20260709 13:13:47.063700  3472 raft_consensus.cc:606] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 6b0316ac722f4603bd53197367ed1c4d [term 2 LEADER]: Received request to transfer leadership to TS 0b4332b9c1a84bde9278052eb2b32835
I20260709 13:13:47.066363  3472 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a59cf3c416745258673b8c3cebf93c4"
dest_uuid: "6b0316ac722f4603bd53197367ed1c4d"
mode: GRACEFUL
new_leader_uuid: "0ce4927ed21e494fa47cd82d743826c7"
 from {username='slave'} at 127.0.0.1:36116
I20260709 13:13:47.066874  3472 raft_consensus.cc:606] T 7a59cf3c416745258673b8c3cebf93c4 P 6b0316ac722f4603bd53197367ed1c4d [term 1 LEADER]: Received request to transfer leadership to TS 0ce4927ed21e494fa47cd82d743826c7
I20260709 13:13:47.069164  3472 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1b40b6f843b4e68b03b9286ad71384f"
dest_uuid: "6b0316ac722f4603bd53197367ed1c4d"
mode: GRACEFUL
new_leader_uuid: "0b4332b9c1a84bde9278052eb2b32835"
 from {username='slave'} at 127.0.0.1:36116
I20260709 13:13:47.069643  3472 raft_consensus.cc:606] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d [term 3 LEADER]: Received request to transfer leadership to TS 0b4332b9c1a84bde9278052eb2b32835
I20260709 13:13:47.071866  3472 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bde0fa9eb0a643ce81bf46013ef6a572"
dest_uuid: "6b0316ac722f4603bd53197367ed1c4d"
mode: GRACEFUL
new_leader_uuid: "0ce4927ed21e494fa47cd82d743826c7"
 from {username='slave'} at 127.0.0.1:36116
I20260709 13:13:47.072333  3472 raft_consensus.cc:606] T bde0fa9eb0a643ce81bf46013ef6a572 P 6b0316ac722f4603bd53197367ed1c4d [term 2 LEADER]: Received request to transfer leadership to TS 0ce4927ed21e494fa47cd82d743826c7
I20260709 13:13:47.073278  2843 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:13:47.073788  2843 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:47.143100  3797 raft_consensus.cc:993] T 7a59cf3c416745258673b8c3cebf93c4 P 6b0316ac722f4603bd53197367ed1c4d: : Instructing follower 0ce4927ed21e494fa47cd82d743826c7 to start an election
I20260709 13:13:47.143718  3805 raft_consensus.cc:1081] T 7a59cf3c416745258673b8c3cebf93c4 P 6b0316ac722f4603bd53197367ed1c4d [term 1 LEADER]: Signalling peer 0ce4927ed21e494fa47cd82d743826c7 to start an election
I20260709 13:13:47.145298  3547 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a59cf3c416745258673b8c3cebf93c4"
dest_uuid: "0ce4927ed21e494fa47cd82d743826c7"
 from {username='slave'} at 127.0.0.1:56942
I20260709 13:13:47.145886  3547 raft_consensus.cc:493] T 7a59cf3c416745258673b8c3cebf93c4 P 0ce4927ed21e494fa47cd82d743826c7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:47.146212  3547 raft_consensus.cc:3060] T 7a59cf3c416745258673b8c3cebf93c4 P 0ce4927ed21e494fa47cd82d743826c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:47.152480  3547 raft_consensus.cc:515] T 7a59cf3c416745258673b8c3cebf93c4 P 0ce4927ed21e494fa47cd82d743826c7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:47.154301  3547 leader_election.cc:290] T 7a59cf3c416745258673b8c3cebf93c4 P 0ce4927ed21e494fa47cd82d743826c7 [CANDIDATE]: Term 2 election: Requested vote from peers 6b0316ac722f4603bd53197367ed1c4d (127.2.198.193:44435), 0b4332b9c1a84bde9278052eb2b32835 (127.2.198.195:33933)
I20260709 13:13:47.155515  3622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a59cf3c416745258673b8c3cebf93c4" candidate_uuid: "0ce4927ed21e494fa47cd82d743826c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b4332b9c1a84bde9278052eb2b32835"
I20260709 13:13:47.155457  3472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a59cf3c416745258673b8c3cebf93c4" candidate_uuid: "0ce4927ed21e494fa47cd82d743826c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6b0316ac722f4603bd53197367ed1c4d"
I20260709 13:13:47.156255  3622 raft_consensus.cc:3060] T 7a59cf3c416745258673b8c3cebf93c4 P 0b4332b9c1a84bde9278052eb2b32835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:47.156370  3472 raft_consensus.cc:3055] T 7a59cf3c416745258673b8c3cebf93c4 P 6b0316ac722f4603bd53197367ed1c4d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:47.156726  3472 raft_consensus.cc:740] T 7a59cf3c416745258673b8c3cebf93c4 P 6b0316ac722f4603bd53197367ed1c4d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b0316ac722f4603bd53197367ed1c4d, State: Running, Role: LEADER
I20260709 13:13:47.157567  3472 consensus_queue.cc:260] T 7a59cf3c416745258673b8c3cebf93c4 P 6b0316ac722f4603bd53197367ed1c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:47.158623  3472 raft_consensus.cc:3060] T 7a59cf3c416745258673b8c3cebf93c4 P 6b0316ac722f4603bd53197367ed1c4d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:47.162587  3622 raft_consensus.cc:2468] T 7a59cf3c416745258673b8c3cebf93c4 P 0b4332b9c1a84bde9278052eb2b32835 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ce4927ed21e494fa47cd82d743826c7 in term 2.
I20260709 13:13:47.163841  3512 leader_election.cc:304] T 7a59cf3c416745258673b8c3cebf93c4 P 0ce4927ed21e494fa47cd82d743826c7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b4332b9c1a84bde9278052eb2b32835, 0ce4927ed21e494fa47cd82d743826c7; no voters: 
I20260709 13:13:47.164670  3785 raft_consensus.cc:2804] T 7a59cf3c416745258673b8c3cebf93c4 P 0ce4927ed21e494fa47cd82d743826c7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:47.165679  3785 raft_consensus.cc:697] T 7a59cf3c416745258673b8c3cebf93c4 P 0ce4927ed21e494fa47cd82d743826c7 [term 2 LEADER]: Becoming Leader. State: Replica: 0ce4927ed21e494fa47cd82d743826c7, State: Running, Role: LEADER
I20260709 13:13:47.165692  3472 raft_consensus.cc:2468] T 7a59cf3c416745258673b8c3cebf93c4 P 6b0316ac722f4603bd53197367ed1c4d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ce4927ed21e494fa47cd82d743826c7 in term 2.
I20260709 13:13:47.166671  3785 consensus_queue.cc:237] T 7a59cf3c416745258673b8c3cebf93c4 P 0ce4927ed21e494fa47cd82d743826c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:47.177692  3370 catalog_manager.cc:5697] T 7a59cf3c416745258673b8c3cebf93c4 P 0ce4927ed21e494fa47cd82d743826c7 reported cstate change: term changed from 1 to 2, leader changed from 6b0316ac722f4603bd53197367ed1c4d (127.2.198.193) to 0ce4927ed21e494fa47cd82d743826c7 (127.2.198.194). New cstate: current_term: 2 leader_uuid: "0ce4927ed21e494fa47cd82d743826c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:47.211728  3797 raft_consensus.cc:993] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d: : Instructing follower 0b4332b9c1a84bde9278052eb2b32835 to start an election
I20260709 13:13:47.212265  3805 raft_consensus.cc:1081] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d [term 3 LEADER]: Signalling peer 0b4332b9c1a84bde9278052eb2b32835 to start an election
I20260709 13:13:47.214485  3622 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a1b40b6f843b4e68b03b9286ad71384f"
dest_uuid: "0b4332b9c1a84bde9278052eb2b32835"
 from {username='slave'} at 127.0.0.1:56326
I20260709 13:13:47.215170  3622 raft_consensus.cc:493] T a1b40b6f843b4e68b03b9286ad71384f P 0b4332b9c1a84bde9278052eb2b32835 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:47.215564  3622 raft_consensus.cc:3060] T a1b40b6f843b4e68b03b9286ad71384f P 0b4332b9c1a84bde9278052eb2b32835 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:47.220865  3622 raft_consensus.cc:515] T a1b40b6f843b4e68b03b9286ad71384f P 0b4332b9c1a84bde9278052eb2b32835 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:47.222561  3622 leader_election.cc:290] T a1b40b6f843b4e68b03b9286ad71384f P 0b4332b9c1a84bde9278052eb2b32835 [CANDIDATE]: Term 4 election: Requested vote from peers 6b0316ac722f4603bd53197367ed1c4d (127.2.198.193:44435), 0ce4927ed21e494fa47cd82d743826c7 (127.2.198.194:45581)
I20260709 13:13:47.223486  3472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1b40b6f843b4e68b03b9286ad71384f" candidate_uuid: "0b4332b9c1a84bde9278052eb2b32835" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6b0316ac722f4603bd53197367ed1c4d"
I20260709 13:13:47.223825  3547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1b40b6f843b4e68b03b9286ad71384f" candidate_uuid: "0b4332b9c1a84bde9278052eb2b32835" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0ce4927ed21e494fa47cd82d743826c7"
I20260709 13:13:47.224171  3472 raft_consensus.cc:3055] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:47.224385  3547 raft_consensus.cc:3060] T a1b40b6f843b4e68b03b9286ad71384f P 0ce4927ed21e494fa47cd82d743826c7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:47.224532  3472 raft_consensus.cc:740] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b0316ac722f4603bd53197367ed1c4d, State: Running, Role: LEADER
I20260709 13:13:47.225443  3472 consensus_queue.cc:260] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:47.226563  3472 raft_consensus.cc:3060] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:47.230026  3547 raft_consensus.cc:2468] T a1b40b6f843b4e68b03b9286ad71384f P 0ce4927ed21e494fa47cd82d743826c7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b4332b9c1a84bde9278052eb2b32835 in term 4.
I20260709 13:13:47.231666  3585 leader_election.cc:304] T a1b40b6f843b4e68b03b9286ad71384f P 0b4332b9c1a84bde9278052eb2b32835 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b4332b9c1a84bde9278052eb2b32835, 0ce4927ed21e494fa47cd82d743826c7; no voters: 
I20260709 13:13:47.232164  3472 raft_consensus.cc:2468] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b4332b9c1a84bde9278052eb2b32835 in term 4.
I20260709 13:13:47.232729  3758 raft_consensus.cc:2804] T a1b40b6f843b4e68b03b9286ad71384f P 0b4332b9c1a84bde9278052eb2b32835 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:47.234184  3758 raft_consensus.cc:697] T a1b40b6f843b4e68b03b9286ad71384f P 0b4332b9c1a84bde9278052eb2b32835 [term 4 LEADER]: Becoming Leader. State: Replica: 0b4332b9c1a84bde9278052eb2b32835, State: Running, Role: LEADER
I20260709 13:13:47.235142  3758 consensus_queue.cc:237] T a1b40b6f843b4e68b03b9286ad71384f P 0b4332b9c1a84bde9278052eb2b32835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:47.242529  3370 catalog_manager.cc:5697] T a1b40b6f843b4e68b03b9286ad71384f P 0b4332b9c1a84bde9278052eb2b32835 reported cstate change: term changed from 3 to 4, leader changed from 6b0316ac722f4603bd53197367ed1c4d (127.2.198.193) to 0b4332b9c1a84bde9278052eb2b32835 (127.2.198.195). New cstate: current_term: 4 leader_uuid: "0b4332b9c1a84bde9278052eb2b32835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:47.411738  3797 raft_consensus.cc:993] T bde0fa9eb0a643ce81bf46013ef6a572 P 6b0316ac722f4603bd53197367ed1c4d: : Instructing follower 0ce4927ed21e494fa47cd82d743826c7 to start an election
I20260709 13:13:47.412235  3805 raft_consensus.cc:1081] T bde0fa9eb0a643ce81bf46013ef6a572 P 6b0316ac722f4603bd53197367ed1c4d [term 2 LEADER]: Signalling peer 0ce4927ed21e494fa47cd82d743826c7 to start an election
I20260709 13:13:47.413691  3547 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bde0fa9eb0a643ce81bf46013ef6a572"
dest_uuid: "0ce4927ed21e494fa47cd82d743826c7"
 from {username='slave'} at 127.0.0.1:56942
I20260709 13:13:47.414230  3547 raft_consensus.cc:493] T bde0fa9eb0a643ce81bf46013ef6a572 P 0ce4927ed21e494fa47cd82d743826c7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:47.414623  3547 raft_consensus.cc:3060] T bde0fa9eb0a643ce81bf46013ef6a572 P 0ce4927ed21e494fa47cd82d743826c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:47.419854  3547 raft_consensus.cc:515] T bde0fa9eb0a643ce81bf46013ef6a572 P 0ce4927ed21e494fa47cd82d743826c7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:47.421665  3547 leader_election.cc:290] T bde0fa9eb0a643ce81bf46013ef6a572 P 0ce4927ed21e494fa47cd82d743826c7 [CANDIDATE]: Term 3 election: Requested vote from peers 6b0316ac722f4603bd53197367ed1c4d (127.2.198.193:44435), 0b4332b9c1a84bde9278052eb2b32835 (127.2.198.195:33933)
I20260709 13:13:47.422683  3472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bde0fa9eb0a643ce81bf46013ef6a572" candidate_uuid: "0ce4927ed21e494fa47cd82d743826c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6b0316ac722f4603bd53197367ed1c4d"
I20260709 13:13:47.422868  3622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bde0fa9eb0a643ce81bf46013ef6a572" candidate_uuid: "0ce4927ed21e494fa47cd82d743826c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0b4332b9c1a84bde9278052eb2b32835"
I20260709 13:13:47.423296  3472 raft_consensus.cc:3055] T bde0fa9eb0a643ce81bf46013ef6a572 P 6b0316ac722f4603bd53197367ed1c4d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:47.423352  3622 raft_consensus.cc:3060] T bde0fa9eb0a643ce81bf46013ef6a572 P 0b4332b9c1a84bde9278052eb2b32835 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:47.423632  3472 raft_consensus.cc:740] T bde0fa9eb0a643ce81bf46013ef6a572 P 6b0316ac722f4603bd53197367ed1c4d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b0316ac722f4603bd53197367ed1c4d, State: Running, Role: LEADER
I20260709 13:13:47.424386  3472 consensus_queue.cc:260] T bde0fa9eb0a643ce81bf46013ef6a572 P 6b0316ac722f4603bd53197367ed1c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:47.425357  3472 raft_consensus.cc:3060] T bde0fa9eb0a643ce81bf46013ef6a572 P 6b0316ac722f4603bd53197367ed1c4d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:47.428056  3622 raft_consensus.cc:2468] T bde0fa9eb0a643ce81bf46013ef6a572 P 0b4332b9c1a84bde9278052eb2b32835 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ce4927ed21e494fa47cd82d743826c7 in term 3.
I20260709 13:13:47.429023  3512 leader_election.cc:304] T bde0fa9eb0a643ce81bf46013ef6a572 P 0ce4927ed21e494fa47cd82d743826c7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b4332b9c1a84bde9278052eb2b32835, 0ce4927ed21e494fa47cd82d743826c7; no voters: 
I20260709 13:13:47.429759  3785 raft_consensus.cc:2804] T bde0fa9eb0a643ce81bf46013ef6a572 P 0ce4927ed21e494fa47cd82d743826c7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:47.430186  3785 raft_consensus.cc:697] T bde0fa9eb0a643ce81bf46013ef6a572 P 0ce4927ed21e494fa47cd82d743826c7 [term 3 LEADER]: Becoming Leader. State: Replica: 0ce4927ed21e494fa47cd82d743826c7, State: Running, Role: LEADER
I20260709 13:13:47.430902  3472 raft_consensus.cc:2468] T bde0fa9eb0a643ce81bf46013ef6a572 P 6b0316ac722f4603bd53197367ed1c4d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ce4927ed21e494fa47cd82d743826c7 in term 3.
I20260709 13:13:47.431007  3785 consensus_queue.cc:237] T bde0fa9eb0a643ce81bf46013ef6a572 P 0ce4927ed21e494fa47cd82d743826c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:47.436754  3797 raft_consensus.cc:993] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 6b0316ac722f4603bd53197367ed1c4d: : Instructing follower 0b4332b9c1a84bde9278052eb2b32835 to start an election
I20260709 13:13:47.437222  3805 raft_consensus.cc:1081] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 6b0316ac722f4603bd53197367ed1c4d [term 2 LEADER]: Signalling peer 0b4332b9c1a84bde9278052eb2b32835 to start an election
I20260709 13:13:47.438786  3622 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b9fa52d1dd94e6db840e2f48bf4f92f"
dest_uuid: "0b4332b9c1a84bde9278052eb2b32835"
 from {username='slave'} at 127.0.0.1:56326
I20260709 13:13:47.439308  3622 raft_consensus.cc:493] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0b4332b9c1a84bde9278052eb2b32835 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:47.439591  3622 raft_consensus.cc:3060] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0b4332b9c1a84bde9278052eb2b32835 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:47.440670  3370 catalog_manager.cc:5697] T bde0fa9eb0a643ce81bf46013ef6a572 P 0ce4927ed21e494fa47cd82d743826c7 reported cstate change: term changed from 2 to 3, leader changed from 6b0316ac722f4603bd53197367ed1c4d (127.2.198.193) to 0ce4927ed21e494fa47cd82d743826c7 (127.2.198.194). New cstate: current_term: 3 leader_uuid: "0ce4927ed21e494fa47cd82d743826c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:47.444015  3622 raft_consensus.cc:515] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0b4332b9c1a84bde9278052eb2b32835 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:47.445979  3622 leader_election.cc:290] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0b4332b9c1a84bde9278052eb2b32835 [CANDIDATE]: Term 3 election: Requested vote from peers 6b0316ac722f4603bd53197367ed1c4d (127.2.198.193:44435), 0ce4927ed21e494fa47cd82d743826c7 (127.2.198.194:45581)
I20260709 13:13:47.446903  3472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9fa52d1dd94e6db840e2f48bf4f92f" candidate_uuid: "0b4332b9c1a84bde9278052eb2b32835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6b0316ac722f4603bd53197367ed1c4d"
I20260709 13:13:47.447528  3472 raft_consensus.cc:3055] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 6b0316ac722f4603bd53197367ed1c4d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:47.447887  3472 raft_consensus.cc:740] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 6b0316ac722f4603bd53197367ed1c4d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b0316ac722f4603bd53197367ed1c4d, State: Running, Role: LEADER
I20260709 13:13:47.447850  3547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9fa52d1dd94e6db840e2f48bf4f92f" candidate_uuid: "0b4332b9c1a84bde9278052eb2b32835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0ce4927ed21e494fa47cd82d743826c7"
I20260709 13:13:47.448575  3547 raft_consensus.cc:3060] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0ce4927ed21e494fa47cd82d743826c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:47.448770  3472 consensus_queue.cc:260] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 6b0316ac722f4603bd53197367ed1c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:47.449896  3472 raft_consensus.cc:3060] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 6b0316ac722f4603bd53197367ed1c4d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:47.455379  3547 raft_consensus.cc:2468] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0ce4927ed21e494fa47cd82d743826c7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b4332b9c1a84bde9278052eb2b32835 in term 3.
I20260709 13:13:47.455468  3472 raft_consensus.cc:2468] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 6b0316ac722f4603bd53197367ed1c4d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b4332b9c1a84bde9278052eb2b32835 in term 3.
I20260709 13:13:47.456594  3585 leader_election.cc:304] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0b4332b9c1a84bde9278052eb2b32835 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b4332b9c1a84bde9278052eb2b32835, 0ce4927ed21e494fa47cd82d743826c7; no voters: 
I20260709 13:13:47.457319  3758 raft_consensus.cc:2804] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0b4332b9c1a84bde9278052eb2b32835 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:47.457769  3758 raft_consensus.cc:697] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0b4332b9c1a84bde9278052eb2b32835 [term 3 LEADER]: Becoming Leader. State: Replica: 0b4332b9c1a84bde9278052eb2b32835, State: Running, Role: LEADER
I20260709 13:13:47.458565  3758 consensus_queue.cc:237] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0b4332b9c1a84bde9278052eb2b32835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } }
I20260709 13:13:47.466249  3370 catalog_manager.cc:5697] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0b4332b9c1a84bde9278052eb2b32835 reported cstate change: term changed from 2 to 3, leader changed from 6b0316ac722f4603bd53197367ed1c4d (127.2.198.193) to 0b4332b9c1a84bde9278052eb2b32835 (127.2.198.195). New cstate: current_term: 3 leader_uuid: "0b4332b9c1a84bde9278052eb2b32835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:47.633809  3547 raft_consensus.cc:1275] T a1b40b6f843b4e68b03b9286ad71384f P 0ce4927ed21e494fa47cd82d743826c7 [term 4 FOLLOWER]: Refusing update from remote peer 0b4332b9c1a84bde9278052eb2b32835: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:47.635171  3758 consensus_queue.cc:1048] T a1b40b6f843b4e68b03b9286ad71384f P 0b4332b9c1a84bde9278052eb2b32835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:47.648994  3472 raft_consensus.cc:1275] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d [term 4 FOLLOWER]: Refusing update from remote peer 0b4332b9c1a84bde9278052eb2b32835: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:47.650377  3812 consensus_queue.cc:1048] T a1b40b6f843b4e68b03b9286ad71384f P 0b4332b9c1a84bde9278052eb2b32835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:47.728250  3472 raft_consensus.cc:1275] T 7a59cf3c416745258673b8c3cebf93c4 P 6b0316ac722f4603bd53197367ed1c4d [term 2 FOLLOWER]: Refusing update from remote peer 0ce4927ed21e494fa47cd82d743826c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:47.729813  3785 consensus_queue.cc:1048] T 7a59cf3c416745258673b8c3cebf93c4 P 0ce4927ed21e494fa47cd82d743826c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:47.739456  3622 raft_consensus.cc:1275] T 7a59cf3c416745258673b8c3cebf93c4 P 0b4332b9c1a84bde9278052eb2b32835 [term 2 FOLLOWER]: Refusing update from remote peer 0ce4927ed21e494fa47cd82d743826c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:47.741268  3806 consensus_queue.cc:1048] T 7a59cf3c416745258673b8c3cebf93c4 P 0ce4927ed21e494fa47cd82d743826c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:47.888674  3472 raft_consensus.cc:1275] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 6b0316ac722f4603bd53197367ed1c4d [term 3 FOLLOWER]: Refusing update from remote peer 0b4332b9c1a84bde9278052eb2b32835: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:47.890038  3812 consensus_queue.cc:1048] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0b4332b9c1a84bde9278052eb2b32835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:13:47.898837  3402 debug-util.cc:398] Leaking SignalData structure 0x7b080004f6a0 after lost signal to thread 2846
I20260709 13:13:47.899269  3547 raft_consensus.cc:1275] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0ce4927ed21e494fa47cd82d743826c7 [term 3 FOLLOWER]: Refusing update from remote peer 0b4332b9c1a84bde9278052eb2b32835: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:13:47.900049  3402 debug-util.cc:398] Leaking SignalData structure 0x7b080004fd80 after lost signal to thread 3405
W20260709 13:13:47.901252  3402 debug-util.cc:398] Leaking SignalData structure 0x7b08000d5b40 after lost signal to thread 3497
I20260709 13:13:47.901464  3758 consensus_queue.cc:1048] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0b4332b9c1a84bde9278052eb2b32835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ce4927ed21e494fa47cd82d743826c7" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 45581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:13:47.902339  3402 debug-util.cc:398] Leaking SignalData structure 0x7b08001689a0 after lost signal to thread 3572
W20260709 13:13:47.903456  3402 debug-util.cc:398] Leaking SignalData structure 0x7b0800100e40 after lost signal to thread 3646
I20260709 13:13:47.909749  3472 raft_consensus.cc:1275] T bde0fa9eb0a643ce81bf46013ef6a572 P 6b0316ac722f4603bd53197367ed1c4d [term 3 FOLLOWER]: Refusing update from remote peer 0ce4927ed21e494fa47cd82d743826c7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:47.911243  3785 consensus_queue.cc:1048] T bde0fa9eb0a643ce81bf46013ef6a572 P 0ce4927ed21e494fa47cd82d743826c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b0316ac722f4603bd53197367ed1c4d" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 44435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:47.923242  3622 raft_consensus.cc:1275] T bde0fa9eb0a643ce81bf46013ef6a572 P 0b4332b9c1a84bde9278052eb2b32835 [term 3 FOLLOWER]: Refusing update from remote peer 0ce4927ed21e494fa47cd82d743826c7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:47.925168  3823 consensus_queue.cc:1048] T bde0fa9eb0a643ce81bf46013ef6a572 P 0ce4927ed21e494fa47cd82d743826c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b4332b9c1a84bde9278052eb2b32835" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:48.074882  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:48.086444  2843 tablet_server.cc:179] TabletServer@127.2.198.193:0 shutting down...
I20260709 13:13:48.126083  2843 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:48.126979  2843 tablet_replica.cc:333] T a288028b1ba44234b32168b0fea601f9 P 6b0316ac722f4603bd53197367ed1c4d: stopping tablet replica
I20260709 13:13:48.127797  2843 raft_consensus.cc:2243] T a288028b1ba44234b32168b0fea601f9 P 6b0316ac722f4603bd53197367ed1c4d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:48.128347  2843 raft_consensus.cc:2272] T a288028b1ba44234b32168b0fea601f9 P 6b0316ac722f4603bd53197367ed1c4d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.130621  2843 tablet_replica.cc:333] T 708d5be49a784b86aa09af32b0f7efd9 P 6b0316ac722f4603bd53197367ed1c4d: stopping tablet replica
I20260709 13:13:48.131223  2843 raft_consensus.cc:2243] T 708d5be49a784b86aa09af32b0f7efd9 P 6b0316ac722f4603bd53197367ed1c4d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:48.132051  2843 raft_consensus.cc:2272] T 708d5be49a784b86aa09af32b0f7efd9 P 6b0316ac722f4603bd53197367ed1c4d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.134099  2843 tablet_replica.cc:333] T e5d5f35ac8584926a75208edc395f0d6 P 6b0316ac722f4603bd53197367ed1c4d: stopping tablet replica
I20260709 13:13:48.134691  2843 raft_consensus.cc:2243] T e5d5f35ac8584926a75208edc395f0d6 P 6b0316ac722f4603bd53197367ed1c4d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:48.135648  2843 raft_consensus.cc:2272] T e5d5f35ac8584926a75208edc395f0d6 P 6b0316ac722f4603bd53197367ed1c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.137516  2843 tablet_replica.cc:333] T bde0fa9eb0a643ce81bf46013ef6a572 P 6b0316ac722f4603bd53197367ed1c4d: stopping tablet replica
I20260709 13:13:48.138046  2843 raft_consensus.cc:2243] T bde0fa9eb0a643ce81bf46013ef6a572 P 6b0316ac722f4603bd53197367ed1c4d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:48.138453  2843 raft_consensus.cc:2272] T bde0fa9eb0a643ce81bf46013ef6a572 P 6b0316ac722f4603bd53197367ed1c4d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.142030  2843 tablet_replica.cc:333] T 7a59cf3c416745258673b8c3cebf93c4 P 6b0316ac722f4603bd53197367ed1c4d: stopping tablet replica
I20260709 13:13:48.142910  2843 raft_consensus.cc:2243] T 7a59cf3c416745258673b8c3cebf93c4 P 6b0316ac722f4603bd53197367ed1c4d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:48.143471  2843 raft_consensus.cc:2272] T 7a59cf3c416745258673b8c3cebf93c4 P 6b0316ac722f4603bd53197367ed1c4d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.146544  2843 tablet_replica.cc:333] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 6b0316ac722f4603bd53197367ed1c4d: stopping tablet replica
I20260709 13:13:48.147387  2843 raft_consensus.cc:2243] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 6b0316ac722f4603bd53197367ed1c4d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:48.148132  2843 raft_consensus.cc:2272] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 6b0316ac722f4603bd53197367ed1c4d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.151073  2843 tablet_replica.cc:333] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d: stopping tablet replica
I20260709 13:13:48.151890  2843 raft_consensus.cc:2243] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:48.152468  2843 raft_consensus.cc:2272] T a1b40b6f843b4e68b03b9286ad71384f P 6b0316ac722f4603bd53197367ed1c4d [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:48.155198  3514 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
I20260709 13:13:48.155969  2843 tablet_replica.cc:333] T d5950c15e891492695358c32b92f10d0 P 6b0316ac722f4603bd53197367ed1c4d: stopping tablet replica
I20260709 13:13:48.158769  2843 raft_consensus.cc:2243] T d5950c15e891492695358c32b92f10d0 P 6b0316ac722f4603bd53197367ed1c4d [term 4 LEADER]: Raft consensus shutting down.
W20260709 13:13:48.159042  3514 consensus_peers.cc:597] T a288028b1ba44234b32168b0fea601f9 P 0ce4927ed21e494fa47cd82d743826c7 -> Peer 6b0316ac722f4603bd53197367ed1c4d (127.2.198.193:44435): Couldn't send request to peer 6b0316ac722f4603bd53197367ed1c4d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:48.159950  2843 raft_consensus.cc:2272] T d5950c15e891492695358c32b92f10d0 P 6b0316ac722f4603bd53197367ed1c4d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.162029  2843 tablet_replica.cc:333] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 6b0316ac722f4603bd53197367ed1c4d: stopping tablet replica
I20260709 13:13:48.162564  2843 raft_consensus.cc:2243] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 6b0316ac722f4603bd53197367ed1c4d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:48.163007  2843 raft_consensus.cc:2272] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 6b0316ac722f4603bd53197367ed1c4d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.165303  2843 tablet_replica.cc:333] T 6e13df989df94dae888a9c7b79470112 P 6b0316ac722f4603bd53197367ed1c4d: stopping tablet replica
I20260709 13:13:48.165849  2843 raft_consensus.cc:2243] T 6e13df989df94dae888a9c7b79470112 P 6b0316ac722f4603bd53197367ed1c4d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:48.166714  2843 raft_consensus.cc:2272] T 6e13df989df94dae888a9c7b79470112 P 6b0316ac722f4603bd53197367ed1c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.190053  2843 tablet_server.cc:196] TabletServer@127.2.198.193:0 shutdown complete.
I20260709 13:13:48.217389  2843 tablet_server.cc:179] TabletServer@127.2.198.194:0 shutting down...
W20260709 13:13:48.246773  3585 consensus_peers.cc:597] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 0b4332b9c1a84bde9278052eb2b32835 -> Peer 0ce4927ed21e494fa47cd82d743826c7 (127.2.198.194:45581): Couldn't send request to peer 0ce4927ed21e494fa47cd82d743826c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:48.256739  2843 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:48.257834  2843 tablet_replica.cc:333] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0ce4927ed21e494fa47cd82d743826c7: stopping tablet replica
I20260709 13:13:48.258890  2843 raft_consensus.cc:2243] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0ce4927ed21e494fa47cd82d743826c7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:48.259675  2843 raft_consensus.cc:2272] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0ce4927ed21e494fa47cd82d743826c7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.263401  2843 tablet_replica.cc:333] T 6e13df989df94dae888a9c7b79470112 P 0ce4927ed21e494fa47cd82d743826c7: stopping tablet replica
I20260709 13:13:48.264360  2843 raft_consensus.cc:2243] T 6e13df989df94dae888a9c7b79470112 P 0ce4927ed21e494fa47cd82d743826c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:48.264977  2843 raft_consensus.cc:2272] T 6e13df989df94dae888a9c7b79470112 P 0ce4927ed21e494fa47cd82d743826c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.267966  2843 tablet_replica.cc:333] T bde0fa9eb0a643ce81bf46013ef6a572 P 0ce4927ed21e494fa47cd82d743826c7: stopping tablet replica
I20260709 13:13:48.268846  2843 raft_consensus.cc:2243] T bde0fa9eb0a643ce81bf46013ef6a572 P 0ce4927ed21e494fa47cd82d743826c7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:48.270026  2843 raft_consensus.cc:2272] T bde0fa9eb0a643ce81bf46013ef6a572 P 0ce4927ed21e494fa47cd82d743826c7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.273115  2843 tablet_replica.cc:333] T 7a59cf3c416745258673b8c3cebf93c4 P 0ce4927ed21e494fa47cd82d743826c7: stopping tablet replica
I20260709 13:13:48.273988  2843 raft_consensus.cc:2243] T 7a59cf3c416745258673b8c3cebf93c4 P 0ce4927ed21e494fa47cd82d743826c7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:48.275116  2843 raft_consensus.cc:2272] T 7a59cf3c416745258673b8c3cebf93c4 P 0ce4927ed21e494fa47cd82d743826c7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.277925  2843 tablet_replica.cc:333] T a288028b1ba44234b32168b0fea601f9 P 0ce4927ed21e494fa47cd82d743826c7: stopping tablet replica
I20260709 13:13:48.278824  2843 raft_consensus.cc:2243] T a288028b1ba44234b32168b0fea601f9 P 0ce4927ed21e494fa47cd82d743826c7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:48.280136  2843 raft_consensus.cc:2272] T a288028b1ba44234b32168b0fea601f9 P 0ce4927ed21e494fa47cd82d743826c7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.283051  2843 tablet_replica.cc:333] T e5d5f35ac8584926a75208edc395f0d6 P 0ce4927ed21e494fa47cd82d743826c7: stopping tablet replica
I20260709 13:13:48.283941  2843 raft_consensus.cc:2243] T e5d5f35ac8584926a75208edc395f0d6 P 0ce4927ed21e494fa47cd82d743826c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:48.284533  2843 raft_consensus.cc:2272] T e5d5f35ac8584926a75208edc395f0d6 P 0ce4927ed21e494fa47cd82d743826c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.287577  2843 tablet_replica.cc:333] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 0ce4927ed21e494fa47cd82d743826c7: stopping tablet replica
I20260709 13:13:48.288476  2843 raft_consensus.cc:2243] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 0ce4927ed21e494fa47cd82d743826c7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:48.289176  2843 raft_consensus.cc:2272] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 0ce4927ed21e494fa47cd82d743826c7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.291993  2843 tablet_replica.cc:333] T d5950c15e891492695358c32b92f10d0 P 0ce4927ed21e494fa47cd82d743826c7: stopping tablet replica
I20260709 13:13:48.292739  2843 raft_consensus.cc:2243] T d5950c15e891492695358c32b92f10d0 P 0ce4927ed21e494fa47cd82d743826c7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:48.293322  2843 raft_consensus.cc:2272] T d5950c15e891492695358c32b92f10d0 P 0ce4927ed21e494fa47cd82d743826c7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.296286  2843 tablet_replica.cc:333] T a1b40b6f843b4e68b03b9286ad71384f P 0ce4927ed21e494fa47cd82d743826c7: stopping tablet replica
I20260709 13:13:48.297093  2843 raft_consensus.cc:2243] T a1b40b6f843b4e68b03b9286ad71384f P 0ce4927ed21e494fa47cd82d743826c7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:48.297763  2843 raft_consensus.cc:2272] T a1b40b6f843b4e68b03b9286ad71384f P 0ce4927ed21e494fa47cd82d743826c7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.300853  2843 tablet_replica.cc:333] T 708d5be49a784b86aa09af32b0f7efd9 P 0ce4927ed21e494fa47cd82d743826c7: stopping tablet replica
I20260709 13:13:48.301381  2843 raft_consensus.cc:2243] T 708d5be49a784b86aa09af32b0f7efd9 P 0ce4927ed21e494fa47cd82d743826c7 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:48.301684  3588 consensus_peers.cc:597] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 0b4332b9c1a84bde9278052eb2b32835 -> Peer 6b0316ac722f4603bd53197367ed1c4d (127.2.198.193:44435): Couldn't send request to peer 6b0316ac722f4603bd53197367ed1c4d. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:44435: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:48.301998  2843 raft_consensus.cc:2272] T 708d5be49a784b86aa09af32b0f7efd9 P 0ce4927ed21e494fa47cd82d743826c7 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:48.310709  3588 consensus_peers.cc:597] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0b4332b9c1a84bde9278052eb2b32835 -> Peer 6b0316ac722f4603bd53197367ed1c4d (127.2.198.193:44435): Couldn't send request to peer 6b0316ac722f4603bd53197367ed1c4d. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:44435: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:48.327848  2843 tablet_server.cc:196] TabletServer@127.2.198.194:0 shutdown complete.
I20260709 13:13:48.360049  2843 tablet_server.cc:179] TabletServer@127.2.198.195:0 shutting down...
I20260709 13:13:48.397353  2843 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:48.398133  2843 tablet_replica.cc:333] T 708d5be49a784b86aa09af32b0f7efd9 P 0b4332b9c1a84bde9278052eb2b32835: stopping tablet replica
I20260709 13:13:48.398896  2843 raft_consensus.cc:2243] T 708d5be49a784b86aa09af32b0f7efd9 P 0b4332b9c1a84bde9278052eb2b32835 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:48.399632  2843 raft_consensus.cc:2272] T 708d5be49a784b86aa09af32b0f7efd9 P 0b4332b9c1a84bde9278052eb2b32835 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.401783  2843 tablet_replica.cc:333] T e5d5f35ac8584926a75208edc395f0d6 P 0b4332b9c1a84bde9278052eb2b32835: stopping tablet replica
I20260709 13:13:48.402350  2843 raft_consensus.cc:2243] T e5d5f35ac8584926a75208edc395f0d6 P 0b4332b9c1a84bde9278052eb2b32835 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:48.402798  2843 raft_consensus.cc:2272] T e5d5f35ac8584926a75208edc395f0d6 P 0b4332b9c1a84bde9278052eb2b32835 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.405112  2843 tablet_replica.cc:333] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0b4332b9c1a84bde9278052eb2b32835: stopping tablet replica
I20260709 13:13:48.405824  2843 raft_consensus.cc:2243] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0b4332b9c1a84bde9278052eb2b32835 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:48.406705  2843 raft_consensus.cc:2272] T 6b9fa52d1dd94e6db840e2f48bf4f92f P 0b4332b9c1a84bde9278052eb2b32835 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.409575  2843 tablet_replica.cc:333] T 6e13df989df94dae888a9c7b79470112 P 0b4332b9c1a84bde9278052eb2b32835: stopping tablet replica
I20260709 13:13:48.410247  2843 raft_consensus.cc:2243] T 6e13df989df94dae888a9c7b79470112 P 0b4332b9c1a84bde9278052eb2b32835 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:48.410804  2843 raft_consensus.cc:2272] T 6e13df989df94dae888a9c7b79470112 P 0b4332b9c1a84bde9278052eb2b32835 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.412958  2843 tablet_replica.cc:333] T bde0fa9eb0a643ce81bf46013ef6a572 P 0b4332b9c1a84bde9278052eb2b32835: stopping tablet replica
I20260709 13:13:48.413477  2843 raft_consensus.cc:2243] T bde0fa9eb0a643ce81bf46013ef6a572 P 0b4332b9c1a84bde9278052eb2b32835 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:48.413908  2843 raft_consensus.cc:2272] T bde0fa9eb0a643ce81bf46013ef6a572 P 0b4332b9c1a84bde9278052eb2b32835 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.416061  2843 tablet_replica.cc:333] T a288028b1ba44234b32168b0fea601f9 P 0b4332b9c1a84bde9278052eb2b32835: stopping tablet replica
I20260709 13:13:48.416627  2843 raft_consensus.cc:2243] T a288028b1ba44234b32168b0fea601f9 P 0b4332b9c1a84bde9278052eb2b32835 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:48.417078  2843 raft_consensus.cc:2272] T a288028b1ba44234b32168b0fea601f9 P 0b4332b9c1a84bde9278052eb2b32835 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.418941  2843 tablet_replica.cc:333] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 0b4332b9c1a84bde9278052eb2b32835: stopping tablet replica
I20260709 13:13:48.419430  2843 raft_consensus.cc:2243] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 0b4332b9c1a84bde9278052eb2b32835 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:48.420290  2843 raft_consensus.cc:2272] T 9ab238772b3f4d1f9fe46f75ae91b0bc P 0b4332b9c1a84bde9278052eb2b32835 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.422137  2843 tablet_replica.cc:333] T a1b40b6f843b4e68b03b9286ad71384f P 0b4332b9c1a84bde9278052eb2b32835: stopping tablet replica
I20260709 13:13:48.422771  2843 raft_consensus.cc:2243] T a1b40b6f843b4e68b03b9286ad71384f P 0b4332b9c1a84bde9278052eb2b32835 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:13:48.423470  2843 raft_consensus.cc:2272] T a1b40b6f843b4e68b03b9286ad71384f P 0b4332b9c1a84bde9278052eb2b32835 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.425521  2843 tablet_replica.cc:333] T d5950c15e891492695358c32b92f10d0 P 0b4332b9c1a84bde9278052eb2b32835: stopping tablet replica
I20260709 13:13:48.426043  2843 raft_consensus.cc:2243] T d5950c15e891492695358c32b92f10d0 P 0b4332b9c1a84bde9278052eb2b32835 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:48.426493  2843 raft_consensus.cc:2272] T d5950c15e891492695358c32b92f10d0 P 0b4332b9c1a84bde9278052eb2b32835 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.428272  2843 tablet_replica.cc:333] T 7a59cf3c416745258673b8c3cebf93c4 P 0b4332b9c1a84bde9278052eb2b32835: stopping tablet replica
I20260709 13:13:48.428726  2843 raft_consensus.cc:2243] T 7a59cf3c416745258673b8c3cebf93c4 P 0b4332b9c1a84bde9278052eb2b32835 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:48.429145  2843 raft_consensus.cc:2272] T 7a59cf3c416745258673b8c3cebf93c4 P 0b4332b9c1a84bde9278052eb2b32835 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.461268  2843 tablet_server.cc:196] TabletServer@127.2.198.195:0 shutdown complete.
I20260709 13:13:48.488610  2843 master.cc:562] Master@127.2.198.254:46749 shutting down...
I20260709 13:13:48.524839  2843 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 7f922d8000cf45ec94648a96fcc922af [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:48.525599  2843 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 7f922d8000cf45ec94648a96fcc922af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.526053  2843 tablet_replica.cc:333] T 00000000000000000000000000000000 P 7f922d8000cf45ec94648a96fcc922af: stopping tablet replica
W20260709 13:13:49.535332  2843 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 3402)
I20260709 13:13:50.123606  2843 master.cc:584] Master@127.2.198.254:46749 shutdown complete.
0b4332b9c1a84bde9278052eb2b32835  1
0ce4927ed21e494fa47cd82d743826c7  4
6b0316ac722f4603bd53197367ed1c4d  5
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (12415 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:13:50.170451  2843 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.198.254:36531
I20260709 13:13:50.171803  2843 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:50.178051  3832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:50.178205  3833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:50.179400  3835 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:50.179709  2843 server_base.cc:1061] running on GCE node
I20260709 13:13:50.180810  2843 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:50.181033  2843 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:50.181217  2843 hybrid_clock.cc:648] HybridClock initialized: now 1783602830181182 us; error 0 us; skew 500 ppm
I20260709 13:13:50.181802  2843 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:50.184842  2843 webserver.cc:533] Webserver started at http://127.2.198.254:42333/ using document root <none> and password file <none>
I20260709 13:13:50.185405  2843 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:50.185619  2843 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:50.185946  2843 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:50.187287  2843 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/master-0-root/instance:
uuid: "af4ff34c238b4043994545a7eb56815f"
format_stamp: "Formatted at 2026-07-09 13:13:50 on dist-test-slave-fc6v"
I20260709 13:13:50.192128  2843 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:13:50.195662  3840 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:50.196409  2843 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:13:50.196715  2843 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/master-0-root
uuid: "af4ff34c238b4043994545a7eb56815f"
format_stamp: "Formatted at 2026-07-09 13:13:50 on dist-test-slave-fc6v"
I20260709 13:13:50.197005  2843 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:50.209399  2843 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:50.210840  2843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:50.255440  2843 rpc_server.cc:307] RPC server started. Bound to: 127.2.198.254:36531
I20260709 13:13:50.255589  3891 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.198.254:36531 every 8 connection(s)
I20260709 13:13:50.260078  3892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.271057  3892 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af4ff34c238b4043994545a7eb56815f: Bootstrap starting.
I20260709 13:13:50.276494  3892 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P af4ff34c238b4043994545a7eb56815f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:50.281364  3892 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af4ff34c238b4043994545a7eb56815f: No bootstrap required, opened a new log
I20260709 13:13:50.283860  3892 raft_consensus.cc:359] T 00000000000000000000000000000000 P af4ff34c238b4043994545a7eb56815f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af4ff34c238b4043994545a7eb56815f" member_type: VOTER }
I20260709 13:13:50.284308  3892 raft_consensus.cc:385] T 00000000000000000000000000000000 P af4ff34c238b4043994545a7eb56815f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:50.284548  3892 raft_consensus.cc:740] T 00000000000000000000000000000000 P af4ff34c238b4043994545a7eb56815f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af4ff34c238b4043994545a7eb56815f, State: Initialized, Role: FOLLOWER
I20260709 13:13:50.285143  3892 consensus_queue.cc:260] T 00000000000000000000000000000000 P af4ff34c238b4043994545a7eb56815f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af4ff34c238b4043994545a7eb56815f" member_type: VOTER }
I20260709 13:13:50.285616  3892 raft_consensus.cc:399] T 00000000000000000000000000000000 P af4ff34c238b4043994545a7eb56815f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:13:50.285852  3892 raft_consensus.cc:493] T 00000000000000000000000000000000 P af4ff34c238b4043994545a7eb56815f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:13:50.286144  3892 raft_consensus.cc:3060] T 00000000000000000000000000000000 P af4ff34c238b4043994545a7eb56815f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:50.290818  3892 raft_consensus.cc:515] T 00000000000000000000000000000000 P af4ff34c238b4043994545a7eb56815f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af4ff34c238b4043994545a7eb56815f" member_type: VOTER }
I20260709 13:13:50.291357  3892 leader_election.cc:304] T 00000000000000000000000000000000 P af4ff34c238b4043994545a7eb56815f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: af4ff34c238b4043994545a7eb56815f; no voters: 
I20260709 13:13:50.292637  3892 leader_election.cc:290] T 00000000000000000000000000000000 P af4ff34c238b4043994545a7eb56815f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:13:50.293102  3895 raft_consensus.cc:2804] T 00000000000000000000000000000000 P af4ff34c238b4043994545a7eb56815f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:50.294530  3895 raft_consensus.cc:697] T 00000000000000000000000000000000 P af4ff34c238b4043994545a7eb56815f [term 1 LEADER]: Becoming Leader. State: Replica: af4ff34c238b4043994545a7eb56815f, State: Running, Role: LEADER
I20260709 13:13:50.295272  3895 consensus_queue.cc:237] T 00000000000000000000000000000000 P af4ff34c238b4043994545a7eb56815f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af4ff34c238b4043994545a7eb56815f" member_type: VOTER }
I20260709 13:13:50.295842  3892 sys_catalog.cc:565] T 00000000000000000000000000000000 P af4ff34c238b4043994545a7eb56815f [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:13:50.300652  3897 sys_catalog.cc:455] T 00000000000000000000000000000000 P af4ff34c238b4043994545a7eb56815f [sys.catalog]: SysCatalogTable state changed. Reason: New leader af4ff34c238b4043994545a7eb56815f. Latest consensus state: current_term: 1 leader_uuid: "af4ff34c238b4043994545a7eb56815f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af4ff34c238b4043994545a7eb56815f" member_type: VOTER } }
I20260709 13:13:50.301265  3897 sys_catalog.cc:458] T 00000000000000000000000000000000 P af4ff34c238b4043994545a7eb56815f [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:50.300521  3896 sys_catalog.cc:455] T 00000000000000000000000000000000 P af4ff34c238b4043994545a7eb56815f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "af4ff34c238b4043994545a7eb56815f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af4ff34c238b4043994545a7eb56815f" member_type: VOTER } }
I20260709 13:13:50.302497  3896 sys_catalog.cc:458] T 00000000000000000000000000000000 P af4ff34c238b4043994545a7eb56815f [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:50.303743  3902 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:13:50.312312  3902 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:13:50.313330  2843 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:13:50.321790  3902 catalog_manager.cc:1383] Generated new cluster ID: 72ebf3bbaca848d98ebe49e13a1c2a4c
I20260709 13:13:50.322109  3902 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:13:50.339497  3902 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:13:50.341128  3902 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:13:50.358986  3902 catalog_manager.cc:6070] T 00000000000000000000000000000000 P af4ff34c238b4043994545a7eb56815f: Generated new TSK 0
I20260709 13:13:50.359745  3902 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:13:50.380096  2843 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:50.387013  3913 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:50.388036  3914 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:50.389597  3916 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:50.390384  2843 server_base.cc:1061] running on GCE node
I20260709 13:13:50.391302  2843 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:50.391516  2843 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:50.391736  2843 hybrid_clock.cc:648] HybridClock initialized: now 1783602830391697 us; error 0 us; skew 500 ppm
I20260709 13:13:50.392329  2843 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:50.394824  2843 webserver.cc:533] Webserver started at http://127.2.198.193:33853/ using document root <none> and password file <none>
I20260709 13:13:50.395383  2843 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:50.395630  2843 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:50.396020  2843 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:50.397526  2843 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/ts-0-root/instance:
uuid: "f1c75790cedf4f52a3463a255c7da059"
format_stamp: "Formatted at 2026-07-09 13:13:50 on dist-test-slave-fc6v"
I20260709 13:13:50.402367  2843 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.006s
I20260709 13:13:50.405810  3921 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:50.406787  2843 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:13:50.407095  2843 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/ts-0-root
uuid: "f1c75790cedf4f52a3463a255c7da059"
format_stamp: "Formatted at 2026-07-09 13:13:50 on dist-test-slave-fc6v"
I20260709 13:13:50.407407  2843 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:50.420738  2843 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:50.422147  2843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:50.423926  2843 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:50.426389  2843 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:50.426615  2843 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:50.426882  2843 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:50.427080  2843 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:50.474174  2843 rpc_server.cc:307] RPC server started. Bound to: 127.2.198.193:35339
I20260709 13:13:50.474283  3983 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.198.193:35339 every 8 connection(s)
I20260709 13:13:50.479760  2843 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:50.487766  3988 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:50.490687  3989 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:50.492112  2843 server_base.cc:1061] running on GCE node
W20260709 13:13:50.492129  3991 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:50.493618  2843 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:50.493880  2843 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:50.494079  2843 hybrid_clock.cc:648] HybridClock initialized: now 1783602830494043 us; error 0 us; skew 500 ppm
I20260709 13:13:50.494849  2843 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:50.496846  3984 heartbeater.cc:344] Connected to a master server at 127.2.198.254:36531
I20260709 13:13:50.497227  3984 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:50.497815  2843 webserver.cc:533] Webserver started at http://127.2.198.194:39507/ using document root <none> and password file <none>
I20260709 13:13:50.498137  3984 heartbeater.cc:507] Master 127.2.198.254:36531 requested a full tablet report, sending...
I20260709 13:13:50.498361  2843 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:50.498637  2843 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:50.498991  2843 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:50.500694  2843 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/ts-1-root/instance:
uuid: "6f5b5e4ed72944ecbda200012d141dc2"
format_stamp: "Formatted at 2026-07-09 13:13:50 on dist-test-slave-fc6v"
I20260709 13:13:50.500698  3857 ts_manager.cc:194] Registered new tserver with Master: f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339)
I20260709 13:13:50.503517  3857 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52092
I20260709 13:13:50.506878  2843 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:13:50.510456  3996 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:50.511224  2843 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:13:50.511677  2843 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/ts-1-root
uuid: "6f5b5e4ed72944ecbda200012d141dc2"
format_stamp: "Formatted at 2026-07-09 13:13:50 on dist-test-slave-fc6v"
I20260709 13:13:50.512032  2843 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:50.521387  2843 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:50.522600  2843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:50.524169  2843 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:50.526448  2843 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:50.526690  2843 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:50.526961  2843 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:50.527124  2843 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:50.574365  2843 rpc_server.cc:307] RPC server started. Bound to: 127.2.198.194:46115
I20260709 13:13:50.574501  4058 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.198.194:46115 every 8 connection(s)
I20260709 13:13:50.580054  2843 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:50.587235  4062 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:50.589402  4063 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:50.593930  4065 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:50.594758  4059 heartbeater.cc:344] Connected to a master server at 127.2.198.254:36531
I20260709 13:13:50.595181  4059 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:50.595276  2843 server_base.cc:1061] running on GCE node
I20260709 13:13:50.596500  4059 heartbeater.cc:507] Master 127.2.198.254:36531 requested a full tablet report, sending...
I20260709 13:13:50.596827  2843 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:50.597110  2843 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:50.597395  2843 hybrid_clock.cc:648] HybridClock initialized: now 1783602830597298 us; error 0 us; skew 500 ppm
I20260709 13:13:50.598240  2843 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:50.599105  3857 ts_manager.cc:194] Registered new tserver with Master: 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:50.600821  3857 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52094
I20260709 13:13:50.601190  2843 webserver.cc:533] Webserver started at http://127.2.198.195:36221/ using document root <none> and password file <none>
I20260709 13:13:50.601776  2843 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:50.602111  2843 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:50.602488  2843 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:50.603890  2843 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/ts-2-root/instance:
uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
format_stamp: "Formatted at 2026-07-09 13:13:50 on dist-test-slave-fc6v"
I20260709 13:13:50.609622  2843 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.002s
I20260709 13:13:50.613452  4070 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:50.614301  2843 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:13:50.614614  2843 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/ts-2-root
uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
format_stamp: "Formatted at 2026-07-09 13:13:50 on dist-test-slave-fc6v"
I20260709 13:13:50.614954  2843 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:50.645354  2843 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:50.646766  2843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:50.648459  2843 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:50.650887  2843 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:50.651103  2843 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:50.651400  2843 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:50.651593  2843 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:50.698184  2843 rpc_server.cc:307] RPC server started. Bound to: 127.2.198.195:37843
I20260709 13:13:50.698323  4132 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.198.195:37843 every 8 connection(s)
I20260709 13:13:50.714494  4133 heartbeater.cc:344] Connected to a master server at 127.2.198.254:36531
I20260709 13:13:50.714967  4133 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:50.715988  4133 heartbeater.cc:507] Master 127.2.198.254:36531 requested a full tablet report, sending...
I20260709 13:13:50.718303  3857 ts_manager.cc:194] Registered new tserver with Master: 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:50.718978  2843 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017314343s
I20260709 13:13:50.719918  3857 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52104
I20260709 13:13:50.748670  3857 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52106:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:50.755656  3857 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:50.992796  4021 tablet_service.cc:1511] Processing CreateTablet for tablet 79e5ee76c81a42c8a9510d0d5d7b55b2 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:13:50.994009  4024 tablet_service.cc:1511] Processing CreateTablet for tablet 86669993fba94e65ba192aa115ed6e88 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:13:50.994618  4021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79e5ee76c81a42c8a9510d0d5d7b55b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.996690  4023 tablet_service.cc:1511] Processing CreateTablet for tablet 9b2556690d2041edb61d331163aced7d (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:13:50.997929  4019 tablet_service.cc:1511] Processing CreateTablet for tablet 7f3e65834a74410e9f2fa3b0e16b1e1e (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:13:50.998250  4095 tablet_service.cc:1511] Processing CreateTablet for tablet 79e5ee76c81a42c8a9510d0d5d7b55b2 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:13:50.999477  4098 tablet_service.cc:1511] Processing CreateTablet for tablet 86669993fba94e65ba192aa115ed6e88 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:13:51.000048  4095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79e5ee76c81a42c8a9510d0d5d7b55b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.000555  4018 tablet_service.cc:1511] Processing CreateTablet for tablet b1073c870d784f068fdb3f222623f5a3 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:13:51.001063  4098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86669993fba94e65ba192aa115ed6e88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.002493  4022 tablet_service.cc:1511] Processing CreateTablet for tablet f492997a6e0f48c5b9e231e43f19e3f3 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:13:51.003816  4097 tablet_service.cc:1511] Processing CreateTablet for tablet 9b2556690d2041edb61d331163aced7d (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:13:51.005278  4097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b2556690d2041edb61d331163aced7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.005203  4094 tablet_service.cc:1511] Processing CreateTablet for tablet b7e7a2dc30a24e5caaa3806c68b96c08 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:13:51.006850  4094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7e7a2dc30a24e5caaa3806c68b96c08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.008893  4096 tablet_service.cc:1511] Processing CreateTablet for tablet f492997a6e0f48c5b9e231e43f19e3f3 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:13:51.010375  4096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f492997a6e0f48c5b9e231e43f19e3f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.996690  4020 tablet_service.cc:1511] Processing CreateTablet for tablet b7e7a2dc30a24e5caaa3806c68b96c08 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:13:51.015360  4024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86669993fba94e65ba192aa115ed6e88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.016111  4022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f492997a6e0f48c5b9e231e43f19e3f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.016911  4020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7e7a2dc30a24e5caaa3806c68b96c08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.017537  4019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f3e65834a74410e9f2fa3b0e16b1e1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.019127  4093 tablet_service.cc:1511] Processing CreateTablet for tablet 7f3e65834a74410e9f2fa3b0e16b1e1e (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:13:51.019905  4018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1073c870d784f068fdb3f222623f5a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.020700  4093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f3e65834a74410e9f2fa3b0e16b1e1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.021176  4017 tablet_service.cc:1511] Processing CreateTablet for tablet 21bc23345fdc47d2b7e9b8964749236e (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:13:51.022722  4017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21bc23345fdc47d2b7e9b8964749236e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.025820  4016 tablet_service.cc:1511] Processing CreateTablet for tablet 0c7551e973324a21b094c1d2869495ac (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:13:51.027314  4016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c7551e973324a21b094c1d2869495ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.032784  4023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b2556690d2041edb61d331163aced7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.034296  4092 tablet_service.cc:1511] Processing CreateTablet for tablet b1073c870d784f068fdb3f222623f5a3 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:13:51.036327  4092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1073c870d784f068fdb3f222623f5a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.042290  4091 tablet_service.cc:1511] Processing CreateTablet for tablet 21bc23345fdc47d2b7e9b8964749236e (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:13:51.044397  4091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21bc23345fdc47d2b7e9b8964749236e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.053387  4090 tablet_service.cc:1511] Processing CreateTablet for tablet 0c7551e973324a21b094c1d2869495ac (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:13:51.055743  4090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c7551e973324a21b094c1d2869495ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.070796  3949 tablet_service.cc:1511] Processing CreateTablet for tablet 86669993fba94e65ba192aa115ed6e88 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:13:51.073040  3949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86669993fba94e65ba192aa115ed6e88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.073276  4015 tablet_service.cc:1511] Processing CreateTablet for tablet 1851e462889842a49d577d585d278117 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:13:51.074740  4015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1851e462889842a49d577d585d278117. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.085072  3948 tablet_service.cc:1511] Processing CreateTablet for tablet 9b2556690d2041edb61d331163aced7d (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:13:51.087410  3948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b2556690d2041edb61d331163aced7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.095527  3946 tablet_service.cc:1511] Processing CreateTablet for tablet 79e5ee76c81a42c8a9510d0d5d7b55b2 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:13:51.097146  3946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79e5ee76c81a42c8a9510d0d5d7b55b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.099949  3947 tablet_service.cc:1511] Processing CreateTablet for tablet f492997a6e0f48c5b9e231e43f19e3f3 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:13:51.101497  3947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f492997a6e0f48c5b9e231e43f19e3f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.105427  3945 tablet_service.cc:1511] Processing CreateTablet for tablet b7e7a2dc30a24e5caaa3806c68b96c08 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:13:51.107030  3945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7e7a2dc30a24e5caaa3806c68b96c08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.111398  3944 tablet_service.cc:1511] Processing CreateTablet for tablet 7f3e65834a74410e9f2fa3b0e16b1e1e (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:13:51.112591  3941 tablet_service.cc:1511] Processing CreateTablet for tablet 0c7551e973324a21b094c1d2869495ac (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:13:51.113032  3944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f3e65834a74410e9f2fa3b0e16b1e1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.116488  3942 tablet_service.cc:1511] Processing CreateTablet for tablet 21bc23345fdc47d2b7e9b8964749236e (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:13:51.117990  3942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21bc23345fdc47d2b7e9b8964749236e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.122059  3941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c7551e973324a21b094c1d2869495ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.122090  3943 tablet_service.cc:1511] Processing CreateTablet for tablet b1073c870d784f068fdb3f222623f5a3 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:13:51.128018  3943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1073c870d784f068fdb3f222623f5a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.160758  4094 tablet_service.cc:1511] Processing CreateTablet for tablet 649df91131174f00af0e0a0240f80adb (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:13:51.160890  3940 tablet_service.cc:1511] Processing CreateTablet for tablet 1851e462889842a49d577d585d278117 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:13:51.170825  4148 tablet_bootstrap.cc:492] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:13:51.171005  4089 tablet_service.cc:1511] Processing CreateTablet for tablet 1851e462889842a49d577d585d278117 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:13:51.181495  4089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1851e462889842a49d577d585d278117. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.181525  3940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1851e462889842a49d577d585d278117. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.163103  4019 tablet_service.cc:1511] Processing CreateTablet for tablet 649df91131174f00af0e0a0240f80adb (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:13:51.191937  4094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 649df91131174f00af0e0a0240f80adb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.200311  4020 tablet_service.cc:1511] Processing CreateTablet for tablet c29b05201a5f4c6089866210cf02f151 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:13:51.201114  4148 tablet_bootstrap.cc:654] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.198688  4095 tablet_service.cc:1511] Processing CreateTablet for tablet ad706e81088440eaa86606b68c1c2c5f (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:13:51.203174  4019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 649df91131174f00af0e0a0240f80adb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.203594  4095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad706e81088440eaa86606b68c1c2c5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.208915  4016 tablet_service.cc:1511] Processing CreateTablet for tablet ad706e81088440eaa86606b68c1c2c5f (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:13:51.212561  4018 tablet_service.cc:1511] Processing CreateTablet for tablet 3f641c5435604e30bb44aa411954bd2f (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:13:51.219182  4020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c29b05201a5f4c6089866210cf02f151. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.218883  3945 tablet_service.cc:1511] Processing CreateTablet for tablet 649df91131174f00af0e0a0240f80adb (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:13:51.220278  3945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 649df91131174f00af0e0a0240f80adb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.223086  4016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad706e81088440eaa86606b68c1c2c5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.212571  4017 tablet_service.cc:1511] Processing CreateTablet for tablet 1d55b0c8cf6547cb8c135f6ecdfce39f (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:13:51.224320  4017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d55b0c8cf6547cb8c135f6ecdfce39f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.229597  4018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f641c5435604e30bb44aa411954bd2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.232195  4149 tablet_bootstrap.cc:492] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:13:51.234519  4150 tablet_bootstrap.cc:492] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:13:51.270412  4022 tablet_service.cc:1511] Processing CreateTablet for tablet 13ea3a969108486bbbaaaf3697e1d3b5 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:13:51.272029  3941 tablet_service.cc:1511] Processing CreateTablet for tablet c29b05201a5f4c6089866210cf02f151 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:13:51.273473  3941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c29b05201a5f4c6089866210cf02f151. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.279968  4022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13ea3a969108486bbbaaaf3697e1d3b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.284897  3945 tablet_service.cc:1511] Processing CreateTablet for tablet 1d55b0c8cf6547cb8c135f6ecdfce39f (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:13:51.286422  3945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d55b0c8cf6547cb8c135f6ecdfce39f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.288265  4097 tablet_service.cc:1511] Processing CreateTablet for tablet c29b05201a5f4c6089866210cf02f151 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:13:51.289915  4097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c29b05201a5f4c6089866210cf02f151. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.290035  4096 tablet_service.cc:1511] Processing CreateTablet for tablet 1d55b0c8cf6547cb8c135f6ecdfce39f (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:13:51.291306  4096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d55b0c8cf6547cb8c135f6ecdfce39f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.268918  4148 tablet_bootstrap.cc:492] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:13:51.298064  4148 ts_tablet_manager.cc:1403] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.128s	user 0.008s	sys 0.026s
I20260709 13:13:51.301328  4024 tablet_service.cc:1511] Processing CreateTablet for tablet 4e6407d1f930405b9aa0d4690377e1da (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:13:51.302776  4024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e6407d1f930405b9aa0d4690377e1da. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:13:51.307826  3905 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:51.310138  3945 tablet_service.cc:1511] Processing CreateTablet for tablet ad706e81088440eaa86606b68c1c2c5f (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:13:51.311532  3945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad706e81088440eaa86606b68c1c2c5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.292764  3949 tablet_service.cc:1511] Processing CreateTablet for tablet 13ea3a969108486bbbaaaf3697e1d3b5 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:13:51.314137  3949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13ea3a969108486bbbaaaf3697e1d3b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.326653  4098 tablet_service.cc:1511] Processing CreateTablet for tablet 3f641c5435604e30bb44aa411954bd2f (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:13:51.333547  4098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f641c5435604e30bb44aa411954bd2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.330648  4091 tablet_service.cc:1511] Processing CreateTablet for tablet 13ea3a969108486bbbaaaf3697e1d3b5 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
W20260709 13:13:51.351940  3841 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 44957.3us
I20260709 13:13:51.359189  3945 tablet_service.cc:1511] Processing CreateTablet for tablet 4e6407d1f930405b9aa0d4690377e1da (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:13:51.360716  3945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e6407d1f930405b9aa0d4690377e1da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.368057  4148 raft_consensus.cc:359] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:51.368995  4148 raft_consensus.cc:385] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.369321  4148 raft_consensus.cc:740] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.370165  4148 consensus_queue.cc:260] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:51.378861  3945 tablet_service.cc:1511] Processing CreateTablet for tablet 97cf7690694c4d5988258ec1b641a2e6 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:13:51.380357  3945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97cf7690694c4d5988258ec1b641a2e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.380281  4090 tablet_service.cc:1511] Processing CreateTablet for tablet 97cf7690694c4d5988258ec1b641a2e6 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:13:51.385430  3946 tablet_service.cc:1511] Processing CreateTablet for tablet 6ff80427d8324bd386a3ac9ff13d768e (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:13:51.386924  3946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ff80427d8324bd386a3ac9ff13d768e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.387207  4015 tablet_service.cc:1511] Processing CreateTablet for tablet 97cf7690694c4d5988258ec1b641a2e6 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:13:51.388669  4094 tablet_service.cc:1511] Processing CreateTablet for tablet 4e6407d1f930405b9aa0d4690377e1da (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:13:51.395234  3942 tablet_service.cc:1511] Processing CreateTablet for tablet 3f641c5435604e30bb44aa411954bd2f (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:13:51.396775  3942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f641c5435604e30bb44aa411954bd2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.402449  4091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13ea3a969108486bbbaaaf3697e1d3b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.401909  4149 tablet_bootstrap.cc:654] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.411863  4148 ts_tablet_manager.cc:1434] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.102s	user 0.010s	sys 0.001s
I20260709 13:13:51.412782  4133 heartbeater.cc:499] Master 127.2.198.254:36531 was elected leader, sending a full tablet report...
I20260709 13:13:51.425767  4093 tablet_service.cc:1511] Processing CreateTablet for tablet 6ff80427d8324bd386a3ac9ff13d768e (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:13:51.425864  4019 tablet_service.cc:1511] Processing CreateTablet for tablet 6ff80427d8324bd386a3ac9ff13d768e (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:13:51.428731  4093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ff80427d8324bd386a3ac9ff13d768e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.388697  4015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97cf7690694c4d5988258ec1b641a2e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.432499  4090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97cf7690694c4d5988258ec1b641a2e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.440210  4094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e6407d1f930405b9aa0d4690377e1da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.404027  4150 tablet_bootstrap.cc:654] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.430261  4148 tablet_bootstrap.cc:492] T b7e7a2dc30a24e5caaa3806c68b96c08 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:13:51.459913  4019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ff80427d8324bd386a3ac9ff13d768e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.460888  3948 tablet_service.cc:1511] Processing CreateTablet for tablet f4845eaa52cb4965b9c8922f37e2f606 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:13:51.462648  3948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4845eaa52cb4965b9c8922f37e2f606. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.466925  4020 tablet_service.cc:1511] Processing CreateTablet for tablet f4845eaa52cb4965b9c8922f37e2f606 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:13:51.468514  4020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4845eaa52cb4965b9c8922f37e2f606. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.478547  4148 tablet_bootstrap.cc:654] T b7e7a2dc30a24e5caaa3806c68b96c08 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.507622  3984 heartbeater.cc:499] Master 127.2.198.254:36531 was elected leader, sending a full tablet report...
I20260709 13:13:51.521636  4093 tablet_service.cc:1511] Processing CreateTablet for tablet f4845eaa52cb4965b9c8922f37e2f606 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:13:51.523440  4093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4845eaa52cb4965b9c8922f37e2f606. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.523486  4092 tablet_service.cc:1511] Processing CreateTablet for tablet 37bb8c27fe534b22824e326e191a66f0 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:13:51.524900  4092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37bb8c27fe534b22824e326e191a66f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.525202  4016 tablet_service.cc:1511] Processing CreateTablet for tablet c18bd2f3197a4762aec88dec3caa6712 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:13:51.525473  3949 tablet_service.cc:1511] Processing CreateTablet for tablet c18bd2f3197a4762aec88dec3caa6712 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:13:51.526587  4016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c18bd2f3197a4762aec88dec3caa6712. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.526965  3949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c18bd2f3197a4762aec88dec3caa6712. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.532857  4023 tablet_service.cc:1511] Processing CreateTablet for tablet 37bb8c27fe534b22824e326e191a66f0 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:13:51.534432  4023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37bb8c27fe534b22824e326e191a66f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.534058  3944 tablet_service.cc:1511] Processing CreateTablet for tablet 37bb8c27fe534b22824e326e191a66f0 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:13:51.535425  3944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37bb8c27fe534b22824e326e191a66f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.538262  4098 tablet_service.cc:1511] Processing CreateTablet for tablet c18bd2f3197a4762aec88dec3caa6712 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:13:51.539620  4098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c18bd2f3197a4762aec88dec3caa6712. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.540647  3943 tablet_service.cc:1511] Processing CreateTablet for tablet b2879f06fa90455ea323efd79c11c330 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:13:51.541976  3943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2879f06fa90455ea323efd79c11c330. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.542971  4018 tablet_service.cc:1511] Processing CreateTablet for tablet b2879f06fa90455ea323efd79c11c330 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:13:51.544318  4018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2879f06fa90455ea323efd79c11c330. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.544694  4096 tablet_service.cc:1511] Processing CreateTablet for tablet b2879f06fa90455ea323efd79c11c330 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:13:51.546250  4096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2879f06fa90455ea323efd79c11c330. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.558822  3947 tablet_service.cc:1511] Processing CreateTablet for tablet f6f1e6f6803e4a459cce95251d23c854 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:13:51.560451  3947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6f1e6f6803e4a459cce95251d23c854. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.564601  4024 tablet_service.cc:1511] Processing CreateTablet for tablet f6f1e6f6803e4a459cce95251d23c854 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:13:51.565201  3940 tablet_service.cc:1511] Processing CreateTablet for tablet 4b83b18c9e8b401c95ac6e2c0a420316 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:13:51.566056  4024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6f1e6f6803e4a459cce95251d23c854. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.566623  3940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b83b18c9e8b401c95ac6e2c0a420316. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.564442  4091 tablet_service.cc:1511] Processing CreateTablet for tablet f6f1e6f6803e4a459cce95251d23c854 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:13:51.578488  4150 tablet_bootstrap.cc:492] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:13:51.582008  4022 tablet_service.cc:1511] Processing CreateTablet for tablet 4b83b18c9e8b401c95ac6e2c0a420316 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:13:51.588516  4022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b83b18c9e8b401c95ac6e2c0a420316. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.593883  4149 tablet_bootstrap.cc:492] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:13:51.594465  4149 ts_tablet_manager.cc:1403] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.363s	user 0.020s	sys 0.014s
I20260709 13:13:51.599841  4149 raft_consensus.cc:359] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:51.599866  4150 ts_tablet_manager.cc:1403] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.366s	user 0.018s	sys 0.012s
I20260709 13:13:51.603427  4092 tablet_service.cc:1511] Processing CreateTablet for tablet 412d794b0f694d089b1b011ba8adea36 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:13:51.605756  4149 raft_consensus.cc:385] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.606137  4149 raft_consensus.cc:740] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.606668  4092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 412d794b0f694d089b1b011ba8adea36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.606583  3945 tablet_service.cc:1511] Processing CreateTablet for tablet 4a08c9f959924154b694899e3a318181 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:13:51.606946  4149 consensus_queue.cc:260] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:51.607928  3945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a08c9f959924154b694899e3a318181. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.608853  4021 tablet_service.cc:1511] Processing CreateTablet for tablet 4a08c9f959924154b694899e3a318181 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:13:51.610133  4021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a08c9f959924154b694899e3a318181. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.604410  4059 heartbeater.cc:499] Master 127.2.198.254:36531 was elected leader, sending a full tablet report...
I20260709 13:13:51.604588  3943 tablet_service.cc:1511] Processing CreateTablet for tablet 412d794b0f694d089b1b011ba8adea36 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:13:51.617478  3943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 412d794b0f694d089b1b011ba8adea36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.631865  4020 tablet_service.cc:1511] Processing CreateTablet for tablet 412d794b0f694d089b1b011ba8adea36 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:13:51.633690  4020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 412d794b0f694d089b1b011ba8adea36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.638692  4150 raft_consensus.cc:359] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:51.631922  4091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6f1e6f6803e4a459cce95251d23c854. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.656203  4150 raft_consensus.cc:385] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.662051  4150 raft_consensus.cc:740] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.663053  4150 consensus_queue.cc:260] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:51.666158  4094 tablet_service.cc:1511] Processing CreateTablet for tablet 4a08c9f959924154b694899e3a318181 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:13:51.669713  4094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a08c9f959924154b694899e3a318181. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.671909  4149 ts_tablet_manager.cc:1434] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.077s	user 0.009s	sys 0.003s
I20260709 13:13:51.673019  4149 tablet_bootstrap.cc:492] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:13:51.687278  4097 tablet_service.cc:1511] Processing CreateTablet for tablet 4b83b18c9e8b401c95ac6e2c0a420316 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:13:51.687444  3940 tablet_service.cc:1511] Processing CreateTablet for tablet cc52edd660634ce5bc356665dd499a61 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:13:51.697360  4148 tablet_bootstrap.cc:492] T b7e7a2dc30a24e5caaa3806c68b96c08 P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:13:51.690915  4015 tablet_service.cc:1511] Processing CreateTablet for tablet cc52edd660634ce5bc356665dd499a61 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:13:51.697553  4097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b83b18c9e8b401c95ac6e2c0a420316. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.693405  4019 tablet_service.cc:1511] Processing CreateTablet for tablet e7b8e59a6e504b3189b0b875dabf2b96 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:13:51.703611  4152 raft_consensus.cc:493] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.693957  3941 tablet_service.cc:1511] Processing CreateTablet for tablet e7b8e59a6e504b3189b0b875dabf2b96 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:13:51.704180  4152 raft_consensus.cc:515] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:51.697615  3940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc52edd660634ce5bc356665dd499a61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.709232  3941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7b8e59a6e504b3189b0b875dabf2b96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.697925  4148 ts_tablet_manager.cc:1403] T b7e7a2dc30a24e5caaa3806c68b96c08 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.271s	user 0.021s	sys 0.008s
I20260709 13:13:51.691078  4093 tablet_service.cc:1511] Processing CreateTablet for tablet cc52edd660634ce5bc356665dd499a61 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:13:51.698834  4015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc52edd660634ce5bc356665dd499a61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.713136  4093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc52edd660634ce5bc356665dd499a61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.727005  4148 raft_consensus.cc:359] T b7e7a2dc30a24e5caaa3806c68b96c08 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:51.727974  4148 raft_consensus.cc:385] T b7e7a2dc30a24e5caaa3806c68b96c08 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.728276  4148 raft_consensus.cc:740] T b7e7a2dc30a24e5caaa3806c68b96c08 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.728644  4150 ts_tablet_manager.cc:1434] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.101s	user 0.012s	sys 0.016s
I20260709 13:13:51.728940  4096 tablet_service.cc:1511] Processing CreateTablet for tablet e7b8e59a6e504b3189b0b875dabf2b96 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:13:51.729704  4150 tablet_bootstrap.cc:492] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:13:51.729077  4148 consensus_queue.cc:260] T b7e7a2dc30a24e5caaa3806c68b96c08 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:51.734127  4152 leader_election.cc:290] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:51.736562  4096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7b8e59a6e504b3189b0b875dabf2b96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.740279  4019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7b8e59a6e504b3189b0b875dabf2b96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.776034  4023 tablet_service.cc:1511] Processing CreateTablet for tablet 40ffdd65ef5c4d8982bdf6556426ee40 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:13:51.777628  4023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40ffdd65ef5c4d8982bdf6556426ee40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.779239  4150 tablet_bootstrap.cc:654] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.792495  3944 tablet_service.cc:1511] Processing CreateTablet for tablet 40ffdd65ef5c4d8982bdf6556426ee40 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:13:51.794518  3944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40ffdd65ef5c4d8982bdf6556426ee40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.814024  4092 tablet_service.cc:1511] Processing CreateTablet for tablet 40ffdd65ef5c4d8982bdf6556426ee40 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:13:51.828246  4092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40ffdd65ef5c4d8982bdf6556426ee40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.848932  4148 ts_tablet_manager.cc:1434] T b7e7a2dc30a24e5caaa3806c68b96c08 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.139s	user 0.005s	sys 0.022s
I20260709 13:13:51.850253  4148 tablet_bootstrap.cc:492] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:13:51.833262  4149 tablet_bootstrap.cc:654] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.859468  4015 tablet_service.cc:1511] Processing CreateTablet for tablet 2705becfe8874dbe97b71d14b12feb8f (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:13:51.865976  3946 tablet_service.cc:1511] Processing CreateTablet for tablet 11c2da89f37f4113a8811c6e081da953 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:13:51.866004  4021 tablet_service.cc:1511] Processing CreateTablet for tablet 11c2da89f37f4113a8811c6e081da953 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:13:51.867515  3946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11c2da89f37f4113a8811c6e081da953. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.868441  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:51.869211  4021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11c2da89f37f4113a8811c6e081da953. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.872244  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:13:51.872915  4071 leader_election.cc:343] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:51.861745  4092 tablet_service.cc:1511] Processing CreateTablet for tablet 2705becfe8874dbe97b71d14b12feb8f (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:13:51.873802  4015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2705becfe8874dbe97b71d14b12feb8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.874059  4092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2705becfe8874dbe97b71d14b12feb8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.870208  4094 tablet_service.cc:1511] Processing CreateTablet for tablet 11c2da89f37f4113a8811c6e081da953 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
W20260709 13:13:51.876281  4074 leader_election.cc:343] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:51.876744  4074 leader_election.cc:304] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:51.878091  4162 raft_consensus.cc:2749] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:51.879215  4094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11c2da89f37f4113a8811c6e081da953. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.880000  4148 tablet_bootstrap.cc:654] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.885016  3941 tablet_service.cc:1511] Processing CreateTablet for tablet 2705becfe8874dbe97b71d14b12feb8f (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:13:51.886426  3941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2705becfe8874dbe97b71d14b12feb8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.888684  3940 tablet_service.cc:1511] Processing CreateTablet for tablet ba7a51e4b70a48daa8267297f285c661 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:13:51.889155  4150 tablet_bootstrap.cc:492] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:13:51.889672  4150 ts_tablet_manager.cc:1403] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.160s	user 0.023s	sys 0.037s
I20260709 13:13:51.889979  3940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba7a51e4b70a48daa8267297f285c661. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.899624  4020 tablet_service.cc:1511] Processing CreateTablet for tablet ba7a51e4b70a48daa8267297f285c661 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:13:51.901247  4020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba7a51e4b70a48daa8267297f285c661. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.910517  4096 tablet_service.cc:1511] Processing CreateTablet for tablet ba7a51e4b70a48daa8267297f285c661 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:13:51.910902  4150 raft_consensus.cc:359] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:51.911693  4150 raft_consensus.cc:385] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.912034  4096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba7a51e4b70a48daa8267297f285c661. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.919521  3943 tablet_service.cc:1511] Processing CreateTablet for tablet 20cb8f6ca1af4ec79acaa9f95e816ca6 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:13:51.920219  4019 tablet_service.cc:1511] Processing CreateTablet for tablet 20cb8f6ca1af4ec79acaa9f95e816ca6 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:13:51.921572  4019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20cb8f6ca1af4ec79acaa9f95e816ca6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.921676  3943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20cb8f6ca1af4ec79acaa9f95e816ca6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.932267  3945 tablet_service.cc:1511] Processing CreateTablet for tablet 256a58e0d11d473c899ea90e30dbd511 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:13:51.933708  3945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 256a58e0d11d473c899ea90e30dbd511. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.936578  4156 raft_consensus.cc:493] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.937099  4156 raft_consensus.cc:515] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:51.947641  4156 leader_election.cc:290] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:51.951027  4093 tablet_service.cc:1511] Processing CreateTablet for tablet 20cb8f6ca1af4ec79acaa9f95e816ca6 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:13:51.912010  4150 raft_consensus.cc:740] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.970256  4150 consensus_queue.cc:260] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:51.972617  4150 ts_tablet_manager.cc:1434] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.083s	user 0.010s	sys 0.000s
I20260709 13:13:51.951853  4015 tablet_service.cc:1511] Processing CreateTablet for tablet 256a58e0d11d473c899ea90e30dbd511 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:13:51.973948  4015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 256a58e0d11d473c899ea90e30dbd511. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.976019  4149 tablet_bootstrap.cc:492] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:13:51.976173  4093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20cb8f6ca1af4ec79acaa9f95e816ca6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.976588  4149 ts_tablet_manager.cc:1403] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.304s	user 0.017s	sys 0.033s
I20260709 13:13:51.954908  4148 tablet_bootstrap.cc:492] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:13:51.979571  4148 ts_tablet_manager.cc:1403] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.130s	user 0.014s	sys 0.014s
I20260709 13:13:51.981494  4023 tablet_service.cc:1511] Processing CreateTablet for tablet 0d4e65893d284960aef32d35d0db30a4 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:13:51.982914  4023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d4e65893d284960aef32d35d0db30a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.982666  4148 raft_consensus.cc:359] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:51.967384  3946 tablet_service.cc:1511] Processing CreateTablet for tablet b523c05ab48243118947b2e30890c0b4 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:13:51.984310  3946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b523c05ab48243118947b2e30890c0b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.985911  4024 tablet_service.cc:1511] Processing CreateTablet for tablet 97cd8a260df0424d973e61ef94d96102 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:13:51.987182  4024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97cd8a260df0424d973e61ef94d96102. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.968572  4021 tablet_service.cc:1511] Processing CreateTablet for tablet b523c05ab48243118947b2e30890c0b4 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:13:51.989569  4021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b523c05ab48243118947b2e30890c0b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.992501  4022 tablet_service.cc:1511] Processing CreateTablet for tablet 4d2c2416b3b84475b42a757829fd63a8 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:13:51.993157  3948 tablet_service.cc:1511] Processing CreateTablet for tablet 97cd8a260df0424d973e61ef94d96102 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:13:51.993866  4022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d2c2416b3b84475b42a757829fd63a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.994458  3948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97cd8a260df0424d973e61ef94d96102. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.996491  3947 tablet_service.cc:1511] Processing CreateTablet for tablet 4d2c2416b3b84475b42a757829fd63a8 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:13:51.997828  3947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d2c2416b3b84475b42a757829fd63a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.998558  3949 tablet_service.cc:1511] Processing CreateTablet for tablet dc2641ff9849458a9200dfc5a9016cce (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:13:51.994460  4150 tablet_bootstrap.cc:492] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:13:51.999845  3949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc2641ff9849458a9200dfc5a9016cce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.000591  3942 tablet_service.cc:1511] Processing CreateTablet for tablet 622bcde3b6ba43678f5eb621e8259db2 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:13:52.002076  3942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 622bcde3b6ba43678f5eb621e8259db2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.004536  4018 tablet_service.cc:1511] Processing CreateTablet for tablet 622bcde3b6ba43678f5eb621e8259db2 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:13:52.005857  4018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 622bcde3b6ba43678f5eb621e8259db2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.007019  4017 tablet_service.cc:1511] Processing CreateTablet for tablet dc2641ff9849458a9200dfc5a9016cce (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:13:52.008301  4017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc2641ff9849458a9200dfc5a9016cce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.010862  4157 raft_consensus.cc:493] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.011498  4157 raft_consensus.cc:515] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:52.029419  4094 tablet_service.cc:1511] Processing CreateTablet for tablet 256a58e0d11d473c899ea90e30dbd511 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:13:52.029887  4092 tablet_service.cc:1511] Processing CreateTablet for tablet 0d4e65893d284960aef32d35d0db30a4 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:13:52.030893  4094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 256a58e0d11d473c899ea90e30dbd511. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.031522  4092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d4e65893d284960aef32d35d0db30a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.034647  4096 tablet_service.cc:1511] Processing CreateTablet for tablet b523c05ab48243118947b2e30890c0b4 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:13:52.035957  4096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b523c05ab48243118947b2e30890c0b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.036338  4157 leader_election.cc:290] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:52.041280  4098 tablet_service.cc:1511] Processing CreateTablet for tablet 4d2c2416b3b84475b42a757829fd63a8 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:13:52.041491  4090 tablet_service.cc:1511] Processing CreateTablet for tablet 622bcde3b6ba43678f5eb621e8259db2 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:13:52.042636  4098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d2c2416b3b84475b42a757829fd63a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.983433  4148 raft_consensus.cc:385] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.057078  4148 raft_consensus.cc:740] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.056703  3940 tablet_service.cc:1511] Processing CreateTablet for tablet 0d4e65893d284960aef32d35d0db30a4 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:13:52.058408  3940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d4e65893d284960aef32d35d0db30a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.058156  4148 consensus_queue.cc:260] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:52.066375  4091 tablet_service.cc:1511] Processing CreateTablet for tablet 97cd8a260df0424d973e61ef94d96102 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:13:52.072158  4016 tablet_service.cc:1511] Processing CreateTablet for tablet 65333bcc8c2a4b1a9f6f35670cefe7d0 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:13:52.073565  4016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65333bcc8c2a4b1a9f6f35670cefe7d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.074749  4148 ts_tablet_manager.cc:1434] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.095s	user 0.006s	sys 0.000s
I20260709 13:13:52.087952  4020 tablet_service.cc:1511] Processing CreateTablet for tablet 08d6732bceef4220a670ac449347258b (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:13:52.089416  4020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08d6732bceef4220a670ac449347258b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.090518  4157 raft_consensus.cc:493] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.091043  4157 raft_consensus.cc:515] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:52.093259  4157 leader_election.cc:290] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:52.103705  4090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 622bcde3b6ba43678f5eb621e8259db2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.104224  4148 tablet_bootstrap.cc:492] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:13:52.116050  4148 tablet_bootstrap.cc:654] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.131305  4091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97cd8a260df0424d973e61ef94d96102. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.133227  4097 tablet_service.cc:1511] Processing CreateTablet for tablet dc2641ff9849458a9200dfc5a9016cce (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:13:52.137907  4150 tablet_bootstrap.cc:654] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.138463  4095 tablet_service.cc:1511] Processing CreateTablet for tablet 65333bcc8c2a4b1a9f6f35670cefe7d0 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:13:52.139972  4097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc2641ff9849458a9200dfc5a9016cce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.149505  3945 tablet_service.cc:1511] Processing CreateTablet for tablet 08d6732bceef4220a670ac449347258b (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:13:52.151693  3945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08d6732bceef4220a670ac449347258b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.151932  4095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65333bcc8c2a4b1a9f6f35670cefe7d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.102813  4149 raft_consensus.cc:359] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:52.155292  4149 raft_consensus.cc:385] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.083390  3944 tablet_service.cc:1511] Processing CreateTablet for tablet 65333bcc8c2a4b1a9f6f35670cefe7d0 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:13:52.155709  4149 raft_consensus.cc:740] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.156111  4019 tablet_service.cc:1511] Processing CreateTablet for tablet eae506e79ba348b3b1db60ecc6ae6714 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:13:52.156697  3944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65333bcc8c2a4b1a9f6f35670cefe7d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.157478  4019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eae506e79ba348b3b1db60ecc6ae6714. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.162134  4149 consensus_queue.cc:260] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:52.176115  4089 tablet_service.cc:1511] Processing CreateTablet for tablet 08d6732bceef4220a670ac449347258b (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:13:52.177683  4089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08d6732bceef4220a670ac449347258b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.186859  4149 ts_tablet_manager.cc:1434] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.210s	user 0.005s	sys 0.004s
I20260709 13:13:52.188274  4149 tablet_bootstrap.cc:492] T 86669993fba94e65ba192aa115ed6e88 P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:13:52.189879  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:13:52.191761  3925 leader_election.cc:343] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:52.194061  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:52.194885  4108 raft_consensus.cc:2468] T b7e7a2dc30a24e5caaa3806c68b96c08 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 0.
I20260709 13:13:52.198849  3922 leader_election.cc:304] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:13:52.200431  4156 raft_consensus.cc:2804] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:52.200858  4156 raft_consensus.cc:493] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:52.201231  4156 raft_consensus.cc:3060] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.241837  4024 tablet_service.cc:1511] Processing CreateTablet for tablet 6b3254b26cc140fc8d2500e3e12dfaf4 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:13:52.246378  4149 tablet_bootstrap.cc:654] T 86669993fba94e65ba192aa115ed6e88 P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.253315  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:52.253949  4156 raft_consensus.cc:515] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:52.255766  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:52.256266  4024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b3254b26cc140fc8d2500e3e12dfaf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.242364  3943 tablet_service.cc:1511] Processing CreateTablet for tablet eae506e79ba348b3b1db60ecc6ae6714 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:13:52.268325  4092 tablet_service.cc:1511] Processing CreateTablet for tablet eae506e79ba348b3b1db60ecc6ae6714 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:13:52.271255  4148 tablet_bootstrap.cc:492] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:13:52.271626  4162 raft_consensus.cc:493] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.271894  4148 ts_tablet_manager.cc:1403] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.168s	user 0.024s	sys 0.046s
I20260709 13:13:52.272130  4162 raft_consensus.cc:515] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:52.274523  4162 leader_election.cc:290] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:52.274453  3948 tablet_service.cc:1511] Processing CreateTablet for tablet 6b3254b26cc140fc8d2500e3e12dfaf4 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:13:52.276311  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:52.277112  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:13:52.278407  4071 leader_election.cc:343] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:52.279417  4074 leader_election.cc:343] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:52.271283  3943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eae506e79ba348b3b1db60ecc6ae6714. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.283964  3948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b3254b26cc140fc8d2500e3e12dfaf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.285610  4093 tablet_service.cc:1511] Processing CreateTablet for tablet 6b3254b26cc140fc8d2500e3e12dfaf4 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:13:52.280097  4074 leader_election.cc:304] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:52.290177  4162 raft_consensus.cc:2749] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:52.291450  4156 leader_election.cc:290] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:52.292039  4156 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.292419  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:13:52.286295  4092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eae506e79ba348b3b1db60ecc6ae6714. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:13:52.294755  3925 leader_election.cc:343] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:52.299207  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:13:52.300153  4108 raft_consensus.cc:3060] T b7e7a2dc30a24e5caaa3806c68b96c08 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.308333  3947 tablet_service.cc:1511] Processing CreateTablet for tablet d672aa4b8b8e421ea43cee412d9da66a (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
W20260709 13:13:52.310376  3905 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:13:52.281800  3997 leader_election.cc:343] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:52.312546  4093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b3254b26cc140fc8d2500e3e12dfaf4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:13:52.323894  3997 leader_election.cc:343] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:52.281572  4148 raft_consensus.cc:359] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:52.324117  4017 tablet_service.cc:1511] Processing CreateTablet for tablet d672aa4b8b8e421ea43cee412d9da66a (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:13:52.324802  4148 raft_consensus.cc:385] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.313156  3947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d672aa4b8b8e421ea43cee412d9da66a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.326380  4148 raft_consensus.cc:740] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.329296  4150 tablet_bootstrap.cc:492] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:13:52.292470  4156 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:52.329849  4148 consensus_queue.cc:260] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:52.332168  4156 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:52.336918  4149 tablet_bootstrap.cc:492] T 86669993fba94e65ba192aa115ed6e88 P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:13:52.337006  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:52.337587  4149 ts_tablet_manager.cc:1403] T 86669993fba94e65ba192aa115ed6e88 P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.150s	user 0.011s	sys 0.021s
W20260709 13:13:52.338807  3925 leader_election.cc:343] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:52.326252  4017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d672aa4b8b8e421ea43cee412d9da66a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.341697  4108 raft_consensus.cc:2468] T b7e7a2dc30a24e5caaa3806c68b96c08 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 1.
I20260709 13:13:52.341639  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:52.342094  4149 raft_consensus.cc:359] T 86669993fba94e65ba192aa115ed6e88 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } }
I20260709 13:13:52.343030  4149 raft_consensus.cc:385] T 86669993fba94e65ba192aa115ed6e88 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.343364  4149 raft_consensus.cc:740] T 86669993fba94e65ba192aa115ed6e88 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.343742  3922 leader_election.cc:304] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:13:52.344172  4149 consensus_queue.cc:260] T 86669993fba94e65ba192aa115ed6e88 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } }
I20260709 13:13:52.345388  4156 raft_consensus.cc:2804] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:13:52.346119  3922 leader_election.cc:343] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:52.346771  4149 ts_tablet_manager.cc:1434] T 86669993fba94e65ba192aa115ed6e88 P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.006s
I20260709 13:13:52.346688  3922 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:13:52.329851  4150 ts_tablet_manager.cc:1403] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.336s	user 0.028s	sys 0.003s
I20260709 13:13:52.348749  4175 raft_consensus.cc:2749] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:52.353480  4150 raft_consensus.cc:359] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:52.354424  4150 raft_consensus.cc:385] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.354790  4150 raft_consensus.cc:740] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.355275  4019 tablet_service.cc:1511] Processing CreateTablet for tablet a55dd6943e7742738991bb00da84127e (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:13:52.356802  4019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a55dd6943e7742738991bb00da84127e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.357599  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:52.356596  4150 consensus_queue.cc:260] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:52.360545  4150 ts_tablet_manager.cc:1434] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:13:52.361585  4150 tablet_bootstrap.cc:492] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:13:52.350134  4148 ts_tablet_manager.cc:1434] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.078s	user 0.008s	sys 0.001s
I20260709 13:13:52.367332  4149 tablet_bootstrap.cc:492] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:13:52.367704  4148 tablet_bootstrap.cc:492] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:13:52.373649  4016 tablet_service.cc:1511] Processing CreateTablet for tablet 604474f002cb41eb9125fc14353547d2 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:13:52.375072  4016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 604474f002cb41eb9125fc14353547d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.375582  4148 tablet_bootstrap.cc:654] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.365759  4156 raft_consensus.cc:697] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:13:52.379457  4156 consensus_queue.cc:237] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:52.383898  3945 tablet_service.cc:1511] Processing CreateTablet for tablet 604474f002cb41eb9125fc14353547d2 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:13:52.383904  3946 tablet_service.cc:1511] Processing CreateTablet for tablet 9873af7d73cf49f3b2d74a17cf7cd3bf (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:13:52.385299  3945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 604474f002cb41eb9125fc14353547d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.385859  3946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9873af7d73cf49f3b2d74a17cf7cd3bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.399106  4149 tablet_bootstrap.cc:654] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.399850  4150 tablet_bootstrap.cc:654] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.412873  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:13:52.412482  3997 leader_election.cc:343] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:52.416601  3997 leader_election.cc:304] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:52.416481  3940 tablet_service.cc:1511] Processing CreateTablet for tablet a55dd6943e7742738991bb00da84127e (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
W20260709 13:13:52.417922  3997 leader_election.cc:343] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:52.418439  3997 leader_election.cc:304] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:52.418306  4089 tablet_service.cc:1511] Processing CreateTablet for tablet d672aa4b8b8e421ea43cee412d9da66a (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:13:52.419672  4089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d672aa4b8b8e421ea43cee412d9da66a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.419355  4098 tablet_service.cc:1511] Processing CreateTablet for tablet 604474f002cb41eb9125fc14353547d2 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:13:52.419795  4169 raft_consensus.cc:2749] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:52.420590  4098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 604474f002cb41eb9125fc14353547d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.417948  3940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a55dd6943e7742738991bb00da84127e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.417672  4097 tablet_service.cc:1511] Processing CreateTablet for tablet a55dd6943e7742738991bb00da84127e (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:13:52.423837  4097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a55dd6943e7742738991bb00da84127e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.425122  4020 tablet_service.cc:1511] Processing CreateTablet for tablet 9873af7d73cf49f3b2d74a17cf7cd3bf (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
W20260709 13:13:52.412436  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 66341.4us
I20260709 13:13:52.426474  4020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9873af7d73cf49f3b2d74a17cf7cd3bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.420567  4169 raft_consensus.cc:2749] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:52.431110  4095 tablet_service.cc:1511] Processing CreateTablet for tablet 9873af7d73cf49f3b2d74a17cf7cd3bf (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:13:52.432459  4095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9873af7d73cf49f3b2d74a17cf7cd3bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.442354  4148 tablet_bootstrap.cc:492] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:13:52.443133  4148 ts_tablet_manager.cc:1403] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.076s	user 0.013s	sys 0.003s
I20260709 13:13:52.458050  4024 tablet_service.cc:1511] Processing CreateTablet for tablet 6e863d888e2a4327a9127a43deb1f1b9 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:13:52.459579  4024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e863d888e2a4327a9127a43deb1f1b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.466391  3945 tablet_service.cc:1511] Processing CreateTablet for tablet 6e863d888e2a4327a9127a43deb1f1b9 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:13:52.467875  3945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e863d888e2a4327a9127a43deb1f1b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.469573  4148 raft_consensus.cc:359] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:52.470369  4148 raft_consensus.cc:385] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.470674  4148 raft_consensus.cc:740] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.476733  4177 raft_consensus.cc:493] T 86669993fba94e65ba192aa115ed6e88 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.480461  4177 raft_consensus.cc:515] T 86669993fba94e65ba192aa115ed6e88 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } }
I20260709 13:13:52.484175  4177 leader_election.cc:290] T 86669993fba94e65ba192aa115ed6e88 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:52.484359  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:52.486606  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:13:52.488289  3925 leader_election.cc:343] T 86669993fba94e65ba192aa115ed6e88 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:52.489467  3922 leader_election.cc:343] T 86669993fba94e65ba192aa115ed6e88 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:52.489923  3922 leader_election.cc:304] T 86669993fba94e65ba192aa115ed6e88 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:13:52.491142  4177 raft_consensus.cc:2749] T 86669993fba94e65ba192aa115ed6e88 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:52.491724  4148 consensus_queue.cc:260] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:52.500782  4150 tablet_bootstrap.cc:492] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:13:52.501336  4150 ts_tablet_manager.cc:1403] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.140s	user 0.014s	sys 0.002s
I20260709 13:13:52.504594  4148 ts_tablet_manager.cc:1434] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.003s
I20260709 13:13:52.505313  4149 tablet_bootstrap.cc:492] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:13:52.505769  4148 tablet_bootstrap.cc:492] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:13:52.505852  4149 ts_tablet_manager.cc:1403] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.139s	user 0.003s	sys 0.013s
I20260709 13:13:52.511626  4150 raft_consensus.cc:359] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:52.512391  4150 raft_consensus.cc:385] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.512717  4150 raft_consensus.cc:740] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.513445  4150 consensus_queue.cc:260] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:52.511439  4149 raft_consensus.cc:359] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:52.519284  4149 raft_consensus.cc:385] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.519703  4149 raft_consensus.cc:740] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.520483  4149 consensus_queue.cc:260] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:52.521788  4017 tablet_service.cc:1511] Processing CreateTablet for tablet f915c4d38c324e5990b58ac46421dfbc (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:13:52.524549  3946 tablet_service.cc:1511] Processing CreateTablet for tablet f915c4d38c324e5990b58ac46421dfbc (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:13:52.525475  4017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f915c4d38c324e5990b58ac46421dfbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.525050  3856 catalog_manager.cc:5697] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 0 to 1, leader changed from <none> to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:52.522949  4149 ts_tablet_manager.cc:1434] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.000s
I20260709 13:13:52.527918  4149 tablet_bootstrap.cc:492] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:13:52.526070  3946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f915c4d38c324e5990b58ac46421dfbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.531877  4156 raft_consensus.cc:493] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.532387  4156 raft_consensus.cc:515] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:52.532984  4150 ts_tablet_manager.cc:1434] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.031s	user 0.001s	sys 0.008s
I20260709 13:13:52.533244  4169 raft_consensus.cc:493] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.534106  4150 tablet_bootstrap.cc:492] T 0c7551e973324a21b094c1d2869495ac P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:13:52.533723  4169 raft_consensus.cc:515] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:52.536065  4169 leader_election.cc:290] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:52.536458  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:52.537887  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:13:52.539386  3925 leader_election.cc:343] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:52.539646  4148 tablet_bootstrap.cc:654] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.537487  4156 leader_election.cc:290] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:52.541508  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:52.541425  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:52.542270  4107 raft_consensus.cc:2468] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 0.
I20260709 13:13:52.526059  4098 tablet_service.cc:1511] Processing CreateTablet for tablet 6e863d888e2a4327a9127a43deb1f1b9 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
W20260709 13:13:52.543673  3997 leader_election.cc:343] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:52.548432  4098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e863d888e2a4327a9127a43deb1f1b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.553046  4092 tablet_service.cc:1511] Processing CreateTablet for tablet f915c4d38c324e5990b58ac46421dfbc (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:13:52.555063  4092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f915c4d38c324e5990b58ac46421dfbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.563561  3940 tablet_service.cc:1511] Processing CreateTablet for tablet 7ebbb84155f1455d87aab7fd5d78e3d8 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:13:52.565356  3940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ebbb84155f1455d87aab7fd5d78e3d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.574743  4148 tablet_bootstrap.cc:492] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:13:52.575412  4148 ts_tablet_manager.cc:1403] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.070s	user 0.012s	sys 0.000s
I20260709 13:13:52.576824  4150 tablet_bootstrap.cc:654] T 0c7551e973324a21b094c1d2869495ac P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.583285  3997 leader_election.cc:304] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
W20260709 13:13:52.583632  3922 leader_election.cc:343] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:52.584151  3922 leader_election.cc:304] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:13:52.584667  4169 raft_consensus.cc:2804] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:52.584388  4019 tablet_service.cc:1511] Processing CreateTablet for tablet 7ebbb84155f1455d87aab7fd5d78e3d8 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:13:52.585119  4169 raft_consensus.cc:493] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:52.585553  4169 raft_consensus.cc:3060] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.585880  4019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ebbb84155f1455d87aab7fd5d78e3d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.586952  4156 raft_consensus.cc:2749] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:52.582008  4149 tablet_bootstrap.cc:654] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.594487  4169 raft_consensus.cc:515] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:52.589115  4093 tablet_service.cc:1511] Processing CreateTablet for tablet 7ebbb84155f1455d87aab7fd5d78e3d8 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:13:52.579106  4148 raft_consensus.cc:359] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:52.598022  4093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ebbb84155f1455d87aab7fd5d78e3d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.598131  4148 raft_consensus.cc:385] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.598569  4148 raft_consensus.cc:740] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.605496  4150 tablet_bootstrap.cc:492] T 0c7551e973324a21b094c1d2869495ac P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:13:52.605821  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:13:52.606360  4150 ts_tablet_manager.cc:1403] T 0c7551e973324a21b094c1d2869495ac P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.072s	user 0.015s	sys 0.002s
W20260709 13:13:52.607806  3997 leader_election.cc:343] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:52.609059  4149 tablet_bootstrap.cc:492] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:13:52.609562  4149 ts_tablet_manager.cc:1403] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.082s	user 0.007s	sys 0.006s
I20260709 13:13:52.610216  4150 raft_consensus.cc:359] T 0c7551e973324a21b094c1d2869495ac P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:52.610896  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:13:52.611126  4150 raft_consensus.cc:385] T 0c7551e973324a21b094c1d2869495ac P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.611599  4150 raft_consensus.cc:740] T 0c7551e973324a21b094c1d2869495ac P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.611626  4108 raft_consensus.cc:3060] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.612660  4150 consensus_queue.cc:260] T 0c7551e973324a21b094c1d2869495ac P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:52.612807  4149 raft_consensus.cc:359] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:52.613956  4149 raft_consensus.cc:385] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.614296  3945 tablet_service.cc:1511] Processing CreateTablet for tablet 5e21bc17c8f64c43938a80f74620d90a (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:13:52.615492  4150 ts_tablet_manager.cc:1434] T 0c7551e973324a21b094c1d2869495ac P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:13:52.615643  3945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e21bc17c8f64c43938a80f74620d90a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.616703  4150 tablet_bootstrap.cc:492] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:13:52.622287  4108 raft_consensus.cc:2468] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 1.
I20260709 13:13:52.624202  4150 tablet_bootstrap.cc:654] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.623971  3997 leader_election.cc:304] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:52.624573  4019 tablet_service.cc:1511] Processing CreateTablet for tablet 5e21bc17c8f64c43938a80f74620d90a (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:13:52.625149  4157 raft_consensus.cc:2804] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:52.625995  4019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e21bc17c8f64c43938a80f74620d90a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.627872  4095 tablet_service.cc:1511] Processing CreateTablet for tablet 5e21bc17c8f64c43938a80f74620d90a (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:13:52.630052  4095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e21bc17c8f64c43938a80f74620d90a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.606007  4148 consensus_queue.cc:260] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:52.633826  4169 leader_election.cc:290] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:52.614279  4149 raft_consensus.cc:740] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.636407  4157 raft_consensus.cc:697] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:13:52.637504  4157 consensus_queue.cc:237] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:52.638247  4149 consensus_queue.cc:260] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:52.643879  4148 ts_tablet_manager.cc:1434] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.002s
I20260709 13:13:52.650416  4149 ts_tablet_manager.cc:1434] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.040s	user 0.001s	sys 0.008s
I20260709 13:13:52.658089  4148 tablet_bootstrap.cc:492] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:13:52.661731  3946 tablet_service.cc:1511] Processing CreateTablet for tablet f59fe7d824ba4030a574c8f7172dab57 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:13:52.662593  4017 tablet_service.cc:1511] Processing CreateTablet for tablet f59fe7d824ba4030a574c8f7172dab57 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:13:52.663300  3946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f59fe7d824ba4030a574c8f7172dab57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.664027  4017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f59fe7d824ba4030a574c8f7172dab57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.667805  4149 tablet_bootstrap.cc:492] T 21bc23345fdc47d2b7e9b8964749236e P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:13:52.675231  4150 tablet_bootstrap.cc:492] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:13:52.675798  4097 tablet_service.cc:1511] Processing CreateTablet for tablet f59fe7d824ba4030a574c8f7172dab57 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:13:52.677354  4097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f59fe7d824ba4030a574c8f7172dab57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.679915  4149 tablet_bootstrap.cc:654] T 21bc23345fdc47d2b7e9b8964749236e P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.675824  4150 ts_tablet_manager.cc:1403] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.059s	user 0.032s	sys 0.023s
I20260709 13:13:52.684392  4148 tablet_bootstrap.cc:654] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.696272  4150 raft_consensus.cc:359] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:52.697376  4150 raft_consensus.cc:385] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.697741  4150 raft_consensus.cc:740] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.702309  4019 tablet_service.cc:1511] Processing CreateTablet for tablet 5ba65f329a14453da0acb3230a4ac721 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:13:52.703420  4092 tablet_service.cc:1511] Processing CreateTablet for tablet 5ba65f329a14453da0acb3230a4ac721 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:13:52.698868  4150 consensus_queue.cc:260] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:52.704196  4019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ba65f329a14453da0acb3230a4ac721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.704730  4092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ba65f329a14453da0acb3230a4ac721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.713400  4024 tablet_service.cc:1511] Processing CreateTablet for tablet cd023a8b08e942db8236dd7bae557ca6 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:13:52.715250  4150 ts_tablet_manager.cc:1434] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.001s
I20260709 13:13:52.715382  4024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd023a8b08e942db8236dd7bae557ca6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.716588  4150 tablet_bootstrap.cc:492] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:13:52.717154  4098 tablet_service.cc:1511] Processing CreateTablet for tablet cd023a8b08e942db8236dd7bae557ca6 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:13:52.718709  4098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd023a8b08e942db8236dd7bae557ca6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.724102  3940 tablet_service.cc:1511] Processing CreateTablet for tablet 5ba65f329a14453da0acb3230a4ac721 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:13:52.724327  3945 tablet_service.cc:1511] Processing CreateTablet for tablet cd023a8b08e942db8236dd7bae557ca6 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:13:52.725714  3940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ba65f329a14453da0acb3230a4ac721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.728166  3945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd023a8b08e942db8236dd7bae557ca6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.726091  4162 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.735023  4162 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:52.736416  3944 tablet_service.cc:1511] Processing CreateTablet for tablet b820fbf0157d41e1b9205cc4eb1bb76c (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:13:52.738139  3944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b820fbf0157d41e1b9205cc4eb1bb76c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.769447  4149 tablet_bootstrap.cc:492] T 21bc23345fdc47d2b7e9b8964749236e P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:13:52.770109  4149 ts_tablet_manager.cc:1403] T 21bc23345fdc47d2b7e9b8964749236e P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.119s	user 0.019s	sys 0.030s
I20260709 13:13:52.769842  4020 tablet_service.cc:1511] Processing CreateTablet for tablet b820fbf0157d41e1b9205cc4eb1bb76c (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:13:52.771327  4020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b820fbf0157d41e1b9205cc4eb1bb76c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.772274  4150 tablet_bootstrap.cc:654] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.818190  4157 raft_consensus.cc:493] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.818801  4157 raft_consensus.cc:515] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:52.821368  4157 leader_election.cc:290] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:52.823212  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:52.824955  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:52.825837  4107 raft_consensus.cc:2393] T b7e7a2dc30a24e5caaa3806c68b96c08 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 1: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:13:52.827221  3997 leader_election.cc:304] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:52.828166  4157 raft_consensus.cc:3060] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.829809  4149 raft_consensus.cc:359] T 21bc23345fdc47d2b7e9b8964749236e P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:52.830571  4149 raft_consensus.cc:385] T 21bc23345fdc47d2b7e9b8964749236e P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.830862  4149 raft_consensus.cc:740] T 21bc23345fdc47d2b7e9b8964749236e P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.831353  4156 consensus_queue.cc:1048] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:52.843160  4162 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:52.842986  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:52.836561  4157 raft_consensus.cc:2749] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:52.849203  4034 raft_consensus.cc:2468] T 0c7551e973324a21b094c1d2869495ac P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 0.
I20260709 13:13:52.835856  4148 tablet_bootstrap.cc:492] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:13:52.850594  4148 ts_tablet_manager.cc:1403] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.193s	user 0.024s	sys 0.003s
I20260709 13:13:52.850652  4074 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:13:52.852979  4089 tablet_service.cc:1511] Processing CreateTablet for tablet b820fbf0157d41e1b9205cc4eb1bb76c (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:13:52.854791  4089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b820fbf0157d41e1b9205cc4eb1bb76c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.853721  4148 raft_consensus.cc:359] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } }
I20260709 13:13:52.860965  4148 raft_consensus.cc:385] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.854285  4149 consensus_queue.cc:260] T 21bc23345fdc47d2b7e9b8964749236e P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:52.861282  4148 raft_consensus.cc:740] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.848537  4196 raft_consensus.cc:493] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.862145  4196 raft_consensus.cc:515] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:52.866312  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:52.867002  4034 raft_consensus.cc:2468] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 0.
I20260709 13:13:52.868331  4074 leader_election.cc:304] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:13:52.869166  4196 leader_election.cc:290] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:52.869693  4196 raft_consensus.cc:2804] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:52.870046  4196 raft_consensus.cc:493] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:52.870447  4196 raft_consensus.cc:3060] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.873430  4149 ts_tablet_manager.cc:1434] T 21bc23345fdc47d2b7e9b8964749236e P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.103s	user 0.007s	sys 0.008s
I20260709 13:13:52.874289  4148 consensus_queue.cc:260] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } }
I20260709 13:13:52.875967  4149 tablet_bootstrap.cc:492] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:13:52.876708  4148 ts_tablet_manager.cc:1434] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:13:52.877732  4148 tablet_bootstrap.cc:492] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:13:52.878842  4196 raft_consensus.cc:515] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:52.844424  3855 catalog_manager.cc:5697] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 1 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:52.854696  4162 raft_consensus.cc:2804] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:52.883298  3948 tablet_service.cc:1511] Processing CreateTablet for tablet bd24fa3ec4ab41cabe4bcfae21f055f3 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:13:52.885393  4196 leader_election.cc:290] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:52.885800  3948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd24fa3ec4ab41cabe4bcfae21f055f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.887447  4149 tablet_bootstrap.cc:654] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.888849  4093 tablet_service.cc:1511] Processing CreateTablet for tablet bd24fa3ec4ab41cabe4bcfae21f055f3 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:13:52.890235  4093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd24fa3ec4ab41cabe4bcfae21f055f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.894517  4156 raft_consensus.cc:493] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.895149  4156 raft_consensus.cc:515] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:52.896405  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:13:52.897027  4034 raft_consensus.cc:3060] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.898685  4156 leader_election.cc:290] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:52.899379  4162 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:52.899821  4162 raft_consensus.cc:3060] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.900115  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:52.900478  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:13:52.902052  3925 leader_election.cc:343] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:52.902660  3922 leader_election.cc:343] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:52.903088  3922 leader_election.cc:304] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:13:52.905793  4095 tablet_service.cc:1511] Processing CreateTablet for tablet f9cefab1b91e4d728ddf2663bc49d316 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:13:52.906509  4156 raft_consensus.cc:2749] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:52.913125  4095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9cefab1b91e4d728ddf2663bc49d316. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.914599  4017 tablet_service.cc:1511] Processing CreateTablet for tablet f9cefab1b91e4d728ddf2663bc49d316 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:13:52.919008  4017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9cefab1b91e4d728ddf2663bc49d316. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.914579  4024 tablet_service.cc:1511] Processing CreateTablet for tablet bd24fa3ec4ab41cabe4bcfae21f055f3 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:13:52.923352  4150 tablet_bootstrap.cc:492] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:13:52.923903  4150 ts_tablet_manager.cc:1403] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.208s	user 0.017s	sys 0.000s
I20260709 13:13:52.924185  4024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd24fa3ec4ab41cabe4bcfae21f055f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.924070  3945 tablet_service.cc:1511] Processing CreateTablet for tablet f9cefab1b91e4d728ddf2663bc49d316 (DEFAULT_TABLE table=test-workload [id=8a2760e8528448a780fea6ccf25816cb]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:13:52.925228  3945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9cefab1b91e4d728ddf2663bc49d316. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.920533  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:52.928151  3959 raft_consensus.cc:2468] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 0.
I20260709 13:13:52.929840  4156 consensus_queue.cc:1048] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:52.936023  4148 tablet_bootstrap.cc:654] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.949414  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:52.953580  4162 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:52.927045  4150 raft_consensus.cc:359] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } }
I20260709 13:13:52.955756  4150 raft_consensus.cc:385] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.956092  4150 raft_consensus.cc:740] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.956691  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:13:52.956841  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:13:52.957461  4032 raft_consensus.cc:3060] T 0c7551e973324a21b094c1d2869495ac P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.955395  4162 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:13:52.968324  4071 leader_election.cc:343] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:52.971005  4032 raft_consensus.cc:2468] T 0c7551e973324a21b094c1d2869495ac P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:13:52.969208  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:13:52.972244  3958 raft_consensus.cc:3060] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.976994  4074 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
W20260709 13:13:52.979107  4071 leader_election.cc:343] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:52.982971  3958 raft_consensus.cc:2468] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:13:52.985344  4149 tablet_bootstrap.cc:492] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:13:52.985885  4149 ts_tablet_manager.cc:1403] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.110s	user 0.008s	sys 0.011s
I20260709 13:13:52.991987  4034 raft_consensus.cc:2468] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:13:52.988869  4150 consensus_queue.cc:260] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } }
I20260709 13:13:52.989955  4162 raft_consensus.cc:2804] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:52.993162  4074 leader_election.cc:304] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:52.994297  4194 raft_consensus.cc:2804] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:52.994432  4162 raft_consensus.cc:697] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:13:52.994602  4150 ts_tablet_manager.cc:1434] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.070s	user 0.007s	sys 0.000s
I20260709 13:13:52.994848  4194 raft_consensus.cc:697] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:13:52.995883  4150 tablet_bootstrap.cc:492] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:13:52.996025  4194 consensus_queue.cc:237] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:52.997112  4149 raft_consensus.cc:359] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:52.998006  4149 raft_consensus.cc:385] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.999599  4149 raft_consensus.cc:740] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.008622  4149 consensus_queue.cc:260] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.011768  4149 ts_tablet_manager.cc:1434] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.003s
I20260709 13:13:53.012540  4148 tablet_bootstrap.cc:492] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:13:53.020252  4148 ts_tablet_manager.cc:1403] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.143s	user 0.009s	sys 0.009s
I20260709 13:13:53.029822  4148 raft_consensus.cc:359] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.030418  4148 raft_consensus.cc:385] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.030658  4148 raft_consensus.cc:740] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.031177  4148 consensus_queue.cc:260] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.032588  4149 tablet_bootstrap.cc:492] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:13:53.032617  4162 consensus_queue.cc:237] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.037599  4150 tablet_bootstrap.cc:654] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.040498  4148 ts_tablet_manager.cc:1434] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:13:53.041790  4148 tablet_bootstrap.cc:492] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:13:53.043370  4149 tablet_bootstrap.cc:654] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.048017  4148 tablet_bootstrap.cc:654] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.050742  4149 tablet_bootstrap.cc:492] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:13:53.051384  4149 ts_tablet_manager.cc:1403] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.000s
I20260709 13:13:53.055189  4149 raft_consensus.cc:359] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.056182  4149 raft_consensus.cc:385] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.056535  4149 raft_consensus.cc:740] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.057417  4149 consensus_queue.cc:260] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.061031  4150 tablet_bootstrap.cc:492] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:13:53.061296  4148 tablet_bootstrap.cc:492] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:13:53.061435  4149 ts_tablet_manager.cc:1434] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:13:53.061568  4150 ts_tablet_manager.cc:1403] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.066s	user 0.011s	sys 0.000s
I20260709 13:13:53.061792  4148 ts_tablet_manager.cc:1403] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.009s
I20260709 13:13:53.062687  4149 tablet_bootstrap.cc:492] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:13:53.064561  4150 raft_consensus.cc:359] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.065286  4150 raft_consensus.cc:385] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.065562  4150 raft_consensus.cc:740] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.066334  4150 consensus_queue.cc:260] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.069800  4149 tablet_bootstrap.cc:654] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.068977  3855 catalog_manager.cc:5697] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 1 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:53.072003  4148 raft_consensus.cc:359] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.072710  4148 raft_consensus.cc:385] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.072995  4148 raft_consensus.cc:740] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.074129  4148 consensus_queue.cc:260] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.077153  4148 ts_tablet_manager.cc:1434] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:13:53.077471  4150 ts_tablet_manager.cc:1434] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:13:53.078387  4148 tablet_bootstrap.cc:492] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:13:53.081944  4150 tablet_bootstrap.cc:492] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:13:53.082656  4149 tablet_bootstrap.cc:492] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:13:53.083236  4149 ts_tablet_manager.cc:1403] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.007s
I20260709 13:13:53.085565  4148 tablet_bootstrap.cc:654] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.086318  4149 raft_consensus.cc:359] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.087427  4149 raft_consensus.cc:385] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.087809  4149 raft_consensus.cc:740] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.088578  4150 tablet_bootstrap.cc:654] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.088927  4149 consensus_queue.cc:260] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.095688  4149 ts_tablet_manager.cc:1434] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:13:53.096818  4149 tablet_bootstrap.cc:492] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:13:53.096230  3857 catalog_manager.cc:5697] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 1 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:53.104144  4149 tablet_bootstrap.cc:654] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.106024  4177 raft_consensus.cc:493] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.106706  4177 raft_consensus.cc:515] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.109521  4177 leader_election.cc:290] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:53.111199  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:53.111199  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:13:53.112936  3922 leader_election.cc:343] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:53.113466  3925 leader_election.cc:343] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:53.113924  3925 leader_election.cc:304] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:13:53.114629  4177 raft_consensus.cc:2749] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:53.118517  4150 tablet_bootstrap.cc:492] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:13:53.119659  4150 ts_tablet_manager.cc:1403] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.038s	user 0.017s	sys 0.019s
I20260709 13:13:53.119778  4148 tablet_bootstrap.cc:492] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:13:53.120535  4148 ts_tablet_manager.cc:1403] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.007s
I20260709 13:13:53.122078  4150 raft_consensus.cc:359] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.122643  4150 raft_consensus.cc:385] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.122920  4150 raft_consensus.cc:740] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.123827  4150 consensus_queue.cc:260] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.124254  4148 raft_consensus.cc:359] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.125188  4148 raft_consensus.cc:385] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.125537  4148 raft_consensus.cc:740] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.125756  4150 ts_tablet_manager.cc:1434] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.003s
I20260709 13:13:53.126672  4148 consensus_queue.cc:260] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.128573  4148 ts_tablet_manager.cc:1434] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:13:53.128677  4149 tablet_bootstrap.cc:492] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:13:53.129091  4149 ts_tablet_manager.cc:1403] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.007s
I20260709 13:13:53.129930  4148 tablet_bootstrap.cc:492] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:13:53.132006  4149 raft_consensus.cc:359] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.132731  4149 raft_consensus.cc:385] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.133008  4150 tablet_bootstrap.cc:492] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:13:53.133052  4149 raft_consensus.cc:740] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.134066  4149 consensus_queue.cc:260] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.136381  4148 tablet_bootstrap.cc:654] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.140286  4150 tablet_bootstrap.cc:654] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.140494  4149 ts_tablet_manager.cc:1434] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:13:53.141906  4149 tablet_bootstrap.cc:492] T 1851e462889842a49d577d585d278117 P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:13:53.146414  4177 raft_consensus.cc:493] T 21bc23345fdc47d2b7e9b8964749236e P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.147189  4177 raft_consensus.cc:515] T 21bc23345fdc47d2b7e9b8964749236e P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.151510  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:53.156152  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:53.157357  4107 raft_consensus.cc:2393] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 1: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:13:53.159080  3922 leader_election.cc:304] T 21bc23345fdc47d2b7e9b8964749236e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:13:53.160434  4156 raft_consensus.cc:3060] T 21bc23345fdc47d2b7e9b8964749236e P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.167703  4177 leader_election.cc:290] T 21bc23345fdc47d2b7e9b8964749236e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:53.175406  4156 raft_consensus.cc:2749] T 21bc23345fdc47d2b7e9b8964749236e P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:53.178017  4148 tablet_bootstrap.cc:492] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:13:53.178393  4150 tablet_bootstrap.cc:492] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:13:53.178576  4148 ts_tablet_manager.cc:1403] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.049s	user 0.025s	sys 0.020s
I20260709 13:13:53.179243  4149 tablet_bootstrap.cc:654] T 1851e462889842a49d577d585d278117 P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.178877  4150 ts_tablet_manager.cc:1403] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.046s	user 0.029s	sys 0.012s
I20260709 13:13:53.182655  4148 raft_consensus.cc:359] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.182798  4157 consensus_queue.cc:1048] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:53.183468  4148 raft_consensus.cc:385] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.183877  4148 raft_consensus.cc:740] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.183686  4150 raft_consensus.cc:359] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.184531  4150 raft_consensus.cc:385] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.184834  4150 raft_consensus.cc:740] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.184635  4148 consensus_queue.cc:260] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.185614  4150 consensus_queue.cc:260] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.186758  4148 ts_tablet_manager.cc:1434] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:13:53.187655  4150 ts_tablet_manager.cc:1434] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:53.188601  4150 tablet_bootstrap.cc:492] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:13:53.190223  4148 tablet_bootstrap.cc:492] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:13:53.197741  4148 tablet_bootstrap.cc:654] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.200781  4150 tablet_bootstrap.cc:654] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.202648  4157 consensus_queue.cc:1048] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:53.231377  4150 tablet_bootstrap.cc:492] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:13:53.231922  4150 ts_tablet_manager.cc:1403] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.008s
I20260709 13:13:53.235365  4150 raft_consensus.cc:359] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.236083  4150 raft_consensus.cc:385] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.236362  4150 raft_consensus.cc:740] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.236982  4150 consensus_queue.cc:260] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.238927  4150 ts_tablet_manager.cc:1434] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:53.239830  4150 tablet_bootstrap.cc:492] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:13:53.245775  4150 tablet_bootstrap.cc:654] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.258364  4150 tablet_bootstrap.cc:492] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:13:53.258912  4150 ts_tablet_manager.cc:1403] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.007s
I20260709 13:13:53.262006  4150 raft_consensus.cc:359] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.262671  4150 raft_consensus.cc:385] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.262920  4150 raft_consensus.cc:740] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.263652  4150 consensus_queue.cc:260] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.264523  4162 raft_consensus.cc:493] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.265765  4162 raft_consensus.cc:515] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.266805  4150 ts_tablet_manager.cc:1434] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:13:53.268271  4150 tablet_bootstrap.cc:492] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:13:53.268391  4156 raft_consensus.cc:493] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.268865  4156 raft_consensus.cc:515] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.269747  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:53.270545  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:53.270890  4156 leader_election.cc:290] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:53.271212  4033 raft_consensus.cc:2468] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 0.
I20260709 13:13:53.275211  4150 tablet_bootstrap.cc:654] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.278187  4162 leader_election.cc:290] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:13:53.271111  4071 leader_election.cc:343] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:53.279052  4074 leader_election.cc:304] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:53.274049  4220 raft_consensus.cc:493] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.272557  4148 tablet_bootstrap.cc:492] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:13:53.280071  4220 raft_consensus.cc:515] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.280959  4148 ts_tablet_manager.cc:1403] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.091s	user 0.020s	sys 0.041s
I20260709 13:13:53.281318  4149 tablet_bootstrap.cc:492] T 1851e462889842a49d577d585d278117 P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:13:53.281867  4149 ts_tablet_manager.cc:1403] T 1851e462889842a49d577d585d278117 P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.140s	user 0.016s	sys 0.026s
I20260709 13:13:53.282477  4220 leader_election.cc:290] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:53.272480  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:53.283947  4148 raft_consensus.cc:359] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.284387  4162 raft_consensus.cc:2804] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:53.284787  4162 raft_consensus.cc:493] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:53.285290  4162 raft_consensus.cc:3060] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.284639  4149 raft_consensus.cc:359] T 1851e462889842a49d577d585d278117 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.285789  4149 raft_consensus.cc:385] T 1851e462889842a49d577d585d278117 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.286187  4149 raft_consensus.cc:740] T 1851e462889842a49d577d585d278117 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.284662  4148 raft_consensus.cc:385] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.287322  4148 raft_consensus.cc:740] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.290380  4148 consensus_queue.cc:260] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.288398  4149 consensus_queue.cc:260] T 1851e462889842a49d577d585d278117 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.273782  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:53.292109  4034 raft_consensus.cc:2468] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 0.
I20260709 13:13:53.293565  3925 leader_election.cc:304] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:13:53.294495  4156 raft_consensus.cc:2804] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:53.294878  4156 raft_consensus.cc:493] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:53.295207  4156 raft_consensus.cc:3060] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.287775  4107 raft_consensus.cc:2468] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 0.
I20260709 13:13:53.300760  4148 ts_tablet_manager.cc:1434] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:13:53.302655  4148 tablet_bootstrap.cc:492] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:13:53.303011  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:53.301352  4149 ts_tablet_manager.cc:1434] T 1851e462889842a49d577d585d278117 P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.002s
I20260709 13:13:53.306737  4194 raft_consensus.cc:493] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.307263  4194 raft_consensus.cc:515] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } }
I20260709 13:13:53.309535  4194 leader_election.cc:290] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:53.311353  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:53.312055  4034 raft_consensus.cc:2468] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 0.
I20260709 13:13:53.312292  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:53.313375  4074 leader_election.cc:304] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
W20260709 13:13:53.313673  3905 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:53.314355  4194 raft_consensus.cc:2804] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:53.314705  4194 raft_consensus.cc:493] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:53.315085  4194 raft_consensus.cc:3060] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.315277  4149 tablet_bootstrap.cc:492] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:13:53.318186  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:53.318848  3958 raft_consensus.cc:2468] T 86669993fba94e65ba192aa115ed6e88 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 0.
W20260709 13:13:53.319029  3997 leader_election.cc:343] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:53.319752  3997 leader_election.cc:343] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:53.320214  3997 leader_election.cc:304] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:53.321321  4220 raft_consensus.cc:2749] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:53.325505  4149 tablet_bootstrap.cc:654] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.327236  4148 tablet_bootstrap.cc:654] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.333549  4194 raft_consensus.cc:515] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } }
I20260709 13:13:53.336826  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:13:53.327366  4156 raft_consensus.cc:515] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.337461  3958 raft_consensus.cc:3060] T 86669993fba94e65ba192aa115ed6e88 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.337647  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:13:53.338258  4034 raft_consensus.cc:3060] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.340700  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:13:53.341507  4033 raft_consensus.cc:3060] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.345621  4034 raft_consensus.cc:2468] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:13:53.346871  4074 leader_election.cc:304] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:13:53.346764  4162 raft_consensus.cc:515] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.347783  4196 raft_consensus.cc:2804] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:53.350184  4033 raft_consensus.cc:2468] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 1.
I20260709 13:13:53.352908  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:13:53.355336  4194 leader_election.cc:290] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:53.355763  4107 raft_consensus.cc:3060] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.357343  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:13:53.355351  4156 leader_election.cc:290] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:53.357995  3959 raft_consensus.cc:3060] T 1851e462889842a49d577d585d278117 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.363413  4196 raft_consensus.cc:697] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:13:53.364790  4196 consensus_queue.cc:237] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } }
I20260709 13:13:53.366950  3925 leader_election.cc:304] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:13:53.368294  4156 raft_consensus.cc:2804] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:53.368573  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:13:53.369378  4156 raft_consensus.cc:697] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:13:53.371861  4162 leader_election.cc:290] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:53.371464  4156 consensus_queue.cc:237] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.354317  3958 raft_consensus.cc:2468] T 86669993fba94e65ba192aa115ed6e88 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:13:53.369477  4034 raft_consensus.cc:3060] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.380053  3959 raft_consensus.cc:2468] T 1851e462889842a49d577d585d278117 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:13:53.381418  4071 leader_election.cc:304] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:13:53.383023  4225 raft_consensus.cc:2804] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:53.354974  4149 tablet_bootstrap.cc:492] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:13:53.383992  4149 ts_tablet_manager.cc:1403] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.069s	user 0.017s	sys 0.000s
I20260709 13:13:53.388672  4034 raft_consensus.cc:2468] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:13:53.389722  4148 tablet_bootstrap.cc:492] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:13:53.385032  4107 raft_consensus.cc:2468] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 1.
I20260709 13:13:53.386140  3855 catalog_manager.cc:5697] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 1 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:53.390242  4148 ts_tablet_manager.cc:1403] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.088s	user 0.015s	sys 0.000s
I20260709 13:13:53.388088  4225 raft_consensus.cc:697] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:13:53.391249  4225 consensus_queue.cc:237] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.395231  4196 consensus_queue.cc:1048] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:53.414034  4220 raft_consensus.cc:493] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.414636  4220 raft_consensus.cc:515] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.420073  4196 raft_consensus.cc:493] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.420811  4196 raft_consensus.cc:515] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.424947  4162 raft_consensus.cc:493] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.425635  4162 raft_consensus.cc:515] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.446039  4220 leader_election.cc:290] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:53.446830  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:53.447279  4150 tablet_bootstrap.cc:492] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:13:53.447904  4150 ts_tablet_manager.cc:1403] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.180s	user 0.050s	sys 0.079s
I20260709 13:13:53.448408  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:13:53.448573  4071 leader_election.cc:343] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:53.449558  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:13:53.451135  3997 leader_election.cc:343] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:53.451040  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:53.451714  4162 leader_election.cc:290] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:13:53.452566  3997 leader_election.cc:343] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:53.452641  4071 leader_election.cc:343] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:53.453047  3997 leader_election.cc:304] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:53.453280  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:53.453933  4220 raft_consensus.cc:2749] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:53.453941  4033 raft_consensus.cc:2468] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 0.
I20260709 13:13:53.455037  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:53.450891  4196 leader_election.cc:290] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:53.455703  4032 raft_consensus.cc:2468] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 0.
I20260709 13:13:53.457365  4148 raft_consensus.cc:359] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.458078  4148 raft_consensus.cc:385] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.457711  4150 raft_consensus.cc:359] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.458352  4148 raft_consensus.cc:740] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.458513  4150 raft_consensus.cc:385] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.458884  4150 raft_consensus.cc:740] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.459091  4148 consensus_queue.cc:260] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.459671  4150 consensus_queue.cc:260] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.461431  4148 ts_tablet_manager.cc:1434] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.071s	user 0.018s	sys 0.006s
I20260709 13:13:53.461663  4150 ts_tablet_manager.cc:1434] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:13:53.462352  4148 tablet_bootstrap.cc:492] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:13:53.462512  4150 tablet_bootstrap.cc:492] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:13:53.462379  3856 catalog_manager.cc:5697] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 0 to 1, leader changed from <none> to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:53.464334  4074 leader_election.cc:304] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:53.465605  4074 leader_election.cc:304] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:53.467072  4162 raft_consensus.cc:2804] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:53.467465  4162 raft_consensus.cc:493] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:53.467760  4194 raft_consensus.cc:2804] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:53.468262  4194 raft_consensus.cc:493] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:53.468619  4194 raft_consensus.cc:3060] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.469262  4150 tablet_bootstrap.cc:654] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.468899  4149 raft_consensus.cc:359] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.469578  4149 raft_consensus.cc:385] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.469878  4149 raft_consensus.cc:740] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.471796  4149 consensus_queue.cc:260] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.483297  4194 raft_consensus.cc:515] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.486424  4194 leader_election.cc:290] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:53.467834  4162 raft_consensus.cc:3060] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.493352  4177 raft_consensus.cc:493] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.493918  4177 raft_consensus.cc:515] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.496241  4177 leader_election.cc:290] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:53.496464  4225 raft_consensus.cc:493] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.497123  4225 raft_consensus.cc:515] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.498083  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:53.499281  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:53.500401  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:13:53.500830  4225 leader_election.cc:290] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:53.501040  4034 raft_consensus.cc:3060] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:53.504331  3922 leader_election.cc:343] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:53.504758  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:53.504516  4162 raft_consensus.cc:515] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.505378  4033 raft_consensus.cc:2468] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 0.
I20260709 13:13:53.506124  4148 tablet_bootstrap.cc:654] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:53.506387  3925 leader_election.cc:343] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:53.506847  3925 leader_election.cc:304] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:13:53.507876  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:13:53.508431  4156 raft_consensus.cc:493] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.508924  4156 raft_consensus.cc:515] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.513200  4162 leader_election.cc:290] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:53.512979  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:53.512809  3856 catalog_manager.cc:5697] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 1 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:53.514989  4074 leader_election.cc:304] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:13:53.516883  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:53.517571  4108 raft_consensus.cc:2468] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 0.
W20260709 13:13:53.517810  3925 leader_election.cc:343] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:53.517768  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:13:53.518611  4033 raft_consensus.cc:3060] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.518769  3922 leader_election.cc:304] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:13:53.518579  4177 raft_consensus.cc:2749] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:53.521116  4177 raft_consensus.cc:2804] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:53.521453  4177 raft_consensus.cc:493] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:53.521785  4177 raft_consensus.cc:3060] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.516990  4233 raft_consensus.cc:2804] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:53.526453  4233 raft_consensus.cc:493] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:53.526855  4233 raft_consensus.cc:3060] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.527667  4156 leader_election.cc:290] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:53.505378  4150 tablet_bootstrap.cc:492] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
W20260709 13:13:53.528646  4071 consensus_peers.cc:597] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:53.528855  4150 ts_tablet_manager.cc:1403] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.067s	user 0.010s	sys 0.022s
W20260709 13:13:53.529500  4071 leader_election.cc:343] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:53.530508  4225 consensus_queue.cc:1048] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:53.534507  4034 raft_consensus.cc:2468] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:13:53.536226  4150 raft_consensus.cc:359] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.536603  4074 leader_election.cc:304] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:53.536962  4150 raft_consensus.cc:385] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.537266  4150 raft_consensus.cc:740] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.537428  4225 raft_consensus.cc:2804] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:53.494328  4149 ts_tablet_manager.cc:1434] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.105s	user 0.006s	sys 0.000s
I20260709 13:13:53.537921  4225 raft_consensus.cc:697] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:13:53.538697  4149 tablet_bootstrap.cc:492] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:13:53.538817  4225 consensus_queue.cc:237] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.541846  4150 consensus_queue.cc:260] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.543023  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:53.543682  3959 raft_consensus.cc:2468] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 0.
I20260709 13:13:53.544631  4150 ts_tablet_manager.cc:1434] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:13:53.544966  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:13:53.545842  4150 tablet_bootstrap.cc:492] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
W20260709 13:13:53.550226  4071 leader_election.cc:343] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:53.558789  4149 tablet_bootstrap.cc:654] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.564224  4150 tablet_bootstrap.cc:654] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.565495  4033 raft_consensus.cc:2468] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:13:53.566902  4074 leader_election.cc:304] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:53.568188  4225 raft_consensus.cc:2804] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:53.568749  4225 raft_consensus.cc:697] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:13:53.569645  4225 consensus_queue.cc:237] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.569559  3856 catalog_manager.cc:5697] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 1 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:53.584408  4148 tablet_bootstrap.cc:492] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:13:53.584965  4148 ts_tablet_manager.cc:1403] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.123s	user 0.019s	sys 0.006s
I20260709 13:13:53.588200  4148 raft_consensus.cc:359] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.588971  4148 raft_consensus.cc:385] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.589365  4148 raft_consensus.cc:740] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.590188  4148 consensus_queue.cc:260] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.592476  4148 ts_tablet_manager.cc:1434] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:53.592214  4194 consensus_queue.cc:1048] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:53.593547  4148 tablet_bootstrap.cc:492] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:13:53.597857  4235 raft_consensus.cc:493] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.598697  4235 raft_consensus.cc:515] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.601276  4235 leader_election.cc:290] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:53.604665  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:13:53.607764  3922 leader_election.cc:343] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:53.563257  4233 raft_consensus.cc:515] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.608597  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:53.558897  4177 raft_consensus.cc:515] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.614866  4177 leader_election.cc:290] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:53.615628  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:13:53.615906  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:13:53.622655  4108 raft_consensus.cc:3060] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.624431  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:13:53.623533  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:13:53.625114  4032 raft_consensus.cc:3060] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:53.625936  3925 leader_election.cc:343] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:53.625238  3856 catalog_manager.cc:5697] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 1 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:53.630084  4108 raft_consensus.cc:2468] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 1.
I20260709 13:13:53.616603  4233 leader_election.cc:290] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:53.635505  3922 leader_election.cc:304] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:13:53.630693  3959 raft_consensus.cc:3060] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.621803  4148 tablet_bootstrap.cc:654] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.609730  4033 raft_consensus.cc:2468] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 0.
I20260709 13:13:53.639576  4177 raft_consensus.cc:2804] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:53.641207  3925 leader_election.cc:304] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:13:53.642083  4235 raft_consensus.cc:2804] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:53.642277  4150 tablet_bootstrap.cc:492] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:13:53.642486  4235 raft_consensus.cc:493] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:53.639271  4032 raft_consensus.cc:2468] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:13:53.642915  4150 ts_tablet_manager.cc:1403] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.097s	user 0.039s	sys 0.024s
I20260709 13:13:53.642854  4235 raft_consensus.cc:3060] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.645470  4177 raft_consensus.cc:697] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:13:53.646037  4150 raft_consensus.cc:359] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.647053  4150 raft_consensus.cc:385] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.647408  4150 raft_consensus.cc:740] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.648106  4150 consensus_queue.cc:260] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.648655  4177 consensus_queue.cc:237] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.650310  4150 ts_tablet_manager.cc:1434] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.004s
I20260709 13:13:53.648130  4149 tablet_bootstrap.cc:492] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:13:53.650979  4149 ts_tablet_manager.cc:1403] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.112s	user 0.023s	sys 0.025s
I20260709 13:13:53.651295  4150 tablet_bootstrap.cc:492] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:13:53.654186  4149 raft_consensus.cc:359] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.654850  4149 raft_consensus.cc:385] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.655074  4149 raft_consensus.cc:740] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.654189  4235 raft_consensus.cc:515] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.656837  4074 leader_election.cc:304] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:13:53.656342  3959 raft_consensus.cc:2468] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:13:53.657697  4233 raft_consensus.cc:2804] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:53.658223  4233 raft_consensus.cc:697] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:13:53.659024  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:13:53.659153  4233 consensus_queue.cc:237] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.659718  4032 raft_consensus.cc:3060] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.661520  4150 tablet_bootstrap.cc:654] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.662041  4149 consensus_queue.cc:260] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.664074  4235 leader_election.cc:290] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:53.665831  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
W20260709 13:13:53.667804  3922 leader_election.cc:343] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:53.669962  4032 raft_consensus.cc:2468] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 1.
I20260709 13:13:53.676635  3925 leader_election.cc:304] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:13:53.679591  4235 raft_consensus.cc:2804] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:53.680294  4235 raft_consensus.cc:697] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:13:53.680615  4148 tablet_bootstrap.cc:492] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:13:53.681113  4148 ts_tablet_manager.cc:1403] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.088s	user 0.006s	sys 0.012s
I20260709 13:13:53.681156  4235 consensus_queue.cc:237] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.685954  4148 raft_consensus.cc:359] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.686833  4148 raft_consensus.cc:385] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.687100  4148 raft_consensus.cc:740] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.688455  4148 consensus_queue.cc:260] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.690441  4149 ts_tablet_manager.cc:1434] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.002s
I20260709 13:13:53.691082  4148 ts_tablet_manager.cc:1434] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.002s
I20260709 13:13:53.692158  4148 tablet_bootstrap.cc:492] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:13:53.691475  4149 tablet_bootstrap.cc:492] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:13:53.699332  4148 tablet_bootstrap.cc:654] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.711270  4225 raft_consensus.cc:493] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.712098  4225 raft_consensus.cc:515] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.716877  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:53.715523  3856 catalog_manager.cc:5697] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 0 to 1, leader changed from <none> to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:53.719440  4071 leader_election.cc:343] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:53.722517  4225 leader_election.cc:290] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:53.722779  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:13:53.724517  4074 leader_election.cc:343] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:53.725172  4150 tablet_bootstrap.cc:492] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:13:53.725033  4074 leader_election.cc:304] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:53.725783  4150 ts_tablet_manager.cc:1403] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.075s	user 0.036s	sys 0.032s
I20260709 13:13:53.728087  4149 tablet_bootstrap.cc:654] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.728928  4150 raft_consensus.cc:359] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.729789  4150 raft_consensus.cc:385] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.730125  4150 raft_consensus.cc:740] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.731000  4150 consensus_queue.cc:260] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.731297  3855 catalog_manager.cc:5697] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 1 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:53.734444  4225 raft_consensus.cc:2749] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:53.737066  4150 ts_tablet_manager.cc:1434] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:13:53.738090  4150 tablet_bootstrap.cc:492] T f4845eaa52cb4965b9c8922f37e2f606 P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:13:53.746305  4150 tablet_bootstrap.cc:654] T f4845eaa52cb4965b9c8922f37e2f606 P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.749392  4148 tablet_bootstrap.cc:492] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:13:53.749864  4148 ts_tablet_manager.cc:1403] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.058s	user 0.024s	sys 0.022s
I20260709 13:13:53.753793  4233 raft_consensus.cc:493] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.754552  4233 raft_consensus.cc:515] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.756536  3856 catalog_manager.cc:5697] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 0 to 1, leader changed from <none> to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:53.757735  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:53.758388  4149 tablet_bootstrap.cc:492] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:13:53.758873  4149 ts_tablet_manager.cc:1403] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.068s	user 0.018s	sys 0.001s
I20260709 13:13:53.758592  3959 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 0.
I20260709 13:13:53.760191  4071 leader_election.cc:304] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:13:53.761497  4148 raft_consensus.cc:359] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.762220  4148 raft_consensus.cc:385] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.762493  4148 raft_consensus.cc:740] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.763090  4225 raft_consensus.cc:2804] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:53.763222  4233 leader_election.cc:290] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:53.763502  4225 raft_consensus.cc:493] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:53.763933  4225 raft_consensus.cc:3060] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.763787  4148 consensus_queue.cc:260] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.764334  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:53.765592  4233 raft_consensus.cc:493] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:53.765750  4074 leader_election.cc:343] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:53.766491  4233 raft_consensus.cc:515] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.768597  4148 ts_tablet_manager.cc:1434] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.002s
I20260709 13:13:53.769541  4148 tablet_bootstrap.cc:492] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:13:53.770859  4149 raft_consensus.cc:359] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.771514  4149 raft_consensus.cc:385] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.773061  4149 raft_consensus.cc:740] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.774134  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:53.774578  4149 consensus_queue.cc:260] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:13:53.775449  4071 leader_election.cc:343] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:53.776685  4148 tablet_bootstrap.cc:654] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.777617  4233 leader_election.cc:290] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:53.777872  4150 tablet_bootstrap.cc:492] T f4845eaa52cb4965b9c8922f37e2f606 P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:13:53.778393  4150 ts_tablet_manager.cc:1403] T f4845eaa52cb4965b9c8922f37e2f606 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.040s	user 0.017s	sys 0.000s
I20260709 13:13:53.778801  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:53.779708  4032 raft_consensus.cc:2468] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 0.
I20260709 13:13:53.780179  4149 ts_tablet_manager.cc:1434] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.019s	user 0.001s	sys 0.006s
I20260709 13:13:53.777240  4225 raft_consensus.cc:515] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.781152  4149 tablet_bootstrap.cc:492] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:13:53.781095  4074 leader_election.cc:304] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:53.782361  4233 raft_consensus.cc:2804] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:53.782754  4233 raft_consensus.cc:493] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:53.783120  4233 raft_consensus.cc:3060] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.784523  4150 raft_consensus.cc:359] T f4845eaa52cb4965b9c8922f37e2f606 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.786707  4150 raft_consensus.cc:385] T f4845eaa52cb4965b9c8922f37e2f606 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.787036  4150 raft_consensus.cc:740] T f4845eaa52cb4965b9c8922f37e2f606 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.788113  4149 tablet_bootstrap.cc:654] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.787786  4150 consensus_queue.cc:260] T f4845eaa52cb4965b9c8922f37e2f606 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.790266  4150 ts_tablet_manager.cc:1434] T f4845eaa52cb4965b9c8922f37e2f606 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:13:53.792153  4150 tablet_bootstrap.cc:492] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:13:53.796936  4162 raft_consensus.cc:493] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.797513  4162 raft_consensus.cc:515] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.799948  4162 leader_election.cc:290] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:53.803579  4233 raft_consensus.cc:515] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.804529  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:13:53.806864  4071 leader_election.cc:343] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:53.808228  4233 leader_election.cc:290] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:53.808600  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:13:53.810056  4150 tablet_bootstrap.cc:654] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:53.810505  4071 leader_election.cc:343] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:53.811683  4149 tablet_bootstrap.cc:492] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:13:53.812214  4149 ts_tablet_manager.cc:1403] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.013s
I20260709 13:13:53.814008  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:53.814867  4032 raft_consensus.cc:2468] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 0.
I20260709 13:13:53.816279  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:13:53.816186  4149 raft_consensus.cc:359] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.817166  4033 raft_consensus.cc:3060] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.817286  4149 raft_consensus.cc:385] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.817768  4149 raft_consensus.cc:740] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.818832  4149 consensus_queue.cc:260] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.821518  4149 ts_tablet_manager.cc:1434] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:13:53.821872  4074 leader_election.cc:304] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:53.822777  4149 tablet_bootstrap.cc:492] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:13:53.823071  4233 raft_consensus.cc:2804] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:53.823571  4233 raft_consensus.cc:493] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:53.824030  4233 raft_consensus.cc:3060] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.831050  4149 tablet_bootstrap.cc:654] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.832619  4177 consensus_queue.cc:1048] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:53.844610  4149 tablet_bootstrap.cc:492] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:13:53.845299  4149 ts_tablet_manager.cc:1403] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.012s
I20260709 13:13:53.846055  4162 consensus_queue.cc:1048] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:53.849020  4149 raft_consensus.cc:359] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.849797  4149 raft_consensus.cc:385] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.850076  4149 raft_consensus.cc:740] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.850936  4149 consensus_queue.cc:260] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.852918  4162 raft_consensus.cc:493] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.853511  4149 ts_tablet_manager.cc:1434] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:13:53.853555  4162 raft_consensus.cc:515] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.854620  4149 tablet_bootstrap.cc:492] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:13:53.861236  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:53.862222  3958 raft_consensus.cc:2468] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 0.
I20260709 13:13:53.863834  4071 leader_election.cc:304] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:13:53.864878  4231 raft_consensus.cc:2804] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:53.865236  4231 raft_consensus.cc:493] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:53.865346  4162 leader_election.cc:290] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:53.865640  4231 raft_consensus.cc:3060] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.870630  4156 consensus_queue.cc:1048] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:53.873101  4149 tablet_bootstrap.cc:654] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.873450  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:53.874168  4032 raft_consensus.cc:2468] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 0.
I20260709 13:13:53.873977  4231 raft_consensus.cc:515] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.877478  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:13:53.878286  3959 raft_consensus.cc:3060] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.881949  4231 leader_election.cc:290] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:53.886912  4231 consensus_queue.cc:1048] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:53.888873  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:13:53.896073  4032 raft_consensus.cc:3060] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.899760  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:13:53.902766  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:13:53.930539  3958 raft_consensus.cc:3060] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:53.931650  4074 leader_election.cc:343] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:53.919938  4149 tablet_bootstrap.cc:492] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:13:53.932952  4149 ts_tablet_manager.cc:1403] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.079s	user 0.017s	sys 0.019s
I20260709 13:13:53.921463  3959 raft_consensus.cc:2468] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:13:53.917362  4225 leader_election.cc:290] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:53.934813  4071 leader_election.cc:304] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:13:53.935743  4225 raft_consensus.cc:2804] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:53.936282  4148 tablet_bootstrap.cc:492] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:13:53.936236  4225 raft_consensus.cc:697] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:13:53.923893  4033 raft_consensus.cc:2468] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:13:53.893384  4233 raft_consensus.cc:515] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.936877  4148 ts_tablet_manager.cc:1403] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.168s	user 0.049s	sys 0.057s
I20260709 13:13:53.937467  4225 consensus_queue.cc:237] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.939051  4150 tablet_bootstrap.cc:492] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:13:53.942255  3958 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:13:53.942898  4150 ts_tablet_manager.cc:1403] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.151s	user 0.020s	sys 0.023s
I20260709 13:13:53.943019  4074 leader_election.cc:304] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:53.943746  4071 leader_election.cc:304] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:13:53.944729  4196 raft_consensus.cc:2804] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:53.944970  4231 raft_consensus.cc:2804] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:53.945250  4196 raft_consensus.cc:697] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:13:53.945515  4231 raft_consensus.cc:697] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:13:53.946141  4196 consensus_queue.cc:237] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.946393  4231 consensus_queue.cc:237] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.949285  4162 consensus_queue.cc:1048] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:53.949747  4233 leader_election.cc:290] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:53.952279  4148 raft_consensus.cc:359] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.952723  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:13:53.953014  4148 raft_consensus.cc:385] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.953310  4031 raft_consensus.cc:3060] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.936976  4149 raft_consensus.cc:359] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.954367  4149 raft_consensus.cc:385] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.954973  4149 raft_consensus.cc:740] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.955720  4150 raft_consensus.cc:359] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.961887  4150 raft_consensus.cc:385] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.962213  4150 raft_consensus.cc:740] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.954942  4032 raft_consensus.cc:2468] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:13:53.959721  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:13:53.961143  4194 consensus_queue.cc:1048] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:53.964089  4156 raft_consensus.cc:493] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.964766  4156 raft_consensus.cc:515] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.956964  4149 consensus_queue.cc:260] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.967062  4156 leader_election.cc:290] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:53.964294  3956 raft_consensus.cc:3060] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.971998  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:53.970752  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:53.974335  4032 raft_consensus.cc:2393] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 1: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:13:53.975723  3925 leader_election.cc:304] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:13:53.964241  3959 raft_consensus.cc:3060] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.976665  4156 raft_consensus.cc:3060] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.977571  4149 ts_tablet_manager.cc:1434] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.004s
I20260709 13:13:53.978601  4149 tablet_bootstrap.cc:492] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:13:53.963049  4150 consensus_queue.cc:260] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.985025  4149 tablet_bootstrap.cc:654] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.988780  4150 ts_tablet_manager.cc:1434] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.000s
I20260709 13:13:53.990808  3956 raft_consensus.cc:2468] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:13:53.992323  4071 leader_election.cc:304] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:13:53.993358  4196 raft_consensus.cc:2804] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:53.994065  4196 raft_consensus.cc:697] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:13:53.994961  4196 consensus_queue.cc:237] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.953320  4148 raft_consensus.cc:740] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.000593  4148 consensus_queue.cc:260] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:53.989841  4150 tablet_bootstrap.cc:492] T c18bd2f3197a4762aec88dec3caa6712 P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:13:53.964763  4031 raft_consensus.cc:2468] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:13:54.010250  4148 ts_tablet_manager.cc:1434] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.070s	user 0.005s	sys 0.002s
I20260709 13:13:54.009421  3855 catalog_manager.cc:5697] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 1 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:54.012633  4150 tablet_bootstrap.cc:654] T c18bd2f3197a4762aec88dec3caa6712 P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.013494  3855 catalog_manager.cc:5697] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 1 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:54.015267  4148 tablet_bootstrap.cc:492] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:13:54.015635  3855 catalog_manager.cc:5697] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 1 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:54.018929  3956 raft_consensus.cc:3060] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.014885  4156 raft_consensus.cc:2749] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:54.032594  4220 raft_consensus.cc:493] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.033322  4220 raft_consensus.cc:515] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.038089  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:54.041133  4220 leader_election.cc:290] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:54.043287  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:54.044406  4108 raft_consensus.cc:2393] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 1: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:13:54.045982  3997 leader_election.cc:304] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:54.046144  4162 consensus_queue.cc:1048] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:54.049249  4220 raft_consensus.cc:3060] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.061432  4148 tablet_bootstrap.cc:654] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.077286  4149 tablet_bootstrap.cc:492] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:13:54.077955  4149 ts_tablet_manager.cc:1403] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.100s	user 0.012s	sys 0.023s
I20260709 13:13:54.081517  4149 raft_consensus.cc:359] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.082486  4149 raft_consensus.cc:385] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.081791  3856 catalog_manager.cc:5697] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 1 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:54.082854  4149 raft_consensus.cc:740] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.091467  4269 raft_consensus.cc:493] T f4845eaa52cb4965b9c8922f37e2f606 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.090914  4149 consensus_queue.cc:260] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.094318  4149 ts_tablet_manager.cc:1434] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.000s
I20260709 13:13:54.096074  4150 tablet_bootstrap.cc:492] T c18bd2f3197a4762aec88dec3caa6712 P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:13:54.096726  4150 ts_tablet_manager.cc:1403] T c18bd2f3197a4762aec88dec3caa6712 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.107s	user 0.031s	sys 0.040s
I20260709 13:13:54.092742  4269 raft_consensus.cc:515] T f4845eaa52cb4965b9c8922f37e2f606 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.099911  4150 raft_consensus.cc:359] T c18bd2f3197a4762aec88dec3caa6712 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.100638  4150 raft_consensus.cc:385] T c18bd2f3197a4762aec88dec3caa6712 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.100960  4150 raft_consensus.cc:740] T c18bd2f3197a4762aec88dec3caa6712 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.102349  4150 consensus_queue.cc:260] T c18bd2f3197a4762aec88dec3caa6712 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.106524  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:13:54.108214  3997 leader_election.cc:343] T f4845eaa52cb4965b9c8922f37e2f606 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:54.109504  4269 leader_election.cc:290] T f4845eaa52cb4965b9c8922f37e2f606 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:54.110535  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:13:54.112159  3997 leader_election.cc:343] T f4845eaa52cb4965b9c8922f37e2f606 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:54.112658  3997 leader_election.cc:304] T f4845eaa52cb4965b9c8922f37e2f606 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:54.114382  4162 raft_consensus.cc:493] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.115077  4162 raft_consensus.cc:515] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.119251  4162 leader_election.cc:290] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:54.119925  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:54.120591  3956 raft_consensus.cc:2468] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 0.
I20260709 13:13:54.121692  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:54.121865  4071 leader_election.cc:304] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:13:54.124253  4231 raft_consensus.cc:2804] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:54.124624  4231 raft_consensus.cc:493] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:54.124979  4231 raft_consensus.cc:3060] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.126142  4271 raft_consensus.cc:2749] T f4845eaa52cb4965b9c8922f37e2f606 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:54.128470  4235 raft_consensus.cc:493] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
W20260709 13:13:54.126019  4074 leader_election.cc:343] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:54.129004  4235 raft_consensus.cc:515] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.137634  4235 leader_election.cc:290] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:54.138466  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:54.140376  4162 consensus_queue.cc:1048] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:54.140901  4150 ts_tablet_manager.cc:1434] T c18bd2f3197a4762aec88dec3caa6712 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.044s	user 0.028s	sys 0.011s
I20260709 13:13:54.140713  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:54.141963  4150 tablet_bootstrap.cc:492] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:13:54.142270  4148 tablet_bootstrap.cc:492] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:13:54.142834  4148 ts_tablet_manager.cc:1403] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.129s	user 0.007s	sys 0.019s
I20260709 13:13:54.090905  4196 consensus_queue.cc:1048] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:13:54.145736  4148 raft_consensus.cc:359] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.146445  4148 raft_consensus.cc:385] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.146749  4148 raft_consensus.cc:740] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.148475  4150 tablet_bootstrap.cc:654] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.147455  4148 consensus_queue.cc:260] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.154174  4148 ts_tablet_manager.cc:1434] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.004s
I20260709 13:13:54.155804  4233 consensus_queue.cc:1048] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:54.151415  4220 raft_consensus.cc:2749] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:54.159035  4149 tablet_bootstrap.cc:492] T 4b83b18c9e8b401c95ac6e2c0a420316 P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:13:54.162604  4148 tablet_bootstrap.cc:492] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:13:54.170679  3925 leader_election.cc:304] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:13:54.174175  4156 raft_consensus.cc:493] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.173974  4233 consensus_queue.cc:1048] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:54.174690  4156 raft_consensus.cc:515] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.176889  4156 leader_election.cc:290] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:54.177659  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:54.178301  4031 raft_consensus.cc:2468] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 0.
I20260709 13:13:54.172112  4235 raft_consensus.cc:2749] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:54.186012  3925 leader_election.cc:304] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:13:54.186690  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:13:54.205681  3922 leader_election.cc:343] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:54.196748  4235 raft_consensus.cc:2804] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:54.214177  4235 raft_consensus.cc:493] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:54.214563  4235 raft_consensus.cc:3060] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.217142  4231 raft_consensus.cc:515] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.224759  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
W20260709 13:13:54.236824  4074 leader_election.cc:343] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:54.236930  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:13:54.237836  3958 raft_consensus.cc:3060] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.239647  4177 consensus_queue.cc:1048] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:54.242161  4149 tablet_bootstrap.cc:654] T 4b83b18c9e8b401c95ac6e2c0a420316 P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.222600  4231 leader_election.cc:290] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:54.255903  4220 raft_consensus.cc:493] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.256495  4220 raft_consensus.cc:515] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.259073  4220 leader_election.cc:290] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:13:54.263974  3922 consensus_peers.cc:597] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:54.265300  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:54.266366  3956 raft_consensus.cc:2393] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 1: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:13:54.270797  4156 consensus_queue.cc:1048] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:13:54.288237  4156 consensus_queue.cc:1048] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:54.291349  4150 tablet_bootstrap.cc:492] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:13:54.291872  4150 ts_tablet_manager.cc:1403] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.150s	user 0.038s	sys 0.039s
I20260709 13:13:54.291996  4148 tablet_bootstrap.cc:654] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.294075  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:54.292507  4235 raft_consensus.cc:515] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.297698  4235 leader_election.cc:290] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:54.295390  4150 raft_consensus.cc:359] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.298731  4150 raft_consensus.cc:385] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.298997  4150 raft_consensus.cc:740] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.299872  4150 consensus_queue.cc:260] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.303905  4150 ts_tablet_manager.cc:1434] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:13:54.305019  4150 tablet_bootstrap.cc:492] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:13:54.304965  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:13:54.305781  4030 raft_consensus.cc:3060] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.308113  4194 consensus_queue.cc:1048] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:54.327313  4194 raft_consensus.cc:493] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.327898  4194 raft_consensus.cc:515] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.329934  4156 raft_consensus.cc:493] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.330091  4194 leader_election.cc:290] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:54.330468  4156 raft_consensus.cc:515] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.332062  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:54.332584  4156 leader_election.cc:290] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:13:54.333559  4071 leader_election.cc:343] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:54.338115  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:54.338966  4032 raft_consensus.cc:2468] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 0.
I20260709 13:13:54.346848  3997 leader_election.cc:304] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:54.347066  3925 leader_election.cc:304] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:13:54.348448  4220 raft_consensus.cc:3060] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.348670  4235 raft_consensus.cc:2804] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:54.349226  4235 raft_consensus.cc:493] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:54.349658  4235 raft_consensus.cc:3060] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.398258  4030 raft_consensus.cc:2468] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 1.
W20260709 13:13:54.399320  4071 consensus_peers.cc:597] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:54.401551  3905 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:54.407889  4148 tablet_bootstrap.cc:492] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:13:54.408440  4148 ts_tablet_manager.cc:1403] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.246s	user 0.012s	sys 0.003s
I20260709 13:13:54.407918  4149 tablet_bootstrap.cc:492] T 4b83b18c9e8b401c95ac6e2c0a420316 P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:13:54.409497  4149 ts_tablet_manager.cc:1403] T 4b83b18c9e8b401c95ac6e2c0a420316 P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.251s	user 0.031s	sys 0.014s
I20260709 13:13:54.392382  4235 raft_consensus.cc:515] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.413506  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:54.408823  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:13:54.415313  4235 leader_election.cc:290] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:54.423796  4148 raft_consensus.cc:359] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.424768  4148 raft_consensus.cc:385] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.425057  4148 raft_consensus.cc:740] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.425796  4148 consensus_queue.cc:260] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.426721  4149 raft_consensus.cc:359] T 4b83b18c9e8b401c95ac6e2c0a420316 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.427459  4149 raft_consensus.cc:385] T 4b83b18c9e8b401c95ac6e2c0a420316 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.427915  4149 raft_consensus.cc:740] T 4b83b18c9e8b401c95ac6e2c0a420316 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.429064  3925 leader_election.cc:304] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:13:54.408411  3958 raft_consensus.cc:2468] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:13:54.431326  4148 ts_tablet_manager.cc:1434] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.001s
I20260709 13:13:54.431259  4236 raft_consensus.cc:2804] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:54.431915  4236 raft_consensus.cc:697] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:13:54.432799  4236 consensus_queue.cc:237] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.430239  4149 consensus_queue.cc:260] T 4b83b18c9e8b401c95ac6e2c0a420316 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.436271  4148 tablet_bootstrap.cc:492] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:13:54.437528  4196 consensus_queue.cc:1048] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:54.444161  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:54.445833  4149 ts_tablet_manager.cc:1434] T 4b83b18c9e8b401c95ac6e2c0a420316 P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.001s
I20260709 13:13:54.445696  4071 leader_election.cc:304] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:13:54.438232  4220 raft_consensus.cc:2749] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:54.446908  4149 tablet_bootstrap.cc:492] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:13:54.447325  4194 raft_consensus.cc:2804] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:54.447888  4194 raft_consensus.cc:697] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
W20260709 13:13:54.448107  3922 leader_election.cc:343] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:54.448973  4194 consensus_queue.cc:237] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.456627  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:13:54.457837  4031 raft_consensus.cc:3060] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:54.462110  3922 leader_election.cc:343] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:54.465062  4225 consensus_queue.cc:1048] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:54.467787  4281 raft_consensus.cc:493] T 4b83b18c9e8b401c95ac6e2c0a420316 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.473840  4150 tablet_bootstrap.cc:654] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.478256  4281 raft_consensus.cc:515] T 4b83b18c9e8b401c95ac6e2c0a420316 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.486995  4148 tablet_bootstrap.cc:654] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.504323  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:54.507824  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
W20260709 13:13:54.506310  3925 leader_election.cc:343] T 4b83b18c9e8b401c95ac6e2c0a420316 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:54.516170  4272 raft_consensus.cc:493] T c18bd2f3197a4762aec88dec3caa6712 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.516682  4272 raft_consensus.cc:515] T c18bd2f3197a4762aec88dec3caa6712 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.500371  4281 leader_election.cc:290] T 4b83b18c9e8b401c95ac6e2c0a420316 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:54.520079  4272 leader_election.cc:290] T c18bd2f3197a4762aec88dec3caa6712 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:54.520864  4149 tablet_bootstrap.cc:654] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.515688  4031 raft_consensus.cc:2468] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 1.
I20260709 13:13:54.523454  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:13:54.524873  3997 leader_election.cc:343] T c18bd2f3197a4762aec88dec3caa6712 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:54.525594  3925 leader_election.cc:304] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:13:54.527009  4177 raft_consensus.cc:2804] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:54.527639  4177 raft_consensus.cc:697] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:13:54.528901  4177 consensus_queue.cc:237] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.530258  4150 tablet_bootstrap.cc:492] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:13:54.530858  4150 ts_tablet_manager.cc:1403] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.226s	user 0.030s	sys 0.039s
I20260709 13:13:54.536500  4150 raft_consensus.cc:359] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.537237  4150 raft_consensus.cc:385] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.537534  4150 raft_consensus.cc:740] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.538287  4150 consensus_queue.cc:260] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.541801  4150 ts_tablet_manager.cc:1434] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.004s
I20260709 13:13:54.542753  4150 tablet_bootstrap.cc:492] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
W20260709 13:13:54.549288  4074 leader_election.cc:343] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:54.549885  4074 leader_election.cc:304] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
W20260709 13:13:54.550056  3922 leader_election.cc:343] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:54.551725  4231 raft_consensus.cc:2749] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:54.556841  4148 tablet_bootstrap.cc:492] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:13:54.557379  4148 ts_tablet_manager.cc:1403] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.122s	user 0.015s	sys 0.004s
I20260709 13:13:54.564409  3856 catalog_manager.cc:5697] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 0 to 1, leader changed from <none> to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:54.571615  4194 consensus_queue.cc:1048] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:54.575428  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:54.575338  4231 consensus_queue.cc:1048] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:13:54.606741  3855 catalog_manager.cc:5697] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 1 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:54.630661  4148 raft_consensus.cc:359] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.631829  4148 raft_consensus.cc:385] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.632189  4148 raft_consensus.cc:740] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.636796  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:13:54.638298  3922 leader_election.cc:343] T 4b83b18c9e8b401c95ac6e2c0a420316 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:54.638901  4148 consensus_queue.cc:260] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.639755  3922 leader_election.cc:304] T 4b83b18c9e8b401c95ac6e2c0a420316 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:13:54.641511  4148 ts_tablet_manager.cc:1434] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.084s	user 0.018s	sys 0.017s
I20260709 13:13:54.642863  4148 tablet_bootstrap.cc:492] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:13:54.642437  4177 raft_consensus.cc:2749] T 4b83b18c9e8b401c95ac6e2c0a420316 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:54.645628  4149 tablet_bootstrap.cc:492] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:13:54.647264  4149 ts_tablet_manager.cc:1403] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.201s	user 0.028s	sys 0.043s
I20260709 13:13:54.651793  4149 raft_consensus.cc:359] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.652572  4149 raft_consensus.cc:385] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.652861  4149 raft_consensus.cc:740] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.653549  4149 consensus_queue.cc:260] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.651863  4225 consensus_queue.cc:1048] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:13:54.656298  4149 ts_tablet_manager.cc:1434] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:13:54.657382  4149 tablet_bootstrap.cc:492] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
W20260709 13:13:54.661877  3997 leader_election.cc:343] T c18bd2f3197a4762aec88dec3caa6712 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:54.664002  4225 consensus_queue.cc:1048] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:54.664290  3997 leader_election.cc:304] T c18bd2f3197a4762aec88dec3caa6712 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:54.666697  4220 raft_consensus.cc:2749] T c18bd2f3197a4762aec88dec3caa6712 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:54.667735  4225 consensus_queue.cc:1048] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:54.669646  4148 tablet_bootstrap.cc:654] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.670430  3856 catalog_manager.cc:5697] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 0 to 1, leader changed from <none> to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:54.673817  4150 tablet_bootstrap.cc:654] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.681797  4149 tablet_bootstrap.cc:654] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.712584  4150 tablet_bootstrap.cc:492] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:13:54.713224  4150 ts_tablet_manager.cc:1403] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.171s	user 0.020s	sys 0.011s
I20260709 13:13:54.716192  4149 tablet_bootstrap.cc:492] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:13:54.717926  4149 ts_tablet_manager.cc:1403] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.061s	user 0.010s	sys 0.011s
I20260709 13:13:54.720777  4149 raft_consensus.cc:359] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.721477  4149 raft_consensus.cc:385] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.721746  4149 raft_consensus.cc:740] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.722419  4149 consensus_queue.cc:260] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.736351  4107 raft_consensus.cc:3060] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.753199  4149 ts_tablet_manager.cc:1434] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.001s
I20260709 13:13:54.754240  4149 tablet_bootstrap.cc:492] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:13:54.761718  4150 raft_consensus.cc:359] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.762398  4150 raft_consensus.cc:385] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.762598  4150 raft_consensus.cc:740] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.764097  4150 consensus_queue.cc:260] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.769614  4150 ts_tablet_manager.cc:1434] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.056s	user 0.005s	sys 0.001s
I20260709 13:13:54.770656  4150 tablet_bootstrap.cc:492] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:13:54.772855  4299 raft_consensus.cc:493] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.773456  4299 raft_consensus.cc:515] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.779131  4150 tablet_bootstrap.cc:654] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.795074  4148 tablet_bootstrap.cc:492] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:13:54.795651  4148 ts_tablet_manager.cc:1403] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.153s	user 0.023s	sys 0.032s
I20260709 13:13:54.800109  4149 tablet_bootstrap.cc:654] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.804133  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:54.805560  3956 raft_consensus.cc:2468] T 4b83b18c9e8b401c95ac6e2c0a420316 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 0.
I20260709 13:13:54.806334  4299 leader_election.cc:290] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:54.808969  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:54.807132  3997 leader_election.cc:304] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:13:54.813520  4299 raft_consensus.cc:2804] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:54.814589  4299 raft_consensus.cc:493] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:54.814998  4299 raft_consensus.cc:3060] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:54.814013  3997 leader_election.cc:343] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:54.817654  4148 raft_consensus.cc:359] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.818372  4148 raft_consensus.cc:385] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.818662  4148 raft_consensus.cc:740] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.819370  4148 consensus_queue.cc:260] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.823868  4148 ts_tablet_manager.cc:1434] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:13:54.824821  4148 tablet_bootstrap.cc:492] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:13:54.831000  4148 tablet_bootstrap.cc:654] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.844446  4148 tablet_bootstrap.cc:492] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:13:54.844993  4148 ts_tablet_manager.cc:1403] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.006s
I20260709 13:13:54.848452  4148 raft_consensus.cc:359] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.849244  4148 raft_consensus.cc:385] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.849560  4148 raft_consensus.cc:740] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.846764  4299 raft_consensus.cc:515] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.850826  4148 consensus_queue.cc:260] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.853221  4148 ts_tablet_manager.cc:1434] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:13:54.854137  4148 tablet_bootstrap.cc:492] T b2879f06fa90455ea323efd79c11c330 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:13:54.854580  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:13:54.855412  3959 raft_consensus.cc:3060] T 4b83b18c9e8b401c95ac6e2c0a420316 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.859141  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:13:54.860682  4297 raft_consensus.cc:493] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:54.861143  3997 leader_election.cc:343] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:54.861176  4297 raft_consensus.cc:515] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.874177  4297 leader_election.cc:290] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:54.868064  3959 raft_consensus.cc:2468] T 4b83b18c9e8b401c95ac6e2c0a420316 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 1.
I20260709 13:13:54.877532  3997 leader_election.cc:304] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:13:54.879171  4148 tablet_bootstrap.cc:654] T b2879f06fa90455ea323efd79c11c330 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.864323  4299 leader_election.cc:290] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:54.878891  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:54.880996  4162 raft_consensus.cc:493] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.881649  4107 raft_consensus.cc:2468] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 0.
I20260709 13:13:54.882385  4297 raft_consensus.cc:2804] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:54.881707  4162 raft_consensus.cc:515] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.882159  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:54.883733  4297 raft_consensus.cc:697] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:13:54.884999  4162 leader_election.cc:290] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:54.885663  4297 consensus_queue.cc:237] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.887399  4149 tablet_bootstrap.cc:492] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:13:54.887364  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:54.888110  4149 ts_tablet_manager.cc:1403] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.134s	user 0.008s	sys 0.061s
I20260709 13:13:54.888325  4031 raft_consensus.cc:2393] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 1: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:13:54.892042  4149 raft_consensus.cc:359] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.893036  4149 raft_consensus.cc:385] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.893443  4149 raft_consensus.cc:740] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.894389  4149 consensus_queue.cc:260] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.897572  4149 ts_tablet_manager.cc:1434] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 13:13:54.898631  4149 tablet_bootstrap.cc:492] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:13:54.899927  4162 raft_consensus.cc:493] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.900426  4162 raft_consensus.cc:515] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.884442  3997 leader_election.cc:304] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:13:54.902513  4162 leader_election.cc:290] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:54.903329  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:54.909439  3957 raft_consensus.cc:2468] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 0.
I20260709 13:13:54.910552  4071 leader_election.cc:304] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:13:54.910918  3997 leader_election.cc:343] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:54.911367  4297 raft_consensus.cc:2804] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:54.911787  4297 raft_consensus.cc:493] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:54.912123  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:54.912139  4297 raft_consensus.cc:3060] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.904275  4148 tablet_bootstrap.cc:492] T b2879f06fa90455ea323efd79c11c330 P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:13:54.908618  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:54.915454  4031 raft_consensus.cc:2468] T c18bd2f3197a4762aec88dec3caa6712 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 0.
I20260709 13:13:54.915556  4162 raft_consensus.cc:2804] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:54.915853  4149 tablet_bootstrap.cc:654] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.915997  4162 raft_consensus.cc:493] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:54.916360  4162 raft_consensus.cc:3060] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.917378  4148 ts_tablet_manager.cc:1403] T b2879f06fa90455ea323efd79c11c330 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.063s	user 0.022s	sys 0.000s
I20260709 13:13:54.917966  4071 leader_election.cc:304] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:54.913883  3855 catalog_manager.cc:5697] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 1 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:54.921046  4297 raft_consensus.cc:515] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.923492  4225 raft_consensus.cc:3060] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.925602  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:13:54.926187  4107 raft_consensus.cc:3060] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.923069  4297 leader_election.cc:290] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:54.931016  4107 raft_consensus.cc:2468] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 1.
I20260709 13:13:54.931219  4225 raft_consensus.cc:2749] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:54.932085  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:13:54.933619  3997 leader_election.cc:304] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
W20260709 13:13:54.943924  3997 leader_election.cc:343] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:54.944036  4148 raft_consensus.cc:359] T b2879f06fa90455ea323efd79c11c330 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.944836  4148 raft_consensus.cc:385] T b2879f06fa90455ea323efd79c11c330 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.945091  4148 raft_consensus.cc:740] T b2879f06fa90455ea323efd79c11c330 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.914927  4150 tablet_bootstrap.cc:492] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
W20260709 13:13:54.941193  4074 consensus_peers.cc:597] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:54.945124  4297 raft_consensus.cc:2804] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:54.946165  4149 tablet_bootstrap.cc:492] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:13:54.945889  4148 consensus_queue.cc:260] T b2879f06fa90455ea323efd79c11c330 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.946630  4149 ts_tablet_manager.cc:1403] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.048s	user 0.021s	sys 0.005s
I20260709 13:13:54.946851  4150 ts_tablet_manager.cc:1403] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.176s	user 0.005s	sys 0.024s
I20260709 13:13:54.946615  4297 raft_consensus.cc:697] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:13:54.948251  4148 ts_tablet_manager.cc:1434] T b2879f06fa90455ea323efd79c11c330 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:13:54.940135  4162 raft_consensus.cc:515] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.949656  4149 raft_consensus.cc:359] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.950344  4149 raft_consensus.cc:385] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.950821  4149 raft_consensus.cc:740] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.951202  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:13:54.951575  4149 consensus_queue.cc:260] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.952018  3959 raft_consensus.cc:3060] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.952857  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:13:54.963876  4031 raft_consensus.cc:3060] T c18bd2f3197a4762aec88dec3caa6712 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.970964  4031 raft_consensus.cc:2468] T c18bd2f3197a4762aec88dec3caa6712 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:13:54.953708  4149 ts_tablet_manager.cc:1434] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.002s
I20260709 13:13:54.974852  3959 raft_consensus.cc:2468] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:13:54.976054  4149 tablet_bootstrap.cc:492] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:13:54.978957  4074 leader_election.cc:304] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:13:54.979952  4231 raft_consensus.cc:2804] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:54.953649  4150 raft_consensus.cc:359] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.953853  4297 consensus_queue.cc:237] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.956257  4148 tablet_bootstrap.cc:492] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:13:54.950325  4162 leader_election.cc:290] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:54.960813  4177 consensus_queue.cc:1048] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:54.980518  4231 raft_consensus.cc:697] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:13:54.985049  4231 consensus_queue.cc:237] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.987387  4148 tablet_bootstrap.cc:654] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.987514  4150 raft_consensus.cc:385] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.988013  4150 raft_consensus.cc:740] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.988940  4150 consensus_queue.cc:260] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:54.991070  4150 ts_tablet_manager.cc:1434] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.044s	user 0.002s	sys 0.002s
I20260709 13:13:54.992318  4150 tablet_bootstrap.cc:492] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:13:54.993220  4149 tablet_bootstrap.cc:654] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.010308  4150 tablet_bootstrap.cc:654] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.017953  4281 consensus_queue.cc:1048] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:55.024749  4150 tablet_bootstrap.cc:492] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:13:55.025315  4150 ts_tablet_manager.cc:1403] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.001s
I20260709 13:13:55.027272  4162 consensus_queue.cc:1048] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:55.028337  4150 raft_consensus.cc:359] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.029100  4150 raft_consensus.cc:385] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.029374  4150 raft_consensus.cc:740] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.035207  3959 raft_consensus.cc:3060] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:55.036269  4150 consensus_queue.cc:260] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.038532  4150 ts_tablet_manager.cc:1434] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:13:55.039494  4150 tablet_bootstrap.cc:492] T 37bb8c27fe534b22824e326e191a66f0 P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:13:55.049136  4177 consensus_queue.cc:1048] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:55.053432  4150 tablet_bootstrap.cc:654] T 37bb8c27fe534b22824e326e191a66f0 P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.058072  4177 raft_consensus.cc:493] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.060066  4177 raft_consensus.cc:515] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.065207  4177 leader_election.cc:290] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:55.065706  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:55.066690  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:13:55.068039  3922 leader_election.cc:343] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:55.073544  3925 leader_election.cc:343] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:55.075914  3925 leader_election.cc:304] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:13:55.076810  4177 raft_consensus.cc:2749] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:55.091764  4150 tablet_bootstrap.cc:492] T 37bb8c27fe534b22824e326e191a66f0 P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:13:55.092306  4149 tablet_bootstrap.cc:492] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:13:55.092798  4149 ts_tablet_manager.cc:1403] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.117s	user 0.031s	sys 0.028s
I20260709 13:13:55.092334  4150 ts_tablet_manager.cc:1403] T 37bb8c27fe534b22824e326e191a66f0 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.053s	user 0.014s	sys 0.000s
I20260709 13:13:55.094622  4148 tablet_bootstrap.cc:492] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:13:55.095100  4148 ts_tablet_manager.cc:1403] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.139s	user 0.034s	sys 0.023s
I20260709 13:13:55.096868  4149 raft_consensus.cc:359] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.137337  4150 raft_consensus.cc:359] T 37bb8c27fe534b22824e326e191a66f0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.148177  4150 raft_consensus.cc:385] T 37bb8c27fe534b22824e326e191a66f0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.144387  4156 raft_consensus.cc:493] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.149192  4150 raft_consensus.cc:740] T 37bb8c27fe534b22824e326e191a66f0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.157007  4149 raft_consensus.cc:385] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.157737  4149 raft_consensus.cc:740] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.178092  3857 catalog_manager.cc:5697] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 1 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:55.181169  3855 catalog_manager.cc:5697] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 1 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:55.162236  4148 raft_consensus.cc:359] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.186816  4148 raft_consensus.cc:385] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.187250  4148 raft_consensus.cc:740] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.188252  4148 consensus_queue.cc:260] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.162216  4156 raft_consensus.cc:515] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.200747  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:55.204308  4150 consensus_queue.cc:260] T 37bb8c27fe534b22824e326e191a66f0 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.167790  4149 consensus_queue.cc:260] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.253489  4033 raft_consensus.cc:2468] T 37bb8c27fe534b22824e326e191a66f0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 0.
I20260709 13:13:55.260527  4149 ts_tablet_manager.cc:1434] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.167s	user 0.006s	sys 0.004s
I20260709 13:13:55.262504  4149 tablet_bootstrap.cc:492] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:13:55.263921  4156 leader_election.cc:290] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:55.265417  4231 raft_consensus.cc:493] T b2879f06fa90455ea323efd79c11c330 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.266207  4231 raft_consensus.cc:515] T b2879f06fa90455ea323efd79c11c330 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.267618  4107 raft_consensus.cc:3060] T b2879f06fa90455ea323efd79c11c330 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:55.268584  3925 leader_election.cc:304] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:13:55.281984  4225 raft_consensus.cc:493] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.283042  4225 raft_consensus.cc:515] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.288546  4236 raft_consensus.cc:2804] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:55.289145  4236 raft_consensus.cc:493] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:55.289604  4236 raft_consensus.cc:3060] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:55.344563  4148 ts_tablet_manager.cc:1434] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.249s	user 0.012s	sys 0.003s
W20260709 13:13:55.346697  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 74537.1us
I20260709 13:13:55.346662  4148 tablet_bootstrap.cc:492] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:13:55.363008  4150 ts_tablet_manager.cc:1434] T 37bb8c27fe534b22824e326e191a66f0 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.269s	user 0.017s	sys 0.006s
I20260709 13:13:55.287329  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:55.388746  4272 raft_consensus.cc:493] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.389951  4225 leader_election.cc:290] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:55.389731  4272 raft_consensus.cc:515] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.395934  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:55.396803  3957 raft_consensus.cc:2468] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 0.
I20260709 13:13:55.399082  4071 leader_election.cc:304] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:13:55.400835  4196 raft_consensus.cc:2804] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:55.401237  4196 raft_consensus.cc:493] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:55.401654  4196 raft_consensus.cc:3060] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:55.394410  4108 raft_consensus.cc:2468] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 0.
I20260709 13:13:55.411890  4150 tablet_bootstrap.cc:492] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:13:55.416303  4231 leader_election.cc:290] T b2879f06fa90455ea323efd79c11c330 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:55.418370  4297 raft_consensus.cc:493] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.420051  4297 raft_consensus.cc:515] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.423148  4297 leader_election.cc:290] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:55.424656  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:55.432638  4272 leader_election.cc:290] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:55.432888  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:13:55.430217  3997 leader_election.cc:343] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:55.437686  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:55.433211  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:55.440430  4033 raft_consensus.cc:2468] T f4845eaa52cb4965b9c8922f37e2f606 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 0.
I20260709 13:13:55.430178  4297 consensus_queue.cc:1048] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:13:55.456166  4225 raft_consensus.cc:493] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.457442  4225 raft_consensus.cc:515] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.470053  4236 raft_consensus.cc:515] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.473026  4236 leader_election.cc:290] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:55.476931  4150 tablet_bootstrap.cc:654] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.476933  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:13:55.451999  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:55.485802  4196 raft_consensus.cc:515] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.483822  4225 leader_election.cc:290] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:55.491443  4033 raft_consensus.cc:3060] T 37bb8c27fe534b22824e326e191a66f0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:55.503669  4148 tablet_bootstrap.cc:654] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:55.511447  3997 consensus_peers.cc:597] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:55.516497  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:13:55.516083  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 46974.9us
I20260709 13:13:55.517974  4074 leader_election.cc:304] T b2879f06fa90455ea323efd79c11c330 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:55.519074  4162 raft_consensus.cc:2749] T b2879f06fa90455ea323efd79c11c330 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:13:55.524353  4071 leader_election.cc:343] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:55.526998  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:13:55.527809  4108 raft_consensus.cc:3060] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:55.541690  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:55.544095  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:55.549636  4236 consensus_queue.cc:1048] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:55.540149  4196 leader_election.cc:290] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:13:55.553278  3997 consensus_peers.cc:597] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:55.554095  4031 raft_consensus.cc:3060] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:55.554296  3997 leader_election.cc:343] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:55.554836  3997 leader_election.cc:304] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:55.556856  3997 leader_election.cc:304] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:55.558044  4220 raft_consensus.cc:2749] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:55.559963  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:13:55.560132  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:13:55.560716  4034 raft_consensus.cc:3060] T f4845eaa52cb4965b9c8922f37e2f606 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:55.553217  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:55.562199  4225 consensus_queue.cc:1048] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:13:55.565945  4074 leader_election.cc:343] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:55.566375  4074 leader_election.cc:304] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:55.567533  4149 tablet_bootstrap.cc:654] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.581040  3957 raft_consensus.cc:3060] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:55.586862  4108 raft_consensus.cc:2468] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 1.
I20260709 13:13:55.590517  4328 raft_consensus.cc:2749] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:55.603772  4297 consensus_queue.cc:1048] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:13:55.605136  4034 raft_consensus.cc:2468] T f4845eaa52cb4965b9c8922f37e2f606 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:13:55.607057  4033 raft_consensus.cc:2468] T 37bb8c27fe534b22824e326e191a66f0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 1.
I20260709 13:13:55.609963  4074 leader_election.cc:304] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:13:55.611259  4196 raft_consensus.cc:2804] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:55.611971  4196 raft_consensus.cc:697] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:13:55.613330  4196 consensus_queue.cc:237] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:13:55.619681  3905 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:55.621220  3922 leader_election.cc:304] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:13:55.622675  4236 raft_consensus.cc:2804] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:55.623167  4236 raft_consensus.cc:697] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:13:55.625438  4236 consensus_queue.cc:237] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.635905  4162 consensus_queue.cc:1048] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:13:55.648728  3957 raft_consensus.cc:2468] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:13:55.666966  4148 tablet_bootstrap.cc:492] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:13:55.667622  4148 ts_tablet_manager.cc:1403] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.321s	user 0.015s	sys 0.023s
I20260709 13:13:55.671335  4148 raft_consensus.cc:359] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.673178  4148 raft_consensus.cc:385] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.673446  4148 raft_consensus.cc:740] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.674175  4148 consensus_queue.cc:260] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.675833  4148 ts_tablet_manager.cc:1434] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:13:55.676009  4149 tablet_bootstrap.cc:492] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:13:55.676705  4149 ts_tablet_manager.cc:1403] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.415s	user 0.029s	sys 0.056s
I20260709 13:13:55.676843  4148 tablet_bootstrap.cc:492] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:13:55.680284  4150 tablet_bootstrap.cc:492] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:13:55.680792  4150 ts_tablet_manager.cc:1403] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.269s	user 0.031s	sys 0.039s
I20260709 13:13:55.680747  4149 raft_consensus.cc:359] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.681555  4149 raft_consensus.cc:385] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.681847  4149 raft_consensus.cc:740] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.686410  4150 raft_consensus.cc:359] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.687021  4150 raft_consensus.cc:385] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.687719  4150 raft_consensus.cc:740] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.687026  4149 consensus_queue.cc:260] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.693959  4150 consensus_queue.cc:260] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.696501  4150 ts_tablet_manager.cc:1434] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.002s
I20260709 13:13:55.699644  4149 ts_tablet_manager.cc:1434] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.023s	user 0.010s	sys 0.000s
I20260709 13:13:55.703691  4299 raft_consensus.cc:493] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.704245  4299 raft_consensus.cc:515] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.709430  4149 tablet_bootstrap.cc:492] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:13:55.709180  4299 leader_election.cc:290] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:55.710853  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:55.711211  4220 raft_consensus.cc:2749] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:55.712846  4148 tablet_bootstrap.cc:654] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.712590  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:13:55.717345  3997 leader_election.cc:343] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:55.718537  3997 leader_election.cc:343] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:55.718695  4150 tablet_bootstrap.cc:492] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:13:55.718737  4149 tablet_bootstrap.cc:654] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.718998  3997 leader_election.cc:304] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:55.720834  4220 raft_consensus.cc:2749] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:55.729494  3857 catalog_manager.cc:5697] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 0 to 1, leader changed from <none> to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:55.754895  4149 tablet_bootstrap.cc:492] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:13:55.755482  4149 ts_tablet_manager.cc:1403] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.046s	user 0.015s	sys 0.007s
I20260709 13:13:55.758622  4149 raft_consensus.cc:359] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.759335  4149 raft_consensus.cc:385] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.759651  4149 raft_consensus.cc:740] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.760177  4150 tablet_bootstrap.cc:654] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.760499  4149 consensus_queue.cc:260] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.762825  4149 ts_tablet_manager.cc:1434] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:13:55.765568  4148 tablet_bootstrap.cc:492] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:13:55.765658  4150 tablet_bootstrap.cc:492] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:13:55.766085  4150 ts_tablet_manager.cc:1403] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.048s	user 0.010s	sys 0.001s
I20260709 13:13:55.766085  4148 ts_tablet_manager.cc:1403] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.089s	user 0.018s	sys 0.012s
I20260709 13:13:55.769150  4148 raft_consensus.cc:359] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.768754  3855 catalog_manager.cc:5697] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 1 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:55.769830  4148 raft_consensus.cc:385] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.770114  4148 raft_consensus.cc:740] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.770820  4148 consensus_queue.cc:260] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.773662  4148 ts_tablet_manager.cc:1434] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:55.773669  4150 raft_consensus.cc:359] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.774761  4150 raft_consensus.cc:385] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.775058  4150 raft_consensus.cc:740] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.775676  4149 tablet_bootstrap.cc:492] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:13:55.776057  4150 consensus_queue.cc:260] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.777877  4150 ts_tablet_manager.cc:1434] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:55.778905  4150 tablet_bootstrap.cc:492] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:13:55.774792  4148 tablet_bootstrap.cc:492] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:13:55.786320  4150 tablet_bootstrap.cc:654] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.787807  4148 tablet_bootstrap.cc:654] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.798157  4149 tablet_bootstrap.cc:654] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.805754  4150 tablet_bootstrap.cc:492] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:13:55.806288  4150 ts_tablet_manager.cc:1403] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.011s
I20260709 13:13:55.807891  4236 raft_consensus.cc:493] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.808243  4149 tablet_bootstrap.cc:492] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:13:55.808339  4148 tablet_bootstrap.cc:492] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:13:55.808795  4149 ts_tablet_manager.cc:1403] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.005s
I20260709 13:13:55.809140  4148 ts_tablet_manager.cc:1403] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.034s	user 0.008s	sys 0.005s
I20260709 13:13:55.809237  4150 raft_consensus.cc:359] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.810000  4150 raft_consensus.cc:385] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.810379  4150 raft_consensus.cc:740] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.811125  4150 consensus_queue.cc:260] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.808421  4236 raft_consensus.cc:515] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.812594  4148 raft_consensus.cc:359] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.813228  4150 ts_tablet_manager.cc:1434] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:55.813534  4148 raft_consensus.cc:385] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.813856  4148 raft_consensus.cc:740] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.813946  4149 raft_consensus.cc:359] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.816087  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:55.814826  4236 leader_election.cc:290] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:55.821957  4150 tablet_bootstrap.cc:492] T 412d794b0f694d089b1b011ba8adea36 P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:13:55.814869  4149 raft_consensus.cc:385] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.824174  4149 raft_consensus.cc:740] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.824932  4149 consensus_queue.cc:260] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.815073  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:55.828469  4149 ts_tablet_manager.cc:1434] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:13:55.823400  4148 consensus_queue.cc:260] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.829021  3925 leader_election.cc:304] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:13:55.832280  4148 ts_tablet_manager.cc:1434] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.002s
I20260709 13:13:55.833058  4281 raft_consensus.cc:2749] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:55.830116  4149 tablet_bootstrap.cc:492] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:13:55.833974  4150 tablet_bootstrap.cc:654] T 412d794b0f694d089b1b011ba8adea36 P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.839941  4149 tablet_bootstrap.cc:654] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.840309  4148 tablet_bootstrap.cc:492] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:13:55.846366  4150 tablet_bootstrap.cc:492] T 412d794b0f694d089b1b011ba8adea36 P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:13:55.846863  4150 ts_tablet_manager.cc:1403] T 412d794b0f694d089b1b011ba8adea36 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.000s
I20260709 13:13:55.849344  4148 tablet_bootstrap.cc:654] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.849793  4150 raft_consensus.cc:359] T 412d794b0f694d089b1b011ba8adea36 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.850492  4150 raft_consensus.cc:385] T 412d794b0f694d089b1b011ba8adea36 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.850751  4150 raft_consensus.cc:740] T 412d794b0f694d089b1b011ba8adea36 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.851498  4150 consensus_queue.cc:260] T 412d794b0f694d089b1b011ba8adea36 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.853734  4150 ts_tablet_manager.cc:1434] T 412d794b0f694d089b1b011ba8adea36 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:13:55.855482  4150 tablet_bootstrap.cc:492] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:13:55.856503  4149 tablet_bootstrap.cc:492] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:13:55.856961  4149 ts_tablet_manager.cc:1403] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.000s
I20260709 13:13:55.859741  4149 raft_consensus.cc:359] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.860368  4149 raft_consensus.cc:385] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.860622  4149 raft_consensus.cc:740] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.861264  4149 consensus_queue.cc:260] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.863957  4150 tablet_bootstrap.cc:654] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.864666  4148 tablet_bootstrap.cc:492] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:13:55.865672  4148 ts_tablet_manager.cc:1403] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.009s
I20260709 13:13:55.868366  4148 raft_consensus.cc:359] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.869060  4148 raft_consensus.cc:385] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.869344  4148 raft_consensus.cc:740] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.870038  4148 consensus_queue.cc:260] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.872272  4148 ts_tablet_manager.cc:1434] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:13:55.873816  4148 tablet_bootstrap.cc:492] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:13:55.877776  4149 ts_tablet_manager.cc:1434] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:13:55.878856  4149 tablet_bootstrap.cc:492] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:13:55.884985  4149 tablet_bootstrap.cc:654] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.893846  4150 tablet_bootstrap.cc:492] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:13:55.894295  4148 tablet_bootstrap.cc:654] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.894424  4150 ts_tablet_manager.cc:1403] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.039s	user 0.019s	sys 0.015s
I20260709 13:13:55.897666  4150 raft_consensus.cc:359] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.898175  4329 raft_consensus.cc:493] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.898437  4150 raft_consensus.cc:385] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.898820  4150 raft_consensus.cc:740] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.899608  4150 consensus_queue.cc:260] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.900465  4236 raft_consensus.cc:493] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.900938  4236 raft_consensus.cc:515] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.902024  4150 ts_tablet_manager.cc:1434] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:55.898893  4329 raft_consensus.cc:515] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.902953  4236 leader_election.cc:290] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:55.904135  4150 tablet_bootstrap.cc:492] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:13:55.904563  4149 tablet_bootstrap.cc:492] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:13:55.905062  4149 ts_tablet_manager.cc:1403] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.005s
I20260709 13:13:55.905344  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:55.905947  4032 raft_consensus.cc:2468] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 0.
I20260709 13:13:55.907076  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:55.908196  3925 leader_election.cc:304] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:13:55.910230  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:55.910879  3957 raft_consensus.cc:2468] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 0.
I20260709 13:13:55.911149  4150 tablet_bootstrap.cc:654] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.909827  4149 raft_consensus.cc:359] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:13:55.910398  3922 leader_election.cc:343] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:55.911886  4149 raft_consensus.cc:385] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.912778  4149 raft_consensus.cc:740] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.913488  4236 raft_consensus.cc:2804] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:55.912814  4071 leader_election.cc:304] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:13:55.914804  4196 raft_consensus.cc:2804] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:55.916072  4196 raft_consensus.cc:493] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:55.916450  4196 raft_consensus.cc:3060] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:55.914515  4149 consensus_queue.cc:260] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.913924  4236 raft_consensus.cc:493] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:55.920080  4236 raft_consensus.cc:3060] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:55.922881  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:55.923599  4032 raft_consensus.cc:2468] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 0.
I20260709 13:13:55.926561  4149 ts_tablet_manager.cc:1434] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:13:55.931214  4149 tablet_bootstrap.cc:492] T 11c2da89f37f4113a8811c6e081da953 P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:13:55.940105  4149 tablet_bootstrap.cc:654] T 11c2da89f37f4113a8811c6e081da953 P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.942847  4196 raft_consensus.cc:515] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.923667  4329 leader_election.cc:290] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:55.945720  4148 tablet_bootstrap.cc:492] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:13:55.948693  4236 raft_consensus.cc:515] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.950731  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:13:55.947500  4148 ts_tablet_manager.cc:1403] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.074s	user 0.011s	sys 0.009s
I20260709 13:13:55.951335  3957 raft_consensus.cc:3060] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:55.950485  4196 leader_election.cc:290] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:55.954927  4236 leader_election.cc:290] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:55.956265  4148 raft_consensus.cc:359] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.957468  4148 raft_consensus.cc:385] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.957813  4148 raft_consensus.cc:740] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.958658  4148 consensus_queue.cc:260] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.960642  4148 ts_tablet_manager.cc:1434] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:13:55.961225  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:13:55.961858  4031 raft_consensus.cc:3060] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:55.962136  4149 tablet_bootstrap.cc:492] T 11c2da89f37f4113a8811c6e081da953 P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:13:55.962620  4149 ts_tablet_manager.cc:1403] T 11c2da89f37f4113a8811c6e081da953 P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.008s
I20260709 13:13:55.962972  4148 tablet_bootstrap.cc:492] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:13:55.963987  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:13:55.964304  4150 tablet_bootstrap.cc:492] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:13:55.964892  4150 ts_tablet_manager.cc:1403] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.061s	user 0.025s	sys 0.035s
I20260709 13:13:55.964579  4107 raft_consensus.cc:3060] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:55.965400  4149 raft_consensus.cc:359] T 11c2da89f37f4113a8811c6e081da953 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.966131  4149 raft_consensus.cc:385] T 11c2da89f37f4113a8811c6e081da953 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.966495  4149 raft_consensus.cc:740] T 11c2da89f37f4113a8811c6e081da953 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.967335  4149 consensus_queue.cc:260] T 11c2da89f37f4113a8811c6e081da953 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.971056  4149 ts_tablet_manager.cc:1434] T 11c2da89f37f4113a8811c6e081da953 P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:13:55.970737  4150 raft_consensus.cc:359] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.971515  4150 raft_consensus.cc:385] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.971884  4150 raft_consensus.cc:740] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.972152  4149 tablet_bootstrap.cc:492] T ba7a51e4b70a48daa8267297f285c661 P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:13:55.972673  4150 consensus_queue.cc:260] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.974339  4148 tablet_bootstrap.cc:654] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.974865  4150 ts_tablet_manager.cc:1434] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.004s
I20260709 13:13:55.976480  4150 tablet_bootstrap.cc:492] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:13:55.977357  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:13:55.977948  4032 raft_consensus.cc:3060] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:55.979975  4149 tablet_bootstrap.cc:654] T ba7a51e4b70a48daa8267297f285c661 P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.983431  4150 tablet_bootstrap.cc:654] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.984978  4148 tablet_bootstrap.cc:492] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:13:55.985663  4148 ts_tablet_manager.cc:1403] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.000s
I20260709 13:13:55.986984  4220 raft_consensus.cc:493] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.987473  4220 raft_consensus.cc:515] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.989759  4220 leader_election.cc:290] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:55.990795  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:55.988922  4148 raft_consensus.cc:359] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.991701  4148 raft_consensus.cc:385] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.992170  4148 raft_consensus.cc:740] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.992175  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:55.993170  4148 consensus_queue.cc:260] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:55.995616  4148 ts_tablet_manager.cc:1434] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:13:55.996479  4150 tablet_bootstrap.cc:492] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:13:55.996872  4148 tablet_bootstrap.cc:492] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:13:55.997051  4150 ts_tablet_manager.cc:1403] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.001s
I20260709 13:13:56.000100  4150 raft_consensus.cc:359] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:56.000767  4150 raft_consensus.cc:385] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.001039  4150 raft_consensus.cc:740] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.001696  4150 consensus_queue.cc:260] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:13:56.003639  3997 leader_election.cc:343] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:55.994006  4106 raft_consensus.cc:2468] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 0.
I20260709 13:13:56.004119  4150 ts_tablet_manager.cc:1434] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:56.005219  3997 leader_election.cc:304] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:56.006091  4220 raft_consensus.cc:2804] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:56.005215  4150 tablet_bootstrap.cc:492] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:13:56.006536  4220 raft_consensus.cc:493] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.006940  4220 raft_consensus.cc:3060] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.007755  4148 tablet_bootstrap.cc:654] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.973613  4031 raft_consensus.cc:2468] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:13:56.017200  3957 raft_consensus.cc:2468] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:13:56.024516  4074 leader_election.cc:304] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:13:56.030161  4196 raft_consensus.cc:2804] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:56.030508  4150 tablet_bootstrap.cc:654] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.030882  4196 raft_consensus.cc:697] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:13:56.016889  4220 raft_consensus.cc:515] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:56.041074  4329 raft_consensus.cc:493] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.044517  4329 raft_consensus.cc:515] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:56.045488  4149 tablet_bootstrap.cc:492] T ba7a51e4b70a48daa8267297f285c661 P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:13:56.046538  4149 ts_tablet_manager.cc:1403] T ba7a51e4b70a48daa8267297f285c661 P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.075s	user 0.027s	sys 0.012s
I20260709 13:13:56.046653  4329 leader_election.cc:290] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:56.049082  4196 consensus_queue.cc:237] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:56.051662  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:56.052738  4031 raft_consensus.cc:2468] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 0.
I20260709 13:13:56.055160  4236 consensus_queue.cc:1048] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:56.058238  4074 leader_election.cc:304] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:13:56.051288  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:56.059410  3959 raft_consensus.cc:2468] T 11c2da89f37f4113a8811c6e081da953 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 0.
I20260709 13:13:56.061998  4149 raft_consensus.cc:359] T ba7a51e4b70a48daa8267297f285c661 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:56.064581  4149 raft_consensus.cc:385] T ba7a51e4b70a48daa8267297f285c661 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.063634  4328 consensus_queue.cc:1048] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:56.064888  4149 raft_consensus.cc:740] T ba7a51e4b70a48daa8267297f285c661 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.065630  4149 consensus_queue.cc:260] T ba7a51e4b70a48daa8267297f285c661 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:56.068771  4149 ts_tablet_manager.cc:1434] T ba7a51e4b70a48daa8267297f285c661 P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.003s
I20260709 13:13:56.069864  4149 tablet_bootstrap.cc:492] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:13:56.070607  4327 raft_consensus.cc:2804] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:56.071014  4327 raft_consensus.cc:493] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.071368  4327 raft_consensus.cc:3060] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.078747  4236 raft_consensus.cc:493] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.079248  4236 raft_consensus.cc:515] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:56.081295  4236 leader_election.cc:290] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:56.083787  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:56.084532  4034 raft_consensus.cc:2468] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 0.
I20260709 13:13:56.085806  4220 leader_election.cc:290] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:56.085975  3925 leader_election.cc:304] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:13:56.086894  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:13:56.063741  4148 tablet_bootstrap.cc:492] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:13:56.087761  4108 raft_consensus.cc:3060] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.087999  4148 ts_tablet_manager.cc:1403] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.091s	user 0.022s	sys 0.015s
I20260709 13:13:56.090267  3958 raft_consensus.cc:3060] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.090087  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:56.090131  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:13:56.090878  4105 raft_consensus.cc:2468] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 0.
I20260709 13:13:56.091560  4236 raft_consensus.cc:2804] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:56.092062  4236 raft_consensus.cc:493] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.092432  4236 raft_consensus.cc:3060] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:56.092749  3997 leader_election.cc:343] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:56.095897  4108 raft_consensus.cc:2468] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 1.
I20260709 13:13:56.097530  4327 raft_consensus.cc:515] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:56.099879  3997 leader_election.cc:304] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:56.101306  4325 raft_consensus.cc:493] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.101823  4325 raft_consensus.cc:515] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:56.104321  4325 leader_election.cc:290] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:56.104678  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:13:56.105501  3954 raft_consensus.cc:3060] T 11c2da89f37f4113a8811c6e081da953 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.107045  4107 raft_consensus.cc:2468] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 1.
I20260709 13:13:56.107692  4220 raft_consensus.cc:2804] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:56.109597  3922 leader_election.cc:304] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:13:56.110234  4220 raft_consensus.cc:697] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:13:56.110476  4325 raft_consensus.cc:2804] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:56.111104  4325 raft_consensus.cc:697] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:13:56.112330  4325 consensus_queue.cc:237] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:56.114714  4148 raft_consensus.cc:359] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:56.116180  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:56.116870  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:56.117560  4033 raft_consensus.cc:2468] T 412d794b0f694d089b1b011ba8adea36 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 0.
I20260709 13:13:56.118203  4107 raft_consensus.cc:2468] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 0.
I20260709 13:13:56.119333  3925 leader_election.cc:304] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:13:56.115420  4148 raft_consensus.cc:385] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.123397  4148 raft_consensus.cc:740] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.124341  4148 consensus_queue.cc:260] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:56.125458  4281 consensus_queue.cc:1048] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:13:56.126772  4281 raft_consensus.cc:2804] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:56.127090  4281 raft_consensus.cc:493] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.127413  4281 raft_consensus.cc:3060] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.134225  4299 raft_consensus.cc:493] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.134718  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:13:56.134819  4299 raft_consensus.cc:515] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:56.135500  4033 raft_consensus.cc:3060] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.137059  4299 leader_election.cc:290] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:56.115422  4220 consensus_queue.cc:237] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:56.137980  4327 leader_election.cc:290] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:56.151991  4148 ts_tablet_manager.cc:1434] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.002s
I20260709 13:13:56.140196  3954 raft_consensus.cc:2468] T 11c2da89f37f4113a8811c6e081da953 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:13:56.147897  4032 raft_consensus.cc:2468] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 1.
I20260709 13:13:56.169044  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:56.169889  3957 raft_consensus.cc:2468] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 0.
I20260709 13:13:56.171227  4148 tablet_bootstrap.cc:492] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:13:56.173977  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:56.173753  3856 catalog_manager.cc:5697] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 1 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:56.177111  3997 leader_election.cc:304] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:13:56.178416  4272 raft_consensus.cc:2804] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:56.178802  4272 raft_consensus.cc:493] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.179059  4236 raft_consensus.cc:515] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:56.179153  4272 raft_consensus.cc:3060] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.187508  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:13:56.188215  4031 raft_consensus.cc:3060] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.191385  4071 leader_election.cc:304] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:13:56.195704  4328 raft_consensus.cc:2804] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:13:56.196893  3997 leader_election.cc:343] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:56.200378  4328 raft_consensus.cc:697] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:13:56.205269  4236 leader_election.cc:290] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:56.206154  4326 raft_consensus.cc:493] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.216574  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:13:56.217332  4108 raft_consensus.cc:3060] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.217430  4272 raft_consensus.cc:515] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:56.218076  4326 raft_consensus.cc:515] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:56.229189  4150 tablet_bootstrap.cc:492] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:13:56.229974  4150 ts_tablet_manager.cc:1403] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.225s	user 0.043s	sys 0.032s
I20260709 13:13:56.253036  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:13:56.251976  4328 consensus_queue.cc:237] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:56.259513  4272 leader_election.cc:290] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:56.271064  4150 raft_consensus.cc:359] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:56.273172  4150 raft_consensus.cc:385] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.273420  4150 raft_consensus.cc:740] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.279778  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:56.280493  4108 raft_consensus.cc:2468] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 1.
I20260709 13:13:56.282601  4033 raft_consensus.cc:2468] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:13:56.267771  4326 leader_election.cc:290] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:56.271435  3959 raft_consensus.cc:3060] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.296555  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:56.298681  4032 raft_consensus.cc:2468] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 0.
W20260709 13:13:56.291973  4071 leader_election.cc:343] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:56.291222  4149 tablet_bootstrap.cc:654] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.303470  4150 consensus_queue.cc:260] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:56.283458  4031 raft_consensus.cc:2468] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 1.
I20260709 13:13:56.305522  3856 catalog_manager.cc:5697] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 1 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:56.314005  4150 ts_tablet_manager.cc:1434] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.084s	user 0.008s	sys 0.001s
I20260709 13:13:56.316332  4150 tablet_bootstrap.cc:492] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:13:56.314930  3925 leader_election.cc:304] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:13:56.329255  4365 raft_consensus.cc:2804] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:56.329849  4365 raft_consensus.cc:697] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:13:56.330828  4365 consensus_queue.cc:237] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:56.302843  3959 raft_consensus.cc:2468] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 1.
I20260709 13:13:56.353434  3997 leader_election.cc:304] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:13:56.354597  4299 raft_consensus.cc:2804] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:56.355074  4299 raft_consensus.cc:697] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:13:56.355999  4299 consensus_queue.cc:237] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:56.362730  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:13:56.364799  4074 leader_election.cc:304] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:56.342937  4281 raft_consensus.cc:515] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:56.367514  4162 consensus_queue.cc:1048] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:13:56.369670  3997 leader_election.cc:343] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:56.371776  4327 raft_consensus.cc:2804] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:56.372670  4327 raft_consensus.cc:493] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.373082  4327 raft_consensus.cc:3060] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.372824  3856 catalog_manager.cc:5697] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 0 to 1, leader changed from <none> to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:56.375301  4150 tablet_bootstrap.cc:654] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.376798  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:13:56.379081  4148 tablet_bootstrap.cc:654] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.384927  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:13:56.375031  4281 leader_election.cc:290] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:56.382561  4327 raft_consensus.cc:515] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:56.395815  4033 raft_consensus.cc:3060] T 412d794b0f694d089b1b011ba8adea36 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.398492  3857 catalog_manager.cc:5697] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 1 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:56.421785  4327 leader_election.cc:290] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:56.422842  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:13:56.423774  4031 raft_consensus.cc:3060] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.407390  4103 raft_consensus.cc:3060] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.422878  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:13:56.450276  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 46348.8us
I20260709 13:13:56.532858  4031 raft_consensus.cc:2468] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:13:56.489512  4326 raft_consensus.cc:493] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.537575  4149 tablet_bootstrap.cc:492] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:13:56.538261  4149 ts_tablet_manager.cc:1403] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.469s	user 0.021s	sys 0.020s
I20260709 13:13:56.535976  4326 raft_consensus.cc:515] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:56.489699  4299 raft_consensus.cc:493] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.546245  4299 raft_consensus.cc:515] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:56.544809  4074 leader_election.cc:304] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:13:56.547660  4328 raft_consensus.cc:2804] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:56.549022  4328 raft_consensus.cc:697] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:13:56.549290  4299 leader_election.cc:290] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:56.558073  4149 raft_consensus.cc:359] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:56.558643  4149 raft_consensus.cc:385] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.558884  4149 raft_consensus.cc:740] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.559434  4149 consensus_queue.cc:260] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:56.537632  4103 raft_consensus.cc:2468] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 1.
I20260709 13:13:56.564590  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:56.577193  4149 ts_tablet_manager.cc:1434] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 13:13:56.550495  4328 consensus_queue.cc:237] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:56.579521  4364 raft_consensus.cc:493] T ba7a51e4b70a48daa8267297f285c661 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.580071  4364 raft_consensus.cc:515] T ba7a51e4b70a48daa8267297f285c661 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:56.581367  4149 tablet_bootstrap.cc:492] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:13:56.582235  3922 leader_election.cc:304] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:13:56.583200  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:13:56.583488  4071 leader_election.cc:343] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:56.584412  4033 raft_consensus.cc:2468] T 412d794b0f694d089b1b011ba8adea36 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 1.
I20260709 13:13:56.585302  4236 raft_consensus.cc:2804] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:56.585774  4236 raft_consensus.cc:697] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:13:56.585726  4327 consensus_queue.cc:1048] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:56.582233  4364 leader_election.cc:290] T ba7a51e4b70a48daa8267297f285c661 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:56.586823  4236 consensus_queue.cc:237] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:56.587962  4326 leader_election.cc:290] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:13:56.590255  3997 leader_election.cc:343] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:56.597373  4148 tablet_bootstrap.cc:492] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:13:56.677956  4150 tablet_bootstrap.cc:492] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:13:56.678162  4148 ts_tablet_manager.cc:1403] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.510s	user 0.021s	sys 0.010s
I20260709 13:13:56.678485  4150 ts_tablet_manager.cc:1403] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.362s	user 0.029s	sys 0.049s
I20260709 13:13:56.674796  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:56.616907  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:56.682344  3958 raft_consensus.cc:2468] T ba7a51e4b70a48daa8267297f285c661 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 0.
I20260709 13:13:56.682715  4150 raft_consensus.cc:359] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:56.683422  4150 raft_consensus.cc:385] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:13:56.606235  3997 leader_election.cc:343] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:56.683833  4150 raft_consensus.cc:740] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.684540  4150 consensus_queue.cc:260] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:56.685696  4364 raft_consensus.cc:493] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.686311  4150 ts_tablet_manager.cc:1434] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:56.686342  4364 raft_consensus.cc:515] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:56.684901  4148 raft_consensus.cc:359] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:56.704797  4149 tablet_bootstrap.cc:654] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.683950  3997 leader_election.cc:304] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:56.690336  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:56.694845  4196 consensus_queue.cc:1048] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:56.700181  4150 tablet_bootstrap.cc:492] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:13:56.629127  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:56.706766  4148 raft_consensus.cc:385] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.707726  4148 raft_consensus.cc:740] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.708508  4148 consensus_queue.cc:260] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:56.710100  4148 ts_tablet_manager.cc:1434] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.001s
I20260709 13:13:56.711127  4148 tablet_bootstrap.cc:492] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:13:56.717993  4029 raft_consensus.cc:2468] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 0.
W20260709 13:13:56.715883  3925 leader_election.cc:343] T ba7a51e4b70a48daa8267297f285c661 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:56.718333  4220 raft_consensus.cc:2749] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:56.724192  4071 leader_election.cc:304] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:13:56.731200  4148 tablet_bootstrap.cc:654] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.732057  3856 catalog_manager.cc:5697] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 1 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:56.717206  4102 raft_consensus.cc:2468] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 0.
I20260709 13:13:56.735725  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:56.728179  4364 leader_election.cc:290] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:56.738389  4196 raft_consensus.cc:2804] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:13:56.732339  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 126181us
I20260709 13:13:56.750092  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:56.751143  4102 raft_consensus.cc:2393] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 1: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:13:56.751435  4196 raft_consensus.cc:493] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.751957  4196 raft_consensus.cc:3060] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.757411  4150 tablet_bootstrap.cc:654] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.763125  3922 leader_election.cc:304] T ba7a51e4b70a48daa8267297f285c661 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:13:56.767508  4364 consensus_queue.cc:1048] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:56.769070  4364 raft_consensus.cc:2804] T ba7a51e4b70a48daa8267297f285c661 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:56.772058  4364 raft_consensus.cc:493] T ba7a51e4b70a48daa8267297f285c661 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.772490  4364 raft_consensus.cc:3060] T ba7a51e4b70a48daa8267297f285c661 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.774616  3925 leader_election.cc:304] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:13:56.771027  4196 raft_consensus.cc:515] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:56.775959  4365 raft_consensus.cc:3060] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.779187  3855 catalog_manager.cc:5697] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 0 to 1, leader changed from <none> to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:56.770906  4149 tablet_bootstrap.cc:492] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:13:56.785753  4149 ts_tablet_manager.cc:1403] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.205s	user 0.014s	sys 0.007s
I20260709 13:13:56.784968  3855 catalog_manager.cc:5697] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 0 to 1, leader changed from <none> to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:56.798092  4220 consensus_queue.cc:1048] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:56.835587  4236 consensus_queue.cc:1048] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:13:56.853385  4384 consensus_queue.cc:1048] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:56.862110  4150 tablet_bootstrap.cc:492] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:13:56.863044  4150 ts_tablet_manager.cc:1403] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.176s	user 0.050s	sys 0.038s
I20260709 13:13:56.837929  3857 catalog_manager.cc:5697] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 1 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:56.864897  4196 leader_election.cc:290] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:56.866575  4150 raft_consensus.cc:359] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:56.867394  4150 raft_consensus.cc:385] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.867720  4150 raft_consensus.cc:740] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.867882  4149 raft_consensus.cc:359] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:56.868955  4150 consensus_queue.cc:260] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:56.869765  4149 raft_consensus.cc:385] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.870579  4149 raft_consensus.cc:740] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
W20260709 13:13:56.871966  3905 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:56.874478  4149 consensus_queue.cc:260] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:56.878556  4106 raft_consensus.cc:3060] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.884157  4150 ts_tablet_manager.cc:1434] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:13:56.890486  4150 tablet_bootstrap.cc:492] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:13:56.906567  4149 ts_tablet_manager.cc:1434] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.121s	user 0.012s	sys 0.018s
I20260709 13:13:56.908363  4149 tablet_bootstrap.cc:492] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:13:56.924539  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:13:56.925277  4028 raft_consensus.cc:3060] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.929538  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:13:56.929760  4236 consensus_queue.cc:1048] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:56.929080  4365 raft_consensus.cc:2749] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:56.940495  4220 consensus_queue.cc:1048] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:56.945899  4148 tablet_bootstrap.cc:492] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:13:56.946488  4148 ts_tablet_manager.cc:1403] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.236s	user 0.022s	sys 0.017s
I20260709 13:13:56.951169  4148 raft_consensus.cc:359] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:56.951962  4148 raft_consensus.cc:385] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.952390  4148 raft_consensus.cc:740] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.951891  4364 raft_consensus.cc:515] T ba7a51e4b70a48daa8267297f285c661 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:56.953151  4148 consensus_queue.cc:260] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:56.954505  4028 raft_consensus.cc:2468] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:13:56.956871  3959 raft_consensus.cc:2393] T ba7a51e4b70a48daa8267297f285c661 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 1: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:13:56.958444  4364 leader_election.cc:290] T ba7a51e4b70a48daa8267297f285c661 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:56.961457  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:13:56.962270  4105 raft_consensus.cc:2393] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 1: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:13:56.963147  4328 raft_consensus.cc:493] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.963675  4328 raft_consensus.cc:515] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:56.968575  4220 consensus_queue.cc:1048] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:56.971184  4328 leader_election.cc:290] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:56.971660  4148 ts_tablet_manager.cc:1434] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.025s	user 0.010s	sys 0.000s
I20260709 13:13:56.972806  4148 tablet_bootstrap.cc:492] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:13:56.977492  4150 tablet_bootstrap.cc:654] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.978658  4196 raft_consensus.cc:493] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.978683  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:56.980614  4384 consensus_queue.cc:1048] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:13:56.984715  3959 raft_consensus.cc:2468] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:13:56.979247  4196 raft_consensus.cc:515] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:56.988394  4196 leader_election.cc:290] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:56.991936  4364 consensus_queue.cc:1048] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:57.002722  4074 leader_election.cc:304] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:57.004347  4328 raft_consensus.cc:2804] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:57.005874  4328 raft_consensus.cc:697] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
W20260709 13:13:57.009810  4394 log.cc:927] Time spent T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:13:57.014343  4149 tablet_bootstrap.cc:654] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.006783  4328 consensus_queue.cc:237] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.020485  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:57.030335  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:57.035238  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:57.014979  4071 leader_election.cc:304] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:13:57.048296  4327 raft_consensus.cc:2804] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:57.048501  4148 tablet_bootstrap.cc:654] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.048884  4327 raft_consensus.cc:493] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:13:57.049382  4327 raft_consensus.cc:3060] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:57.084981  4150 tablet_bootstrap.cc:492] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:13:57.085736  4150 ts_tablet_manager.cc:1403] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.196s	user 0.016s	sys 0.016s
I20260709 13:13:57.097359  4272 consensus_queue.cc:1048] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:57.099841  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:13:57.106418  4150 raft_consensus.cc:359] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.107573  4150 raft_consensus.cc:385] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.107904  4150 raft_consensus.cc:740] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.108796  4150 consensus_queue.cc:260] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.119405  4150 ts_tablet_manager.cc:1434] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.033s	user 0.010s	sys 0.000s
I20260709 13:13:57.113315  4028 raft_consensus.cc:2393] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 1: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:13:57.140852  4149 tablet_bootstrap.cc:492] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:13:57.141641  4149 ts_tablet_manager.cc:1403] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.234s	user 0.020s	sys 0.006s
W20260709 13:13:57.155200  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 83142us
I20260709 13:13:57.155699  4150 tablet_bootstrap.cc:492] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:13:57.166102  4327 raft_consensus.cc:515] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.163221  3925 leader_election.cc:304] T ba7a51e4b70a48daa8267297f285c661 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:13:57.171747  4281 raft_consensus.cc:2749] T ba7a51e4b70a48daa8267297f285c661 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:57.173297  4281 consensus_queue.cc:1048] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:57.206513  4074 leader_election.cc:304] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:57.208547  4148 tablet_bootstrap.cc:492] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:13:57.209154  4148 ts_tablet_manager.cc:1403] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.237s	user 0.026s	sys 0.001s
I20260709 13:13:57.209975  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:13:57.212034  4071 consensus_peers.cc:597] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:57.213531  4327 leader_election.cc:290] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:57.217255  3855 catalog_manager.cc:5697] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 1 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:57.218465  4328 consensus_queue.cc:1048] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:57.220471  4149 raft_consensus.cc:359] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.221128  4149 raft_consensus.cc:385] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.221364  4149 raft_consensus.cc:740] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.221951  4149 consensus_queue.cc:260] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.223522  4150 tablet_bootstrap.cc:654] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.225056  4367 raft_consensus.cc:2749] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:57.240000  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:13:57.247572  4105 raft_consensus.cc:1240] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:57.256824  4149 ts_tablet_manager.cc:1434] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.115s	user 0.005s	sys 0.008s
I20260709 13:13:57.263466  4149 tablet_bootstrap.cc:492] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:13:57.319104  4148 raft_consensus.cc:359] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.320957  4148 raft_consensus.cc:385] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.321254  4148 raft_consensus.cc:740] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.313162  4106 raft_consensus.cc:3060] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.285454  4236 consensus_queue.cc:1048] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.039s
I20260709 13:13:57.328323  4150 tablet_bootstrap.cc:492] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:13:57.328881  4150 ts_tablet_manager.cc:1403] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.188s	user 0.023s	sys 0.014s
I20260709 13:13:57.336169  4148 consensus_queue.cc:260] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.314029  4272 consensus_queue.cc:1059] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 13:13:57.340029  4272 raft_consensus.cc:3055] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:57.340404  4272 raft_consensus.cc:740] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:13:57.335687  4364 raft_consensus.cc:493] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.344846  4148 ts_tablet_manager.cc:1434] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.135s	user 0.010s	sys 0.010s
I20260709 13:13:57.343061  4384 raft_consensus.cc:493] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.345160  4364 raft_consensus.cc:515] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.345584  4384 raft_consensus.cc:515] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.346103  4148 tablet_bootstrap.cc:492] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:13:57.347455  4364 leader_election.cc:290] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:57.349786  4272 consensus_queue.cc:260] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.356319  4149 tablet_bootstrap.cc:654] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.360245  4384 leader_election.cc:290] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:57.363747  4272 raft_consensus.cc:3060] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:57.365511  4150 raft_consensus.cc:359] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.366640  4150 raft_consensus.cc:385] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.366957  4150 raft_consensus.cc:740] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.367977  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:57.367265  4299 raft_consensus.cc:493] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.368599  4150 consensus_queue.cc:260] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.368830  4299 raft_consensus.cc:515] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.370774  4150 ts_tablet_manager.cc:1434] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 13:13:57.370970  4299 leader_election.cc:290] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:57.371822  4150 tablet_bootstrap.cc:492] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:13:57.380339  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:57.380502  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:13:57.384795  4071 leader_election.cc:343] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:57.386210  3997 leader_election.cc:343] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:57.386302  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:57.388190  4074 leader_election.cc:304] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:57.422017  4409 raft_consensus.cc:2749] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:57.434726  4299 raft_consensus.cc:493] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.435293  4299 raft_consensus.cc:515] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.437512  4299 leader_election.cc:290] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:57.445333  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:13:57.448901  3922 leader_election.cc:343] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:57.460005  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:57.467716  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:57.471431  4148 tablet_bootstrap.cc:654] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:57.475875  3997 leader_election.cc:343] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:57.492589  3997 leader_election.cc:343] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:57.493017  4150 tablet_bootstrap.cc:654] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.493134  3997 leader_election.cc:304] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:57.496202  4220 raft_consensus.cc:493] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.496877  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:57.496196  4272 raft_consensus.cc:2749] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:57.496810  4220 raft_consensus.cc:515] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:13:57.506188  3997 leader_election.cc:343] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:57.506714  3997 leader_election.cc:304] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:57.508466  4272 raft_consensus.cc:2749] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:57.509008  4220 leader_election.cc:290] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:57.511970  4028 raft_consensus.cc:2468] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 0.
I20260709 13:13:57.515422  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:57.518399  4149 tablet_bootstrap.cc:492] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
W20260709 13:13:57.518862  4074 leader_election.cc:343] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:57.523162  4074 leader_election.cc:304] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:57.524600  4326 raft_consensus.cc:2749] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:57.521862  4148 tablet_bootstrap.cc:492] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:13:57.525813  4148 ts_tablet_manager.cc:1403] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.180s	user 0.017s	sys 0.016s
W20260709 13:13:57.525753  3997 leader_election.cc:343] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:57.522099  4162 consensus_queue.cc:1048] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:57.528301  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:57.529006  3958 raft_consensus.cc:2468] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 0.
I20260709 13:13:57.529721  4149 ts_tablet_manager.cc:1403] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.267s	user 0.025s	sys 0.040s
I20260709 13:13:57.530602  3997 leader_election.cc:304] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:13:57.531996  4220 raft_consensus.cc:2804] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:57.532382  4220 raft_consensus.cc:493] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.532855  4220 raft_consensus.cc:3060] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.533726  4364 raft_consensus.cc:493] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.534241  4364 raft_consensus.cc:515] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.528908  4148 raft_consensus.cc:359] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.535786  4148 raft_consensus.cc:385] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.536078  4148 raft_consensus.cc:740] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.536808  4148 consensus_queue.cc:260] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.537410  4364 leader_election.cc:290] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:57.538982  4148 ts_tablet_manager.cc:1434] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 13:13:57.539211  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:57.540226  3925 leader_election.cc:304] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:13:57.541350  4364 raft_consensus.cc:2804] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:57.542076  4364 raft_consensus.cc:493] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.543663  4364 raft_consensus.cc:3060] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:57.544281  3922 leader_election.cc:343] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:57.545831  4326 consensus_queue.cc:1048] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:57.546689  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:57.547817  4028 raft_consensus.cc:2468] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 0.
I20260709 13:13:57.546476  4149 raft_consensus.cc:359] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.549149  4149 raft_consensus.cc:385] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.549508  4149 raft_consensus.cc:740] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.550200  4150 tablet_bootstrap.cc:492] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:13:57.550730  4150 ts_tablet_manager.cc:1403] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.179s	user 0.008s	sys 0.004s
I20260709 13:13:57.550944  3925 leader_election.cc:304] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:13:57.552165  4236 raft_consensus.cc:2804] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:57.552517  4236 raft_consensus.cc:493] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.552862  4236 raft_consensus.cc:3060] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.550606  4149 consensus_queue.cc:260] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.555869  4149 ts_tablet_manager.cc:1434] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 13:13:57.555518  4150 raft_consensus.cc:359] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.556493  4150 raft_consensus.cc:385] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.556845  4150 raft_consensus.cc:740] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.559779  4149 tablet_bootstrap.cc:492] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:13:57.560253  4236 raft_consensus.cc:515] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.564237  4148 tablet_bootstrap.cc:492] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:13:57.568110  4150 consensus_queue.cc:260] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.570596  4148 tablet_bootstrap.cc:654] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.571599  4149 tablet_bootstrap.cc:654] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.572156  4220 raft_consensus.cc:515] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.573383  4150 ts_tablet_manager.cc:1434] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:13:57.575680  4150 tablet_bootstrap.cc:492] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:13:57.567608  3955 raft_consensus.cc:3060] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.580520  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:13:57.582916  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:13:57.565716  4364 raft_consensus.cc:515] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:13:57.587047  3997 leader_election.cc:343] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:57.587646  3958 raft_consensus.cc:2393] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 1: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:13:57.587742  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:13:57.587927  4220 leader_election.cc:290] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:57.588347  4028 raft_consensus.cc:3060] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.589660  3997 leader_election.cc:304] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:57.590758  4220 raft_consensus.cc:2749] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:57.592530  4150 tablet_bootstrap.cc:654] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.593978  4162 raft_consensus.cc:493] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.594406  4162 raft_consensus.cc:515] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.596257  4162 leader_election.cc:290] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:57.596858  4028 raft_consensus.cc:2468] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 1.
I20260709 13:13:57.598762  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:57.601815  4364 leader_election.cc:290] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:57.610797  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:13:57.611801  4034 raft_consensus.cc:2393] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 1: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:13:57.613107  3925 leader_election.cc:304] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:13:57.613950  4364 raft_consensus.cc:2804] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:57.614513  4364 raft_consensus.cc:697] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:13:57.615525  4364 consensus_queue.cc:237] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:13:57.618247  4071 leader_election.cc:343] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:57.619745  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:13:57.602393  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:13:57.604307  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:57.624595  4025 raft_consensus.cc:2468] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 0.
I20260709 13:13:57.625708  4149 tablet_bootstrap.cc:492] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
W20260709 13:13:57.625811  3922 leader_election.cc:343] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:57.626101  4074 leader_election.cc:304] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:57.626370  3922 leader_election.cc:304] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:13:57.627498  4326 raft_consensus.cc:2804] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:57.627983  4326 raft_consensus.cc:493] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.628053  4411 raft_consensus.cc:2749] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:57.628489  4326 raft_consensus.cc:3060] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.626346  4149 ts_tablet_manager.cc:1403] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.067s	user 0.020s	sys 0.029s
I20260709 13:13:57.608652  4236 leader_election.cc:290] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:13:57.639930  3922 leader_election.cc:343] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:57.648029  4326 raft_consensus.cc:515] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.636346  4149 raft_consensus.cc:359] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.657845  4149 raft_consensus.cc:385] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.658200  4149 raft_consensus.cc:740] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.658977  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:13:57.659044  4149 consensus_queue.cc:260] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.659708  4028 raft_consensus.cc:3060] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.669368  4149 ts_tablet_manager.cc:1434] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.000s
I20260709 13:13:57.670217  4150 tablet_bootstrap.cc:492] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:13:57.670708  4150 ts_tablet_manager.cc:1403] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.095s	user 0.012s	sys 0.004s
I20260709 13:13:57.671255  4149 tablet_bootstrap.cc:492] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:13:57.672845  4150 raft_consensus.cc:359] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.673367  4150 raft_consensus.cc:385] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.673593  4150 raft_consensus.cc:740] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.674171  4150 consensus_queue.cc:260] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.674685  4028 raft_consensus.cc:2468] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:13:57.676117  4150 ts_tablet_manager.cc:1434] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:13:57.676272  4074 leader_election.cc:304] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:13:57.677276  4384 raft_consensus.cc:2804] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:57.677750  4384 raft_consensus.cc:697] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:13:57.678555  4384 consensus_queue.cc:237] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.679388  4149 tablet_bootstrap.cc:654] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.660799  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:13:57.659734  4326 leader_election.cc:290] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:13:57.682976  4071 leader_election.cc:343] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:57.688230  4148 tablet_bootstrap.cc:492] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:13:57.689020  4148 ts_tablet_manager.cc:1403] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.125s	user 0.024s	sys 0.021s
I20260709 13:13:57.688325  4150 tablet_bootstrap.cc:492] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:13:57.704373  4148 raft_consensus.cc:359] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.705315  4148 raft_consensus.cc:385] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.705583  4148 raft_consensus.cc:740] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.706285  4148 consensus_queue.cc:260] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.709335  4150 tablet_bootstrap.cc:654] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.724514  3857 catalog_manager.cc:5697] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 0 to 1, leader changed from <none> to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:57.729089  4148 ts_tablet_manager.cc:1434] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.001s
I20260709 13:13:57.728045  3855 catalog_manager.cc:5697] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 1 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:57.731758  4148 tablet_bootstrap.cc:492] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:13:57.732000  4149 tablet_bootstrap.cc:492] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:13:57.732458  4149 ts_tablet_manager.cc:1403] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.061s	user 0.007s	sys 0.012s
I20260709 13:13:57.735211  4150 tablet_bootstrap.cc:492] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:13:57.735737  4150 ts_tablet_manager.cc:1403] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.048s	user 0.024s	sys 0.003s
I20260709 13:13:57.739010  4150 raft_consensus.cc:359] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.739833  4150 raft_consensus.cc:385] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.740185  4150 raft_consensus.cc:740] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.735177  4149 raft_consensus.cc:359] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.741765  4149 raft_consensus.cc:385] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.742077  4149 raft_consensus.cc:740] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.742841  4149 consensus_queue.cc:260] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.744395  4149 ts_tablet_manager.cc:1434] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.002s
I20260709 13:13:57.745347  4148 tablet_bootstrap.cc:654] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.745354  4149 tablet_bootstrap.cc:492] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:13:57.749694  4150 consensus_queue.cc:260] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.752140  4150 ts_tablet_manager.cc:1434] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:13:57.753664  4149 tablet_bootstrap.cc:654] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.757625  4150 tablet_bootstrap.cc:492] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:13:57.764165  4149 tablet_bootstrap.cc:492] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:13:57.764638  4149 ts_tablet_manager.cc:1403] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.020s	user 0.003s	sys 0.012s
I20260709 13:13:57.765007  4150 tablet_bootstrap.cc:654] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.768121  4149 raft_consensus.cc:359] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.769066  4149 raft_consensus.cc:385] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.769327  4149 raft_consensus.cc:740] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.770155  4149 consensus_queue.cc:260] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.773851  4148 tablet_bootstrap.cc:492] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:13:57.774389  4148 ts_tablet_manager.cc:1403] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.043s	user 0.010s	sys 0.001s
I20260709 13:13:57.775431  4149 ts_tablet_manager.cc:1434] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.002s
I20260709 13:13:57.776480  4149 tablet_bootstrap.cc:492] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:13:57.777312  4148 raft_consensus.cc:359] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.777993  4148 raft_consensus.cc:385] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.778250  4148 raft_consensus.cc:740] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.778934  4148 consensus_queue.cc:260] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.785136  4148 ts_tablet_manager.cc:1434] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:13:57.785823  4299 raft_consensus.cc:493] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.786303  4148 tablet_bootstrap.cc:492] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:13:57.786347  4299 raft_consensus.cc:515] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.791832  4272 raft_consensus.cc:493] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.792362  4272 raft_consensus.cc:515] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.794399  4272 leader_election.cc:290] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:57.795677  4148 tablet_bootstrap.cc:654] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.795855  4150 tablet_bootstrap.cc:492] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:13:57.796350  4150 ts_tablet_manager.cc:1403] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.009s
I20260709 13:13:57.796984  4149 tablet_bootstrap.cc:654] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.799409  4150 raft_consensus.cc:359] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.800091  4150 raft_consensus.cc:385] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.800350  4150 raft_consensus.cc:740] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.800951  4150 consensus_queue.cc:260] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.803097  4150 ts_tablet_manager.cc:1434] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:13:57.804049  4150 tablet_bootstrap.cc:492] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:13:57.811326  4150 tablet_bootstrap.cc:654] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.816475  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:57.817149  4102 raft_consensus.cc:2468] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 0.
I20260709 13:13:57.818629  4299 leader_election.cc:290] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:57.818531  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:57.820362  3997 leader_election.cc:304] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:13:57.821420  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:57.824818  4106 raft_consensus.cc:2468] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 0.
I20260709 13:13:57.822365  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:57.826387  4149 tablet_bootstrap.cc:492] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:13:57.826306  3958 raft_consensus.cc:2468] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 0.
I20260709 13:13:57.826894  4149 ts_tablet_manager.cc:1403] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.051s	user 0.028s	sys 0.002s
I20260709 13:13:57.828334  4150 tablet_bootstrap.cc:492] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:13:57.828788  4150 ts_tablet_manager.cc:1403] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.001s
I20260709 13:13:57.822964  4148 tablet_bootstrap.cc:492] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:13:57.830070  4148 ts_tablet_manager.cc:1403] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.044s	user 0.020s	sys 0.000s
I20260709 13:13:57.830358  4299 raft_consensus.cc:2804] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:57.830837  4299 raft_consensus.cc:493] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.831316  4299 raft_consensus.cc:3060] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.831710  4150 raft_consensus.cc:359] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.832381  4150 raft_consensus.cc:385] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.832648  4150 raft_consensus.cc:740] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.833176  4149 raft_consensus.cc:359] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.833482  4150 consensus_queue.cc:260] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.833855  4149 raft_consensus.cc:385] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.834403  4149 raft_consensus.cc:740] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.835026  4148 raft_consensus.cc:359] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.835062  4149 consensus_queue.cc:260] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.835781  4148 raft_consensus.cc:385] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.835774  4150 ts_tablet_manager.cc:1434] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:13:57.837241  4149 ts_tablet_manager.cc:1434] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:13:57.842512  4326 raft_consensus.cc:493] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.842952  4148 raft_consensus.cc:740] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.843449  4326 raft_consensus.cc:515] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.843837  4150 tablet_bootstrap.cc:492] T dc2641ff9849458a9200dfc5a9016cce P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:13:57.843847  4148 consensus_queue.cc:260] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.846249  4148 ts_tablet_manager.cc:1434] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
W20260709 13:13:57.836459  3997 leader_election.cc:343] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:57.846290  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:57.847357  4148 tablet_bootstrap.cc:492] T 622bcde3b6ba43678f5eb621e8259db2 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:13:57.848410  3997 leader_election.cc:304] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:13:57.850876  4150 tablet_bootstrap.cc:654] T dc2641ff9849458a9200dfc5a9016cce P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.851423  4272 raft_consensus.cc:2804] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:57.843859  4149 tablet_bootstrap.cc:492] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:13:57.851877  4272 raft_consensus.cc:493] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.852259  4272 raft_consensus.cc:3060] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.859100  4149 tablet_bootstrap.cc:654] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.859467  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:57.871848  4148 tablet_bootstrap.cc:654] T 622bcde3b6ba43678f5eb621e8259db2 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.877420  4272 raft_consensus.cc:515] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.879663  4272 leader_election.cc:290] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:57.870827  4326 leader_election.cc:290] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:57.882982  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:13:57.888155  3958 raft_consensus.cc:3060] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.888301  4236 raft_consensus.cc:493] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.888867  4236 raft_consensus.cc:515] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.872192  4028 raft_consensus.cc:2393] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 1: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:13:57.893653  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:13:57.894393  4106 raft_consensus.cc:3060] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.891165  4364 raft_consensus.cc:493] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.895152  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:57.898046  4364 raft_consensus.cc:515] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.899237  4025 raft_consensus.cc:2468] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 0.
I20260709 13:13:57.903126  4299 raft_consensus.cc:515] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.903810  4150 tablet_bootstrap.cc:492] T dc2641ff9849458a9200dfc5a9016cce P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:13:57.904336  4150 ts_tablet_manager.cc:1403] T dc2641ff9849458a9200dfc5a9016cce P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.061s	user 0.022s	sys 0.032s
I20260709 13:13:57.901079  4074 leader_election.cc:304] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:57.906250  4364 leader_election.cc:290] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:57.906610  4299 leader_election.cc:290] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:57.908219  4367 raft_consensus.cc:493] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.908669  4367 raft_consensus.cc:515] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.910442  4236 leader_election.cc:290] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:57.910737  4367 leader_election.cc:290] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:57.912046  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:13:57.913054  4106 raft_consensus.cc:2468] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 1.
I20260709 13:13:57.913398  4384 raft_consensus.cc:3060] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.913720  3925 leader_election.cc:304] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:13:57.914368  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:57.914605  4364 raft_consensus.cc:2804] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:57.914966  4364 raft_consensus.cc:493] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.915289  4364 raft_consensus.cc:3060] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.918078  3997 leader_election.cc:304] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
W20260709 13:13:57.919094  3997 leader_election.cc:343] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:57.920089  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:57.920178  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:57.920113  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:57.921157  4272 raft_consensus.cc:2804] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:57.921671  4272 raft_consensus.cc:697] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
W20260709 13:13:57.921851  4071 leader_election.cc:343] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:57.922509  4272 consensus_queue.cc:237] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.924913  3958 raft_consensus.cc:2468] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 1.
W20260709 13:13:57.926980  3922 leader_election.cc:343] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:57.927942  3922 leader_election.cc:343] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:57.932729  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:13:57.931666  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:57.935808  4106 raft_consensus.cc:3060] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.937040  4028 raft_consensus.cc:2468] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 0.
I20260709 13:13:57.937592  4364 raft_consensus.cc:515] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.939736  4364 leader_election.cc:290] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:57.923358  4384 raft_consensus.cc:2749] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:57.940248  4150 raft_consensus.cc:359] T dc2641ff9849458a9200dfc5a9016cce P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.940791  4074 leader_election.cc:304] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:57.947835  4150 raft_consensus.cc:385] T dc2641ff9849458a9200dfc5a9016cce P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.942595  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:13:57.948577  4196 raft_consensus.cc:2804] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:57.948678  4034 raft_consensus.cc:3060] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.943259  4149 tablet_bootstrap.cc:492] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:13:57.949049  4196 raft_consensus.cc:493] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.946177  4148 tablet_bootstrap.cc:492] T 622bcde3b6ba43678f5eb621e8259db2 P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:13:57.948167  4150 raft_consensus.cc:740] T dc2641ff9849458a9200dfc5a9016cce P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.949410  4149 ts_tablet_manager.cc:1403] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.106s	user 0.018s	sys 0.005s
I20260709 13:13:57.964322  4148 ts_tablet_manager.cc:1403] T 622bcde3b6ba43678f5eb621e8259db2 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.117s	user 0.014s	sys 0.010s
I20260709 13:13:57.964098  4150 consensus_queue.cc:260] T dc2641ff9849458a9200dfc5a9016cce P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.949462  4196 raft_consensus.cc:3060] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.965838  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:13:57.966533  4025 raft_consensus.cc:2468] T dc2641ff9849458a9200dfc5a9016cce P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 0.
I20260709 13:13:57.971575  3925 leader_election.cc:304] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:13:57.971514  4148 raft_consensus.cc:359] T 622bcde3b6ba43678f5eb621e8259db2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.972322  4148 raft_consensus.cc:385] T 622bcde3b6ba43678f5eb621e8259db2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.949963  3855 catalog_manager.cc:5697] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 1 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:57.972482  4236 raft_consensus.cc:2804] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:57.972661  4148 raft_consensus.cc:740] T 622bcde3b6ba43678f5eb621e8259db2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.972955  4236 raft_consensus.cc:493] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.973357  4236 raft_consensus.cc:3060] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.973533  4148 consensus_queue.cc:260] T 622bcde3b6ba43678f5eb621e8259db2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.974709  4149 raft_consensus.cc:359] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:13:57.975203  4134 tablet.cc:2406] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:13:57.975360  4149 raft_consensus.cc:385] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.975658  4149 raft_consensus.cc:740] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.976250  4149 consensus_queue.cc:260] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.949044  4106 raft_consensus.cc:2468] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 1.
I20260709 13:13:57.981776  4149 ts_tablet_manager.cc:1434] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:13:57.983040  4150 ts_tablet_manager.cc:1434] T dc2641ff9849458a9200dfc5a9016cce P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.078s	user 0.006s	sys 0.007s
I20260709 13:13:57.984159  4150 tablet_bootstrap.cc:492] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:13:57.990327  4150 tablet_bootstrap.cc:654] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.993819  4196 raft_consensus.cc:515] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:57.995231  3997 leader_election.cc:304] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:57.998746  4149 tablet_bootstrap.cc:492] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
W20260709 13:13:58.003136  3922 leader_election.cc:343] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:58.005467  4148 ts_tablet_manager.cc:1434] T 622bcde3b6ba43678f5eb621e8259db2 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.041s	user 0.001s	sys 0.007s
I20260709 13:13:58.005142  4299 raft_consensus.cc:2804] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:58.010036  4299 raft_consensus.cc:697] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:13:58.011925  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:13:58.013375  4071 leader_election.cc:343] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:58.010955  4299 consensus_queue.cc:237] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.013944  4236 raft_consensus.cc:515] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.023999  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:13:58.024750  4025 raft_consensus.cc:3060] T dc2641ff9849458a9200dfc5a9016cce P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.991405  4034 raft_consensus.cc:2468] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 1.
I20260709 13:13:58.028872  4236 leader_election.cc:290] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:58.029860  4196 leader_election.cc:290] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:58.029986  4272 raft_consensus.cc:493] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.030536  4272 raft_consensus.cc:515] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.029996  3925 leader_election.cc:304] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:13:58.033022  4272 leader_election.cc:290] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:58.033255  4236 raft_consensus.cc:2804] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:58.033737  4236 raft_consensus.cc:697] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:13:58.034515  4236 consensus_queue.cc:237] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.035674  4148 tablet_bootstrap.cc:492] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:13:58.036507  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:58.037175  4149 tablet_bootstrap.cc:654] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:58.038014  3997 leader_election.cc:343] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:58.039710  4150 tablet_bootstrap.cc:492] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:13:58.040179  4150 ts_tablet_manager.cc:1403] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.056s	user 0.007s	sys 0.006s
I20260709 13:13:58.047255  4150 raft_consensus.cc:359] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.051623  4150 raft_consensus.cc:385] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:58.051911  4150 raft_consensus.cc:740] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:58.044713  4025 raft_consensus.cc:2468] T dc2641ff9849458a9200dfc5a9016cce P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 1.
I20260709 13:13:58.054452  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:13:58.054984  4034 raft_consensus.cc:3060] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:58.053335  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:58.055884  4150 consensus_queue.cc:260] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.063958  4150 ts_tablet_manager.cc:1434] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.004s
I20260709 13:13:58.064512  3855 catalog_manager.cc:5697] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 0 to 1, leader changed from <none> to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:58.065934  3905 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:58.061129  3925 leader_election.cc:304] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:13:58.073415  4364 raft_consensus.cc:2804] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:58.073930  4364 raft_consensus.cc:697] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:13:58.074747  4364 consensus_queue.cc:237] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.078243  4150 tablet_bootstrap.cc:492] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:13:58.084395  3856 catalog_manager.cc:5697] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 1 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:58.093088  3997 leader_election.cc:343] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:58.093602  3997 leader_election.cc:304] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:58.094314  4034 raft_consensus.cc:2468] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:13:58.094681  4299 raft_consensus.cc:2749] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:58.105350  4148 tablet_bootstrap.cc:654] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:58.106142  4149 tablet_bootstrap.cc:492] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:13:58.111191  4149 ts_tablet_manager.cc:1403] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.119s	user 0.013s	sys 0.011s
I20260709 13:13:58.100647  4281 consensus_queue.cc:1048] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:13:58.110278  4150 tablet_bootstrap.cc:654] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:58.113598  4074 leader_election.cc:304] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:58.115267  4196 raft_consensus.cc:2804] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:58.115918  4196 raft_consensus.cc:697] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:13:58.116953  4196 consensus_queue.cc:237] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.100893  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:13:58.143523  4196 consensus_queue.cc:1048] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 13:13:58.144045  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 43492.8us
W20260709 13:13:58.146834  3922 leader_election.cc:343] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:58.144516  4299 raft_consensus.cc:493] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.151865  4299 raft_consensus.cc:515] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.154150  4299 leader_election.cc:290] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:58.147807  4149 raft_consensus.cc:359] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.156718  4149 raft_consensus.cc:385] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:58.157500  4149 raft_consensus.cc:740] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:13:58.156659  3855 catalog_manager.cc:5697] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 1 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:58.159649  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:58.161578  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:13:58.165604  3997 leader_election.cc:343] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:58.163421  3856 catalog_manager.cc:5697] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 0 to 1, leader changed from <none> to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:58.170773  3997 leader_election.cc:343] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:58.161455  4149 consensus_queue.cc:260] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.171299  3997 leader_election.cc:304] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:58.173503  4272 raft_consensus.cc:2749] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:58.175174  4149 ts_tablet_manager.cc:1434] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.063s	user 0.008s	sys 0.000s
I20260709 13:13:58.176287  4149 tablet_bootstrap.cc:492] T 0d4e65893d284960aef32d35d0db30a4 P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:13:58.187232  4148 tablet_bootstrap.cc:492] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:13:58.187925  4148 ts_tablet_manager.cc:1403] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.155s	user 0.012s	sys 0.010s
I20260709 13:13:58.202426  4149 tablet_bootstrap.cc:654] T 0d4e65893d284960aef32d35d0db30a4 P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:58.205621  4148 raft_consensus.cc:359] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.207013  4150 tablet_bootstrap.cc:492] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:13:58.208436  4148 raft_consensus.cc:385] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:58.208740  4148 raft_consensus.cc:740] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:13:58.208901  4150 ts_tablet_manager.cc:1403] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.137s	user 0.015s	sys 0.008s
I20260709 13:13:58.209422  4148 consensus_queue.cc:260] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.211913  4150 raft_consensus.cc:359] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.216688  4150 raft_consensus.cc:385] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:58.216975  4150 raft_consensus.cc:740] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:58.217861  3958 raft_consensus.cc:3060] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:58.217746  4150 consensus_queue.cc:260] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.219137  4148 ts_tablet_manager.cc:1434] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.001s
I20260709 13:13:58.220026  4150 ts_tablet_manager.cc:1434] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:13:58.221164  4150 tablet_bootstrap.cc:492] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:13:58.227814  4150 tablet_bootstrap.cc:654] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:58.220170  4148 tablet_bootstrap.cc:492] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:13:58.234637  4236 consensus_queue.cc:1048] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:58.238312  4148 tablet_bootstrap.cc:654] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:58.253839  4409 consensus_queue.cc:1048] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:58.285461  4150 tablet_bootstrap.cc:492] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:13:58.286041  4150 ts_tablet_manager.cc:1403] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.065s	user 0.005s	sys 0.026s
I20260709 13:13:58.288904  4150 raft_consensus.cc:359] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.289613  4150 raft_consensus.cc:385] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:58.289870  4150 raft_consensus.cc:740] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:58.290566  4150 consensus_queue.cc:260] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.292032  4148 tablet_bootstrap.cc:492] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:13:58.305606  4148 ts_tablet_manager.cc:1403] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.086s	user 0.019s	sys 0.013s
I20260709 13:13:58.305958  4272 consensus_queue.cc:1048] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:58.308145  4409 raft_consensus.cc:493] T 622bcde3b6ba43678f5eb621e8259db2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.308884  4409 raft_consensus.cc:515] T 622bcde3b6ba43678f5eb621e8259db2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.314687  4149 tablet_bootstrap.cc:492] T 0d4e65893d284960aef32d35d0db30a4 P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:13:58.315200  4149 ts_tablet_manager.cc:1403] T 0d4e65893d284960aef32d35d0db30a4 P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.139s	user 0.016s	sys 0.037s
I20260709 13:13:58.318638  4149 raft_consensus.cc:359] T 0d4e65893d284960aef32d35d0db30a4 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.319298  4149 raft_consensus.cc:385] T 0d4e65893d284960aef32d35d0db30a4 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:58.319566  4149 raft_consensus.cc:740] T 0d4e65893d284960aef32d35d0db30a4 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:13:58.320303  4149 consensus_queue.cc:260] T 0d4e65893d284960aef32d35d0db30a4 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.322010  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:58.322228  4409 leader_election.cc:290] T 622bcde3b6ba43678f5eb621e8259db2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:58.324011  4236 raft_consensus.cc:493] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.324471  4236 raft_consensus.cc:515] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.325479  4220 consensus_queue.cc:1048] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:58.326545  4236 leader_election.cc:290] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:58.329130  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:58.329567  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:58.329783  4026 raft_consensus.cc:2468] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 0.
I20260709 13:13:58.330348  4025 raft_consensus.cc:2393] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 1: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:13:58.331538  3925 leader_election.cc:304] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:13:58.332356  4449 raft_consensus.cc:2804] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:58.332774  4449 raft_consensus.cc:493] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:58.333163  4449 raft_consensus.cc:3060] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:58.333925  4150 ts_tablet_manager.cc:1434] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.048s	user 0.005s	sys 0.004s
I20260709 13:13:58.308836  4148 raft_consensus.cc:359] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.334429  4148 raft_consensus.cc:385] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:58.334715  4148 raft_consensus.cc:740] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:13:58.335356  4148 consensus_queue.cc:260] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.336862  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:58.338303  4148 ts_tablet_manager.cc:1434] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:13:58.339341  4148 tablet_bootstrap.cc:492] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
W20260709 13:13:58.340267  3922 leader_election.cc:343] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:58.342993  4071 leader_election.cc:304] T 622bcde3b6ba43678f5eb621e8259db2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:58.344120  4149 ts_tablet_manager.cc:1434] T 0d4e65893d284960aef32d35d0db30a4 P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.001s
I20260709 13:13:58.344063  4409 raft_consensus.cc:3060] T 622bcde3b6ba43678f5eb621e8259db2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:58.365629  4149 tablet_bootstrap.cc:492] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:13:58.367966  4150 tablet_bootstrap.cc:492] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:13:58.372318  4148 tablet_bootstrap.cc:654] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:58.376106  4409 raft_consensus.cc:2749] T 622bcde3b6ba43678f5eb621e8259db2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:58.377091  4449 raft_consensus.cc:515] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.382066  4150 tablet_bootstrap.cc:654] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:58.387938  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:13:58.388875  4025 raft_consensus.cc:3060] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:58.391269  4449 leader_election.cc:290] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:58.392285  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
W20260709 13:13:58.397184  3922 leader_election.cc:343] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:58.416129  4025 raft_consensus.cc:2468] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 1.
I20260709 13:13:58.395043  4149 tablet_bootstrap.cc:654] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:58.417865  3925 leader_election.cc:304] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:13:58.419480  4449 raft_consensus.cc:2804] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:58.420130  4449 raft_consensus.cc:697] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:13:58.421373  4449 consensus_queue.cc:237] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.423555  4150 tablet_bootstrap.cc:492] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:13:58.424090  4150 ts_tablet_manager.cc:1403] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.057s	user 0.018s	sys 0.028s
I20260709 13:13:58.424990  4148 tablet_bootstrap.cc:492] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:13:58.425333  4149 tablet_bootstrap.cc:492] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:13:58.425513  4148 ts_tablet_manager.cc:1403] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.086s	user 0.025s	sys 0.029s
I20260709 13:13:58.425797  4149 ts_tablet_manager.cc:1403] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.060s	user 0.008s	sys 0.004s
I20260709 13:13:58.427000  4150 raft_consensus.cc:359] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.427788  4150 raft_consensus.cc:385] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:58.428118  4150 raft_consensus.cc:740] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:58.428762  4150 consensus_queue.cc:260] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.431051  4150 ts_tablet_manager.cc:1434] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:13:58.431236  4149 raft_consensus.cc:359] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.431944  4149 raft_consensus.cc:385] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:58.432235  4149 raft_consensus.cc:740] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:13:58.432914  4149 consensus_queue.cc:260] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.434090  4150 tablet_bootstrap.cc:492] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:13:58.435050  4149 ts_tablet_manager.cc:1434] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:13:58.436085  4149 tablet_bootstrap.cc:492] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:13:58.436578  4148 raft_consensus.cc:359] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.439718  4148 raft_consensus.cc:385] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:58.440126  4148 raft_consensus.cc:740] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:13:58.444815  4150 tablet_bootstrap.cc:654] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:58.446941  4148 consensus_queue.cc:260] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.457129  4148 ts_tablet_manager.cc:1434] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 13:13:58.458176  4148 tablet_bootstrap.cc:492] T 08d6732bceef4220a670ac449347258b P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:13:58.459570  3856 catalog_manager.cc:5697] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 0 to 1, leader changed from <none> to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:58.471033  4364 raft_consensus.cc:493] T 0d4e65893d284960aef32d35d0db30a4 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.471648  4364 raft_consensus.cc:515] T 0d4e65893d284960aef32d35d0db30a4 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.474153  4364 leader_election.cc:290] T 0d4e65893d284960aef32d35d0db30a4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:58.477339  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:58.477701  4150 tablet_bootstrap.cc:492] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:13:58.478216  4150 ts_tablet_manager.cc:1403] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.044s	user 0.009s	sys 0.013s
I20260709 13:13:58.478308  4149 tablet_bootstrap.cc:654] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:58.474360  4148 tablet_bootstrap.cc:654] T 08d6732bceef4220a670ac449347258b P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:58.474821  4196 raft_consensus.cc:493] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.479259  4196 raft_consensus.cc:515] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.474989  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:58.482575  4102 raft_consensus.cc:2393] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 1: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:13:58.485939  4196 leader_election.cc:290] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:58.487481  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:58.490293  3925 leader_election.cc:304] T 0d4e65893d284960aef32d35d0db30a4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:13:58.490429  4150 raft_consensus.cc:359] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.491505  4150 raft_consensus.cc:385] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:58.491588  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:58.491868  3957 raft_consensus.cc:3060] T 0d4e65893d284960aef32d35d0db30a4 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:58.492096  4150 raft_consensus.cc:740] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:58.492569  4025 raft_consensus.cc:2393] T dc2641ff9849458a9200dfc5a9016cce P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 1: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:13:58.493306  4150 consensus_queue.cc:260] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.494180  4074 leader_election.cc:304] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:58.500303  4150 ts_tablet_manager.cc:1434] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.004s
I20260709 13:13:58.502701  4196 raft_consensus.cc:3060] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:58.503917  4150 tablet_bootstrap.cc:492] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:13:58.513420  4149 tablet_bootstrap.cc:492] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:13:58.514430  4149 ts_tablet_manager.cc:1403] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.079s	user 0.017s	sys 0.005s
I20260709 13:13:58.519380  4149 raft_consensus.cc:359] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.526957  4364 raft_consensus.cc:2749] T 0d4e65893d284960aef32d35d0db30a4 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:58.527369  4149 raft_consensus.cc:385] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:58.528020  4149 raft_consensus.cc:740] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:13:58.529063  4149 consensus_queue.cc:260] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.531019  4196 raft_consensus.cc:2749] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:58.526787  4150 tablet_bootstrap.cc:654] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:58.533309  4149 ts_tablet_manager.cc:1434] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.018s	user 0.010s	sys 0.000s
I20260709 13:13:58.534520  4149 tablet_bootstrap.cc:492] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:13:58.537591  4150 tablet_bootstrap.cc:492] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:13:58.538278  4150 ts_tablet_manager.cc:1403] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.001s
I20260709 13:13:58.538196  4272 consensus_queue.cc:1048] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:58.541402  4149 tablet_bootstrap.cc:654] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:58.541901  4148 tablet_bootstrap.cc:492] T 08d6732bceef4220a670ac449347258b P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:13:58.542450  4148 ts_tablet_manager.cc:1403] T 08d6732bceef4220a670ac449347258b P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.084s	user 0.019s	sys 0.038s
I20260709 13:13:58.548651  4150 raft_consensus.cc:359] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.549724  4150 raft_consensus.cc:385] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:58.550117  4150 raft_consensus.cc:740] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:58.551056  4150 consensus_queue.cc:260] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.554363  4150 ts_tablet_manager.cc:1434] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.003s
I20260709 13:13:58.555948  4150 tablet_bootstrap.cc:492] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:13:58.557813  4148 raft_consensus.cc:359] T 08d6732bceef4220a670ac449347258b P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.558656  4148 raft_consensus.cc:385] T 08d6732bceef4220a670ac449347258b P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:58.559090  4148 raft_consensus.cc:740] T 08d6732bceef4220a670ac449347258b P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:13:58.559873  4148 consensus_queue.cc:260] T 08d6732bceef4220a670ac449347258b P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.560724  4149 tablet_bootstrap.cc:492] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:13:58.562673  4149 ts_tablet_manager.cc:1403] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.008s
I20260709 13:13:58.563596  4150 tablet_bootstrap.cc:654] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:58.565548  4149 raft_consensus.cc:359] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.566234  4149 raft_consensus.cc:385] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:58.566576  4149 raft_consensus.cc:740] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:13:58.562101  4148 ts_tablet_manager.cc:1434] T 08d6732bceef4220a670ac449347258b P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:13:58.569845  4148 tablet_bootstrap.cc:492] T eae506e79ba348b3b1db60ecc6ae6714 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:13:58.571379  4272 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.571911  4272 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.573668  4272 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:58.574800  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:58.567397  4149 consensus_queue.cc:260] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:13:58.580837  3997 leader_election.cc:343] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:58.581548  4149 ts_tablet_manager.cc:1434] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:13:58.582336  4150 tablet_bootstrap.cc:492] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:13:58.582515  4149 tablet_bootstrap.cc:492] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:13:58.582827  4150 ts_tablet_manager.cc:1403] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.008s
I20260709 13:13:58.585888  4150 raft_consensus.cc:359] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.586638  4150 raft_consensus.cc:385] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:58.586897  4150 raft_consensus.cc:740] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:58.590909  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:58.591161  4150 consensus_queue.cc:260] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.592581  4220 raft_consensus.cc:493] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.593175  4220 raft_consensus.cc:515] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.593760  4299 consensus_queue.cc:1048] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:58.595280  4220 leader_election.cc:290] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:58.597985  4150 ts_tablet_manager.cc:1434] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.004s
I20260709 13:13:58.599169  4150 tablet_bootstrap.cc:492] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
W20260709 13:13:58.601351  3997 leader_election.cc:343] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:58.601588  4364 consensus_queue.cc:1048] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:58.601840  3997 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:58.603824  4220 raft_consensus.cc:2749] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:58.605376  4149 tablet_bootstrap.cc:654] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:58.614508  4148 tablet_bootstrap.cc:654] T eae506e79ba348b3b1db60ecc6ae6714 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:58.614017  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:58.615520  4106 raft_consensus.cc:2468] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
I20260709 13:13:58.622824  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:58.632184  3997 leader_election.cc:304] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:13:58.633646  4272 raft_consensus.cc:2804] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:58.634593  4272 raft_consensus.cc:493] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:58.635172  4272 raft_consensus.cc:3060] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:58.636596  4236 consensus_queue.cc:1048] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:58.639844  4364 consensus_queue.cc:1048] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:58.642444  4326 raft_consensus.cc:493] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.643153  4326 raft_consensus.cc:515] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.646059  4326 leader_election.cc:290] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:58.649121  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:58.649923  4236 raft_consensus.cc:493] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.650554  4236 raft_consensus.cc:515] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:13:58.651403  4071 leader_election.cc:343] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:58.654106  4236 leader_election.cc:290] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:58.662750  4449 raft_consensus.cc:493] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.663324  4449 raft_consensus.cc:515] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.672863  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:58.665575  4449 leader_election.cc:290] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:58.689635  4236 consensus_queue.cc:1048] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:58.696282  4150 tablet_bootstrap.cc:654] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:58.696779  4409 raft_consensus.cc:493] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.706255  3958 raft_consensus.cc:3060] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:58.707723  4299 raft_consensus.cc:493] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.707791  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:58.708369  4299 raft_consensus.cc:515] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.703269  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:58.709843  4029 raft_consensus.cc:2393] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 1: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:13:58.710819  4299 leader_election.cc:290] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:13:58.732103  3922 leader_election.cc:343] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:58.744717  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:58.745517  3958 raft_consensus.cc:2468] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 0.
I20260709 13:13:58.698088  4026 raft_consensus.cc:2468] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 0.
I20260709 13:13:58.749264  4196 consensus_queue.cc:1048] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:58.712898  4272 raft_consensus.cc:515] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.760576  4149 tablet_bootstrap.cc:492] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:13:58.760756  4272 leader_election.cc:290] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:58.761247  4149 ts_tablet_manager.cc:1403] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.179s	user 0.043s	sys 0.068s
I20260709 13:13:58.715695  4409 raft_consensus.cc:515] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.765123  4409 leader_election.cc:290] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:58.757872  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:58.766237  4149 raft_consensus.cc:359] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.767138  4149 raft_consensus.cc:385] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:58.767474  4149 raft_consensus.cc:740] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:13:58.769011  4149 consensus_queue.cc:260] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.770970  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:58.771256  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:58.771725  4149 ts_tablet_manager.cc:1434] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 13:13:58.792261  4149 tablet_bootstrap.cc:492] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:13:58.791780  4028 raft_consensus.cc:2468] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 0.
I20260709 13:13:58.810165  4299 raft_consensus.cc:493] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.810966  4299 raft_consensus.cc:515] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.818823  3997 leader_election.cc:304] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:13:58.823340  4449 raft_consensus.cc:493] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.823848  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:13:58.829526  4150 tablet_bootstrap.cc:492] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:13:58.830266  4150 ts_tablet_manager.cc:1403] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.231s	user 0.032s	sys 0.034s
I20260709 13:13:58.824000  4449 raft_consensus.cc:515] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.846890  3925 leader_election.cc:304] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:13:58.847888  4281 raft_consensus.cc:2804] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:58.848299  4281 raft_consensus.cc:493] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:58.848657  4281 raft_consensus.cc:3060] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:58.848706  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:58.849447  4150 raft_consensus.cc:359] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.850183  4150 raft_consensus.cc:385] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:58.850534  4150 raft_consensus.cc:740] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
W20260709 13:13:58.851269  3997 leader_election.cc:343] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:58.855247  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:58.855481  4449 leader_election.cc:290] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:58.856267  3957 raft_consensus.cc:2393] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 1: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:13:58.862066  4150 consensus_queue.cc:260] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.863806  4299 leader_election.cc:290] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:58.876752  3922 leader_election.cc:304] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:13:58.878383  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:58.881136  4026 raft_consensus.cc:2393] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 1: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:13:58.893093  4491 raft_consensus.cc:493] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.894042  4149 tablet_bootstrap.cc:654] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:58.859145  4485 raft_consensus.cc:2804] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:58.866073  4490 raft_consensus.cc:493] T 08d6732bceef4220a670ac449347258b P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:58.895474  3997 leader_election.cc:343] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:58.896500  4220 raft_consensus.cc:493] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.895910  4491 raft_consensus.cc:515] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.912025  4220 raft_consensus.cc:515] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.904641  4490 raft_consensus.cc:515] T 08d6732bceef4220a670ac449347258b P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.904712  4299 raft_consensus.cc:493] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.901252  4485 raft_consensus.cc:493] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:58.925575  4148 tablet_bootstrap.cc:492] T eae506e79ba348b3b1db60ecc6ae6714 P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:13:59.016062  4148 ts_tablet_manager.cc:1403] T eae506e79ba348b3b1db60ecc6ae6714 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.447s	user 0.060s	sys 0.061s
I20260709 13:13:58.944986  4074 leader_election.cc:304] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:58.924860  4449 raft_consensus.cc:493] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
W20260709 13:13:59.031421  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 86570us
I20260709 13:13:59.042654  4196 consensus_queue.cc:1048] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:59.065300  4236 raft_consensus.cc:2749] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:59.067337  4220 leader_election.cc:290] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:59.027918  4299 raft_consensus.cc:515] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:59.069880  4490 leader_election.cc:290] T 08d6732bceef4220a670ac449347258b P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:13:59.028092  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 179584us
I20260709 13:13:59.054663  4484 raft_consensus.cc:2804] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:59.039060  4449 raft_consensus.cc:515] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:59.071411  4299 leader_election.cc:290] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:59.116257  4148 raft_consensus.cc:359] T eae506e79ba348b3b1db60ecc6ae6714 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:59.117203  4148 raft_consensus.cc:385] T eae506e79ba348b3b1db60ecc6ae6714 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:59.117478  4148 raft_consensus.cc:740] T eae506e79ba348b3b1db60ecc6ae6714 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:13:59.125193  4150 ts_tablet_manager.cc:1434] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.295s	user 0.009s	sys 0.014s
I20260709 13:13:59.090339  4484 raft_consensus.cc:493] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:59.138911  4148 consensus_queue.cc:260] T eae506e79ba348b3b1db60ecc6ae6714 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:58.981112  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:59.141863  4150 tablet_bootstrap.cc:492] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:13:59.116755  4485 raft_consensus.cc:3060] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:59.144157  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 101909us
I20260709 13:13:59.145076  4074 leader_election.cc:304] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:59.145388  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:59.146081  3959 raft_consensus.cc:2468] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 0.
I20260709 13:13:59.147919  3997 leader_election.cc:304] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:13:59.137830  4484 raft_consensus.cc:3060] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:59.256531  4148 ts_tablet_manager.cc:1434] T eae506e79ba348b3b1db60ecc6ae6714 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.238s	user 0.009s	sys 0.000s
I20260709 13:13:59.152613  4486 raft_consensus.cc:2804] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:59.259649  4488 raft_consensus.cc:3060] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:59.275641  4496 log.cc:927] Time spent T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 13:13:59.202550  4491 leader_election.cc:290] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:59.259721  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:59.151683  4281 raft_consensus.cc:515] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:59.263144  4486 raft_consensus.cc:493] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:59.492158  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 347225us
I20260709 13:13:59.288143  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:13:59.505393  3997 leader_election.cc:343] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:59.333554  4364 raft_consensus.cc:493] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:59.330659  4449 leader_election.cc:290] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:59.497933  4272 raft_consensus.cc:493] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:59.511236  4149 tablet_bootstrap.cc:492] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:13:59.514999  4149 ts_tablet_manager.cc:1403] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.742s	user 0.021s	sys 0.016s
I20260709 13:13:59.497965  4486 raft_consensus.cc:3060] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:59.510027  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 177701us
I20260709 13:13:59.504756  4299 raft_consensus.cc:493] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:59.523854  3905 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:59.527271  4299 raft_consensus.cc:515] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:59.532793  4485 raft_consensus.cc:515] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:59.520396  4272 raft_consensus.cc:515] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:59.515920  4364 raft_consensus.cc:515] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:59.534430  4484 raft_consensus.cc:515] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:59.558305  4485 leader_election.cc:290] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:59.565366  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:13:59.571183  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 71033.6us
I20260709 13:13:59.573437  4364 leader_election.cc:290] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:59.578991  4150 tablet_bootstrap.cc:654] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:59.581141  3922 leader_election.cc:343] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:59.582983  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:59.584578  4149 raft_consensus.cc:359] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:59.585258  4149 raft_consensus.cc:385] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:59.585587  4149 raft_consensus.cc:740] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:13:59.586686  4149 consensus_queue.cc:260] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:59.604802  4149 ts_tablet_manager.cc:1434] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.089s	user 0.002s	sys 0.005s
I20260709 13:13:59.627911  4236 raft_consensus.cc:493] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:59.628561  4236 raft_consensus.cc:515] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:59.589293  4281 leader_election.cc:290] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:59.639634  4236 leader_election.cc:290] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:59.697805  4236 raft_consensus.cc:493] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:13:59.698845  4236 raft_consensus.cc:515] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:13:59.712864  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 74666.2us
I20260709 13:13:59.697785  4488 raft_consensus.cc:2749] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:59.696857  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:59.720875  4236 leader_election.cc:290] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:59.726744  4033 raft_consensus.cc:2393] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 1: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:13:59.725251  4484 leader_election.cc:290] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:59.732645  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:59.732712  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:13:59.733680  4025 raft_consensus.cc:3060] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:59.723685  4299 leader_election.cc:290] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:59.742487  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:59.743279  4029 raft_consensus.cc:2468] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 0.
I20260709 13:13:59.745623  4512 raft_consensus.cc:493] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:13:59.746207  4512 raft_consensus.cc:515] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:59.773011  3925 leader_election.cc:304] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:13:59.756143  4486 raft_consensus.cc:515] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:59.785158  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:59.780239  4449 raft_consensus.cc:2804] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:59.789526  4028 raft_consensus.cc:2468] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 1.
I20260709 13:13:59.794307  4449 raft_consensus.cc:493] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:59.805334  4512 leader_election.cc:290] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:13:59.809211  4150 tablet_bootstrap.cc:492] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:13:59.809711  4150 ts_tablet_manager.cc:1403] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.668s	user 0.028s	sys 0.008s
I20260709 13:13:59.810837  4026 raft_consensus.cc:2393] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 1: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:13:59.807104  4449 raft_consensus.cc:3060] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:59.830377  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 56299.3us
I20260709 13:13:59.830442  4409 raft_consensus.cc:493] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:13:59.840303  4409 raft_consensus.cc:515] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:59.808069  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:59.858039  4149 tablet_bootstrap.cc:492] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:13:59.816743  4025 raft_consensus.cc:2468] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 1.
I20260709 13:13:59.852006  4326 raft_consensus.cc:493] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:13:59.868387  4326 raft_consensus.cc:515] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:59.873208  4100 raft_consensus.cc:2393] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 1: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:13:59.891826  4148 tablet_bootstrap.cc:492] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:13:59.891579  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:13:59.892612  4104 raft_consensus.cc:3060] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:59.898924  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:13:59.900022  4099 raft_consensus.cc:3060] T eae506e79ba348b3b1db60ecc6ae6714 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:59.895757  4490 raft_consensus.cc:493] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:13:59.913020  4150 raft_consensus.cc:359] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:59.916326  4150 raft_consensus.cc:385] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:59.921070  4486 leader_election.cc:290] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:59.924984  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:13:59.925159  4150 raft_consensus.cc:740] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:13:59.917768  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:59.926203  4150 consensus_queue.cc:260] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:59.921114  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:59.933282  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:59.934831  4272 leader_election.cc:290] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:13:59.935900  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:13:59.936736  4031 raft_consensus.cc:2368] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 2. Current term is 3.
I20260709 13:13:59.909385  4490 raft_consensus.cc:515] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:59.939066  4150 ts_tablet_manager.cc:1434] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.129s	user 0.006s	sys 0.010s
I20260709 13:13:59.941125  4150 tablet_bootstrap.cc:492] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:13:59.945586  3956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 228) took 1032 ms. Trace:
I20260709 13:13:59.946094  3956 rpcz_store.cc:276] 0709 13:13:58.926191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:58.947227 (+ 21036us) service_pool.cc:224] Handling call
0709 13:13:59.944819 (+997592us) spinlock_profiling.cc:243] Waited 4.68 ms on lock 0x7b5800002d98. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f1522549b71 00007f1522549a22 00007f152b462c09 00007f152a5bcee0 00007f152a6860ab 00007f152a686131 00007f152a647fc0 00007f152a632929 00007f152a6323d2 00007f1523ba9bd4
0709 13:13:59.945017 (+   198us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:59.945193 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:59.945221 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:59.945279 (+    58us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:59.945325 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:59.945394 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:59.945517 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10772224}
I20260709 13:13:59.959293  4074 leader_election.cc:304] T 08d6732bceef4220a670ac449347258b P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
W20260709 13:13:59.959844  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 43672.5us
I20260709 13:13:59.960680  4367 raft_consensus.cc:3060] T 08d6732bceef4220a670ac449347258b P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:59.939960  4490 leader_election.cc:290] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:13:59.963820  3997 leader_election.cc:343] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:59.967279  4272 raft_consensus.cc:493] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:13:59.968109  4272 raft_consensus.cc:515] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } }
W20260709 13:13:59.969679  3997 leader_election.cc:343] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:59.970342  3997 leader_election.cc:304] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:13:59.958819  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:13:59.962962  4508 log.cc:927] Time spent T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.365s	user 0.000s	sys 0.004s
I20260709 13:13:59.972851  4486 raft_consensus.cc:2749] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:59.977252  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:59.980304  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:13:59.981021  3956 raft_consensus.cc:3060] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:59.982074  4149 tablet_bootstrap.cc:654] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:59.982676  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:13:59.990638  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:59.991964  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:59.991787  4449 raft_consensus.cc:515] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:13:59.994202  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:13:59.994856  3952 raft_consensus.cc:2393] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 1: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:13:59.997617  4104 raft_consensus.cc:2468] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 3.
I20260709 13:13:59.998270  4104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45336 (request call id 78) took 1078 ms. Trace:
I20260709 13:13:59.998642  4104 rpcz_store.cc:276] 0709 13:13:58.919561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:58.922738 (+  3177us) service_pool.cc:224] Handling call
0709 13:13:59.066034 (+143296us) spinlock_profiling.cc:243] Waited 1.26 ms on lock 0x7b5800011798. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f1522549b71 00007f1522549a22 00007f152b462c09 00007f152a5bcee0 00007f152a6860ab 00007f152a686131 00007f152a6340a0 00007f152a633984 00007f1523bae6d4 00007f1523bae662
0709 13:13:59.852257 (+786223us) spinlock_profiling.cc:243] Waited 3.67 ms on lock 0x7b5800011798. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f1522549e9c 00007f1522549a5b 00007f152b462c09 00007f152a5bcee0 00007f152a6860ab 00007f152a686131 00007f152a6340a0 00007f152a633984 00007f1523bae6d4 00007f1523bae662
0709 13:13:59.998175 (+145918us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11331584}
I20260709 13:14:00.000265  4272 leader_election.cc:290] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339)
I20260709 13:14:00.001190  4099 raft_consensus.cc:2468] T eae506e79ba348b3b1db60ecc6ae6714 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 1.
I20260709 13:14:00.008785  4409 leader_election.cc:290] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:00.010370  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:00.014554  3956 raft_consensus.cc:2468] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 1.
I20260709 13:14:00.014688  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:00.015638  3954 raft_consensus.cc:2468] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 1.
I20260709 13:13:59.994256  4449 leader_election.cc:290] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:00.020437  4367 raft_consensus.cc:2749] T 08d6732bceef4220a670ac449347258b P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:00.022418  4148 tablet_bootstrap.cc:654] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:00.025321  3997 leader_election.cc:343] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:00.025876  3997 leader_election.cc:304] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:00.026996  4196 raft_consensus.cc:493] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:00.027446  4196 raft_consensus.cc:515] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:00.029511  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:00.032953  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:00.033268  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:00.034255  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:00.035390  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:00.036062  4102 raft_consensus.cc:2468] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 1.
I20260709 13:14:00.040870  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:00.043154  4196 leader_election.cc:290] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:00.044180  4494 raft_consensus.cc:2749] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:00.049862  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:00.050621  3957 raft_consensus.cc:3060] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.050777  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:00.051743  4103 raft_consensus.cc:2368] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 2. Current term is 3.
I20260709 13:14:00.053326  3997 leader_election.cc:304] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
W20260709 13:14:00.054404  3997 leader_election.cc:343] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:00.055824  3997 leader_election.cc:304] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:00.058458  4498 raft_consensus.cc:2804] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:00.059021  4498 raft_consensus.cc:697] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
W20260709 13:14:00.061563  3997 leader_election.cc:343] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:00.062817  3997 leader_election.cc:343] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:00.063970  3925 leader_election.cc:304] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:14:00.065738  3997 leader_election.cc:343] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:00.065970  3925 leader_election.cc:304] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:14:00.066442  3997 leader_election.cc:343] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:00.067305  3997 leader_election.cc:304] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:00.066869  3925 leader_election.cc:304] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:00.070926  4521 raft_consensus.cc:2804] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:00.071390  4521 raft_consensus.cc:493] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:00.071767  4521 raft_consensus.cc:3060] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:00.072505  4149 tablet_bootstrap.cc:492] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:14:00.073172  4149 ts_tablet_manager.cc:1403] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.215s	user 0.027s	sys 0.024s
I20260709 13:14:00.076277  4523 raft_consensus.cc:2804] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:00.076877  4523 raft_consensus.cc:697] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
W20260709 13:14:00.084795  4510 log.cc:927] Time spent T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.363s	user 0.000s	sys 0.007s
I20260709 13:14:00.086776  4326 leader_election.cc:290] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:00.087409  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:00.088186  4105 raft_consensus.cc:2468] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 1.
I20260709 13:14:00.065814  4485 raft_consensus.cc:2749] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:00.095562  3925 leader_election.cc:400] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115) with higher term. Message: Invalid argument: T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 2. Current term is 3.
I20260709 13:14:00.067588  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:00.096048  3925 leader_election.cc:403] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:00.103255  4236 raft_consensus.cc:3060] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:14:00.106058  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:00.090214  4272 raft_consensus.cc:2804] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:00.106803  4030 raft_consensus.cc:3060] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.107434  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:00.110730  3922 leader_election.cc:304] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
W20260709 13:14:00.113570  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 46353.7us
I20260709 13:14:00.077790  4523 consensus_queue.cc:237] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:00.106832  4272 raft_consensus.cc:493] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:00.144354  3922 leader_election.cc:400] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843) with higher term. Message: Invalid argument: T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 2. Current term is 3.
I20260709 13:14:00.152113  4500 raft_consensus.cc:2749] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:00.153920  4150 tablet_bootstrap.cc:654] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.062281  4498 consensus_queue.cc:237] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:00.158511  3997 leader_election.cc:343] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:00.159049  3997 leader_election.cc:304] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:00.160104  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:00.160248  4149 raft_consensus.cc:359] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:00.161051  4149 raft_consensus.cc:385] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.156662  4364 consensus_queue.cc:1048] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:14:00.161440  4149 raft_consensus.cc:740] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.145170  4272 raft_consensus.cc:3060] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:00.162508  4236 raft_consensus.cc:2749] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115) with higher term. Message: Invalid argument: T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 2. Current term is 3.
I20260709 13:14:00.161019  4107 raft_consensus.cc:2393] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 1: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:00.162477  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:00.168596  4149 consensus_queue.cc:260] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:00.173352  4148 tablet_bootstrap.cc:492] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:14:00.173938  4148 ts_tablet_manager.cc:1403] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.282s	user 0.014s	sys 0.013s
I20260709 13:14:00.168123  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:00.173599  4485 raft_consensus.cc:2749] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:00.183804  4149 ts_tablet_manager.cc:1434] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.110s	user 0.007s	sys 0.003s
I20260709 13:14:00.184927  4149 tablet_bootstrap.cc:492] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:14:00.184746  3957 raft_consensus.cc:2468] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 1.
I20260709 13:14:00.185403  4281 raft_consensus.cc:2749] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:00.182260  3997 leader_election.cc:304] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:00.190058  4485 raft_consensus.cc:2804] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:00.190578  4485 raft_consensus.cc:697] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:00.195794  3997 leader_election.cc:304] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:00.199679  3997 leader_election.cc:304] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:00.200070  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:00.203027  4527 raft_consensus.cc:2749] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:00.203244  4494 raft_consensus.cc:2804] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:00.204454  4494 raft_consensus.cc:697] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:00.202221  4281 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.205169  4281 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:00.200791  4030 raft_consensus.cc:2468] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:14:00.191468  4485 consensus_queue.cc:237] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:00.205372  4494 consensus_queue.cc:237] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:00.230536  4148 raft_consensus.cc:359] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:00.232276  4148 raft_consensus.cc:385] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.232712  4148 raft_consensus.cc:740] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.220006  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:00.227885  4521 raft_consensus.cc:515] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:00.229449  4272 raft_consensus.cc:515] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:00.300091  4150 tablet_bootstrap.cc:492] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:14:00.400831  4150 ts_tablet_manager.cc:1403] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.461s	user 0.030s	sys 0.000s
I20260709 13:14:00.296738  4281 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:00.236815  4148 consensus_queue.cc:260] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:00.279752  4498 raft_consensus.cc:493] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.405941  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:00.409842  4026 raft_consensus.cc:2393] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 1: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:00.407438  4498 raft_consensus.cc:515] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:00.417824  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:00.312413  4299 raft_consensus.cc:493] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:00.423864  4299 raft_consensus.cc:515] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:00.424966  3856 catalog_manager.cc:5697] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:00.425021  3922 leader_election.cc:343] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:00.469563  4523 raft_consensus.cc:493] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.470139  4523 raft_consensus.cc:515] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:00.475184  4523 leader_election.cc:290] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:00.491973  4498 leader_election.cc:290] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:00.497234  4148 ts_tablet_manager.cc:1434] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.323s	user 0.032s	sys 0.035s
I20260709 13:14:00.522344  4148 tablet_bootstrap.cc:492] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:14:00.549481  4521 leader_election.cc:290] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:00.550060  4150 raft_consensus.cc:359] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:00.550848  4150 raft_consensus.cc:385] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.551378  4150 raft_consensus.cc:740] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.552325  4150 consensus_queue.cc:260] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:00.553583  4272 leader_election.cc:290] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:00.554003  4150 ts_tablet_manager.cc:1434] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.153s	user 0.005s	sys 0.002s
I20260709 13:14:00.555154  4150 tablet_bootstrap.cc:492] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:14:00.558089  4149 tablet_bootstrap.cc:654] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.563328  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:00.563724  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:00.567234  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:00.564069  4103 raft_consensus.cc:3060] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:00.569505  4299 leader_election.cc:290] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:00.571101  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:00.554243  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:00.583881  4299 raft_consensus.cc:493] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.584410  4299 raft_consensus.cc:515] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:00.586535  4299 leader_election.cc:290] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:00.587885  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:00.588557  4026 raft_consensus.cc:2468] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 0.
I20260709 13:14:00.594400  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:14:00.595167  3922 leader_election.cc:343] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:00.575968  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:00.580350  4074 leader_election.cc:304] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:00.599010  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:14:00.602885  3997 leader_election.cc:343] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:00.605285  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:00.606101  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:00.607374  4031 raft_consensus.cc:2393] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 2: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:14:00.607720  4514 raft_consensus.cc:2749] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:00.608417  3925 leader_election.cc:304] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:00.609385  4074 leader_election.cc:304] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:00.610023  4364 raft_consensus.cc:2749] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:14:00.610517  4074 leader_election.cc:304] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:00.611928  4487 raft_consensus.cc:2749] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:00.613397  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:00.610052  4519 consensus_queue.cc:1048] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:14:00.616065  4326 raft_consensus.cc:2749] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:00.606146  3955 raft_consensus.cc:2393] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 2: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:14:00.621332  3925 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:00.622152  4236 raft_consensus.cc:2804] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:00.621351  4074 leader_election.cc:304] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:00.622519  4236 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:00.622929  4236 raft_consensus.cc:3060] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.623179  4196 raft_consensus.cc:2749] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:00.624112  4074 leader_election.cc:304] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:00.629748  3925 leader_election.cc:304] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:00.629969  4074 leader_election.cc:304] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:00.630471  4236 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:00.633630  4236 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:00.634229  4326 raft_consensus.cc:2804] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:00.634558  4367 raft_consensus.cc:2749] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:00.634791  4326 raft_consensus.cc:697] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:00.635023  4103 raft_consensus.cc:2468] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
W20260709 13:14:00.636104  3905 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:00.635687  4326 consensus_queue.cc:237] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:00.637048  4519 raft_consensus.cc:2749] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:00.639142  4367 raft_consensus.cc:493] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.639426  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:00.639648  4367 raft_consensus.cc:515] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:00.640039  4031 raft_consensus.cc:3060] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.641629  4367 leader_election.cc:290] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:00.615262  4030 raft_consensus.cc:2468] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 0.
I20260709 13:14:00.644734  4150 tablet_bootstrap.cc:654] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.646438  3925 leader_election.cc:304] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:00.644444  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:00.648289  3955 raft_consensus.cc:2393] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 1: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:14:00.659516  3997 leader_election.cc:304] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:00.655939  4519 raft_consensus.cc:2804] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:00.660532  4519 raft_consensus.cc:493] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:00.660880  4519 raft_consensus.cc:3060] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.661152  4149 tablet_bootstrap.cc:492] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:14:00.661690  4149 ts_tablet_manager.cc:1403] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.477s	user 0.014s	sys 0.036s
W20260709 13:14:00.660933  3997 leader_election.cc:343] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:00.662726  3997 leader_election.cc:304] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:00.664366  3997 leader_election.cc:304] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:00.662249  4299 raft_consensus.cc:2749] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:00.661912  4031 raft_consensus.cc:2468] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 1.
I20260709 13:14:00.671520  4272 raft_consensus.cc:2749] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:00.683682  3857 catalog_manager.cc:5697] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 1 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:00.685124  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
W20260709 13:14:00.686995  3922 leader_election.cc:343] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:00.687705  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:00.688685  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:00.692425  4074 leader_election.cc:304] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:00.693981  3997 leader_election.cc:304] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:00.673688  4485 raft_consensus.cc:2804] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:00.698151  4485 raft_consensus.cc:697] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:00.699137  4485 consensus_queue.cc:237] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:00.671636  4108 raft_consensus.cc:3060] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.707708  4148 tablet_bootstrap.cc:654] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.709164  3955 raft_consensus.cc:1275] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:00.711304  4272 consensus_queue.cc:1048] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:00.713737  4236 consensus_queue.cc:1048] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:00.721498  4149 raft_consensus.cc:359] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:00.725032  3925 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:00.725579  4149 raft_consensus.cc:385] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.726035  4149 raft_consensus.cc:740] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.726811  4236 raft_consensus.cc:2804] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:00.727303  4236 raft_consensus.cc:697] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:00.726962  4149 consensus_queue.cc:260] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:00.728106  4236 consensus_queue.cc:237] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:00.719059  4519 raft_consensus.cc:515] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:00.740252  4149 ts_tablet_manager.cc:1434] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.078s	user 0.006s	sys 0.002s
I20260709 13:14:00.736502  4281 consensus_queue.cc:1048] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:14:00.740959  4494 raft_consensus.cc:2749] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:00.745445  4487 raft_consensus.cc:2749] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:00.753139  4149 tablet_bootstrap.cc:492] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:14:00.781977  3855 catalog_manager.cc:5697] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 0 to 1, leader changed from <none> to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:00.813089  4103 raft_consensus.cc:1275] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:00.813448  4299 raft_consensus.cc:493] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.813947  4299 raft_consensus.cc:515] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:00.760267  4485 consensus_queue.cc:1048] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
W20260709 13:14:00.826707  4545 log.cc:927] Time spent T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:14:00.828251  4485 consensus_queue.cc:1048] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:14:00.840272  4519 leader_election.cc:290] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:00.936421  4150 tablet_bootstrap.cc:492] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:14:00.860626  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:00.937093  4150 ts_tablet_manager.cc:1403] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.382s	user 0.019s	sys 0.019s
W20260709 13:14:00.860006  4544 log.cc:927] Time spent T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:14:00.940830  4148 tablet_bootstrap.cc:492] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:14:00.869863  4149 tablet_bootstrap.cc:654] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.941412  4148 ts_tablet_manager.cc:1403] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.422s	user 0.016s	sys 0.014s
I20260709 13:14:00.944579  4148 raft_consensus.cc:359] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:00.948237  4150 raft_consensus.cc:359] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:00.949087  4150 raft_consensus.cc:385] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.949393  4150 raft_consensus.cc:740] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.951414  4148 raft_consensus.cc:385] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.951895  4148 raft_consensus.cc:740] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.952629  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:00.950160  4150 consensus_queue.cc:260] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:00.953294  4030 raft_consensus.cc:3060] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.954234  4150 ts_tablet_manager.cc:1434] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.004s
I20260709 13:14:00.955379  4150 tablet_bootstrap.cc:492] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:14:00.952677  4148 consensus_queue.cc:260] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:00.958277  3922 leader_election.cc:343] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:00.971524  4299 leader_election.cc:290] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:00.971932  4148 ts_tablet_manager.cc:1434] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.002s
I20260709 13:14:00.972956  4148 tablet_bootstrap.cc:492] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:14:00.976805  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:14:00.978672  3997 leader_election.cc:343] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:00.981280  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:00.982973  4148 tablet_bootstrap.cc:654] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.990091  4150 tablet_bootstrap.cc:654] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.993675  4494 consensus_queue.cc:1048] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:01.003283  4148 tablet_bootstrap.cc:492] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:14:01.003909  4148 ts_tablet_manager.cc:1403] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.002s
W20260709 13:14:01.006254  3997 leader_election.cc:343] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:01.006763  3997 leader_election.cc:304] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:01.007134  4148 raft_consensus.cc:359] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.007900  4148 raft_consensus.cc:385] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:01.008177  4148 raft_consensus.cc:740] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:14:01.008420  4494 raft_consensus.cc:2749] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:01.008931  4148 consensus_queue.cc:260] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.010532  4149 tablet_bootstrap.cc:492] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:14:01.011183  4149 ts_tablet_manager.cc:1403] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.261s	user 0.009s	sys 0.012s
I20260709 13:14:01.011380  4148 ts_tablet_manager.cc:1434] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:14:01.019214  4149 raft_consensus.cc:359] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.020134  4149 raft_consensus.cc:385] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:01.020479  4149 raft_consensus.cc:740] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:14:01.021327  4149 consensus_queue.cc:260] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.024586  4149 ts_tablet_manager.cc:1434] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:14:01.031001  4149 tablet_bootstrap.cc:492] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:14:01.036861  4030 raft_consensus.cc:2468] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 1.
I20260709 13:14:01.038762  4148 tablet_bootstrap.cc:492] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:14:01.043514  4494 consensus_queue.cc:1048] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:01.046191  4149 tablet_bootstrap.cc:654] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:01.050287  3925 leader_election.cc:304] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:01.051689  4493 raft_consensus.cc:2804] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:01.052245  4493 raft_consensus.cc:697] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:01.053089  4493 consensus_queue.cc:237] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.057593  4106 raft_consensus.cc:3060] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:01.057898  4148 tablet_bootstrap.cc:654] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:01.064275  4150 tablet_bootstrap.cc:492] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:14:01.064849  4150 ts_tablet_manager.cc:1403] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.110s	user 0.005s	sys 0.022s
I20260709 13:14:01.067678  4150 raft_consensus.cc:359] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.068425  4150 raft_consensus.cc:385] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:01.068698  4150 raft_consensus.cc:740] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:14:01.071329  4150 consensus_queue.cc:260] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.073668  4150 ts_tablet_manager.cc:1434] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:14:01.073779  3857 catalog_manager.cc:5697] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 1 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:14:01.074795  4150 tablet_bootstrap.cc:492] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:14:01.085958  4150 tablet_bootstrap.cc:654] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:01.122093  4149 tablet_bootstrap.cc:492] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:14:01.124035  4149 ts_tablet_manager.cc:1403] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.093s	user 0.022s	sys 0.008s
I20260709 13:14:01.129596  4236 raft_consensus.cc:493] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:01.130307  4236 raft_consensus.cc:515] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.133003  4236 leader_election.cc:290] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:01.137564  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:01.138608  4030 raft_consensus.cc:2468] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 0.
I20260709 13:14:01.143895  3925 leader_election.cc:304] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:01.145401  4236 raft_consensus.cc:2804] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:01.145807  4236 raft_consensus.cc:493] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:01.146132  4236 raft_consensus.cc:3060] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:01.149538  4519 consensus_queue.cc:1048] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:01.153753  4514 raft_consensus.cc:493] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:01.154575  4514 raft_consensus.cc:515] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.158694  4505 raft_consensus.cc:493] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:01.159286  4505 raft_consensus.cc:515] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.128202  4149 raft_consensus.cc:359] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.160342  4149 raft_consensus.cc:385] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:01.160634  4149 raft_consensus.cc:740] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:14:01.161811  4505 leader_election.cc:290] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:01.163589  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:01.164304  4028 raft_consensus.cc:2468] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 0.
I20260709 13:14:01.165683  3925 leader_election.cc:304] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:01.166410  4487 consensus_queue.cc:1048] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:01.166940  4505 raft_consensus.cc:2804] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:01.168255  4505 raft_consensus.cc:493] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:01.168699  4505 raft_consensus.cc:3060] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:01.163470  4149 consensus_queue.cc:260] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.163482  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:01.178314  4149 ts_tablet_manager.cc:1434] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.054s	user 0.004s	sys 0.003s
I20260709 13:14:01.179663  4149 tablet_bootstrap.cc:492] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:14:01.182324  4485 consensus_queue.cc:1048] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:01.181499  4505 raft_consensus.cc:515] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.157711  4514 leader_election.cc:290] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:01.190495  4148 tablet_bootstrap.cc:492] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:14:01.191074  4148 ts_tablet_manager.cc:1403] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.153s	user 0.031s	sys 0.036s
I20260709 13:14:01.166131  4236 raft_consensus.cc:515] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.186246  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:01.192374  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:01.193008  4033 raft_consensus.cc:3060] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:01.193912  4236 leader_election.cc:290] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:01.194183  4148 raft_consensus.cc:359] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.195008  4148 raft_consensus.cc:385] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:01.195338  4148 raft_consensus.cc:740] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:14:01.196192  4148 consensus_queue.cc:260] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.197710  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:01.198400  4028 raft_consensus.cc:3060] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:01.199484  4148 ts_tablet_manager.cc:1434] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:14:01.201402  4148 tablet_bootstrap.cc:492] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:14:01.203261  4033 raft_consensus.cc:2468] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 1.
I20260709 13:14:01.209833  3957 raft_consensus.cc:1275] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:14:01.212107  4485 consensus_queue.cc:1048] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:01.212718  4028 raft_consensus.cc:2468] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 1.
I20260709 13:14:01.208755  4149 tablet_bootstrap.cc:654] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:01.214795  3925 leader_election.cc:304] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:01.216293  4493 raft_consensus.cc:2804] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:01.217052  4493 raft_consensus.cc:697] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:01.218214  4493 consensus_queue.cc:237] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.221710  3925 leader_election.cc:304] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:01.222579  4236 raft_consensus.cc:2804] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:01.223292  4236 raft_consensus.cc:697] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:01.224332  4236 consensus_queue.cc:237] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.218833  4148 tablet_bootstrap.cc:654] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:01.212306  4505 leader_election.cc:290] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:01.241025  4485 raft_consensus.cc:493] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:01.241690  4485 raft_consensus.cc:515] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.251921  3856 catalog_manager.cc:5697] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 0 to 1, leader changed from <none> to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:01.261291  4512 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:01.262113  4512 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.264777  4512 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:01.266855  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:01.271047  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:01.272023  4107 raft_consensus.cc:2468] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 0.
I20260709 13:14:01.274061  4107 raft_consensus.cc:3060] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:01.285341  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:01.286505  4149 tablet_bootstrap.cc:492] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:14:01.286696  4485 leader_election.cc:290] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:01.287140  4149 ts_tablet_manager.cc:1403] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.108s	user 0.025s	sys 0.019s
W20260709 13:14:01.287266  3997 leader_election.cc:343] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:01.290895  4149 raft_consensus.cc:359] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.295753  4149 raft_consensus.cc:385] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:01.296305  4149 raft_consensus.cc:740] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:14:01.298190  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:01.298528  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:01.299072  4106 raft_consensus.cc:3060] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:01.299299  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:01.297538  4149 consensus_queue.cc:260] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.320518  4505 raft_consensus.cc:493] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:01.321255  4505 raft_consensus.cc:515] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.321866  4106 raft_consensus.cc:2468] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 1.
I20260709 13:14:01.320868  4149 ts_tablet_manager.cc:1434] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 13:14:01.323980  4149 tablet_bootstrap.cc:492] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:14:01.323911  4449 raft_consensus.cc:493] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:01.324615  4449 raft_consensus.cc:515] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.327404  4449 leader_election.cc:290] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:01.327943  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:01.328764  4030 raft_consensus.cc:2468] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 0.
I20260709 13:14:01.330400  4150 tablet_bootstrap.cc:492] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:14:01.330333  3925 leader_election.cc:304] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:01.331161  4519 raft_consensus.cc:2804] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:01.331579  4519 raft_consensus.cc:493] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:01.331914  4519 raft_consensus.cc:3060] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:01.332471  4149 tablet_bootstrap.cc:654] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:01.335798  4150 ts_tablet_manager.cc:1403] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.261s	user 0.052s	sys 0.096s
I20260709 13:14:01.343456  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:01.345649  4099 raft_consensus.cc:1275] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:14:01.348726  4149 tablet_bootstrap.cc:492] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:14:01.349371  4149 ts_tablet_manager.cc:1403] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.003s
I20260709 13:14:01.350054  4519 raft_consensus.cc:515] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.350636  4150 raft_consensus.cc:359] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.351361  4150 raft_consensus.cc:385] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:01.351671  4150 raft_consensus.cc:740] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:14:01.351480  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:01.352249  4030 raft_consensus.cc:2468] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 0.
I20260709 13:14:01.352723  4149 raft_consensus.cc:359] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.353183  4519 leader_election.cc:290] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:01.352955  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:01.353500  4149 raft_consensus.cc:385] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:01.353289  4150 consensus_queue.cc:260] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.353863  4028 raft_consensus.cc:3060] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:01.353981  4149 raft_consensus.cc:740] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:14:01.355120  4150 ts_tablet_manager.cc:1434] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:14:01.354878  4149 consensus_queue.cc:260] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.356305  4150 tablet_bootstrap.cc:492] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:14:01.357234  4149 ts_tablet_manager.cc:1434] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:14:01.358271  4149 tablet_bootstrap.cc:492] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:14:01.359985  3925 leader_election.cc:304] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:01.360839  4236 raft_consensus.cc:2804] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:01.361240  4236 raft_consensus.cc:493] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:01.361572  4236 raft_consensus.cc:3060] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:01.360845  4028 raft_consensus.cc:2468] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 1.
I20260709 13:14:01.363765  4150 tablet_bootstrap.cc:654] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:01.364398  3925 leader_election.cc:304] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:01.365027  4148 tablet_bootstrap.cc:492] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:14:01.365145  4149 tablet_bootstrap.cc:654] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:01.365321  4519 raft_consensus.cc:2804] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:01.367816  4519 raft_consensus.cc:697] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:01.368774  4519 consensus_queue.cc:237] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.374853  4505 leader_election.cc:290] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:01.374781  4485 raft_consensus.cc:493] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:01.375975  4150 tablet_bootstrap.cc:492] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:14:01.375946  4485 raft_consensus.cc:515] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.377486  4149 tablet_bootstrap.cc:492] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:14:01.378568  4149 ts_tablet_manager.cc:1403] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.020s	user 0.004s	sys 0.014s
I20260709 13:14:01.379048  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:01.381861  4149 raft_consensus.cc:359] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.382551  4485 leader_election.cc:290] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:01.382860  4149 raft_consensus.cc:385] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:01.382915  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:01.383460  4149 raft_consensus.cc:740] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:14:01.384395  4149 consensus_queue.cc:260] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.390254  4149 ts_tablet_manager.cc:1434] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 13:14:01.391882  4149 tablet_bootstrap.cc:492] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:14:01.376605  4150 ts_tablet_manager.cc:1403] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.008s
I20260709 13:14:01.401191  4150 raft_consensus.cc:359] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.401988  4150 raft_consensus.cc:385] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:01.402719  4150 raft_consensus.cc:740] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
W20260709 13:14:01.406194  3922 leader_election.cc:343] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:01.407737  4150 consensus_queue.cc:260] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.410153  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:01.410621  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:01.388870  3957 raft_consensus.cc:2468] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 0.
I20260709 13:14:01.413403  4149 tablet_bootstrap.cc:654] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:01.414346  3922 leader_election.cc:343] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:01.420430  4148 ts_tablet_manager.cc:1403] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.219s	user 0.021s	sys 0.021s
I20260709 13:14:01.421217  4449 consensus_queue.cc:1048] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:14:01.422078  3922 leader_election.cc:343] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:01.423242  3997 leader_election.cc:304] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:01.415997  4150 ts_tablet_manager.cc:1434] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:14:01.424700  4150 tablet_bootstrap.cc:492] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:14:01.424714  4485 raft_consensus.cc:2804] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:01.425220  4485 raft_consensus.cc:493] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:01.427681  4148 raft_consensus.cc:359] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.425571  4485 raft_consensus.cc:3060] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:01.428364  4148 raft_consensus.cc:385] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:01.428671  4148 raft_consensus.cc:740] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:14:01.427201  3855 catalog_manager.cc:5697] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 1 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:01.433241  3855 catalog_manager.cc:5697] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 0 to 2, leader changed from <none> to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 2 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:01.430334  4148 consensus_queue.cc:260] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.440294  4150 tablet_bootstrap.cc:654] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:01.440251  4519 raft_consensus.cc:493] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:01.441150  4148 ts_tablet_manager.cc:1434] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.003s
I20260709 13:14:01.440991  4519 raft_consensus.cc:515] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.442237  4148 tablet_bootstrap.cc:492] T 6e863d888e2a4327a9127a43deb1f1b9 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:14:01.442752  4236 raft_consensus.cc:515] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.451655  4236 leader_election.cc:290] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:01.455957  4519 leader_election.cc:290] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:01.457748  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:01.459084  4149 tablet_bootstrap.cc:492] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:14:01.458823  4030 raft_consensus.cc:2468] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 0.
I20260709 13:14:01.459683  4149 ts_tablet_manager.cc:1403] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.068s	user 0.010s	sys 0.010s
I20260709 13:14:01.461615  4150 tablet_bootstrap.cc:492] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:14:01.462159  4150 ts_tablet_manager.cc:1403] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.038s	user 0.019s	sys 0.000s
I20260709 13:14:01.465469  3925 leader_election.cc:304] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:01.465237  4150 raft_consensus.cc:359] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.466077  4150 raft_consensus.cc:385] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:01.466321  4148 tablet_bootstrap.cc:654] T 6e863d888e2a4327a9127a43deb1f1b9 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:01.466393  4150 raft_consensus.cc:740] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:14:01.466820  4449 raft_consensus.cc:2804] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:01.467247  4449 raft_consensus.cc:493] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:01.467705  4449 raft_consensus.cc:3060] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:01.467338  4150 consensus_queue.cc:260] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.463295  4149 raft_consensus.cc:359] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.469703  4149 raft_consensus.cc:385] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:01.471536  4149 raft_consensus.cc:740] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:14:01.469779  4150 ts_tablet_manager.cc:1434] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:14:01.472854  4149 consensus_queue.cc:260] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.476131  4150 tablet_bootstrap.cc:492] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2: Bootstrap starting.
I20260709 13:14:01.476011  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:01.476694  4028 raft_consensus.cc:3060] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:01.477111  4149 ts_tablet_manager.cc:1434] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.003s
I20260709 13:14:01.478312  4149 tablet_bootstrap.cc:492] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:14:01.483940  4150 tablet_bootstrap.cc:654] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:01.484500  4148 tablet_bootstrap.cc:492] T 6e863d888e2a4327a9127a43deb1f1b9 P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:14:01.485128  4148 ts_tablet_manager.cc:1403] T 6e863d888e2a4327a9127a43deb1f1b9 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.043s	user 0.007s	sys 0.005s
I20260709 13:14:01.485687  4149 tablet_bootstrap.cc:654] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:01.488348  4148 raft_consensus.cc:359] T 6e863d888e2a4327a9127a43deb1f1b9 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.492116  4148 raft_consensus.cc:385] T 6e863d888e2a4327a9127a43deb1f1b9 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:01.492511  4148 raft_consensus.cc:740] T 6e863d888e2a4327a9127a43deb1f1b9 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:14:01.493430  4148 consensus_queue.cc:260] T 6e863d888e2a4327a9127a43deb1f1b9 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.499586  4148 ts_tablet_manager.cc:1434] T 6e863d888e2a4327a9127a43deb1f1b9 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:14:01.500771  4148 tablet_bootstrap.cc:492] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:14:01.514129  4272 consensus_queue.cc:1048] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:01.532095  4236 raft_consensus.cc:493] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:01.532935  4236 raft_consensus.cc:515] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.535187  4236 leader_election.cc:290] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:01.548220  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:01.549060  4030 raft_consensus.cc:2468] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 0.
W20260709 13:14:01.550329  3997 leader_election.cc:343] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:01.551252  3925 leader_election.cc:304] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:01.550897  3997 leader_election.cc:304] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:01.552350  4236 raft_consensus.cc:2804] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:01.554850  4449 raft_consensus.cc:515] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.556670  4485 raft_consensus.cc:515] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.557125  4028 raft_consensus.cc:2468] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 1.
I20260709 13:14:01.558063  4236 raft_consensus.cc:493] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:01.566462  4236 raft_consensus.cc:3060] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:01.558640  4494 raft_consensus.cc:2749] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:01.592716  3925 leader_election.cc:304] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:01.598215  4449 leader_election.cc:290] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:01.598960  4236 raft_consensus.cc:515] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.600314  4485 leader_election.cc:290] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:01.601462  4236 leader_election.cc:290] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:01.609751  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:01.612391  4074 leader_election.cc:304] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:01.612769  3957 raft_consensus.cc:3060] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:01.603858  4519 raft_consensus.cc:2804] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:01.614835  4519 raft_consensus.cc:697] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:01.615322  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:01.615999  4030 raft_consensus.cc:3060] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:01.615747  4519 consensus_queue.cc:237] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.625586  4150 tablet_bootstrap.cc:492] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2: No bootstrap required, opened a new log
I20260709 13:14:01.626173  4150 ts_tablet_manager.cc:1403] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent bootstrapping tablet: real 0.152s	user 0.034s	sys 0.015s
I20260709 13:14:01.627704  4498 raft_consensus.cc:493] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:01.628245  4498 raft_consensus.cc:515] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.638423  4236 consensus_queue.cc:1048] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:01.666391  3957 raft_consensus.cc:2468] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 1.
I20260709 13:14:01.674676  4582 raft_consensus.cc:2749] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:01.680701  4150 raft_consensus.cc:359] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.682067  4150 raft_consensus.cc:385] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:01.682427  4150 raft_consensus.cc:740] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Initialized, Role: FOLLOWER
I20260709 13:14:01.686658  4487 consensus_queue.cc:1048] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:01.686944  4074 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:01.687758  4514 raft_consensus.cc:2749] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:01.688223  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:01.692356  4033 raft_consensus.cc:3060] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:01.697494  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 70645.3us
I20260709 13:14:01.683197  4150 consensus_queue.cc:260] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.700212  4149 tablet_bootstrap.cc:492] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:14:01.700788  4149 ts_tablet_manager.cc:1403] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.223s	user 0.025s	sys 0.051s
I20260709 13:14:01.700923  4148 tablet_bootstrap.cc:654] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:01.706380  4150 ts_tablet_manager.cc:1434] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent starting tablet: real 0.080s	user 0.009s	sys 0.000s
I20260709 13:14:01.707121  4149 raft_consensus.cc:359] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.707952  4149 raft_consensus.cc:385] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:01.708240  4149 raft_consensus.cc:740] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:14:01.709134  4033 raft_consensus.cc:2468] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 1.
I20260709 13:14:01.708876  4149 consensus_queue.cc:260] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.713039  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:01.703625  4030 raft_consensus.cc:2468] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 1.
I20260709 13:14:01.715514  4236 consensus_queue.cc:1048] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:01.718891  4149 ts_tablet_manager.cc:1434] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:14:01.719449  3925 leader_election.cc:304] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:01.720012  4149 tablet_bootstrap.cc:492] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:14:01.720423  4236 raft_consensus.cc:2804] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:01.721107  4236 raft_consensus.cc:697] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:01.721741  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:01.722500  3950 raft_consensus.cc:2468] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 0.
I20260709 13:14:01.721956  4236 consensus_queue.cc:237] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.723486  3997 leader_election.cc:304] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:01.724349  4580 raft_consensus.cc:2804] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:01.724888  4580 raft_consensus.cc:697] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:01.725747  4580 consensus_queue.cc:237] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.727928  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:01.774638  4498 leader_election.cc:290] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:01.779579  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:01.780578  3925 leader_election.cc:304] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:01.781597  4493 raft_consensus.cc:2804] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:01.782107  4493 raft_consensus.cc:697] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:01.783028  4493 consensus_queue.cc:237] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:01.793298  3997 leader_election.cc:343] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:01.796160  3997 leader_election.cc:304] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:01.797364  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:01.797873  4498 raft_consensus.cc:2804] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:01.798290  4498 raft_consensus.cc:493] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:01.798642  4498 raft_consensus.cc:3060] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:01.798672  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:01.799758  4102 raft_consensus.cc:3060] T 6e863d888e2a4327a9127a43deb1f1b9 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:01.819588  3855 catalog_manager.cc:5697] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 1 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:01.787770  4512 raft_consensus.cc:493] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:01.831216  4149 tablet_bootstrap.cc:654] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:01.970463  4148 tablet_bootstrap.cc:492] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:14:01.850710  4299 raft_consensus.cc:493] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:01.971172  4148 ts_tablet_manager.cc:1403] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.471s	user 0.011s	sys 0.032s
I20260709 13:14:01.840324  3855 catalog_manager.cc:5697] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
W20260709 13:14:01.974116  4588 log.cc:927] Time spent T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.103s	user 0.000s	sys 0.011s
I20260709 13:14:01.839342  4494 raft_consensus.cc:493] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:01.974934  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 165513us
I20260709 13:14:01.839802  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:14:01.987746  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 143669us
I20260709 13:14:01.926661  4498 raft_consensus.cc:515] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:02.015177  4594 consensus_queue.cc:1048] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:01.992570  4512 raft_consensus.cc:515] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.996806  4299 raft_consensus.cc:515] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:01.998024  4494 raft_consensus.cc:515] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:02.029007  4494 leader_election.cc:290] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:01.837396  3922 leader_election.cc:343] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:02.040974  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
W20260709 13:14:02.041153  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 203808us
W20260709 13:14:02.041939  3922 leader_election.cc:343] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:02.053722  4512 leader_election.cc:290] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:14:02.061810  3922 leader_election.cc:343] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:02.074580  4148 raft_consensus.cc:359] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:02.075448  4148 raft_consensus.cc:385] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:02.077934  4148 raft_consensus.cc:740] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:14:02.083220  4148 consensus_queue.cc:260] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:02.062743  4498 leader_election.cc:290] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:02.069187  4512 raft_consensus.cc:493] T 6e863d888e2a4327a9127a43deb1f1b9 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:02.094518  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 45817.5us
I20260709 13:14:02.103839  4512 raft_consensus.cc:515] T 6e863d888e2a4327a9127a43deb1f1b9 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:02.151943  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:02.153421  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:02.131469  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:02.159392  4148 ts_tablet_manager.cc:1434] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.170s	user 0.005s	sys 0.002s
I20260709 13:14:02.173560  4149 tablet_bootstrap.cc:492] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:14:02.174419  4149 ts_tablet_manager.cc:1403] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.455s	user 0.015s	sys 0.006s
W20260709 13:14:02.215793  3922 leader_election.cc:343] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:02.217018  3922 leader_election.cc:343] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:02.221482  3922 leader_election.cc:343] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:02.102546  4594 consensus_queue.cc:1048] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.117s
I20260709 13:14:02.225339  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:14:02.238268  3922 leader_election.cc:343] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:02.245927  4594 consensus_queue.cc:1048] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:14:02.271062  4149 raft_consensus.cc:359] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:02.275859  4149 raft_consensus.cc:385] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:02.276181  4149 raft_consensus.cc:740] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:14:02.280148  4149 consensus_queue.cc:260] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:02.280992  4148 tablet_bootstrap.cc:492] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:14:02.285981  4149 ts_tablet_manager.cc:1434] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.111s	user 0.008s	sys 0.000s
I20260709 13:14:02.287297  4149 tablet_bootstrap.cc:492] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:14:02.305275  4149 tablet_bootstrap.cc:654] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:02.288219  4512 leader_election.cc:290] T 6e863d888e2a4327a9127a43deb1f1b9 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:02.289480  4299 leader_election.cc:290] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:02.291132  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 77677.2us
I20260709 13:14:02.295918  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:02.316365  3955 raft_consensus.cc:2468] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 0.
W20260709 13:14:02.316704  3905 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:02.319181  4101 raft_consensus.cc:3060] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:02.297012  4148 tablet_bootstrap.cc:654] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:02.337733  3997 leader_election.cc:304] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:02.386291  4299 raft_consensus.cc:2804] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:02.386783  4299 raft_consensus.cc:493] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:02.387140  4299 raft_consensus.cc:3060] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:02.389648  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 52788.4us
I20260709 13:14:02.392843  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:02.393543  3953 raft_consensus.cc:3060] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:02.408484  3922 consensus_peers.cc:597] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:02.408691  4519 consensus_queue.cc:1048] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:02.411135  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:02.413312  4299 raft_consensus.cc:515] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:02.416100  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:02.416759  4149 tablet_bootstrap.cc:492] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:14:02.417269  4149 ts_tablet_manager.cc:1403] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.130s	user 0.017s	sys 0.016s
I20260709 13:14:02.417482  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:14:02.418082  3997 leader_election.cc:343] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:02.418732  3997 leader_election.cc:343] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:02.421010  3997 leader_election.cc:343] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:02.422250  3997 leader_election.cc:343] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:02.422530  4149 raft_consensus.cc:359] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:02.423223  4149 raft_consensus.cc:385] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:02.423872  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:02.423498  4149 raft_consensus.cc:740] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:14:02.428385  4149 consensus_queue.cc:260] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:02.431233  4299 leader_election.cc:290] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:02.431787  4148 tablet_bootstrap.cc:492] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:14:02.432313  4148 ts_tablet_manager.cc:1403] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.152s	user 0.019s	sys 0.003s
I20260709 13:14:02.434398  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:02.434983  3958 raft_consensus.cc:3060] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:02.438347  3953 raft_consensus.cc:2468] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 1.
I20260709 13:14:02.444350  3997 leader_election.cc:304] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:02.444487  4104 raft_consensus.cc:3060] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:02.445117  4580 raft_consensus.cc:2804] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:02.445595  4580 raft_consensus.cc:697] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:02.446416  4580 consensus_queue.cc:237] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:02.449117  4148 raft_consensus.cc:359] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:02.449852  4148 raft_consensus.cc:385] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:02.450140  4148 raft_consensus.cc:740] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:14:02.446408  3958 raft_consensus.cc:2468] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 1.
I20260709 13:14:02.450794  4148 consensus_queue.cc:260] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:02.439327  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:02.459311  4148 ts_tablet_manager.cc:1434] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:14:02.463187  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:02.488508  4149 ts_tablet_manager.cc:1434] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.071s	user 0.008s	sys 0.000s
I20260709 13:14:02.481076  3997 leader_election.cc:304] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:14:02.493109  3997 leader_election.cc:343] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:02.493637  3997 leader_election.cc:304] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:02.494470  4580 raft_consensus.cc:2749] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:02.496490  4299 raft_consensus.cc:2804] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:02.497087  4299 raft_consensus.cc:697] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:02.497181  4149 tablet_bootstrap.cc:492] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059: Bootstrap starting.
I20260709 13:14:02.507328  4148 tablet_bootstrap.cc:492] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:14:02.512631  4299 consensus_queue.cc:237] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:02.499491  4074 leader_election.cc:304] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:02.517450  4512 raft_consensus.cc:2749] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:02.519366  4074 leader_election.cc:304] T 6e863d888e2a4327a9127a43deb1f1b9 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:02.521153  4514 raft_consensus.cc:2749] T 6e863d888e2a4327a9127a43deb1f1b9 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:02.523406  4519 consensus_queue.cc:1048] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:02.538235  3856 catalog_manager.cc:5697] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 0 to 1, leader changed from <none> to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:02.548049  3856 catalog_manager.cc:5697] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 0 to 1, leader changed from <none> to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:02.550642  3856 catalog_manager.cc:5697] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 0 to 1, leader changed from <none> to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:02.499596  4498 consensus_queue.cc:1048] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.043s
W20260709 13:14:02.614239  3997 consensus_peers.cc:597] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:02.614439  3922 consensus_peers.cc:597] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:02.615219  4236 consensus_queue.cc:1048] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:14:02.620091  3997 leader_election.cc:343] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:02.595841  4519 raft_consensus.cc:493] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:02.630482  4148 tablet_bootstrap.cc:654] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:02.634461  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:02.634577  4591 consensus_queue.cc:1048] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:02.626520  4493 consensus_queue.cc:1048] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 13:14:02.618175  4592 raft_consensus.cc:493] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:02.680171  4622 log.cc:927] Time spent T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
W20260709 13:14:02.702670  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 63349.3us
W20260709 13:14:02.716801  3922 consensus_peers.cc:597] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:02.720268  3997 leader_election.cc:343] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:02.662555  4594 consensus_queue.cc:1048] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.060s
I20260709 13:14:02.742115  4149 tablet_bootstrap.cc:654] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:02.664892  4519 raft_consensus.cc:515] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:02.715700  4592 raft_consensus.cc:515] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:02.761315  4592 leader_election.cc:290] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:02.803366  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:02.870843  4519 leader_election.cc:290] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:02.873497  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 123806us
W20260709 13:14:02.875505  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 115262us
I20260709 13:14:02.910712  4149 tablet_bootstrap.cc:492] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059: No bootstrap required, opened a new log
I20260709 13:14:02.911342  4149 ts_tablet_manager.cc:1403] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059: Time spent bootstrapping tablet: real 0.414s	user 0.023s	sys 0.018s
I20260709 13:14:02.914371  4149 raft_consensus.cc:359] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:02.915122  4149 raft_consensus.cc:385] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:02.917532  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:02.924196  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:02.915397  4149 raft_consensus.cc:740] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Initialized, Role: FOLLOWER
I20260709 13:14:02.924973  4103 raft_consensus.cc:2468] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 0.
I20260709 13:14:02.925541  4149 consensus_queue.cc:260] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:02.932057  4149 ts_tablet_manager.cc:1434] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.003s
I20260709 13:14:02.943396  3922 leader_election.cc:304] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:02.944245  4595 raft_consensus.cc:2804] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:02.944635  4595 raft_consensus.cc:493] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:02.944969  4595 raft_consensus.cc:3060] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:02.951853  4590 raft_consensus.cc:493] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:02.952531  4590 raft_consensus.cc:515] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:02.951886  4595 raft_consensus.cc:515] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:02.954043  4148 tablet_bootstrap.cc:492] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:14:02.954635  4148 ts_tablet_manager.cc:1403] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.448s	user 0.027s	sys 0.018s
I20260709 13:14:02.954865  4595 leader_election.cc:290] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:02.955097  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:02.954916  4590 leader_election.cc:290] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:02.955773  4034 raft_consensus.cc:2468] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 0.
I20260709 13:14:02.958195  4148 raft_consensus.cc:359] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:02.959019  4148 raft_consensus.cc:385] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:02.959362  4148 raft_consensus.cc:740] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:14:02.960284  4148 consensus_queue.cc:260] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:02.962051  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:02.961238  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:02.963901  4103 raft_consensus.cc:3060] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:02.964747  4148 ts_tablet_manager.cc:1434] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:14:02.970160  4148 tablet_bootstrap.cc:492] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:14:02.976598  4148 tablet_bootstrap.cc:654] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:02.963388  3922 leader_election.cc:343] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:02.976374  4103 raft_consensus.cc:2468] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 1.
I20260709 13:14:02.979401  3922 leader_election.cc:304] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:02.982821  4595 raft_consensus.cc:2804] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:02.983608  4595 raft_consensus.cc:697] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:02.984879  4595 consensus_queue.cc:237] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:03.014475  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:03.014819  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:03.015211  4034 raft_consensus.cc:2468] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 0.
I20260709 13:14:03.015513  4028 raft_consensus.cc:3060] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:03.022631  4028 raft_consensus.cc:2468] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 1.
I20260709 13:14:03.028719  4074 leader_election.cc:304] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:03.030247  4596 raft_consensus.cc:2749] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:14:03.031903  3997 consensus_peers.cc:597] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:03.048200  3856 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52092 (request call id 87) took 1273 ms. Trace:
I20260709 13:14:03.052719  4485 consensus_queue.cc:1048] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:03.048561  3856 rpcz_store.cc:276] 0709 13:14:01.775088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:01.786961 (+ 11873us) service_pool.cc:224] Handling call
0709 13:14:03.048115 (+1261154us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:02.860419 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:02.861232 (+   813us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:02.861281 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:14:02.861308 (+    27us) tablet.cc:662] Decoding operations
0709 13:14:02.862071 (+   763us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:02.862154 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:02.862196 (+    42us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:14:02.862650 (+   454us) tablet.cc:701] Row locks acquired
0709 13:14:02.862676 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:14:02.862862 (+   186us) write_op.cc:270] Start()
0709 13:14:02.863013 (+   151us) write_op.cc:276] Timestamp: P: 1783602842862800 usec, L: 0
0709 13:14:02.863055 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 13:14:02.881696 (+ 18641us) log.cc:844] Serialized 1316 byte log entry
0709 13:14:03.015131 (+133435us) op_driver.cc:464] REPLICATION: finished
0709 13:14:03.025724 (+ 10593us) write_op.cc:301] APPLY: starting
0709 13:14:03.025804 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:03.025936 (+   132us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:03.026087 (+   151us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:03.026506 (+   419us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:03.026671 (+   165us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:14:03.026713 (+    42us) write_op.cc:312] APPLY: finished
0709 13:14:03.026927 (+   214us) log.cc:844] Serialized 34 byte log entry
0709 13:14:03.029872 (+  2945us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:03.029964 (+    92us) write_op.cc:454] Released schema lock
0709 13:14:03.030008 (+    44us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":13795,"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":10368,"apply.run_cpu_time_us":1844,"apply.run_wall_time_us":4603,"num_ops":3,"prepare.queue_time_us":244249,"prepare.run_cpu_time_us":4046,"prepare.run_wall_time_us":21659,"replication_time_us":151790,"thread_start_us":255989,"threads_started":2}]]}
I20260709 13:14:03.075378  4148 tablet_bootstrap.cc:492] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:14:03.075915  4148 ts_tablet_manager.cc:1403] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.106s	user 0.032s	sys 0.057s
I20260709 13:14:03.088932  4148 raft_consensus.cc:359] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:03.089710  4148 raft_consensus.cc:385] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:03.089993  4148 raft_consensus.cc:740] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:14:03.092363  4148 consensus_queue.cc:260] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:03.094717  4148 ts_tablet_manager.cc:1434] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.001s
I20260709 13:14:03.095777  4148 tablet_bootstrap.cc:492] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:14:03.101539  3925 leader_election.cc:304] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:03.090859  3855 catalog_manager.cc:5697] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 1 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:03.102478  4595 raft_consensus.cc:2804] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:03.102835  4595 raft_consensus.cc:493] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:03.103186  4595 raft_consensus.cc:3060] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:03.103829  3855 catalog_manager.cc:5697] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 1 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:03.105687  3855 catalog_manager.cc:5697] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:14:03.107390  3855 catalog_manager.cc:5697] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:14:03.108716  3855 catalog_manager.cc:5697] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:14:03.113605  4595 raft_consensus.cc:515] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:03.117991  4148 tablet_bootstrap.cc:654] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:03.119666  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
W20260709 13:14:03.120895  3922 leader_election.cc:343] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:03.121641  4595 leader_election.cc:290] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:03.132387  4148 tablet_bootstrap.cc:492] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:14:03.133388  4148 ts_tablet_manager.cc:1403] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.011s
I20260709 13:14:03.136404  4148 raft_consensus.cc:359] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:03.137192  4148 raft_consensus.cc:385] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:03.137527  4148 raft_consensus.cc:740] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:14:03.138214  4148 consensus_queue.cc:260] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:03.143919  4148 ts_tablet_manager.cc:1434] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:14:03.145022  4148 tablet_bootstrap.cc:492] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:14:03.148241  3857 catalog_manager.cc:5697] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 0 to 1, leader changed from <none> to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:03.152014  4148 tablet_bootstrap.cc:654] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:03.163686  3997 consensus_peers.cc:597] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:03.171211  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:03.172173  4033 raft_consensus.cc:3060] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:03.200102  4635 consensus_queue.cc:1048] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:03.210017  4148 tablet_bootstrap.cc:492] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:14:03.210799  4148 ts_tablet_manager.cc:1403] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.066s	user 0.024s	sys 0.019s
I20260709 13:14:03.220670  4033 raft_consensus.cc:2468] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 1.
I20260709 13:14:03.221115  4148 raft_consensus.cc:359] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:03.221920  4148 raft_consensus.cc:385] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:03.222287  4148 raft_consensus.cc:740] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:14:03.223572  3925 leader_election.cc:304] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:03.227870  4148 consensus_queue.cc:260] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:03.229064  4595 raft_consensus.cc:2804] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:03.229602  4595 raft_consensus.cc:697] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:03.230433  4595 consensus_queue.cc:237] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:03.234730  4148 ts_tablet_manager.cc:1434] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.024s	user 0.002s	sys 0.005s
I20260709 13:14:03.236064  4148 tablet_bootstrap.cc:492] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:14:03.246961  4148 tablet_bootstrap.cc:654] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:03.259792  4148 tablet_bootstrap.cc:492] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:14:03.260341  4148 ts_tablet_manager.cc:1403] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.001s
I20260709 13:14:03.269728  4148 raft_consensus.cc:359] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:03.270517  4148 raft_consensus.cc:385] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:03.270807  4148 raft_consensus.cc:740] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:14:03.271494  4148 consensus_queue.cc:260] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:03.277304  4148 ts_tablet_manager.cc:1434] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:14:03.281808  4148 tablet_bootstrap.cc:492] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:14:03.289548  4148 tablet_bootstrap.cc:654] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:03.288651  3854 catalog_manager.cc:5697] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 0 to 1, leader changed from <none> to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:03.304517  4148 tablet_bootstrap.cc:492] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:14:03.305001  4148 ts_tablet_manager.cc:1403] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.008s
I20260709 13:14:03.307317  4148 raft_consensus.cc:359] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:03.308046  4148 raft_consensus.cc:385] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:03.308327  4148 raft_consensus.cc:740] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:14:03.308975  4148 consensus_queue.cc:260] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:03.311494  4148 ts_tablet_manager.cc:1434] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:14:03.328626  4101 raft_consensus.cc:3060] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:03.336015  4148 tablet_bootstrap.cc:492] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Bootstrap starting.
I20260709 13:14:03.343883  4148 tablet_bootstrap.cc:654] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:03.349277  4148 tablet_bootstrap.cc:492] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc: No bootstrap required, opened a new log
I20260709 13:14:03.349774  4148 ts_tablet_manager.cc:1403] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent bootstrapping tablet: real 0.014s	user 0.003s	sys 0.008s
I20260709 13:14:03.353310  4148 raft_consensus.cc:359] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:03.354149  4148 raft_consensus.cc:385] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:03.354406  4148 raft_consensus.cc:740] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Initialized, Role: FOLLOWER
I20260709 13:14:03.355010  4148 consensus_queue.cc:260] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:03.356738  4148 ts_tablet_manager.cc:1434] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:14:03.362707  4512 raft_consensus.cc:493] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:03.363186  4512 raft_consensus.cc:515] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:03.368407  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:03.371660  4601 raft_consensus.cc:493] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:03.372099  4512 leader_election.cc:290] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:03.373775  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:03.375772  4074 leader_election.cc:304] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:03.376493  4512 raft_consensus.cc:2749] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:03.372139  4601 raft_consensus.cc:515] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:03.378607  4601 leader_election.cc:290] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:03.379573  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:03.379648  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:03.381114  4074 leader_election.cc:304] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:03.381793  4101 raft_consensus.cc:3060] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:03.401219  4601 raft_consensus.cc:2749] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:03.406330  4601 raft_consensus.cc:493] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:03.406931  4601 raft_consensus.cc:515] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:03.408211  4103 raft_consensus.cc:3060] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:03.416373  4601 leader_election.cc:290] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:03.419801  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:03.422673  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:03.429666  4071 leader_election.cc:304] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:03.432471  4601 raft_consensus.cc:2749] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:03.462078  4103 raft_consensus.cc:3060] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:03.462118  4590 consensus_queue.cc:1048] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:03.486402  4108 raft_consensus.cc:3060] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:03.500252  4590 consensus_queue.cc:1048] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:03.581339  4596 raft_consensus.cc:493] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:03.581857  4596 raft_consensus.cc:515] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:03.583995  4596 leader_election.cc:290] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:03.584561  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:03.584805  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:03.585602  4033 raft_consensus.cc:2393] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 1: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:14:03.586436  4074 leader_election.cc:304] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:03.587116  4596 raft_consensus.cc:3060] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:03.593132  4596 raft_consensus.cc:2749] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:03.610648  4108 raft_consensus.cc:3060] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:03.696686  4594 consensus_queue.cc:1048] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:03.703236  2843 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260709 13:14:03.711346  4594 consensus_queue.cc:1048] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:14:03.757761  4662 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:03.781124  4663 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:03.811326  2843 server_base.cc:1061] running on GCE node
W20260709 13:14:03.814234  4667 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:03.815789  2843 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:03.816097  2843 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:03.816370  2843 hybrid_clock.cc:648] HybridClock initialized: now 1783602843816347 us; error 0 us; skew 500 ppm
I20260709 13:14:03.817332  2843 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:03.822501  2843 webserver.cc:533] Webserver started at http://127.2.198.196:38093/ using document root <none> and password file <none>
I20260709 13:14:03.823235  2843 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:03.823624  2843 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:03.824060  2843 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:03.825421  2843 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/ts-3-root/instance:
uuid: "d709ee666b774ec29aa732e508219938"
format_stamp: "Formatted at 2026-07-09 13:14:03 on dist-test-slave-fc6v"
I20260709 13:14:03.830856  2843 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:14:03.834694  4671 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:03.835604  2843 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:14:03.835937  2843 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/ts-3-root
uuid: "d709ee666b774ec29aa732e508219938"
format_stamp: "Formatted at 2026-07-09 13:14:03 on dist-test-slave-fc6v"
I20260709 13:14:03.836251  2843 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:03.856590  2843 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:03.858841  2843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:03.860776  2843 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:03.864080  2843 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:03.864269  2843 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:03.864598  2843 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:03.864764  2843 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:03.990845  2843 rpc_server.cc:307] RPC server started. Bound to: 127.2.198.196:37117
I20260709 13:14:03.990890  4733 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.198.196:37117 every 8 connection(s)
I20260709 13:14:03.999054  2843 auto_leader_rebalancer-test.cc:384] add a tserver: d709ee666b774ec29aa732e508219938
I20260709 13:14:04.019451  4734 heartbeater.cc:344] Connected to a master server at 127.2.198.254:36531
I20260709 13:14:04.020062  4734 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:04.021014  4734 heartbeater.cc:507] Master 127.2.198.254:36531 requested a full tablet report, sending...
I20260709 13:14:04.023065  3857 ts_manager.cc:194] Registered new tserver with Master: d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:04.024868  3857 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44680
I20260709 13:14:04.494509  4101 consensus_queue.cc:237] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:04.503939  4028 raft_consensus.cc:1275] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:04.505439  4601 consensus_queue.cc:1048] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:04.509178  3958 raft_consensus.cc:1275] T ba7a51e4b70a48daa8267297f285c661 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:04.512311  4601 consensus_queue.cc:1048] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:04.527321  4741 raft_consensus.cc:2955] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:04.540562  4028 raft_consensus.cc:2955] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:04.544257  3958 raft_consensus.cc:2955] T ba7a51e4b70a48daa8267297f285c661 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:04.563215  3857 catalog_manager.cc:5697] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New cstate: current_term: 1 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:04.565716  4073 consensus_peers.cc:597] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117): Couldn't send request to peer d709ee666b774ec29aa732e508219938. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ba7a51e4b70a48daa8267297f285c661. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:04.598695  3958 consensus_queue.cc:237] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:04.614041  4028 raft_consensus.cc:1275] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:04.615715  4590 consensus_queue.cc:1048] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:04.624549  4101 raft_consensus.cc:1275] T eae506e79ba348b3b1db60ecc6ae6714 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:04.627429  4595 consensus_queue.cc:1048] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:04.644559  4590 raft_consensus.cc:2955] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:04.653672  4034 raft_consensus.cc:2955] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
W20260709 13:14:04.677430  3924 consensus_peers.cc:597] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 -> Peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117): Couldn't send request to peer d709ee666b774ec29aa732e508219938. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eae506e79ba348b3b1db60ecc6ae6714. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:04.688864  3958 consensus_queue.cc:237] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:04.698987  4103 raft_consensus.cc:2955] T eae506e79ba348b3b1db60ecc6ae6714 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
W20260709 13:14:04.709870  3924 consensus_peers.cc:597] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 -> Peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117): Couldn't send request to peer d709ee666b774ec29aa732e508219938. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dc2641ff9849458a9200dfc5a9016cce. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:04.712044  4103 raft_consensus.cc:1275] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:04.705542  3857 catalog_manager.cc:5697] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:04.713518  4033 raft_consensus.cc:1275] T dc2641ff9849458a9200dfc5a9016cce P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:04.713483  4756 consensus_queue.cc:1048] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:04.716635  4594 consensus_queue.cc:1048] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:04.733211  4594 raft_consensus.cc:2955] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:04.735328  4103 raft_consensus.cc:2955] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:04.737519  4033 raft_consensus.cc:2955] T dc2641ff9849458a9200dfc5a9016cce P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:04.751956  4103 consensus_queue.cc:237] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:04.757342  3854 catalog_manager.cc:5697] T dc2641ff9849458a9200dfc5a9016cce P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
W20260709 13:14:04.763322  4073 consensus_peers.cc:597] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117): Couldn't send request to peer d709ee666b774ec29aa732e508219938. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c18bd2f3197a4762aec88dec3caa6712. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:04.763969  4033 raft_consensus.cc:1275] T c18bd2f3197a4762aec88dec3caa6712 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:04.765018  3958 raft_consensus.cc:1275] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:04.765910  4592 consensus_queue.cc:1048] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:04.766865  4601 consensus_queue.cc:1048] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:04.776166  4746 raft_consensus.cc:2955] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:04.778046  3957 raft_consensus.cc:2955] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:04.804733  4034 raft_consensus.cc:2955] T c18bd2f3197a4762aec88dec3caa6712 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:04.819303  3857 catalog_manager.cc:5697] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New cstate: current_term: 1 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:04.965243  4765 ts_tablet_manager.cc:933] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938: Initiating tablet copy from peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:04.967868  4765 tablet_copy_client.cc:323] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938: tablet copy: Beginning tablet copy session from remote peer at address 127.2.198.195:37843
I20260709 13:14:04.981074  4118 tablet_copy_service.cc:140] P 8952c48a6f3a43968f7d77f7bfc4d1bc: Received BeginTabletCopySession request for tablet ba7a51e4b70a48daa8267297f285c661 from peer d709ee666b774ec29aa732e508219938 ({username='slave'} at 127.0.0.1:34656)
I20260709 13:14:04.981775  4118 tablet_copy_service.cc:161] P 8952c48a6f3a43968f7d77f7bfc4d1bc: Beginning new tablet copy session on tablet ba7a51e4b70a48daa8267297f285c661 from peer d709ee666b774ec29aa732e508219938 at {username='slave'} at 127.0.0.1:34656: session id = d709ee666b774ec29aa732e508219938-ba7a51e4b70a48daa8267297f285c661
I20260709 13:14:04.995280  4118 tablet_copy_source_session.cc:215] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:05.000712  4768 ts_tablet_manager.cc:933] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938: Initiating tablet copy from peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339)
I20260709 13:14:05.003002  4765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba7a51e4b70a48daa8267297f285c661. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:05.003350  4768 tablet_copy_client.cc:323] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938: tablet copy: Beginning tablet copy session from remote peer at address 127.2.198.193:35339
I20260709 13:14:05.017395  3969 tablet_copy_service.cc:140] P f1c75790cedf4f52a3463a255c7da059: Received BeginTabletCopySession request for tablet eae506e79ba348b3b1db60ecc6ae6714 from peer d709ee666b774ec29aa732e508219938 ({username='slave'} at 127.0.0.1:35354)
I20260709 13:14:05.018061  3969 tablet_copy_service.cc:161] P f1c75790cedf4f52a3463a255c7da059: Beginning new tablet copy session on tablet eae506e79ba348b3b1db60ecc6ae6714 from peer d709ee666b774ec29aa732e508219938 at {username='slave'} at 127.0.0.1:35354: session id = d709ee666b774ec29aa732e508219938-eae506e79ba348b3b1db60ecc6ae6714
I20260709 13:14:05.024338  4765 tablet_copy_client.cc:806] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:05.026062  4765 tablet_copy_client.cc:670] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:05.026798  3969 tablet_copy_source_session.cc:215] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:05.027237  4734 heartbeater.cc:499] Master 127.2.198.254:36531 was elected leader, sending a full tablet report...
I20260709 13:14:05.032742  4765 tablet_copy_client.cc:538] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:05.036487  4768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eae506e79ba348b3b1db60ecc6ae6714. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:05.051052  4765 tablet_bootstrap.cc:492] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938: Bootstrap starting.
I20260709 13:14:05.054427  4768 tablet_copy_client.cc:806] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:05.055289  4768 tablet_copy_client.cc:670] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:05.059634  4768 tablet_copy_client.cc:538] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:05.069892  4768 tablet_bootstrap.cc:492] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938: Bootstrap starting.
I20260709 13:14:05.092537  4765 tablet_bootstrap.cc:492] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:05.093709  4765 tablet_bootstrap.cc:492] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938: Bootstrap complete.
I20260709 13:14:05.094462  4765 ts_tablet_manager.cc:1403] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938: Time spent bootstrapping tablet: real 0.044s	user 0.028s	sys 0.012s
I20260709 13:14:05.097563  4768 tablet_bootstrap.cc:492] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:05.097743  4765 raft_consensus.cc:359] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:05.098742  4765 raft_consensus.cc:740] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Initialized, Role: LEARNER
I20260709 13:14:05.098906  4768 tablet_bootstrap.cc:492] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938: Bootstrap complete.
I20260709 13:14:05.100306  4768 ts_tablet_manager.cc:1403] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.014s
I20260709 13:14:05.100006  4765 consensus_queue.cc:260] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:05.105681  4768 raft_consensus.cc:359] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:05.108274  4768 raft_consensus.cc:740] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Initialized, Role: LEARNER
I20260709 13:14:05.109153  4768 consensus_queue.cc:260] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:05.112901  4765 ts_tablet_manager.cc:1434] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938: Time spent starting tablet: real 0.018s	user 0.010s	sys 0.009s
I20260709 13:14:05.120352  4118 tablet_copy_service.cc:342] P 8952c48a6f3a43968f7d77f7bfc4d1bc: Request end of tablet copy session d709ee666b774ec29aa732e508219938-ba7a51e4b70a48daa8267297f285c661 received from {username='slave'} at 127.0.0.1:34656
I20260709 13:14:05.120882  4118 tablet_copy_service.cc:434] P 8952c48a6f3a43968f7d77f7bfc4d1bc: ending tablet copy session d709ee666b774ec29aa732e508219938-ba7a51e4b70a48daa8267297f285c661 on tablet ba7a51e4b70a48daa8267297f285c661 with peer d709ee666b774ec29aa732e508219938
I20260709 13:14:05.127866  4768 ts_tablet_manager.cc:1434] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.007s
I20260709 13:14:05.136798  3969 tablet_copy_service.cc:342] P f1c75790cedf4f52a3463a255c7da059: Request end of tablet copy session d709ee666b774ec29aa732e508219938-eae506e79ba348b3b1db60ecc6ae6714 received from {username='slave'} at 127.0.0.1:35354
I20260709 13:14:05.137346  3969 tablet_copy_service.cc:434] P f1c75790cedf4f52a3463a255c7da059: ending tablet copy session d709ee666b774ec29aa732e508219938-eae506e79ba348b3b1db60ecc6ae6714 on tablet eae506e79ba348b3b1db60ecc6ae6714 with peer d709ee666b774ec29aa732e508219938
I20260709 13:14:05.190902  4768 ts_tablet_manager.cc:933] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938: Initiating tablet copy from peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:05.193322  4768 tablet_copy_client.cc:323] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938: tablet copy: Beginning tablet copy session from remote peer at address 127.2.198.195:37843
I20260709 13:14:05.195084  4118 tablet_copy_service.cc:140] P 8952c48a6f3a43968f7d77f7bfc4d1bc: Received BeginTabletCopySession request for tablet c18bd2f3197a4762aec88dec3caa6712 from peer d709ee666b774ec29aa732e508219938 ({username='slave'} at 127.0.0.1:34656)
I20260709 13:14:05.195657  4118 tablet_copy_service.cc:161] P 8952c48a6f3a43968f7d77f7bfc4d1bc: Beginning new tablet copy session on tablet c18bd2f3197a4762aec88dec3caa6712 from peer d709ee666b774ec29aa732e508219938 at {username='slave'} at 127.0.0.1:34656: session id = d709ee666b774ec29aa732e508219938-c18bd2f3197a4762aec88dec3caa6712
I20260709 13:14:05.301707  4765 ts_tablet_manager.cc:933] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938: Initiating tablet copy from peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339)
I20260709 13:14:05.320456  4765 tablet_copy_client.cc:323] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938: tablet copy: Beginning tablet copy session from remote peer at address 127.2.198.193:35339
I20260709 13:14:05.325286  3969 tablet_copy_service.cc:140] P f1c75790cedf4f52a3463a255c7da059: Received BeginTabletCopySession request for tablet dc2641ff9849458a9200dfc5a9016cce from peer d709ee666b774ec29aa732e508219938 ({username='slave'} at 127.0.0.1:35354)
I20260709 13:14:05.326371  3969 tablet_copy_service.cc:161] P f1c75790cedf4f52a3463a255c7da059: Beginning new tablet copy session on tablet dc2641ff9849458a9200dfc5a9016cce from peer d709ee666b774ec29aa732e508219938 at {username='slave'} at 127.0.0.1:35354: session id = d709ee666b774ec29aa732e508219938-dc2641ff9849458a9200dfc5a9016cce
I20260709 13:14:05.350127  4118 tablet_copy_source_session.cc:215] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:05.355710  4768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c18bd2f3197a4762aec88dec3caa6712. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:14:05.371417  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 60123.9us
I20260709 13:14:05.372011  3969 tablet_copy_source_session.cc:215] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:05.407306  4709 raft_consensus.cc:1217] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:05.434914  4765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc2641ff9849458a9200dfc5a9016cce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:05.518054  4765 tablet_copy_client.cc:806] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:05.518869  4765 tablet_copy_client.cc:670] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:05.524547  4765 tablet_copy_client.cc:538] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:05.529876  4709 raft_consensus.cc:1217] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:05.573091  4765 tablet_bootstrap.cc:492] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938: Bootstrap starting.
I20260709 13:14:05.575652  4768 tablet_copy_client.cc:806] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:05.576406  4768 tablet_copy_client.cc:670] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:05.581804  4768 tablet_copy_client.cc:538] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:05.592459  4768 tablet_bootstrap.cc:492] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938: Bootstrap starting.
I20260709 13:14:05.610666  4765 tablet_bootstrap.cc:492] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:05.612462  4765 tablet_bootstrap.cc:492] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938: Bootstrap complete.
I20260709 13:14:05.613309  4765 ts_tablet_manager.cc:1403] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938: Time spent bootstrapping tablet: real 0.040s	user 0.022s	sys 0.007s
I20260709 13:14:05.621733  4768 tablet_bootstrap.cc:492] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:05.622746  4768 tablet_bootstrap.cc:492] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938: Bootstrap complete.
I20260709 13:14:05.623445  4768 ts_tablet_manager.cc:1403] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938: Time spent bootstrapping tablet: real 0.031s	user 0.019s	sys 0.008s
I20260709 13:14:05.626904  4768 raft_consensus.cc:359] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:05.627919  4768 raft_consensus.cc:740] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Initialized, Role: LEARNER
I20260709 13:14:05.628741  4768 consensus_queue.cc:260] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:05.633530  4768 ts_tablet_manager.cc:1434] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:14:05.623262  4765 raft_consensus.cc:359] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:05.635005  4765 raft_consensus.cc:740] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Initialized, Role: LEARNER
I20260709 13:14:05.635726  4765 consensus_queue.cc:260] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:05.638167  4765 ts_tablet_manager.cc:1434] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:14:05.639031  4118 tablet_copy_service.cc:342] P 8952c48a6f3a43968f7d77f7bfc4d1bc: Request end of tablet copy session d709ee666b774ec29aa732e508219938-c18bd2f3197a4762aec88dec3caa6712 received from {username='slave'} at 127.0.0.1:34656
I20260709 13:14:05.639530  4118 tablet_copy_service.cc:434] P 8952c48a6f3a43968f7d77f7bfc4d1bc: ending tablet copy session d709ee666b774ec29aa732e508219938-c18bd2f3197a4762aec88dec3caa6712 on tablet c18bd2f3197a4762aec88dec3caa6712 with peer d709ee666b774ec29aa732e508219938
I20260709 13:14:05.642370  3969 tablet_copy_service.cc:342] P f1c75790cedf4f52a3463a255c7da059: Request end of tablet copy session d709ee666b774ec29aa732e508219938-dc2641ff9849458a9200dfc5a9016cce received from {username='slave'} at 127.0.0.1:35354
I20260709 13:14:05.642762  3969 tablet_copy_service.cc:434] P f1c75790cedf4f52a3463a255c7da059: ending tablet copy session d709ee666b774ec29aa732e508219938-dc2641ff9849458a9200dfc5a9016cce on tablet dc2641ff9849458a9200dfc5a9016cce with peer d709ee666b774ec29aa732e508219938
I20260709 13:14:05.648661  4709 raft_consensus.cc:1217] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:05.872267  4709 raft_consensus.cc:1217] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:05.971022  4777 raft_consensus.cc:1064] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059: attempting to promote NON_VOTER d709ee666b774ec29aa732e508219938 to VOTER
I20260709 13:14:05.984189  4741 raft_consensus.cc:1064] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc: attempting to promote NON_VOTER d709ee666b774ec29aa732e508219938 to VOTER
I20260709 13:14:05.985179  4777 consensus_queue.cc:237] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:05.989117  4741 consensus_queue.cc:237] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:06.006389  4709 raft_consensus.cc:1275] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:06.008908  4709 raft_consensus.cc:1275] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:06.009110  4101 raft_consensus.cc:1275] T eae506e79ba348b3b1db60ecc6ae6714 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:06.010952  4028 raft_consensus.cc:1275] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:06.010797  4592 consensus_queue.cc:1048] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:06.013655  3950 raft_consensus.cc:1275] T ba7a51e4b70a48daa8267297f285c661 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:06.015268  4028 raft_consensus.cc:1275] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:06.008903  4594 consensus_queue.cc:1048] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:14:06.018385  4590 consensus_queue.cc:1048] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:06.018425  4741 consensus_queue.cc:1048] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:06.020484  4777 consensus_queue.cc:1048] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:06.022964  4592 consensus_queue.cc:1048] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:06.088716  4594 raft_consensus.cc:2955] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:06.103699  4101 raft_consensus.cc:2955] T eae506e79ba348b3b1db60ecc6ae6714 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:06.162598  4781 raft_consensus.cc:2955] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:06.165100  4709 raft_consensus.cc:2955] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:06.171187  3950 raft_consensus.cc:2955] T ba7a51e4b70a48daa8267297f285c661 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
W20260709 13:14:06.184042  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 96547.8us
I20260709 13:14:06.209412  4708 raft_consensus.cc:2955] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:06.198563  3855 catalog_manager.cc:5697] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 reported cstate change: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:06.215941  4033 raft_consensus.cc:2955] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:06.236833  4796 raft_consensus.cc:1064] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc: attempting to promote NON_VOTER d709ee666b774ec29aa732e508219938 to VOTER
I20260709 13:14:06.240178  4796 consensus_queue.cc:237] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:06.251402  4034 raft_consensus.cc:2955] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:06.268936  4708 raft_consensus.cc:1275] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:06.269316  3950 raft_consensus.cc:1275] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:06.271126  4592 consensus_queue.cc:1048] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:06.275187  4592 consensus_queue.cc:1048] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:06.276237  4034 raft_consensus.cc:1275] T c18bd2f3197a4762aec88dec3caa6712 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:06.280158  4781 consensus_queue.cc:1048] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:06.292537  4781 raft_consensus.cc:2955] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:06.298018  4708 raft_consensus.cc:2955] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:06.307022  4033 raft_consensus.cc:2955] T c18bd2f3197a4762aec88dec3caa6712 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:06.316390  3950 raft_consensus.cc:2955] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:06.349557  3854 catalog_manager.cc:5697] T ba7a51e4b70a48daa8267297f285c661 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:06.363511  3855 catalog_manager.cc:5697] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 reported cstate change: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:06.389883  4101 consensus_queue.cc:237] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:06.393839  3950 consensus_queue.cc:237] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:06.397382  4708 raft_consensus.cc:1275] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:06.398054  4106 consensus_queue.cc:237] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:06.399084  4592 consensus_queue.cc:1048] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:06.402441  4708 raft_consensus.cc:1275] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:06.404269  4034 raft_consensus.cc:1275] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:06.406545  4795 consensus_queue.cc:1048] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:06.408476  4034 raft_consensus.cc:1275] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:06.412757  4707 raft_consensus.cc:1275] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:06.415171  4796 consensus_queue.cc:1048] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:06.415970  4778 consensus_queue.cc:1048] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:06.415671  4741 raft_consensus.cc:2955] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:06.418319  3957 raft_consensus.cc:1275] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:06.418411  4781 consensus_queue.cc:1048] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:06.419902  4796 consensus_queue.cc:1048] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:06.423090  4590 raft_consensus.cc:2955] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:06.428731  4707 raft_consensus.cc:2955] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:06.431366  4799 raft_consensus.cc:2955] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:06.432785  3957 raft_consensus.cc:2955] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:06.425725  4034 raft_consensus.cc:2955] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:06.438851  4709 raft_consensus.cc:2955] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:06.440254  4033 raft_consensus.cc:2955] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:06.444208  4797 raft_consensus.cc:1064] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059: attempting to promote NON_VOTER d709ee666b774ec29aa732e508219938 to VOTER
I20260709 13:14:06.447090  4797 consensus_queue.cc:237] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:06.450085  4708 raft_consensus.cc:2955] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:06.478631  3856 catalog_manager.cc:5697] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: config changed from index 3 to 4, VOTER 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) evicted. New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:06.483507  3841 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet eae506e79ba348b3b1db60ecc6ae6714 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:06.527586  3841 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c18bd2f3197a4762aec88dec3caa6712 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:06.528535  3841 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ba7a51e4b70a48daa8267297f285c661 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:06.537938  3854 catalog_manager.cc:5697] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: config changed from index 3 to 4, VOTER 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) evicted. New cstate: current_term: 1 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:06.539217  4033 raft_consensus.cc:1275] T dc2641ff9849458a9200dfc5a9016cce P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:06.542066  4778 consensus_queue.cc:1048] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:06.552917  4017 tablet_service.cc:1558] Processing DeleteTablet for tablet c18bd2f3197a4762aec88dec3caa6712 with delete_type TABLET_DATA_TOMBSTONED (TS 6f5b5e4ed72944ecbda200012d141dc2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38278
I20260709 13:14:06.561309  4106 raft_consensus.cc:1275] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:06.564445  4707 raft_consensus.cc:1275] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:06.573494  4778 consensus_queue.cc:1048] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:06.583609  4590 consensus_queue.cc:1048] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:06.588199  4809 tablet_replica.cc:333] T c18bd2f3197a4762aec88dec3caa6712 P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:14:06.588706  3857 catalog_manager.cc:5697] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 reported cstate change: config changed from index 3 to 4, VOTER f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) evicted. New cstate: current_term: 1 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:06.593765  4809 raft_consensus.cc:2243] T c18bd2f3197a4762aec88dec3caa6712 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:06.594615  4809 raft_consensus.cc:2272] T c18bd2f3197a4762aec88dec3caa6712 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:06.597424  4095 tablet_service.cc:1558] Processing DeleteTablet for tablet eae506e79ba348b3b1db60ecc6ae6714 with delete_type TABLET_DATA_TOMBSTONED (TS 8952c48a6f3a43968f7d77f7bfc4d1bc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45324
I20260709 13:14:06.599648  4809 ts_tablet_manager.cc:1916] T c18bd2f3197a4762aec88dec3caa6712 P 6f5b5e4ed72944ecbda200012d141dc2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:06.610064  3948 tablet_service.cc:1558] Processing DeleteTablet for tablet ba7a51e4b70a48daa8267297f285c661 with delete_type TABLET_DATA_TOMBSTONED (TS f1c75790cedf4f52a3463a255c7da059 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38604
I20260709 13:14:06.612948  4812 tablet_replica.cc:333] T ba7a51e4b70a48daa8267297f285c661 P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:14:06.614611  4812 raft_consensus.cc:2243] T ba7a51e4b70a48daa8267297f285c661 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:06.615348  4812 raft_consensus.cc:2272] T ba7a51e4b70a48daa8267297f285c661 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:06.618927  4812 ts_tablet_manager.cc:1916] T ba7a51e4b70a48daa8267297f285c661 P f1c75790cedf4f52a3463a255c7da059: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:06.639727  4809 ts_tablet_manager.cc:1929] T c18bd2f3197a4762aec88dec3caa6712 P 6f5b5e4ed72944ecbda200012d141dc2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:06.640415  4809 log.cc:1199] T c18bd2f3197a4762aec88dec3caa6712 P 6f5b5e4ed72944ecbda200012d141dc2: Deleting WAL directory at /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/ts-1-root/wals/c18bd2f3197a4762aec88dec3caa6712
I20260709 13:14:06.643426  3844 catalog_manager.cc:5028] TS 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): tablet c18bd2f3197a4762aec88dec3caa6712 (table test-workload [id=8a2760e8528448a780fea6ccf25816cb]) successfully deleted
I20260709 13:14:06.645838  4811 tablet_replica.cc:333] T eae506e79ba348b3b1db60ecc6ae6714 P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:14:06.647627  4811 raft_consensus.cc:2243] T eae506e79ba348b3b1db60ecc6ae6714 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:06.648635  4811 raft_consensus.cc:2272] T eae506e79ba348b3b1db60ecc6ae6714 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:06.652477  4778 raft_consensus.cc:2955] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:06.654479  4707 raft_consensus.cc:2955] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:06.663334  4811 ts_tablet_manager.cc:1916] T eae506e79ba348b3b1db60ecc6ae6714 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:06.664492  4108 raft_consensus.cc:2955] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:06.669194  4812 ts_tablet_manager.cc:1929] T ba7a51e4b70a48daa8267297f285c661 P f1c75790cedf4f52a3463a255c7da059: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:06.669659  4812 log.cc:1199] T ba7a51e4b70a48daa8267297f285c661 P f1c75790cedf4f52a3463a255c7da059: Deleting WAL directory at /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/ts-0-root/wals/ba7a51e4b70a48daa8267297f285c661
I20260709 13:14:06.671523  3841 catalog_manager.cc:5028] TS f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): tablet ba7a51e4b70a48daa8267297f285c661 (table test-workload [id=8a2760e8528448a780fea6ccf25816cb]) successfully deleted
I20260709 13:14:06.676365  4033 raft_consensus.cc:2955] T dc2641ff9849458a9200dfc5a9016cce P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:06.683259  3857 catalog_manager.cc:5697] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 reported cstate change: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:06.694783  4811 ts_tablet_manager.cc:1929] T eae506e79ba348b3b1db60ecc6ae6714 P 8952c48a6f3a43968f7d77f7bfc4d1bc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:06.695462  4811 log.cc:1199] T eae506e79ba348b3b1db60ecc6ae6714 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Deleting WAL directory at /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/ts-2-root/wals/eae506e79ba348b3b1db60ecc6ae6714
I20260709 13:14:06.703203  3950 consensus_queue.cc:237] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:06.713876  4707 raft_consensus.cc:1275] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:06.715876  4778 consensus_queue.cc:1048] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:06.723914  4590 raft_consensus.cc:2955] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:06.725677  4707 raft_consensus.cc:2955] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:06.743991  3857 catalog_manager.cc:5697] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 reported cstate change: config changed from index 3 to 4, VOTER 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) evicted. New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:06.750213  4103 raft_consensus.cc:1275] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:06.750093  3841 catalog_manager.cc:5028] TS 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): tablet eae506e79ba348b3b1db60ecc6ae6714 (table test-workload [id=8a2760e8528448a780fea6ccf25816cb]) successfully deleted
I20260709 13:14:06.752911  3841 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dc2641ff9849458a9200dfc5a9016cce with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:06.757845  4017 tablet_service.cc:1558] Processing DeleteTablet for tablet dc2641ff9849458a9200dfc5a9016cce with delete_type TABLET_DATA_TOMBSTONED (TS 6f5b5e4ed72944ecbda200012d141dc2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38278
I20260709 13:14:06.759025  4809 tablet_replica.cc:333] T dc2641ff9849458a9200dfc5a9016cce P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:14:06.760368  4809 raft_consensus.cc:2243] T dc2641ff9849458a9200dfc5a9016cce P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:06.761305  4809 raft_consensus.cc:2272] T dc2641ff9849458a9200dfc5a9016cce P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:06.765914  4809 ts_tablet_manager.cc:1916] T dc2641ff9849458a9200dfc5a9016cce P 6f5b5e4ed72944ecbda200012d141dc2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:06.767781  4778 consensus_queue.cc:1048] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:06.775895  4108 raft_consensus.cc:2955] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:06.784382  4809 ts_tablet_manager.cc:1929] T dc2641ff9849458a9200dfc5a9016cce P 6f5b5e4ed72944ecbda200012d141dc2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:06.784966  4809 log.cc:1199] T dc2641ff9849458a9200dfc5a9016cce P 6f5b5e4ed72944ecbda200012d141dc2: Deleting WAL directory at /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/ts-1-root/wals/dc2641ff9849458a9200dfc5a9016cce
I20260709 13:14:06.786607  3844 catalog_manager.cc:5028] TS 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): tablet dc2641ff9849458a9200dfc5a9016cce (table test-workload [id=8a2760e8528448a780fea6ccf25816cb]) successfully deleted
I20260709 13:14:07.829591  3958 consensus_queue.cc:237] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:07.836239  4033 raft_consensus.cc:1275] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:07.836745  4103 raft_consensus.cc:1275] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:14:07.836776  3924 consensus_peers.cc:597] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 -> Peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117): Couldn't send request to peer d709ee666b774ec29aa732e508219938. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9873af7d73cf49f3b2d74a17cf7cd3bf. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:07.837598  4778 consensus_queue.cc:1048] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:07.838680  4590 consensus_queue.cc:1048] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:07.845912  4778 raft_consensus.cc:2955] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:07.848029  4103 raft_consensus.cc:2955] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:07.850086  4033 raft_consensus.cc:2955] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:07.892083  3857 catalog_manager.cc:5697] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:07.968317  4033 consensus_queue.cc:237] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:07.992439  3957 raft_consensus.cc:1275] T 0d4e65893d284960aef32d35d0db30a4 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:07.996121  4103 raft_consensus.cc:1275] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:07.998466  4828 consensus_queue.cc:1048] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:14:08.007186  4498 consensus_queue.cc:1048] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:08.018769  4828 raft_consensus.cc:2955] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:08.021128  3958 raft_consensus.cc:2955] T 0d4e65893d284960aef32d35d0db30a4 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:08.030725  4101 raft_consensus.cc:2955] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
W20260709 13:14:08.033816  3999 consensus_peers.cc:597] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117): Couldn't send request to peer d709ee666b774ec29aa732e508219938. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0d4e65893d284960aef32d35d0db30a4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:08.049253  4108 consensus_queue.cc:237] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:08.051488  3854 catalog_manager.cc:5697] T 0d4e65893d284960aef32d35d0db30a4 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New cstate: current_term: 1 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:08.061848  4033 raft_consensus.cc:1275] T 0c7551e973324a21b094c1d2869495ac P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:14:08.062482  4073 consensus_peers.cc:597] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117): Couldn't send request to peer d709ee666b774ec29aa732e508219938. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0c7551e973324a21b094c1d2869495ac. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:08.063386  4796 consensus_queue.cc:1048] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:08.066112  3958 raft_consensus.cc:1275] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:08.067703  4796 consensus_queue.cc:1048] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:08.085986  4796 raft_consensus.cc:2955] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:08.088572  3958 raft_consensus.cc:2955] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:08.088762  4033 raft_consensus.cc:2955] T 0c7551e973324a21b094c1d2869495ac P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:08.103889  4033 consensus_queue.cc:237] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:08.105187  3857 catalog_manager.cc:5697] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New cstate: current_term: 1 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:08.116168  3999 consensus_peers.cc:597] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117): Couldn't send request to peer d709ee666b774ec29aa732e508219938. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4b83b18c9e8b401c95ac6e2c0a420316. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:08.117234  3958 raft_consensus.cc:1275] T 4b83b18c9e8b401c95ac6e2c0a420316 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:08.118238  4103 raft_consensus.cc:1275] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:08.119467  4498 consensus_queue.cc:1048] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:08.121519  4828 consensus_queue.cc:1048] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:08.138355  4837 raft_consensus.cc:2955] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:08.145741  3950 raft_consensus.cc:2955] T 4b83b18c9e8b401c95ac6e2c0a420316 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:08.149422  4103 raft_consensus.cc:2955] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:08.166821  3854 catalog_manager.cc:5697] T 4b83b18c9e8b401c95ac6e2c0a420316 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New cstate: current_term: 1 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:08.377041  4840 ts_tablet_manager.cc:933] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938: Initiating tablet copy from peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339)
I20260709 13:14:08.379510  4840 tablet_copy_client.cc:323] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938: tablet copy: Beginning tablet copy session from remote peer at address 127.2.198.193:35339
I20260709 13:14:08.381243  3969 tablet_copy_service.cc:140] P f1c75790cedf4f52a3463a255c7da059: Received BeginTabletCopySession request for tablet 9873af7d73cf49f3b2d74a17cf7cd3bf from peer d709ee666b774ec29aa732e508219938 ({username='slave'} at 127.0.0.1:35354)
I20260709 13:14:08.381974  3969 tablet_copy_service.cc:161] P f1c75790cedf4f52a3463a255c7da059: Beginning new tablet copy session on tablet 9873af7d73cf49f3b2d74a17cf7cd3bf from peer d709ee666b774ec29aa732e508219938 at {username='slave'} at 127.0.0.1:35354: session id = d709ee666b774ec29aa732e508219938-9873af7d73cf49f3b2d74a17cf7cd3bf
I20260709 13:14:08.391112  3969 tablet_copy_source_session.cc:215] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:08.392037  4842 ts_tablet_manager.cc:933] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938: Initiating tablet copy from peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:08.398859  4840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9873af7d73cf49f3b2d74a17cf7cd3bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:08.408439  4842 tablet_copy_client.cc:323] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938: tablet copy: Beginning tablet copy session from remote peer at address 127.2.198.194:46115
I20260709 13:14:08.435117  4840 tablet_copy_client.cc:806] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:08.435956  4840 tablet_copy_client.cc:670] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:08.441179  4840 tablet_copy_client.cc:538] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:08.450053  4044 tablet_copy_service.cc:140] P 6f5b5e4ed72944ecbda200012d141dc2: Received BeginTabletCopySession request for tablet 0d4e65893d284960aef32d35d0db30a4 from peer d709ee666b774ec29aa732e508219938 ({username='slave'} at 127.0.0.1:41312)
I20260709 13:14:08.450811  4044 tablet_copy_service.cc:161] P 6f5b5e4ed72944ecbda200012d141dc2: Beginning new tablet copy session on tablet 0d4e65893d284960aef32d35d0db30a4 from peer d709ee666b774ec29aa732e508219938 at {username='slave'} at 127.0.0.1:41312: session id = d709ee666b774ec29aa732e508219938-0d4e65893d284960aef32d35d0db30a4
I20260709 13:14:08.451962  4840 tablet_bootstrap.cc:492] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938: Bootstrap starting.
I20260709 13:14:08.457880  4044 tablet_copy_source_session.cc:215] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:08.461452  4842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d4e65893d284960aef32d35d0db30a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:08.484918  4842 tablet_copy_client.cc:806] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:08.485622  4842 tablet_copy_client.cc:670] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:08.490906  4842 tablet_copy_client.cc:538] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:08.492192  4840 tablet_bootstrap.cc:492] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:08.494189  4840 tablet_bootstrap.cc:492] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938: Bootstrap complete.
I20260709 13:14:08.495282  4840 ts_tablet_manager.cc:1403] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938: Time spent bootstrapping tablet: real 0.044s	user 0.022s	sys 0.012s
I20260709 13:14:08.499754  4840 raft_consensus.cc:359] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:08.500999  4840 raft_consensus.cc:740] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Initialized, Role: LEARNER
I20260709 13:14:08.501780  4840 consensus_queue.cc:260] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:08.518194  4846 ts_tablet_manager.cc:933] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938: Initiating tablet copy from peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:08.522075  4842 tablet_bootstrap.cc:492] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938: Bootstrap starting.
I20260709 13:14:08.529991  4840 ts_tablet_manager.cc:1434] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.019s
I20260709 13:14:08.538988  4846 tablet_copy_client.cc:323] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938: tablet copy: Beginning tablet copy session from remote peer at address 127.2.198.195:37843
I20260709 13:14:08.540993  3969 tablet_copy_service.cc:342] P f1c75790cedf4f52a3463a255c7da059: Request end of tablet copy session d709ee666b774ec29aa732e508219938-9873af7d73cf49f3b2d74a17cf7cd3bf received from {username='slave'} at 127.0.0.1:35354
I20260709 13:14:08.541482  3969 tablet_copy_service.cc:434] P f1c75790cedf4f52a3463a255c7da059: ending tablet copy session d709ee666b774ec29aa732e508219938-9873af7d73cf49f3b2d74a17cf7cd3bf on tablet 9873af7d73cf49f3b2d74a17cf7cd3bf with peer d709ee666b774ec29aa732e508219938
I20260709 13:14:08.542156  4118 tablet_copy_service.cc:140] P 8952c48a6f3a43968f7d77f7bfc4d1bc: Received BeginTabletCopySession request for tablet 0c7551e973324a21b094c1d2869495ac from peer d709ee666b774ec29aa732e508219938 ({username='slave'} at 127.0.0.1:34656)
I20260709 13:14:08.542920  4118 tablet_copy_service.cc:161] P 8952c48a6f3a43968f7d77f7bfc4d1bc: Beginning new tablet copy session on tablet 0c7551e973324a21b094c1d2869495ac from peer d709ee666b774ec29aa732e508219938 at {username='slave'} at 127.0.0.1:34656: session id = d709ee666b774ec29aa732e508219938-0c7551e973324a21b094c1d2869495ac
I20260709 13:14:08.553861  4118 tablet_copy_source_session.cc:215] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:08.557865  4846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c7551e973324a21b094c1d2869495ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:08.563997  4842 tablet_bootstrap.cc:492] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:08.566867  4842 tablet_bootstrap.cc:492] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938: Bootstrap complete.
I20260709 13:14:08.572154  4842 ts_tablet_manager.cc:1403] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938: Time spent bootstrapping tablet: real 0.050s	user 0.015s	sys 0.013s
I20260709 13:14:08.578440  4840 ts_tablet_manager.cc:933] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938: Initiating tablet copy from peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:08.598650  4842 raft_consensus.cc:359] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:08.601476  4846 tablet_copy_client.cc:806] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:08.601668  4842 raft_consensus.cc:740] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Initialized, Role: LEARNER
I20260709 13:14:08.601097  4840 tablet_copy_client.cc:323] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938: tablet copy: Beginning tablet copy session from remote peer at address 127.2.198.194:46115
I20260709 13:14:08.605027  4044 tablet_copy_service.cc:140] P 6f5b5e4ed72944ecbda200012d141dc2: Received BeginTabletCopySession request for tablet 4b83b18c9e8b401c95ac6e2c0a420316 from peer d709ee666b774ec29aa732e508219938 ({username='slave'} at 127.0.0.1:41312)
I20260709 13:14:08.604509  4846 tablet_copy_client.cc:670] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:08.605683  4044 tablet_copy_service.cc:161] P 6f5b5e4ed72944ecbda200012d141dc2: Beginning new tablet copy session on tablet 4b83b18c9e8b401c95ac6e2c0a420316 from peer d709ee666b774ec29aa732e508219938 at {username='slave'} at 127.0.0.1:41312: session id = d709ee666b774ec29aa732e508219938-4b83b18c9e8b401c95ac6e2c0a420316
I20260709 13:14:08.603376  4842 consensus_queue.cc:260] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:08.610497  4842 ts_tablet_manager.cc:1434] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.002s
I20260709 13:14:08.610559  4846 tablet_copy_client.cc:538] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:08.614286  4043 tablet_copy_service.cc:342] P 6f5b5e4ed72944ecbda200012d141dc2: Request end of tablet copy session d709ee666b774ec29aa732e508219938-0d4e65893d284960aef32d35d0db30a4 received from {username='slave'} at 127.0.0.1:41312
I20260709 13:14:08.614898  4043 tablet_copy_service.cc:434] P 6f5b5e4ed72944ecbda200012d141dc2: ending tablet copy session d709ee666b774ec29aa732e508219938-0d4e65893d284960aef32d35d0db30a4 on tablet 0d4e65893d284960aef32d35d0db30a4 with peer d709ee666b774ec29aa732e508219938
I20260709 13:14:08.634261  4846 tablet_bootstrap.cc:492] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938: Bootstrap starting.
I20260709 13:14:08.647651  4044 tablet_copy_source_session.cc:215] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:08.651953  4840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b83b18c9e8b401c95ac6e2c0a420316. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:08.669231  4846 tablet_bootstrap.cc:492] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:08.670631  4846 tablet_bootstrap.cc:492] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938: Bootstrap complete.
I20260709 13:14:08.671491  4846 ts_tablet_manager.cc:1403] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938: Time spent bootstrapping tablet: real 0.038s	user 0.034s	sys 0.000s
I20260709 13:14:08.675391  4840 tablet_copy_client.cc:806] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:08.675321  4846 raft_consensus.cc:359] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:08.676214  4840 tablet_copy_client.cc:670] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:08.676556  4846 raft_consensus.cc:740] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Initialized, Role: LEARNER
I20260709 13:14:08.677861  4846 consensus_queue.cc:260] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:08.680682  4840 tablet_copy_client.cc:538] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:08.681258  4846 ts_tablet_manager.cc:1434] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:14:08.690047  4118 tablet_copy_service.cc:342] P 8952c48a6f3a43968f7d77f7bfc4d1bc: Request end of tablet copy session d709ee666b774ec29aa732e508219938-0c7551e973324a21b094c1d2869495ac received from {username='slave'} at 127.0.0.1:34656
I20260709 13:14:08.690596  4118 tablet_copy_service.cc:434] P 8952c48a6f3a43968f7d77f7bfc4d1bc: ending tablet copy session d709ee666b774ec29aa732e508219938-0c7551e973324a21b094c1d2869495ac on tablet 0c7551e973324a21b094c1d2869495ac with peer d709ee666b774ec29aa732e508219938
I20260709 13:14:08.694936  4840 tablet_bootstrap.cc:492] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938: Bootstrap starting.
I20260709 13:14:08.713676  4840 tablet_bootstrap.cc:492] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:08.714504  4840 tablet_bootstrap.cc:492] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938: Bootstrap complete.
I20260709 13:14:08.715102  4840 ts_tablet_manager.cc:1403] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.004s
I20260709 13:14:08.717886  4840 raft_consensus.cc:359] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:08.718556  4840 raft_consensus.cc:740] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Initialized, Role: LEARNER
I20260709 13:14:08.719216  4840 consensus_queue.cc:260] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:08.721728  4840 ts_tablet_manager.cc:1434] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:14:08.723932  4044 tablet_copy_service.cc:342] P 6f5b5e4ed72944ecbda200012d141dc2: Request end of tablet copy session d709ee666b774ec29aa732e508219938-4b83b18c9e8b401c95ac6e2c0a420316 received from {username='slave'} at 127.0.0.1:41312
I20260709 13:14:08.724407  4044 tablet_copy_service.cc:434] P 6f5b5e4ed72944ecbda200012d141dc2: ending tablet copy session d709ee666b774ec29aa732e508219938-4b83b18c9e8b401c95ac6e2c0a420316 on tablet 4b83b18c9e8b401c95ac6e2c0a420316 with peer d709ee666b774ec29aa732e508219938
I20260709 13:14:08.843430  4707 raft_consensus.cc:1217] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:08.870831  4707 raft_consensus.cc:1217] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:08.997875  4707 raft_consensus.cc:1217] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:09.075794  4707 raft_consensus.cc:1217] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:09.232785  4778 raft_consensus.cc:1064] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059: attempting to promote NON_VOTER d709ee666b774ec29aa732e508219938 to VOTER
I20260709 13:14:09.234723  4778 consensus_queue.cc:237] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:09.241267  4033 raft_consensus.cc:1275] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:09.241346  4707 raft_consensus.cc:1275] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:09.242950  4857 consensus_queue.cc:1048] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:09.244679  4857 consensus_queue.cc:1048] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:09.248416  4101 raft_consensus.cc:1275] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:09.255427  4857 consensus_queue.cc:1048] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:09.265893  4778 raft_consensus.cc:2955] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:09.270114  4033 raft_consensus.cc:2955] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:09.279640  4101 raft_consensus.cc:2955] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:09.279817  4707 raft_consensus.cc:2955] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:09.309548  3857 catalog_manager.cc:5697] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:09.359292  3958 consensus_queue.cc:237] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:09.373545  4707 raft_consensus.cc:1275] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:09.376546  4034 raft_consensus.cc:1275] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:09.376510  4823 consensus_queue.cc:1048] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:09.381352  4857 consensus_queue.cc:1048] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:09.394608  4822 raft_consensus.cc:2955] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:09.404863  4707 raft_consensus.cc:2955] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:09.405689  4034 raft_consensus.cc:2955] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:09.429131  3841 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9873af7d73cf49f3b2d74a17cf7cd3bf with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:09.431016  3857 catalog_manager.cc:5697] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 reported cstate change: config changed from index 3 to 4, VOTER 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) evicted. New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:09.442484  4095 tablet_service.cc:1558] Processing DeleteTablet for tablet 9873af7d73cf49f3b2d74a17cf7cd3bf with delete_type TABLET_DATA_TOMBSTONED (TS 8952c48a6f3a43968f7d77f7bfc4d1bc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45324
I20260709 13:14:09.445845  4866 tablet_replica.cc:333] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:14:09.447093  4866 raft_consensus.cc:2243] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:09.447990  4866 raft_consensus.cc:2272] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:09.452075  4866 ts_tablet_manager.cc:1916] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 8952c48a6f3a43968f7d77f7bfc4d1bc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:09.466477  4866 ts_tablet_manager.cc:1929] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 8952c48a6f3a43968f7d77f7bfc4d1bc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:09.466928  4866 log.cc:1199] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 8952c48a6f3a43968f7d77f7bfc4d1bc: Deleting WAL directory at /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/ts-2-root/wals/9873af7d73cf49f3b2d74a17cf7cd3bf
I20260709 13:14:09.468544  3841 catalog_manager.cc:5028] TS 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): tablet 9873af7d73cf49f3b2d74a17cf7cd3bf (table test-workload [id=8a2760e8528448a780fea6ccf25816cb]) successfully deleted
I20260709 13:14:09.489054  4828 raft_consensus.cc:1064] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2: attempting to promote NON_VOTER d709ee666b774ec29aa732e508219938 to VOTER
I20260709 13:14:09.493661  4828 consensus_queue.cc:237] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:09.502641  4707 raft_consensus.cc:1275] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:09.505671  4791 consensus_queue.cc:1048] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:09.509301  4101 raft_consensus.cc:1275] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:09.513633  3958 raft_consensus.cc:1275] T 0d4e65893d284960aef32d35d0db30a4 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:09.516508  4855 consensus_queue.cc:1048] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:09.518563  4791 consensus_queue.cc:1048] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:09.528553  4868 raft_consensus.cc:2955] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:09.531608  3958 raft_consensus.cc:2955] T 0d4e65893d284960aef32d35d0db30a4 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:09.533655  4101 raft_consensus.cc:2955] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:09.546185  4707 raft_consensus.cc:2955] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:09.550331  3857 catalog_manager.cc:5697] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:09.565910  4030 consensus_queue.cc:237] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:09.583487  4708 raft_consensus.cc:1275] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:09.584968  4101 raft_consensus.cc:1275] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:09.586390  4868 consensus_queue.cc:1048] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:09.587240  4791 consensus_queue.cc:1048] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:09.594214  4791 raft_consensus.cc:2955] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:09.598356  4101 raft_consensus.cc:2955] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:09.598320  4708 raft_consensus.cc:2955] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:09.612564  4796 raft_consensus.cc:1064] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc: attempting to promote NON_VOTER d709ee666b774ec29aa732e508219938 to VOTER
I20260709 13:14:09.615164  4796 consensus_queue.cc:237] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:09.633800  3844 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0d4e65893d284960aef32d35d0db30a4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:09.641295  3857 catalog_manager.cc:5697] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 reported cstate change: config changed from index 3 to 4, VOTER f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) evicted. New cstate: current_term: 1 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:09.660233  3948 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d4e65893d284960aef32d35d0db30a4 with delete_type TABLET_DATA_TOMBSTONED (TS f1c75790cedf4f52a3463a255c7da059 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38604
I20260709 13:14:09.675449  4030 raft_consensus.cc:1275] T 0c7551e973324a21b094c1d2869495ac P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:09.675997  3958 raft_consensus.cc:1275] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:09.677695  4851 consensus_queue.cc:1048] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:14:09.680987  4791 raft_consensus.cc:1064] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2: attempting to promote NON_VOTER d709ee666b774ec29aa732e508219938 to VOTER
I20260709 13:14:09.683859  4791 consensus_queue.cc:237] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:09.698231  4873 tablet_replica.cc:333] T 0d4e65893d284960aef32d35d0db30a4 P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:14:09.701408  4799 consensus_queue.cc:1048] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:09.706453  4873 raft_consensus.cc:2243] T 0d4e65893d284960aef32d35d0db30a4 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:09.696972  4708 raft_consensus.cc:1275] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:09.707454  4873 raft_consensus.cc:2272] T 0d4e65893d284960aef32d35d0db30a4 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:09.715411  4873 ts_tablet_manager.cc:1916] T 0d4e65893d284960aef32d35d0db30a4 P f1c75790cedf4f52a3463a255c7da059: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:09.723253  4799 consensus_queue.cc:1048] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:09.735627  4873 ts_tablet_manager.cc:1929] T 0d4e65893d284960aef32d35d0db30a4 P f1c75790cedf4f52a3463a255c7da059: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:09.736263  4873 log.cc:1199] T 0d4e65893d284960aef32d35d0db30a4 P f1c75790cedf4f52a3463a255c7da059: Deleting WAL directory at /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/ts-0-root/wals/0d4e65893d284960aef32d35d0db30a4
I20260709 13:14:09.738137  3841 catalog_manager.cc:5028] TS f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): tablet 0d4e65893d284960aef32d35d0db30a4 (table test-workload [id=8a2760e8528448a780fea6ccf25816cb]) successfully deleted
I20260709 13:14:09.763733  4852 raft_consensus.cc:2955] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:09.777114  4707 raft_consensus.cc:1275] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:09.774842  4708 raft_consensus.cc:2955] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:09.779031  3957 raft_consensus.cc:1275] T 4b83b18c9e8b401c95ac6e2c0a420316 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:09.779212  4101 raft_consensus.cc:1275] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:09.780709  4855 consensus_queue.cc:1048] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:09.782853  4868 consensus_queue.cc:1048] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:09.784086  4837 consensus_queue.cc:1048] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:09.797801  4034 raft_consensus.cc:2955] T 0c7551e973324a21b094c1d2869495ac P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:09.808127  4837 raft_consensus.cc:2955] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:09.817962  4709 raft_consensus.cc:2955] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:09.819442  3854 catalog_manager.cc:5697] T 0c7551e973324a21b094c1d2869495ac P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:09.829427  3957 raft_consensus.cc:2955] T 4b83b18c9e8b401c95ac6e2c0a420316 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:09.836366  3857 catalog_manager.cc:5697] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 reported cstate change: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:09.840365  3958 raft_consensus.cc:2955] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:09.860939  4101 raft_consensus.cc:2955] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:09.885365  4034 consensus_queue.cc:237] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:09.892877  4709 raft_consensus.cc:1275] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:09.895126  4828 consensus_queue.cc:1048] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:09.886723  4108 consensus_queue.cc:237] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:09.904083  4708 raft_consensus.cc:1275] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:09.904264  3958 raft_consensus.cc:1275] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:09.905795  4851 consensus_queue.cc:1048] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:09.906333  4855 raft_consensus.cc:2955] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:09.908900  4108 raft_consensus.cc:1275] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:09.910737  4851 consensus_queue.cc:1048] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:09.912256  4708 raft_consensus.cc:2955] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:09.915145  4837 consensus_queue.cc:1048] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:09.926817  4851 raft_consensus.cc:2955] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:09.932849  4108 raft_consensus.cc:2955] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:09.933329  4708 raft_consensus.cc:2955] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:09.937330  3854 catalog_manager.cc:5697] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 reported cstate change: config changed from index 3 to 4, VOTER f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) evicted. New cstate: current_term: 1 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:09.940728  3844 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4b83b18c9e8b401c95ac6e2c0a420316 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:09.959636  3958 raft_consensus.cc:2955] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:09.964900  3948 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b83b18c9e8b401c95ac6e2c0a420316 with delete_type TABLET_DATA_TOMBSTONED (TS f1c75790cedf4f52a3463a255c7da059 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38604
I20260709 13:14:09.966022  4873 tablet_replica.cc:333] T 4b83b18c9e8b401c95ac6e2c0a420316 P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:14:09.967072  4873 raft_consensus.cc:2243] T 4b83b18c9e8b401c95ac6e2c0a420316 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:09.969106  3841 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0c7551e973324a21b094c1d2869495ac with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:09.977851  4873 raft_consensus.cc:2272] T 4b83b18c9e8b401c95ac6e2c0a420316 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:09.982191  4873 ts_tablet_manager.cc:1916] T 4b83b18c9e8b401c95ac6e2c0a420316 P f1c75790cedf4f52a3463a255c7da059: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:09.997812  3854 catalog_manager.cc:5697] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 reported cstate change: config changed from index 3 to 4, VOTER 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) evicted. New cstate: current_term: 1 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:10.028115  4873 ts_tablet_manager.cc:1929] T 4b83b18c9e8b401c95ac6e2c0a420316 P f1c75790cedf4f52a3463a255c7da059: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:10.028028  4017 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c7551e973324a21b094c1d2869495ac with delete_type TABLET_DATA_TOMBSTONED (TS 6f5b5e4ed72944ecbda200012d141dc2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38278
I20260709 13:14:10.034875  4873 log.cc:1199] T 4b83b18c9e8b401c95ac6e2c0a420316 P f1c75790cedf4f52a3463a255c7da059: Deleting WAL directory at /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/ts-0-root/wals/4b83b18c9e8b401c95ac6e2c0a420316
I20260709 13:14:10.036293  3841 catalog_manager.cc:5028] TS f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): tablet 4b83b18c9e8b401c95ac6e2c0a420316 (table test-workload [id=8a2760e8528448a780fea6ccf25816cb]) successfully deleted
I20260709 13:14:10.037544  4881 tablet_replica.cc:333] T 0c7551e973324a21b094c1d2869495ac P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:14:10.038442  4881 raft_consensus.cc:2243] T 0c7551e973324a21b094c1d2869495ac P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:10.039108  4881 raft_consensus.cc:2272] T 0c7551e973324a21b094c1d2869495ac P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:10.043040  4881 ts_tablet_manager.cc:1916] T 0c7551e973324a21b094c1d2869495ac P 6f5b5e4ed72944ecbda200012d141dc2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:10.060570  4881 ts_tablet_manager.cc:1929] T 0c7551e973324a21b094c1d2869495ac P 6f5b5e4ed72944ecbda200012d141dc2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:10.061021  4881 log.cc:1199] T 0c7551e973324a21b094c1d2869495ac P 6f5b5e4ed72944ecbda200012d141dc2: Deleting WAL directory at /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/ts-1-root/wals/0c7551e973324a21b094c1d2869495ac
I20260709 13:14:10.062647  3844 catalog_manager.cc:5028] TS 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): tablet 0c7551e973324a21b094c1d2869495ac (table test-workload [id=8a2760e8528448a780fea6ccf25816cb]) successfully deleted
I20260709 13:14:11.108889  3958 consensus_queue.cc:237] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
W20260709 13:14:11.115023  3924 consensus_peers.cc:597] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 -> Peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117): Couldn't send request to peer d709ee666b774ec29aa732e508219938. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 08d6732bceef4220a670ac449347258b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:11.115437  4103 raft_consensus.cc:1275] T 08d6732bceef4220a670ac449347258b P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:11.116289  4034 raft_consensus.cc:1275] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:11.116957  4822 consensus_queue.cc:1048] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:11.118078  4882 consensus_queue.cc:1048] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:11.125566  4822 raft_consensus.cc:2955] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:11.127269  4103 raft_consensus.cc:2955] T 08d6732bceef4220a670ac449347258b P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:11.153669  4108 consensus_queue.cc:237] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
W20260709 13:14:11.216413  4073 consensus_peers.cc:597] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117): Couldn't send request to peer d709ee666b774ec29aa732e508219938. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 11c2da89f37f4113a8811c6e081da953. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:11.220258  4025 raft_consensus.cc:1275] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:11.222441  4851 consensus_queue.cc:1048] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:14:11.235917  4025 raft_consensus.cc:2955] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:11.236577  3857 catalog_manager.cc:5697] T 08d6732bceef4220a670ac449347258b P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:11.242614  4851 raft_consensus.cc:2955] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:11.244087  4034 raft_consensus.cc:2955] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:11.264782  3956 raft_consensus.cc:1275] T 11c2da89f37f4113a8811c6e081da953 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:11.268121  4103 consensus_queue.cc:237] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:11.279796  4851 consensus_queue.cc:1048] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:14:11.417656  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 145779us
I20260709 13:14:11.442781  3958 raft_consensus.cc:1275] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:11.447012  4890 consensus_queue.cc:1048] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:11.480507  4028 raft_consensus.cc:1275] T f4845eaa52cb4965b9c8922f37e2f606 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:11.511332  3855 catalog_manager.cc:5697] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New cstate: current_term: 1 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:11.521250  4890 consensus_queue.cc:1048] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
W20260709 13:14:11.539690  4073 consensus_peers.cc:597] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117): Couldn't send request to peer d709ee666b774ec29aa732e508219938. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f4845eaa52cb4965b9c8922f37e2f606. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:11.550201  3957 raft_consensus.cc:2955] T 11c2da89f37f4113a8811c6e081da953 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
W20260709 13:14:11.564977  4904 log.cc:927] Time spent T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:14:11.568611  4851 raft_consensus.cc:2955] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:11.591248  3957 raft_consensus.cc:2955] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:11.607205  3958 consensus_queue.cc:237] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:11.627156  4030 raft_consensus.cc:2955] T f4845eaa52cb4965b9c8922f37e2f606 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
W20260709 13:14:11.631814  3924 consensus_peers.cc:597] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 -> Peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117): Couldn't send request to peer d709ee666b774ec29aa732e508219938. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 622bcde3b6ba43678f5eb621e8259db2. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:11.634207  4108 raft_consensus.cc:1275] T 622bcde3b6ba43678f5eb621e8259db2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:11.636299  4027 raft_consensus.cc:1275] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:11.636623  4906 consensus_queue.cc:1048] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:11.637979  4884 consensus_queue.cc:1048] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:11.642021  4908 ts_tablet_manager.cc:933] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938: Initiating tablet copy from peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:11.644654  4908 tablet_copy_client.cc:323] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938: tablet copy: Beginning tablet copy session from remote peer at address 127.2.198.195:37843
I20260709 13:14:11.646370  4118 tablet_copy_service.cc:140] P 8952c48a6f3a43968f7d77f7bfc4d1bc: Received BeginTabletCopySession request for tablet 11c2da89f37f4113a8811c6e081da953 from peer d709ee666b774ec29aa732e508219938 ({username='slave'} at 127.0.0.1:34656)
I20260709 13:14:11.646935  4118 tablet_copy_service.cc:161] P 8952c48a6f3a43968f7d77f7bfc4d1bc: Beginning new tablet copy session on tablet 11c2da89f37f4113a8811c6e081da953 from peer d709ee666b774ec29aa732e508219938 at {username='slave'} at 127.0.0.1:34656: session id = d709ee666b774ec29aa732e508219938-11c2da89f37f4113a8811c6e081da953
I20260709 13:14:11.658526  4118 tablet_copy_source_session.cc:215] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:11.662048  4908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11c2da89f37f4113a8811c6e081da953. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.660111  3855 catalog_manager.cc:5697] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New cstate: current_term: 1 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:11.668934  4906 raft_consensus.cc:2955] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:11.678609  4030 raft_consensus.cc:2955] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:11.707698  4103 raft_consensus.cc:2955] T 622bcde3b6ba43678f5eb621e8259db2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:11.708573  3857 catalog_manager.cc:5697] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:11.731388  4908 tablet_copy_client.cc:806] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:11.732676  4908 tablet_copy_client.cc:670] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:11.734302  4913 ts_tablet_manager.cc:933] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938: Initiating tablet copy from peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339)
I20260709 13:14:11.740204  4908 tablet_copy_client.cc:538] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:11.753368  4913 tablet_copy_client.cc:323] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938: tablet copy: Beginning tablet copy session from remote peer at address 127.2.198.193:35339
I20260709 13:14:11.755525  3969 tablet_copy_service.cc:140] P f1c75790cedf4f52a3463a255c7da059: Received BeginTabletCopySession request for tablet 08d6732bceef4220a670ac449347258b from peer d709ee666b774ec29aa732e508219938 ({username='slave'} at 127.0.0.1:35354)
I20260709 13:14:11.756194  3969 tablet_copy_service.cc:161] P f1c75790cedf4f52a3463a255c7da059: Beginning new tablet copy session on tablet 08d6732bceef4220a670ac449347258b from peer d709ee666b774ec29aa732e508219938 at {username='slave'} at 127.0.0.1:35354: session id = d709ee666b774ec29aa732e508219938-08d6732bceef4220a670ac449347258b
I20260709 13:14:11.764796  3969 tablet_copy_source_session.cc:215] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:11.764858  4908 tablet_bootstrap.cc:492] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938: Bootstrap starting.
I20260709 13:14:11.768520  4913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08d6732bceef4220a670ac449347258b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.794325  4908 tablet_bootstrap.cc:492] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:11.795521  4908 tablet_bootstrap.cc:492] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938: Bootstrap complete.
I20260709 13:14:11.796314  4908 ts_tablet_manager.cc:1403] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938: Time spent bootstrapping tablet: real 0.032s	user 0.026s	sys 0.000s
I20260709 13:14:11.801412  4908 raft_consensus.cc:359] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:11.802341  4908 raft_consensus.cc:740] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Initialized, Role: LEARNER
I20260709 13:14:11.803041  4908 consensus_queue.cc:260] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:11.804731  4913 tablet_copy_client.cc:806] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:11.805763  4913 tablet_copy_client.cc:670] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:11.812476  4913 tablet_copy_client.cc:538] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:11.813638  4908 ts_tablet_manager.cc:1434] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.005s
I20260709 13:14:11.824765  4118 tablet_copy_service.cc:342] P 8952c48a6f3a43968f7d77f7bfc4d1bc: Request end of tablet copy session d709ee666b774ec29aa732e508219938-11c2da89f37f4113a8811c6e081da953 received from {username='slave'} at 127.0.0.1:34656
I20260709 13:14:11.825304  4118 tablet_copy_service.cc:434] P 8952c48a6f3a43968f7d77f7bfc4d1bc: ending tablet copy session d709ee666b774ec29aa732e508219938-11c2da89f37f4113a8811c6e081da953 on tablet 11c2da89f37f4113a8811c6e081da953 with peer d709ee666b774ec29aa732e508219938
I20260709 13:14:11.831161  4913 tablet_bootstrap.cc:492] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938: Bootstrap starting.
I20260709 13:14:11.859180  4913 tablet_bootstrap.cc:492] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:11.860301  4913 tablet_bootstrap.cc:492] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938: Bootstrap complete.
I20260709 13:14:11.861083  4913 ts_tablet_manager.cc:1403] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.012s
I20260709 13:14:11.864699  4913 raft_consensus.cc:359] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:11.865624  4913 raft_consensus.cc:740] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Initialized, Role: LEARNER
I20260709 13:14:11.866333  4913 consensus_queue.cc:260] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:11.868971  4913 ts_tablet_manager.cc:1434] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:14:11.873175  3969 tablet_copy_service.cc:342] P f1c75790cedf4f52a3463a255c7da059: Request end of tablet copy session d709ee666b774ec29aa732e508219938-08d6732bceef4220a670ac449347258b received from {username='slave'} at 127.0.0.1:35354
I20260709 13:14:11.873692  3969 tablet_copy_service.cc:434] P f1c75790cedf4f52a3463a255c7da059: ending tablet copy session d709ee666b774ec29aa732e508219938-08d6732bceef4220a670ac449347258b on tablet 08d6732bceef4220a670ac449347258b with peer d709ee666b774ec29aa732e508219938
I20260709 13:14:11.935395  4913 ts_tablet_manager.cc:933] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938: Initiating tablet copy from peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:11.937306  4913 tablet_copy_client.cc:323] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938: tablet copy: Beginning tablet copy session from remote peer at address 127.2.198.195:37843
I20260709 13:14:11.938941  4118 tablet_copy_service.cc:140] P 8952c48a6f3a43968f7d77f7bfc4d1bc: Received BeginTabletCopySession request for tablet f4845eaa52cb4965b9c8922f37e2f606 from peer d709ee666b774ec29aa732e508219938 ({username='slave'} at 127.0.0.1:34656)
I20260709 13:14:11.939498  4118 tablet_copy_service.cc:161] P 8952c48a6f3a43968f7d77f7bfc4d1bc: Beginning new tablet copy session on tablet f4845eaa52cb4965b9c8922f37e2f606 from peer d709ee666b774ec29aa732e508219938 at {username='slave'} at 127.0.0.1:34656: session id = d709ee666b774ec29aa732e508219938-f4845eaa52cb4965b9c8922f37e2f606
I20260709 13:14:11.950348  4118 tablet_copy_source_session.cc:215] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:11.955226  4913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4845eaa52cb4965b9c8922f37e2f606. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.975266  4913 tablet_copy_client.cc:806] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:11.976147  4913 tablet_copy_client.cc:670] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:11.980577  4913 tablet_copy_client.cc:538] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:11.992381  4913 tablet_bootstrap.cc:492] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938: Bootstrap starting.
I20260709 13:14:12.014992  4913 tablet_bootstrap.cc:492] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:12.016069  4913 tablet_bootstrap.cc:492] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938: Bootstrap complete.
I20260709 13:14:12.029376  4913 ts_tablet_manager.cc:1403] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938: Time spent bootstrapping tablet: real 0.037s	user 0.020s	sys 0.004s
I20260709 13:14:12.035809  4913 raft_consensus.cc:359] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:12.036808  4913 raft_consensus.cc:740] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Initialized, Role: LEARNER
I20260709 13:14:12.037485  4913 consensus_queue.cc:260] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:12.040087  4913 ts_tablet_manager.cc:1434] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:14:12.042665  4118 tablet_copy_service.cc:342] P 8952c48a6f3a43968f7d77f7bfc4d1bc: Request end of tablet copy session d709ee666b774ec29aa732e508219938-f4845eaa52cb4965b9c8922f37e2f606 received from {username='slave'} at 127.0.0.1:34656
I20260709 13:14:12.043155  4118 tablet_copy_service.cc:434] P 8952c48a6f3a43968f7d77f7bfc4d1bc: ending tablet copy session d709ee666b774ec29aa732e508219938-f4845eaa52cb4965b9c8922f37e2f606 on tablet f4845eaa52cb4965b9c8922f37e2f606 with peer d709ee666b774ec29aa732e508219938
I20260709 13:14:12.127895  4708 raft_consensus.cc:1217] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:12.136212  4913 ts_tablet_manager.cc:933] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938: Initiating tablet copy from peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339)
I20260709 13:14:12.143551  4913 tablet_copy_client.cc:323] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938: tablet copy: Beginning tablet copy session from remote peer at address 127.2.198.193:35339
I20260709 13:14:12.145200  3969 tablet_copy_service.cc:140] P f1c75790cedf4f52a3463a255c7da059: Received BeginTabletCopySession request for tablet 622bcde3b6ba43678f5eb621e8259db2 from peer d709ee666b774ec29aa732e508219938 ({username='slave'} at 127.0.0.1:35354)
I20260709 13:14:12.145740  3969 tablet_copy_service.cc:161] P f1c75790cedf4f52a3463a255c7da059: Beginning new tablet copy session on tablet 622bcde3b6ba43678f5eb621e8259db2 from peer d709ee666b774ec29aa732e508219938 at {username='slave'} at 127.0.0.1:35354: session id = d709ee666b774ec29aa732e508219938-622bcde3b6ba43678f5eb621e8259db2
I20260709 13:14:12.153172  3969 tablet_copy_source_session.cc:215] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:12.156258  4913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 622bcde3b6ba43678f5eb621e8259db2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.170398  4913 tablet_copy_client.cc:806] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:12.171007  4913 tablet_copy_client.cc:670] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:12.175129  4913 tablet_copy_client.cc:538] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:12.183871  4913 tablet_bootstrap.cc:492] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938: Bootstrap starting.
I20260709 13:14:12.200853  4913 tablet_bootstrap.cc:492] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:12.201779  4913 tablet_bootstrap.cc:492] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938: Bootstrap complete.
I20260709 13:14:12.202431  4913 ts_tablet_manager.cc:1403] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.001s
I20260709 13:14:12.205346  4913 raft_consensus.cc:359] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:12.206209  4913 raft_consensus.cc:740] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Initialized, Role: LEARNER
I20260709 13:14:12.206991  4913 consensus_queue.cc:260] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:12.209654  4913 ts_tablet_manager.cc:1434] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:14:12.211496  3969 tablet_copy_service.cc:342] P f1c75790cedf4f52a3463a255c7da059: Request end of tablet copy session d709ee666b774ec29aa732e508219938-622bcde3b6ba43678f5eb621e8259db2 received from {username='slave'} at 127.0.0.1:35354
I20260709 13:14:12.211968  3969 tablet_copy_service.cc:434] P f1c75790cedf4f52a3463a255c7da059: ending tablet copy session d709ee666b774ec29aa732e508219938-622bcde3b6ba43678f5eb621e8259db2 on tablet 622bcde3b6ba43678f5eb621e8259db2 with peer d709ee666b774ec29aa732e508219938
I20260709 13:14:12.228226  4708 raft_consensus.cc:1217] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:14:12.322836  3980 debug-util.cc:398] Leaking SignalData structure 0x7b08000ddfc0 after lost signal to thread 2846
W20260709 13:14:12.324323  3980 debug-util.cc:398] Leaking SignalData structure 0x7b0800148be0 after lost signal to thread 3891
W20260709 13:14:12.325837  3980 debug-util.cc:398] Leaking SignalData structure 0x7b080029d340 after lost signal to thread 3983
W20260709 13:14:12.327175  3980 debug-util.cc:398] Leaking SignalData structure 0x7b0800303260 after lost signal to thread 4058
W20260709 13:14:12.329095  3980 debug-util.cc:398] Leaking SignalData structure 0x7b080030dc60 after lost signal to thread 4132
I20260709 13:14:12.329478  4708 raft_consensus.cc:1217] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:14:12.333253  3980 debug-util.cc:398] Leaking SignalData structure 0x7b08002bc740 after lost signal to thread 4733
I20260709 13:14:12.540184  4822 raft_consensus.cc:1064] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059: attempting to promote NON_VOTER d709ee666b774ec29aa732e508219938 to VOTER
I20260709 13:14:12.542892  4822 consensus_queue.cc:237] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:12.615764  4708 raft_consensus.cc:1275] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:12.619895  4822 consensus_queue.cc:1048] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:12.631944  4108 raft_consensus.cc:1275] T 08d6732bceef4220a670ac449347258b P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:12.634739  4906 consensus_queue.cc:1048] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:12.661471  4033 raft_consensus.cc:1275] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:12.663177  4906 consensus_queue.cc:1048] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:12.687103  4707 raft_consensus.cc:1217] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:12.711813  4891 raft_consensus.cc:1064] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc: attempting to promote NON_VOTER d709ee666b774ec29aa732e508219938 to VOTER
I20260709 13:14:12.717895  4891 consensus_queue.cc:237] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:12.732592  4900 raft_consensus.cc:1064] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc: attempting to promote NON_VOTER d709ee666b774ec29aa732e508219938 to VOTER
W20260709 13:14:12.735075  4923 log.cc:927] Time spent T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:14:12.735972  4900 consensus_queue.cc:237] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:12.739825  4822 raft_consensus.cc:2955] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:12.746572  4027 raft_consensus.cc:2955] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:12.758675  4707 raft_consensus.cc:2955] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:12.815580  4708 raft_consensus.cc:1275] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:12.819869  4890 consensus_queue.cc:1048] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:12.834115  4025 raft_consensus.cc:1275] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:12.836826  3955 raft_consensus.cc:1275] T 11c2da89f37f4113a8811c6e081da953 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:12.842963  4900 consensus_queue.cc:1048] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:12.861959  4106 raft_consensus.cc:2955] T 08d6732bceef4220a670ac449347258b P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:12.899978  3857 catalog_manager.cc:5697] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:12.939930  4900 consensus_queue.cc:1048] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:12.975813  4707 raft_consensus.cc:1275] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:12.979157  4934 consensus_queue.cc:1048] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:12.989552  3956 raft_consensus.cc:1275] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:12.996318  4900 consensus_queue.cc:1048] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:14:13.017144  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 54016.3us
I20260709 13:14:13.023466  4900 raft_consensus.cc:2955] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:13.028250  3956 raft_consensus.cc:2955] T 11c2da89f37f4113a8811c6e081da953 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:13.034571  4025 raft_consensus.cc:1275] T f4845eaa52cb4965b9c8922f37e2f606 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:13.053056  4707 raft_consensus.cc:2955] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:13.063884  4934 raft_consensus.cc:2955] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:13.069530  3958 raft_consensus.cc:2955] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:13.083725  4932 consensus_queue.cc:1048] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:13.087424  4707 raft_consensus.cc:2955] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:13.091691  4030 raft_consensus.cc:2955] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:13.095052  4033 raft_consensus.cc:2955] T f4845eaa52cb4965b9c8922f37e2f606 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:13.136653  3957 consensus_queue.cc:237] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:13.142231  3854 catalog_manager.cc:5697] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 reported cstate change: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:13.159106  4707 raft_consensus.cc:1275] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:13.161727  4930 consensus_queue.cc:1048] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:13.164736  3854 catalog_manager.cc:5697] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 reported cstate change: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:13.169348  4030 raft_consensus.cc:1275] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:13.176502  4822 consensus_queue.cc:1048] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:13.179862  4884 raft_consensus.cc:2955] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:13.196239  4707 raft_consensus.cc:2955] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:13.202538  4025 raft_consensus.cc:2955] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:13.241700  4106 consensus_queue.cc:237] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:13.242859  4108 consensus_queue.cc:237] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:13.247921  3841 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 08d6732bceef4220a670ac449347258b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:13.253299  4707 raft_consensus.cc:1275] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:13.263216  4932 consensus_queue.cc:1048] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:13.269831  4708 raft_consensus.cc:1275] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:13.288940  4900 consensus_queue.cc:1048] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:13.273898  4025 raft_consensus.cc:1275] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:13.276804  3957 raft_consensus.cc:1275] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:13.280259  3857 catalog_manager.cc:5697] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: config changed from index 3 to 4, VOTER 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) evicted. New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:13.283691  4930 raft_consensus.cc:1064] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059: attempting to promote NON_VOTER d709ee666b774ec29aa732e508219938 to VOTER
I20260709 13:14:13.294422  4928 raft_consensus.cc:2955] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:13.296104  4890 consensus_queue.cc:1048] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:13.296473  4930 consensus_queue.cc:237] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:13.298313  4890 consensus_queue.cc:1048] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:13.301187  4025 raft_consensus.cc:2955] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:13.305718  4707 raft_consensus.cc:2955] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:13.315178  4095 tablet_service.cc:1558] Processing DeleteTablet for tablet 08d6732bceef4220a670ac449347258b with delete_type TABLET_DATA_TOMBSTONED (TS 8952c48a6f3a43968f7d77f7bfc4d1bc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45324
I20260709 13:14:13.320595  4900 raft_consensus.cc:2955] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:13.325734  4708 raft_consensus.cc:2955] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:13.340771  4947 tablet_replica.cc:333] T 08d6732bceef4220a670ac449347258b P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:14:13.342170  3841 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 11c2da89f37f4113a8811c6e081da953 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:13.346062  4030 raft_consensus.cc:1275] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:13.346575  4103 raft_consensus.cc:1275] T 622bcde3b6ba43678f5eb621e8259db2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:13.349838  4930 consensus_queue.cc:1048] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:13.359910  4943 consensus_queue.cc:1048] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:13.360913  4947 raft_consensus.cc:2243] T 08d6732bceef4220a670ac449347258b P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:13.362511  3857 catalog_manager.cc:5697] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: config changed from index 3 to 4, VOTER f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) evicted. New cstate: current_term: 1 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:13.367450  4709 raft_consensus.cc:1275] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:13.374464  4822 consensus_queue.cc:1048] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:13.383631  4947 raft_consensus.cc:2272] T 08d6732bceef4220a670ac449347258b P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:13.388290  4947 ts_tablet_manager.cc:1916] T 08d6732bceef4220a670ac449347258b P 8952c48a6f3a43968f7d77f7bfc4d1bc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:13.408500  3948 tablet_service.cc:1558] Processing DeleteTablet for tablet 11c2da89f37f4113a8811c6e081da953 with delete_type TABLET_DATA_TOMBSTONED (TS f1c75790cedf4f52a3463a255c7da059 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38604
I20260709 13:14:13.409596  4822 raft_consensus.cc:2955] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:13.415725  3855 catalog_manager.cc:5697] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 reported cstate change: config changed from index 3 to 4, VOTER 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) evicted. New cstate: current_term: 1 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:13.439023  3841 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f4845eaa52cb4965b9c8922f37e2f606 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:13.422837  4709 raft_consensus.cc:2955] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:13.448807  4951 tablet_replica.cc:333] T 11c2da89f37f4113a8811c6e081da953 P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:14:13.450286  4951 raft_consensus.cc:2243] T 11c2da89f37f4113a8811c6e081da953 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:13.451205  4951 raft_consensus.cc:2272] T 11c2da89f37f4113a8811c6e081da953 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:13.455480  4951 ts_tablet_manager.cc:1916] T 11c2da89f37f4113a8811c6e081da953 P f1c75790cedf4f52a3463a255c7da059: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:13.459662  4025 raft_consensus.cc:2955] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:13.465981  4947 ts_tablet_manager.cc:1929] T 08d6732bceef4220a670ac449347258b P 8952c48a6f3a43968f7d77f7bfc4d1bc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:13.466660  4947 log.cc:1199] T 08d6732bceef4220a670ac449347258b P 8952c48a6f3a43968f7d77f7bfc4d1bc: Deleting WAL directory at /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/ts-2-root/wals/08d6732bceef4220a670ac449347258b
I20260709 13:14:13.468835  3841 catalog_manager.cc:5028] TS 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): tablet 08d6732bceef4220a670ac449347258b (table test-workload [id=8a2760e8528448a780fea6ccf25816cb]) successfully deleted
I20260709 13:14:13.482615  3956 raft_consensus.cc:2955] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:13.495112  4108 raft_consensus.cc:2955] T 622bcde3b6ba43678f5eb621e8259db2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:13.488694  4951 ts_tablet_manager.cc:1929] T 11c2da89f37f4113a8811c6e081da953 P f1c75790cedf4f52a3463a255c7da059: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:13.499214  4951 log.cc:1199] T 11c2da89f37f4113a8811c6e081da953 P f1c75790cedf4f52a3463a255c7da059: Deleting WAL directory at /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/ts-0-root/wals/11c2da89f37f4113a8811c6e081da953
I20260709 13:14:13.501395  3841 catalog_manager.cc:5028] TS f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): tablet 11c2da89f37f4113a8811c6e081da953 (table test-workload [id=8a2760e8528448a780fea6ccf25816cb]) successfully deleted
I20260709 13:14:13.523454  4017 tablet_service.cc:1558] Processing DeleteTablet for tablet f4845eaa52cb4965b9c8922f37e2f606 with delete_type TABLET_DATA_TOMBSTONED (TS 6f5b5e4ed72944ecbda200012d141dc2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38278
I20260709 13:14:13.529278  3857 catalog_manager.cc:5697] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:13.585143  4954 tablet_replica.cc:333] T f4845eaa52cb4965b9c8922f37e2f606 P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
W20260709 13:14:13.605067  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 85250.3us
I20260709 13:14:13.615998  3958 consensus_queue.cc:237] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:13.624277  4709 raft_consensus.cc:1275] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:13.626219  4929 consensus_queue.cc:1048] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:13.629671  4954 raft_consensus.cc:2243] T f4845eaa52cb4965b9c8922f37e2f606 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:13.630579  4954 raft_consensus.cc:2272] T f4845eaa52cb4965b9c8922f37e2f606 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:13.639484  4930 raft_consensus.cc:2955] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:13.645002  4709 raft_consensus.cc:2955] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:13.653867  4954 ts_tablet_manager.cc:1916] T f4845eaa52cb4965b9c8922f37e2f606 P 6f5b5e4ed72944ecbda200012d141dc2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:13.655167  3841 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 622bcde3b6ba43678f5eb621e8259db2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:13.669140  4025 raft_consensus.cc:1275] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:13.671782  3856 catalog_manager.cc:5697] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 reported cstate change: config changed from index 3 to 4, VOTER 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) evicted. New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:13.681418  4930 consensus_queue.cc:1048] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:13.691116  4033 raft_consensus.cc:2955] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:13.693362  4095 tablet_service.cc:1558] Processing DeleteTablet for tablet 622bcde3b6ba43678f5eb621e8259db2 with delete_type TABLET_DATA_TOMBSTONED (TS 8952c48a6f3a43968f7d77f7bfc4d1bc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45324
I20260709 13:14:13.695057  4947 tablet_replica.cc:333] T 622bcde3b6ba43678f5eb621e8259db2 P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:14:13.696259  4947 raft_consensus.cc:2243] T 622bcde3b6ba43678f5eb621e8259db2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:13.696993  4947 raft_consensus.cc:2272] T 622bcde3b6ba43678f5eb621e8259db2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:13.701179  4947 ts_tablet_manager.cc:1916] T 622bcde3b6ba43678f5eb621e8259db2 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:13.703356  4954 ts_tablet_manager.cc:1929] T f4845eaa52cb4965b9c8922f37e2f606 P 6f5b5e4ed72944ecbda200012d141dc2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:13.703928  4954 log.cc:1199] T f4845eaa52cb4965b9c8922f37e2f606 P 6f5b5e4ed72944ecbda200012d141dc2: Deleting WAL directory at /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/ts-1-root/wals/f4845eaa52cb4965b9c8922f37e2f606
I20260709 13:14:13.705839  3844 catalog_manager.cc:5028] TS 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): tablet f4845eaa52cb4965b9c8922f37e2f606 (table test-workload [id=8a2760e8528448a780fea6ccf25816cb]) successfully deleted
I20260709 13:14:13.717716  4947 ts_tablet_manager.cc:1929] T 622bcde3b6ba43678f5eb621e8259db2 P 8952c48a6f3a43968f7d77f7bfc4d1bc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:13.718245  4947 log.cc:1199] T 622bcde3b6ba43678f5eb621e8259db2 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Deleting WAL directory at /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/ts-2-root/wals/622bcde3b6ba43678f5eb621e8259db2
I20260709 13:14:13.719712  3841 catalog_manager.cc:5028] TS 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): tablet 622bcde3b6ba43678f5eb621e8259db2 (table test-workload [id=8a2760e8528448a780fea6ccf25816cb]) successfully deleted
I20260709 13:14:14.784777  3958 consensus_queue.cc:237] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:14.799360  4108 raft_consensus.cc:1275] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:14:14.799476  3924 consensus_peers.cc:597] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 -> Peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117): Couldn't send request to peer d709ee666b774ec29aa732e508219938. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 412d794b0f694d089b1b011ba8adea36. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:14.800750  4030 raft_consensus.cc:1275] T 412d794b0f694d089b1b011ba8adea36 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:14.801584  4943 consensus_queue.cc:1048] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:14.802839  4929 consensus_queue.cc:1048] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:14.829326  4943 raft_consensus.cc:2955] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:14.831952  4030 raft_consensus.cc:2955] T 412d794b0f694d089b1b011ba8adea36 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:14.836467  4108 raft_consensus.cc:2955] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:14.847086  4103 consensus_queue.cc:237] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
W20260709 13:14:14.857501  4073 consensus_peers.cc:597] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117): Couldn't send request to peer d709ee666b774ec29aa732e508219938. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1851e462889842a49d577d585d278117. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:14.858750  3856 catalog_manager.cc:5697] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:14.862246  4030 raft_consensus.cc:1275] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:14.864567  4955 consensus_queue.cc:1048] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:14.867244  3958 raft_consensus.cc:1275] T 1851e462889842a49d577d585d278117 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:14.869025  4955 consensus_queue.cc:1048] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:14.881341  4950 raft_consensus.cc:2955] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:14.885231  3958 raft_consensus.cc:2955] T 1851e462889842a49d577d585d278117 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:14.890434  4033 raft_consensus.cc:2955] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:14.912961  3956 consensus_queue.cc:237] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:14.928123  4108 raft_consensus.cc:1275] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:14:14.929021  3924 consensus_peers.cc:597] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 -> Peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117): Couldn't send request to peer d709ee666b774ec29aa732e508219938. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bd24fa3ec4ab41cabe4bcfae21f055f3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:14.929108  4033 raft_consensus.cc:1275] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:14.930050  4929 consensus_queue.cc:1048] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:14.931950  4943 consensus_queue.cc:1048] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:14.950381  4943 raft_consensus.cc:2955] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:14.952533  3855 catalog_manager.cc:5697] T 1851e462889842a49d577d585d278117 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New cstate: current_term: 1 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:14.956655  4108 raft_consensus.cc:2955] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:14.981657  3956 consensus_queue.cc:237] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:14.982302  4033 raft_consensus.cc:2955] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:15.014616  3856 catalog_manager.cc:5697] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
W20260709 13:14:15.043597  3924 consensus_peers.cc:597] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 -> Peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117): Couldn't send request to peer d709ee666b774ec29aa732e508219938. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b7e7a2dc30a24e5caaa3806c68b96c08. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:15.044626  4030 raft_consensus.cc:1275] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:15.046146  4929 consensus_queue.cc:1048] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:15.047307  4103 raft_consensus.cc:1275] T b7e7a2dc30a24e5caaa3806c68b96c08 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:15.048738  4929 consensus_queue.cc:1048] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:15.055394  4929 raft_consensus.cc:2955] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:15.058879  4030 raft_consensus.cc:2955] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:15.098477  4103 raft_consensus.cc:2955] T b7e7a2dc30a24e5caaa3806c68b96c08 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:15.098588  3855 catalog_manager.cc:5697] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:15.398484  4978 ts_tablet_manager.cc:933] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938: Initiating tablet copy from peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339)
I20260709 13:14:15.467139  4982 ts_tablet_manager.cc:933] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938: Initiating tablet copy from peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:15.449687  4978 tablet_copy_client.cc:323] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938: tablet copy: Beginning tablet copy session from remote peer at address 127.2.198.193:35339
I20260709 13:14:15.500864  3969 tablet_copy_service.cc:140] P f1c75790cedf4f52a3463a255c7da059: Received BeginTabletCopySession request for tablet 412d794b0f694d089b1b011ba8adea36 from peer d709ee666b774ec29aa732e508219938 ({username='slave'} at 127.0.0.1:35354)
I20260709 13:14:15.509822  4982 tablet_copy_client.cc:323] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938: tablet copy: Beginning tablet copy session from remote peer at address 127.2.198.195:37843
I20260709 13:14:15.504055  3969 tablet_copy_service.cc:161] P f1c75790cedf4f52a3463a255c7da059: Beginning new tablet copy session on tablet 412d794b0f694d089b1b011ba8adea36 from peer d709ee666b774ec29aa732e508219938 at {username='slave'} at 127.0.0.1:35354: session id = d709ee666b774ec29aa732e508219938-412d794b0f694d089b1b011ba8adea36
I20260709 13:14:15.514819  4118 tablet_copy_service.cc:140] P 8952c48a6f3a43968f7d77f7bfc4d1bc: Received BeginTabletCopySession request for tablet 1851e462889842a49d577d585d278117 from peer d709ee666b774ec29aa732e508219938 ({username='slave'} at 127.0.0.1:34656)
I20260709 13:14:15.515663  4118 tablet_copy_service.cc:161] P 8952c48a6f3a43968f7d77f7bfc4d1bc: Beginning new tablet copy session on tablet 1851e462889842a49d577d585d278117 from peer d709ee666b774ec29aa732e508219938 at {username='slave'} at 127.0.0.1:34656: session id = d709ee666b774ec29aa732e508219938-1851e462889842a49d577d585d278117
I20260709 13:14:15.535866  4985 ts_tablet_manager.cc:933] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938: Initiating tablet copy from peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339)
I20260709 13:14:15.638273  4986 ts_tablet_manager.cc:933] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938: Initiating tablet copy from peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339)
I20260709 13:14:15.647506  3969 tablet_copy_source_session.cc:215] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:15.677659  4118 tablet_copy_source_session.cc:215] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:15.692519  4982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1851e462889842a49d577d585d278117. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:15.743086  4985 tablet_copy_client.cc:323] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938: tablet copy: Beginning tablet copy session from remote peer at address 127.2.198.193:35339
I20260709 13:14:15.758338  4978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 412d794b0f694d089b1b011ba8adea36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:15.750919  4986 tablet_copy_client.cc:323] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938: tablet copy: Beginning tablet copy session from remote peer at address 127.2.198.193:35339
I20260709 13:14:15.776363  3969 tablet_copy_service.cc:140] P f1c75790cedf4f52a3463a255c7da059: Received BeginTabletCopySession request for tablet bd24fa3ec4ab41cabe4bcfae21f055f3 from peer d709ee666b774ec29aa732e508219938 ({username='slave'} at 127.0.0.1:35354)
I20260709 13:14:15.777040  3969 tablet_copy_service.cc:161] P f1c75790cedf4f52a3463a255c7da059: Beginning new tablet copy session on tablet bd24fa3ec4ab41cabe4bcfae21f055f3 from peer d709ee666b774ec29aa732e508219938 at {username='slave'} at 127.0.0.1:35354: session id = d709ee666b774ec29aa732e508219938-bd24fa3ec4ab41cabe4bcfae21f055f3
I20260709 13:14:15.777124  3968 tablet_copy_service.cc:140] P f1c75790cedf4f52a3463a255c7da059: Received BeginTabletCopySession request for tablet b7e7a2dc30a24e5caaa3806c68b96c08 from peer d709ee666b774ec29aa732e508219938 ({username='slave'} at 127.0.0.1:35354)
I20260709 13:14:15.777688  3968 tablet_copy_service.cc:161] P f1c75790cedf4f52a3463a255c7da059: Beginning new tablet copy session on tablet b7e7a2dc30a24e5caaa3806c68b96c08 from peer d709ee666b774ec29aa732e508219938 at {username='slave'} at 127.0.0.1:35354: session id = d709ee666b774ec29aa732e508219938-b7e7a2dc30a24e5caaa3806c68b96c08
I20260709 13:14:15.786731  3969 tablet_copy_source_session.cc:215] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:15.792344  3968 tablet_copy_source_session.cc:215] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:15.808338  4986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7e7a2dc30a24e5caaa3806c68b96c08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:15.822247  4985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd24fa3ec4ab41cabe4bcfae21f055f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:15.822816  4982 tablet_copy_client.cc:806] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:15.827287  4982 tablet_copy_client.cc:670] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:15.835196  4982 tablet_copy_client.cc:538] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:15.879492  4982 tablet_bootstrap.cc:492] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938: Bootstrap starting.
I20260709 13:14:15.881915  4978 tablet_copy_client.cc:806] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:15.882691  4978 tablet_copy_client.cc:670] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:15.889319  4986 tablet_copy_client.cc:806] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:15.890117  4986 tablet_copy_client.cc:670] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:15.894213  4985 tablet_copy_client.cc:806] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:15.894994  4985 tablet_copy_client.cc:670] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:15.896374  4986 tablet_copy_client.cc:538] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:15.895344  4978 tablet_copy_client.cc:538] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:15.906000  4985 tablet_copy_client.cc:538] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:15.931658  4978 tablet_bootstrap.cc:492] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938: Bootstrap starting.
I20260709 13:14:15.932721  4986 tablet_bootstrap.cc:492] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938: Bootstrap starting.
I20260709 13:14:15.933532  4985 tablet_bootstrap.cc:492] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938: Bootstrap starting.
I20260709 13:14:15.989094  4982 tablet_bootstrap.cc:492] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:15.990155  4982 tablet_bootstrap.cc:492] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938: Bootstrap complete.
I20260709 13:14:15.991008  4982 ts_tablet_manager.cc:1403] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938: Time spent bootstrapping tablet: real 0.112s	user 0.016s	sys 0.012s
I20260709 13:14:15.996150  4985 tablet_bootstrap.cc:492] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:15.997502  4985 tablet_bootstrap.cc:492] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938: Bootstrap complete.
I20260709 13:14:15.998401  4985 ts_tablet_manager.cc:1403] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938: Time spent bootstrapping tablet: real 0.065s	user 0.028s	sys 0.004s
I20260709 13:14:16.002072  4985 raft_consensus.cc:359] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:16.003237  4985 raft_consensus.cc:740] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Initialized, Role: LEARNER
I20260709 13:14:16.004643  4985 consensus_queue.cc:260] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:15.999004  4982 raft_consensus.cc:359] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:16.006724  4982 raft_consensus.cc:740] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Initialized, Role: LEARNER
I20260709 13:14:16.008433  4982 consensus_queue.cc:260] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:16.016968  4985 ts_tablet_manager.cc:1434] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.008s
I20260709 13:14:16.022011  3969 tablet_copy_service.cc:342] P f1c75790cedf4f52a3463a255c7da059: Request end of tablet copy session d709ee666b774ec29aa732e508219938-bd24fa3ec4ab41cabe4bcfae21f055f3 received from {username='slave'} at 127.0.0.1:35354
I20260709 13:14:16.022538  3969 tablet_copy_service.cc:434] P f1c75790cedf4f52a3463a255c7da059: ending tablet copy session d709ee666b774ec29aa732e508219938-bd24fa3ec4ab41cabe4bcfae21f055f3 on tablet bd24fa3ec4ab41cabe4bcfae21f055f3 with peer d709ee666b774ec29aa732e508219938
I20260709 13:14:16.028906  4978 tablet_bootstrap.cc:492] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:16.030181  4978 tablet_bootstrap.cc:492] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938: Bootstrap complete.
I20260709 13:14:16.031062  4978 ts_tablet_manager.cc:1403] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938: Time spent bootstrapping tablet: real 0.100s	user 0.025s	sys 0.003s
I20260709 13:14:16.036741  4978 raft_consensus.cc:359] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:16.033314  4982 ts_tablet_manager.cc:1434] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938: Time spent starting tablet: real 0.042s	user 0.015s	sys 0.000s
I20260709 13:14:16.045795  4978 raft_consensus.cc:740] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Initialized, Role: LEARNER
I20260709 13:14:16.046700  4978 consensus_queue.cc:260] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:16.048049  4118 tablet_copy_service.cc:342] P 8952c48a6f3a43968f7d77f7bfc4d1bc: Request end of tablet copy session d709ee666b774ec29aa732e508219938-1851e462889842a49d577d585d278117 received from {username='slave'} at 127.0.0.1:34656
I20260709 13:14:16.048594  4118 tablet_copy_service.cc:434] P 8952c48a6f3a43968f7d77f7bfc4d1bc: ending tablet copy session d709ee666b774ec29aa732e508219938-1851e462889842a49d577d585d278117 on tablet 1851e462889842a49d577d585d278117 with peer d709ee666b774ec29aa732e508219938
I20260709 13:14:16.049939  4978 ts_tablet_manager.cc:1434] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:14:16.051973  3969 tablet_copy_service.cc:342] P f1c75790cedf4f52a3463a255c7da059: Request end of tablet copy session d709ee666b774ec29aa732e508219938-412d794b0f694d089b1b011ba8adea36 received from {username='slave'} at 127.0.0.1:35354
I20260709 13:14:16.052531  3969 tablet_copy_service.cc:434] P f1c75790cedf4f52a3463a255c7da059: ending tablet copy session d709ee666b774ec29aa732e508219938-412d794b0f694d089b1b011ba8adea36 on tablet 412d794b0f694d089b1b011ba8adea36 with peer d709ee666b774ec29aa732e508219938
I20260709 13:14:16.059823  4986 tablet_bootstrap.cc:492] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:16.060984  4986 tablet_bootstrap.cc:492] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938: Bootstrap complete.
I20260709 13:14:16.065521  4709 raft_consensus.cc:1217] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:16.063520  4986 ts_tablet_manager.cc:1403] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938: Time spent bootstrapping tablet: real 0.131s	user 0.023s	sys 0.003s
I20260709 13:14:16.078037  4986 raft_consensus.cc:359] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:16.083711  4986 raft_consensus.cc:740] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Initialized, Role: LEARNER
I20260709 13:14:16.084547  4986 consensus_queue.cc:260] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:16.092938  4986 ts_tablet_manager.cc:1434] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:14:16.094636  3969 tablet_copy_service.cc:342] P f1c75790cedf4f52a3463a255c7da059: Request end of tablet copy session d709ee666b774ec29aa732e508219938-b7e7a2dc30a24e5caaa3806c68b96c08 received from {username='slave'} at 127.0.0.1:35354
I20260709 13:14:16.095118  3969 tablet_copy_service.cc:434] P f1c75790cedf4f52a3463a255c7da059: ending tablet copy session d709ee666b774ec29aa732e508219938-b7e7a2dc30a24e5caaa3806c68b96c08 on tablet b7e7a2dc30a24e5caaa3806c68b96c08 with peer d709ee666b774ec29aa732e508219938
I20260709 13:14:16.484231  4709 raft_consensus.cc:1217] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:16.508988  4929 raft_consensus.cc:1064] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059: attempting to promote NON_VOTER d709ee666b774ec29aa732e508219938 to VOTER
I20260709 13:14:16.515164  4709 raft_consensus.cc:1217] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:16.519134  4929 consensus_queue.cc:237] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:16.572374  4709 raft_consensus.cc:1275] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:16.576181  4709 raft_consensus.cc:1217] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:16.578274  4971 consensus_queue.cc:1048] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:16.595669  4033 raft_consensus.cc:1275] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:16.597625  4929 consensus_queue.cc:1048] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:14:16.603411  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 51335.5us
I20260709 13:14:16.614172  4101 raft_consensus.cc:1275] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:16.617429  4929 consensus_queue.cc:1048] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:16.626056  4973 raft_consensus.cc:2955] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:16.657732  4707 raft_consensus.cc:2955] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:16.663205  4027 raft_consensus.cc:2955] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:16.704670  3856 catalog_manager.cc:5697] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:16.770536  4101 raft_consensus.cc:2955] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:16.803619  3955 consensus_queue.cc:237] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:16.816280  4027 raft_consensus.cc:1275] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:16.813128  4707 raft_consensus.cc:1275] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:16.823143  5000 consensus_queue.cc:1048] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:16.827407  5000 consensus_queue.cc:1048] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:16.838325  5001 raft_consensus.cc:2955] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:16.849750  4709 raft_consensus.cc:2955] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:16.858429  4030 raft_consensus.cc:2955] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:16.866837  3856 catalog_manager.cc:5697] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 reported cstate change: config changed from index 3 to 4, VOTER 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) evicted. New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:16.889158  3841 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bd24fa3ec4ab41cabe4bcfae21f055f3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:16.896433  4095 tablet_service.cc:1558] Processing DeleteTablet for tablet bd24fa3ec4ab41cabe4bcfae21f055f3 with delete_type TABLET_DATA_TOMBSTONED (TS 8952c48a6f3a43968f7d77f7bfc4d1bc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45324
I20260709 13:14:16.961992  5010 tablet_replica.cc:333] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:14:16.969244  4989 raft_consensus.cc:1064] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc: attempting to promote NON_VOTER d709ee666b774ec29aa732e508219938 to VOTER
I20260709 13:14:16.978012  4989 consensus_queue.cc:237] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:17.002082  4973 raft_consensus.cc:1064] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059: attempting to promote NON_VOTER d709ee666b774ec29aa732e508219938 to VOTER
I20260709 13:14:17.006249  5010 raft_consensus.cc:2243] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:17.005575  4973 consensus_queue.cc:237] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:17.007198  5010 raft_consensus.cc:2272] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:17.019479  5010 ts_tablet_manager.cc:1916] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:17.030656  4709 raft_consensus.cc:1275] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:17.038143  4989 consensus_queue.cc:1048] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:17.047732  3956 raft_consensus.cc:1275] T 1851e462889842a49d577d585d278117 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:17.055114  4955 consensus_queue.cc:1048] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:17.056417  4707 raft_consensus.cc:1275] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:17.065376  5000 raft_consensus.cc:1064] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059: attempting to promote NON_VOTER d709ee666b774ec29aa732e508219938 to VOTER
I20260709 13:14:17.068320  5000 consensus_queue.cc:237] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:17.071592  5001 consensus_queue.cc:1048] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:17.102847  5010 ts_tablet_manager.cc:1929] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:17.107591  4030 raft_consensus.cc:1275] T 412d794b0f694d089b1b011ba8adea36 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:17.105293  5010 log.cc:1199] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Deleting WAL directory at /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/ts-2-root/wals/bd24fa3ec4ab41cabe4bcfae21f055f3
I20260709 13:14:17.116690  4708 raft_consensus.cc:1275] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:17.122430  4929 consensus_queue.cc:1048] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:17.130357  4027 raft_consensus.cc:1275] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:17.141880  5016 consensus_queue.cc:1048] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
W20260709 13:14:17.141999  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 65662us
I20260709 13:14:17.147327  3841 catalog_manager.cc:5028] TS 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): tablet bd24fa3ec4ab41cabe4bcfae21f055f3 (table test-workload [id=8a2760e8528448a780fea6ccf25816cb]) successfully deleted
I20260709 13:14:17.151505  4027 raft_consensus.cc:1275] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:17.138857  5000 consensus_queue.cc:1048] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:14:17.160570  4981 raft_consensus.cc:2955] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:17.166744  3955 raft_consensus.cc:2955] T 1851e462889842a49d577d585d278117 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:17.172560  4103 raft_consensus.cc:1275] T b7e7a2dc30a24e5caaa3806c68b96c08 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:17.172580  4108 raft_consensus.cc:1275] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:17.218703  4929 consensus_queue.cc:1048] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:17.221069  4973 consensus_queue.cc:1048] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:17.233352  4709 raft_consensus.cc:2955] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:17.239322  4971 raft_consensus.cc:2955] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:17.254436  4030 raft_consensus.cc:2955] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:17.248065  3855 catalog_manager.cc:5697] T 1851e462889842a49d577d585d278117 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:17.287191  3855 catalog_manager.cc:5697] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:14:17.312665  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 92089.3us
I20260709 13:14:17.328392  4707 raft_consensus.cc:2955] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:17.347826  4973 raft_consensus.cc:2955] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:17.352242  3955 consensus_queue.cc:237] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:17.366472  4030 raft_consensus.cc:2955] T 412d794b0f694d089b1b011ba8adea36 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:17.393343  4707 raft_consensus.cc:2955] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:17.422333  3856 catalog_manager.cc:5697] T 412d794b0f694d089b1b011ba8adea36 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:17.444568  4030 raft_consensus.cc:1275] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 13:14:17.445909  4073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 137519us
I20260709 13:14:17.446162  4973 consensus_queue.cc:1048] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:17.454207  4973 raft_consensus.cc:2955] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:17.456528  4030 raft_consensus.cc:2955] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:17.466915  3841 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b7e7a2dc30a24e5caaa3806c68b96c08 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:17.468137  4709 raft_consensus.cc:1275] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:17.475495  4973 consensus_queue.cc:1048] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:14:17.484346  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 170406us
I20260709 13:14:17.486701  5027 consensus_queue.cc:1048] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:17.487017  3854 catalog_manager.cc:5697] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: config changed from index 3 to 4, VOTER 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) evicted. New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:17.517849  4707 raft_consensus.cc:2955] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:17.580001  4034 raft_consensus.cc:2955] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:17.584263  4095 tablet_service.cc:1558] Processing DeleteTablet for tablet b7e7a2dc30a24e5caaa3806c68b96c08 with delete_type TABLET_DATA_TOMBSTONED (TS 8952c48a6f3a43968f7d77f7bfc4d1bc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45324
I20260709 13:14:17.586251  5010 tablet_replica.cc:333] T b7e7a2dc30a24e5caaa3806c68b96c08 P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:14:17.587680  5010 raft_consensus.cc:2243] T b7e7a2dc30a24e5caaa3806c68b96c08 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:17.588284  5010 pending_rounds.cc:70] T b7e7a2dc30a24e5caaa3806c68b96c08 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Trying to abort 1 pending ops.
I20260709 13:14:17.588670  5010 pending_rounds.cc:77] T b7e7a2dc30a24e5caaa3806c68b96c08 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305637302545346560 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } } }
I20260709 13:14:17.590445  5010 raft_consensus.cc:2917] T b7e7a2dc30a24e5caaa3806c68b96c08 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 13:14:17.591797  5010 raft_consensus.cc:2889] T b7e7a2dc30a24e5caaa3806c68b96c08 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:14:17.592275  5010 raft_consensus.cc:2272] T b7e7a2dc30a24e5caaa3806c68b96c08 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:17.600422  5010 ts_tablet_manager.cc:1916] T b7e7a2dc30a24e5caaa3806c68b96c08 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:17.639501  3955 consensus_queue.cc:237] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:17.678263  5010 ts_tablet_manager.cc:1929] T b7e7a2dc30a24e5caaa3806c68b96c08 P 8952c48a6f3a43968f7d77f7bfc4d1bc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:17.678886  5010 log.cc:1199] T b7e7a2dc30a24e5caaa3806c68b96c08 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Deleting WAL directory at /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/ts-2-root/wals/b7e7a2dc30a24e5caaa3806c68b96c08
I20260709 13:14:17.687094  4707 raft_consensus.cc:1275] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:17.688628  5023 consensus_queue.cc:1048] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:17.699204  5026 raft_consensus.cc:2955] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:17.700830  4709 raft_consensus.cc:2955] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:17.703155  4099 raft_consensus.cc:2955] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:17.712674  3841 catalog_manager.cc:5028] TS 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): tablet b7e7a2dc30a24e5caaa3806c68b96c08 (table test-workload [id=8a2760e8528448a780fea6ccf25816cb]) successfully deleted
I20260709 13:14:17.724154  3841 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 412d794b0f694d089b1b011ba8adea36 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:17.728075  4104 raft_consensus.cc:1275] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:17.738122  5023 consensus_queue.cc:1048] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:17.736497  3857 catalog_manager.cc:5697] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: config changed from index 3 to 4, VOTER 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) evicted. New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:17.757793  4104 raft_consensus.cc:2955] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:17.768427  4017 tablet_service.cc:1558] Processing DeleteTablet for tablet 412d794b0f694d089b1b011ba8adea36 with delete_type TABLET_DATA_TOMBSTONED (TS 6f5b5e4ed72944ecbda200012d141dc2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38278
I20260709 13:14:17.794387  5033 tablet_replica.cc:333] T 412d794b0f694d089b1b011ba8adea36 P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:14:17.796190  5033 raft_consensus.cc:2243] T 412d794b0f694d089b1b011ba8adea36 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:17.797477  5033 raft_consensus.cc:2272] T 412d794b0f694d089b1b011ba8adea36 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:17.807302  5033 ts_tablet_manager.cc:1916] T 412d794b0f694d089b1b011ba8adea36 P 6f5b5e4ed72944ecbda200012d141dc2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:17.827752  5033 ts_tablet_manager.cc:1929] T 412d794b0f694d089b1b011ba8adea36 P 6f5b5e4ed72944ecbda200012d141dc2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:17.828449  5033 log.cc:1199] T 412d794b0f694d089b1b011ba8adea36 P 6f5b5e4ed72944ecbda200012d141dc2: Deleting WAL directory at /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/ts-1-root/wals/412d794b0f694d089b1b011ba8adea36
I20260709 13:14:17.834910  3844 catalog_manager.cc:5028] TS 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): tablet 412d794b0f694d089b1b011ba8adea36 (table test-workload [id=8a2760e8528448a780fea6ccf25816cb]) successfully deleted
I20260709 13:14:17.925825  4104 consensus_queue.cc:237] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:17.934288  4709 raft_consensus.cc:1275] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:17.934852  4025 raft_consensus.cc:1275] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:17.936412  5024 consensus_queue.cc:1048] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:17.937654  5014 consensus_queue.cc:1048] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:17.957511  5028 raft_consensus.cc:2955] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:17.976222  4709 raft_consensus.cc:2955] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:17.994014  4025 raft_consensus.cc:2955] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:17.999785  3841 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1851e462889842a49d577d585d278117 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:18.014123  3856 catalog_manager.cc:5697] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: config changed from index 3 to 4, VOTER f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) evicted. New cstate: current_term: 1 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:18.028179  3948 tablet_service.cc:1558] Processing DeleteTablet for tablet 1851e462889842a49d577d585d278117 with delete_type TABLET_DATA_TOMBSTONED (TS f1c75790cedf4f52a3463a255c7da059 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38604
I20260709 13:14:18.036342  5034 tablet_replica.cc:333] T 1851e462889842a49d577d585d278117 P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:14:18.037532  5034 raft_consensus.cc:2243] T 1851e462889842a49d577d585d278117 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:18.038492  5034 raft_consensus.cc:2272] T 1851e462889842a49d577d585d278117 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:18.047994  5034 ts_tablet_manager.cc:1916] T 1851e462889842a49d577d585d278117 P f1c75790cedf4f52a3463a255c7da059: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:18.079857  5034 ts_tablet_manager.cc:1929] T 1851e462889842a49d577d585d278117 P f1c75790cedf4f52a3463a255c7da059: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:18.080328  5034 log.cc:1199] T 1851e462889842a49d577d585d278117 P f1c75790cedf4f52a3463a255c7da059: Deleting WAL directory at /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/ts-0-root/wals/1851e462889842a49d577d585d278117
I20260709 13:14:18.082254  3841 catalog_manager.cc:5028] TS f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): tablet 1851e462889842a49d577d585d278117 (table test-workload [id=8a2760e8528448a780fea6ccf25816cb]) successfully deleted
I20260709 13:14:19.129989  4025 consensus_queue.cc:237] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:19.138238  4104 raft_consensus.cc:1275] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:19.139292  3955 raft_consensus.cc:1275] T 21bc23345fdc47d2b7e9b8964749236e P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:14:19.140347  3999 consensus_peers.cc:597] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117): Couldn't send request to peer d709ee666b774ec29aa732e508219938. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 21bc23345fdc47d2b7e9b8964749236e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:19.140479  5032 consensus_queue.cc:1048] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:19.141577  4992 consensus_queue.cc:1048] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:19.151383  5032 raft_consensus.cc:2955] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:19.153649  3955 raft_consensus.cc:2955] T 21bc23345fdc47d2b7e9b8964749236e P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:19.159382  4104 raft_consensus.cc:2955] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:19.189313  3857 catalog_manager.cc:5697] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New cstate: current_term: 1 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:19.196679  3955 consensus_queue.cc:237] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:19.214843  4104 raft_consensus.cc:1275] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:19.216615  5001 consensus_queue.cc:1048] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:19.219488  4034 raft_consensus.cc:1275] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:14:19.220750  3924 consensus_peers.cc:597] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 -> Peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117): Couldn't send request to peer d709ee666b774ec29aa732e508219938. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6b3254b26cc140fc8d2500e3e12dfaf4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:19.225986  5026 consensus_queue.cc:1048] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:19.290237  4973 raft_consensus.cc:2955] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:19.292264  4034 raft_consensus.cc:2955] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:19.307240  4104 raft_consensus.cc:2955] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:19.326977  3958 consensus_queue.cc:237] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:19.335407  3854 catalog_manager.cc:5697] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:19.356766  4104 raft_consensus.cc:1275] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:14:19.357142  3924 consensus_peers.cc:597] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 -> Peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117): Couldn't send request to peer d709ee666b774ec29aa732e508219938. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 37bb8c27fe534b22824e326e191a66f0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:19.359155  5044 consensus_queue.cc:1048] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:19.360673  4034 raft_consensus.cc:1275] T 37bb8c27fe534b22824e326e191a66f0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:19.362098  5044 consensus_queue.cc:1048] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:19.370507  4973 raft_consensus.cc:2955] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:19.374075  4099 raft_consensus.cc:2955] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:19.374575  4034 raft_consensus.cc:2955] T 37bb8c27fe534b22824e326e191a66f0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:19.395180  3958 consensus_queue.cc:237] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:19.403187  4104 raft_consensus.cc:1275] T b2879f06fa90455ea323efd79c11c330 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:19.399111  3857 catalog_manager.cc:5697] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:19.403844  4025 raft_consensus.cc:1275] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:14:19.403923  3924 consensus_peers.cc:597] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 -> Peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117): Couldn't send request to peer d709ee666b774ec29aa732e508219938. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b2879f06fa90455ea323efd79c11c330. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:19.408193  5044 consensus_queue.cc:1048] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:19.409791  5026 consensus_queue.cc:1048] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:19.428100  5044 raft_consensus.cc:2955] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:19.430122  4104 raft_consensus.cc:2955] T b2879f06fa90455ea323efd79c11c330 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:19.432891  4034 raft_consensus.cc:2955] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:19.452142  3857 catalog_manager.cc:5697] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:19.716187  5054 ts_tablet_manager.cc:933] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938: Initiating tablet copy from peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:19.719596  5054 tablet_copy_client.cc:323] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938: tablet copy: Beginning tablet copy session from remote peer at address 127.2.198.194:46115
I20260709 13:14:19.721550  4044 tablet_copy_service.cc:140] P 6f5b5e4ed72944ecbda200012d141dc2: Received BeginTabletCopySession request for tablet 21bc23345fdc47d2b7e9b8964749236e from peer d709ee666b774ec29aa732e508219938 ({username='slave'} at 127.0.0.1:41312)
I20260709 13:14:19.722047  4044 tablet_copy_service.cc:161] P 6f5b5e4ed72944ecbda200012d141dc2: Beginning new tablet copy session on tablet 21bc23345fdc47d2b7e9b8964749236e from peer d709ee666b774ec29aa732e508219938 at {username='slave'} at 127.0.0.1:41312: session id = d709ee666b774ec29aa732e508219938-21bc23345fdc47d2b7e9b8964749236e
I20260709 13:14:19.728596  4044 tablet_copy_source_session.cc:215] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:19.733565  5054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21bc23345fdc47d2b7e9b8964749236e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:19.737802  5056 ts_tablet_manager.cc:933] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938: Initiating tablet copy from peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339)
I20260709 13:14:19.743327  5056 tablet_copy_client.cc:323] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938: tablet copy: Beginning tablet copy session from remote peer at address 127.2.198.193:35339
I20260709 13:14:19.745246  3969 tablet_copy_service.cc:140] P f1c75790cedf4f52a3463a255c7da059: Received BeginTabletCopySession request for tablet 6b3254b26cc140fc8d2500e3e12dfaf4 from peer d709ee666b774ec29aa732e508219938 ({username='slave'} at 127.0.0.1:35354)
I20260709 13:14:19.745813  3969 tablet_copy_service.cc:161] P f1c75790cedf4f52a3463a255c7da059: Beginning new tablet copy session on tablet 6b3254b26cc140fc8d2500e3e12dfaf4 from peer d709ee666b774ec29aa732e508219938 at {username='slave'} at 127.0.0.1:35354: session id = d709ee666b774ec29aa732e508219938-6b3254b26cc140fc8d2500e3e12dfaf4
I20260709 13:14:19.754724  5054 tablet_copy_client.cc:806] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:19.755555  5054 tablet_copy_client.cc:670] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:19.757335  3969 tablet_copy_source_session.cc:215] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:19.759428  5054 tablet_copy_client.cc:538] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:19.761200  5056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b3254b26cc140fc8d2500e3e12dfaf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:19.773417  5054 tablet_bootstrap.cc:492] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938: Bootstrap starting.
I20260709 13:14:19.781234  5056 tablet_copy_client.cc:806] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:19.782042  5056 tablet_copy_client.cc:670] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:19.787757  5056 tablet_copy_client.cc:538] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:19.799014  5056 tablet_bootstrap.cc:492] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938: Bootstrap starting.
I20260709 13:14:19.826653  5054 tablet_bootstrap.cc:492] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:19.827775  5054 tablet_bootstrap.cc:492] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938: Bootstrap complete.
I20260709 13:14:19.828461  5054 ts_tablet_manager.cc:1403] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938: Time spent bootstrapping tablet: real 0.056s	user 0.019s	sys 0.012s
I20260709 13:14:19.832080  5054 raft_consensus.cc:359] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:19.832768  5056 tablet_bootstrap.cc:492] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:19.833016  5054 raft_consensus.cc:740] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Initialized, Role: LEARNER
I20260709 13:14:19.833719  5056 tablet_bootstrap.cc:492] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938: Bootstrap complete.
I20260709 13:14:19.834465  5056 ts_tablet_manager.cc:1403] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.021s
I20260709 13:14:19.833784  5054 consensus_queue.cc:260] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:19.846536  5054 ts_tablet_manager.cc:1434] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.004s
I20260709 13:14:19.838011  5056 raft_consensus.cc:359] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:19.852279  5056 raft_consensus.cc:740] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Initialized, Role: LEARNER
I20260709 13:14:19.855002  4044 tablet_copy_service.cc:342] P 6f5b5e4ed72944ecbda200012d141dc2: Request end of tablet copy session d709ee666b774ec29aa732e508219938-21bc23345fdc47d2b7e9b8964749236e received from {username='slave'} at 127.0.0.1:41312
I20260709 13:14:19.855607  4044 tablet_copy_service.cc:434] P 6f5b5e4ed72944ecbda200012d141dc2: ending tablet copy session d709ee666b774ec29aa732e508219938-21bc23345fdc47d2b7e9b8964749236e on tablet 21bc23345fdc47d2b7e9b8964749236e with peer d709ee666b774ec29aa732e508219938
I20260709 13:14:19.873983  5054 ts_tablet_manager.cc:933] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938: Initiating tablet copy from peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339)
I20260709 13:14:19.854508  5056 consensus_queue.cc:260] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:19.882881  5056 ts_tablet_manager.cc:1434] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260709 13:14:19.890314  3969 tablet_copy_service.cc:342] P f1c75790cedf4f52a3463a255c7da059: Request end of tablet copy session d709ee666b774ec29aa732e508219938-6b3254b26cc140fc8d2500e3e12dfaf4 received from {username='slave'} at 127.0.0.1:35354
I20260709 13:14:19.890903  3969 tablet_copy_service.cc:434] P f1c75790cedf4f52a3463a255c7da059: ending tablet copy session d709ee666b774ec29aa732e508219938-6b3254b26cc140fc8d2500e3e12dfaf4 on tablet 6b3254b26cc140fc8d2500e3e12dfaf4 with peer d709ee666b774ec29aa732e508219938
I20260709 13:14:19.904582  5054 tablet_copy_client.cc:323] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938: tablet copy: Beginning tablet copy session from remote peer at address 127.2.198.193:35339
I20260709 13:14:19.906519  3969 tablet_copy_service.cc:140] P f1c75790cedf4f52a3463a255c7da059: Received BeginTabletCopySession request for tablet b2879f06fa90455ea323efd79c11c330 from peer d709ee666b774ec29aa732e508219938 ({username='slave'} at 127.0.0.1:35354)
I20260709 13:14:19.907135  3969 tablet_copy_service.cc:161] P f1c75790cedf4f52a3463a255c7da059: Beginning new tablet copy session on tablet b2879f06fa90455ea323efd79c11c330 from peer d709ee666b774ec29aa732e508219938 at {username='slave'} at 127.0.0.1:35354: session id = d709ee666b774ec29aa732e508219938-b2879f06fa90455ea323efd79c11c330
I20260709 13:14:19.917394  3969 tablet_copy_source_session.cc:215] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:19.922549  5054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2879f06fa90455ea323efd79c11c330. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:19.940344  5054 tablet_copy_client.cc:806] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:19.941179  5054 tablet_copy_client.cc:670] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:19.942065  5056 ts_tablet_manager.cc:933] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938: Initiating tablet copy from peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339)
I20260709 13:14:19.946130  5056 tablet_copy_client.cc:323] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938: tablet copy: Beginning tablet copy session from remote peer at address 127.2.198.193:35339
I20260709 13:14:19.946341  5054 tablet_copy_client.cc:538] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:19.952641  3969 tablet_copy_service.cc:140] P f1c75790cedf4f52a3463a255c7da059: Received BeginTabletCopySession request for tablet 37bb8c27fe534b22824e326e191a66f0 from peer d709ee666b774ec29aa732e508219938 ({username='slave'} at 127.0.0.1:35354)
I20260709 13:14:19.953289  3969 tablet_copy_service.cc:161] P f1c75790cedf4f52a3463a255c7da059: Beginning new tablet copy session on tablet 37bb8c27fe534b22824e326e191a66f0 from peer d709ee666b774ec29aa732e508219938 at {username='slave'} at 127.0.0.1:35354: session id = d709ee666b774ec29aa732e508219938-37bb8c27fe534b22824e326e191a66f0
I20260709 13:14:19.957072  5054 tablet_bootstrap.cc:492] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938: Bootstrap starting.
I20260709 13:14:19.964782  3969 tablet_copy_source_session.cc:215] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:19.968508  5056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37bb8c27fe534b22824e326e191a66f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:19.984087  5054 tablet_bootstrap.cc:492] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:19.984961  5054 tablet_bootstrap.cc:492] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938: Bootstrap complete.
I20260709 13:14:19.985616  5054 ts_tablet_manager.cc:1403] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938: Time spent bootstrapping tablet: real 0.029s	user 0.018s	sys 0.004s
I20260709 13:14:19.988302  5054 raft_consensus.cc:359] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:19.989006  5054 raft_consensus.cc:740] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Initialized, Role: LEARNER
I20260709 13:14:19.989641  5056 tablet_copy_client.cc:806] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:19.989621  5054 consensus_queue.cc:260] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:19.990443  5056 tablet_copy_client.cc:670] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:19.991984  5054 ts_tablet_manager.cc:1434] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:14:19.994809  3969 tablet_copy_service.cc:342] P f1c75790cedf4f52a3463a255c7da059: Request end of tablet copy session d709ee666b774ec29aa732e508219938-b2879f06fa90455ea323efd79c11c330 received from {username='slave'} at 127.0.0.1:35354
I20260709 13:14:19.995224  3969 tablet_copy_service.cc:434] P f1c75790cedf4f52a3463a255c7da059: ending tablet copy session d709ee666b774ec29aa732e508219938-b2879f06fa90455ea323efd79c11c330 on tablet b2879f06fa90455ea323efd79c11c330 with peer d709ee666b774ec29aa732e508219938
I20260709 13:14:19.998224  5056 tablet_copy_client.cc:538] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:20.017843  5056 tablet_bootstrap.cc:492] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938: Bootstrap starting.
I20260709 13:14:20.043140  5056 tablet_bootstrap.cc:492] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:20.044044  5056 tablet_bootstrap.cc:492] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938: Bootstrap complete.
I20260709 13:14:20.044680  5056 ts_tablet_manager.cc:1403] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938: Time spent bootstrapping tablet: real 0.030s	user 0.019s	sys 0.007s
I20260709 13:14:20.047466  5056 raft_consensus.cc:359] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:20.048419  5056 raft_consensus.cc:740] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Initialized, Role: LEARNER
I20260709 13:14:20.048983  5056 consensus_queue.cc:260] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:20.052115  5056 ts_tablet_manager.cc:1434] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:14:20.054486  3968 tablet_copy_service.cc:342] P f1c75790cedf4f52a3463a255c7da059: Request end of tablet copy session d709ee666b774ec29aa732e508219938-37bb8c27fe534b22824e326e191a66f0 received from {username='slave'} at 127.0.0.1:35354
I20260709 13:14:20.054884  3968 tablet_copy_service.cc:434] P f1c75790cedf4f52a3463a255c7da059: ending tablet copy session d709ee666b774ec29aa732e508219938-37bb8c27fe534b22824e326e191a66f0 on tablet 37bb8c27fe534b22824e326e191a66f0 with peer d709ee666b774ec29aa732e508219938
I20260709 13:14:20.127556  4707 raft_consensus.cc:1217] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:20.214500  4707 raft_consensus.cc:1217] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:20.381691  4707 raft_consensus.cc:1217] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:20.407595  4707 raft_consensus.cc:1217] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:20.518114  5026 raft_consensus.cc:1064] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059: attempting to promote NON_VOTER d709ee666b774ec29aa732e508219938 to VOTER
I20260709 13:14:20.520661  5026 consensus_queue.cc:237] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:20.536334  4707 raft_consensus.cc:1275] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:20.537324  4034 raft_consensus.cc:1275] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:20.537747  5044 consensus_queue.cc:1048] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:20.538961  4104 raft_consensus.cc:1275] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:20.539691  5001 consensus_queue.cc:1048] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:20.541347  4973 consensus_queue.cc:1048] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:20.567720  5001 raft_consensus.cc:2955] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:20.569597  4707 raft_consensus.cc:2955] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:20.574250  4104 raft_consensus.cc:2955] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:20.580453  4034 raft_consensus.cc:2955] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:20.592340  3854 catalog_manager.cc:5697] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:20.645992  4992 raft_consensus.cc:1064] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2: attempting to promote NON_VOTER d709ee666b774ec29aa732e508219938 to VOTER
I20260709 13:14:20.648715  4992 consensus_queue.cc:237] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:20.652226  3955 consensus_queue.cc:237] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:20.658730  4707 raft_consensus.cc:1275] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:20.659209  4099 raft_consensus.cc:1275] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:20.660863  5044 consensus_queue.cc:1048] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:20.661864  5026 consensus_queue.cc:1048] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:20.670131  5026 raft_consensus.cc:2955] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:20.678591  4707 raft_consensus.cc:2955] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:20.678162  4104 raft_consensus.cc:2955] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:20.696370  4099 raft_consensus.cc:1275] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:20.696370  4708 raft_consensus.cc:1275] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:20.697731  3955 raft_consensus.cc:1275] T 21bc23345fdc47d2b7e9b8964749236e P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:20.701759  3841 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6b3254b26cc140fc8d2500e3e12dfaf4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:20.701579  5067 consensus_queue.cc:1048] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:20.702903  5066 consensus_queue.cc:1048] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:20.704643  5032 consensus_queue.cc:1048] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:20.720698  3856 catalog_manager.cc:5697] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: config changed from index 3 to 4, VOTER 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) evicted. New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:20.754210  4017 tablet_service.cc:1558] Processing DeleteTablet for tablet 6b3254b26cc140fc8d2500e3e12dfaf4 with delete_type TABLET_DATA_TOMBSTONED (TS 6f5b5e4ed72944ecbda200012d141dc2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38278
I20260709 13:14:20.760682  5081 tablet_replica.cc:333] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:14:20.761807  5081 raft_consensus.cc:2243] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:20.774349  5081 raft_consensus.cc:2272] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:20.779670  5081 ts_tablet_manager.cc:1916] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 6f5b5e4ed72944ecbda200012d141dc2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:20.798206  5066 raft_consensus.cc:2955] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:20.805693  5081 ts_tablet_manager.cc:1929] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 6f5b5e4ed72944ecbda200012d141dc2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:20.806577  5081 log.cc:1199] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 6f5b5e4ed72944ecbda200012d141dc2: Deleting WAL directory at /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/ts-1-root/wals/6b3254b26cc140fc8d2500e3e12dfaf4
I20260709 13:14:20.808382  3844 catalog_manager.cc:5028] TS 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): tablet 6b3254b26cc140fc8d2500e3e12dfaf4 (table test-workload [id=8a2760e8528448a780fea6ccf25816cb]) successfully deleted
I20260709 13:14:20.808598  3958 raft_consensus.cc:2955] T 21bc23345fdc47d2b7e9b8964749236e P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:20.813557  4709 raft_consensus.cc:2955] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:20.827811  4104 raft_consensus.cc:2955] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:20.837358  3857 catalog_manager.cc:5697] T 21bc23345fdc47d2b7e9b8964749236e P f1c75790cedf4f52a3463a255c7da059 reported cstate change: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:20.857199  4025 consensus_queue.cc:237] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:20.864468  4707 raft_consensus.cc:1275] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:20.865840  4104 raft_consensus.cc:1275] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:20.866807  4992 consensus_queue.cc:1048] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:20.868083  5067 consensus_queue.cc:1048] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:20.875078  5067 raft_consensus.cc:2955] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:20.876381  4707 raft_consensus.cc:2955] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:20.878393  4104 raft_consensus.cc:2955] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:20.889528  3844 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 21bc23345fdc47d2b7e9b8964749236e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:20.907359  3854 catalog_manager.cc:5697] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 reported cstate change: config changed from index 3 to 4, VOTER f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) evicted. New cstate: current_term: 1 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:20.940675  3948 tablet_service.cc:1558] Processing DeleteTablet for tablet 21bc23345fdc47d2b7e9b8964749236e with delete_type TABLET_DATA_TOMBSTONED (TS f1c75790cedf4f52a3463a255c7da059 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38604
I20260709 13:14:20.945315  5082 tablet_replica.cc:333] T 21bc23345fdc47d2b7e9b8964749236e P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:14:20.947118  5082 raft_consensus.cc:2243] T 21bc23345fdc47d2b7e9b8964749236e P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:20.950284  5082 raft_consensus.cc:2272] T 21bc23345fdc47d2b7e9b8964749236e P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:20.961362  4973 raft_consensus.cc:1064] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059: attempting to promote NON_VOTER d709ee666b774ec29aa732e508219938 to VOTER
I20260709 13:14:20.963862  5082 ts_tablet_manager.cc:1916] T 21bc23345fdc47d2b7e9b8964749236e P f1c75790cedf4f52a3463a255c7da059: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:20.964143  4973 consensus_queue.cc:237] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:20.976585  4707 raft_consensus.cc:1275] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:20.978060  4101 raft_consensus.cc:1275] T b2879f06fa90455ea323efd79c11c330 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:20.979836  5001 consensus_queue.cc:1048] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:20.980888  5026 consensus_queue.cc:1048] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:20.987509  4034 raft_consensus.cc:1275] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:20.988620  5082 ts_tablet_manager.cc:1929] T 21bc23345fdc47d2b7e9b8964749236e P f1c75790cedf4f52a3463a255c7da059: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:20.989579  5082 log.cc:1199] T 21bc23345fdc47d2b7e9b8964749236e P f1c75790cedf4f52a3463a255c7da059: Deleting WAL directory at /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/ts-0-root/wals/21bc23345fdc47d2b7e9b8964749236e
I20260709 13:14:20.991686  3841 catalog_manager.cc:5028] TS f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): tablet 21bc23345fdc47d2b7e9b8964749236e (table test-workload [id=8a2760e8528448a780fea6ccf25816cb]) successfully deleted
I20260709 13:14:20.992862  5026 consensus_queue.cc:1048] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:20.999706  5001 raft_consensus.cc:1064] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059: attempting to promote NON_VOTER d709ee666b774ec29aa732e508219938 to VOTER
I20260709 13:14:21.002344  5001 consensus_queue.cc:237] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:21.011982  5026 raft_consensus.cc:2955] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:21.012133  4034 raft_consensus.cc:2955] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:21.017266  4707 raft_consensus.cc:2955] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:21.025596  4101 raft_consensus.cc:2955] T b2879f06fa90455ea323efd79c11c330 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:21.047904  3854 catalog_manager.cc:5697] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:21.057929  4708 raft_consensus.cc:1275] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:21.066578  4101 raft_consensus.cc:1275] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:21.068104  5026 consensus_queue.cc:1048] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:21.068336  4034 raft_consensus.cc:1275] T 37bb8c27fe534b22824e326e191a66f0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:21.079738  3955 consensus_queue.cc:237] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:21.071991  5044 consensus_queue.cc:1048] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:14:21.087237  5026 consensus_queue.cc:1048] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:21.090526  4034 raft_consensus.cc:1275] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:21.092420  5026 consensus_queue.cc:1048] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:21.101828  5088 raft_consensus.cc:2955] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:21.103196  4034 raft_consensus.cc:2955] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:21.116382  3841 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b2879f06fa90455ea323efd79c11c330 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:21.117424  5001 raft_consensus.cc:2955] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:21.120431  4025 raft_consensus.cc:2955] T 37bb8c27fe534b22824e326e191a66f0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:21.128993  4101 raft_consensus.cc:2955] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:21.143975  4709 raft_consensus.cc:1275] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:21.142850  3857 catalog_manager.cc:5697] T 37bb8c27fe534b22824e326e191a66f0 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:21.152014  3854 catalog_manager.cc:5697] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: config changed from index 3 to 4, VOTER 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) evicted. New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:21.157497  4709 raft_consensus.cc:2955] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:21.164068  5044 consensus_queue.cc:1048] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:21.172149  4707 raft_consensus.cc:2955] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:21.173605  4095 tablet_service.cc:1558] Processing DeleteTablet for tablet b2879f06fa90455ea323efd79c11c330 with delete_type TABLET_DATA_TOMBSTONED (TS 8952c48a6f3a43968f7d77f7bfc4d1bc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45324
I20260709 13:14:21.178673  5093 tablet_replica.cc:333] T b2879f06fa90455ea323efd79c11c330 P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:14:21.180052  5093 raft_consensus.cc:2243] T b2879f06fa90455ea323efd79c11c330 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:21.180920  5093 raft_consensus.cc:2272] T b2879f06fa90455ea323efd79c11c330 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:21.184688  5093 ts_tablet_manager.cc:1916] T b2879f06fa90455ea323efd79c11c330 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:21.201515  3958 consensus_queue.cc:237] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:21.210527  4106 raft_consensus.cc:1275] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:21.211920  4707 raft_consensus.cc:1275] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:21.215035  5001 consensus_queue.cc:1048] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:21.215416  5093 ts_tablet_manager.cc:1929] T b2879f06fa90455ea323efd79c11c330 P 8952c48a6f3a43968f7d77f7bfc4d1bc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:21.216121  5093 log.cc:1199] T b2879f06fa90455ea323efd79c11c330 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Deleting WAL directory at /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/ts-2-root/wals/b2879f06fa90455ea323efd79c11c330
I20260709 13:14:21.217211  5089 consensus_queue.cc:1048] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:21.221441  3841 catalog_manager.cc:5028] TS 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): tablet b2879f06fa90455ea323efd79c11c330 (table test-workload [id=8a2760e8528448a780fea6ccf25816cb]) successfully deleted
I20260709 13:14:21.223604  5001 raft_consensus.cc:2955] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:21.225160  4707 raft_consensus.cc:2955] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:21.231072  4099 raft_consensus.cc:2955] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:21.240912  3841 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 37bb8c27fe534b22824e326e191a66f0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:21.248021  3855 catalog_manager.cc:5697] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 reported cstate change: config changed from index 3 to 4, VOTER 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) evicted. New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:21.261371  4017 tablet_service.cc:1558] Processing DeleteTablet for tablet 37bb8c27fe534b22824e326e191a66f0 with delete_type TABLET_DATA_TOMBSTONED (TS 6f5b5e4ed72944ecbda200012d141dc2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38278
I20260709 13:14:21.262406  5081 tablet_replica.cc:333] T 37bb8c27fe534b22824e326e191a66f0 P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:14:21.263599  5081 raft_consensus.cc:2243] T 37bb8c27fe534b22824e326e191a66f0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:21.264417  5081 raft_consensus.cc:2272] T 37bb8c27fe534b22824e326e191a66f0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:21.269055  5081 ts_tablet_manager.cc:1916] T 37bb8c27fe534b22824e326e191a66f0 P 6f5b5e4ed72944ecbda200012d141dc2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:21.284149  5081 ts_tablet_manager.cc:1929] T 37bb8c27fe534b22824e326e191a66f0 P 6f5b5e4ed72944ecbda200012d141dc2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:21.284602  5081 log.cc:1199] T 37bb8c27fe534b22824e326e191a66f0 P 6f5b5e4ed72944ecbda200012d141dc2: Deleting WAL directory at /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/ts-1-root/wals/37bb8c27fe534b22824e326e191a66f0
I20260709 13:14:21.286005  3844 catalog_manager.cc:5028] TS 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): tablet 37bb8c27fe534b22824e326e191a66f0 (table test-workload [id=8a2760e8528448a780fea6ccf25816cb]) successfully deleted
W20260709 13:14:22.983950  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 73664.6us
I20260709 13:14:23.004812  4101 consensus_queue.cc:237] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
W20260709 13:14:23.022682  4073 consensus_peers.cc:597] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117): Couldn't send request to peer d709ee666b774ec29aa732e508219938. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 97cf7690694c4d5988258ec1b641a2e6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:23.024423  3955 raft_consensus.cc:1275] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:23.026430  5104 consensus_queue.cc:1048] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:23.036604  4033 raft_consensus.cc:1275] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:23.041543  5112 consensus_queue.cc:1048] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:23.043020  5104 raft_consensus.cc:2955] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:23.045022  3955 raft_consensus.cc:2955] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:23.058820  4101 consensus_queue.cc:237] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
W20260709 13:14:23.066712  4073 consensus_peers.cc:597] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117): Couldn't send request to peer d709ee666b774ec29aa732e508219938. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 86669993fba94e65ba192aa115ed6e88. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:23.068143  4029 raft_consensus.cc:1275] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:23.068723  3955 raft_consensus.cc:1275] T 86669993fba94e65ba192aa115ed6e88 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:23.074018  5112 consensus_queue.cc:1048] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:23.074155  3855 catalog_manager.cc:5697] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New cstate: current_term: 1 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:23.076210  5112 consensus_queue.cc:1048] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:23.077431  4033 raft_consensus.cc:2955] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:23.090363  5104 raft_consensus.cc:2955] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:23.091885  3955 raft_consensus.cc:2955] T 86669993fba94e65ba192aa115ed6e88 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:23.105756  4029 raft_consensus.cc:2955] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:23.121126  4101 consensus_queue.cc:237] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:23.134339  4029 raft_consensus.cc:1275] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:14:23.134794  4073 consensus_peers.cc:597] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117): Couldn't send request to peer d709ee666b774ec29aa732e508219938. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1d55b0c8cf6547cb8c135f6ecdfce39f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:23.135984  3955 raft_consensus.cc:1275] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:23.136554  5105 consensus_queue.cc:1048] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:23.140036  5104 consensus_queue.cc:1048] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:23.161315  5105 raft_consensus.cc:2955] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:23.161836  4029 raft_consensus.cc:2955] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:23.167795  3855 catalog_manager.cc:5697] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New cstate: current_term: 1 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:23.182889  3955 raft_consensus.cc:2955] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:23.191305  3854 catalog_manager.cc:5697] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New cstate: current_term: 1 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:23.195387  3956 consensus_queue.cc:237] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
W20260709 13:14:23.213816  3924 consensus_peers.cc:597] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 -> Peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117): Couldn't send request to peer d709ee666b774ec29aa732e508219938. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6e863d888e2a4327a9127a43deb1f1b9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:23.215610  4101 raft_consensus.cc:1275] T 6e863d888e2a4327a9127a43deb1f1b9 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:23.218464  4033 raft_consensus.cc:1275] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:23.218798  5001 consensus_queue.cc:1048] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:23.221817  5102 consensus_queue.cc:1048] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:23.237401  5102 raft_consensus.cc:2955] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:23.241935  4101 raft_consensus.cc:2955] T 6e863d888e2a4327a9127a43deb1f1b9 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:23.248230  4033 raft_consensus.cc:2955] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:14:23.274501  3857 catalog_manager.cc:5697] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: config changed from index -1 to 2, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:23.275520  3980 debug-util.cc:398] Leaking SignalData structure 0x7b08002cc200 after lost signal to thread 2846
W20260709 13:14:23.276775  3980 debug-util.cc:398] Leaking SignalData structure 0x7b08002e4880 after lost signal to thread 3891
W20260709 13:14:23.278049  3980 debug-util.cc:398] Leaking SignalData structure 0x7b08001aefc0 after lost signal to thread 3983
W20260709 13:14:23.279237  3980 debug-util.cc:398] Leaking SignalData structure 0x7b08000e0e00 after lost signal to thread 4058
W20260709 13:14:23.280409  3980 debug-util.cc:398] Leaking SignalData structure 0x7b0800337280 after lost signal to thread 4132
W20260709 13:14:23.281596  3980 debug-util.cc:398] Leaking SignalData structure 0x7b080028daa0 after lost signal to thread 4733
I20260709 13:14:23.483975  5131 ts_tablet_manager.cc:933] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938: Initiating tablet copy from peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:23.485889  5131 tablet_copy_client.cc:323] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938: tablet copy: Beginning tablet copy session from remote peer at address 127.2.198.195:37843
I20260709 13:14:23.487612  4118 tablet_copy_service.cc:140] P 8952c48a6f3a43968f7d77f7bfc4d1bc: Received BeginTabletCopySession request for tablet 97cf7690694c4d5988258ec1b641a2e6 from peer d709ee666b774ec29aa732e508219938 ({username='slave'} at 127.0.0.1:34656)
I20260709 13:14:23.488147  4118 tablet_copy_service.cc:161] P 8952c48a6f3a43968f7d77f7bfc4d1bc: Beginning new tablet copy session on tablet 97cf7690694c4d5988258ec1b641a2e6 from peer d709ee666b774ec29aa732e508219938 at {username='slave'} at 127.0.0.1:34656: session id = d709ee666b774ec29aa732e508219938-97cf7690694c4d5988258ec1b641a2e6
I20260709 13:14:23.494285  4118 tablet_copy_source_session.cc:215] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:23.497155  5131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97cf7690694c4d5988258ec1b641a2e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:23.512220  5131 tablet_copy_client.cc:806] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:23.512811  5131 tablet_copy_client.cc:670] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:23.517294  5131 tablet_copy_client.cc:538] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:23.527014  5131 tablet_bootstrap.cc:492] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938: Bootstrap starting.
I20260709 13:14:23.546443  5131 tablet_bootstrap.cc:492] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:23.547227  5131 tablet_bootstrap.cc:492] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938: Bootstrap complete.
I20260709 13:14:23.547883  5131 ts_tablet_manager.cc:1403] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938: Time spent bootstrapping tablet: real 0.021s	user 0.020s	sys 0.000s
I20260709 13:14:23.550362  5131 raft_consensus.cc:359] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:23.551007  5131 raft_consensus.cc:740] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Initialized, Role: LEARNER
I20260709 13:14:23.551620  5131 consensus_queue.cc:260] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:23.554534  5131 ts_tablet_manager.cc:1434] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.004s
I20260709 13:14:23.556663  4118 tablet_copy_service.cc:342] P 8952c48a6f3a43968f7d77f7bfc4d1bc: Request end of tablet copy session d709ee666b774ec29aa732e508219938-97cf7690694c4d5988258ec1b641a2e6 received from {username='slave'} at 127.0.0.1:34656
I20260709 13:14:23.557145  4118 tablet_copy_service.cc:434] P 8952c48a6f3a43968f7d77f7bfc4d1bc: ending tablet copy session d709ee666b774ec29aa732e508219938-97cf7690694c4d5988258ec1b641a2e6 on tablet 97cf7690694c4d5988258ec1b641a2e6 with peer d709ee666b774ec29aa732e508219938
I20260709 13:14:23.589924  5131 ts_tablet_manager.cc:933] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938: Initiating tablet copy from peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:23.591758  5131 tablet_copy_client.cc:323] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938: tablet copy: Beginning tablet copy session from remote peer at address 127.2.198.195:37843
I20260709 13:14:23.593447  4118 tablet_copy_service.cc:140] P 8952c48a6f3a43968f7d77f7bfc4d1bc: Received BeginTabletCopySession request for tablet 86669993fba94e65ba192aa115ed6e88 from peer d709ee666b774ec29aa732e508219938 ({username='slave'} at 127.0.0.1:34656)
I20260709 13:14:23.593956  4118 tablet_copy_service.cc:161] P 8952c48a6f3a43968f7d77f7bfc4d1bc: Beginning new tablet copy session on tablet 86669993fba94e65ba192aa115ed6e88 from peer d709ee666b774ec29aa732e508219938 at {username='slave'} at 127.0.0.1:34656: session id = d709ee666b774ec29aa732e508219938-86669993fba94e65ba192aa115ed6e88
I20260709 13:14:23.601681  4118 tablet_copy_source_session.cc:215] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:23.604817  5131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86669993fba94e65ba192aa115ed6e88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:23.622534  5131 tablet_copy_client.cc:806] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:23.623162  5131 tablet_copy_client.cc:670] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:23.631803  5131 tablet_copy_client.cc:538] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:23.644693  5131 tablet_bootstrap.cc:492] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938: Bootstrap starting.
I20260709 13:14:23.651499  5136 ts_tablet_manager.cc:933] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938: Initiating tablet copy from peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:23.674219  5136 tablet_copy_client.cc:323] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938: tablet copy: Beginning tablet copy session from remote peer at address 127.2.198.195:37843
I20260709 13:14:23.675895  4118 tablet_copy_service.cc:140] P 8952c48a6f3a43968f7d77f7bfc4d1bc: Received BeginTabletCopySession request for tablet 1d55b0c8cf6547cb8c135f6ecdfce39f from peer d709ee666b774ec29aa732e508219938 ({username='slave'} at 127.0.0.1:34656)
I20260709 13:14:23.676390  4118 tablet_copy_service.cc:161] P 8952c48a6f3a43968f7d77f7bfc4d1bc: Beginning new tablet copy session on tablet 1d55b0c8cf6547cb8c135f6ecdfce39f from peer d709ee666b774ec29aa732e508219938 at {username='slave'} at 127.0.0.1:34656: session id = d709ee666b774ec29aa732e508219938-1d55b0c8cf6547cb8c135f6ecdfce39f
I20260709 13:14:23.680276  5131 tablet_bootstrap.cc:492] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:23.681329  5131 tablet_bootstrap.cc:492] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938: Bootstrap complete.
I20260709 13:14:23.682114  5131 ts_tablet_manager.cc:1403] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938: Time spent bootstrapping tablet: real 0.038s	user 0.020s	sys 0.008s
I20260709 13:14:23.685235  4118 tablet_copy_source_session.cc:215] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:23.685375  5131 raft_consensus.cc:359] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:23.686292  5131 raft_consensus.cc:740] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Initialized, Role: LEARNER
I20260709 13:14:23.686960  5131 consensus_queue.cc:260] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:23.689934  5131 ts_tablet_manager.cc:1434] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:14:23.691969  5136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d55b0c8cf6547cb8c135f6ecdfce39f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:23.709479  5136 tablet_copy_client.cc:806] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:23.710107  5136 tablet_copy_client.cc:670] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:23.712816  4118 tablet_copy_service.cc:342] P 8952c48a6f3a43968f7d77f7bfc4d1bc: Request end of tablet copy session d709ee666b774ec29aa732e508219938-86669993fba94e65ba192aa115ed6e88 received from {username='slave'} at 127.0.0.1:34656
I20260709 13:14:23.713641  4118 tablet_copy_service.cc:434] P 8952c48a6f3a43968f7d77f7bfc4d1bc: ending tablet copy session d709ee666b774ec29aa732e508219938-86669993fba94e65ba192aa115ed6e88 on tablet 86669993fba94e65ba192aa115ed6e88 with peer d709ee666b774ec29aa732e508219938
I20260709 13:14:23.717634  5131 ts_tablet_manager.cc:933] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938: Initiating tablet copy from peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339)
I20260709 13:14:23.724246  5136 tablet_copy_client.cc:538] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:23.732070  5131 tablet_copy_client.cc:323] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938: tablet copy: Beginning tablet copy session from remote peer at address 127.2.198.193:35339
I20260709 13:14:23.734470  3968 tablet_copy_service.cc:140] P f1c75790cedf4f52a3463a255c7da059: Received BeginTabletCopySession request for tablet 6e863d888e2a4327a9127a43deb1f1b9 from peer d709ee666b774ec29aa732e508219938 ({username='slave'} at 127.0.0.1:35354)
I20260709 13:14:23.735034  3968 tablet_copy_service.cc:161] P f1c75790cedf4f52a3463a255c7da059: Beginning new tablet copy session on tablet 6e863d888e2a4327a9127a43deb1f1b9 from peer d709ee666b774ec29aa732e508219938 at {username='slave'} at 127.0.0.1:35354: session id = d709ee666b774ec29aa732e508219938-6e863d888e2a4327a9127a43deb1f1b9
I20260709 13:14:23.741421  3968 tablet_copy_source_session.cc:215] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:23.744899  5131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e863d888e2a4327a9127a43deb1f1b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:23.749796  5136 tablet_bootstrap.cc:492] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938: Bootstrap starting.
I20260709 13:14:23.765993  5131 tablet_copy_client.cc:806] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:23.766556  5131 tablet_copy_client.cc:670] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:23.770649  5131 tablet_copy_client.cc:538] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:23.781653  5131 tablet_bootstrap.cc:492] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938: Bootstrap starting.
I20260709 13:14:23.782943  5136 tablet_bootstrap.cc:492] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:23.784371  5136 tablet_bootstrap.cc:492] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938: Bootstrap complete.
I20260709 13:14:23.786339  5136 ts_tablet_manager.cc:1403] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938: Time spent bootstrapping tablet: real 0.037s	user 0.023s	sys 0.004s
I20260709 13:14:23.790514  5136 raft_consensus.cc:359] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:23.791388  5136 raft_consensus.cc:740] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Initialized, Role: LEARNER
I20260709 13:14:23.792091  5136 consensus_queue.cc:260] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:23.795187  5136 ts_tablet_manager.cc:1434] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:14:23.800243  4117 tablet_copy_service.cc:342] P 8952c48a6f3a43968f7d77f7bfc4d1bc: Request end of tablet copy session d709ee666b774ec29aa732e508219938-1d55b0c8cf6547cb8c135f6ecdfce39f received from {username='slave'} at 127.0.0.1:34656
I20260709 13:14:23.800670  4117 tablet_copy_service.cc:434] P 8952c48a6f3a43968f7d77f7bfc4d1bc: ending tablet copy session d709ee666b774ec29aa732e508219938-1d55b0c8cf6547cb8c135f6ecdfce39f on tablet 1d55b0c8cf6547cb8c135f6ecdfce39f with peer d709ee666b774ec29aa732e508219938
I20260709 13:14:23.842434  5131 tablet_bootstrap.cc:492] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:23.843636  5131 tablet_bootstrap.cc:492] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938: Bootstrap complete.
I20260709 13:14:23.844422  5131 ts_tablet_manager.cc:1403] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938: Time spent bootstrapping tablet: real 0.063s	user 0.033s	sys 0.013s
I20260709 13:14:23.848325  5131 raft_consensus.cc:359] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:23.849200  5131 raft_consensus.cc:740] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Initialized, Role: LEARNER
I20260709 13:14:23.849898  5131 consensus_queue.cc:260] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:23.852385  5131 ts_tablet_manager.cc:1434] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:14:23.855166  3968 tablet_copy_service.cc:342] P f1c75790cedf4f52a3463a255c7da059: Request end of tablet copy session d709ee666b774ec29aa732e508219938-6e863d888e2a4327a9127a43deb1f1b9 received from {username='slave'} at 127.0.0.1:35354
I20260709 13:14:23.855625  3968 tablet_copy_service.cc:434] P f1c75790cedf4f52a3463a255c7da059: ending tablet copy session d709ee666b774ec29aa732e508219938-6e863d888e2a4327a9127a43deb1f1b9 on tablet 6e863d888e2a4327a9127a43deb1f1b9 with peer d709ee666b774ec29aa732e508219938
I20260709 13:14:23.908118  4708 raft_consensus.cc:1217] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:24.065647  4708 raft_consensus.cc:1217] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:24.090232  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:24.137560  4708 raft_consensus.cc:1217] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:24.167336  4106 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "d709ee666b774ec29aa732e508219938"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:14:24.168037  4106 raft_consensus.cc:606] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Received request to transfer leadership to TS d709ee666b774ec29aa732e508219938
I20260709 13:14:24.170572  4106 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:14:24.171066  4106 raft_consensus.cc:606] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Received request to transfer leadership to TS 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:24.191891  3955 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a"
dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
mode: GRACEFUL
new_leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:35222
I20260709 13:14:24.192584  3955 raft_consensus.cc:606] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Received request to transfer leadership to TS 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:24.195399  4099 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "649df91131174f00af0e0a0240f80adb"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:14:24.195936  4099 raft_consensus.cc:606] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Received request to transfer leadership to TS 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:24.204545  4099 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:14:24.205145  4099 raft_consensus.cc:606] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Received request to transfer leadership to TS 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:24.247082  4708 raft_consensus.cc:1217] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:24.248520  4099 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "d709ee666b774ec29aa732e508219938"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:14:24.249274  4099 raft_consensus.cc:606] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Received request to transfer leadership to TS d709ee666b774ec29aa732e508219938
I20260709 13:14:24.274989  2843 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:14:24.277469  2843 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:24.357689  5143 raft_consensus.cc:993] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc: : Instructing follower 6f5b5e4ed72944ecbda200012d141dc2 to start an election
I20260709 13:14:24.358299  5109 raft_consensus.cc:1081] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Signalling peer 6f5b5e4ed72944ecbda200012d141dc2 to start an election
I20260709 13:14:24.365573  5104 raft_consensus.cc:993] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc: : Instructing follower d709ee666b774ec29aa732e508219938 to start an election
I20260709 13:14:24.366092  5104 raft_consensus.cc:1081] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Signalling peer d709ee666b774ec29aa732e508219938 to start an election
I20260709 13:14:24.367908  4709 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661"
dest_uuid: "d709ee666b774ec29aa732e508219938"
 from {username='slave'} at 127.0.0.1:57666
I20260709 13:14:24.368623  4709 raft_consensus.cc:493] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:24.369359  4029 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6"
dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:38290
I20260709 13:14:24.369957  4029 raft_consensus.cc:493] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:24.370338  4029 raft_consensus.cc:3060] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.369042  4709 raft_consensus.cc:3060] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.380592  5100 raft_consensus.cc:993] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059: : Instructing follower 6f5b5e4ed72944ecbda200012d141dc2 to start an election
I20260709 13:14:24.381181  5100 raft_consensus.cc:1081] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Signalling peer 6f5b5e4ed72944ecbda200012d141dc2 to start an election
I20260709 13:14:24.382100  4029 raft_consensus.cc:515] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:24.385341  4026 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a"
dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:38304
I20260709 13:14:24.385998  4026 raft_consensus.cc:493] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:24.386379  4026 raft_consensus.cc:3060] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.386806  4029 leader_election.cc:290] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:24.388964  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:24.389855  3956 raft_consensus.cc:3060] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.395184  4026 raft_consensus.cc:515] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:24.395408  4709 raft_consensus.cc:515] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:24.396800  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:24.398977  4101 raft_consensus.cc:3055] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:24.399186  4026 leader_election.cc:290] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:24.399324  4101 raft_consensus.cc:740] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:24.400281  4101 consensus_queue.cc:260] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:24.401312  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:24.403772  4101 raft_consensus.cc:3060] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.404014  3955 raft_consensus.cc:3055] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:24.404079  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:24.404464  3955 raft_consensus.cc:740] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:24.404774  4106 raft_consensus.cc:3055] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:24.405097  4106 raft_consensus.cc:740] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:24.405290  3955 consensus_queue.cc:260] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:24.406728  3955 raft_consensus.cc:3060] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.405874  4106 consensus_queue.cc:260] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:24.407596  4106 raft_consensus.cc:3060] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.421391  3955 raft_consensus.cc:2468] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
I20260709 13:14:24.402308  4709 leader_election.cc:290] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:24.402624  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:24.425293  4099 raft_consensus.cc:3060] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.426079  3997 leader_election.cc:304] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:24.430153  4101 raft_consensus.cc:2468] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
I20260709 13:14:24.430503  3956 raft_consensus.cc:2468] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
I20260709 13:14:24.432817  5110 raft_consensus.cc:2804] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:24.433346  5110 raft_consensus.cc:697] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:24.433909  3997 leader_election.cc:304] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:24.434278  5110 consensus_queue.cc:237] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:24.417822  4106 raft_consensus.cc:2468] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 2.
I20260709 13:14:24.436120  4672 leader_election.cc:304] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:24.437145  4099 raft_consensus.cc:2468] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
I20260709 13:14:24.437224  5111 raft_consensus.cc:2804] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:24.437909  5111 raft_consensus.cc:697] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:24.438344  5134 raft_consensus.cc:2804] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:24.438887  5111 consensus_queue.cc:237] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:24.446870  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:24.451078  4026 raft_consensus.cc:3060] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.469214  4026 raft_consensus.cc:2468] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 2.
I20260709 13:14:24.470240  5134 raft_consensus.cc:697] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 2 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:14:24.471783  5134 consensus_queue.cc:237] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:24.479003  5143 raft_consensus.cc:993] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc: : Instructing follower 6f5b5e4ed72944ecbda200012d141dc2 to start an election
I20260709 13:14:24.478267  3855 catalog_manager.cc:5697] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 1 to 2, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 2 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:24.479687  5143 raft_consensus.cc:1081] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Signalling peer 6f5b5e4ed72944ecbda200012d141dc2 to start an election
I20260709 13:14:24.482339  4026 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f"
dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:38290
I20260709 13:14:24.483162  4026 raft_consensus.cc:493] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:24.483753  4026 raft_consensus.cc:3060] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.490628  5109 raft_consensus.cc:993] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc: : Instructing follower 6f5b5e4ed72944ecbda200012d141dc2 to start an election
I20260709 13:14:24.491235  5109 raft_consensus.cc:1081] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Signalling peer 6f5b5e4ed72944ecbda200012d141dc2 to start an election
I20260709 13:14:24.492955  4027 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "649df91131174f00af0e0a0240f80adb"
dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:38290
I20260709 13:14:24.493580  4027 raft_consensus.cc:493] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:24.493976  4027 raft_consensus.cc:3060] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.498200  5143 raft_consensus.cc:1064] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc: attempting to promote NON_VOTER d709ee666b774ec29aa732e508219938 to VOTER
W20260709 13:14:24.498624  5143 raft_consensus.cc:1068] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc: Unable to promote non-voter d709ee666b774ec29aa732e508219938: Service unavailable: leader transfer in progress
I20260709 13:14:24.504428  4027 raft_consensus.cc:515] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:24.506701  4027 leader_election.cc:290] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:24.508112  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:24.508014  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:24.509080  4099 raft_consensus.cc:3055] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:24.509377  4099 raft_consensus.cc:740] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:24.510135  4099 consensus_queue.cc:260] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:24.508693  3956 raft_consensus.cc:3060] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.511180  3857 catalog_manager.cc:5697] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 reported cstate change: term changed from 1 to 2, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to d709ee666b774ec29aa732e508219938 (127.2.198.196). New cstate: current_term: 2 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:24.511214  4099 raft_consensus.cc:3060] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.524655  5143 raft_consensus.cc:993] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc: : Instructing follower d709ee666b774ec29aa732e508219938 to start an election
I20260709 13:14:24.525229  5143 raft_consensus.cc:1081] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Signalling peer d709ee666b774ec29aa732e508219938 to start an election
I20260709 13:14:24.527102  4709 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953"
dest_uuid: "d709ee666b774ec29aa732e508219938"
 from {username='slave'} at 127.0.0.1:57666
I20260709 13:14:24.527683  4709 raft_consensus.cc:493] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:24.528048  4709 raft_consensus.cc:3060] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.530226  3956 raft_consensus.cc:2468] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
I20260709 13:14:24.530171  4099 raft_consensus.cc:2468] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
I20260709 13:14:24.532547  3997 leader_election.cc:304] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:24.533272  5111 raft_consensus.cc:2804] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:24.533737  5111 raft_consensus.cc:697] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:24.534701  5111 consensus_queue.cc:237] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:24.540165  4026 raft_consensus.cc:515] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:24.541375  4709 raft_consensus.cc:515] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:24.548394  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:24.548514  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:24.546499  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:24.549263  4027 raft_consensus.cc:3060] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.549450  3956 raft_consensus.cc:3060] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.550103  4026 leader_election.cc:290] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:24.551116  4709 leader_election.cc:290] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:24.554843  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:24.555459  4106 raft_consensus.cc:3055] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:24.555787  4106 raft_consensus.cc:740] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:24.556588  4106 consensus_queue.cc:260] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:24.558243  4106 raft_consensus.cc:3060] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.560904  3956 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
I20260709 13:14:24.561848  4099 raft_consensus.cc:3055] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:24.562155  4099 raft_consensus.cc:740] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:24.562438  3997 leader_election.cc:304] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:24.563443  5110 raft_consensus.cc:2804] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:24.562870  4099 consensus_queue.cc:260] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:24.565348  4099 raft_consensus.cc:3060] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.571197  4099 raft_consensus.cc:2468] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 2.
I20260709 13:14:24.573240  4106 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
I20260709 13:14:24.577135  4672 leader_election.cc:304] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:24.578023  4027 raft_consensus.cc:2468] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 2.
I20260709 13:14:24.578825  5134 raft_consensus.cc:2804] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:24.579880  5134 raft_consensus.cc:697] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [term 2 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:14:24.580814  5134 consensus_queue.cc:237] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:24.587708  5110 raft_consensus.cc:697] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:24.588819  5110 consensus_queue.cc:237] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:24.605796  3857 catalog_manager.cc:5697] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 1 to 2, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 2 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:24.607868  3857 catalog_manager.cc:5697] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 1 to 2, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 2 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:24.609980  3855 catalog_manager.cc:5697] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 reported cstate change: term changed from 1 to 2, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to d709ee666b774ec29aa732e508219938 (127.2.198.196). New cstate: current_term: 2 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:24.625820  3855 catalog_manager.cc:5697] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 1 to 2, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 2 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:24.640375  4026 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f"
dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:38278
I20260709 13:14:24.641007  4026 raft_consensus.cc:606] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Received request to transfer leadership
I20260709 13:14:24.644330  4026 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f"
dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:38278
I20260709 13:14:24.644745  4026 raft_consensus.cc:606] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Received request to transfer leadership
W20260709 13:14:24.645630  3844 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 1d55b0c8cf6547cb8c135f6ecdfce39f already in progress [suppressed 4 similar messages]
I20260709 13:14:24.648624  4026 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f"
dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:38278
I20260709 13:14:24.649163  4026 raft_consensus.cc:606] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Received request to transfer leadership
W20260709 13:14:24.653941  3905 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:14:24.654384  3905 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 1d55b0c8cf6547cb8c135f6ecdfce39f already in progress
W20260709 13:14:24.654667  3905 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 1d55b0c8cf6547cb8c135f6ecdfce39f already in progress
I20260709 13:14:24.711871  5102 raft_consensus.cc:1064] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059: attempting to promote NON_VOTER d709ee666b774ec29aa732e508219938 to VOTER
I20260709 13:14:24.714713  5102 consensus_queue.cc:237] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:24.721529  4106 raft_consensus.cc:1275] T 6e863d888e2a4327a9127a43deb1f1b9 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:24.721706  4709 raft_consensus.cc:1275] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:24.723739  5148 consensus_queue.cc:1048] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:24.725472  5147 consensus_queue.cc:1048] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:24.727281  4026 raft_consensus.cc:1275] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:24.729787  5147 consensus_queue.cc:1048] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:24.737039  5109 raft_consensus.cc:1064] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc: attempting to promote NON_VOTER d709ee666b774ec29aa732e508219938 to VOTER
I20260709 13:14:24.739883  5109 consensus_queue.cc:237] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:24.759413  5102 raft_consensus.cc:2955] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:24.762882  4709 raft_consensus.cc:1275] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:24.764849  3956 raft_consensus.cc:1275] T 86669993fba94e65ba192aa115ed6e88 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:24.765300  5143 consensus_queue.cc:1048] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:24.766489  5104 consensus_queue.cc:1048] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:24.769390  4026 raft_consensus.cc:2955] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:24.762041  4708 raft_consensus.cc:2955] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:24.778477  4027 raft_consensus.cc:1275] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:24.784085  5104 consensus_queue.cc:1048] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:24.809281  4099 raft_consensus.cc:2955] T 6e863d888e2a4327a9127a43deb1f1b9 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:24.810804  3855 catalog_manager.cc:5697] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 reported cstate change: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:24.849148  3957 consensus_queue.cc:237] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:24.850107  3955 raft_consensus.cc:1275] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:14:24.853789  5110 consensus_queue.cc:1048] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:24.868009  4033 raft_consensus.cc:1275] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:24.870414  4709 raft_consensus.cc:1275] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:24.871748  5147 consensus_queue.cc:1048] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:24.875996  5143 raft_consensus.cc:2955] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:24.880852  5098 raft_consensus.cc:2955] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:24.882913  4709 raft_consensus.cc:2955] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:24.883817  3956 raft_consensus.cc:2955] T 86669993fba94e65ba192aa115ed6e88 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:24.891140  3841 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6e863d888e2a4327a9127a43deb1f1b9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:24.893731  4033 raft_consensus.cc:1275] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:24.894193  5147 consensus_queue.cc:1048] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:24.898645  4099 raft_consensus.cc:1275] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:14:24.899655  4708 raft_consensus.cc:3060] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Advancing to term 2
I20260709 13:14:24.904184  5134 consensus_queue.cc:1048] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:24.905553  4027 raft_consensus.cc:2955] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:24.911783  4708 raft_consensus.cc:1275] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [term 2 LEARNER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:14:24.916548  5110 consensus_queue.cc:1048] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:24.919739  5110 consensus_queue.cc:1048] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:24.933302  3855 catalog_manager.cc:5697] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: config changed from index 3 to 4, VOTER 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) evicted. New cstate: current_term: 1 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:24.944136  4703 raft_consensus.cc:2955] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:24.957459  3957 raft_consensus.cc:1275] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:24.964577  4106 raft_consensus.cc:1275] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:24.967051  5134 consensus_queue.cc:1048] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:24.992905  4709 raft_consensus.cc:3060] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 1 LEARNER]: Advancing to term 2
I20260709 13:14:24.993260  5110 consensus_queue.cc:1048] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:24.999716  4026 raft_consensus.cc:2955] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:25.001360  4107 raft_consensus.cc:1275] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:25.002696  4095 tablet_service.cc:1558] Processing DeleteTablet for tablet 6e863d888e2a4327a9127a43deb1f1b9 with delete_type TABLET_DATA_TOMBSTONED (TS 8952c48a6f3a43968f7d77f7bfc4d1bc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45324
I20260709 13:14:25.007571  5110 raft_consensus.cc:1064] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2: attempting to promote NON_VOTER d709ee666b774ec29aa732e508219938 to VOTER
I20260709 13:14:25.009922  5110 consensus_queue.cc:237] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:25.014107  4033 raft_consensus.cc:1275] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:14:25.104940  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 70493.3us
W20260709 13:14:25.125397  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 93587.9us
I20260709 13:14:25.130231  3856 catalog_manager.cc:5697] T 86669993fba94e65ba192aa115ed6e88 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: config changed from index 2 to 3, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
W20260709 13:14:25.144953  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 90233.3us
I20260709 13:14:25.148793  4709 raft_consensus.cc:1275] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 2 LEARNER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:14:25.136843  5134 consensus_queue.cc:1048] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
W20260709 13:14:25.224131  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 248165us
W20260709 13:14:25.233419  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 203595us
I20260709 13:14:25.236692  5183 tablet_replica.cc:333] T 6e863d888e2a4327a9127a43deb1f1b9 P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
W20260709 13:14:25.237700  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 87348.3us
I20260709 13:14:25.240032  4709 raft_consensus.cc:1275] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [term 2 LEARNER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:25.247007  5159 consensus_queue.cc:1048] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:25.256593  5159 consensus_queue.cc:1048] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:14:25.263922  5183 raft_consensus.cc:2243] T 6e863d888e2a4327a9127a43deb1f1b9 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:25.265086  5183 raft_consensus.cc:2272] T 6e863d888e2a4327a9127a43deb1f1b9 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.274533  5183 ts_tablet_manager.cc:1916] T 6e863d888e2a4327a9127a43deb1f1b9 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:25.278821  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:14:25.287716  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 144469us
I20260709 13:14:25.290861  4099 raft_consensus.cc:1275] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:14:25.292919  4099 raft_consensus.cc:1275] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:25.298380  5183 ts_tablet_manager.cc:1929] T 6e863d888e2a4327a9127a43deb1f1b9 P 8952c48a6f3a43968f7d77f7bfc4d1bc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:25.299067  5183 log.cc:1199] T 6e863d888e2a4327a9127a43deb1f1b9 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Deleting WAL directory at /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/ts-2-root/wals/6e863d888e2a4327a9127a43deb1f1b9
I20260709 13:14:25.302971  5194 consensus_queue.cc:1048] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:14:25.316150  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 65134.7us
I20260709 13:14:25.345046  4099 raft_consensus.cc:1275] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:25.372591  3841 catalog_manager.cc:5028] TS 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): tablet 6e863d888e2a4327a9127a43deb1f1b9 (table test-workload [id=8a2760e8528448a780fea6ccf25816cb]) successfully deleted
I20260709 13:14:25.378916  5194 consensus_queue.cc:1048] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:14:25.393390  5195 consensus_queue.cc:1048] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:14:25.396236  3957 raft_consensus.cc:1275] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:14:25.397146  3958 raft_consensus.cc:1275] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:25.402323  5192 consensus_queue.cc:1048] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:14:25.405249  4099 raft_consensus.cc:1275] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:25.494758  5189 consensus_queue.cc:1048] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:14:25.607805  5192 raft_consensus.cc:1064] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2: attempting to promote NON_VOTER d709ee666b774ec29aa732e508219938 to VOTER
W20260709 13:14:25.608495  5192 raft_consensus.cc:1068] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2: Unable to promote non-voter d709ee666b774ec29aa732e508219938: Service unavailable: leader transfer in progress
W20260709 13:14:25.744926  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 285208us
W20260709 13:14:25.800799  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 308809us
I20260709 13:14:25.868434  5203 consensus_queue.cc:1048] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:14:25.843020  4106 consensus_queue.cc:237] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:25.876601  5205 consensus_queue.cc:1048] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:14:25.920317  5188 raft_consensus.cc:1064] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2: attempting to promote NON_VOTER d709ee666b774ec29aa732e508219938 to VOTER
W20260709 13:14:25.921051  5188 raft_consensus.cc:1068] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2: Unable to promote non-voter d709ee666b774ec29aa732e508219938: Service unavailable: leader transfer in progress
W20260709 13:14:25.945606  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 461946us
I20260709 13:14:25.949668  5159 raft_consensus.cc:993] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2: : Instructing follower 8952c48a6f3a43968f7d77f7bfc4d1bc to start an election
I20260709 13:14:25.950541  5159 raft_consensus.cc:1081] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Signalling peer 8952c48a6f3a43968f7d77f7bfc4d1bc to start an election
I20260709 13:14:25.965087  4026 raft_consensus.cc:1275] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:25.937852  5194 raft_consensus.cc:2955] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:25.997603  4100 raft_consensus.cc:2955] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:26.042914  5202 consensus_queue.cc:1048] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:14:26.049129  4708 raft_consensus.cc:1275] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:26.052664  5201 consensus_queue.cc:1048] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:26.077957  4108 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
 from {username='slave'} at 127.0.0.1:45336
I20260709 13:14:26.091953  4108 raft_consensus.cc:493] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:26.092486  4108 raft_consensus.cc:3060] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:26.108948  4108 raft_consensus.cc:515] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:26.123457  4108 leader_election.cc:290] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:26.159940  4708 raft_consensus.cc:2955] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:26.413930  5111 raft_consensus.cc:493] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:26.414745  5111 raft_consensus.cc:515] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:26.417802  5111 leader_election.cc:290] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:26.716552  5111 raft_consensus.cc:493] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:26.717504  5111 raft_consensus.cc:515] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:26.732652  5111 leader_election.cc:290] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:26.753608  5111 raft_consensus.cc:493] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:26.754549  5111 raft_consensus.cc:515] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:26.757520  5111 leader_election.cc:290] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:26.791923  5111 raft_consensus.cc:493] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:26.793062  5111 raft_consensus.cc:515] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:26.844581  5111 leader_election.cc:290] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:26.909791  5111 raft_consensus.cc:493] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:26.910892  5111 raft_consensus.cc:515] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:26.914026  5111 leader_election.cc:290] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:27.183300  5111 raft_consensus.cc:493] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:27.186304  4033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38304 (request call id 1396) took 1146 ms. Trace:
I20260709 13:14:27.186058  5111 raft_consensus.cc:515] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:27.186733  4033 rpcz_store.cc:276] 0709 13:14:27.182629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:27.182846 (+   217us) service_pool.cc:224] Handling call
0709 13:14:27.183347 (+   501us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:27.185796 (+  2449us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:27.185825 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:27.185872 (+    47us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:14:27.185903 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:27.185967 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:27.186119 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:27.188679  5111 leader_election.cc:290] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:27.196645  5111 raft_consensus.cc:493] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:27.197444  5111 raft_consensus.cc:515] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:27.200047  5111 leader_election.cc:290] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:27.202289  5111 raft_consensus.cc:493] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:27.206662  3857 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52094 (request call id 196) took 1402 ms. Trace:
I20260709 13:14:27.205302  5218 raft_consensus.cc:493] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:27.207314  3857 rpcz_store.cc:276] 0709 13:14:25.804476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:25.806036 (+  1560us) service_pool.cc:224] Handling call
0709 13:14:27.206464 (+1400428us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":4}
I20260709 13:14:27.207602  5111 raft_consensus.cc:515] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:27.210263  5111 leader_election.cc:290] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:27.216324  5220 raft_consensus.cc:493] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:27.217077  5220 raft_consensus.cc:515] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:27.220669  5220 leader_election.cc:290] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:27.221272  5220 raft_consensus.cc:493] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:27.221832  5220 raft_consensus.cc:515] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:27.223986  5220 leader_election.cc:290] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:27.224347  5194 raft_consensus.cc:493] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:27.224561  5220 raft_consensus.cc:493] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:27.224751  5109 raft_consensus.cc:493] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:27.225162  5194 raft_consensus.cc:515] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:27.225353  5220 raft_consensus.cc:515] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:27.225390  5109 raft_consensus.cc:515] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:27.227448  5194 leader_election.cc:290] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:27.228325  5220 leader_election.cc:290] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:27.227636  5109 leader_election.cc:290] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:27.230580  5109 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:27.231205  5109 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:27.231592  5194 raft_consensus.cc:493] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:27.232259  5194 raft_consensus.cc:515] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:27.234380  5194 leader_election.cc:290] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:27.236004  5171 raft_consensus.cc:493] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:27.236709  5171 raft_consensus.cc:515] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:27.239704  5220 raft_consensus.cc:493] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:27.239863  5188 raft_consensus.cc:493] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:27.239290  5171 leader_election.cc:290] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:27.240556  5220 raft_consensus.cc:515] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:27.242383  5171 raft_consensus.cc:493] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:27.243093  5171 raft_consensus.cc:515] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:27.243734  5194 raft_consensus.cc:493] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:27.247437  5223 raft_consensus.cc:493] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:27.248342  5223 raft_consensus.cc:515] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:27.259892  5220 leader_election.cc:290] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:27.266057  5143 raft_consensus.cc:493] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:27.266731  5143 raft_consensus.cc:515] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:27.267589  5171 leader_election.cc:290] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:27.268374  5171 raft_consensus.cc:493] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:27.269028  5171 raft_consensus.cc:515] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:27.276772  5143 leader_election.cc:290] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:27.278294  5194 raft_consensus.cc:515] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:27.277578  3853 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44680 (request call id 115) took 1315 ms. Trace:
I20260709 13:14:27.279501  3853 rpcz_store.cc:276] 0709 13:14:25.958644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:25.959359 (+   715us) service_pool.cc:224] Handling call
0709 13:14:27.269313 (+1309954us) spinlock_profiling.cc:243] Waited 1.51 ms on lock 0x7b5400002490. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f152254a640 00007f152b421b76 00007f152b52bc3e 00007f15299ec2a4 00007f15299ec232 00007f15299ec161 00007f15299ec0dc 00007f15299eb392 00007f15239a948c 00007f15239a88c6
0709 13:14:27.273691 (+  4378us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":3484416}
I20260709 13:14:27.260912  5111 raft_consensus.cc:493] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:27.251113  5109 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:27.251116  5223 leader_election.cc:290] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:27.283105  5171 leader_election.cc:290] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:27.284530  5224 raft_consensus.cc:493] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:27.281313  5194 leader_election.cc:290] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:27.240558  5188 raft_consensus.cc:515] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:27.292037  5218 raft_consensus.cc:515] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:27.651763  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 1.62149e+06us
I20260709 13:14:27.689070  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:27.690272  4700 raft_consensus.cc:2468] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 1.
I20260709 13:14:27.691500  5226 raft_consensus.cc:493] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:27.562038  5109 raft_consensus.cc:493] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:27.446164  5223 raft_consensus.cc:493] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:14:27.546852  5222 raft_consensus.cc:493] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:27.499423  5171 raft_consensus.cc:493] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:27.698684  5190 raft_consensus.cc:493] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:27.304297  4703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:27.297869  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:27.685521  5143 raft_consensus.cc:493] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:27.706501  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:27.445847  5111 raft_consensus.cc:515] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:27.710393  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:27.304489  4704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:27.699841  4701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:27.495854  5224 raft_consensus.cc:515] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:27.724960  4709 raft_consensus.cc:2468] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 1.
I20260709 13:14:27.714058  5203 raft_consensus.cc:493] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:27.724915  4707 raft_consensus.cc:2468] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 1.
I20260709 13:14:27.730177  5221 raft_consensus.cc:493] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:27.711251  5109 raft_consensus.cc:515] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:27.712291  5223 raft_consensus.cc:515] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:27.713366  5171 raft_consensus.cc:515] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:27.718681  5143 raft_consensus.cc:515] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:27.736790  4704 raft_consensus.cc:2468] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 1.
I20260709 13:14:27.717309  5226 raft_consensus.cc:515] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:14:27.745452  3999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 244959us
I20260709 13:14:27.750474  5230 raft_consensus.cc:493] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:27.752027  5225 raft_consensus.cc:493] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:27.734704  5203 raft_consensus.cc:515] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:27.746889  4701 raft_consensus.cc:2410] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:14:27.749100  4703 raft_consensus.cc:2468] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 1.
I20260709 13:14:27.752086  5230 raft_consensus.cc:515] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:27.730858  5221 raft_consensus.cc:515] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:27.734129  5222 raft_consensus.cc:515] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:27.756150  5229 raft_consensus.cc:493] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:27.733453  5231 raft_consensus.cc:493] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:27.743475  4706 raft_consensus.cc:2468] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 1.
I20260709 13:14:27.718739  5190 raft_consensus.cc:515] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:27.762040  5111 leader_election.cc:290] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:27.755165  5225 raft_consensus.cc:515] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:27.818279  5111 raft_consensus.cc:493] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:27.842891  5111 raft_consensus.cc:515] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:27.845841  5111 leader_election.cc:290] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:27.846552  5111 raft_consensus.cc:493] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:27.850276  5229 raft_consensus.cc:515] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:27.807324  5223 leader_election.cc:290] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:27.847123  5111 raft_consensus.cc:515] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:27.818778  5109 leader_election.cc:290] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:27.915874  5228 raft_consensus.cc:493] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:27.916512  5104 raft_consensus.cc:493] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:27.893455  5218 leader_election.cc:290] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:27.892918  5232 raft_consensus.cc:493] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:27.910595  5223 raft_consensus.cc:493] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:27.996634  5224 leader_election.cc:290] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:27.997507  5224 raft_consensus.cc:493] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:28.000413  5223 raft_consensus.cc:515] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:28.002311  5230 leader_election.cc:290] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:28.002885  5230 raft_consensus.cc:493] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:27.909933  5231 raft_consensus.cc:515] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:27.969434  5218 raft_consensus.cc:493] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:27.984014  5104 raft_consensus.cc:515] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:27.998168  5224 raft_consensus.cc:515] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:27.982741  5226 leader_election.cc:290] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:28.003367  5230 raft_consensus.cc:515] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:28.018564  5234 raft_consensus.cc:493] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:28.020356  5222 leader_election.cc:290] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:28.021492  5229 leader_election.cc:290] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:28.022082  5143 leader_election.cc:290] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:27.976449  5227 raft_consensus.cc:493] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:14:28.024225  5225 leader_election.cc:290] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:28.000469  5233 raft_consensus.cc:493] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:28.080655  5171 leader_election.cc:290] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:28.081655  5231 leader_election.cc:290] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:28.015087  5218 raft_consensus.cc:515] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:28.025137  5221 leader_election.cc:290] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:27.976501  5228 raft_consensus.cc:515] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:28.025472  5232 raft_consensus.cc:515] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:28.081516  5233 raft_consensus.cc:515] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:28.121282  5104 leader_election.cc:290] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:28.148427  5109 raft_consensus.cc:493] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:28.111479  5229 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:28.078845  5226 raft_consensus.cc:493] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:28.083019  5222 raft_consensus.cc:493] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:28.136739  5111 leader_election.cc:290] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:28.135704  5236 raft_consensus.cc:493] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:14:28.092550  5225 raft_consensus.cc:493] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:28.137637  5235 raft_consensus.cc:493] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:28.182816  5111 raft_consensus.cc:493] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:28.183071  5109 raft_consensus.cc:515] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:28.143728  5203 leader_election.cc:290] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:28.129057  5143 raft_consensus.cc:493] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:28.173106  5231 raft_consensus.cc:493] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:28.172138  5221 raft_consensus.cc:493] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:14:28.183511  5111 raft_consensus.cc:515] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:28.183305  5235 raft_consensus.cc:515] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:28.196480  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:28.196640  5238 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:28.198850  5230 leader_election.cc:290] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:28.198686  5221 raft_consensus.cc:515] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:28.199018  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:28.199812  4029 raft_consensus.cc:2468] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 1.
W20260709 13:14:28.200232  5239 log.cc:927] Time spent T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:14:28.196270  5104 raft_consensus.cc:493] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:28.182487  5222 raft_consensus.cc:515] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:28.120038  5234 raft_consensus.cc:515] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:28.205835  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:28.195722  5171 raft_consensus.cc:493] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:28.207264  4027 raft_consensus.cc:2468] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 1.
I20260709 13:14:28.187036  5226 raft_consensus.cc:515] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:28.206971  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:28.204948  5237 raft_consensus.cc:493] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:28.210628  5232 leader_election.cc:290] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:28.127039  5227 raft_consensus.cc:515] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:28.197325  5143 raft_consensus.cc:515] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:28.210175  5171 raft_consensus.cc:515] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:28.186481  5225 raft_consensus.cc:515] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:28.211128  5237 raft_consensus.cc:515] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:28.212702  5223 leader_election.cc:290] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:28.213267  5241 raft_consensus.cc:493] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:28.213361  5111 leader_election.cc:290] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:28.214986  5109 leader_election.cc:290] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:28.215122  5222 leader_election.cc:290] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:28.215373  5240 raft_consensus.cc:493] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:28.214336  5104 raft_consensus.cc:515] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:28.194226  5229 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:28.216609  5233 leader_election.cc:290] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:28.187916  5236 raft_consensus.cc:515] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:28.232573  3999 leader_election.cc:304] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:28.224077  5221 leader_election.cc:290] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:28.211894  5218 leader_election.cc:290] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:28.207010  5228 leader_election.cc:290] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:28.229729  5234 leader_election.cc:290] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:28.230382  5104 leader_election.cc:290] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:28.230571  5229 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:28.233718  3999 leader_election.cc:304] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:28.206341  5238 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:28.234965  5096 raft_consensus.cc:2804] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:28.201426  5231 raft_consensus.cc:515] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:28.242841  5231 leader_election.cc:290] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:28.243607  5096 raft_consensus.cc:493] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:28.244143  5096 raft_consensus.cc:3060] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:28.227608  5171 leader_election.cc:290] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:14:28.240351  4055 debug-util.cc:398] Leaking SignalData structure 0x7b08001b2de0 after lost signal to thread 2846
I20260709 13:14:28.246608  3999 leader_election.cc:304] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:28.247229  4675 leader_election.cc:304] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
W20260709 13:14:28.248085  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 45649.5us
I20260709 13:14:28.249078  3999 leader_election.cc:304] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:28.237452  5235 leader_election.cc:290] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:28.249868  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:14:28.250204  4055 debug-util.cc:398] Leaking SignalData structure 0x7b0800178fc0 after lost signal to thread 3891
I20260709 13:14:28.253269  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:28.236536  5240 raft_consensus.cc:515] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:14:28.254652  4055 debug-util.cc:398] Leaking SignalData structure 0x7b08002410a0 after lost signal to thread 3983
I20260709 13:14:28.248299  5231 raft_consensus.cc:2804] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:28.253742  3999 leader_election.cc:304] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:28.260767  5231 raft_consensus.cc:493] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:28.256755  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:28.258246  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:28.261233  5194 raft_consensus.cc:2804] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:28.259374  5205 raft_consensus.cc:1064] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2: attempting to promote NON_VOTER d709ee666b774ec29aa732e508219938 to VOTER
I20260709 13:14:28.253439  5229 raft_consensus.cc:2804] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:28.254395  5236 leader_election.cc:290] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:28.260145  5221 raft_consensus.cc:1064] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2: attempting to promote NON_VOTER d709ee666b774ec29aa732e508219938 to VOTER
I20260709 13:14:28.261719  5194 raft_consensus.cc:493] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
W20260709 13:14:28.257296  4055 debug-util.cc:398] Leaking SignalData structure 0x7b0800343160 after lost signal to thread 3984
I20260709 13:14:28.252844  5232 raft_consensus.cc:2804] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:28.256136  5237 leader_election.cc:290] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:28.264824  5194 raft_consensus.cc:3060] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:28.263088  5229 raft_consensus.cc:493] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:28.272529  4701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:28.253718  5143 leader_election.cc:290] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:28.261245  5231 raft_consensus.cc:3060] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:28.272765  5229 raft_consensus.cc:3060] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:28.254292  5238 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:28.273959  4701 raft_consensus.cc:2468] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 1.
I20260709 13:14:28.274713  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:28.263293  5226 leader_election.cc:290] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:28.276240  4704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:28.279816  5204 raft_consensus.cc:493] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:28.277743  5143 raft_consensus.cc:493] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:28.228736  5241 raft_consensus.cc:515] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:28.267231  5232 raft_consensus.cc:493] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:28.283706  5104 raft_consensus.cc:493] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:28.284781  3999 leader_election.cc:304] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:28.281265  5204 raft_consensus.cc:515] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:28.285887  5104 raft_consensus.cc:515] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:28.283567  5171 raft_consensus.cc:493] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:28.287992  4025 raft_consensus.cc:2468] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 1.
I20260709 13:14:28.283605  5232 raft_consensus.cc:3060] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:28.290668  5223 raft_consensus.cc:493] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:28.283483  5236 raft_consensus.cc:493] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:28.295909  5104 leader_election.cc:290] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:28.294283  4675 leader_election.cc:304] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:28.288335  5171 raft_consensus.cc:515] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:28.298372  5242 raft_consensus.cc:493] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:28.298581  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:28.288784  5227 leader_election.cc:290] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:28.290012  5237 raft_consensus.cc:2804] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:28.299733  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:28.304793  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:28.305773  4708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:28.284617  5143 raft_consensus.cc:515] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:28.307039  4708 raft_consensus.cc:2468] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:14:28.311412  4700 raft_consensus.cc:2468] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:14:28.314392  5241 leader_election.cc:290] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:28.314666  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:28.293490  5223 raft_consensus.cc:515] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:28.300496  5238 raft_consensus.cc:2804] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:28.316272  5238 raft_consensus.cc:493] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:28.322137  5171 leader_election.cc:290] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:28.322409  5223 leader_election.cc:290] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:28.308091  5237 raft_consensus.cc:493] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:28.318027  4704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:28.307852  5240 leader_election.cc:290] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:28.299799  5236 raft_consensus.cc:515] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:28.336308  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:28.325250  5238 raft_consensus.cc:3060] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:28.318084  5243 raft_consensus.cc:2804] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:28.328002  5237 raft_consensus.cc:3060] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:28.335970  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:28.341359  4031 raft_consensus.cc:2468] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:14:28.341668  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:28.342381  4032 raft_consensus.cc:2468] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:14:28.333216  4704 raft_consensus.cc:2468] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:14:28.345034  5104 raft_consensus.cc:493] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:28.335194  5171 raft_consensus.cc:493] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:28.325482  5242 raft_consensus.cc:515] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:28.348270  4055 debug-util.cc:398] Leaking SignalData structure 0x7b08003436a0 after lost signal to thread 4058
I20260709 13:14:28.348731  5236 leader_election.cc:290] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:28.346396  5223 raft_consensus.cc:493] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:28.349582  5223 raft_consensus.cc:515] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:28.350445  5143 leader_election.cc:290] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:28.346251  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:28.348588  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:28.354480  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:28.354590  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:28.355206  5109 raft_consensus.cc:493] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:28.359042  5171 raft_consensus.cc:515] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:28.359261  5109 raft_consensus.cc:515] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:28.361636  5171 leader_election.cc:290] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:28.361693  5109 leader_election.cc:290] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:28.351325  5225 leader_election.cc:290] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:28.355857  5236 raft_consensus.cc:493] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:28.363698  5223 leader_election.cc:290] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:28.346897  5204 leader_election.cc:290] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:28.365113  4706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57692 (request call id 115) took 1074 ms. Trace:
I20260709 13:14:28.365530  4706 rpcz_store.cc:276] 0709 13:14:27.291148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:27.291321 (+   173us) service_pool.cc:224] Handling call
0709 13:14:28.364915 (+1073594us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b54005b0254. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:14:28.365032 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47363968}
I20260709 13:14:28.356268  5104 raft_consensus.cc:515] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:28.356935  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:28.357803  4703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:28.364058  5236 raft_consensus.cc:515] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:28.359485  4701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:28.369974  4703 raft_consensus.cc:2468] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:14:28.358292  5229 raft_consensus.cc:515] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:28.345185  5243 raft_consensus.cc:493] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:28.374270  5243 raft_consensus.cc:3060] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:28.373634  3999 leader_election.cc:304] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:28.346887  5205 consensus_queue.cc:237] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:28.363062  5231 raft_consensus.cc:515] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:28.382189  5219 raft_consensus.cc:2804] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:28.385335  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:28.386314  5224 leader_election.cc:290] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:28.390446  5104 leader_election.cc:290] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:28.378885  5223 raft_consensus.cc:493] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:28.391969  5223 raft_consensus.cc:515] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:28.370150  5143 raft_consensus.cc:2955] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:28.400549  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:28.404281  5104 raft_consensus.cc:493] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:28.405901  5223 leader_election.cc:290] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:28.406348  5104 raft_consensus.cc:515] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:28.408437  4055 debug-util.cc:398] Leaking SignalData structure 0x7b0800324de0 after lost signal to thread 4132
I20260709 13:14:28.408465  5104 leader_election.cc:290] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:28.412544  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:28.400903  5109 raft_consensus.cc:493] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:28.414125  5109 raft_consensus.cc:515] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:28.417062  4108 raft_consensus.cc:2468] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 1.
I20260709 13:14:28.416217  5109 leader_election.cc:290] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:28.388084  5232 raft_consensus.cc:515] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:28.397338  5219 raft_consensus.cc:493] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
W20260709 13:14:28.416788  4055 debug-util.cc:398] Leaking SignalData structure 0x7b080021d3c0 after lost signal to thread 4133
W20260709 13:14:28.423661  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 729048us
I20260709 13:14:28.434564  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:28.438680  5229 leader_election.cc:290] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:28.443406  5100 raft_consensus.cc:493] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:28.444113  5100 raft_consensus.cc:515] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:28.448762  5190 leader_election.cc:290] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:28.402576  5244 raft_consensus.cc:493] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:28.451288  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:28.432361  5219 raft_consensus.cc:3060] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:28.456866  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:14:28.458789  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:28.458981  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:28.453423  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:28.461700  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:28.452405  5243 raft_consensus.cc:515] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:28.468209  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:28.471150  4106 raft_consensus.cc:2468] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 1.
I20260709 13:14:28.471673  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:28.466070  4101 raft_consensus.cc:2468] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 1.
I20260709 13:14:28.469481  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:28.474870  5209 raft_consensus.cc:493] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:28.474977  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:28.475746  4099 raft_consensus.cc:2468] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 1.
I20260709 13:14:28.476059  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:28.477125  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:28.459839  5242 leader_election.cc:290] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:28.477778  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:28.478240  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:28.477120  4026 raft_consensus.cc:3055] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:28.480731  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
W20260709 13:14:28.470335  4055 debug-util.cc:398] Leaking SignalData structure 0x7b0800316440 after lost signal to thread 4733
I20260709 13:14:28.478922  3956 raft_consensus.cc:3060] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:28.538475  4709 raft_consensus.cc:2393] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 2: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
I20260709 13:14:28.516530  4026 raft_consensus.cc:740] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:28.520087  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:28.448824  5100 leader_election.cc:290] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:28.541330  5148 raft_consensus.cc:493] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:28.548346  5243 leader_election.cc:290] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:28.549609  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:28.473824  3953 raft_consensus.cc:2468] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:28.553188  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:28.550271  3955 raft_consensus.cc:2468] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:14:28.555847  4675 leader_election.cc:304] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:28.562680  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:28.562979  4701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:28.563278  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:28.563439  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:28.563879  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:28.565362  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:28.565873  5148 raft_consensus.cc:515] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:28.567301  4703 raft_consensus.cc:1275] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 2 LEARNER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:28.562707  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:28.472429  5236 leader_election.cc:290] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:14:28.571353  5247 log.cc:927] Time spent T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:14:28.571453  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:28.572118  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:28.591923  4029 raft_consensus.cc:2393] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 in current term 2: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:14:28.575970  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:28.575297  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:28.592537  4101 raft_consensus.cc:2468] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 1.
I20260709 13:14:28.576687  4107 raft_consensus.cc:2468] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 1.
I20260709 13:14:28.579164  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:28.577680  3957 raft_consensus.cc:2468] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:14:28.594995  4025 raft_consensus.cc:2393] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 in current term 2: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:14:28.596500  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:28.596750  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:28.553145  5209 raft_consensus.cc:515] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:28.586793  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:28.583781  3950 raft_consensus.cc:2468] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:14:28.582938  4026 consensus_queue.cc:260] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:28.586143  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:28.568845  4099 raft_consensus.cc:2468] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 1.
I20260709 13:14:28.592423  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:28.516009  5232 leader_election.cc:290] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:28.516228  5194 raft_consensus.cc:515] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:28.599431  4709 raft_consensus.cc:3060] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:28.604292  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:28.604753  3952 raft_consensus.cc:2468] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:14:28.604897  4108 raft_consensus.cc:2468] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 1.
I20260709 13:14:28.605821  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:28.606387  4108 raft_consensus.cc:2468] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 1.
I20260709 13:14:28.600701  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:28.587253  4701 raft_consensus.cc:3060] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:28.602187  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:28.609653  4101 raft_consensus.cc:2468] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 1.
I20260709 13:14:28.596673  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:28.603572  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:28.579823  5229 raft_consensus.cc:2804] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:28.600544  5210 raft_consensus.cc:493] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:28.603601  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:28.606432  3959 raft_consensus.cc:2468] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:14:28.608994  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:28.612353  4027 raft_consensus.cc:2468] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:14:28.613713  3997 leader_election.cc:304] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:28.568642  5096 raft_consensus.cc:515] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:28.616993  3997 leader_election.cc:304] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:28.617713  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:28.618045  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:28.618348  4034 raft_consensus.cc:2468] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:14:28.619946  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:28.620360  5096 leader_election.cc:290] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:28.595047  5231 leader_election.cc:290] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:28.621027  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:28.625116  5220 raft_consensus.cc:2804] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:28.622993  5241 raft_consensus.cc:2804] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:28.628115  5220 raft_consensus.cc:493] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:28.628604  5220 raft_consensus.cc:3060] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:28.632685  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:28.633351  4100 raft_consensus.cc:2468] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 1.
I20260709 13:14:28.611348  5229 raft_consensus.cc:493] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
W20260709 13:14:28.640870  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:28.652643  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:28.653466  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:28.654175  4028 raft_consensus.cc:2468] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:14:28.634863  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:28.656119  5100 raft_consensus.cc:493] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:28.656744  5100 raft_consensus.cc:515] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:28.659049  5100 leader_election.cc:290] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:28.659621  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:28.660405  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:28.623167  3954 raft_consensus.cc:2468] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 2.
I20260709 13:14:28.623366  3951 raft_consensus.cc:2468] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 2.
I20260709 13:14:28.666939  4703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:28.667611  4703 raft_consensus.cc:3060] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:28.620556  5148 leader_election.cc:290] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:28.676803  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:28.628194  5241 raft_consensus.cc:493] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:28.616223  5238 raft_consensus.cc:515] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:28.474004  5244 raft_consensus.cc:515] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:28.622135  5237 raft_consensus.cc:515] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:28.663554  5229 raft_consensus.cc:3060] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:28.687656  5191 raft_consensus.cc:493] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:28.693655  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:28.700250  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:28.698836  4030 raft_consensus.cc:2955] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:28.699800  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:28.686020  5241 raft_consensus.cc:3060] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:28.702553  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:28.707526  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:28.707710  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:28.708372  4102 raft_consensus.cc:2468] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 1.
I20260709 13:14:28.709868  5102 raft_consensus.cc:493] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:28.725842  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:28.680195  5210 raft_consensus.cc:515] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:28.728112  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:14:28.881883  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 166881us
I20260709 13:14:28.790931  4709 raft_consensus.cc:2468] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
I20260709 13:14:28.708372  3954 raft_consensus.cc:2468] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:14:28.941192  3956 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:28.967787  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:28.974159  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:14:28.984067  3999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 134409us
I20260709 13:14:28.986734  3999 leader_election.cc:304] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
W20260709 13:14:28.999341  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:28.929880  5221 raft_consensus.cc:1068] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2: Unable to promote non-voter d709ee666b774ec29aa732e508219938: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
  Committed config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }.
  Pending config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:14:29.004489  4073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 242862us
I20260709 13:14:28.859951  5194 leader_election.cc:290] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:28.741549  5188 leader_election.cc:290] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:28.871917  5237 leader_election.cc:290] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:28.713225  5191 raft_consensus.cc:515] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:29.006502  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:29.025202  4073 leader_election.cc:304] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:29.035288  4073 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
W20260709 13:14:29.008605  5219 consensus_meta.cc:287] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 0.540s	user 0.002s	sys 0.008s
I20260709 13:14:28.862516  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:29.008750  4031 raft_consensus.cc:1240] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:29.014608  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:29.015595  5231 raft_consensus.cc:2804] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:29.016563  5244 leader_election.cc:290] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:29.017884  5238 leader_election.cc:290] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:28.969919  5209 leader_election.cc:290] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:29.022050  3998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:29.022764  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:29.026856  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:28.736508  5102 raft_consensus.cc:515] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:29.028198  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:29.028785  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:29.029896  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:29.036190  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:29.038874  4030 raft_consensus.cc:2393] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 in current term 2: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:14:29.041683  4026 raft_consensus.cc:3060] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:29.039391  4073 leader_election.cc:304] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:28.848578  5220 raft_consensus.cc:515] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:29.093861  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:29.112973  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:29.112525  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:29.108054  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:14:29.143795  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:29.175237  3950 raft_consensus.cc:2468] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 2.
I20260709 13:14:29.112000  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:14:29.152918  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:29.174844  4073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 135492us
I20260709 13:14:29.177795  4073 leader_election.cc:304] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:29.174247  4709 raft_consensus.cc:3060] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:29.174698  3956 raft_consensus.cc:2376] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3. Re-sending same reply.
I20260709 13:14:29.186918  4027 raft_consensus.cc:1240] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:29.039688  5219 raft_consensus.cc:515] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:29.190786  3856 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52104 (request call id 200) took 2917 ms. Trace:
I20260709 13:14:29.092366  3959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36"
dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
mode: GRACEFUL
new_leader_uuid: "d709ee666b774ec29aa732e508219938"
 from {username='slave'} at 127.0.0.1:35222
I20260709 13:14:29.193243  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:29.193176  5209 consensus_queue.cc:1059] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:29.193794  3959 raft_consensus.cc:606] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Received request to transfer leadership to TS d709ee666b774ec29aa732e508219938
W20260709 13:14:29.194185  5252 log.cc:927] Time spent T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:14:29.195140  4028 raft_consensus.cc:1240] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:29.196979  4672 leader_election.cc:304] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:29.197319  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:29.187788  5242 raft_consensus.cc:2804] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:29.198444  5242 raft_consensus.cc:493] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:29.198639  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:29.198848  5242 raft_consensus.cc:3060] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:29.078486  3857 catalog_manager.cc:5697] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 reported cstate change: config changed from index 2 to 4, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:29.193260  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:14:29.201371  4703 consensus_meta.cc:287] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938: Time spent flushing consensus metadata: real 0.533s	user 0.010s	sys 0.001s
I20260709 13:14:29.183014  5204 raft_consensus.cc:2804] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:29.201807  4703 raft_consensus.cc:2468] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
I20260709 13:14:29.201964  5204 raft_consensus.cc:493] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:29.202487  5204 raft_consensus.cc:3060] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:28.852025  4074 leader_election.cc:304] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:29.197471  4705 raft_consensus.cc:1240] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:29.194542  5209 raft_consensus.cc:3055] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:29.204612  5209 raft_consensus.cc:740] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:29.205518  5209 consensus_queue.cc:260] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:29.206873  5224 raft_consensus.cc:2804] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:29.207309  5224 raft_consensus.cc:493] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:29.195156  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:29.207810  5224 raft_consensus.cc:3060] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:29.063872  5143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:45324 (request call id 73) took 3298 ms. Trace:
I20260709 13:14:29.208782  4704 raft_consensus.cc:1240] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:29.068548  4706 raft_consensus.cc:2393] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 2: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
I20260709 13:14:29.045746  5190 raft_consensus.cc:2804] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:29.220086  5236 raft_consensus.cc:2804] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:29.074946  5229 raft_consensus.cc:515] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:29.227764  5236 raft_consensus.cc:493] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:29.227893  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:29.228245  5236 raft_consensus.cc:3060] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:29.228559  4033 raft_consensus.cc:2468] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 1.
W20260709 13:14:29.210631  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 513257us
I20260709 13:14:29.229583  4074 leader_election.cc:304] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:29.220990  5209 raft_consensus.cc:3060] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:29.047418  5109 raft_consensus.cc:2804] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:29.191190  3856 rpcz_store.cc:276] 0709 13:14:26.168346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:26.168693 (+   347us) service_pool.cc:224] Handling call
0709 13:14:27.758578 (+1589885us) spinlock_profiling.cc:243] Waited 966 ms on lock 0x7b5400428954. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d8090 00007f1525676f3a 00007f152b42d1cc 00007f152b52b37e 00007f15299ec2a4 00007f15299ec232 00007f15299ec161 00007f15299ec0dc 00007f15299eb392 00007f15239a948c 00007f15239a88c6
0709 13:14:29.085911 (+1327333us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":7,"spinlock_wait_cycles":2221177600}
I20260709 13:14:29.071197  5191 leader_election.cc:290] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:29.222648  3950 raft_consensus.cc:2468] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 2.
I20260709 13:14:29.076894  5231 raft_consensus.cc:697] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:29.239384  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:29.236569  4074 leader_election.cc:304] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:14:29.068877  5194 raft_consensus.cc:493] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:29.113160  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:29.068554  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:14:29.231866  4701 consensus_meta.cc:287] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938: Time spent flushing consensus metadata: real 0.607s	user 0.013s	sys 0.001s
I20260709 13:14:29.116914  5210 leader_election.cc:290] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:29.248548  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 207860us
I20260709 13:14:29.248829  4701 raft_consensus.cc:2468] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
I20260709 13:14:29.249751  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:29.229592  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:29.250262  4029 raft_consensus.cc:1240] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 1. Current term is 2. Ops: []
W20260709 13:14:29.227079  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 43725.9us
I20260709 13:14:29.250895  4707 raft_consensus.cc:1240] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:29.048107  3952 raft_consensus.cc:2468] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:14:29.237039  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:29.237527  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:29.232467  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:29.243480  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:29.244624  4027 raft_consensus.cc:1240] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 1. Current term is 2. Ops: []
W20260709 13:14:29.241456  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 170404us
I20260709 13:14:29.263878  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:29.267702  3951 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:29.267872  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:29.226258  5190 raft_consensus.cc:493] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:29.253949  3999 leader_election.cc:304] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:29.239727  5246 raft_consensus.cc:2804] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:29.269232  4709 raft_consensus.cc:2468] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
I20260709 13:14:29.300129  4708 raft_consensus.cc:1240] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:29.234639  5109 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:29.240409  5205 raft_consensus.cc:493] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:29.309929  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:29.307690  5109 raft_consensus.cc:3060] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:29.311944  4705 raft_consensus.cc:1240] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:29.305297  5246 raft_consensus.cc:493] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:29.312626  5246 raft_consensus.cc:3060] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:29.313786  4026 raft_consensus.cc:2410] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 3 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
W20260709 13:14:29.313913  3999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 60060.5us
I20260709 13:14:29.267366  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:29.313108  4703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:29.208993  5143 rpcz_store.cc:276] 0709 13:14:25.755227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:25.757653 (+  2426us) service_pool.cc:224] Handling call
0709 13:14:25.875274 (+117621us) log.cc:844] Serialized 501 byte log entry
0709 13:14:27.265573 (+1390299us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b4c002aab80. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152393aa20 00007f152394ba29 00007f152394c13f 00007f15239102ab 00007f152393df3c 00007f152393e3fe 00007f1523bcb50b 00007f15255ca381 00007f15255c826b 00007f15255ced53 00007f15255cecd9
0709 13:14:29.051832 (+1786259us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8673,"raft.queue_time_us":33522,"raft.run_cpu_time_us":19553,"raft.run_wall_time_us":1344421,"spinlock_wait_cycles":39021824}
I20260709 13:14:29.246918  5229 leader_election.cc:290] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:29.304612  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 59780.1us
I20260709 13:14:29.308003  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:29.308316  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:29.305315  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:29.269580  3925 leader_election.cc:304] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:29.251901  5244 raft_consensus.cc:2749] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:29.276139  5190 raft_consensus.cc:3060] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:29.308277  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:29.260768  5194 raft_consensus.cc:515] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:29.326869  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:29.328613  5102 leader_election.cc:290] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:29.318920  5253 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:29.329322  5250 raft_consensus.cc:2804] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:29.329790  5250 raft_consensus.cc:493] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:29.330322  5250 raft_consensus.cc:3060] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:29.329659  5253 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:29.322201  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:29.331131  3958 raft_consensus.cc:2468] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 1.
W20260709 13:14:29.323518  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 54001.5us
I20260709 13:14:29.331967  3999 leader_election.cc:304] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:29.336031  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:29.338797  4026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38290 (request call id 1223) took 1044 ms. Trace:
I20260709 13:14:29.313519  5251 raft_consensus.cc:493] T 86669993fba94e65ba192aa115ed6e88 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:29.349751  5251 raft_consensus.cc:515] T 86669993fba94e65ba192aa115ed6e88 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:29.319612  5237 raft_consensus.cc:2804] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:29.343649  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:29.342114  5100 consensus_queue.cc:1059] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:14:29.344676  5249 consensus_queue.cc:1059] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:29.322170  5191 raft_consensus.cc:493] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:29.349099  5194 leader_election.cc:290] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:29.333977  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 135974us
I20260709 13:14:29.361155  5219 leader_election.cc:290] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:29.365957  3999 leader_election.cc:304] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:29.367174  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:14:29.339533  5241 consensus_meta.cc:287] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 0.615s	user 0.013s	sys 0.002s
I20260709 13:14:29.355350  4709 raft_consensus.cc:2955] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:29.350957  5242 raft_consensus.cc:515] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:29.340551  5208 consensus_queue.cc:1059] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:14:29.339165  4026 rpcz_store.cc:276] 0709 13:14:28.294107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:28.294220 (+   113us) service_pool.cc:224] Handling call
0709 13:14:29.041330 (+747110us) spinlock_profiling.cc:243] Waited 414 ms on lock 0x7b58005c00d0. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15255ca0aa 00007f152564c447 00007f1525664fe7 00007f15256667de 00007f152567227c 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c
0709 13:14:29.338605 (+297275us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54001e87d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:14:29.338738 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1346926080}
I20260709 13:14:29.368724  4108 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a08c9f959924154b694899e3a318181"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:14:29.360237  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:29.320549  5205 raft_consensus.cc:515] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:29.383328  4108 raft_consensus.cc:606] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Received request to transfer leadership to TS 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:29.352741  5251 leader_election.cc:290] T 86669993fba94e65ba192aa115ed6e88 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:29.376972  5237 raft_consensus.cc:697] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:29.369036  5221 raft_consensus.cc:2804] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:29.399873  5210 consensus_queue.cc:1059] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:29.400532  5221 raft_consensus.cc:697] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:29.401420  5221 consensus_queue.cc:237] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:29.409651  5195 raft_consensus.cc:2804] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:29.410374  5195 raft_consensus.cc:697] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:29.386507  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:29.374563  5147 consensus_queue.cc:1059] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:14:29.423903  5266 consensus_queue.cc:1059] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:29.364315  5231 consensus_queue.cc:237] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:29.383342  5241 raft_consensus.cc:515] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:29.411381  5195 consensus_queue.cc:237] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:29.414812  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:29.434226  5205 leader_election.cc:290] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:29.382342  5191 raft_consensus.cc:515] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:29.439697  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:29.449303  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 66550.3us
I20260709 13:14:29.394153  4672 leader_election.cc:304] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:29.456930  4025 raft_consensus.cc:2393] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 2: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:14:29.462424  3954 raft_consensus.cc:1275] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:29.471626  3955 raft_consensus.cc:2468] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
W20260709 13:14:29.472309  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 85372.2us
I20260709 13:14:29.474731  4672 leader_election.cc:304] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:29.475314  4071 leader_election.cc:304] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:29.476119  5263 raft_consensus.cc:2749] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:29.476692  4672 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:29.454468  5220 leader_election.cc:290] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:29.532218  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 106133us
I20260709 13:14:29.533824  4071 leader_election.cc:304] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:29.535270  4071 leader_election.cc:304] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:29.536870  4071 leader_election.cc:304] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:14:29.539518  4073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 224584us
I20260709 13:14:29.455248  5224 raft_consensus.cc:515] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:14:29.541970  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 220307us
I20260709 13:14:29.480275  5257 raft_consensus.cc:2804] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:29.483425  5266 consensus_queue.cc:1059] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:14:29.514047  5256 raft_consensus.cc:2804] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:29.508119  5190 raft_consensus.cc:515] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:29.558836  5224 leader_election.cc:290] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:29.559727  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:29.560555  5268 raft_consensus.cc:3055] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:29.560986  5268 raft_consensus.cc:740] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:29.561944  5268 consensus_queue.cc:260] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:29.556506  5263 raft_consensus.cc:2804] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:29.563629  5263 raft_consensus.cc:493] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:29.563844  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:29.528898  5109 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:29.565225  5242 leader_election.cc:290] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:29.566217  5109 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:29.566526  5275 raft_consensus.cc:2804] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:29.567008  5275 raft_consensus.cc:493] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:29.567277  5241 leader_election.cc:290] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:29.567387  5275 raft_consensus.cc:3060] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:29.567739  5191 leader_election.cc:290] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:29.530071  5237 consensus_queue.cc:237] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:29.564030  5263 raft_consensus.cc:3060] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:29.550252  5229 raft_consensus.cc:2804] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:29.572570  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:29.550149  5257 raft_consensus.cc:493] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:29.573001  5229 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:29.589082  5257 raft_consensus.cc:3060] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:29.589494  5229 raft_consensus.cc:3060] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:29.570109  5268 raft_consensus.cc:3060] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:29.598752  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:29.569980  5244 raft_consensus.cc:2804] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:29.552810  5256 raft_consensus.cc:493] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:29.576375  4701 raft_consensus.cc:1240] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:29.609159  5229 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:29.543193  5264 consensus_queue.cc:1059] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
W20260709 13:14:29.626540  3998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:29.555203  5253 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:29.630424  3958 raft_consensus.cc:1240] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 2. Current term is 3. Ops: [2.3-2.3]
I20260709 13:14:29.566268  5236 raft_consensus.cc:515] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:29.636183  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:29.601125  5244 raft_consensus.cc:493] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:29.598891  5190 leader_election.cc:290] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:14:29.642015  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 164916us
I20260709 13:14:29.574046  5204 raft_consensus.cc:515] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:29.622284  5256 raft_consensus.cc:3060] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:29.642041  5244 raft_consensus.cc:3060] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:29.652679  4704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:29.661198  4033 raft_consensus.cc:1240] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:29.662797  5208 raft_consensus.cc:3055] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:29.663244  5208 raft_consensus.cc:740] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:29.666083  4033 raft_consensus.cc:1240] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:29.663558  5272 consensus_queue.cc:1059] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:29.652864  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:29.683431  5147 consensus_queue.cc:1059] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:14:29.693804  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:29.694072  5208 consensus_queue.cc:260] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:29.697258  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:29.698319  4025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38290 (request call id 1260) took 1073 ms. Trace:
I20260709 13:14:29.698432  4030 raft_consensus.cc:1240] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:29.698817  4025 rpcz_store.cc:276] 0709 13:14:28.626035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:28.626488 (+   453us) service_pool.cc:224] Handling call
0709 13:14:28.943887 (+317399us) spinlock_profiling.cc:243] Waited 4.74 ms on lock 0x7b5800114c98. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f1522549b71 00007f1522549a22 00007f152b462c09 00007f152a5bcee0 00007f152a6860ab 00007f152a686131 00007f152a6340a0 00007f152a633984 00007f1523bae6d4 00007f1523bae662
0709 13:14:29.026669 (+ 82782us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b5800114c98. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f1522549e9c 00007f1522549a5b 00007f152b462c09 00007f152a5bcee0 00007f152a6860ab 00007f152a686131 00007f152a6340a0 00007f152a633984 00007f1523bae6d4 00007f1523bae662
0709 13:14:29.698081 (+671412us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b54001d9f54. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:14:29.698245 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":679918336}
I20260709 13:14:29.700932  4705 raft_consensus.cc:1240] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:29.693835  5229 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:29.708312  5265 raft_consensus.cc:3055] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:29.711090  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:29.711450  5269 raft_consensus.cc:3055] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:29.720626  5204 leader_election.cc:290] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:29.725739  5208 raft_consensus.cc:3060] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:29.734525  3924 leader_election.cc:304] T 86669993fba94e65ba192aa115ed6e88 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:14:29.688154  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:29.751616  4025 raft_consensus.cc:1240] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:29.749467  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:29.752835  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:14:29.744975  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 265182us
I20260709 13:14:29.741969  5265 raft_consensus.cc:740] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:29.765019  4672 leader_election.cc:304] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:29.765496  4702 raft_consensus.cc:1240] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:29.766183  5100 raft_consensus.cc:993] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059: : Instructing follower d709ee666b774ec29aa732e508219938 to start an election
I20260709 13:14:29.766261  4672 leader_election.cc:304] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:29.766760  5100 raft_consensus.cc:1081] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Signalling peer d709ee666b774ec29aa732e508219938 to start an election
I20260709 13:14:29.767189  5270 raft_consensus.cc:2749] T 86669993fba94e65ba192aa115ed6e88 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:29.767762  5229 raft_consensus.cc:2804] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:29.750174  5269 raft_consensus.cc:740] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:29.769061  5229 raft_consensus.cc:493] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:29.770236  5276 raft_consensus.cc:2749] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:29.770568  4672 leader_election.cc:304] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:29.772285  5229 raft_consensus.cc:3060] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:29.761147  5209 consensus_queue.cc:1059] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:14:29.772588  5236 leader_election.cc:290] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:29.763447  5253 consensus_queue.cc:1059] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:14:29.790556  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:29.785002  5238 raft_consensus.cc:2749] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:29.793432  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:29.786440  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:29.799628  5270 consensus_queue.cc:1059] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:29.804174  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:29.801648  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:29.807003  5250 raft_consensus.cc:515] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:29.803908  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:29.807899  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:29.809427  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:29.817917  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:29.816301  3954 raft_consensus.cc:2468] T 86669993fba94e65ba192aa115ed6e88 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 1.
I20260709 13:14:29.821638  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:14:29.828008  4073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 286449us
I20260709 13:14:29.781956  5265 consensus_queue.cc:260] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:14:29.828791  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 277756us
I20260709 13:14:29.830638  4074 leader_election.cc:304] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:14:29.819919  5275 raft_consensus.cc:515] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:29.836324  4074 leader_election.cc:304] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:14:29.829577  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:29.842501  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:29.845613  4032 raft_consensus.cc:1240] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:29.832037  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:29.851884  5251 raft_consensus.cc:3055] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:29.852185  5250 leader_election.cc:290] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:29.852645  5271 raft_consensus.cc:3055] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:29.833516  5236 raft_consensus.cc:2749] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:29.858064  5251 raft_consensus.cc:740] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:29.862020  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:29.840365  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:29.858775  5271 raft_consensus.cc:740] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:29.865137  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:29.866482  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:29.850709  5265 raft_consensus.cc:3060] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:29.880411  5271 consensus_queue.cc:260] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:29.867626  5251 consensus_queue.cc:260] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:29.881786  5191 raft_consensus.cc:3055] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:29.871336  3952 raft_consensus.cc:2468] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
W20260709 13:14:29.889763  3997 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.198.193:35339 timed out after 2.140s (SENT) [suppressed 27 similar messages]
I20260709 13:14:29.890949  5191 raft_consensus.cc:740] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:29.904186  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:29.905184  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:29.906070  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:29.908665  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:29.909238  4702 raft_consensus.cc:1240] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:29.886974  5283 raft_consensus.cc:2749] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:29.911892  5100 raft_consensus.cc:3055] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:29.914799  5100 raft_consensus.cc:740] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:29.915782  5100 consensus_queue.cc:260] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:29.917714  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
W20260709 13:14:29.918277  5246 consensus_meta.cc:287] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.605s	user 0.012s	sys 0.000s
I20260709 13:14:29.918741  5246 raft_consensus.cc:515] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:29.919440  4702 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36"
dest_uuid: "d709ee666b774ec29aa732e508219938"
 from {username='slave'} at 127.0.0.1:57680
I20260709 13:14:29.922742  4703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:29.924482  4704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:29.943573  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:29.944734  4108 raft_consensus.cc:2393] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 in current term 2: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:29.954694  5148 raft_consensus.cc:493] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:29.955399  5148 raft_consensus.cc:515] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:29.955868  5210 raft_consensus.cc:493] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
W20260709 13:14:29.957947  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 421130us
I20260709 13:14:29.959172  4071 leader_election.cc:304] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:29.960312  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:29.960943  4030 raft_consensus.cc:3060] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:29.961715  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 125194us
I20260709 13:14:29.962262  4071 leader_election.cc:304] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:29.853724  5269 consensus_queue.cc:260] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:29.966325  4071 leader_election.cc:304] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:29.966559  4074 leader_election.cc:304] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:29.969228  4030 raft_consensus.cc:2468] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 2.
I20260709 13:14:29.970252  3925 leader_election.cc:304] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:29.956632  5275 leader_election.cc:290] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:29.942317  5263 raft_consensus.cc:515] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:29.917659  5244 raft_consensus.cc:515] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:29.975643  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:29.974960  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:29.979274  5274 raft_consensus.cc:2804] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:29.982147  4074 leader_election.cc:304] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:29.979910  5229 raft_consensus.cc:515] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:29.965634  5251 raft_consensus.cc:3060] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:29.970260  5283 raft_consensus.cc:2804] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:29.993875  3957 raft_consensus.cc:2468] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
I20260709 13:14:29.994259  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:29.994345  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:29.995663  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:29.995733  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:29.996316  3954 raft_consensus.cc:2468] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 1.
I20260709 13:14:29.996827  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:29.984956  5274 raft_consensus.cc:493] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:29.997550  5274 raft_consensus.cc:3060] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:29.997645  4705 raft_consensus.cc:2393] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 2: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
I20260709 13:14:30.000023  5263 leader_election.cc:290] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:29.993908  5283 raft_consensus.cc:493] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:30.001086  5283 raft_consensus.cc:3060] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:29.965883  5257 raft_consensus.cc:515] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:29.956418  5191 consensus_queue.cc:260] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:30.004058  5191 raft_consensus.cc:3060] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:29.976938  5248 raft_consensus.cc:2804] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:30.004972  5257 leader_election.cc:290] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:30.005913  5148 leader_election.cc:290] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:29.972712  5271 raft_consensus.cc:3060] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:29.956149  5256 raft_consensus.cc:515] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:29.992981  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:29.993214  5244 leader_election.cc:290] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:29.977011  5260 raft_consensus.cc:2804] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:29.996917  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:30.002264  3959 raft_consensus.cc:2468] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
I20260709 13:14:29.972728  5100 raft_consensus.cc:3060] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:30.009891  5248 raft_consensus.cc:697] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 2 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:30.009002  4071 leader_election.cc:304] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:29.972121  5250 consensus_queue.cc:1059] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:14:29.987926  5259 raft_consensus.cc:2749] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:30.012336  4074 leader_election.cc:304] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:29.964329  5210 raft_consensus.cc:515] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:29.985563  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:30.024302  4074 leader_election.cc:304] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:14:30.026629  4071 leader_election.cc:304] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:30.011870  5275 raft_consensus.cc:2804] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:30.030753  4706 raft_consensus.cc:1240] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:30.015805  4702 raft_consensus.cc:493] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:30.030826  3955 raft_consensus.cc:1240] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:30.014349  5285 consensus_queue.cc:1059] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:14:30.040191  5262 raft_consensus.cc:2804] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:30.040849  5262 raft_consensus.cc:493] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:30.041356  5262 raft_consensus.cc:3060] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:30.046320  4071 leader_election.cc:304] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:30.036935  4074 leader_election.cc:304] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:14:30.013721  5260 raft_consensus.cc:493] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:30.051347  5260 raft_consensus.cc:3060] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:30.030931  5242 raft_consensus.cc:2749] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:30.050632  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:14:30.055516  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:30.027207  5244 raft_consensus.cc:2804] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:30.057336  5231 consensus_queue.cc:1059] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:30.062157  4071 leader_election.cc:304] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:30.063112  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:14:30.065402  3925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:30.039398  5285 raft_consensus.cc:3055] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:30.032128  5275 raft_consensus.cc:493] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:30.061187  4074 leader_election.cc:304] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:14:30.036360  4702 raft_consensus.cc:3060] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:30.017714  4672 leader_election.cc:304] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:30.065308  4071 leader_election.cc:304] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:30.028106  5287 raft_consensus.cc:2804] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:30.031481  5250 consensus_queue.cc:1243] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Peer 6f5b5e4ed72944ecbda200012d141dc2 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:14:30.034592  3952 raft_consensus.cc:2468] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 1.
I20260709 13:14:30.081275  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:30.083523  4074 leader_election.cc:304] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:30.060966  5244 raft_consensus.cc:493] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:30.059093  5263 raft_consensus.cc:2749] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:14:30.104949  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:30.084908  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:14:30.179831  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 171008us
I20260709 13:14:30.324792  5246 leader_election.cc:290] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:30.076419  5275 raft_consensus.cc:3060] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:30.082983  5253 raft_consensus.cc:493] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:30.143628  5204 raft_consensus.cc:3060] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:30.096239  5242 raft_consensus.cc:2749] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:30.400578  5280 raft_consensus.cc:2804] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:30.166255  5248 consensus_queue.cc:237] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:30.124703  5287 raft_consensus.cc:493] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:30.072576  5190 raft_consensus.cc:2749] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:14:30.330472  3998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:30.061491  5143 raft_consensus.cc:2749] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:30.091370  5244 raft_consensus.cc:3060] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:30.068146  5285 raft_consensus.cc:740] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:30.358009  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:30.398528  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:30.482860  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:30.330029  5278 raft_consensus.cc:2749] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:30.329353  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:30.367057  5256 leader_election.cc:290] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:30.369181  3841 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 86669993fba94e65ba192aa115ed6e88 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:30.398350  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:30.401337  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:30.402119  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:30.402280  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:30.501622  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:30.502375  4101 raft_consensus.cc:2468] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
I20260709 13:14:30.411926  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:30.502921  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:30.503300  4107 raft_consensus.cc:2468] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 1.
I20260709 13:14:30.403159  5221 raft_consensus.cc:493] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:30.413797  4672 leader_election.cc:304] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:30.430428  5253 raft_consensus.cc:515] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:30.461854  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:30.405509  5195 raft_consensus.cc:3055] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:14:30.482771  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 417510us
I20260709 13:14:30.515020  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:30.485330  3955 raft_consensus.cc:2468] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
I20260709 13:14:30.495209  4026 raft_consensus.cc:1240] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:30.516414  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:30.477367  5287 raft_consensus.cc:3060] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:14:30.499007  3841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 171327us
I20260709 13:14:30.518430  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:30.519704  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:30.520504  4100 raft_consensus.cc:2393] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 2: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:30.521322  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:30.521862  4100 raft_consensus.cc:3060] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:30.522987  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:30.524227  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:30.523902  5285 consensus_queue.cc:260] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:30.525301  5285 raft_consensus.cc:3060] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:30.525345  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:30.526031  4104 raft_consensus.cc:2468] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 1.
I20260709 13:14:30.526894  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:30.527868  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:30.528055  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:30.528190  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:30.529048  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:30.529261  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:30.529660  4101 raft_consensus.cc:2468] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 1.
I20260709 13:14:30.530494  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:30.532152  4104 raft_consensus.cc:2393] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 2: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:30.533007  4071 leader_election.cc:304] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:30.403002  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:14:30.510560  3925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:30.489398  5229 leader_election.cc:290] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:30.536387  4071 leader_election.cc:304] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:30.512307  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:30.534653  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:30.505563  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:30.483825  4704 raft_consensus.cc:1275] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:14:30.538193  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 450218us
I20260709 13:14:30.537858  4108 raft_consensus.cc:2468] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 1.
I20260709 13:14:30.541805  4071 leader_election.cc:304] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
W20260709 13:14:30.513854  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:30.365108  4073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 269258us
I20260709 13:14:30.484699  5280 raft_consensus.cc:697] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:30.511843  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:14:30.545657  3924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:30.511760  5210 leader_election.cc:290] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:30.546674  4709 raft_consensus.cc:1275] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:30.515575  5195 raft_consensus.cc:740] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:30.552593  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
W20260709 13:14:30.551249  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 179237us
I20260709 13:14:30.554797  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:30.555038  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:30.555806  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:30.556871  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:30.557410  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:30.557435  4031 raft_consensus.cc:3060] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:30.540120  5143 raft_consensus.cc:2749] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:30.539584  5278 raft_consensus.cc:2749] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:30.560375  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:30.560868  4071 leader_election.cc:304] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:30.568392  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:30.569778  5241 consensus_queue.cc:1048] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:30.570191  4705 raft_consensus.cc:1240] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:30.572956  5195 consensus_queue.cc:260] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:30.575449  5253 leader_election.cc:290] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:30.575809  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:30.576453  4107 raft_consensus.cc:2468] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
I20260709 13:14:30.578395  5190 raft_consensus.cc:2749] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:30.515156  5221 raft_consensus.cc:515] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:30.581455  5221 leader_election.cc:290] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:14:30.581769  5274 consensus_meta.cc:287] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.584s	user 0.008s	sys 0.017s
I20260709 13:14:30.582129  3857 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44680 (request call id 116) took 2022 ms. Trace:
I20260709 13:14:30.584708  3959 raft_consensus.cc:2468] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
I20260709 13:14:30.585758  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:30.560050  5259 raft_consensus.cc:2804] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:14:30.588649  5100 consensus_meta.cc:287] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.568s	user 0.014s	sys 0.020s
I20260709 13:14:30.554919  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:30.589336  3956 raft_consensus.cc:2468] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
I20260709 13:14:30.590554  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:30.592345  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:30.552173  5209 raft_consensus.cc:493] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:30.593024  3959 raft_consensus.cc:2376] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2. Re-sending same reply.
I20260709 13:14:30.611517  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:30.631985  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:30.632302  4709 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 2 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
I20260709 13:14:30.615926  4700 raft_consensus.cc:1275] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:14:30.635718  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 51033.9us
W20260709 13:14:30.634549  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 86446.6us
W20260709 13:14:30.638221  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 45158.4us
I20260709 13:14:30.638260  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:30.640707  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:30.571309  5241 consensus_queue.cc:1048] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:14:30.588690  5259 raft_consensus.cc:493] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:30.645434  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:30.650558  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:30.654645  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:30.644024  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:30.582171  5274 raft_consensus.cc:515] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:30.666777  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 116875us
I20260709 13:14:30.668551  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:30.669212  3959 raft_consensus.cc:2376] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2. Re-sending same reply.
W20260709 13:14:30.669358  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 108574us
I20260709 13:14:30.670359  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:30.671928  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:30.672106  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:30.672632  3955 raft_consensus.cc:2468] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 1.
I20260709 13:14:30.672540  4071 leader_election.cc:304] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:30.637543  3954 raft_consensus.cc:2468] T 86669993fba94e65ba192aa115ed6e88 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 1.
I20260709 13:14:30.637630  5209 raft_consensus.cc:515] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:30.680140  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:30.671066  3997 leader_election.cc:304] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:14:30.675644  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:30.636309  5275 raft_consensus.cc:515] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:30.657761  5259 raft_consensus.cc:3060] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:14:30.664865  5265 consensus_meta.cc:287] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.777s	user 0.005s	sys 0.013s
W20260709 13:14:30.670118  5260 consensus_meta.cc:287] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.615s	user 0.008s	sys 0.004s
I20260709 13:14:30.682089  3997 leader_election.cc:304] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:30.698801  4099 raft_consensus.cc:2393] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 2: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:30.638674  5100 consensus_queue.cc:1059] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
W20260709 13:14:30.675182  5283 consensus_meta.cc:287] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.669s	user 0.014s	sys 0.005s
W20260709 13:14:30.681092  4702 consensus_meta.cc:287] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938: Time spent flushing consensus metadata: real 0.592s	user 0.008s	sys 0.008s
I20260709 13:14:30.699798  4031 raft_consensus.cc:2468] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 2.
I20260709 13:14:30.701372  3997 leader_election.cc:304] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
W20260709 13:14:30.696133  5191 consensus_meta.cc:287] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.685s	user 0.006s	sys 0.012s
I20260709 13:14:30.685559  3922 leader_election.cc:304] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
W20260709 13:14:30.703979  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 138686us
I20260709 13:14:30.689626  5237 raft_consensus.cc:2804] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:30.702867  3955 raft_consensus.cc:2468] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 1.
I20260709 13:14:30.705224  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:30.582552  3857 rpcz_store.cc:276] 0709 13:14:28.559916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:28.560261 (+   345us) service_pool.cc:224] Handling call
0709 13:14:30.582067 (+2021806us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:29.239062 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:29.266013 (+ 26951us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:29.266064 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:14:29.266099 (+    35us) tablet.cc:662] Decoding operations
0709 13:14:29.266529 (+   430us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:29.266632 (+   103us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:29.266676 (+    44us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:14:29.267003 (+   327us) tablet.cc:701] Row locks acquired
0709 13:14:29.267051 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:14:29.267247 (+   196us) write_op.cc:270] Start()
0709 13:14:29.267407 (+   160us) write_op.cc:276] Timestamp: P: 1783602869267177 usec, L: 0
0709 13:14:29.267445 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:14:29.268264 (+   819us) log.cc:844] Serialized 598 byte log entry
0709 13:14:29.859054 (+590790us) op_driver.cc:464] REPLICATION: finished
0709 13:14:29.974697 (+115643us) write_op.cc:301] APPLY: starting
0709 13:14:29.976502 (+  1805us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:29.976658 (+   156us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:29.985007 (+  8349us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:30.004666 (+ 19659us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:30.004994 (+   328us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:14:30.005077 (+    83us) write_op.cc:312] APPLY: finished
0709 13:14:30.005448 (+   371us) log.cc:844] Serialized 22 byte log entry
0709 13:14:30.005703 (+   255us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:30.005820 (+   117us) write_op.cc:454] Released schema lock
0709 13:14:30.005910 (+    90us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:30.006414 (+   504us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:30.006447 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":12425,"reported_tablets":3,"spinlock_wait_cycles":27264,"child_traces":[["op",{"apply.queue_time_us":113448,"apply.run_cpu_time_us":2754,"apply.run_wall_time_us":31738,"num_ops":1,"prepare.queue_time_us":10399,"prepare.run_cpu_time_us":54390,"prepare.run_wall_time_us":138201,"raft.queue_time_us":415308,"raft.run_cpu_time_us":4742,"raft.run_wall_time_us":133712,"replication_time_us":564470,"thread_start_us":490516,"threads_started":4,"wal-append.queue_time_us":104144}]]}
I20260709 13:14:30.707513  3950 raft_consensus.cc:2468] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
W20260709 13:14:30.703961  5271 consensus_meta.cc:287] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.697s	user 0.017s	sys 0.001s
I20260709 13:14:30.696797  4706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57680 (request call id 354) took 1046 ms. Trace:
I20260709 13:14:30.722463  4107 raft_consensus.cc:2468] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 1.
I20260709 13:14:30.724481  4672 leader_election.cc:304] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:30.723245  3997 leader_election.cc:304] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:30.729271  3997 leader_election.cc:304] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:30.730786  3997 leader_election.cc:304] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:30.704300  5291 raft_consensus.cc:2804] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:30.733168  4672 leader_election.cc:304] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:30.717738  5296 raft_consensus.cc:2749] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:30.700501  5260 raft_consensus.cc:515] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:30.707255  5301 raft_consensus.cc:2804] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:30.743779  4672 leader_election.cc:304] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:30.723464  5237 raft_consensus.cc:493] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:14:30.770749  4672 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:30.756265  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:30.755101  4071 leader_election.cc:304] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
W20260709 13:14:30.758620  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:30.726842  5248 raft_consensus.cc:2749] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:30.691769  5292 consensus_queue.cc:1048] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:14:30.748045  4102 raft_consensus.cc:2393] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 2: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:30.768752  4100 raft_consensus.cc:2468] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
I20260709 13:14:30.802014  4672 leader_election.cc:304] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:30.707769  5283 raft_consensus.cc:515] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:30.718271  4702 raft_consensus.cc:515] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:30.779544  4071 leader_election.cc:304] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:30.740816  5291 raft_consensus.cc:493] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
W20260709 13:14:30.797309  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 88136.3us
I20260709 13:14:30.744135  5229 raft_consensus.cc:2749] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:30.741806  5297 raft_consensus.cc:2804] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:30.751313  5241 raft_consensus.cc:2804] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:30.669361  5280 consensus_queue.cc:237] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:30.739233  5243 raft_consensus.cc:2804] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:30.748508  5278 raft_consensus.cc:2749] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:30.731761  3951 raft_consensus.cc:2468] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
I20260709 13:14:30.778578  4107 raft_consensus.cc:2393] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 in current term 2: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:30.761469  5301 raft_consensus.cc:493] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:30.780977  5238 raft_consensus.cc:2749] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:30.777930  5237 raft_consensus.cc:3060] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:14:30.801607  5262 consensus_meta.cc:287] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.760s	user 0.014s	sys 0.005s
I20260709 13:14:30.812978  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:30.799273  5256 raft_consensus.cc:2804] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:30.822248  4071 leader_election.cc:304] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:30.826498  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:30.807011  5257 raft_consensus.cc:2749] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:30.851697  5262 raft_consensus.cc:515] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:30.833488  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:30.860949  5275 leader_election.cc:290] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:30.863866  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:30.865172  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:30.727258  4706 rpcz_store.cc:276] 0709 13:14:29.644200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:29.645461 (+  1261us) service_pool.cc:224] Handling call
0709 13:14:29.652221 (+  6760us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:30.036276 (+384055us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:30.669001 (+632725us) spinlock_profiling.cc:243] Waited 374 ms on lock 0x7b5400580f54. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:14:30.690636 (+ 21635us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":859469696}
I20260709 13:14:30.819926  5297 raft_consensus.cc:493] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:30.845767  5274 leader_election.cc:290] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:30.845388  4704 raft_consensus.cc:1240] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 1. Current term is 3. Ops: []
I20260709 13:14:30.853421  5256 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:30.852890  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:30.846035  4107 raft_consensus.cc:1240] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:30.808082  5291 raft_consensus.cc:3060] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:30.821120  5241 raft_consensus.cc:493] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:30.831861  5301 raft_consensus.cc:3060] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:30.855860  4108 raft_consensus.cc:2393] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 in current term 2: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:30.846812  5283 leader_election.cc:290] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:30.826332  5243 raft_consensus.cc:493] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:30.836226  4672 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
W20260709 13:14:30.914842  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 78677.7us
I20260709 13:14:30.870721  5297 raft_consensus.cc:3060] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:30.872545  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:30.834309  5269 raft_consensus.cc:3060] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:30.871889  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 49751.3us
I20260709 13:14:30.879833  5190 raft_consensus.cc:2749] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:14:30.866390  5251 consensus_meta.cc:287] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.859s	user 0.006s	sys 0.006s
I20260709 13:14:30.902699  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:30.823590  5287 raft_consensus.cc:515] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:30.915462  3950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38612 (request call id 728) took 1110 ms. Trace:
I20260709 13:14:30.932595  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:30.829607  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:30.902592  5300 raft_consensus.cc:2749] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:30.906426  5256 raft_consensus.cc:3060] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:30.906637  5241 raft_consensus.cc:3060] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:30.919739  4108 raft_consensus.cc:1240] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 1. Current term is 2. Ops: []
W20260709 13:14:30.924664  3998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:30.905773  5204 raft_consensus.cc:2749] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:30.863888  5259 raft_consensus.cc:515] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:30.931747  4100 raft_consensus.cc:2393] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 in current term 2: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:30.916558  4672 leader_election.cc:304] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:30.917243  5243 raft_consensus.cc:3060] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:30.933089  3950 rpcz_store.cc:276] 0709 13:14:29.801493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:29.801842 (+   349us) service_pool.cc:224] Handling call
0709 13:14:30.910511 (+1108669us) spinlock_profiling.cc:243] Waited 900 ms on lock 0x7b5400188dd4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:14:30.910632 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2069710336}
I20260709 13:14:30.951622  4672 leader_election.cc:304] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:30.935415  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:30.917557  5263 raft_consensus.cc:2804] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:30.918545  5257 raft_consensus.cc:2749] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:14:30.954293  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:30.960935  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:30.974182  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:30.937863  5262 leader_election.cc:290] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:30.981436  5310 raft_consensus.cc:493] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:30.982021  5310 raft_consensus.cc:515] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:14:30.984045  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 161957us
I20260709 13:14:30.990064  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:30.995754  4074 leader_election.cc:304] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:30.957439  5263 raft_consensus.cc:493] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:30.992769  3956 raft_consensus.cc:2468] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 2.
I20260709 13:14:30.975644  5278 raft_consensus.cc:2749] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:30.978569  5229 raft_consensus.cc:2749] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:31.010854  5300 raft_consensus.cc:2804] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:31.016620  3953 raft_consensus.cc:2468] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
I20260709 13:14:31.017198  5287 leader_election.cc:290] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:31.017987  5313 consensus_queue.cc:1048] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:31.018589  4705 raft_consensus.cc:1240] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:31.022360  5209 leader_election.cc:290] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:31.025031  4672 leader_election.cc:304] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
W20260709 13:14:31.026225  5244 consensus_meta.cc:287] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.526s	user 0.005s	sys 0.003s
I20260709 13:14:31.026624  5244 raft_consensus.cc:515] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:31.027765  4106 raft_consensus.cc:2393] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 2: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:31.028240  5265 raft_consensus.cc:3055] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:31.028682  5265 raft_consensus.cc:740] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:31.028987  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:31.029480  5265 consensus_queue.cc:260] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:14:31.030652  3952 consensus_meta.cc:287] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.516s	user 0.005s	sys 0.005s
W20260709 13:14:31.030716  5285 consensus_meta.cc:287] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.505s	user 0.001s	sys 0.012s
I20260709 13:14:31.031167  3952 raft_consensus.cc:2468] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
I20260709 13:14:31.038410  4071 leader_election.cc:304] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:31.031764  5265 raft_consensus.cc:3060] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:31.046463  3957 raft_consensus.cc:2468] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
I20260709 13:14:31.031453  4104 raft_consensus.cc:2468] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
I20260709 13:14:31.033402  5244 leader_election.cc:290] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:31.042069  4101 raft_consensus.cc:2468] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
I20260709 13:14:30.988440  5260 leader_election.cc:290] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:31.050774  5259 leader_election.cc:290] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:31.009291  5263 raft_consensus.cc:3060] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:31.058187  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:31.057801  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:30.990761  5204 consensus_queue.cc:1059] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:14:31.046725  5229 raft_consensus.cc:2749] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:31.067415  3956 raft_consensus.cc:2393] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 in current term 2: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:14:31.068965  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:14:31.080188  3925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:31.089437  4709 raft_consensus.cc:1240] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:31.061165  5271 raft_consensus.cc:493] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:31.070469  4071 leader_election.cc:304] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:31.042732  5270 consensus_queue.cc:1059] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:14:31.096432  5204 raft_consensus.cc:3055] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:31.097084  5248 consensus_queue.cc:1059] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:31.104943  5304 raft_consensus.cc:2749] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:31.108062  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:31.108868  5195 raft_consensus.cc:3060] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:31.069291  5300 raft_consensus.cc:697] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:31.100910  5314 raft_consensus.cc:2749] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:31.104413  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:31.111209  5204 raft_consensus.cc:740] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:31.126699  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:31.134382  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:31.136297  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:31.122754  5251 raft_consensus.cc:493] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:31.137110  3953 raft_consensus.cc:3060] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:31.137669  5251 raft_consensus.cc:515] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:31.111827  5271 raft_consensus.cc:515] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:31.152078  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:31.152757  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:31.153510  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:31.153828  5271 leader_election.cc:290] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:31.154740  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:31.156388  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:31.156973  3950 raft_consensus.cc:3060] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:31.152256  3955 raft_consensus.cc:3060] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:31.158257  4071 leader_election.cc:304] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
W20260709 13:14:31.159904  3924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:31.160027  4073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 358280us
I20260709 13:14:31.163470  4672 leader_election.cc:304] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:31.165937  5238 raft_consensus.cc:2749] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:31.170019  4672 leader_election.cc:304] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:31.153937  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:31.171975  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:31.117345  4100 raft_consensus.cc:1240] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:31.065464  5268 raft_consensus.cc:493] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:31.155405  3951 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 3.
I20260709 13:14:31.175730  5268 raft_consensus.cc:515] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:31.183609  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:31.184551  3953 raft_consensus.cc:2468] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 2.
I20260709 13:14:31.173213  5304 raft_consensus.cc:2749] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:31.195698  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:31.174178  4702 leader_election.cc:290] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:31.179728  5238 raft_consensus.cc:2749] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:31.151041  5291 raft_consensus.cc:515] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:31.180963  5237 raft_consensus.cc:515] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:31.208072  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:14:31.218750  3999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 259940us
I20260709 13:14:31.219492  3955 raft_consensus.cc:2468] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 2.
I20260709 13:14:31.221834  4071 leader_election.cc:304] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:31.228003  4071 leader_election.cc:304] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:31.202180  5300 consensus_queue.cc:237] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:31.175745  5204 consensus_queue.cc:260] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:31.231825  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:31.232903  3956 raft_consensus.cc:2468] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 2.
W20260709 13:14:31.217506  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 278235us
W20260709 13:14:31.235046  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 143348us
I20260709 13:14:31.243759  4025 raft_consensus.cc:1275] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:31.254333  4031 raft_consensus.cc:1240] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:31.229851  5251 leader_election.cc:290] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:31.255717  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:31.229470  4702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:57680 (request call id 359) took 1303 ms. Trace:
W20260709 13:14:31.255640  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:31.259884  4030 raft_consensus.cc:1240] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:31.232071  5299 raft_consensus.cc:2804] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:31.253515  5283 raft_consensus.cc:2749] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:31.262039  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:31.279520  3958 raft_consensus.cc:2468] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
I20260709 13:14:31.267494  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:31.282307  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:31.269423  5299 raft_consensus.cc:697] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:31.270908  5204 raft_consensus.cc:3060] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:31.297226  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:31.298853  4103 raft_consensus.cc:1240] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:31.301347  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:31.302003  4030 raft_consensus.cc:3060] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:31.303453  3950 raft_consensus.cc:2468] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:31.271301  5256 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:31.305397  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:31.306495  5268 leader_election.cc:290] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:31.306994  5256 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:31.279630  5243 raft_consensus.cc:515] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:31.309271  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:31.356773  4708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:31.310545  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:31.281517  5210 raft_consensus.cc:493] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.269249  5301 raft_consensus.cc:515] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:31.312361  5237 leader_election.cc:290] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 election: Requested vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:31.314517  5299 consensus_queue.cc:237] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:31.350826  4071 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:31.360507  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:31.361099  4071 leader_election.cc:304] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:31.309623  5291 leader_election.cc:290] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:31.362044  4708 raft_consensus.cc:1240] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:31.358700  4030 raft_consensus.cc:2468] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 2.
I20260709 13:14:31.365723  4102 raft_consensus.cc:2393] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 2: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:31.371872  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:31.374787  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:31.363519  5283 raft_consensus.cc:2749] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:31.348148  5297 raft_consensus.cc:515] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:31.372871  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:31.376267  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:31.377022  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:31.378609  5243 leader_election.cc:290] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:31.383165  5301 leader_election.cc:290] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:31.383703  4108 raft_consensus.cc:1240] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:31.260711  4702 rpcz_store.cc:276] 0709 13:14:29.912933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:29.919279 (+  6346us) service_pool.cc:224] Handling call
0709 13:14:31.149388 (+1230109us) spinlock_profiling.cc:243] Waited 95.7 ms on lock 0x7b5400693f54. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f1525665a3d 00007f152a635cd0 00007f1523bba254 00007f1523bba1e2 00007f1523bba111 00007f1523bba08c 00007f1523bb9342 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:14:31.213985 (+ 64597us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":220153216}
I20260709 13:14:31.374389  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:31.367074  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:31.369043  3997 leader_election.cc:304] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:31.367947  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:31.370165  5241 raft_consensus.cc:515] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:31.432253  4102 raft_consensus.cc:2393] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 3: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:31.432404  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:31.433317  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:31.433696  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:31.433948  4102 raft_consensus.cc:3060] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:31.434079  5241 leader_election.cc:290] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:31.434886  5241 raft_consensus.cc:2749] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:31.436652  3957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38612 (request call id 749) took 1455 ms. Trace:
I20260709 13:14:31.438860  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:31.440483  4032 raft_consensus.cc:1240] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:31.311468  5263 raft_consensus.cc:515] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:31.374347  5210 raft_consensus.cc:515] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:31.366067  5287 raft_consensus.cc:2804] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:31.365868  4701 raft_consensus.cc:1240] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:31.399868  5310 leader_election.cc:290] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:14:31.408658  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:31.371829  4705 raft_consensus.cc:1275] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:14:31.431695  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 62750.3us
I20260709 13:14:31.466216  3997 leader_election.cc:304] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:31.467707  3997 leader_election.cc:304] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:31.407780  5209 raft_consensus.cc:3055] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:31.442246  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:31.456410  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:31.434881  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:31.444909  3959 raft_consensus.cc:1275] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:31.456936  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:31.476500  4101 raft_consensus.cc:2393] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 3: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:31.460464  5210 leader_election.cc:290] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:31.460852  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:31.469774  4104 raft_consensus.cc:1240] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:31.481812  4104 raft_consensus.cc:1240] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 LEADER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:31.437232  3957 rpcz_store.cc:276] 0709 13:14:29.981436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:29.996547 (+ 15111us) service_pool.cc:224] Handling call
0709 13:14:31.436394 (+1439847us) spinlock_profiling.cc:243] Waited 925 ms on lock 0x7b5400384354. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:14:31.436566 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2127062912}
I20260709 13:14:31.397938  5268 consensus_queue.cc:1059] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:14:31.471184  3997 leader_election.cc:304] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:31.488068  3997 leader_election.cc:304] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:31.486161  4104 raft_consensus.cc:1240] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:31.468219  5287 raft_consensus.cc:697] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:31.491979  5195 raft_consensus.cc:2749] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:31.492838  5195 raft_consensus.cc:2749] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:31.493530  3957 raft_consensus.cc:1275] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:31.493119  5287 consensus_queue.cc:237] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:31.493698  3958 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38612 (request call id 715) took 1845 ms (client timeout 1912 ms). Trace:
I20260709 13:14:31.494269  3997 leader_election.cc:304] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
W20260709 13:14:31.494196  3958 rpcz_store.cc:269] 0709 13:14:29.648272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:29.908396 (+260124us) service_pool.cc:224] Handling call
0709 13:14:31.493499 (+1585103us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54003ef654. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:14:31.493626 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3151051520}
I20260709 13:14:31.478695  5232 raft_consensus.cc:2749] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:31.496023  3954 raft_consensus.cc:1275] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:31.473940  5209 raft_consensus.cc:740] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:31.497234  5209 consensus_queue.cc:260] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:31.498456  5209 raft_consensus.cc:3060] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:31.500546  5291 consensus_queue.cc:1048] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:31.501981  4100 raft_consensus.cc:1240] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:31.502369  3952 raft_consensus.cc:3060] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:31.509476  3925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:31.480661  5241 raft_consensus.cc:2749] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:31.495572  5296 raft_consensus.cc:2749] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:31.515220  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:31.521271  3956 raft_consensus.cc:3060] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:31.517292  4071 leader_election.cc:304] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:31.526065  4106 raft_consensus.cc:2468] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 2.
I20260709 13:14:31.534703  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:31.497236  5305 raft_consensus.cc:993] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc: : Instructing follower 6f5b5e4ed72944ecbda200012d141dc2 to start an election
W20260709 13:14:31.546245  3925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:31.553254  4108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45336 (request call id 813) took 1040 ms. Trace:
I20260709 13:14:31.503371  4100 raft_consensus.cc:1240] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:31.554713  4108 rpcz_store.cc:276] 0709 13:14:30.501749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:30.973684 (+471935us) service_pool.cc:224] Handling call
0709 13:14:31.005502 (+ 31818us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:31.429922 (+424420us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:31.541637 (+111715us) spinlock_profiling.cc:243] Waited 378 ms on lock 0x7b540042efd4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:14:31.541909 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":869309184}
I20260709 13:14:31.548249  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:31.571149  5305 raft_consensus.cc:1081] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Signalling peer 6f5b5e4ed72944ecbda200012d141dc2 to start an election
I20260709 13:14:31.592377  4105 raft_consensus.cc:2393] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 2: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:31.603513  4672 leader_election.cc:304] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:31.618970  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
W20260709 13:14:31.619374  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 122363us
I20260709 13:14:31.620402  3997 leader_election.cc:304] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:31.625653  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:31.626492  3922 leader_election.cc:304] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:14:31.627815  3922 leader_election.cc:304] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:31.631105  3956 raft_consensus.cc:2468] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 2.
I20260709 13:14:31.632427  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:31.633181  3956 raft_consensus.cc:3060] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:31.639739  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:31.644773  3997 leader_election.cc:304] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:31.587685  5304 raft_consensus.cc:2749] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:31.649528  3997 leader_election.cc:304] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:31.651908  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:31.652566  3957 raft_consensus.cc:3055] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:31.653494  3957 raft_consensus.cc:740] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:31.654042  3922 leader_election.cc:304] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:31.618739  5229 raft_consensus.cc:2749] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:31.656852  3997 leader_election.cc:304] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:31.649734  5291 raft_consensus.cc:2749] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:31.658517  5297 leader_election.cc:290] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:31.661368  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:31.662878  4031 raft_consensus.cc:1240] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:31.666107  3956 raft_consensus.cc:2468] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 2.
I20260709 13:14:31.668883  4074 leader_election.cc:304] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:31.669313  3922 leader_election.cc:304] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:31.646028  5268 raft_consensus.cc:2749] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:31.648568  5210 raft_consensus.cc:2749] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:31.674508  4074 leader_election.cc:304] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
W20260709 13:14:31.674575  3998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:31.664961  3957 consensus_queue.cc:260] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:31.649585  5241 raft_consensus.cc:2804] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:31.679706  4031 raft_consensus.cc:1240] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:31.682252  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:31.682695  4025 raft_consensus.cc:1240] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:31.678665  4074 leader_election.cc:304] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:31.683604  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:31.684096  4033 raft_consensus.cc:1240] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:31.685127  3957 raft_consensus.cc:3060] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:14:31.664083  5232 raft_consensus.cc:2804] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:31.674607  5246 raft_consensus.cc:2749] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:31.705199  5232 raft_consensus.cc:493] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:31.688452  5253 consensus_queue.cc:1048] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:31.705727  5232 raft_consensus.cc:3060] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:31.706769  3958 raft_consensus.cc:1240] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 2 LEADER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:31.706884  4108 raft_consensus.cc:1240] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:31.680924  5315 raft_consensus.cc:2749] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:31.693989  4102 raft_consensus.cc:2468] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 3.
I20260709 13:14:31.640209  5283 consensus_queue.cc:1059] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:14:31.708451  4101 raft_consensus.cc:1240] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 1. Current term is 3. Ops: []
I20260709 13:14:31.709012  5283 raft_consensus.cc:3055] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:31.709416  5283 raft_consensus.cc:740] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:31.709746  3958 raft_consensus.cc:1275] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:14:31.710073  4101 raft_consensus.cc:1240] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:31.710417  5283 consensus_queue.cc:260] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:31.712481  4103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45336 (request call id 797) took 1233 ms. Trace:
I20260709 13:14:31.699443  3952 raft_consensus.cc:2468] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 2.
I20260709 13:14:31.713029  4103 rpcz_store.cc:276] 0709 13:14:30.478948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:30.479168 (+   220us) service_pool.cc:224] Handling call
0709 13:14:30.503837 (+ 24669us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:31.299320 (+795483us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:31.712220 (+412900us) spinlock_profiling.cc:243] Waited 768 ms on lock 0x7b540003af54. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:14:31.712397 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1765389056}
I20260709 13:14:31.713589  4074 leader_election.cc:304] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:31.714437  5246 raft_consensus.cc:2749] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:31.714879  4074 leader_election.cc:304] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:31.715648  5246 raft_consensus.cc:2749] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:31.716120  4074 leader_election.cc:304] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:31.716902  5246 raft_consensus.cc:2749] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:31.707460  5294 raft_consensus.cc:3055] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:31.719933  5294 raft_consensus.cc:740] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:31.720592  4104 raft_consensus.cc:1275] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:31.720801  5294 consensus_queue.cc:260] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:31.683264  5241 raft_consensus.cc:493] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:31.722311  5294 raft_consensus.cc:3060] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:31.722729  5241 raft_consensus.cc:3060] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:31.685375  5297 raft_consensus.cc:3060] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:31.729396  3856 catalog_manager.cc:5697] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: config changed from index 3 to 4, VOTER f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) evicted. New cstate: current_term: 1 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:31.704190  4100 raft_consensus.cc:1240] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:31.704418  3959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38612 (request call id 778) took 1068 ms. Trace:
I20260709 13:14:31.674737  5271 raft_consensus.cc:2749] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:31.712558  4099 raft_consensus.cc:1240] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:31.732805  3959 rpcz_store.cc:276] 0709 13:14:30.647903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:30.688441 (+ 40538us) service_pool.cc:224] Handling call
0709 13:14:31.441590 (+753149us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:31.475521 (+ 33931us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:31.704196 (+228675us) spinlock_profiling.cc:243] Waited 753 ms on lock 0x7b5400384350. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566d8ad 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:14:31.704331 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1731140480}
I20260709 13:14:31.734047  5314 raft_consensus.cc:2804] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:31.734642  5314 raft_consensus.cc:697] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:31.734889  4099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45336 (request call id 810) took 1234 ms. Trace:
I20260709 13:14:31.735339  4099 rpcz_store.cc:276] 0709 13:14:30.500393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:30.850212 (+349819us) service_pool.cc:224] Handling call
0709 13:14:31.712375 (+862163us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:31.733358 (+ 20983us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:31.734692 (+  1334us) spinlock_profiling.cc:243] Waited 862 ms on lock 0x7b540003af50. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566d8ad 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:14:31.734829 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1982092544}
I20260709 13:14:31.735630  5314 consensus_queue.cc:237] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:31.740597  5297 raft_consensus.cc:2749] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:31.740815  5263 leader_election.cc:290] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:31.741654  4026 raft_consensus.cc:1240] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 1. Current term is 2. Ops: []
W20260709 13:14:31.699376  4073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:31.730933  3856 catalog_manager.cc:5697] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 1 to 2, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 2 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:31.745594  4672 leader_election.cc:304] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
W20260709 13:14:31.746748  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 77532.4us
I20260709 13:14:31.744592  3856 catalog_manager.cc:5697] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 1 to 2, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 2 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:31.747490  3922 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:14:31.750070  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:31.752306  4031 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a08c9f959924154b694899e3a318181"
dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:38290
I20260709 13:14:31.752899  4031 raft_consensus.cc:493] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 13:14:31.752956  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 72322.9us
I20260709 13:14:31.753432  4031 raft_consensus.cc:3060] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:31.754801  3997 leader_election.cc:304] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:31.756479  3957 raft_consensus.cc:2468] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 3.
I20260709 13:14:31.761754  4675 leader_election.cc:304] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:31.763938  5310 raft_consensus.cc:2804] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:14:31.764585  5191 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:14:31.765779  5269 consensus_queue.cc:1059] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:31.766935  5269 raft_consensus.cc:2749] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:31.767614  5269 raft_consensus.cc:3055] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:31.767985  5269 raft_consensus.cc:740] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:31.768864  5269 consensus_queue.cc:260] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:31.770047  5269 raft_consensus.cc:3060] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:31.774590  4031 raft_consensus.cc:515] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:31.777769  3924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:31.781738  3997 leader_election.cc:304] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:31.748978  3856 catalog_manager.cc:5697] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 1 to 2, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 2 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:31.784260  3856 catalog_manager.cc:5697] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 1 to 2, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 2 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:31.785497  3997 leader_election.cc:304] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:31.786696  4027 raft_consensus.cc:1275] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:31.790524  4071 leader_election.cc:304] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:31.791615  3997 leader_election.cc:304] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:31.789041  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:31.792479  4031 leader_election.cc:290] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:31.794843  3997 leader_election.cc:304] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:14:31.796938  3997 leader_election.cc:304] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:14:31.759637  5231 raft_consensus.cc:2749] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:31.797327  4705 raft_consensus.cc:3060] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 2 LEARNER]: Advancing to term 3
W20260709 13:14:31.808574  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 45191.9us
W20260709 13:14:31.807891  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 60459.7us
I20260709 13:14:31.776666  5238 raft_consensus.cc:2749] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:31.810635  3922 leader_election.cc:304] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:31.787222  5307 raft_consensus.cc:2749] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:31.793926  5283 raft_consensus.cc:3060] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:31.835848  3997 leader_election.cc:304] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:31.779922  5310 raft_consensus.cc:697] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 3 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:14:31.794188  5297 raft_consensus.cc:2804] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:14:31.854019  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 43555.4us
I20260709 13:14:31.859103  3922 leader_election.cc:304] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:31.860641  3922 leader_election.cc:304] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:31.776063  5100 consensus_queue.cc:1059] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:14:31.855639  3925 leader_election.cc:304] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:14:31.862076  5268 raft_consensus.cc:3060] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:31.867820  5270 raft_consensus.cc:2749] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:31.869518  5100 raft_consensus.cc:3055] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:31.870000  5100 raft_consensus.cc:740] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:31.874509  5253 raft_consensus.cc:2749] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:31.875737  5248 consensus_queue.cc:1059] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:31.877147  5248 consensus_queue.cc:1059] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:31.877570  5322 raft_consensus.cc:3055] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:31.878238  5322 raft_consensus.cc:740] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:31.878384  5248 raft_consensus.cc:3055] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:31.878927  5248 raft_consensus.cc:740] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:31.879529  5322 consensus_queue.cc:260] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:31.875455  5253 consensus_queue.cc:1059] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:14:31.881282  5253 raft_consensus.cc:3055] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:31.881889  5253 raft_consensus.cc:740] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:31.871150  5100 consensus_queue.cc:260] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:31.884085  5100 raft_consensus.cc:3060] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:31.888618  3922 leader_election.cc:304] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:31.890026  5270 raft_consensus.cc:2749] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:31.895617  5248 consensus_queue.cc:260] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:31.897442  5248 raft_consensus.cc:3060] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:31.782543  5229 consensus_queue.cc:1059] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:14:31.797636  5296 raft_consensus.cc:2804] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:31.802111  5195 raft_consensus.cc:2804] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:31.881345  5322 raft_consensus.cc:3060] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:31.831800  5242 raft_consensus.cc:2804] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:31.843700  5221 raft_consensus.cc:2804] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:31.832207  5250 raft_consensus.cc:2749] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:31.917052  5307 raft_consensus.cc:2804] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:14:31.921892  3999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 86152.4us
I20260709 13:14:31.908396  5294 raft_consensus.cc:2749] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:31.857739  5297 raft_consensus.cc:493] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:31.856225  3954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38612 (request call id 779) took 1173 ms. Trace:
I20260709 13:14:31.819855  5246 consensus_queue.cc:1048] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.095s
I20260709 13:14:31.926470  3922 leader_election.cc:304] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:31.914080  5296 raft_consensus.cc:493] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:31.918550  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:14:31.941787  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 139747us
I20260709 13:14:31.944620  3922 leader_election.cc:304] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:31.923664  5195 raft_consensus.cc:697] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:31.946352  3957 raft_consensus.cc:1240] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:31.852933  5323 consensus_queue.cc:1059] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.085s
I20260709 13:14:31.932214  5307 raft_consensus.cc:493] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:31.942655  5297 raft_consensus.cc:3060] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:31.908324  5293 consensus_queue.cc:1059] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:14:31.940083  5242 raft_consensus.cc:697] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:31.947579  5296 raft_consensus.cc:3060] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:31.962911  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 127291us
I20260709 13:14:31.958209  3922 leader_election.cc:304] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:31.945933  5270 raft_consensus.cc:2749] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:31.964818  4071 leader_election.cc:304] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:31.968118  5195 consensus_queue.cc:237] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:31.969549  4071 leader_election.cc:304] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:31.952312  3953 raft_consensus.cc:3060] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:31.972915  5238 raft_consensus.cc:3055] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:31.973354  5238 raft_consensus.cc:740] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:14:31.974356  5238 consensus_queue.cc:260] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:31.975829  5287 raft_consensus.cc:2804] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:31.976126  5293 raft_consensus.cc:3055] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:31.976406  5287 raft_consensus.cc:697] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:31.976534  5293 raft_consensus.cc:740] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:31.977387  5287 consensus_queue.cc:237] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:31.979372  5304 raft_consensus.cc:2804] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:31.952564  5250 raft_consensus.cc:3060] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:31.983486  4026 raft_consensus.cc:3055] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:31.983858  4026 raft_consensus.cc:740] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:31.966135  5280 consensus_queue.cc:1048] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:31.961915  5307 raft_consensus.cc:3060] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:31.995921  4027 raft_consensus.cc:3055] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:31.997181  4026 consensus_queue.cc:260] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:32.011984  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:32.029421  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 64463us
W20260709 13:14:32.046460  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:32.027377  5221 raft_consensus.cc:697] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
W20260709 13:14:32.035048  4672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:32.044775  4026 raft_consensus.cc:3060] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:32.046964  4027 raft_consensus.cc:740] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:31.940855  3954 rpcz_store.cc:276] 0709 13:14:30.658920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:30.702431 (+ 43511us) service_pool.cc:224] Handling call
0709 13:14:31.495654 (+793223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:31.496427 (+   773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:31.794977 (+298550us) spinlock_profiling.cc:243] Waited 769 ms on lock 0x7b54003ef650. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566d8ad 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:14:31.831734 (+ 36757us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1768664832}
I20260709 13:14:32.027645  5191 raft_consensus.cc:2749] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:14:32.096436  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 111768us
I20260709 13:14:32.081048  3997 leader_election.cc:304] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
W20260709 13:14:32.096490  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 46161.3us
I20260709 13:14:32.105718  3922 leader_election.cc:304] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:32.106755  5209 raft_consensus.cc:2749] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:32.108552  3922 leader_election.cc:304] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:32.110271  4108 raft_consensus.cc:1240] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:32.113595  4106 raft_consensus.cc:1240] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:32.115135  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:32.110044  4100 raft_consensus.cc:1240] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 LEADER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:32.116145  4101 raft_consensus.cc:1240] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:32.116402  5221 consensus_queue.cc:237] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:14:32.117406  5334 log.cc:927] Time spent T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:14:32.118041  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
W20260709 13:14:32.121477  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 137027us
I20260709 13:14:32.061961  5241 raft_consensus.cc:515] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:32.133549  4099 raft_consensus.cc:1240] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:32.049007  5238 raft_consensus.cc:3060] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:32.120404  4027 consensus_queue.cc:260] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:32.137653  4026 raft_consensus.cc:1275] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:32.139021  4027 raft_consensus.cc:3060] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:32.139182  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:32.141602  4103 raft_consensus.cc:3055] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:31.963285  5310 consensus_queue.cc:237] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:32.041378  5323 consensus_queue.cc:1059] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.093s
W20260709 13:14:32.142750  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 66075us
I20260709 13:14:32.141975  4103 raft_consensus.cc:740] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:32.146991  4030 raft_consensus.cc:1240] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:32.147312  4103 consensus_queue.cc:260] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:32.141866  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:32.148710  5241 leader_election.cc:290] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:32.049080  5291 consensus_queue.cc:1048] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.088s
I20260709 13:14:31.967434  5242 consensus_queue.cc:237] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:32.134649  5294 raft_consensus.cc:2749] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:32.154392  3997 leader_election.cc:304] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:32.136556  4105 raft_consensus.cc:1240] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:32.138756  5195 raft_consensus.cc:2804] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:31.977411  5293 consensus_queue.cc:260] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:32.141791  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:32.144315  5253 consensus_queue.cc:260] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:32.141731  5271 consensus_queue.cc:1059] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:14:32.165058  5316 raft_consensus.cc:2804] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:32.184190  4672 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:32.187433  5265 raft_consensus.cc:493] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:32.188107  5265 raft_consensus.cc:515] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:32.190284  5265 leader_election.cc:290] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:32.192044  5320 raft_consensus.cc:2804] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:32.192625  5320 raft_consensus.cc:697] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 2 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:14:32.198151  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:32.198680  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:32.163134  5195 raft_consensus.cc:493] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:32.141271  5307 raft_consensus.cc:515] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:32.146163  5304 raft_consensus.cc:697] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
W20260709 13:14:32.213078  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 47519.7us
I20260709 13:14:32.191576  5265 raft_consensus.cc:493] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:32.170941  3952 raft_consensus.cc:1275] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:32.169462  5221 consensus_queue.cc:1059] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:14:32.169643  5231 consensus_queue.cc:1059] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:14:32.205619  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:32.216920  3997 leader_election.cc:304] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:32.219446  3997 leader_election.cc:304] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:32.197356  5294 consensus_queue.cc:1048] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:14:32.221093  4031 raft_consensus.cc:1240] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 13:14:32.209198  5195 raft_consensus.cc:3060] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:32.176788  5191 consensus_queue.cc:1059] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:14:32.208551  3951 raft_consensus.cc:1275] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:32.211962  5316 raft_consensus.cc:697] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:32.213436  3953 raft_consensus.cc:2468] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 2.
I20260709 13:14:32.247884  3954 raft_consensus.cc:1275] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:32.242421  5304 consensus_queue.cc:237] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:32.251693  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:32.253062  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:32.259028  3954 raft_consensus.cc:3060] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:32.261860  3951 raft_consensus.cc:1240] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:32.231150  5348 raft_consensus.cc:493] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:32.279486  5348 raft_consensus.cc:515] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:32.280365  3951 raft_consensus.cc:1240] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:32.277266  5307 leader_election.cc:290] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:32.257337  5291 raft_consensus.cc:3060] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:32.290928  3997 leader_election.cc:304] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:14:32.228883  5265 raft_consensus.cc:515] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:32.305540  5268 raft_consensus.cc:2749] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:32.307952  5316 consensus_queue.cc:237] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:32.317376  3957 raft_consensus.cc:1275] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:32.317615  5324 raft_consensus.cc:3055] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:32.318157  5324 raft_consensus.cc:740] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:32.326293  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:32.298557  4705 raft_consensus.cc:1275] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 3 LEARNER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:14:32.322549  5296 raft_consensus.cc:515] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:32.347973  5265 leader_election.cc:290] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:32.259841  5237 raft_consensus.cc:2804] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:32.319315  5324 consensus_queue.cc:260] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:32.354176  5324 raft_consensus.cc:3060] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:32.358361  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:32.367358  5265 raft_consensus.cc:493] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.367566  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:32.368191  5265 raft_consensus.cc:515] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:32.369768  3958 raft_consensus.cc:2955] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
W20260709 13:14:32.372512  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 231280us
I20260709 13:14:32.375097  5204 consensus_queue.cc:1048] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:32.375584  4071 leader_election.cc:304] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:32.375504  5355 consensus_queue.cc:1048] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:32.376557  5263 raft_consensus.cc:2804] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:32.377240  5263 raft_consensus.cc:697] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:32.378441  5263 consensus_queue.cc:237] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:32.365091  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:32.394856  5355 consensus_queue.cc:1048] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:32.299060  5320 consensus_queue.cc:237] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:32.404174  4027 raft_consensus.cc:1275] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:32.410751  5353 consensus_queue.cc:1059] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:14:32.429746  5195 raft_consensus.cc:515] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:32.432438  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:32.440901  5354 raft_consensus.cc:2749] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:32.457072  5241 raft_consensus.cc:3055] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:32.457691  5241 raft_consensus.cc:740] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:32.462836  3954 raft_consensus.cc:2468] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
I20260709 13:14:32.405877  5348 leader_election.cc:290] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:32.465704  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:32.458739  5241 consensus_queue.cc:260] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:32.466905  5358 consensus_queue.cc:1059] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
W20260709 13:14:32.470978  5283 consensus_meta.cc:287] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.563s	user 0.003s	sys 0.008s
W20260709 13:14:32.445293  5232 consensus_meta.cc:287] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 0.734s	user 0.013s	sys 0.000s
I20260709 13:14:32.486855  4026 raft_consensus.cc:1240] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:32.450805  5229 raft_consensus.cc:493] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.497344  5229 raft_consensus.cc:515] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:32.502023  5229 leader_election.cc:290] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:32.446573  5231 consensus_queue.cc:1059] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
W20260709 13:14:32.489835  5322 consensus_meta.cc:287] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.555s	user 0.005s	sys 0.006s
I20260709 13:14:32.479022  5265 leader_election.cc:290] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:32.505543  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:32.508138  4030 raft_consensus.cc:2468] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 2.
W20260709 13:14:32.508922  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:32.510206  4675 leader_election.cc:304] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:32.484910  5354 consensus_queue.cc:1048] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:14:32.512912  5241 raft_consensus.cc:3060] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:32.517361  5210 raft_consensus.cc:3055] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:32.477037  5297 raft_consensus.cc:515] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:32.504385  5250 consensus_meta.cc:287] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.508s	user 0.010s	sys 0.001s
I20260709 13:14:32.526175  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:32.527078  4026 raft_consensus.cc:1240] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:32.517799  5210 raft_consensus.cc:740] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:32.542413  4107 raft_consensus.cc:1240] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:32.486018  5232 raft_consensus.cc:515] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:32.542717  4071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:32.555095  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:32.557952  4107 raft_consensus.cc:2468] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 2.
W20260709 13:14:32.528601  5269 consensus_meta.cc:287] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.758s	user 0.015s	sys 0.000s
I20260709 13:14:32.543977  4025 raft_consensus.cc:2468] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 2.
I20260709 13:14:32.544687  4031 raft_consensus.cc:1240] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:32.562923  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:32.563036  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:32.564374  4108 raft_consensus.cc:2393] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 2: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:32.564673  4030 raft_consensus.cc:1240] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:32.558924  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:32.524605  5229 raft_consensus.cc:2804] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:32.567584  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:32.569621  4107 raft_consensus.cc:2393] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 2: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:32.574713  3950 raft_consensus.cc:2468] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
W20260709 13:14:32.576987  3925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:32.529732  5296 leader_election.cc:290] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:32.578367  4033 raft_consensus.cc:1240] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:32.577874  5341 raft_consensus.cc:3055] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:32.579913  5341 raft_consensus.cc:740] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:32.554780  5250 raft_consensus.cc:2749] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:32.581355  5293 raft_consensus.cc:3060] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:32.580960  5341 consensus_queue.cc:260] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:32.554910  5322 consensus_queue.cc:1059] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:14:32.562664  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:32.576221  5229 raft_consensus.cc:493] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:32.593472  5348 consensus_queue.cc:1059] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:14:32.614041  5341 raft_consensus.cc:3060] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:32.614406  5348 raft_consensus.cc:3055] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:32.586578  5271 raft_consensus.cc:493] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.622470  5271 raft_consensus.cc:515] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:32.586045  5358 raft_consensus.cc:3055] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:32.619789  3922 leader_election.cc:304] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:32.625720  3922 leader_election.cc:304] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:32.621116  5232 leader_election.cc:290] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:32.609011  5242 consensus_queue.cc:1059] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:14:32.628268  3958 raft_consensus.cc:1275] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:32.586191  5283 consensus_queue.cc:1048] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:14:32.630028  5322 raft_consensus.cc:2804] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:32.633555  5291 raft_consensus.cc:2749] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:32.657761  5322 raft_consensus.cc:493] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:32.658246  5322 raft_consensus.cc:3060] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:32.658339  4034 raft_consensus.cc:1240] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 1. Current term is 2. Ops: []
W20260709 13:14:32.658944  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:32.658342  4103 raft_consensus.cc:3060] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:32.659718  5256 raft_consensus.cc:493] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.660306  5256 raft_consensus.cc:515] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:32.627872  5358 raft_consensus.cc:740] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:32.593309  5355 consensus_queue.cc:1048] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:14:32.663268  5256 leader_election.cc:290] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:32.662838  5358 consensus_queue.cc:260] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:32.656847  5352 raft_consensus.cc:3060] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:32.625169  5348 raft_consensus.cc:740] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:32.680464  5307 raft_consensus.cc:3055] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:32.618351  5210 consensus_queue.cc:260] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:32.684029  5307 raft_consensus.cc:740] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:32.681082  5268 raft_consensus.cc:493] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.692687  5271 leader_election.cc:290] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:32.694767  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:32.695474  4700 raft_consensus.cc:2468] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 2.
I20260709 13:14:32.695812  5268 raft_consensus.cc:515] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:32.630352  5195 leader_election.cc:290] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:32.697000  3924 leader_election.cc:304] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:32.615587  5229 raft_consensus.cc:3060] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:32.699397  5268 leader_election.cc:290] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:32.698566  5271 raft_consensus.cc:2804] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:32.700111  5271 raft_consensus.cc:493] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:32.700610  5271 raft_consensus.cc:3060] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:32.689097  5348 consensus_queue.cc:260] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:32.702126  5348 raft_consensus.cc:3060] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:32.679528  3959 raft_consensus.cc:2468] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
I20260709 13:14:32.698344  4103 raft_consensus.cc:2468] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
I20260709 13:14:32.690217  5358 raft_consensus.cc:3060] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:32.708199  3955 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.025s	sys 0.028s
W20260709 13:14:32.710812  3955 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.025s	sys 0.028s
I20260709 13:14:32.687857  5269 consensus_queue.cc:1059] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:14:32.634447  5242 consensus_queue.cc:1243] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer 6f5b5e4ed72944ecbda200012d141dc2 log is divergent from this leader: its last log entry 2.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:14:32.717896  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:32.721127  4102 raft_consensus.cc:2468] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 2.
I20260709 13:14:32.716372  5297 leader_election.cc:290] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:32.735154  4700 raft_consensus.cc:1275] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:32.737061  5341 consensus_queue.cc:1048] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:32.778438  5268 raft_consensus.cc:493] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.779285  5268 raft_consensus.cc:515] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:14:32.789458  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 434485us
I20260709 13:14:32.791455  5237 raft_consensus.cc:697] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:32.814047  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:32.827206  5291 consensus_queue.cc:1059] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
W20260709 13:14:32.840092  5340 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.044s	sys 0.057s
W20260709 13:14:32.840633  5340 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.044s	sys 0.058s
I20260709 13:14:32.841449  5253 raft_consensus.cc:3060] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:32.802150  5297 consensus_queue.cc:1048] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:14:32.860498  3997 leader_election.cc:304] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:32.812376  5231 consensus_queue.cc:1048] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
W20260709 13:14:32.874991  3925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:32.877534  5256 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.936201  5256 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:32.874107  5265 raft_consensus.cc:493] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.939080  5265 raft_consensus.cc:515] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:32.941709  5265 leader_election.cc:290] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:32.955291  5322 raft_consensus.cc:515] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:32.873307  5268 leader_election.cc:290] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:14:33.040992  5362 log.cc:927] Time spent T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 13:14:33.044276  5237 consensus_queue.cc:237] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:33.083715  3951 raft_consensus.cc:1275] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:33.092985  5271 raft_consensus.cc:515] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:33.132992  5271 leader_election.cc:290] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:14:33.114498  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:33.138473  5305 raft_consensus.cc:493] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:33.138904  5301 consensus_queue.cc:1048] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:33.139155  5305 raft_consensus.cc:515] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:33.140730  4027 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.011s	sys 0.027s
I20260709 13:14:33.141069  5251 raft_consensus.cc:3055] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:33.141589  5251 raft_consensus.cc:740] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:33.141830  5305 leader_election.cc:290] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:14:33.143267  3953 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.007s	sys 0.025s
W20260709 13:14:33.144987  3953 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.007s	sys 0.025s
I20260709 13:14:33.145421  3956 raft_consensus.cc:2468] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
W20260709 13:14:33.141095  4027 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.011s	sys 0.027s
I20260709 13:14:33.114692  5322 leader_election.cc:290] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:33.117100  5352 raft_consensus.cc:2749] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:33.051766  5293 raft_consensus.cc:493] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.135208  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:33.150895  4104 raft_consensus.cc:2393] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 2: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
W20260709 13:14:33.143134  3954 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.004s	sys 0.024s
W20260709 13:14:33.177194  4072 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.000s	user 0.019s	sys 0.025s
I20260709 13:14:33.187346  5293 raft_consensus.cc:515] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:33.189574  5307 consensus_queue.cc:260] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:33.191486  4072 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.014s	user 0.020s	sys 0.025s
W20260709 13:14:33.149112  4705 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.004s	sys 0.024s
I20260709 13:14:33.211218  5322 raft_consensus.cc:493] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:33.211627  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 351221us
I20260709 13:14:33.142765  5251 consensus_queue.cc:260] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:33.213343  4705 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.004s	sys 0.024s
I20260709 13:14:33.212198  5195 raft_consensus.cc:2804] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:14:33.196204  3954 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.004s	sys 0.024s
I20260709 13:14:33.212656  5307 raft_consensus.cc:3060] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:33.215977  3997 leader_election.cc:304] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:33.218930  3997 leader_election.cc:304] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:14:33.220788  4000 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.809s	user 0.020s	sys 0.034s
W20260709 13:14:33.221108  4000 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.020s	sys 0.034s
I20260709 13:14:33.222119  5297 raft_consensus.cc:2804] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:33.222802  5297 raft_consensus.cc:697] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
W20260709 13:14:33.223462  5342 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.827s	user 0.017s	sys 0.066s
I20260709 13:14:33.223603  4027 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316"
dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
mode: GRACEFUL
new_leader_uuid: "d709ee666b774ec29aa732e508219938"
 from {username='slave'} at 127.0.0.1:44232
W20260709 13:14:33.223908  5342 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.828s	user 0.017s	sys 0.066s
I20260709 13:14:33.224390  4027 raft_consensus.cc:606] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 LEADER]: Received request to transfer leadership to TS d709ee666b774ec29aa732e508219938
I20260709 13:14:33.223871  5297 consensus_queue.cc:237] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:33.224761  5231 raft_consensus.cc:493] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:33.225437  5231 raft_consensus.cc:515] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:33.228698  4027 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a"
dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
mode: GRACEFUL
new_leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
 from {username='slave'} at 127.0.0.1:44232
I20260709 13:14:33.229535  4027 raft_consensus.cc:606] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Received request to transfer leadership to TS 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:33.214550  5345 raft_consensus.cc:493] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
W20260709 13:14:33.237607  3998 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.000s	sys 0.043s
W20260709 13:14:33.238412  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:33.251732  3998 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.000s	sys 0.044s
I20260709 13:14:33.228688  5358 raft_consensus.cc:2804] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:14:33.235960  5229 consensus_meta.cc:287] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938: Time spent flushing consensus metadata: real 0.523s	user 0.008s	sys 0.003s
I20260709 13:14:33.254933  5352 raft_consensus.cc:493] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:33.261844  5353 raft_consensus.cc:3055] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:33.264091  5310 raft_consensus.cc:493] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:33.264633  5293 leader_election.cc:290] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:33.265097  5363 raft_consensus.cc:493] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:33.228416  5195 raft_consensus.cc:697] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:33.230463  5251 raft_consensus.cc:3060] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:33.217496  5322 raft_consensus.cc:515] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:33.274660  4073 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.061s	user 0.044s	sys 0.037s
W20260709 13:14:33.279124  3925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:33.281248  3955 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.015s	sys 0.005s
W20260709 13:14:33.256208  5263 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.012s	sys 0.035s
W20260709 13:14:33.288720  4073 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.073s	user 0.044s	sys 0.037s
W20260709 13:14:33.289287  3955 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.015s	sys 0.005s
I20260709 13:14:33.273999  5353 raft_consensus.cc:740] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:33.297384  3955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1371) took 1162 ms. Trace:
W20260709 13:14:33.292047  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:33.295058  5195 consensus_queue.cc:237] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:33.286365  5363 raft_consensus.cc:515] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:33.301203  5355 raft_consensus.cc:493] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.301759  5355 raft_consensus.cc:515] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:33.304256  5355 leader_election.cc:290] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:33.304692  5355 raft_consensus.cc:493] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:33.305404  5355 raft_consensus.cc:515] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:33.307317  5355 leader_election.cc:290] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:33.288234  5324 consensus_queue.cc:1059] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:14:33.309999  4032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38304 (request call id 1466) took 1532 ms. Trace:
W20260709 13:14:33.283373  4101 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.037s	sys 0.029s
W20260709 13:14:33.312492  4101 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.038s	sys 0.029s
W20260709 13:14:33.218315  5320 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.031s	sys 0.087s
I20260709 13:14:33.333483  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:33.335054  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:33.336094  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:33.336732  4028 raft_consensus.cc:1240] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:33.313176  3955 rpcz_store.cc:276] 0709 13:14:32.135395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:32.135516 (+   121us) service_pool.cc:224] Handling call
0709 13:14:32.135844 (+   328us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:32.153065 (+ 17221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:32.153119 (+    54us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:32.156423 (+  3304us) log.cc:844] Serialized 52 byte log entry
0709 13:14:32.712921 (+556498us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:14:33.296782 (+583861us) log.cc:844] Serialized 14 byte log entry
0709 13:14:33.297034 (+   252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:33.297115 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:33.297159 (+    44us) raft_consensus.cc:1685] finished
0709 13:14:33.297169 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:33.297319 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5779,"raft.queue_time_us":7391,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":14791,"thread_start_us":1118540,"threads_started":2,"wal-append.queue_time_us":707171}
I20260709 13:14:33.285054  5231 leader_election.cc:290] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:33.322676  5263 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.012s	sys 0.036s
I20260709 13:14:33.275316  5345 raft_consensus.cc:515] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:33.291129  5293 raft_consensus.cc:493] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:33.326896  5320 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.825s	user 0.032s	sys 0.088s
I20260709 13:14:33.328642  5256 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:33.276558  5229 raft_consensus.cc:515] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:33.285792  5310 raft_consensus.cc:515] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:33.279608  5352 raft_consensus.cc:515] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:33.324186  5299 raft_consensus.cc:493] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:14:33.323328  3954 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151"
dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
mode: GRACEFUL
new_leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:35222
I20260709 13:14:33.287431  5358 raft_consensus.cc:697] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:33.361138  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:33.362329  4026 raft_consensus.cc:2468] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 2.
I20260709 13:14:33.339485  5355 raft_consensus.cc:493] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:33.353655  3957 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.003s	sys 0.039s
I20260709 13:14:33.337072  5305 raft_consensus.cc:493] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:33.310639  4032 rpcz_store.cc:276] 0709 13:14:31.777953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:31.779422 (+  1469us) service_pool.cc:224] Handling call
0709 13:14:31.800486 (+ 21064us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:31.930681 (+130195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:31.938806 (+  8125us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:31.965105 (+ 26299us) log.cc:844] Serialized 26 byte log entry
0709 13:14:32.432676 (+467571us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b180026a520. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f1522563e07 00007f152b3beab9 00007f152258069b 00007f152257e93f 00007f1522580c02 00007f152520820b 00007f152520dd23 00007f152520e0d1 00007f1525629a0f
0709 13:14:32.768245 (+335569us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:14:32.768307 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:33.294138 (+525831us) spinlock_profiling.cc:243] Waited 56.9 ms on lock 0x7b54000479d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:14:33.296338 (+  2200us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:33.309620 (+ 13282us) raft_consensus.cc:1685] finished
0709 13:14:33.309654 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:33.309887 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22253,"raft.queue_time_us":1206,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":6915,"spinlock_wait_cycles":133462016,"thread_start_us":335260,"threads_started":1,"wal-append.queue_time_us":911772}
I20260709 13:14:33.356701  5210 raft_consensus.cc:3060] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:33.357687  5250 raft_consensus.cc:3055] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:33.351296  5293 raft_consensus.cc:515] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:33.365082  3957 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.004s	sys 0.039s
I20260709 13:14:33.354043  5256 raft_consensus.cc:493] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:33.371743  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:33.376128  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:33.361099  5263 raft_consensus.cc:493] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:33.374907  3957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38612 (request call id 795) took 1033 ms. Trace:
I20260709 13:14:33.372864  5250 raft_consensus.cc:740] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:33.380170  5256 raft_consensus.cc:515] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:33.383033  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:33.381852  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:33.383744  4032 raft_consensus.cc:2468] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 2.
I20260709 13:14:33.385605  4025 raft_consensus.cc:1275] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:33.381150  3957 rpcz_store.cc:276] 0709 13:14:32.341696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:32.342423 (+   727us) service_pool.cc:224] Handling call
0709 13:14:32.342863 (+   440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:32.373461 (+ 30598us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:32.373510 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:32.374137 (+   627us) log.cc:844] Serialized 26 byte log entry
0709 13:14:32.706524 (+332387us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:33.373908 (+667384us) log.cc:844] Serialized 14 byte log entry
0709 13:14:33.374308 (+   400us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:33.374409 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:33.374463 (+    54us) raft_consensus.cc:1685] finished
0709 13:14:33.374478 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:33.374828 (+   350us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30090,"raft.queue_time_us":32203,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":5462,"thread_start_us":992219,"threads_started":2,"wal-append.queue_time_us":604407}
I20260709 13:14:33.368396  3954 raft_consensus.cc:606] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Received request to transfer leadership to TS 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:33.371943  5320 raft_consensus.cc:493] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:33.395532  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:33.396601  4029 raft_consensus.cc:2468] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 1.
I20260709 13:14:33.388500  5263 raft_consensus.cc:515] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:14:33.368595  5238 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.006s	sys 0.009s
I20260709 13:14:33.381486  5322 leader_election.cc:290] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:33.404626  5256 leader_election.cc:290] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:33.367343  5355 raft_consensus.cc:515] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:33.365721  5299 raft_consensus.cc:515] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:33.382962  5250 consensus_queue.cc:260] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:33.399302  3954 raft_consensus.cc:614] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:14:33.409793  4674 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.014s	sys 0.054s
I20260709 13:14:33.391618  5348 raft_consensus.cc:493] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.394142  4701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:33.369418  5305 raft_consensus.cc:515] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:14:33.407740  5238 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.006s	sys 0.010s
I20260709 13:14:33.368624  5353 consensus_queue.cc:260] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:33.437839  4675 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.015s	sys 0.043s
W20260709 13:14:33.443907  3925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:33.454878  4675 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.015s	sys 0.043s
W20260709 13:14:33.420146  4674 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.014s	sys 0.055s
I20260709 13:14:33.415512  5256 raft_consensus.cc:493] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:33.466250  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:33.409368  5320 raft_consensus.cc:515] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:33.478622  3925 leader_election.cc:304] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:33.452456  5250 raft_consensus.cc:3060] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:33.487838  5324 raft_consensus.cc:2804] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:33.488533  5324 raft_consensus.cc:493] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:33.489023  5324 raft_consensus.cc:3060] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:33.497781  3925 leader_election.cc:304] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:33.460155  5238 raft_consensus.cc:493] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:33.469194  5316 raft_consensus.cc:493] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.509268  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:33.510211  4025 raft_consensus.cc:2468] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 2.
I20260709 13:14:33.511794  3925 leader_election.cc:304] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:33.474081  5270 raft_consensus.cc:493] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.473291  5301 raft_consensus.cc:493] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:14:33.514185  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:33.515357  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:33.515703  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:33.516849  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:33.518196  4026 raft_consensus.cc:1240] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 13:14:33.452924  4701 raft_consensus.cc:3060] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 3 LEARNER]: Advancing to term 4
I20260709 13:14:33.421227  5358 consensus_queue.cc:237] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:33.476087  5370 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.447515  5348 raft_consensus.cc:515] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:33.492134  5310 leader_election.cc:290] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:33.522234  2843 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:14:33.473376  5256 raft_consensus.cc:515] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:33.518730  5248 raft_consensus.cc:2804] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:33.501307  5345 leader_election.cc:290] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:33.537250  2843 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:33.525775  5191 raft_consensus.cc:2804] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:33.533257  5293 leader_election.cc:290] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:33.546448  5374 log.cc:927] Time spent T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.194s	user 0.001s	sys 0.001s
I20260709 13:14:33.562279  5364 raft_consensus.cc:493] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:33.562923  5364 raft_consensus.cc:515] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:33.546794  5382 raft_consensus.cc:493] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:33.548501  5352 leader_election.cc:290] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:33.550371  5191 raft_consensus.cc:493] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:33.547623  5310 raft_consensus.cc:493] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.518949  5316 raft_consensus.cc:515] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:33.516341  5238 raft_consensus.cc:515] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:33.527770  5270 raft_consensus.cc:515] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:33.529138  5301 raft_consensus.cc:515] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:33.554224  5345 raft_consensus.cc:493] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.550328  5394 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.584365  3997 leader_election.cc:304] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:33.551318  5263 leader_election.cc:290] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:33.548841  5248 raft_consensus.cc:493] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:33.557044  5393 raft_consensus.cc:493] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
W20260709 13:14:33.701020  5379 log.cc:927] Time spent T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.293s	user 0.000s	sys 0.001s
I20260709 13:14:33.811592  5301 leader_election.cc:290] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:33.812319  5307 raft_consensus.cc:2749] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:33.591992  5365 consensus_queue.cc:1059] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.117s
I20260709 13:14:33.570689  5382 raft_consensus.cc:515] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:14:33.704818  5391 log.cc:927] Time spent T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 13:14:33.598696  5387 raft_consensus.cc:493] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:33.817485  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:33.598335  5310 raft_consensus.cc:515] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:14:33.759832  3998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:33.628858  5299 leader_election.cc:290] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:33.535887  5370 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:33.587814  5191 raft_consensus.cc:3060] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:33.635110  5397 raft_consensus.cc:493] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:33.796764  5377 log.cc:927] Time spent T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.270s	user 0.002s	sys 0.003s
I20260709 13:14:33.808655  5248 raft_consensus.cc:3060] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:33.768401  5345 raft_consensus.cc:515] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:33.769380  5210 raft_consensus.cc:493] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:33.795135  5251 consensus_meta.cc:287] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.507s	user 0.010s	sys 0.007s
I20260709 13:14:33.796157  5385 raft_consensus.cc:493] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
W20260709 13:14:33.773977  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 189735us
I20260709 13:14:33.815536  4030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38290 (request call id 1312) took 1291 ms. Trace:
W20260709 13:14:33.768312  5390 log.cc:927] Time spent T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.162s	user 0.000s	sys 0.002s
W20260709 13:14:33.775149  3925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:33.796489  5367 log.cc:927] Time spent T 00000000000000000000000000000000 P af4ff34c238b4043994545a7eb56815f: Append to log took a long time: real 0.341s	user 0.004s	sys 0.001s
W20260709 13:14:33.818477  5392 log.cc:927] Time spent T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.239s	user 0.002s	sys 0.006s
I20260709 13:14:33.812258  5348 leader_election.cc:290] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:14:33.837149  5386 log.cc:927] Time spent T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.275s	user 0.000s	sys 0.009s
I20260709 13:14:33.837229  5305 leader_election.cc:290] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:33.769152  5253 raft_consensus.cc:493] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:33.838471  4030 rpcz_store.cc:276] 0709 13:14:32.523974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:32.527741 (+  3767us) service_pool.cc:224] Handling call
0709 13:14:32.528096 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:32.565184 (+ 37088us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:33.815277 (+1250093us) spinlock_profiling.cc:243] Waited 36.4 ms on lock 0x7b54003b1854. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:14:33.815474 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":83613952}
I20260709 13:14:33.821988  5355 leader_election.cc:290] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:33.844630  5400 raft_consensus.cc:493] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:33.844472  5385 raft_consensus.cc:515] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:33.846362  5396 raft_consensus.cc:493] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.826165  5307 raft_consensus.cc:493] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.825179  5263 raft_consensus.cc:493] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:33.850117  4073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 93862us
I20260709 13:14:33.852169  3997 leader_election.cc:304] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:33.809856  5394 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:33.835886  5324 raft_consensus.cc:515] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:33.871124  4101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45332 (request call id 1313) took 1330 ms. Trace:
I20260709 13:14:33.809379  5393 raft_consensus.cc:515] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:33.841322  5210 raft_consensus.cc:515] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:33.878166  3951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1378) took 1389 ms. Trace:
I20260709 13:14:33.881315  5210 leader_election.cc:290] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:33.856768  5320 leader_election.cc:290] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:33.855890  5195 consensus_queue.cc:1059] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:14:33.882933  5365 raft_consensus.cc:3055] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:33.859694  5348 raft_consensus.cc:493] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.873759  4101 rpcz_store.cc:276] 0709 13:14:32.540852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:32.540997 (+   145us) service_pool.cc:224] Handling call
0709 13:14:32.554676 (+ 13679us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:32.555084 (+   408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:32.555114 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:32.561848 (+  6734us) log.cc:844] Serialized 26 byte log entry
0709 13:14:33.312946 (+751098us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:14:33.312992 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:33.313059 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:33.870904 (+557845us) raft_consensus.cc:1685] finished
0709 13:14:33.870925 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:33.871057 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3260,"raft.queue_time_us":430,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":17834,"thread_start_us":708893,"threads_started":1,"wal-append.queue_time_us":869603}
I20260709 13:14:33.871325  3997 leader_election.cc:304] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:33.855468  4701 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 4 LEARNER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 4.
I20260709 13:14:33.858608  5238 leader_election.cc:290] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:33.890827  3959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35354 (request call id 66) took 1016 ms. Trace:
I20260709 13:14:33.891400  3959 rpcz_store.cc:276] 0709 13:14:32.874852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:32.876290 (+  1438us) service_pool.cc:224] Handling call
0709 13:14:32.876772 (+   482us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:32.877080 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:32.877124 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:32.877797 (+   673us) log.cc:844] Serialized 26 byte log entry
0709 13:14:33.368032 (+490235us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:33.368074 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:33.368153 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:33.890526 (+522373us) raft_consensus.cc:1685] finished
0709 13:14:33.890555 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:33.890739 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":486279,"threads_started":1,"wal-append.queue_time_us":600006}
I20260709 13:14:33.878115  5316 leader_election.cc:290] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:33.878778  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:33.879304  5385 leader_election.cc:290] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:33.895440  5250 raft_consensus.cc:493] T 86669993fba94e65ba192aa115ed6e88 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:33.889334  5398 consensus_queue.cc:1048] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:14:33.896024  5250 raft_consensus.cc:515] T 86669993fba94e65ba192aa115ed6e88 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:33.872937  5341 raft_consensus.cc:2749] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:14:33.899724  4701 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57692 (request call id 168) took 1387 ms (client timeout 1507 ms). Trace:
W20260709 13:14:33.900163  4701 rpcz_store.cc:269] 0709 13:14:32.512190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:32.513179 (+   989us) service_pool.cc:224] Handling call
0709 13:14:33.388274 (+875095us) spinlock_profiling.cc:243] Waited 5.77 ms on lock 0x7b5800003f98. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f1522549b71 00007f1522549eee 0000000000375939 00007f152a5bd1e0 00007f152a6860c4 00007f152a686131 00007f152a6340a0 00007f152a633984 00007f1523bae6d4 00007f1523bae662
0709 13:14:33.899648 (+511374us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13278976}
I20260709 13:14:33.900833  5345 leader_election.cc:290] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:33.894263  4104 raft_consensus.cc:2468] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 1.
I20260709 13:14:33.899260  5316 raft_consensus.cc:3060] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:33.872224  5256 leader_election.cc:290] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:33.883468  5365 raft_consensus.cc:740] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:33.869352  5263 raft_consensus.cc:515] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:33.913977  3997 leader_election.cc:304] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:33.856727  5253 raft_consensus.cc:515] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:33.880731  3951 rpcz_store.cc:276] 0709 13:14:32.489230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:32.503854 (+ 14624us) service_pool.cc:224] Handling call
0709 13:14:32.505933 (+  2079us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:33.084383 (+578450us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:33.877881 (+793498us) spinlock_profiling.cc:243] Waited 577 ms on lock 0x7b54000f2dd4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:14:33.878096 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1327488384}
I20260709 13:14:33.865985  5307 raft_consensus.cc:515] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:33.938004  5307 leader_election.cc:290] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:33.870472  5400 raft_consensus.cc:515] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:33.938619  5253 leader_election.cc:290] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:33.893853  5348 raft_consensus.cc:515] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:33.940275  5400 leader_election.cc:290] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:33.873241  5396 raft_consensus.cc:515] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:33.942200  5348 leader_election.cc:290] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:33.942458  5396 leader_election.cc:290] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:33.826326  5387 raft_consensus.cc:515] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:33.924410  5297 raft_consensus.cc:3055] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:33.943320  5297 raft_consensus.cc:740] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:33.944476  5297 consensus_queue.cc:260] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:33.945245  5387 leader_election.cc:290] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:33.925585  5393 leader_election.cc:290] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:33.832931  5397 raft_consensus.cc:515] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:33.951290  3997 leader_election.cc:304] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:33.953572  3997 leader_election.cc:304] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:14:33.901255  5270 leader_election.cc:290] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:33.955438  5396 raft_consensus.cc:493] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.946138  5297 raft_consensus.cc:3060] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:33.974550  4074 leader_election.cc:304] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:33.951102  5400 raft_consensus.cc:493] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.966725  5307 raft_consensus.cc:2749] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:33.972332  5396 raft_consensus.cc:515] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:33.978891  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:33.979740  4030 raft_consensus.cc:2468] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 2.
I20260709 13:14:33.979873  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:33.980618  4028 raft_consensus.cc:2468] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 2.
I20260709 13:14:33.980862  5382 leader_election.cc:290] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:33.982169  5370 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:33.982568  5396 leader_election.cc:290] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:33.984028  5365 consensus_queue.cc:260] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:33.985469  5365 raft_consensus.cc:3060] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:33.986476  5404 raft_consensus.cc:2804] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:33.986941  5404 raft_consensus.cc:493] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:33.956851  5231 raft_consensus.cc:2749] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:14:33.968178  5195 raft_consensus.cc:2749] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:14:33.974943  5395 log.cc:927] Time spent T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.161s	user 0.001s	sys 0.001s
I20260709 13:14:33.987339  5404 raft_consensus.cc:3060] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:33.978763  5310 leader_election.cc:290] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:33.972982  5191 raft_consensus.cc:515] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:33.995579  5229 leader_election.cc:290] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:33.996356  5348 consensus_queue.cc:1059] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:33.997201  5263 leader_election.cc:290] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:33.997754  5324 leader_election.cc:290] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:33.998381  5191 leader_election.cc:290] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:33.991344  5270 raft_consensus.cc:493] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.993353  5401 consensus_queue.cc:1048] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:14:34.004592  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:34.005312  4104 raft_consensus.cc:2468] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
I20260709 13:14:34.005439  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:34.006374  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:34.006661  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:34.007911  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:34.008494  4108 raft_consensus.cc:1240] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:33.998458  5402 consensus_queue.cc:1059] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:14:33.989336  5400 raft_consensus.cc:515] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:34.017997  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:34.019279  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:34.026618  5398 consensus_queue.cc:1059] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:34.019280  5248 raft_consensus.cc:515] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:34.010051  5270 raft_consensus.cc:515] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:34.028769  5263 raft_consensus.cc:3055] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:34.029198  5263 raft_consensus.cc:740] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:34.011066  5348 consensus_queue.cc:1243] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer 6f5b5e4ed72944ecbda200012d141dc2 log is divergent from this leader: its last log entry 2.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:14:34.032863  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:34.035053  5270 leader_election.cc:290] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:34.039830  4103 raft_consensus.cc:1240] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:34.041447  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:34.042016  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:34.042315  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:34.042711  4030 raft_consensus.cc:2468] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 2.
I20260709 13:14:34.043574  3997 leader_election.cc:304] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:14:34.044342  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:34.044631  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:34.045421  4026 raft_consensus.cc:2393] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 2: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:14:34.046833  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:34.047709  4025 raft_consensus.cc:3055] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:34.048097  4025 raft_consensus.cc:740] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:34.048456  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:34.049024  4025 consensus_queue.cc:260] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:34.049840  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:34.050040  4025 raft_consensus.cc:3060] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:34.050498  4026 raft_consensus.cc:2468] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 2.
I20260709 13:14:34.052112  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:34.052380  4026 raft_consensus.cc:1275] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:34.054112  3997 leader_election.cc:304] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:34.055960  4029 raft_consensus.cc:2393] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 3: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:14:34.058051  4099 raft_consensus.cc:1275] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:34.059644  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:34.061277  4074 leader_election.cc:304] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:34.062023  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:34.062726  4101 raft_consensus.cc:3060] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:34.062983  4074 leader_election.cc:304] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:34.059604  5195 raft_consensus.cc:2749] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:34.053222  5270 raft_consensus.cc:493] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:34.063705  5396 raft_consensus.cc:493] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.067176  5345 raft_consensus.cc:2804] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:34.059603  5409 raft_consensus.cc:2804] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:34.069185  5408 raft_consensus.cc:493] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:34.071189  5337 raft_consensus.cc:2804] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:34.071066  5396 raft_consensus.cc:515] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:34.066362  5310 raft_consensus.cc:493] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:34.075562  5397 leader_election.cc:290] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:34.075693  5310 raft_consensus.cc:515] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:34.076261  5408 raft_consensus.cc:515] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:34.064798  5248 leader_election.cc:290] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:34.068819  5414 consensus_queue.cc:1048] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:34.078152  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:34.078847  4029 raft_consensus.cc:2468] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 2.
I20260709 13:14:34.079196  5310 leader_election.cc:290] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:34.077399  4030 raft_consensus.cc:2468] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:14:34.079764  5337 raft_consensus.cc:493] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:34.080237  5337 raft_consensus.cc:3060] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:34.079507  5404 raft_consensus.cc:515] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:34.080914  5409 raft_consensus.cc:493] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:34.082042  5409 raft_consensus.cc:3060] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:34.072405  5345 raft_consensus.cc:493] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:34.086263  4101 raft_consensus.cc:2468] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3.
I20260709 13:14:34.074393  5231 consensus_queue.cc:1048] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:14:34.090212  4074 leader_election.cc:304] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
W20260709 13:14:34.094241  5389 log.cc:927] Time spent T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.499s	user 0.005s	sys 0.003s
I20260709 13:14:34.094832  5402 raft_consensus.cc:2804] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:34.090360  5345 raft_consensus.cc:3060] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:34.095677  5402 raft_consensus.cc:493] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:34.096269  5402 raft_consensus.cc:3060] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:34.098248  4025 raft_consensus.cc:1275] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:34.106154  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:34.072626  5270 raft_consensus.cc:515] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:34.113521  4025 raft_consensus.cc:2468] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 2.
I20260709 13:14:34.114574  4074 leader_election.cc:304] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:34.111658  5397 consensus_queue.cc:1048] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:14:34.120365  4032 raft_consensus.cc:2468] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:34.122469  5408 leader_election.cc:290] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:34.124943  5396 leader_election.cc:290] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:34.127254  5316 raft_consensus.cc:2749] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:34.129369  5300 raft_consensus.cc:3055] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:34.129799  5300 raft_consensus.cc:740] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:34.130684  5300 consensus_queue.cc:260] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:34.132123  5300 raft_consensus.cc:3060] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:34.133116  5404 leader_election.cc:290] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:34.153692  5363 leader_election.cc:290] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:34.139983  5404 raft_consensus.cc:2804] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:34.156919  4028 raft_consensus.cc:1275] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:34.141207  5402 raft_consensus.cc:515] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:34.160710  5402 leader_election.cc:290] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:34.163475  5404 raft_consensus.cc:697] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:34.164882  5404 consensus_queue.cc:237] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:34.167991  5345 raft_consensus.cc:515] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:34.172022  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:34.169037  5337 raft_consensus.cc:515] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:34.185722  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:34.186301  4028 raft_consensus.cc:3060] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:34.193604  5337 leader_election.cc:290] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:34.182161  5402 consensus_queue.cc:1048] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:14:34.213055  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:34.213410  4028 raft_consensus.cc:2468] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:34.213903  4025 raft_consensus.cc:3060] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:14:34.216832  3924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:34.217377  4101 raft_consensus.cc:1275] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:34.227955  4033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38290 (request call id 1299) took 2460 ms. Trace:
I20260709 13:14:34.228406  4033 rpcz_store.cc:276] 0709 13:14:31.751290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:31.751393 (+   103us) service_pool.cc:224] Handling call
0709 13:14:31.751675 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:32.582541 (+830866us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:34.211141 (+1628600us) spinlock_profiling.cc:243] Waited 826 ms on lock 0x7b540010a754. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:14:34.211405 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1900648704}
I20260709 13:14:34.234023  4025 raft_consensus.cc:2468] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:34.231961  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:34.236716  4099 raft_consensus.cc:2468] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 2.
I20260709 13:14:34.240350  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:34.241021  4103 raft_consensus.cc:2468] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 1.
I20260709 13:14:34.202051  5364 leader_election.cc:290] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:34.244151  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:34.245680  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:34.229122  5253 raft_consensus.cc:493] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.224648  5191 raft_consensus.cc:493] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:34.224972  5248 raft_consensus.cc:493] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:34.228072  5324 raft_consensus.cc:493] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:34.228236  5210 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.297569  5210 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:14:34.253441  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:34.299894  5210 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:34.253038  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:34.224650  5340 raft_consensus.cc:493] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.195187  5409 raft_consensus.cc:515] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:34.302382  4708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:34.239916  5293 raft_consensus.cc:493] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.303100  4708 raft_consensus.cc:2468] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 1.
I20260709 13:14:34.294646  5270 leader_election.cc:290] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:34.296365  4709 raft_consensus.cc:3060] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:34.237442  5322 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.306228  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:34.307552  5324 raft_consensus.cc:515] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:34.307243  5293 raft_consensus.cc:515] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:34.253783  5345 leader_election.cc:290] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:34.243342  5229 raft_consensus.cc:493] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.307634  5191 raft_consensus.cc:515] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:34.243137  5394 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:34.253971  4701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:34.307719  5253 raft_consensus.cc:515] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:34.255379  5251 raft_consensus.cc:493] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.255769  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:34.325315  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:34.326558  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:34.327227  3955 raft_consensus.cc:2468] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 2.
I20260709 13:14:34.327854  3957 raft_consensus.cc:2468] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:14:34.308215  4672 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
W20260709 13:14:34.334192  3997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:34.334862  3997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:34.335806  3997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:34.338362  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:34.339030  3950 raft_consensus.cc:2468] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 2.
I20260709 13:14:34.338188  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:34.340030  4709 raft_consensus.cc:2468] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3.
I20260709 13:14:34.329825  4672 leader_election.cc:304] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:34.314697  4701 raft_consensus.cc:2410] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:14:34.352066  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:34.361666  3954 raft_consensus.cc:2468] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:34.343343  5382 raft_consensus.cc:2804] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:34.363006  5382 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:34.363613  5382 raft_consensus.cc:3060] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:14:34.363735  3925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:34.364373  3925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:34.365250  3925 leader_election.cc:304] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:34.352802  3958 raft_consensus.cc:1275] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:34.315137  5191 leader_election.cc:290] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:34.355299  5387 raft_consensus.cc:2804] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:34.315742  5251 raft_consensus.cc:515] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:34.310669  5322 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:34.356019  5408 raft_consensus.cc:493] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.356237  5426 raft_consensus.cc:493] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.313674  5293 leader_election.cc:290] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:34.313282  5229 raft_consensus.cc:515] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:34.310900  5310 consensus_queue.cc:1048] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:14:34.313010  5324 leader_election.cc:290] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:34.303937  5340 raft_consensus.cc:515] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:34.343479  4700 raft_consensus.cc:2468] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 2.
I20260709 13:14:34.371116  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:34.370010  3925 leader_election.cc:304] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:34.371968  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:14:34.253587  5421 log.cc:927] Time spent T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:14:34.307648  5248 raft_consensus.cc:515] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:34.372766  5387 raft_consensus.cc:493] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:34.374126  5270 raft_consensus.cc:2804] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:34.380074  3958 raft_consensus.cc:2468] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:34.383071  5251 leader_election.cc:290] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:34.375491  3924 leader_election.cc:304] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:34.376940  5426 raft_consensus.cc:515] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:34.340047  3957 raft_consensus.cc:2468] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 2.
I20260709 13:14:34.387511  3924 leader_election.cc:304] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:34.389627  5293 raft_consensus.cc:2804] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:34.388525  5324 raft_consensus.cc:2804] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:34.390177  5293 raft_consensus.cc:697] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 3 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:34.390532  5324 raft_consensus.cc:493] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:34.391080  5324 raft_consensus.cc:3060] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:34.391248  5293 consensus_queue.cc:237] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:34.388541  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:34.393437  3957 raft_consensus.cc:2468] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 2.
I20260709 13:14:34.394580  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:34.377902  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:34.407218  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:34.407428  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:34.408387  3950 raft_consensus.cc:2468] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 2.
I20260709 13:14:34.408707  3957 raft_consensus.cc:2468] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 2.
I20260709 13:14:34.410647  3924 leader_election.cc:304] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:14:34.385735  5270 raft_consensus.cc:493] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:34.377359  5408 raft_consensus.cc:515] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:34.386067  5387 raft_consensus.cc:3060] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:34.380177  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:34.409685  5251 raft_consensus.cc:493] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.413945  5340 leader_election.cc:290] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:34.415278  5269 raft_consensus.cc:493] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.417340  5270 raft_consensus.cc:3060] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:34.417464  5191 raft_consensus.cc:2749] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:34.436875  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:34.438179  4700 raft_consensus.cc:2410] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:14:34.440421  5426 leader_election.cc:290] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:34.441398  5269 raft_consensus.cc:515] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:34.444319  5269 leader_election.cc:290] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:34.432474  5210 raft_consensus.cc:2804] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:34.445504  5263 consensus_queue.cc:260] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:34.450311  5322 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:34.423584  5394 raft_consensus.cc:493] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.429997  3954 raft_consensus.cc:2393] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 2: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:14:34.464923  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:34.465687  4099 raft_consensus.cc:2468] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 2.
I20260709 13:14:34.427912  4702 raft_consensus.cc:2468] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 1.
I20260709 13:14:34.454770  5359 raft_consensus.cc:493] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:34.467762  5359 raft_consensus.cc:515] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:34.468271  5408 leader_election.cc:290] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:34.469399  5310 raft_consensus.cc:493] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:34.470193  5359 leader_election.cc:290] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:34.431813  5251 raft_consensus.cc:515] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:34.469933  5310 raft_consensus.cc:515] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:34.456037  5394 raft_consensus.cc:515] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:34.451335  5253 leader_election.cc:290] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:34.470836  5248 leader_election.cc:290] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:34.477195  3957 raft_consensus.cc:1275] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:34.476830  4099 raft_consensus.cc:1275] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:34.628661  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:34.456071  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:34.585041  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:34.481587  4703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:34.634914  5229 leader_election.cc:290] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:34.648531  5191 raft_consensus.cc:493] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:34.649070  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:34.680631  5191 raft_consensus.cc:515] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:34.681458  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:34.682085  4099 raft_consensus.cc:2468] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 2.
I20260709 13:14:34.649827  5248 raft_consensus.cc:493] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:34.650924  5253 raft_consensus.cc:493] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:34.683844  5253 raft_consensus.cc:515] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:34.685690  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:34.650861  5382 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:34.653849  5210 raft_consensus.cc:493] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:34.654629  5269 raft_consensus.cc:493] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:34.655750  5426 raft_consensus.cc:493] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:34.644146  3924 leader_election.cc:304] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:35.222528  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:34.672488  4101 raft_consensus.cc:2393] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 3: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
W20260709 13:14:36.674736  3956 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38612 (request call id 784) took 2440 ms (client timeout 1539 ms). Trace:
W20260709 13:14:37.205179  3956 rpcz_store.cc:269] 0709 13:14:32.198264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:32.198449 (+   185us) service_pool.cc:224] Handling call
0709 13:14:34.638566 (+2440117us) spinlock_profiling.cc:243] Waited 763 ms on lock 0x7b54000be5d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:14:34.638722 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1754387712}
I20260709 13:14:37.207046  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:37.207959  3956 raft_consensus.cc:2468] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 2.
I20260709 13:14:36.770677  3951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1380) took 2453 ms. Trace:
I20260709 13:14:37.209571  3951 rpcz_store.cc:276] 0709 13:14:34.316925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:34.326792 (+  9867us) service_pool.cc:224] Handling call
0709 13:14:34.360091 (+ 33299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:34.392511 (+ 32420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:34.392546 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:34.392604 (+    58us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:14:34.392640 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:36.769834 (+2377194us) spinlock_profiling.cc:243] Waited 32.2 ms on lock 0x7b54001f7554. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:14:36.769959 (+   125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:36.770369 (+   410us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":73954688}
I20260709 13:14:37.211685  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:37.212705  3951 raft_consensus.cc:2393] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 in current term 3: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:14:37.213615  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:14:36.804302  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:36.818261  5442 raft_consensus.cc:493] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:14:37.214831  5442 raft_consensus.cc:515] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:37.209182  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:37.218214  5442 leader_election.cc:290] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:36.838078  5444 raft_consensus.cc:493] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:37.218618  3956 raft_consensus.cc:2468] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 2.
I20260709 13:14:37.219199  5444 raft_consensus.cc:515] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:37.221611  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:37.222582  3956 raft_consensus.cc:2468] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 2.
I20260709 13:14:37.222656  5444 leader_election.cc:290] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:36.843062  5445 raft_consensus.cc:493] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.844879  5446 raft_consensus.cc:493] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.223592  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:37.223554  5445 raft_consensus.cc:515] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:37.223865  5446 raft_consensus.cc:515] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:37.224593  3956 raft_consensus.cc:2468] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 2.
I20260709 13:14:37.226192  5445 leader_election.cc:290] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:37.226568  5446 leader_election.cc:290] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:37.040946  3888 debug-util.cc:398] Leaking SignalData structure 0x7b0800039dc0 after lost signal to thread 2846
I20260709 13:14:37.064486  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:37.227973  3952 raft_consensus.cc:2393] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 2: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
W20260709 13:14:37.228257  3888 debug-util.cc:398] Leaking SignalData structure 0x7b08000344a0 after lost signal to thread 3891
W20260709 13:14:37.228480  3952 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38606 (request call id 1392) took 2901 ms (client timeout 2032 ms). Trace:
W20260709 13:14:37.228945  3952 rpcz_store.cc:269] 0709 13:14:34.326730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:34.340870 (+ 14140us) service_pool.cc:224] Handling call
0709 13:14:37.063873 (+2723003us) spinlock_profiling.cc:243] Waited 3.12 ms on lock 0x7b5800002d98. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f1522549b71 00007f1522549a22 00007f152b462c09 00007f152a5bcee0 00007f152a6860ab 00007f152a686131 00007f152a6340a0 00007f152a633984 00007f1523bae6d4 00007f1523bae662
0709 13:14:37.228390 (+164517us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7183744}
W20260709 13:14:37.068313  3955 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38606 (request call id 1393) took 2730 ms (client timeout 2351 ms). Trace:
W20260709 13:14:37.229792  3888 debug-util.cc:398] Leaking SignalData structure 0x7b0800359fe0 after lost signal to thread 3983
W20260709 13:14:37.230178  3888 debug-util.cc:398] Leaking SignalData structure 0x7b080034a540 after lost signal to thread 3984
W20260709 13:14:37.230020  3955 rpcz_store.cc:269] 0709 13:14:34.337489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.067880 (+2730391us) service_pool.cc:211] Skipping call since client already timed out
0709 13:14:37.068039 (+   159us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:14:37.069546  5450 raft_consensus.cc:2804] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:37.231012  5450 raft_consensus.cc:493] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:37.231453  5450 raft_consensus.cc:3060] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:14:37.231618  3888 debug-util.cc:398] Leaking SignalData structure 0x7b0800357bc0 after lost signal to thread 4058
W20260709 13:14:37.232034  3888 debug-util.cc:398] Leaking SignalData structure 0x7b0800357a60 after lost signal to thread 4059
W20260709 13:14:37.232872  3888 debug-util.cc:398] Leaking SignalData structure 0x7b0800357be0 after lost signal to thread 4103
W20260709 13:14:37.233140  3888 debug-util.cc:398] Leaking SignalData structure 0x7b08003039e0 after lost signal to thread 4105
W20260709 13:14:37.233412  3888 debug-util.cc:398] Leaking SignalData structure 0x7b0800357c80 after lost signal to thread 4107
W20260709 13:14:37.234086  3888 debug-util.cc:398] Leaking SignalData structure 0x7b0800279b80 after lost signal to thread 4132
W20260709 13:14:37.234380  3888 debug-util.cc:398] Leaking SignalData structure 0x7b080030b1e0 after lost signal to thread 4133
W20260709 13:14:37.234814  3888 debug-util.cc:398] Leaking SignalData structure 0x7b080028ea40 after lost signal to thread 4672
W20260709 13:14:37.065480  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 2.421e+06us
W20260709 13:14:37.235512  3888 debug-util.cc:398] Leaking SignalData structure 0x7b080010bec0 after lost signal to thread 4700
W20260709 13:14:37.236653  3888 debug-util.cc:398] Leaking SignalData structure 0x7b08000a1080 after lost signal to thread 4702
W20260709 13:14:37.237020  3888 debug-util.cc:398] Leaking SignalData structure 0x7b080022f440 after lost signal to thread 4703
W20260709 13:14:37.237676  3888 debug-util.cc:398] Leaking SignalData structure 0x7b080009a060 after lost signal to thread 4707
W20260709 13:14:37.238281  3888 debug-util.cc:398] Leaking SignalData structure 0x7b0800369000 after lost signal to thread 4709
W20260709 13:14:36.768566  3997 connection.cc:256] RPC call timeout handler was delayed by -2.0746835429999919s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1636s for a response
W20260709 13:14:37.337884  3997 connection.cc:256] RPC call timeout handler was delayed by -1.7497835430001487s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19970000000000002s for a response
W20260709 13:14:37.338292  3997 connection.cc:256] RPC call timeout handler was delayed by -1.7389835430001312s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2009s for a response
W20260709 13:14:36.884799  3998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:36.709524  3999 connection.cc:256] RPC call timeout handler was delayed by -1.1520810820002225s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1507s for a response
W20260709 13:14:37.346289  3999 leader_election.cc:336] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117): Timed out: RequestConsensusVote RPC to 127.2.198.196:37117 timed out after 1.507s (SENT)
I20260709 13:14:36.836736  4026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38290 (request call id 1349) took 2693 ms. Trace:
W20260709 13:14:36.815160  4032 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38290 (request call id 1339) took 2766 ms (client timeout 1687 ms). Trace:
W20260709 13:14:37.351222  4032 rpcz_store.cc:269] 0709 13:14:34.048098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:34.048212 (+   114us) service_pool.cc:224] Handling call
0709 13:14:36.814426 (+2766214us) spinlock_profiling.cc:243] Waited 71.1 ms on lock 0x7b5400397454. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:14:36.814737 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":163521920}
I20260709 13:14:36.888480  4034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38290 (request call id 1342) took 2817 ms. Trace:
W20260709 13:14:36.746695  4071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:36.843576  4072 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.623s	user 0.017s	sys 0.033s
W20260709 13:14:36.913133  4073 connection.cc:256] RPC call timeout handler was delayed by -1.2111239870000645s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1998s for a response
I20260709 13:14:34.675526  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:14:37.056370  4099 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45332 (request call id 1331) took 2416 ms (client timeout 1675 ms). Trace:
I20260709 13:14:37.073149  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:36.748729  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:14:37.018146  4102 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45332 (request call id 1340) took 2363 ms (client timeout 1685 ms). Trace:
W20260709 13:14:35.445791  4105 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.797s	user 0.024s	sys 0.035s
I20260709 13:14:36.898756  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:34.686620  4107 raft_consensus.cc:2468] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 2.
I20260709 13:14:35.766826  4108 raft_consensus.cc:1240] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 LEADER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 1. Current term is 2. Ops: []
W20260709 13:14:36.865243  4675 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.242s	user 0.028s	sys 0.024s
I20260709 13:14:36.851894  4701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:34.776059  4700 raft_consensus.cc:2393] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 3: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
I20260709 13:14:35.705976  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:34.679816  4703 raft_consensus.cc:2468] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 2.
I20260709 13:14:36.902410  4704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:35.324342  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:35.224496  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:36.865553  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:37.031306  4708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57666 (request call id 279) took 1774 ms. Trace:
W20260709 13:14:35.699506  5229 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.991s	user 0.039s	sys 0.120s
W20260709 13:14:37.377904  5229 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.692s	user 0.041s	sys 0.120s
I20260709 13:14:37.353315  4034 rpcz_store.cc:276] 0709 13:14:34.070773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:34.072505 (+  1732us) service_pool.cc:224] Handling call
0709 13:14:34.083334 (+ 10829us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:34.083652 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:34.084277 (+   625us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:34.091237 (+  6960us) log.cc:844] Serialized 26 byte log entry
0709 13:14:36.882412 (+2791175us) spinlock_profiling.cc:243] Waited 7.37 ms on lock 0x7b18002829a0. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f1522563e07 00007f152b3beab9 00007f152258069b 00007f152257e93f 00007f1522580c02 00007f152520820b 00007f152520dd23 00007f152520e0d1 00007f1525629a0f
0709 13:14:36.887658 (+  5246us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:14:36.887717 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:36.887836 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:36.887904 (+    68us) raft_consensus.cc:1685] finished
0709 13:14:36.887917 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:36.888248 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":97,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":6168,"spinlock_wait_cycles":16945920,"thread_start_us":4893,"threads_started":1,"wal-append.queue_time_us":2792677}
I20260709 13:14:37.353415  5445 raft_consensus.cc:493] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.379990  5445 raft_consensus.cc:515] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:37.382362  5445 leader_election.cc:290] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:35.387084  5191 leader_election.cc:290] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:37.353731  5444 raft_consensus.cc:493] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.386426  5444 raft_consensus.cc:515] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:37.389963  5444 leader_election.cc:290] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:14:37.353945  3997 connection.cc:256] RPC call timeout handler was delayed by -1.5382835430000341s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22320000000000004s for a response
W20260709 13:14:37.390998  3997 connection.cc:256] RPC call timeout handler was delayed by -1.4501604440001756s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1511s for a response
W20260709 13:14:37.391304  3997 connection.cc:256] RPC call timeout handler was delayed by -1.4501604440001756s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1511s for a response
W20260709 13:14:37.391607  3997 connection.cc:256] RPC call timeout handler was delayed by -1.2233604440000363s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1763s for a response
W20260709 13:14:37.391909  3997 connection.cc:256] RPC call timeout handler was delayed by -1.1531604440001502s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1841s for a response
W20260709 13:14:37.392186  3997 connection.cc:256] RPC call timeout handler was delayed by -1.1522604440001487s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18420000000000003s for a response
W20260709 13:14:37.392467  3997 connection.cc:256] RPC call timeout handler was delayed by -1.1522604440001487s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18420000000000003s for a response
I20260709 13:14:34.715947  5210 raft_consensus.cc:3060] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:34.682960  5248 raft_consensus.cc:515] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:36.997833  5250 leader_election.cc:290] T 86669993fba94e65ba192aa115ed6e88 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:34.907909  5251 leader_election.cc:290] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:34.686053  5253 leader_election.cc:290] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:37.401943  5248 leader_election.cc:290] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:34.763311  5269 raft_consensus.cc:515] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:34.671394  5270 raft_consensus.cc:515] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:37.007822  5293 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.386s	user 0.003s	sys 0.011s
W20260709 13:14:37.360728  4104 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45336 (request call id 863) took 3327 ms (client timeout 1511 ms). Trace:
W20260709 13:14:37.407572  5293 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.795s	user 0.004s	sys 0.012s
W20260709 13:14:37.407848  4104 rpcz_store.cc:269] 0709 13:14:34.033396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:34.033523 (+   127us) service_pool.cc:224] Handling call
0709 13:14:36.748073 (+2714550us) spinlock_profiling.cc:243] Waited 2.73 ms on lock 0x7b5800011798. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f1522549b71 00007f1522549a22 00007f152b462c09 00007f152a5bcee0 00007f152a6860ab 00007f152a686131 00007f152a6340a0 00007f152a633984 00007f1523bae6d4 00007f1523bae662
0709 13:14:37.360652 (+612579us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6273408}
I20260709 13:14:34.870427  5299 raft_consensus.cc:493] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
W20260709 13:14:37.361735  4102 rpcz_store.cc:269] 0709 13:14:34.654224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.017693 (+2363469us) service_pool.cc:211] Skipping call since client already timed out
0709 13:14:37.017892 (+   199us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:14:37.410945  4102 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45332 (request call id 1325) took 2824 ms (client timeout 1830 ms). Trace:
I20260709 13:14:37.144542  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:14:37.411484  4102 rpcz_store.cc:269] 0709 13:14:34.586306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.410716 (+2824410us) service_pool.cc:211] Skipping call since client already timed out
0709 13:14:37.410862 (+   146us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:14:37.412029  3958 raft_consensus.cc:2468] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 2.
W20260709 13:14:37.412448  4102 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45332 (request call id 1336) took 2760 ms (client timeout 1781 ms). Trace:
I20260709 13:14:36.809837  5237 raft_consensus.cc:493] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:37.362346  4105 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.714s	user 0.027s	sys 0.035s
I20260709 13:14:37.146320  3953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1391) took 2819 ms. Trace:
I20260709 13:14:37.147089  3954 raft_consensus.cc:1275] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:37.414703  4105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34656 (request call id 72) took 2975 ms. Trace:
I20260709 13:14:37.374153  4709 raft_consensus.cc:2368] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 2. Current term is 3.
I20260709 13:14:35.548200  5310 leader_election.cc:290] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:34.652349  5322 raft_consensus.cc:493] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:37.368749  4701 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57680 (request call id 382) took 2995 ms (client timeout 1979 ms). Trace:
I20260709 13:14:35.262864  5382 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:37.421691  4709 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57666 (request call id 278) took 2197 ms (client timeout 2777 ms). Trace:
W20260709 13:14:34.942687  5387 consensus_meta.cc:287] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938: Time spent flushing consensus metadata: real 0.509s	user 0.009s	sys 0.003s
I20260709 13:14:35.425972  5394 leader_election.cc:290] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:37.405879  3951 raft_consensus.cc:2468] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 2.
I20260709 13:14:35.118569  5404 raft_consensus.cc:493] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:37.420667  4701 rpcz_store.cc:269] 0709 13:14:34.373339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:34.374727 (+  1388us) service_pool.cc:224] Handling call
0709 13:14:36.851348 (+2476621us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b5800003f98. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f1522549b71 00007f1522549a22 00007f152b462c09 00007f152a5bcee0 00007f152a6860ab 00007f152a686131 00007f152a6340a0 00007f152a633984 00007f1523bae6d4 00007f1523bae662
0709 13:14:37.368606 (+517258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4809600}
I20260709 13:14:37.426154  5404 raft_consensus.cc:515] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:37.427140  4701 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57692 (request call id 176) took 1878 ms (client timeout 1507 ms). Trace:
W20260709 13:14:35.705343  5430 log.cc:927] Time spent T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.736s	user 0.001s	sys 0.001s
I20260709 13:14:36.265246  5436 raft_consensus.cc:493] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:37.431869  5436 raft_consensus.cc:515] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:36.708284  5439 raft_consensus.cc:493] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.709667  5441 raft_consensus.cc:493] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:37.442812  5441 raft_consensus.cc:515] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:37.445866  5441 leader_election.cc:290] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:37.148656  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:36.769411  5440 raft_consensus.cc:493] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.448215  5440 raft_consensus.cc:515] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:36.687788  5438 raft_consensus.cc:493] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.452858  5438 raft_consensus.cc:515] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:35.478160  5432 raft_consensus.cc:493] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:35.448419  5431 raft_consensus.cc:493] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.459795  5431 raft_consensus.cc:515] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:37.461077  4707 raft_consensus.cc:2468] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 2.
I20260709 13:14:34.763166  5426 raft_consensus.cc:515] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:36.745463  5403 raft_consensus.cc:493] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:36.714303  5370 raft_consensus.cc:3055] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:37.474592  5370 raft_consensus.cc:740] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:36.810734  5364 raft_consensus.cc:493] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.476969  5364 raft_consensus.cc:515] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:37.043184  5353 raft_consensus.cc:3060] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:37.465068  5210 raft_consensus.cc:515] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:37.153498  4101 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45332 (request call id 1322) took 2569 ms (client timeout 1585 ms). Trace:
I20260709 13:14:37.154191  3922 leader_election.cc:304] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
W20260709 13:14:37.483731  4101 rpcz_store.cc:269] 0709 13:14:34.584502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:34.584678 (+   176us) service_pool.cc:224] Handling call
0709 13:14:37.153239 (+2568561us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:37.484756  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 330934us
I20260709 13:14:37.485886  3922 leader_election.cc:304] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:37.486425  5370 consensus_queue.cc:260] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:37.213822  5341 raft_consensus.cc:493] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.487963  5370 raft_consensus.cc:3060] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:37.488000  5341 raft_consensus.cc:515] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:37.490564  5341 leader_election.cc:290] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:36.991851  3957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1405) took 2651 ms. Trace:
I20260709 13:14:37.491199  3957 rpcz_store.cc:276] 0709 13:14:34.340471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:34.409763 (+ 69292us) service_pool.cc:224] Handling call
0709 13:14:34.410044 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:34.629402 (+219358us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:36.991260 (+2361858us) spinlock_profiling.cc:243] Waited 66.8 ms on lock 0x7b5400218ed4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:14:36.991669 (+   409us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":153681664}
I20260709 13:14:37.492410  5293 raft_consensus.cc:3060] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:37.479406  5364 leader_election.cc:290] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:37.239326  3888 debug-util.cc:398] Leaking SignalData structure 0x7b0800213c40 after lost signal to thread 4733
I20260709 13:14:37.253260  5450 raft_consensus.cc:515] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:14:37.495770  3888 debug-util.cc:398] Leaking SignalData structure 0x7b080026e120 after lost signal to thread 4734
I20260709 13:14:37.258740  5453 raft_consensus.cc:493] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:37.496601  3888 debug-util.cc:398] Leaking SignalData structure 0x7b08001ef1e0 after lost signal to thread 5324
W20260709 13:14:37.497200  3888 debug-util.cc:398] Leaking SignalData structure 0x7b08001afce0 after lost signal to thread 5375
I20260709 13:14:37.496677  5453 raft_consensus.cc:515] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:37.261051  4028 consensus_queue.cc:237] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:37.240854  3856 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52094 (request call id 197) took 7158 ms. Trace:
I20260709 13:14:37.264948  5454 raft_consensus.cc:493] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:37.501718  5454 raft_consensus.cc:515] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:37.269888  5455 raft_consensus.cc:493] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.272224  5451 raft_consensus.cc:493] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.274036  3948 tablet_service.cc:1558] Processing DeleteTablet for tablet 86669993fba94e65ba192aa115ed6e88 with delete_type TABLET_DATA_TOMBSTONED (TS f1c75790cedf4f52a3463a255c7da059 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38604
W20260709 13:14:34.930275  4672 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 2.082s (SENT) [suppressed 16 similar messages]
I20260709 13:14:37.298280  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:37.507938  5426 leader_election.cc:290] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:37.315939  3857 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44680 (request call id 117) took 5926 ms. Trace:
I20260709 13:14:37.319769  5263 raft_consensus.cc:3060] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:37.323339  4074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:37.333768  3853 catalog_manager.cc:5697] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 1 to 2, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 2 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:37.349885  4026 rpcz_store.cc:276] 0709 13:14:34.143373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:34.143492 (+   119us) service_pool.cc:224] Handling call
0709 13:14:34.143895 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:34.144376 (+   481us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:34.144420 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:34.154882 (+ 10462us) log.cc:844] Serialized 26 byte log entry
0709 13:14:36.818704 (+2663822us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b1800042a60. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f1522563e07 00007f152b3beab9 00007f152258069b 00007f152257e93f 00007f1522580c02 00007f152520820b 00007f152520dd23 00007f152520e0d1 00007f1525629a0f
0709 13:14:36.835851 (+ 17147us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:14:36.835895 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:36.836025 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:36.836087 (+    62us) raft_consensus.cc:1685] finished
0709 13:14:36.836102 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:36.836474 (+   372us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":337,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":4164,"spinlock_wait_cycles":39168768,"thread_start_us":16831,"threads_started":1,"wal-append.queue_time_us":2678109}
I20260709 13:14:37.352283  5446 raft_consensus.cc:493] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:37.356663  4072 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.154s	user 0.021s	sys 0.033s
W20260709 13:14:37.403028  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:37.357280  4073 connection.cc:256] RPC call timeout handler was delayed by -1.1773114170000554s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2074s for a response
W20260709 13:14:37.534233  4073 connection.cc:256] RPC call timeout handler was delayed by -1.1233114170001954s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2134s for a response
W20260709 13:14:37.534578  4073 connection.cc:256] RPC call timeout handler was delayed by -1.1159871640002166s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2777s for a response
W20260709 13:14:37.535002  4073 connection.cc:256] RPC call timeout handler was delayed by -1.1053114170001663s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2154s for a response
W20260709 13:14:37.535362  4073 connection.cc:256] RPC call timeout handler was delayed by -1.0582443989999319s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19110000000000002s for a response
I20260709 13:14:37.359654  4100 raft_consensus.cc:2468] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 2.
W20260709 13:14:37.409533  4104 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45332 (request call id 1326) took 2823 ms (client timeout 1769 ms). Trace:
W20260709 13:14:37.536231  4104 rpcz_store.cc:269] 0709 13:14:34.586580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.409285 (+2822705us) service_pool.cc:211] Skipping call since client already timed out
0709 13:14:37.409442 (+   157us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:14:37.532898  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 2.60235e+06us
W20260709 13:14:37.363292  4106 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45336 (request call id 856) took 3356 ms (client timeout 1842 ms). Trace:
W20260709 13:14:37.364007  4107 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34656 (request call id 70) took 3115 ms (client timeout 1531 ms). Trace:
I20260709 13:14:37.366183  4108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45336 (request call id 858) took 3349 ms. Trace:
W20260709 13:14:37.354077  4071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:37.414062  5237 raft_consensus.cc:515] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:37.371359  4702 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57666 (request call id 283) took 2025 ms (client timeout 1552 ms). Trace:
W20260709 13:14:37.351967  3998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:37.410907  5299 raft_consensus.cc:515] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:37.357980  4103 raft_consensus.cc:2468] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 2.
W20260709 13:14:35.723351  5324 consensus_meta.cc:287] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 1.331s	user 0.018s	sys 0.002s
I20260709 13:14:37.405320  3950 raft_consensus.cc:1240] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 2. Current term is 3. Ops: []
W20260709 13:14:37.538612  4702 rpcz_store.cc:269] 0709 13:14:35.346067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:35.700852 (+354785us) service_pool.cc:224] Handling call
0709 13:14:37.371121 (+1670269us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:37.542546  4702 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57666 (request call id 282) took 2213 ms (client timeout 2074 ms). Trace:
W20260709 13:14:37.367672  4675 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.745s	user 0.030s	sys 0.024s
W20260709 13:14:37.543385  4675 connection.cc:256] RPC call timeout handler was delayed by -1.0227429569999913s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2082s for a response
W20260709 13:14:37.371964  4703 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57680 (request call id 379) took 3083 ms (client timeout 2212 ms). Trace:
W20260709 13:14:37.422739  3999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 68471.6us
I20260709 13:14:37.544768  4675 leader_election.cc:304] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:37.372797  4704 raft_consensus.cc:3060] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:14:37.545934  4103 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45332 (request call id 1338) took 2892 ms (client timeout 1509 ms). Trace:
W20260709 13:14:37.422290  4709 rpcz_store.cc:269] 0709 13:14:35.224041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:35.224216 (+   175us) service_pool.cc:224] Handling call
0709 13:14:37.421581 (+2197365us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:37.370350  4700 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57680 (request call id 384) took 2915 ms (client timeout 2229 ms). Trace:
I20260709 13:14:34.659708  5400 leader_election.cc:290] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:37.424296  5387 raft_consensus.cc:515] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:37.564699  5455 raft_consensus.cc:515] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:37.358537  4099 rpcz_store.cc:269] 0709 13:14:34.639707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:34.682659 (+ 42952us) service_pool.cc:224] Handling call
0709 13:14:37.056125 (+2373466us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:36.608105  5409 leader_election.cc:290] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Requested vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:14:37.580190  4099 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45332 (request call id 1332) took 2940 ms (client timeout 1979 ms). Trace:
I20260709 13:14:37.428128  5322 raft_consensus.cc:515] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:37.572451  5394 raft_consensus.cc:493] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:37.581557  5301 raft_consensus.cc:493] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
W20260709 13:14:37.582437  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:37.582545  5322 leader_election.cc:290] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:37.582358  5301 raft_consensus.cc:515] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:37.415975  3953 rpcz_store.cc:276] 0709 13:14:34.326407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:34.327875 (+  1468us) service_pool.cc:224] Handling call
0709 13:14:37.144995 (+2817120us) spinlock_profiling.cc:243] Waited 5.78 ms on lock 0x7b5800002d98. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f1522549b71 00007f1522549a22 00007f152b462c09 00007f152a5bcee0 00007f152a6860ab 00007f152a686131 00007f152a647fc0 00007f152a632929 00007f152a6323d2 00007f1523ba9bd4
0709 13:14:37.145357 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:37.145747 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:37.145775 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:37.145826 (+    51us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:14:37.145867 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:37.145939 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:37.146104 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13290752}
I20260709 13:14:37.376046  4708 rpcz_store.cc:276] 0709 13:14:35.257334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:35.257630 (+   296us) service_pool.cc:224] Handling call
0709 13:14:37.030077 (+1772447us) spinlock_profiling.cc:243] Waited 24.7 ms on lock 0x7b5800003f98. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f1522549b71 00007f1522549a22 00007f152b462c09 00007f152a5bcee0 00007f152a6860ab 00007f152a686131 00007f152a647fc0 00007f152a632929 00007f152a6323d2 00007f1523ba9bd4
0709 13:14:37.030444 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:37.030776 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:37.030795 (+    19us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:37.030850 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:37.030867 (+    17us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:37.030932 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:37.031092 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56789248}
W20260709 13:14:37.555713  4700 rpcz_store.cc:269] 0709 13:14:34.455257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:34.455760 (+   503us) service_pool.cc:224] Handling call
0709 13:14:37.370004 (+2914244us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b54005979d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:14:37.370161 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":234264448}
W20260709 13:14:37.584264  4700 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57666 (request call id 290) took 2038 ms (client timeout 1911 ms). Trace:
W20260709 13:14:37.584323  4708 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57666 (request call id 281) took 2257 ms (client timeout 2154 ms). Trace:
I20260709 13:14:37.434895  5436 leader_election.cc:290] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:37.406466  5270 leader_election.cc:290] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:37.584645  5301 leader_election.cc:290] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:37.405612  5269 leader_election.cc:290] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:37.416743  4105 rpcz_store.cc:276] 0709 13:14:34.451597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:34.454465 (+  2868us) service_pool.cc:224] Handling call
0709 13:14:34.456130 (+  1665us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:34.477239 (+ 21109us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:34.477280 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:34.648276 (+170996us) log.cc:844] Serialized 26 byte log entry
0709 13:14:37.414216 (+2765940us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:37.414281 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:37.414388 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:37.414447 (+    59us) raft_consensus.cc:1685] finished
0709 13:14:37.414464 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:37.414641 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9531,"raft.queue_time_us":9894,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":95,"thread_start_us":2765360,"threads_started":1,"wal-append.queue_time_us":1071799,"wal-append.run_cpu_time_us":2752,"wal-append.run_wall_time_us":1008338}
I20260709 13:14:37.441372  4705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57680 (request call id 374) took 3203 ms. Trace:
I20260709 13:14:37.457831  5438 leader_election.cc:290] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:37.457266  5440 leader_election.cc:290] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:37.587523  4705 rpcz_store.cc:276] 0709 13:14:34.238111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:34.239799 (+  1688us) service_pool.cc:224] Handling call
0709 13:14:37.005152 (+2765353us) spinlock_profiling.cc:243] Waited 7.61 ms on lock 0x7b5800003f98. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f1522549b71 00007f1522549a22 00007f152b462c09 00007f152a5bcee0 00007f152a6860ab 00007f152a686131 00007f152a647fc0 00007f152a632929 00007f152a6323d2 00007f1523ba9bd4
0709 13:14:37.005602 (+   450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:37.437320 (+431718us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:37.437379 (+    59us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:37.437450 (+    71us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:37.437502 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:37.440846 (+  3344us) spinlock_profiling.cc:243] Waited 431 ms on lock 0x7b54006301d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:14:37.440921 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:37.441113 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1009476736}
W20260709 13:14:37.462287  4707 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57666 (request call id 280) took 2171 ms (client timeout 2773 ms). Trace:
I20260709 13:14:37.538384  5451 raft_consensus.cc:515] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:37.589821  4707 rpcz_store.cc:269] 0709 13:14:35.290794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:35.291032 (+   238us) service_pool.cc:224] Handling call
0709 13:14:37.462083 (+2171051us) spinlock_profiling.cc:243] Waited 87.6 ms on lock 0x7b5400598654. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:14:37.462224 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":201520896}
W20260709 13:14:37.590286  4705 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57666 (request call id 285) took 2202 ms (client timeout 2134 ms). Trace:
W20260709 13:14:37.591068  4707 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57692 (request call id 179) took 2041 ms (client timeout 1984 ms). Trace:
I20260709 13:14:37.544800  5237 leader_election.cc:290] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:37.591516  4707 rpcz_store.cc:269] 0709 13:14:35.558993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.590864 (+2031871us) service_pool.cc:211] Skipping call since client already timed out
0709 13:14:37.591009 (+   145us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:14:37.565121  5426 raft_consensus.cc:493] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:37.591894  4105 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45332 (request call id 1334) took 2951 ms (client timeout 2073 ms). Trace:
W20260709 13:14:37.546576  4100 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34656 (request call id 64) took 3674 ms (client timeout 2082 ms). Trace:
I20260709 13:14:37.592054  5451 leader_election.cc:290] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:37.592559  5426 raft_consensus.cc:515] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:37.472340  5403 raft_consensus.cc:515] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:37.484922  4101 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45332 (request call id 1333) took 2844 ms (client timeout 1935 ms). Trace:
I20260709 13:14:37.499706  3856 rpcz_store.cc:276] 0709 13:14:30.082760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:30.090968 (+  8208us) service_pool.cc:224] Handling call
0709 13:14:37.240579 (+7149611us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:32.155030 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:32.220816 (+ 65786us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:32.228774 (+  7958us) write_op.cc:435] Acquired schema lock
0709 13:14:32.230961 (+  2187us) tablet.cc:662] Decoding operations
0709 13:14:32.348043 (+117082us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:32.348124 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:32.348179 (+    55us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:14:32.353633 (+  5454us) tablet.cc:701] Row locks acquired
0709 13:14:32.353664 (+    31us) write_op.cc:260] PREPARE: finished
0709 13:14:32.353874 (+   210us) write_op.cc:270] Start()
0709 13:14:32.354062 (+   188us) write_op.cc:276] Timestamp: P: 1783602872353822 usec, L: 0
0709 13:14:32.354094 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:14:32.395949 (+ 41855us) log.cc:844] Serialized 2065 byte log entry
0709 13:14:33.991719 (+1595770us) op_driver.cc:464] REPLICATION: finished
0709 13:14:34.075866 (+ 84147us) write_op.cc:301] APPLY: starting
0709 13:14:34.075957 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:34.076122 (+   165us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:34.076255 (+   133us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:34.091334 (+ 15079us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:34.092113 (+   779us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:14:34.092159 (+    46us) write_op.cc:312] APPLY: finished
0709 13:14:34.092432 (+   273us) log.cc:844] Serialized 47 byte log entry
0709 13:14:34.092618 (+   186us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:34.092740 (+   122us) write_op.cc:454] Released schema lock
0709 13:14:34.092793 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:34.111516 (+ 18723us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:34.111566 (+    50us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":111316,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":82601,"apply.run_cpu_time_us":2833,"apply.run_wall_time_us":32141,"num_ops":5,"prepare.queue_time_us":215125,"prepare.run_cpu_time_us":89862,"prepare.run_wall_time_us":1085360,"raft.queue_time_us":110415,"raft.run_cpu_time_us":8611,"raft.run_wall_time_us":91730,"replication_time_us":1624235,"thread_start_us":995202,"threads_started":4,"wal-append.queue_time_us":1011799,"wal-append.run_cpu_time_us":39642,"wal-append.run_wall_time_us":1705955}]]}
W20260709 13:14:37.270397  3924 connection.cc:256] RPC call timeout handler was delayed by -1.262437170000112s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1965s for a response
W20260709 13:14:37.572342  4074 connection.cc:256] RPC call timeout handler was delayed by -1.7629542229999515s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16870000000000002s for a response
I20260709 13:14:37.462201  5431 leader_election.cc:290] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:37.593703  4101 rpcz_store.cc:269] 0709 13:14:34.640263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.484694 (+2844431us) service_pool.cc:211] Skipping call since client already timed out
0709 13:14:37.484838 (+   144us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:14:37.512271  3959 raft_consensus.cc:2368] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 for earlier term 2. Current term is 3.
I20260709 13:14:37.511075  3857 rpcz_store.cc:276] 0709 13:14:31.389769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:31.389911 (+   142us) service_pool.cc:224] Handling call
0709 13:14:37.315682 (+5925771us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":3}
W20260709 13:14:37.594184  3924 connection.cc:256] RPC call timeout handler was delayed by -1.1144150920001721s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19790000000000002s for a response
W20260709 13:14:37.597332  3924 connection.cc:256] RPC call timeout handler was delayed by -1.04013716999998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22120000000000004s for a response
I20260709 13:14:37.532203  5210 leader_election.cc:290] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:37.593024  4100 rpcz_store.cc:269] 0709 13:14:33.866545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:33.869407 (+  2862us) service_pool.cc:224] Handling call
0709 13:14:37.069930 (+3200523us) spinlock_profiling.cc:243] Waited 3.1 ms on lock 0x7b5800011798. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f1522549b71 00007f1522549a22 00007f152b462c09 00007f152a5bcee0 00007f152a6860ab 00007f152a686131 00007f152a6340a0 00007f152a633984 00007f1523bae6d4 00007f1523bae662
0709 13:14:37.539192 (+469262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7124352}
I20260709 13:14:37.597586  5403 leader_election.cc:290] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:37.485904  5248 raft_consensus.cc:2804] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:14:37.412900  4102 rpcz_store.cc:269] 0709 13:14:34.653000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.412274 (+2759274us) service_pool.cc:211] Skipping call since client already timed out
0709 13:14:37.412392 (+   118us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:14:37.598289  5248 raft_consensus.cc:493] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:37.598443  4100 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45332 (request call id 1329) took 3011 ms (client timeout 2186 ms). Trace:
W20260709 13:14:37.537073  4106 rpcz_store.cc:269] 0709 13:14:34.006915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:34.016993 (+ 10078us) service_pool.cc:224] Handling call
0709 13:14:36.898388 (+2881395us) spinlock_profiling.cc:243] Waited 1.83 ms on lock 0x7b5800011798. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f1522549b71 00007f1522549a22 00007f152b462c09 00007f152a5bcee0 00007f152a6860ab 00007f152a686131 00007f152a6340a0 00007f152a633984 00007f1523bae6d4 00007f1523bae662
0709 13:14:37.363218 (+464830us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4210048}
I20260709 13:14:37.598762  5248 raft_consensus.cc:3060] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:14:37.592499  4105 rpcz_store.cc:269] 0709 13:14:34.640496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.591700 (+2951204us) service_pool.cc:211] Skipping call since client already timed out
0709 13:14:37.591831 (+   131us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:14:37.599622  4106 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45332 (request call id 1339) took 2945 ms (client timeout 2229 ms). Trace:
I20260709 13:14:37.542191  5324 raft_consensus.cc:515] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:14:37.599783  4105 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45332 (request call id 1335) took 2959 ms (client timeout 2617 ms). Trace:
W20260709 13:14:37.600214  4105 rpcz_store.cc:269] 0709 13:14:34.640720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.599594 (+2958874us) service_pool.cc:211] Skipping call since client already timed out
0709 13:14:37.599724 (+   130us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:14:37.600553  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:37.601565  3951 raft_consensus.cc:2468] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:37.602006  5324 leader_election.cc:290] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 election: Requested vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:37.602341  4105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34656 (request call id 75) took 2652 ms. Trace:
W20260709 13:14:37.600037  4106 rpcz_store.cc:269] 0709 13:14:34.653925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.599374 (+2945449us) service_pool.cc:211] Skipping call since client already timed out
0709 13:14:37.599532 (+   158us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:14:37.598704  4102 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45332 (request call id 1328) took 3011 ms (client timeout 2212 ms). Trace:
W20260709 13:14:37.603845  4102 rpcz_store.cc:269] 0709 13:14:34.587119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.598508 (+3011389us) service_pool.cc:211] Skipping call since client already timed out
0709 13:14:37.598638 (+   130us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:14:37.375349  4706 raft_consensus.cc:2410] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:14:37.540825  4071 connection.cc:256] RPC call timeout handler was delayed by -1.5768700789999457s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2054s for a response
W20260709 13:14:37.605230  4071 connection.cc:256] RPC call timeout handler was delayed by -1.4678867109998919s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20320000000000002s for a response
W20260709 13:14:37.605394  4706 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57680 (request call id 381) took 3311 ms (client timeout 2778 ms). Trace:
W20260709 13:14:37.550062  4709 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57666 (request call id 287) took 2125 ms (client timeout 1998 ms). Trace:
I20260709 13:14:37.550915  5382 raft_consensus.cc:2804] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:14:37.606048  4709 rpcz_store.cc:269] 0709 13:14:35.424565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.549843 (+2125278us) service_pool.cc:211] Skipping call since client already timed out
0709 13:14:37.549997 (+   154us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:14:37.605954  4706 rpcz_store.cc:269] 0709 13:14:34.293908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:34.295095 (+  1187us) service_pool.cc:224] Handling call
0709 13:14:36.865026 (+2569931us) spinlock_profiling.cc:243] Waited 6.88 ms on lock 0x7b5800003f98. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f1522549b71 00007f1522549a22 00007f152b462c09 00007f152a5bcee0 00007f152a6860ab 00007f152a686131 00007f152a6340a0 00007f152a633984 00007f1523bae6d4 00007f1523bae662
0709 13:14:37.605306 (+740280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15834368}
I20260709 13:14:37.607370  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:14:37.607746  3999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 62496us
W20260709 13:14:37.608258  4709 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57666 (request call id 289) took 2070 ms (client timeout 2249 ms). Trace:
W20260709 13:14:37.608650  4709 rpcz_store.cc:269] 0709 13:14:35.538282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.606975 (+2068693us) service_pool.cc:224] Handling call
0709 13:14:37.608170 (+  1195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:37.537962  4108 rpcz_store.cc:276] 0709 13:14:34.016835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:34.017327 (+   492us) service_pool.cc:224] Handling call
0709 13:14:35.763235 (+1745908us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b5800011798. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f1522549b71 00007f1522549a22 00007f152b462c09 00007f152a5bcee0 00007f152a6860ab 00007f152a686131 00007f152a647fc0 00007f152a632929 00007f152a6323d2 00007f1523ba9bd4
0709 13:14:35.766510 (+  3275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:37.365664 (+1599154us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:37.365978 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4048128}
I20260709 13:14:37.543097  3950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1403) took 3203 ms. Trace:
I20260709 13:14:37.609920  5426 leader_election.cc:290] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:37.610049  3950 rpcz_store.cc:276] 0709 13:14:34.339947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:34.408992 (+ 69045us) service_pool.cc:224] Handling call
0709 13:14:34.409258 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:37.542008 (+3132750us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:37.542707 (+   699us) spinlock_profiling.cc:243] Waited 3 s on lock 0x7b5400217fd4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:14:37.543005 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6889324800}
W20260709 13:14:37.537675  4107 rpcz_store.cc:269] 0709 13:14:34.248699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:34.248861 (+   162us) service_pool.cc:224] Handling call
0709 13:14:34.685460 (+436599us) spinlock_profiling.cc:243] Waited 4.31 ms on lock 0x7b5800011798. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f1522549b71 00007f1522549a22 00007f152b462c09 00007f152a5bcee0 00007f152a6860ab 00007f152a686131 00007f152a6340a0 00007f152a633984 00007f1523bae6d4 00007f1523bae662
0709 13:14:37.363801 (+2678341us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9907072}
I20260709 13:14:37.611579  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:37.612392  3953 raft_consensus.cc:2468] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 2.
I20260709 13:14:37.602998  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:37.605955  5450 leader_election.cc:290] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:14:37.607810  4101 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45332 (request call id 1330) took 2968 ms (client timeout 2077 ms). Trace:
W20260709 13:14:37.616678  4101 rpcz_store.cc:269] 0709 13:14:34.638950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.596511 (+2957561us) service_pool.cc:211] Skipping call since client already timed out
0709 13:14:37.607703 (+ 11192us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:14:37.561151  3998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:37.619776  5444 raft_consensus.cc:493] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:37.621031  5438 raft_consensus.cc:493] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:37.624189  5438 raft_consensus.cc:515] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:37.626451  5438 leader_election.cc:290] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:37.546377  4103 rpcz_store.cc:269] 0709 13:14:34.653593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:34.675140 (+ 21547us) service_pool.cc:224] Handling call
0709 13:14:37.545811 (+2870671us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:37.579926  5387 leader_election.cc:290] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:37.427731  4701 rpcz_store.cc:269] 0709 13:14:35.548523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.426872 (+1878349us) service_pool.cc:211] Skipping call since client already timed out
0709 13:14:37.427019 (+   147us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:14:37.599996  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:14:37.561947  4104 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45332 (request call id 1327) took 2971 ms (client timeout 2015 ms). Trace:
I20260709 13:14:37.433490  5404 leader_election.cc:290] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:14:37.543097  4702 rpcz_store.cc:269] 0709 13:14:35.329268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.542300 (+2213032us) service_pool.cc:211] Skipping call since client already timed out
0709 13:14:37.542453 (+   153us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:14:37.628710  3957 raft_consensus.cc:2468] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 2.
I20260709 13:14:37.439869  5439 raft_consensus.cc:515] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:37.628737  4104 rpcz_store.cc:269] 0709 13:14:34.586845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.547208 (+2960363us) service_pool.cc:211] Skipping call since client already timed out
0709 13:14:37.557875 (+ 10667us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:14:37.631135  5439 leader_election.cc:290] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:37.586186  4099 rpcz_store.cc:269] 0709 13:14:34.640017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.579944 (+2939927us) service_pool.cc:211] Skipping call since client already timed out
0709 13:14:37.580119 (+   175us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:14:37.544399  4703 rpcz_store.cc:269] 0709 13:14:34.288957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:34.289652 (+   695us) service_pool.cc:224] Handling call
0709 13:14:34.481414 (+191762us) spinlock_profiling.cc:243] Waited 6.71 ms on lock 0x7b5800003f98. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f1522549b71 00007f1522549a22 00007f152b462c09 00007f152a5bcee0 00007f152a6860ab 00007f152a686131 00007f152a6340a0 00007f152a633984 00007f1523bae6d4 00007f1523bae662
0709 13:14:37.371764 (+2890350us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15442176}
W20260709 13:14:37.584812  4708 rpcz_store.cc:269] 0709 13:14:35.326912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.584134 (+2257222us) service_pool.cc:211] Skipping call since client already timed out
0709 13:14:37.584256 (+   122us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:14:37.587530  3922 leader_election.cc:304] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
W20260709 13:14:37.634023  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 77884.9us
I20260709 13:14:37.457710  5432 raft_consensus.cc:515] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:37.602792  4105 rpcz_store.cc:276] 0709 13:14:34.950044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.601059 (+2651015us) service_pool.cc:224] Handling call
0709 13:14:37.601626 (+   567us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:37.601909 (+   283us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:37.601941 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:37.602014 (+    73us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:37.602052 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:37.602120 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:37.602246 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:37.620412  5364 raft_consensus.cc:493] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:37.637388  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:37.638051  3957 raft_consensus.cc:3060] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:37.577395  5453 leader_election.cc:290] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:37.639147  5453 raft_consensus.cc:2804] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:14:37.594360  4074 connection.cc:256] RPC call timeout handler was delayed by -1.7287915039999007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15800000000000003s for a response
W20260709 13:14:37.639846  4074 connection.cc:256] RPC call timeout handler was delayed by -1.540266795999969s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1824s for a response
I20260709 13:14:37.639994  5453 raft_consensus.cc:697] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 3 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
W20260709 13:14:37.640239  4074 connection.cc:256] RPC call timeout handler was delayed by -1.4830542229999537s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1998s for a response
I20260709 13:14:37.538463  5446 raft_consensus.cc:515] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:37.641269  5453 consensus_queue.cc:237] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:37.592841  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:14:37.604508  4100 rpcz_store.cc:269] 0709 13:14:34.587408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.598212 (+3010804us) service_pool.cc:211] Skipping call since client already timed out
0709 13:14:37.598351 (+   139us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:14:37.605590  4071 connection.cc:256] RPC call timeout handler was delayed by -1.3753023959998245s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1577s for a response
I20260709 13:14:37.549330  5299 leader_election.cc:290] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:37.606568  5382 raft_consensus.cc:493] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:37.590755  4705 rpcz_store.cc:269] 0709 13:14:35.387953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.590037 (+2202084us) service_pool.cc:211] Skipping call since client already timed out
0709 13:14:37.590221 (+   184us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:14:37.614739  5248 raft_consensus.cc:515] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:37.643111  4071 connection.cc:256] RPC call timeout handler was delayed by -1.2763023959998918s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16870000000000002s for a response
W20260709 13:14:37.643944  4071 connection.cc:256] RPC call timeout handler was delayed by -1.1161362430000281s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1885s for a response
W20260709 13:14:37.644233  4071 connection.cc:256] RPC call timeout handler was delayed by -1.0617626869998276s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2351s for a response
I20260709 13:14:37.643508  5382 raft_consensus.cc:3060] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:37.621871  5441 raft_consensus.cc:493] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:37.585160  5394 raft_consensus.cc:515] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:37.652949  5441 raft_consensus.cc:515] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:37.623281  5444 raft_consensus.cc:515] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:37.569036  5461 tablet_replica.cc:333] T 86669993fba94e65ba192aa115ed6e88 P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
W20260709 13:14:37.643086  4707 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57666 (request call id 291) took 2096 ms (client timeout 2221 ms). Trace:
I20260709 13:14:37.621541  5440 raft_consensus.cc:493] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:37.656643  5440 raft_consensus.cc:515] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:37.656236  4707 rpcz_store.cc:269] 0709 13:14:35.546326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.592386 (+2046060us) service_pool.cc:224] Handling call
0709 13:14:37.643006 (+ 50620us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:37.554677  5454 leader_election.cc:290] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:37.663992  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:37.665964  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:37.666682  4034 raft_consensus.cc:3060] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:37.669150  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:37.669874  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:37.670531  4028 raft_consensus.cc:1813] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Handling vote request from an unknown peer f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:37.670679  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:37.671132  4028 raft_consensus.cc:2410] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:14:37.671255  4029 raft_consensus.cc:3060] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:37.672559  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:37.673520  4031 raft_consensus.cc:2468] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 2.
I20260709 13:14:37.675414  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:37.676190  4026 raft_consensus.cc:3060] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:37.677649  5387 raft_consensus.cc:493] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.678339  5387 raft_consensus.cc:515] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:14:37.584707  4700 rpcz_store.cc:269] 0709 13:14:35.545971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.584056 (+2038085us) service_pool.cc:211] Skipping call since client already timed out
0709 13:14:37.584202 (+   146us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:14:37.682039  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:37.682368  5446 leader_election.cc:290] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:37.682575  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:37.682961  3959 raft_consensus.cc:2393] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 3: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:14:37.683315  3953 raft_consensus.cc:3060] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:37.683244  5364 raft_consensus.cc:515] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:37.685863  5364 leader_election.cc:290] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:37.687610  5432 leader_election.cc:290] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:37.688690  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:37.689477  3959 raft_consensus.cc:2468] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:14:37.692770  3922 leader_election.cc:304] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:37.693382  4704 raft_consensus.cc:2468] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3.
I20260709 13:14:37.695062  5454 raft_consensus.cc:2804] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:37.699903  5454 raft_consensus.cc:493] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:37.700368  5454 raft_consensus.cc:3060] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:37.703032  5293 raft_consensus.cc:2749] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:37.580566  5455 leader_election.cc:290] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:37.691465  5440 leader_election.cc:290] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:37.707507  5441 leader_election.cc:290] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:37.708089  4704 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57680 (request call id 380) took 3417 ms (client timeout 1965 ms). Trace:
W20260709 13:14:37.709961  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 64551.7us
I20260709 13:14:37.696615  5387 leader_election.cc:290] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:37.697602  5444 leader_election.cc:290] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:37.695309  4027 raft_consensus.cc:2468] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 2.
I20260709 13:14:37.714710  4029 raft_consensus.cc:2468] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3.
I20260709 13:14:37.717669  4034 raft_consensus.cc:2468] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3.
I20260709 13:14:37.696316  5248 leader_election.cc:290] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:37.720608  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:37.723711  5340 raft_consensus.cc:493] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.724017  4032 raft_consensus.cc:2468] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 2.
I20260709 13:14:37.724237  5340 raft_consensus.cc:515] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:37.725021  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:37.726183  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:37.721691  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:37.727952  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:37.728744  4030 raft_consensus.cc:2393] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 4: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:14:37.722195  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:37.721542  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
W20260709 13:14:37.721498  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:37.730515  4032 raft_consensus.cc:2468] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 2.
I20260709 13:14:37.736842  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:37.739205  4034 raft_consensus.cc:2468] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 2.
I20260709 13:14:37.742719  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:14:37.676203  4672 connection.cc:256] RPC call timeout handler was delayed by -1.9982618710000679s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1531s for a response
W20260709 13:14:37.743713  4672 connection.cc:256] RPC call timeout handler was delayed by -1.9982618710000679s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1531s for a response
W20260709 13:14:37.744195  4672 connection.cc:256] RPC call timeout handler was delayed by -1.9874618710000505s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1543s for a response
W20260709 13:14:37.744664  4672 connection.cc:256] RPC call timeout handler was delayed by -1.9361618709999675s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16000000000000003s for a response
W20260709 13:14:37.745057  4672 connection.cc:256] RPC call timeout handler was delayed by -1.7831618709999475s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17700000000000002s for a response
W20260709 13:14:37.746133  4672 connection.cc:256] RPC call timeout handler was delayed by -1.5482618710000224s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20310000000000003s for a response
W20260709 13:14:37.747141  4672 connection.cc:256] RPC call timeout handler was delayed by -1.5041618709999511s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20800000000000002s for a response
I20260709 13:14:37.741935  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:37.748618  4025 raft_consensus.cc:2393] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 2: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:14:37.748723  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:14:37.748961  4027 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38290 (request call id 1351) took 3603 ms (client timeout 1824 ms). Trace:
W20260709 13:14:37.749374  4027 rpcz_store.cc:269] 0709 13:14:34.145381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:34.145533 (+   152us) service_pool.cc:224] Handling call
0709 13:14:37.742401 (+3596868us) spinlock_profiling.cc:243] Waited 3.52 s on lock 0x7b54001dbd54. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:14:37.748894 (+  6493us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8100239616}
I20260709 13:14:37.749874  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:37.750555  4032 raft_consensus.cc:2468] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 1.
I20260709 13:14:37.753078  4071 leader_election.cc:304] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:37.754267  4071 leader_election.cc:304] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:37.753933  5382 raft_consensus.cc:515] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:37.755414  4707 raft_consensus.cc:2368] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 2. Current term is 3.
I20260709 13:14:37.743116  4708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:37.755787  5403 raft_consensus.cc:2804] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:37.756054  4708 raft_consensus.cc:2468] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 1.
I20260709 13:14:37.756224  5403 raft_consensus.cc:493] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:37.756662  5403 raft_consensus.cc:3060] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:37.756976  3954 raft_consensus.cc:2468] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 2.
I20260709 13:14:37.757373  4708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:37.757679  3999 leader_election.cc:304] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:37.758584  5444 raft_consensus.cc:2804] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:37.758817  4708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:37.758951  5444 raft_consensus.cc:493] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:37.683013  5394 leader_election.cc:290] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:37.759481  5444 raft_consensus.cc:3060] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:37.759588  4708 raft_consensus.cc:3060] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:14:37.748659  4033 raft_consensus.cc:2468] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3.
I20260709 13:14:37.751065  5299 consensus_queue.cc:1048] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:14:37.716910  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:37.727370  5340 leader_election.cc:290] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:37.763365  4706 raft_consensus.cc:2468] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 3.
W20260709 13:14:37.764081  4706 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57692 (request call id 178) took 2214 ms (client timeout 2467 ms). Trace:
W20260709 13:14:37.764456  4706 rpcz_store.cc:269] 0709 13:14:35.549226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.607286 (+2058060us) service_pool.cc:224] Handling call
0709 13:14:37.764001 (+156715us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:37.765532  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:37.766204  4706 raft_consensus.cc:2468] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 2.
I20260709 13:14:37.770525  4033 raft_consensus.cc:3055] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:37.770923  4033 raft_consensus.cc:740] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:37.771034  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:37.771718  4032 raft_consensus.cc:3060] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:37.771802  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:37.771950  4033 consensus_queue.cc:260] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:37.773020  4033 raft_consensus.cc:3060] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:37.773149  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:37.773852  4028 raft_consensus.cc:2468] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 2.
I20260709 13:14:37.774876  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:37.775457  4027 raft_consensus.cc:3060] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:37.775611  4029 raft_consensus.cc:2468] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 1.
I20260709 13:14:37.776316  4708 raft_consensus.cc:2468] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3.
I20260709 13:14:37.770567  5444 raft_consensus.cc:515] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:37.778855  4708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:37.780388  4026 raft_consensus.cc:2410] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:14:37.780577  4708 raft_consensus.cc:2468] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 1.
I20260709 13:14:37.779177  5444 leader_election.cc:290] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Requested vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:14:37.747946  4672 connection.cc:256] RPC call timeout handler was delayed by -1.4780618709999089s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2109s for a response
W20260709 13:14:37.769397  3997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:37.709776  4704 rpcz_store.cc:269] 0709 13:14:34.290199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:34.291150 (+   951us) service_pool.cc:224] Handling call
0709 13:14:36.902015 (+2610865us) spinlock_profiling.cc:243] Waited 6.92 ms on lock 0x7b5800003f98. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f1522549b71 00007f1522549a22 00007f152b462c09 00007f152a5bcee0 00007f152a6860ab 00007f152a686131 00007f152a6340a0 00007f152a633984 00007f1523bae6d4 00007f1523bae662
0709 13:14:37.708007 (+805992us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15919360}
W20260709 13:14:37.784446  4672 connection.cc:256] RPC call timeout handler was delayed by -1.4402618710000752s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21509999999999999s for a response
W20260709 13:14:37.785104  4672 connection.cc:256] RPC call timeout handler was delayed by -1.1586933169999156s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21850000000000003s for a response
W20260709 13:14:37.787755  4073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 196185us
I20260709 13:14:37.755527  5345 raft_consensus.cc:2804] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:14:37.795475  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 101557us
I20260709 13:14:37.792023  4032 raft_consensus.cc:2410] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:14:37.793453  3997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:37.804455  3957 raft_consensus.cc:2468] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:37.807629  4708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:37.808514  4708 raft_consensus.cc:2410] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:14:37.809352  4708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:37.810436  4708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:37.810953  4708 raft_consensus.cc:2468] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 3.
I20260709 13:14:37.813509  4707 raft_consensus.cc:1240] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 4 LEARNER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 13:14:37.815459  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:37.816329  4702 raft_consensus.cc:1813] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Handling vote request from an unknown peer f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:37.817250  4702 raft_consensus.cc:2410] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:14:37.818159  4704 raft_consensus.cc:1240] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:14:37.818464  4702 raft_consensus.cc:1240] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:37.818837  4704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57692 (request call id 170) took 2272 ms. Trace:
I20260709 13:14:37.819103  4702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57692 (request call id 171) took 2272 ms. Trace:
I20260709 13:14:37.819746  4071 leader_election.cc:304] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:37.820737  5299 raft_consensus.cc:2804] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:37.820787  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:37.820940  4071 leader_election.cc:304] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:37.821287  5299 raft_consensus.cc:493] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:37.821732  5299 raft_consensus.cc:3060] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:37.822957  4703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:14:37.823616  3997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:37.798316  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:37.823865  4703 raft_consensus.cc:2393] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 3: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:14:37.824126  4700 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 4 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 4.
W20260709 13:14:37.824405  3997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:37.825562  4703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57692 (request call id 172) took 2278 ms. Trace:
I20260709 13:14:37.825834  4700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57692 (request call id 173) took 2278 ms. Trace:
I20260709 13:14:37.821755  4709 raft_consensus.cc:2393] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 3: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
W20260709 13:14:37.827216  4709 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57666 (request call id 288) took 2378 ms (client timeout 2630 ms). Trace:
I20260709 13:14:37.814368  4707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57666 (request call id 286) took 2390 ms. Trace:
I20260709 13:14:37.794389  5345 raft_consensus.cc:493] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:37.827976  4707 rpcz_store.cc:276] 0709 13:14:35.424077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.812584 (+2388507us) service_pool.cc:224] Handling call
0709 13:14:37.813046 (+   462us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:37.814024 (+   978us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:37.814274 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:37.828738  4701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:37.829528  4701 raft_consensus.cc:2468] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 2.
I20260709 13:14:37.829910  5400 consensus_queue.cc:1048] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:14:37.830219  4701 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57666 (request call id 284) took 2461 ms (client timeout 2865 ms). Trace:
I20260709 13:14:37.830538  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:14:37.830673  4701 rpcz_store.cc:269] 0709 13:14:35.369337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.628096 (+2258759us) service_pool.cc:224] Handling call
0709 13:14:37.828554 (+200458us) spinlock_profiling.cc:243] Waited 84.5 ms on lock 0x7b5800003f98. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f1522549b71 00007f1522549a22 00007f152b462c09 00007f152a5bcee0 00007f152a6860ab 00007f152a686131 00007f152a6340a0 00007f152a633984 00007f1523bae6d4 00007f1523bae662
0709 13:14:37.830152 (+  1598us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":194275712}
I20260709 13:14:37.832229  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:37.832744  4701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57692 (request call id 175) took 2284 ms. Trace:
I20260709 13:14:37.832875  5382 leader_election.cc:290] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:37.833112  4705 raft_consensus.cc:2393] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 3: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
I20260709 13:14:37.829523  4707 raft_consensus.cc:1240] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:37.832252  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:14:37.827917  4709 rpcz_store.cc:269] 0709 13:14:35.448789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.609314 (+2160525us) service_pool.cc:224] Handling call
0709 13:14:37.796983 (+187669us) spinlock_profiling.cc:243] Waited 877 us on lock 0x7b5800003f98. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f1522549b71 00007f1522549a22 00007f152b462c09 00007f152a5bcee0 00007f152a6860ab 00007f152a686131 00007f152a6340a0 00007f152a633984 00007f1523bae6d4 00007f1523bae662
0709 13:14:37.820632 (+ 23649us) spinlock_profiling.cc:243] Waited 1.25 ms on lock 0x7b5800003f98. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f1522549e9c 00007f1522549a5b 00007f152b462c09 00007f152a5bcee0 00007f152a6860ab 00007f152a686131 00007f152a6340a0 00007f152a633984 00007f1523bae6d4 00007f1523bae662
0709 13:14:37.827157 (+  6525us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4890240}
I20260709 13:14:37.823092  4071 leader_election.cc:304] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:37.842360  4027 raft_consensus.cc:2468] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3.
I20260709 13:14:37.836611  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:37.843397  4032 raft_consensus.cc:2468] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3.
I20260709 13:14:37.827874  5301 raft_consensus.cc:2804] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:14:37.848235  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 48426.7us
I20260709 13:14:37.769105  5454 raft_consensus.cc:515] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:37.826576  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:37.851138  4707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57692 (request call id 174) took 2286 ms. Trace:
I20260709 13:14:37.851069  4672 leader_election.cc:304] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:37.861842  4707 rpcz_store.cc:276] 0709 13:14:35.547919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.828931 (+2281012us) service_pool.cc:224] Handling call
0709 13:14:37.829311 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:37.834303 (+  4992us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:37.834469 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:37.863466  3953 raft_consensus.cc:2468] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:37.864182  4071 leader_election.cc:304] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:37.864635  4099 raft_consensus.cc:1275] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:37.865361  5404 raft_consensus.cc:3060] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:37.865855  4708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:37.866173  4709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57692 (request call id 177) took 2317 ms. Trace:
I20260709 13:14:37.866596  4709 rpcz_store.cc:276] 0709 13:14:35.548894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.850528 (+2301634us) service_pool.cc:224] Handling call
0709 13:14:37.865535 (+ 15007us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:37.865763 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:37.865788 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:37.865861 (+    73us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:37.865916 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:37.865973 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:37.866088 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:37.825977  4703 rpcz_store.cc:276] 0709 13:14:35.547249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.824532 (+2277283us) service_pool.cc:224] Handling call
0709 13:14:37.824946 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:37.825191 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:37.825228 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:37.825277 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:37.825319 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:37.825380 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:37.825484 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:37.835071  4702 rpcz_store.cc:276] 0709 13:14:35.546959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.817873 (+2270914us) service_pool.cc:224] Handling call
0709 13:14:37.818265 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:37.818871 (+   606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:37.819052 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:37.833194  4701 rpcz_store.cc:276] 0709 13:14:35.548216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.831728 (+2283512us) service_pool.cc:224] Handling call
0709 13:14:37.832119 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:37.832380 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:37.832419 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:37.832461 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:37.832504 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:37.832569 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:37.832691 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:37.869354  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:37.870056  4028 raft_consensus.cc:2468] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 2.
I20260709 13:14:37.870389  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:37.871282  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:37.871904  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:37.872131  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:37.873078  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:37.873677  4032 raft_consensus.cc:2468] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3.
I20260709 13:14:37.873836  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:37.874496  4030 raft_consensus.cc:3060] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:37.827883  5345 raft_consensus.cc:3060] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:37.877440  5404 raft_consensus.cc:2749] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:37.881560  3924 leader_election.cc:304] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:37.882603  3924 leader_election.cc:304] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:37.883069  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:37.883278  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:37.882800  5293 raft_consensus.cc:2804] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:37.883489  3924 leader_election.cc:304] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:37.890893  5293 raft_consensus.cc:493] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:37.891007  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:37.891430  5293 raft_consensus.cc:3060] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:37.891662  5394 raft_consensus.cc:2804] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:37.891852  4705 raft_consensus.cc:3060] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:37.892149  5394 raft_consensus.cc:493] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:37.892534  5394 raft_consensus.cc:3060] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:37.894707  5450 raft_consensus.cc:2804] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:37.883767  3999 leader_election.cc:304] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:37.895805  5450 raft_consensus.cc:697] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 3 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:37.896323  3999 leader_election.cc:400] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Vote denied by peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117) with higher term. Message: Invalid argument: T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 2. Current term is 3.
I20260709 13:14:37.896636  3999 leader_election.cc:403] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:14:37.896847  5450 consensus_queue.cc:237] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:37.897886  5444 raft_consensus.cc:2804] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:37.898346  5444 raft_consensus.cc:493] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:37.898695  5444 raft_consensus.cc:3060] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:37.898873  5455 raft_consensus.cc:2804] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:37.899315  5455 raft_consensus.cc:493] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:37.847915  5301 raft_consensus.cc:493] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:37.899744  5455 raft_consensus.cc:3060] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:37.899847  5301 raft_consensus.cc:3060] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:37.901294  5340 raft_consensus.cc:3060] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:37.901799  4073 leader_election.cc:304] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:14:37.863199  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:37.819288  4704 rpcz_store.cc:276] 0709 13:14:35.546667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.817409 (+2270742us) service_pool.cc:224] Handling call
0709 13:14:37.817833 (+   424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:37.818560 (+   727us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:37.818782 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:37.903944  4103 raft_consensus.cc:2468] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
I20260709 13:14:37.905310  4026 raft_consensus.cc:2468] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 2.
I20260709 13:14:37.905527  4703 raft_consensus.cc:1275] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:14:37.906541  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 100259us
I20260709 13:14:37.907025  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:37.907712  4672 leader_election.cc:304] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:37.831284  5403 raft_consensus.cc:515] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:37.908512  5370 raft_consensus.cc:2749] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:37.908751  5382 raft_consensus.cc:2804] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:37.909194  5382 raft_consensus.cc:493] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:37.908545  5387 raft_consensus.cc:2749] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:37.909807  5382 raft_consensus.cc:3060] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:37.909925  5403 leader_election.cc:290] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:37.866199  4071 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:37.915747  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:37.916769  4030 raft_consensus.cc:2468] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 3.
I20260709 13:14:37.917912  4033 raft_consensus.cc:2393] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 in current term 3: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:14:37.918083  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:14:37.920272  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 54162.8us
I20260709 13:14:37.923345  4099 raft_consensus.cc:1240] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 1. Current term is 2. Ops: []
W20260709 13:14:37.929046  4073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:37.935400  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:37.937636  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:37.938752  4104 raft_consensus.cc:2468] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 2.
I20260709 13:14:37.942140  5293 raft_consensus.cc:515] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:37.945763  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:37.925897  5454 leader_election.cc:290] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:37.947793  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:37.947974  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:37.951650  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:37.951086  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:37.948186  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:37.960988  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:37.961812  4708 raft_consensus.cc:1275] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:37.962908  4099 raft_consensus.cc:1240] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:37.957712  3922 leader_election.cc:304] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:37.990097  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:37.966203  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:37.967764  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:37.969029  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:37.990828  4025 raft_consensus.cc:2393] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 in current term 2: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:14:37.980198  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:37.947322  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:37.969734  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:37.967450  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:37.996294  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:37.977192  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:37.996901  5444 raft_consensus.cc:515] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:37.966624  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:37.952010  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:38.026367  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:37.952327  4103 raft_consensus.cc:3060] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:38.040904  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 83405.8us
I20260709 13:14:38.042830  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:38.045974  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:37.963608  4071 leader_election.cc:304] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:37.826397  4700 rpcz_store.cc:276] 0709 13:14:35.547596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.824888 (+2277292us) service_pool.cc:224] Handling call
0709 13:14:37.825224 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:37.825480 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:37.825506 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:37.825558 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:37.825611 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:37.825664 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:37.825776 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:38.046659  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:37.955312  5461 raft_consensus.cc:2243] T 86669993fba94e65ba192aa115ed6e88 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:14:38.013167  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:38.065599  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:38.065599  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:37.947634  5403 raft_consensus.cc:2804] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:38.093057  4108 raft_consensus.cc:2468] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
I20260709 13:14:38.093478  4707 raft_consensus.cc:2393] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 3: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
I20260709 13:14:37.946276  4705 raft_consensus.cc:2468] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
I20260709 13:14:38.094267  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:38.096601  4029 raft_consensus.cc:2393] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 in current term 4: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:14:38.094928  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:38.070487  4031 raft_consensus.cc:1240] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:38.049672  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:38.089272  4032 raft_consensus.cc:2393] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 in current term 3: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:14:38.099834  4033 raft_consensus.cc:2393] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 in current term 2: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:14:38.051918  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:38.086241  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:38.100627  4034 raft_consensus.cc:2468] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 2.
I20260709 13:14:38.100881  4025 raft_consensus.cc:2468] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:38.090778  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:38.091835  4030 raft_consensus.cc:1240] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:14:38.049268  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:38.102698  4027 raft_consensus.cc:2393] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 3: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:14:38.041105  4701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:37.962642  5340 raft_consensus.cc:2749] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117) with higher term. Message: Invalid argument: T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 2. Current term is 3.
I20260709 13:14:37.963959  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:37.975236  5382 raft_consensus.cc:515] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:38.114326  4702 raft_consensus.cc:2376] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3. Re-sending same reply.
I20260709 13:14:38.114598  4028 raft_consensus.cc:1240] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:38.115242  4099 raft_consensus.cc:2468] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 3.
I20260709 13:14:38.115480  5263 raft_consensus.cc:3060] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:38.115974  5382 leader_election.cc:290] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:38.116122  4028 raft_consensus.cc:1240] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:37.972345  5299 raft_consensus.cc:515] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:38.040555  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:38.118284  5299 leader_election.cc:290] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:38.111482  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:38.119899  4100 raft_consensus.cc:2393] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 in current term 3: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:38.120168  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:38.120937  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:38.121439  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:38.122364  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:37.997495  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:38.122862  3925 leader_election.cc:304] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:14:38.124141  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:38.124323  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:38.125118  4028 raft_consensus.cc:2393] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 2: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:14:38.125192  5450 raft_consensus.cc:2749] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:38.125820  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:38.116346  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:38.126096  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:38.041196  5248 raft_consensus.cc:2804] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:38.122742  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:14:38.128109  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:38.123200  4100 raft_consensus.cc:2468] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 3.
I20260709 13:14:38.144191  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:38.145146  4032 raft_consensus.cc:2393] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 2: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:14:38.145020  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:38.146129  5461 raft_consensus.cc:2272] T 86669993fba94e65ba192aa115ed6e88 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:38.147562  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:38.093318  5403 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:38.149484  4033 raft_consensus.cc:1275] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:37.976415  5301 raft_consensus.cc:515] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:37.948141  5310 consensus_queue.cc:1048] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.177s
I20260709 13:14:38.158951  5403 raft_consensus.cc:3060] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:38.174283  5301 leader_election.cc:290] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:38.103976  4704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:38.180650  5293 leader_election.cc:290] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:38.188047  4025 raft_consensus.cc:1240] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 1. Current term is 2. Ops: []
W20260709 13:14:38.194578  3999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 44517.1us
W20260709 13:14:38.183409  3980 debug-util.cc:398] Leaking SignalData structure 0x7b080028db20 after lost signal to thread 2846
I20260709 13:14:38.152910  4108 raft_consensus.cc:2468] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
W20260709 13:14:38.201274  3997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:38.247948  3980 debug-util.cc:398] Leaking SignalData structure 0x7b08000bf540 after lost signal to thread 3891
I20260709 13:14:38.137010  5248 raft_consensus.cc:493] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:38.041275  5454 consensus_queue.cc:1048] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:14:38.183637  4101 raft_consensus.cc:3060] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:38.174602  4107 raft_consensus.cc:1240] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:38.227087  4099 raft_consensus.cc:2468] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 3.
I20260709 13:14:38.228468  3924 leader_election.cc:304] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:38.128611  5441 consensus_queue.cc:1059] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:14:38.231626  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:14:38.237391  4073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:38.172870  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 209427us
I20260709 13:14:38.253484  5248 raft_consensus.cc:3060] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:38.260344  4071 leader_election.cc:304] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:38.261955  4071 leader_election.cc:304] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:38.262919  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:38.263736  4108 raft_consensus.cc:2468] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
I20260709 13:14:38.263933  5370 raft_consensus.cc:2804] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:38.264396  5370 raft_consensus.cc:493] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:38.264778  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:38.250324  4026 raft_consensus.cc:2468] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 3.
I20260709 13:14:38.243667  3925 leader_election.cc:304] T 86669993fba94e65ba192aa115ed6e88 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:14:38.229223  5450 raft_consensus.cc:493] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
W20260709 13:14:38.265882  3925 raft_consensus.cc:2686] T 86669993fba94e65ba192aa115ed6e88 P f1c75790cedf4f52a3463a255c7da059: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:14:38.266088  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:38.254113  4709 raft_consensus.cc:1240] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:38.266755  4108 raft_consensus.cc:3060] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:14:38.179476  3953 raft_consensus.cc:1240] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:38.266619  3925 leader_election.cc:304] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:38.268568  5444 leader_election.cc:290] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: Requested vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:38.268955  5454 raft_consensus.cc:2804] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:38.269181  5461 ts_tablet_manager.cc:1916] T 86669993fba94e65ba192aa115ed6e88 P f1c75790cedf4f52a3463a255c7da059: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:38.268577  3925 leader_election.cc:304] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:38.269449  5454 raft_consensus.cc:493] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:38.271013  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:38.271838  5299 consensus_queue.cc:1048] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:38.272212  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:38.273083  4705 raft_consensus.cc:2393] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 3: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
I20260709 13:14:38.274060  5400 consensus_queue.cc:1059] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:38.275130  5263 raft_consensus.cc:2749] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:38.246193  5345 raft_consensus.cc:515] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:38.260291  4708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:38.271132  5454 raft_consensus.cc:3060] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:38.264780  5370 raft_consensus.cc:3060] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:38.277880  5345 leader_election.cc:290] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:38.278575  5345 raft_consensus.cc:3055] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:38.278944  5345 raft_consensus.cc:740] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:38.279038  5453 raft_consensus.cc:2804] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:38.271875  4700 raft_consensus.cc:2368] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 2. Current term is 3.
I20260709 13:14:38.279831  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:38.280546  4707 raft_consensus.cc:2368] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 3. Current term is 4.
I20260709 13:14:38.266584  4701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:38.281641  5394 raft_consensus.cc:515] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:38.282186  5293 raft_consensus.cc:2804] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:38.282716  5293 raft_consensus.cc:697] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 3 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:38.283751  5293 consensus_queue.cc:237] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:38.285214  5403 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:38.250541  4106 raft_consensus.cc:2468] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
I20260709 13:14:38.288036  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:14:38.256485  3980 debug-util.cc:398] Leaking SignalData structure 0x7b08002e45c0 after lost signal to thread 3983
W20260709 13:14:38.288722  3980 debug-util.cc:398] Leaking SignalData structure 0x7b08002e4600 after lost signal to thread 3984
W20260709 13:14:38.289927  3980 debug-util.cc:398] Leaking SignalData structure 0x7b0800304900 after lost signal to thread 4058
W20260709 13:14:38.290490  3980 debug-util.cc:398] Leaking SignalData structure 0x7b0800309f20 after lost signal to thread 4059
W20260709 13:14:38.291775  3980 debug-util.cc:398] Leaking SignalData structure 0x7b080032aa80 after lost signal to thread 4103
W20260709 13:14:38.292119  3980 debug-util.cc:398] Leaking SignalData structure 0x7b080032ab40 after lost signal to thread 4105
W20260709 13:14:38.292425  3980 debug-util.cc:398] Leaking SignalData structure 0x7b0800219c80 after lost signal to thread 4107
W20260709 13:14:38.293140  3980 debug-util.cc:398] Leaking SignalData structure 0x7b08002ce0a0 after lost signal to thread 4132
W20260709 13:14:38.293414  3980 debug-util.cc:398] Leaking SignalData structure 0x7b08002b9540 after lost signal to thread 4133
W20260709 13:14:38.293836  3980 debug-util.cc:398] Leaking SignalData structure 0x7b080029c960 after lost signal to thread 4672
W20260709 13:14:38.294647  3980 debug-util.cc:398] Leaking SignalData structure 0x7b08002e4fc0 after lost signal to thread 4700
W20260709 13:14:38.294974  3980 debug-util.cc:398] Leaking SignalData structure 0x7b0800323580 after lost signal to thread 4702
W20260709 13:14:38.296418  2848 debug-util.cc:398] Leaking SignalData structure 0x7b080000fae0 after lost signal to thread 4672
I20260709 13:14:38.298569  4103 raft_consensus.cc:1275] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:38.286785  5454 raft_consensus.cc:515] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:38.316104  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:38.317586  5454 leader_election.cc:290] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:38.301736  3980 debug-util.cc:398] Leaking SignalData structure 0x7b08000b6220 after lost signal to thread 4703
W20260709 13:14:38.318668  3980 debug-util.cc:398] Leaking SignalData structure 0x7b08002ff8c0 after lost signal to thread 4707
W20260709 13:14:38.318975  3980 debug-util.cc:398] Leaking SignalData structure 0x7b0800332de0 after lost signal to thread 4709
I20260709 13:14:38.319892  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:38.320096  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:14:38.322110  3980 debug-util.cc:398] Leaking SignalData structure 0x7b0800373560 after lost signal to thread 4733
I20260709 13:14:38.322013  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:14:38.322494  3980 debug-util.cc:398] Leaking SignalData structure 0x7b0800373480 after lost signal to thread 4734
W20260709 13:14:38.322775  3980 debug-util.cc:398] Leaking SignalData structure 0x7b0800365b60 after lost signal to thread 5191
I20260709 13:14:38.322814  4102 raft_consensus.cc:2393] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 in current term 3: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
W20260709 13:14:38.323170  3980 debug-util.cc:398] Leaking SignalData structure 0x7b0800373400 after lost signal to thread 5210
I20260709 13:14:38.240465  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:38.323896  5394 leader_election.cc:290] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:38.324574  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:38.324867  5345 consensus_queue.cc:260] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:38.325879  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:38.326514  5345 raft_consensus.cc:3060] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:38.326809  3954 raft_consensus.cc:2410] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:14:38.327672  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:38.327843  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:38.302552  3957 raft_consensus.cc:1240] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 3 LEADER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:38.328905  4701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:14:38.323468  3980 debug-util.cc:398] Leaking SignalData structure 0x7b0800373280 after lost signal to thread 5229
W20260709 13:14:38.329543  3980 debug-util.cc:398] Leaking SignalData structure 0x7b08003733c0 after lost signal to thread 5248
W20260709 13:14:38.329850  3980 debug-util.cc:398] Leaking SignalData structure 0x7b0800373260 after lost signal to thread 5251
W20260709 13:14:38.330101  3980 debug-util.cc:398] Leaking SignalData structure 0x7b08003a37a0 after lost signal to thread 5253
I20260709 13:14:38.330371  3953 raft_consensus.cc:1240] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:38.331065  3957 raft_consensus.cc:1240] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:38.331926  4100 raft_consensus.cc:2393] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 3: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:38.316102  4105 raft_consensus.cc:2393] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 in current term 3: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:38.332749  3953 raft_consensus.cc:1240] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 3 LEADER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 2. Current term is 3. Ops: []
W20260709 13:14:38.330377  3980 debug-util.cc:398] Leaking SignalData structure 0x7b08003a3960 after lost signal to thread 5269
I20260709 13:14:38.333923  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:38.304677  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:14:38.334970  3980 debug-util.cc:398] Leaking SignalData structure 0x7b08003733a0 after lost signal to thread 5270
I20260709 13:14:38.336373  4104 raft_consensus.cc:2410] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
W20260709 13:14:38.336412  3980 debug-util.cc:398] Leaking SignalData structure 0x7b08003731c0 after lost signal to thread 5299
W20260709 13:14:38.337352  3980 debug-util.cc:398] Leaking SignalData structure 0x7b0800373240 after lost signal to thread 5310
W20260709 13:14:38.337598  3980 debug-util.cc:398] Leaking SignalData structure 0x7b0800373160 after lost signal to thread 5322
W20260709 13:14:38.337826  3980 debug-util.cc:398] Leaking SignalData structure 0x7b0800373200 after lost signal to thread 5324
I20260709 13:14:38.338402  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:14:38.348738  3980 debug-util.cc:398] Leaking SignalData structure 0x7b080039d400 after lost signal to thread 5382
W20260709 13:14:38.349133  3980 debug-util.cc:398] Leaking SignalData structure 0x7b080039d4a0 after lost signal to thread 5387
I20260709 13:14:38.339162  4103 raft_consensus.cc:2468] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 1.
W20260709 13:14:38.353679  3999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 51489.1us
I20260709 13:14:38.279450  5453 raft_consensus.cc:493] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:38.265980  5450 raft_consensus.cc:515] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:38.361243  5450 leader_election.cc:290] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:38.363711  3959 raft_consensus.cc:3060] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:38.364091  4701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:38.365470  4701 raft_consensus.cc:2393] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 3: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
I20260709 13:14:38.366835  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:38.307787  5471 raft_consensus.cc:2749] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:38.259220  5455 raft_consensus.cc:515] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:38.371790  5455 leader_election.cc:290] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 election: Requested vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:38.373195  4107 raft_consensus.cc:1275] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:38.373348  5444 raft_consensus.cc:3055] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:38.373889  5444 raft_consensus.cc:740] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:38.373206  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:38.322942  3952 raft_consensus.cc:2393] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 3: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:14:38.376377  4104 raft_consensus.cc:1275] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:14:38.376770  3997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:38.367652  4103 raft_consensus.cc:2393] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 3: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
W20260709 13:14:38.398270  3997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:38.399102  4101 raft_consensus.cc:2468] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 2.
I20260709 13:14:38.334506  4703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:38.410885  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:38.411118  3957 raft_consensus.cc:1275] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:38.411755  3958 raft_consensus.cc:3060] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:38.378118  5453 raft_consensus.cc:3060] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:38.415012  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:38.396220  5403 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:38.396581  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:38.427728  4672 leader_election.cc:304] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:38.430750  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:38.431768  3957 raft_consensus.cc:2376] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2. Re-sending same reply.
I20260709 13:14:38.397575  5441 consensus_queue.cc:1059] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:14:38.436111  5441 raft_consensus.cc:3055] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:38.436501  5441 raft_consensus.cc:740] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:38.437611  5441 consensus_queue.cc:260] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:38.442116  4108 raft_consensus.cc:2468] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 4.
I20260709 13:14:38.443084  4073 leader_election.cc:304] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:14:38.444404  3954 raft_consensus.cc:2468] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 1.
I20260709 13:14:38.445051  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:38.445456  4708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:38.445770  4073 leader_election.cc:400] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 election: Vote denied by peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117) with higher term. Message: Invalid argument: T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 2. Current term is 3.
I20260709 13:14:38.446313  4704 raft_consensus.cc:1240] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:38.446877  4073 leader_election.cc:400] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Vote denied by peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117) with higher term. Message: Invalid argument: T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 3. Current term is 4.
I20260709 13:14:38.447193  4073 leader_election.cc:403] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:38.447029  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:38.375053  5444 consensus_queue.cc:260] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:38.447835  4709 raft_consensus.cc:3060] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:38.443277  5472 consensus_queue.cc:1059] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:14:38.448413  5444 raft_consensus.cc:3060] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:38.448640  5472 raft_consensus.cc:3055] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:38.449050  5472 raft_consensus.cc:740] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:38.449864  5472 consensus_queue.cc:260] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:38.451052  5472 raft_consensus.cc:3060] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:38.445663  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:38.451577  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:38.452557  3952 raft_consensus.cc:2393] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 3: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:14:38.452762  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:38.453495  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:38.445694  4707 raft_consensus.cc:2468] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 2.
I20260709 13:14:38.453573  3954 raft_consensus.cc:2393] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 3: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:14:38.455660  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:38.448534  5263 raft_consensus.cc:2749] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:38.456225  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:38.457109  4702 raft_consensus.cc:2368] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 2. Current term is 3.
I20260709 13:14:38.458076  4703 raft_consensus.cc:2393] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 2: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
I20260709 13:14:38.450170  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:38.439242  5441 raft_consensus.cc:3060] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:38.462397  4675 leader_election.cc:304] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:38.462978  3958 raft_consensus.cc:2468] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
I20260709 13:14:38.463466  5310 raft_consensus.cc:2804] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:38.463788  5403 raft_consensus.cc:2749] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117) with higher term. Message: Invalid argument: T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 3. Current term is 4.
I20260709 13:14:38.465344  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:38.466146  3954 raft_consensus.cc:2468] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 3.
I20260709 13:14:38.466661  3959 raft_consensus.cc:2468] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
I20260709 13:14:38.466981  4073 leader_election.cc:304] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:38.468266  4102 raft_consensus.cc:1240] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:38.471133  4672 leader_election.cc:304] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:38.473026  5370 raft_consensus.cc:515] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:38.461688  3950 raft_consensus.cc:2468] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
I20260709 13:14:38.474254  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:38.474500  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:38.475051  3958 raft_consensus.cc:2468] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
I20260709 13:14:38.475040  3950 raft_consensus.cc:2468] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 3.
I20260709 13:14:38.476279  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:38.477257  3950 raft_consensus.cc:2410] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:14:38.458546  4701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:38.478217  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:38.479166  3950 raft_consensus.cc:2393] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 3: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:14:38.473270  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:38.479516  5382 raft_consensus.cc:2804] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:38.480244  3954 raft_consensus.cc:2410] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:14:38.459940  4708 raft_consensus.cc:3060] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:38.486649  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:38.494140  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:38.517674  3950 raft_consensus.cc:1240] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:38.530812  3957 raft_consensus.cc:2468] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
I20260709 13:14:38.533669  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:38.455017  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:38.533751  3950 raft_consensus.cc:1240] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:38.539520  4099 raft_consensus.cc:2393] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 4: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:38.546301  4706 raft_consensus.cc:2393] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 3: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
I20260709 13:14:38.553248  3952 raft_consensus.cc:2393] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 3: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:14:38.554728  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:38.555707  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:38.556396  3959 raft_consensus.cc:2468] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 3.
I20260709 13:14:38.557154  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:38.557636  3959 raft_consensus.cc:2468] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 1.
I20260709 13:14:38.559721  3952 raft_consensus.cc:2468] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
I20260709 13:14:38.560927  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:38.562129  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:38.562793  3952 raft_consensus.cc:2468] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 1.
I20260709 13:14:38.558413  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:38.571117  3959 raft_consensus.cc:2468] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 3.
I20260709 13:14:38.537472  3954 raft_consensus.cc:1240] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:38.588757  3958 raft_consensus.cc:1240] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 3 LEADER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:38.590296  4709 raft_consensus.cc:2468] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:38.591315  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:38.592702  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:38.594322  3950 raft_consensus.cc:2376] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2. Re-sending same reply.
I20260709 13:14:38.601135  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:38.602080  3958 raft_consensus.cc:2376] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2. Re-sending same reply.
I20260709 13:14:38.605054  4708 raft_consensus.cc:2468] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:38.618883  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:38.627091  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:38.628026  3950 raft_consensus.cc:2468] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 1.
I20260709 13:14:38.629038  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:38.629768  3950 raft_consensus.cc:2393] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 3: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:14:38.630954  3950 raft_consensus.cc:1275] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:38.631978  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:38.632795  3957 raft_consensus.cc:2468] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 1.
W20260709 13:14:38.636147  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 170662us
I20260709 13:14:38.636734  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:38.639643  3959 raft_consensus.cc:2468] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 1.
I20260709 13:14:38.592209  5441 raft_consensus.cc:493] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:38.646436  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:38.593374  5248 raft_consensus.cc:515] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:38.680037  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 209010us
I20260709 13:14:38.655438  5310 raft_consensus.cc:697] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 3 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:14:38.655196  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:38.682188  4675 leader_election.cc:304] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
W20260709 13:14:38.690479  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 421951us
W20260709 13:14:38.691772  3999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 315559us
W20260709 13:14:38.682881  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 454542us
W20260709 13:14:38.682684  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 414591us
I20260709 13:14:38.688292  4026 raft_consensus.cc:3055] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:38.688704  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:38.693529  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:38.693933  4026 raft_consensus.cc:740] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:38.694520  4030 raft_consensus.cc:2393] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 in current term 4: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:14:38.679869  5263 raft_consensus.cc:493] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.696395  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:38.699013  4025 raft_consensus.cc:3060] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:38.700183  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:38.657294  5441 raft_consensus.cc:515] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:38.706303  3922 connection.cc:256] RPC call timeout handler was delayed by -2.0312254240000129s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21860000000000002s for a response
I20260709 13:14:38.707280  3925 leader_election.cc:304] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:14:38.709120  3925 leader_election.cc:304] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:38.709368  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:38.709970  5450 raft_consensus.cc:2804] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:38.710618  3925 leader_election.cc:304] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:38.710863  5450 raft_consensus.cc:697] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 3 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:38.711601  5455 raft_consensus.cc:2804] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:38.712093  5455 raft_consensus.cc:493] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:38.712463  5455 raft_consensus.cc:3060] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:38.712391  5450 consensus_queue.cc:237] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:38.710049  3954 raft_consensus.cc:3060] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:38.691150  5403 raft_consensus.cc:2749] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:38.719218  3924 leader_election.cc:304] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
W20260709 13:14:38.728130  3998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:38.729820  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:38.719719  4026 consensus_queue.cc:260] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:38.733227  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:38.729549  3925 leader_election.cc:304] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:14:38.740581  3998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:38.735898  3957 raft_consensus.cc:2468] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 2.
I20260709 13:14:38.699893  3952 raft_consensus.cc:2468] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 3.
I20260709 13:14:38.733595  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:38.742519  4026 raft_consensus.cc:3060] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:38.702831  5382 raft_consensus.cc:697] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 2 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:14:38.749199  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:38.739494  3953 raft_consensus.cc:1240] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:38.740036  5370 leader_election.cc:290] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:38.759116  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:38.760962  3957 raft_consensus.cc:2468] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 2.
I20260709 13:14:38.759856  4074 leader_election.cc:304] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:38.702884  5263 raft_consensus.cc:515] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:38.760888  4672 leader_election.cc:304] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:38.770466  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:38.770298  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:38.766098  5488 raft_consensus.cc:2804] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:14:38.782315  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 100189us
I20260709 13:14:38.783746  4675 leader_election.cc:304] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:38.784873  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:38.785935  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:38.769981  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:38.789369  3950 raft_consensus.cc:2393] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 in current term 3: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:14:38.792068  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:38.793241  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:38.783939  5370 raft_consensus.cc:2804] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:38.780162  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:38.802160  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:38.786223  5293 raft_consensus.cc:2749] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:14:38.800989  5473 log.cc:927] Time spent T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:14:38.765837  5310 consensus_queue.cc:237] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:38.860004  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:14:38.860252  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 90063.8us
I20260709 13:14:38.801875  5248 leader_election.cc:290] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:38.812376  5370 raft_consensus.cc:493] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:38.851679  5345 consensus_meta.cc:287] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.525s	user 0.009s	sys 0.005s
I20260709 13:14:38.865226  4026 raft_consensus.cc:1275] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:14:38.870079  4026 pending_rounds.cc:85] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2: Aborting all ops after (but not including) 1
I20260709 13:14:38.883888  4672 leader_election.cc:304] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:38.886647  4025 raft_consensus.cc:2468] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3.
W20260709 13:14:38.888521  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 130858us
W20260709 13:14:38.891721  3999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 140764us
I20260709 13:14:38.891981  4709 raft_consensus.cc:1275] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:38.892815  5488 raft_consensus.cc:697] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 4 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:14:38.802248  5453 raft_consensus.cc:515] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:38.867911  5370 raft_consensus.cc:3060] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:38.884809  4026 pending_rounds.cc:107] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:14:38.901573  4026 raft_consensus.cc:2889] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:38.903260  4672 leader_election.cc:304] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
W20260709 13:14:38.908331  5483 log.cc:927] Time spent T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:14:38.908869  5340 consensus_queue.cc:1048] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:14:38.909291  5479 log.cc:927] Time spent T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:14:38.864457  5491 consensus_queue.cc:1048] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:14:38.913000  5495 raft_consensus.cc:493] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.913637  5495 raft_consensus.cc:515] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:38.865350  5382 consensus_queue.cc:237] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:14:38.918711  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 131442us
I20260709 13:14:38.894739  5248 raft_consensus.cc:2804] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:38.927501  4672 leader_election.cc:304] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:38.938565  3958 raft_consensus.cc:2393] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 3: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:14:38.899021  5441 leader_election.cc:290] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:38.900306  5492 raft_consensus.cc:2764] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:14:38.943053  4672 leader_election.cc:304] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:38.944026  5489 raft_consensus.cc:2749] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:14:38.945526  4071 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.012s	sys 0.031s
I20260709 13:14:38.925853  5486 raft_consensus.cc:2804] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:14:38.948639  4073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:38.949347  5490 log.cc:927] Time spent T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260709 13:14:38.950006  5481 log.cc:927] Time spent T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
W20260709 13:14:38.960284  4071 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.013s	sys 0.032s
W20260709 13:14:38.966109  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 182423us
W20260709 13:14:38.974143  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 708998us
I20260709 13:14:38.889950  5345 consensus_queue.cc:1059] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:14:38.936561  5248 raft_consensus.cc:493] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
W20260709 13:14:38.986851  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 43848.1us
I20260709 13:14:38.991847  3999 leader_election.cc:304] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
W20260709 13:14:38.991524  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 46992.1us
I20260709 13:14:38.996593  4672 leader_election.cc:304] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:38.942536  5263 leader_election.cc:290] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:14:39.002174  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 280018us
I20260709 13:14:38.974071  5491 raft_consensus.cc:2749] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:39.003603  3997 leader_election.cc:304] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:39.006035  3925 leader_election.cc:304] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:39.007787  4073 leader_election.cc:400] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Vote denied by peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117) with higher term. Message: Invalid argument: T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 2. Current term is 3.
I20260709 13:14:38.999912  5248 raft_consensus.cc:3060] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:38.983003  5486 raft_consensus.cc:697] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 3 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:14:39.023993  4672 leader_election.cc:304] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:38.965229  5500 consensus_queue.cc:1048] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
W20260709 13:14:39.027197  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 43535.3us
I20260709 13:14:38.991531  5400 consensus_queue.cc:1048] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:14:39.005080  5485 raft_consensus.cc:2804] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:39.028165  3925 leader_election.cc:304] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:39.005484  5492 raft_consensus.cc:2764] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:14:39.033468  5495 leader_election.cc:290] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:39.003239  5441 consensus_queue.cc:1048] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:14:39.010525  5496 raft_consensus.cc:2749] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:39.034888  3997 leader_election.cc:304] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:39.022202  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:39.005826  5345 consensus_queue.cc:1059] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:14:39.040776  4073 leader_election.cc:304] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:14:39.008572  5310 raft_consensus.cc:2749] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:39.056938  3997 leader_election.cc:304] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:39.060648  4071 leader_election.cc:304] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:39.031199  5477 raft_consensus.cc:2804] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:39.024401  5484 raft_consensus.cc:2804] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:39.035527  5491 raft_consensus.cc:3060] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:39.064440  4073 leader_election.cc:304] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:39.066636  3925 leader_election.cc:304] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:14:39.068710  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 44804.4us
I20260709 13:14:39.069507  4672 leader_election.cc:304] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:39.073480  4073 leader_election.cc:304] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:39.039256  5485 raft_consensus.cc:697] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:39.078879  3997 leader_election.cc:304] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:39.080387  5400 raft_consensus.cc:2804] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:39.080978  5400 raft_consensus.cc:697] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:39.081486  5441 raft_consensus.cc:2804] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:39.081898  5441 raft_consensus.cc:493] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:39.082264  5441 raft_consensus.cc:3060] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:39.081988  5400 consensus_queue.cc:237] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:39.053478  5476 raft_consensus.cc:2749] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:39.079689  3997 leader_election.cc:304] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:39.083685  5497 raft_consensus.cc:2749] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:39.063951  5477 raft_consensus.cc:493] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:39.065622  5293 raft_consensus.cc:2804] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:39.052079  5461 ts_tablet_manager.cc:1929] T 86669993fba94e65ba192aa115ed6e88 P f1c75790cedf4f52a3463a255c7da059: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
W20260709 13:14:39.113762  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 43496.4us
I20260709 13:14:39.020653  5488 consensus_queue.cc:237] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:14:39.114672  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 45251.2us
I20260709 13:14:39.123350  4672 leader_election.cc:304] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:39.095700  3997 leader_election.cc:304] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:39.083384  3954 raft_consensus.cc:2468] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 3.
I20260709 13:14:39.075971  5403 raft_consensus.cc:2749] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:39.072680  5502 raft_consensus.cc:2749] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:39.073880  5446 raft_consensus.cc:2749] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:39.088078  5455 raft_consensus.cc:515] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:39.142781  5455 leader_election.cc:290] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:39.143831  5497 raft_consensus.cc:2749] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:39.144621  5486 consensus_queue.cc:237] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:39.085448  5301 consensus_queue.cc:1059] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:14:39.145902  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:39.076874  5484 raft_consensus.cc:697] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:39.147431  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:39.116288  5453 leader_election.cc:290] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:39.138885  5299 consensus_queue.cc:1059] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:14:39.148494  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:39.148296  5484 consensus_queue.cc:237] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:39.149186  4030 raft_consensus.cc:2468] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
W20260709 13:14:39.150108  5472 consensus_meta.cc:287] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.699s	user 0.015s	sys 0.000s
I20260709 13:14:39.150919  5472 raft_consensus.cc:3055] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:14:39.115368  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 54592.5us
W20260709 13:14:39.118366  5444 consensus_meta.cc:287] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 0.669s	user 0.008s	sys 0.004s
I20260709 13:14:39.120105  5450 raft_consensus.cc:2804] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:14:39.121712  5478 log.cc:927] Time spent T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.210s	user 0.000s	sys 0.002s
I20260709 13:14:39.077471  5263 raft_consensus.cc:2804] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:39.123615  5310 raft_consensus.cc:2749] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:39.134050  5485 consensus_queue.cc:237] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:39.135282  5471 raft_consensus.cc:2804] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:39.080420  5345 raft_consensus.cc:3055] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:39.138695  5461 log.cc:1199] T 86669993fba94e65ba192aa115ed6e88 P f1c75790cedf4f52a3463a255c7da059: Deleting WAL directory at /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/ts-0-root/wals/86669993fba94e65ba192aa115ed6e88
I20260709 13:14:39.167364  5506 raft_consensus.cc:2749] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:39.113907  5477 raft_consensus.cc:3060] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:14:39.167472  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 44199.7us
I20260709 13:14:39.122691  5340 raft_consensus.cc:2804] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:39.175000  3925 leader_election.cc:304] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:39.116376  5293 raft_consensus.cc:493] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:39.182197  4672 leader_election.cc:304] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
W20260709 13:14:39.180701  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 92318.9us
W20260709 13:14:39.178673  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 83113.6us
I20260709 13:14:39.151419  5472 raft_consensus.cc:740] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:39.184255  3997 leader_election.cc:304] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:39.183149  3925 leader_election.cc:304] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:39.178014  5263 raft_consensus.cc:493] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:39.172156  5450 raft_consensus.cc:493] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:39.186312  5453 raft_consensus.cc:2804] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:39.182005  5340 raft_consensus.cc:493] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:39.187953  3997 leader_election.cc:304] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:39.192590  5404 raft_consensus.cc:3055] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:39.211684  5404 raft_consensus.cc:740] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:39.212853  5404 consensus_queue.cc:260] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:39.214541  5404 raft_consensus.cc:3060] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:39.193003  5461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38604 (request call id 77) took 1919 ms. Trace:
I20260709 13:14:39.215472  5461 rpcz_store.cc:276] 0709 13:14:37.273333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.273526 (+   193us) service_pool.cc:224] Handling call
0709 13:14:37.568374 (+294848us) ts_tablet_manager.cc:1151] Deleting tablet 86669993fba94e65ba192aa115ed6e88
0709 13:14:37.568468 (+    94us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:14:38.405935 (+837467us) tablet_metadata.cc:665] Metadata flushed
0709 13:14:39.035353 (+629418us) tablet_metadata.cc:665] Metadata flushed
0709 13:14:39.192911 (+157558us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":232923,"tablet-delete.queue_time_us":63202,"thread_start_us":55132,"threads_started":1}
I20260709 13:14:39.195852  5472 consensus_queue.cc:260] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:39.199815  3998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:39.181025  5471 raft_consensus.cc:697] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
W20260709 13:14:39.204794  4073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 131407us
I20260709 13:14:39.180332  5345 raft_consensus.cc:740] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:39.209472  5455 raft_consensus.cc:2804] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:39.221557  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:39.201757  4672 leader_election.cc:304] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:39.240638  4030 raft_consensus.cc:2468] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 2.
I20260709 13:14:39.240898  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:39.222575  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:39.222891  3925 leader_election.cc:304] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:39.227638  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:39.241601  4025 raft_consensus.cc:2376] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3. Re-sending same reply.
I20260709 13:14:39.183941  5293 raft_consensus.cc:3060] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:39.197587  5444 raft_consensus.cc:2804] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:39.242983  4034 raft_consensus.cc:2393] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 3: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:14:39.245020  5501 raft_consensus.cc:2804] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:39.245626  5501 raft_consensus.cc:493] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:39.246170  5501 raft_consensus.cc:3060] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:39.205291  5450 raft_consensus.cc:3060] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:39.247056  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:39.201089  5263 raft_consensus.cc:3060] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:39.247069  4103 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 4.
I20260709 13:14:39.207930  5310 raft_consensus.cc:2749] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:39.248253  3925 leader_election.cc:304] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:14:39.255801  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:39.252803  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:39.257217  4026 raft_consensus.cc:2393] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 3: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
I20260709 13:14:39.221095  5340 raft_consensus.cc:3060] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:39.205566  5453 raft_consensus.cc:493] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:39.254739  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:39.254914  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:39.252221  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
W20260709 13:14:39.249552  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 47915.3us
I20260709 13:14:39.261201  4101 raft_consensus.cc:2468] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 2.
I20260709 13:14:39.261729  4672 leader_election.cc:304] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:39.240094  5497 raft_consensus.cc:2804] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:39.258100  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:39.263819  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:39.264595  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:39.242693  5499 consensus_queue.cc:1059] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:14:39.263355  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:39.268141  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:39.268783  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:39.268497  5345 consensus_queue.cc:260] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:39.247881  5444 raft_consensus.cc:493] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:39.270364  5471 consensus_queue.cc:237] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:39.273095  5263 raft_consensus.cc:515] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:39.274628  5248 raft_consensus.cc:515] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:39.249832  5455 raft_consensus.cc:697] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 3 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
W20260709 13:14:39.275023  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 91661.3us
I20260709 13:14:39.301204  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:39.301921  4101 raft_consensus.cc:2468] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 1.
I20260709 13:14:39.302004  4071 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:14:39.243639  5489 raft_consensus.cc:2749] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:39.277252  3925 leader_election.cc:304] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:39.248811  5503 raft_consensus.cc:493] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.307807  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:39.307749  5503 raft_consensus.cc:515] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:39.281131  5453 raft_consensus.cc:3060] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:39.310091  5503 leader_election.cc:290] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:39.280483  5476 raft_consensus.cc:2749] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:39.283892  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:39.284322  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:39.285171  4033 raft_consensus.cc:1240] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:39.311751  4031 raft_consensus.cc:3060] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:39.286541  4034 raft_consensus.cc:1240] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:39.287997  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:39.312652  4032 raft_consensus.cc:2468] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:39.281574  5497 raft_consensus.cc:493] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:39.313506  5497 raft_consensus.cc:3060] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:39.314404  5263 leader_election.cc:290] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:39.288874  5310 raft_consensus.cc:2749] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:39.315621  3925 leader_election.cc:304] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:39.317253  3925 leader_election.cc:304] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:14:39.318176  4071 leader_election.cc:304] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:39.318394  3925 leader_election.cc:304] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:39.319205  5500 raft_consensus.cc:2804] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:39.319159  4071 leader_election.cc:304] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:14:39.292698  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 73948.1us
I20260709 13:14:39.268141  5370 raft_consensus.cc:515] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:39.303139  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:39.304044  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:39.304590  5455 consensus_queue.cc:237] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:39.289410  4672 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:39.326918  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:39.321400  3997 leader_election.cc:304] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:39.324318  4026 raft_consensus.cc:2393] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 3: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:14:39.327605  4106 raft_consensus.cc:2468] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 2.
I20260709 13:14:39.319723  5454 raft_consensus.cc:2804] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:39.328615  3997 leader_election.cc:304] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:39.330708  3997 leader_election.cc:304] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:39.332823  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:39.332989  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:39.333716  4101 raft_consensus.cc:3060] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:39.299796  5444 raft_consensus.cc:3060] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:39.336645  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:39.337560  4034 raft_consensus.cc:2393] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 2: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:14:39.319718  5500 raft_consensus.cc:493] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:39.319890  5495 raft_consensus.cc:2749] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:39.342487  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:39.342911  4026 raft_consensus.cc:1275] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:14:39.343367  4026 pending_rounds.cc:85] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2: Aborting all ops after (but not including) 4
I20260709 13:14:39.343473  4071 leader_election.cc:304] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:39.343781  4026 pending_rounds.cc:107] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:14:39.344321  4026 raft_consensus.cc:2889] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:39.347016  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:39.329406  5454 raft_consensus.cc:493] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:39.325439  5299 raft_consensus.cc:2804] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:39.349720  4106 raft_consensus.cc:2393] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 3: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:39.327872  5476 consensus_queue.cc:1048] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:14:39.333091  5499 raft_consensus.cc:2804] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:39.356709  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:39.361327  4026 pending_rounds.cc:85] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2: Aborting all ops after (but not including) 4
I20260709 13:14:39.361836  4026 pending_rounds.cc:107] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:14:39.362155  4026 raft_consensus.cc:2889] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:39.340448  5489 raft_consensus.cc:2804] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:39.341857  5403 raft_consensus.cc:2804] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:39.343146  5500 raft_consensus.cc:3060] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:39.354321  5454 raft_consensus.cc:3060] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:39.365515  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:39.366701  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:39.368793  4034 raft_consensus.cc:3060] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:39.350274  5299 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:14:39.370105  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:39.370903  4106 raft_consensus.cc:2393] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 4: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:39.367853  5403 raft_consensus.cc:493] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:39.360327  5499 raft_consensus.cc:493] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:39.375710  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:39.377071  4031 raft_consensus.cc:2468] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 4.
I20260709 13:14:39.358240  5495 raft_consensus.cc:493] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:14:39.372023  5475 raft_consensus.cc:2804] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:39.377699  5403 raft_consensus.cc:3060] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:39.389264  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:39.390062  3958 raft_consensus.cc:2368] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 2. Current term is 3.
I20260709 13:14:39.390998  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:39.393080  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:39.388160  5495 raft_consensus.cc:515] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:39.400849  4106 raft_consensus.cc:2468] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 1.
I20260709 13:14:39.404716  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:39.405534  4101 raft_consensus.cc:2410] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:14:39.372206  5299 raft_consensus.cc:3060] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:39.379123  5485 raft_consensus.cc:2804] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:39.412788  4104 raft_consensus.cc:2393] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 4: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:39.377990  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:39.372689  5489 raft_consensus.cc:697] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 3 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:14:39.381002  5499 raft_consensus.cc:3060] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:39.433233  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:39.434136  4104 raft_consensus.cc:2468] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 2.
I20260709 13:14:39.435753  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:39.436129  5477 raft_consensus.cc:515] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:39.388377  5248 leader_election.cc:290] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:39.413563  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:39.381057  5293 raft_consensus.cc:515] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:39.450402  5521 raft_consensus.cc:2804] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:39.468365  4102 raft_consensus.cc:1275] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:14:39.468825  4102 pending_rounds.cc:85] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Aborting all ops after (but not including) 4
I20260709 13:14:39.469067  4102 pending_rounds.cc:107] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:14:39.469332  4102 raft_consensus.cc:2889] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:39.470743  3955 raft_consensus.cc:1240] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:39.411144  5503 raft_consensus.cc:493] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.436151  3953 raft_consensus.cc:1240] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:14:39.422338  5495 leader_election.cc:290] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:39.477155  3959 raft_consensus.cc:1240] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:39.445137  5517 raft_consensus.cc:2804] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:39.415828  5485 raft_consensus.cc:493] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:39.479774  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:39.521991  4101 raft_consensus.cc:2468] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 2.
I20260709 13:14:39.443490  5507 raft_consensus.cc:2804] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:39.525804  5370 leader_election.cc:290] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:39.526535  3954 raft_consensus.cc:2393] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 3: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:14:39.527784  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:39.528443  3954 raft_consensus.cc:3060] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:39.522600  5485 raft_consensus.cc:3060] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:39.543165  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:39.547801  4104 raft_consensus.cc:2393] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 3: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:39.468433  5521 raft_consensus.cc:493] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:39.467264  5293 leader_election.cc:290] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:39.575840  5507 raft_consensus.cc:697] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 3 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:39.576965  5507 consensus_queue.cc:237] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:39.558794  5521 raft_consensus.cc:3060] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:39.556537  5517 raft_consensus.cc:697] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:39.588567  5517 consensus_queue.cc:237] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:39.598623  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:39.599856  4101 raft_consensus.cc:2393] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 3: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:39.518067  5488 consensus_queue.cc:1048] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.094s
I20260709 13:14:39.604097  5489 consensus_queue.cc:237] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:39.610432  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:39.615550  4031 raft_consensus.cc:1275] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:39.619925  4031 raft_consensus.cc:1275] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:39.519658  5503 raft_consensus.cc:515] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:39.582540  4104 raft_consensus.cc:1275] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:14:39.628245  3998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:39.635015  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 304364us
I20260709 13:14:39.636889  3997 leader_election.cc:304] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:39.638518  3997 leader_election.cc:304] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:39.642316  4107 raft_consensus.cc:1275] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:39.647652  4101 raft_consensus.cc:3060] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:39.651834  5493 consensus_queue.cc:1048] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:14:39.648957  5446 raft_consensus.cc:2764] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:14:39.654378  5503 leader_election.cc:290] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:39.487115  5475 raft_consensus.cc:697] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:39.662813  4103 raft_consensus.cc:1275] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:39.629184  5486 consensus_queue.cc:1048] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:14:39.675350  3997 leader_election.cc:304] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:39.686244  4108 raft_consensus.cc:2468] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3.
I20260709 13:14:39.690152  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:39.648875  5484 raft_consensus.cc:2749] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:39.696674  4034 raft_consensus.cc:2468] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3.
I20260709 13:14:39.698204  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:39.705583  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:39.663275  5488 consensus_queue.cc:1048] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:14:39.680548  5345 raft_consensus.cc:3060] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:39.716287  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:39.717741  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:39.718699  4103 raft_consensus.cc:2468] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 2.
I20260709 13:14:39.727072  5501 raft_consensus.cc:515] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:39.727219  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:14:39.780834  5340 consensus_meta.cc:287] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 0.503s	user 0.013s	sys 0.004s
I20260709 13:14:39.781227  4034 raft_consensus.cc:1275] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:14:39.713781  5491 consensus_meta.cc:287] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938: Time spent flushing consensus metadata: real 0.643s	user 0.023s	sys 0.004s
I20260709 13:14:39.770696  5475 consensus_queue.cc:237] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:39.793421  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:40.011174  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:39.796779  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:39.796397  5444 raft_consensus.cc:515] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:39.798278  5525 log.cc:927] Time spent T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
W20260709 13:14:40.017236  5537 log.cc:927] Time spent T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
I20260709 13:14:39.800204  5497 raft_consensus.cc:515] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:39.871798  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
W20260709 13:14:39.920465  5535 log.cc:927] Time spent T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.131s	user 0.005s	sys 0.027s
W20260709 13:14:39.929342  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 254194us
I20260709 13:14:39.874846  5299 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:39.730573  5528 raft_consensus.cc:2955] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:40.008970  5484 raft_consensus.cc:2804] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:40.006409  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:39.996170  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:14:39.994267  5441 consensus_meta.cc:287] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 0.912s	user 0.015s	sys 0.028s
I20260709 13:14:40.012156  4107 raft_consensus.cc:2468] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 2.
I20260709 13:14:40.030596  4029 raft_consensus.cc:1240] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 2. Current term is 3. Ops: []
W20260709 13:14:40.009449  5453 consensus_meta.cc:287] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.700s	user 0.019s	sys 0.013s
W20260709 13:14:40.009894  5454 consensus_meta.cc:287] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.618s	user 0.011s	sys 0.032s
W20260709 13:14:40.009635  5403 consensus_meta.cc:287] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.607s	user 0.009s	sys 0.021s
I20260709 13:14:40.022487  4104 raft_consensus.cc:3060] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:40.025548  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:40.061266  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:40.061554  4103 raft_consensus.cc:3060] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:14:39.732982  3957 raft_consensus.cc:2368] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 2. Current term is 3.
I20260709 13:14:39.923102  5521 raft_consensus.cc:515] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:40.002791  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:40.005218  5489 raft_consensus.cc:493] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
W20260709 13:14:40.029644  3958 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.030s	sys 0.045s
I20260709 13:14:40.032409  3955 raft_consensus.cc:2393] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 3: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
W20260709 13:14:40.069033  3958 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.031s	sys 0.045s
I20260709 13:14:40.033176  3997 leader_election.cc:304] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:40.013790  5491 raft_consensus.cc:2749] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:40.014006  5340 raft_consensus.cc:515] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:40.026124  4071 leader_election.cc:400] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Vote denied by peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339) with higher term. Message: Invalid argument: T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 2. Current term is 3.
I20260709 13:14:40.035563  4028 raft_consensus.cc:1240] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:14:40.079567  4071 leader_election.cc:403] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:40.007895  4101 raft_consensus.cc:1275] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:40.062029  4107 raft_consensus.cc:2468] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3.
I20260709 13:14:40.070778  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:40.072253  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:40.015784  3953 raft_consensus.cc:3060] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:40.029472  5484 raft_consensus.cc:493] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:40.060693  5454 raft_consensus.cc:515] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:40.037271  5453 raft_consensus.cc:515] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:40.085714  4026 raft_consensus.cc:2468] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 2.
I20260709 13:14:40.094278  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:40.095031  4026 raft_consensus.cc:2393] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 3: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:14:40.087282  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
W20260709 13:14:40.097819  4074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:40.098865  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:40.099579  3959 raft_consensus.cc:2468] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 2.
I20260709 13:14:40.105420  4027 raft_consensus.cc:2368] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 3. Current term is 4.
W20260709 13:14:40.110469  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 84508.9us
I20260709 13:14:40.111394  4071 leader_election.cc:304] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
W20260709 13:14:40.117564  5539 log.cc:927] Time spent T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:14:40.118459  5454 leader_election.cc:290] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:40.118820  4703 raft_consensus.cc:1240] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:40.119182  5527 raft_consensus.cc:2749] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:14:40.122815  5543 log.cc:927] Time spent T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:14:40.123354  3952 raft_consensus.cc:1240] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:40.124943  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:40.125198  5542 raft_consensus.cc:2749] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:40.125784  4106 raft_consensus.cc:2393] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 4: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
I20260709 13:14:40.121685  5453 leader_election.cc:290] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:40.082692  4102 raft_consensus.cc:1240] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:40.037624  5493 consensus_queue.cc:1048] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:14:40.035261  5441 raft_consensus.cc:515] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:40.098716  5532 log.cc:927] Time spent T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.248s	user 0.006s	sys 0.010s
I20260709 13:14:40.086973  5484 raft_consensus.cc:3060] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:40.134569  5498 raft_consensus.cc:3055] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:14:40.145274  5530 log.cc:927] Time spent T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:14:40.145617  3956 raft_consensus.cc:1240] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:40.086083  5501 leader_election.cc:290] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:40.161695  5485 consensus_meta.cc:287] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 0.629s	user 0.007s	sys 0.015s
W20260709 13:14:40.147275  5540 log.cc:927] Time spent T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:14:40.149143  5521 leader_election.cc:290] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:40.152523  3954 consensus_meta.cc:287] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.624s	user 0.011s	sys 0.019s
I20260709 13:14:40.225139  3954 raft_consensus.cc:2468] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:40.226614  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:40.152395  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:40.155877  5477 leader_election.cc:290] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:40.157965  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:40.228750  4105 raft_consensus.cc:2393] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 4: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:40.065161  5403 raft_consensus.cc:515] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:40.127739  4071 leader_election.cc:304] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:40.166430  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:40.176082  4103 raft_consensus.cc:2468] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3.
I20260709 13:14:40.128265  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:40.233951  4026 raft_consensus.cc:2468] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 2.
I20260709 13:14:40.234097  5516 raft_consensus.cc:2749] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:40.192394  3922 leader_election.cc:304] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:40.235410  5403 leader_election.cc:290] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:40.235854  3922 leader_election.cc:304] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
W20260709 13:14:40.232774  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 105054us
I20260709 13:14:40.238068  5517 consensus_queue.cc:1059] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:40.238227  3853 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52092 (request call id 204) took 8052 ms. Trace:
I20260709 13:14:40.238950  5517 consensus_queue.cc:1059] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:40.240638  5503 raft_consensus.cc:3055] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:40.241037  5503 raft_consensus.cc:740] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:40.241878  5503 consensus_queue.cc:260] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:39.269328  3841 catalog_manager.cc:5028] TS f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): tablet 86669993fba94e65ba192aa115ed6e88 (table test-workload [id=8a2760e8528448a780fea6ccf25816cb]) successfully deleted
I20260709 13:14:40.243141  5503 raft_consensus.cc:3060] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:40.200295  4025 raft_consensus.cc:2393] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 4: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:14:40.078366  5489 raft_consensus.cc:515] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:40.204133  5497 leader_election.cc:290] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:40.205492  5500 consensus_meta.cc:287] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.827s	user 0.018s	sys 0.008s
I20260709 13:14:40.178747  5498 raft_consensus.cc:740] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:40.206614  5299 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:40.207736  5472 raft_consensus.cc:3060] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:40.208189  5444 leader_election.cc:290] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:40.209743  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:14:40.211591  5531 log.cc:927] Time spent T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 13:14:40.211771  5485 raft_consensus.cc:515] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:40.212273  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:14:40.213882  5499 consensus_meta.cc:287] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 0.768s	user 0.026s	sys 0.012s
I20260709 13:14:40.266499  5403 raft_consensus.cc:3055] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:40.161949  5527 consensus_queue.cc:1059] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:14:40.261451  4104 raft_consensus.cc:2468] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3.
I20260709 13:14:40.268265  4074 leader_election.cc:304] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:14:40.178499  5454 raft_consensus.cc:493] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:40.268599  4071 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:40.297184  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:40.245147  5404 raft_consensus.cc:2749] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339) with higher term. Message: Invalid argument: T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 2. Current term is 3.
W20260709 13:14:40.276943  3841 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 1.0573e+06us
W20260709 13:14:40.257002  5450 consensus_meta.cc:287] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.998s	user 0.000s	sys 0.021s
I20260709 13:14:40.279804  3956 raft_consensus.cc:2468] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:14:40.256157  5476 raft_consensus.cc:2804] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:40.265427  5453 raft_consensus.cc:2804] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:14:40.232582  5345 consensus_meta.cc:287] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.515s	user 0.011s	sys 0.000s
I20260709 13:14:40.281147  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:40.306839  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:40.307495  3955 raft_consensus.cc:2393] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 4: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
W20260709 13:14:40.307479  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 279215us
I20260709 13:14:40.284474  3951 raft_consensus.cc:3060] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:14:40.287132  4029 raft_consensus.cc:1275] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:40.308358  3997 leader_election.cc:304] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:40.297950  4033 raft_consensus.cc:2393] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 4: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:40.267426  5500 raft_consensus.cc:515] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:40.283864  3855 catalog_manager.cc:5697] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 2 to 3, leader changed from 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 3 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:40.300161  3922 leader_election.cc:304] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:14:40.311461  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:40.316371  4030 raft_consensus.cc:3060] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:40.286827  5403 raft_consensus.cc:740] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:40.313498  4028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38290 (request call id 1391) took 1026 ms. Trace:
I20260709 13:14:40.313833  3997 leader_election.cc:304] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:40.314723  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:40.319188  4028 rpcz_store.cc:276] 0709 13:14:39.286836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:39.286977 (+   141us) service_pool.cc:224] Handling call
0709 13:14:39.287392 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:40.079696 (+792304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:40.313254 (+233558us) spinlock_profiling.cc:243] Waited 748 ms on lock 0x7b54001e9bd4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:14:40.313441 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1719934336}
I20260709 13:14:40.320897  4025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38290 (request call id 1379) took 1071 ms. Trace:
I20260709 13:14:40.321349  4025 rpcz_store.cc:276] 0709 13:14:39.242895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:39.243942 (+  1047us) service_pool.cc:224] Handling call
0709 13:14:40.313660 (+1069718us) spinlock_profiling.cc:243] Waited 938 ms on lock 0x7b540026e8d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:14:40.313780 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2156823424}
I20260709 13:14:40.304548  5340 leader_election.cc:290] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:40.329093  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:40.330931  4709 raft_consensus.cc:1275] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:40.331372  3956 raft_consensus.cc:3060] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:40.332792  3997 leader_election.cc:304] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:40.311084  5453 raft_consensus.cc:493] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:40.306375  5476 raft_consensus.cc:493] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:40.286209  5499 raft_consensus.cc:515] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:40.336977  3958 raft_consensus.cc:2393] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 4: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:14:40.337558  3855 catalog_manager.cc:5697] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 1 to 2, leader changed from 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 2 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:40.320673  4100 raft_consensus.cc:1813] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Handling vote request from an unknown peer f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:40.342227  3997 leader_election.cc:304] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:14:40.344553  4027 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38290 (request call id 1373) took 1199 ms (client timeout 1580 ms). Trace:
I20260709 13:14:40.321779  5497 raft_consensus.cc:2804] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:40.347844  3855 catalog_manager.cc:5697] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 1 to 2, leader changed from 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 2 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:40.320466  5516 raft_consensus.cc:2749] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:14:40.350591  4027 rpcz_store.cc:269] 0709 13:14:39.145076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:39.147122 (+  2046us) service_pool.cc:224] Handling call
0709 13:14:40.344290 (+1197168us) spinlock_profiling.cc:243] Waited 957 ms on lock 0x7b54001e91d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:14:40.344478 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2200939904}
I20260709 13:14:40.304075  5454 raft_consensus.cc:515] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:40.359932  3955 raft_consensus.cc:1240] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:14:40.325003  5471 raft_consensus.cc:2749] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:40.306890  5450 raft_consensus.cc:515] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:40.328773  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:40.364173  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:40.340412  5521 raft_consensus.cc:2804] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:40.365978  3855 catalog_manager.cc:5697] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 2 to 3, leader changed from 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 3 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:40.341464  5453 raft_consensus.cc:3060] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:40.341286  5538 raft_consensus.cc:2804] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:40.364295  4706 raft_consensus.cc:2955] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:40.376649  3997 leader_election.cc:304] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:40.344756  5476 raft_consensus.cc:3060] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:40.378538  4030 raft_consensus.cc:2468] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3.
I20260709 13:14:40.345479  5546 raft_consensus.cc:493] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:40.390326  3855 catalog_manager.cc:5697] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 1 to 2, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 2 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
W20260709 13:14:40.398082  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 98045.9us
I20260709 13:14:40.399135  3955 raft_consensus.cc:1240] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:40.392555  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:40.304425  5498 consensus_queue.cc:260] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:40.392231  4100 raft_consensus.cc:2410] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:14:40.337482  5446 consensus_queue.cc:1048] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:14:40.375164  5293 raft_consensus.cc:2749] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:40.402153  3997 leader_election.cc:304] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:14:40.382468  5545 log.cc:927] Time spent T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.138s	user 0.002s	sys 0.000s
I20260709 13:14:40.382445  5536 raft_consensus.cc:2804] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:40.432821  5550 consensus_queue.cc:1059] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:40.433885  5550 raft_consensus.cc:3055] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:40.434216  5550 raft_consensus.cc:740] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:40.435046  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:40.382068  5454 leader_election.cc:290] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:40.382545  5340 consensus_queue.cc:1048] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:14:40.383126  5497 raft_consensus.cc:697] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:40.392817  5538 raft_consensus.cc:493] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:40.400053  5441 leader_election.cc:290] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:40.450838  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 181567us
I20260709 13:14:40.425820  5542 raft_consensus.cc:2804] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:40.453012  3955 raft_consensus.cc:1240] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:40.450071  3855 catalog_manager.cc:5697] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 1 to 2, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 2 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
W20260709 13:14:40.466723  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 64668.2us
I20260709 13:14:40.442952  5536 raft_consensus.cc:493] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:40.468524  4074 leader_election.cc:304] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:40.450665  5498 raft_consensus.cc:3060] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:40.469416  3855 catalog_manager.cc:5697] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 1 to 2, leader changed from 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 2 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:40.459985  5538 raft_consensus.cc:3060] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:40.459219  5293 raft_consensus.cc:493] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:40.435155  5550 consensus_queue.cc:260] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:40.473050  5485 leader_election.cc:290] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:40.472805  5521 raft_consensus.cc:697] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:40.475145  5497 consensus_queue.cc:237] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:40.475718  5454 raft_consensus.cc:493] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:40.476383  5500 leader_election.cc:290] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:40.478999  5499 leader_election.cc:290] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:40.424113  5546 raft_consensus.cc:515] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:14:40.480288  5554 log.cc:927] Time spent T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:14:40.483804  5340 consensus_queue.cc:1059] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:40.488408  3954 raft_consensus.cc:1240] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:40.492372  3955 raft_consensus.cc:1275] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:40.493414  3855 catalog_manager.cc:5697] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 1 to 2, leader changed from 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 2 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:40.497262  5484 raft_consensus.cc:515] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:40.499598  3957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38606 (request call id 1419) took 1124 ms. Trace:
I20260709 13:14:40.238826  3853 rpcz_store.cc:276] 0709 13:14:32.186119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:32.187577 (+  1458us) service_pool.cc:224] Handling call
0709 13:14:40.238116 (+8050539us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:37.780196 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:37.894668 (+114472us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:37.894727 (+    59us) write_op.cc:435] Acquired schema lock
0709 13:14:37.894747 (+    20us) tablet.cc:662] Decoding operations
0709 13:14:37.895197 (+   450us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:37.895305 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:37.895341 (+    36us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:14:37.895724 (+   383us) tablet.cc:701] Row locks acquired
0709 13:14:37.895784 (+    60us) write_op.cc:260] PREPARE: finished
0709 13:14:37.895978 (+   194us) write_op.cc:270] Start()
0709 13:14:37.896126 (+   148us) write_op.cc:276] Timestamp: P: 1783602877895898 usec, L: 0
0709 13:14:37.896150 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:14:37.896915 (+   765us) log.cc:844] Serialized 541 byte log entry
0709 13:14:38.767838 (+870923us) op_driver.cc:464] REPLICATION: finished
0709 13:14:39.038877 (+271039us) spinlock_profiling.cc:243] Waited 6.09 ms on lock 0x7b4400022b4c. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f15224a7c85 00007f15224a86a2 00007f152521a1db 00007f1525215aaf 00007f15225640ac 00007f152b3beab9 00007f152258069b 00007f152257e93f 00007f1522580c02 00007f15290a4ef0
0709 13:14:39.150673 (+111796us) write_op.cc:301] APPLY: starting
0709 13:14:39.150786 (+   113us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:39.150931 (+   145us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:39.150969 (+    38us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:39.151346 (+   377us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:39.151735 (+   389us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:14:39.151789 (+    54us) write_op.cc:312] APPLY: finished
0709 13:14:39.152130 (+   341us) log.cc:844] Serialized 23 byte log entry
0709 13:14:39.167454 (+ 15324us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:39.167590 (+   136us) write_op.cc:454] Released schema lock
0709 13:14:39.167678 (+    88us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:39.168245 (+   567us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:39.168292 (+    47us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":375544,"apply.run_cpu_time_us":2519,"apply.run_wall_time_us":17542,"num_ops":1,"prepare.queue_time_us":209693,"prepare.run_cpu_time_us":15883,"prepare.run_wall_time_us":305228,"raft.queue_time_us":368310,"raft.run_cpu_time_us":19908,"raft.run_wall_time_us":345064,"replication_time_us":860287,"spinlock_wait_cycles":14008576,"thread_start_us":647216,"threads_started":4,"wal-append.queue_time_us":466939,"wal-append.run_cpu_time_us":47811,"wal-append.run_wall_time_us":1833272}]]}
I20260709 13:14:40.525348  3957 rpcz_store.cc:276] 0709 13:14:39.375191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:39.375319 (+   128us) service_pool.cc:224] Handling call
0709 13:14:40.499354 (+1124035us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b5400168fd4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:14:40.499497 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":807553792}
I20260709 13:14:40.517094  5486 raft_consensus.cc:493] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:40.471815  5536 raft_consensus.cc:3060] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:40.517591  5299 raft_consensus.cc:2749] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:40.472100  5552 raft_consensus.cc:2804] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:40.417969  5403 consensus_queue.cc:260] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:40.507151  5528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:38278 (request call id 72) took 3235 ms. Trace:
I20260709 13:14:40.508462  5450 leader_election.cc:290] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:40.509116  5549 log.cc:927] Time spent T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.173s	user 0.002s	sys 0.000s
I20260709 13:14:40.520679  5454 raft_consensus.cc:515] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:40.561866  5486 raft_consensus.cc:515] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:40.573097  4034 raft_consensus.cc:1240] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:40.561691  3953 raft_consensus.cc:2468] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:40.574158  5484 leader_election.cc:290] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:40.576385  4099 raft_consensus.cc:2410] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:14:40.515771  5293 raft_consensus.cc:515] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:14:40.580562  4073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:40.581530  5293 leader_election.cc:290] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:40.582479  5403 raft_consensus.cc:3060] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:40.585549  4104 raft_consensus.cc:1275] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:40.587288  3958 raft_consensus.cc:1275] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:40.595404  3956 raft_consensus.cc:2468] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:40.418588  4030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4"
dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
mode: GRACEFUL
new_leader_uuid: "d709ee666b774ec29aa732e508219938"
 from {username='slave'} at 127.0.0.1:44232
I20260709 13:14:40.471704  5489 leader_election.cc:290] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:40.518435  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 49986.8us
I20260709 13:14:40.518805  5477 consensus_queue.cc:1048] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
W20260709 13:14:40.521610  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 253130us
I20260709 13:14:40.465207  5542 raft_consensus.cc:493] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
W20260709 13:14:40.527218  3997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:40.624908  3997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:40.625564  3997 connection.cc:256] RPC call timeout handler was delayed by -1.6443020970000362s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1511s for a response
W20260709 13:14:40.626021  3997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:40.626379  3997 connection.cc:256] RPC call timeout handler was delayed by -1.6173020969999925s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15410000000000001s for a response
W20260709 13:14:40.626861  3997 connection.cc:256] RPC call timeout handler was delayed by -1.5194875739998679s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1743s for a response
I20260709 13:14:40.542017  3922 leader_election.cc:304] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:40.550132  3855 catalog_manager.cc:5697] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 1 to 2, leader changed from 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 2 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:40.611865  4030 raft_consensus.cc:606] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Received request to transfer leadership to TS d709ee666b774ec29aa732e508219938
I20260709 13:14:40.628640  4030 raft_consensus.cc:614] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:40.613758  4074 leader_election.cc:304] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:14:40.620574  4071 leader_election.cc:304] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:14:40.627266  3997 connection.cc:256] RPC call timeout handler was delayed by -1.5014875739998388s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1763s for a response
W20260709 13:14:40.630424  3997 connection.cc:256] RPC call timeout handler was delayed by -1.463687574000005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1805s for a response
W20260709 13:14:40.630846  3997 connection.cc:256] RPC call timeout handler was delayed by -1.3781875739998668s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19s for a response
W20260709 13:14:40.631222  3997 connection.cc:256] RPC call timeout handler was delayed by -1.3464020970000092s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18420000000000003s for a response
W20260709 13:14:40.631616  3997 connection.cc:256] RPC call timeout handler was delayed by -1.3360917190000237s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1836s for a response
W20260709 13:14:40.631991  3997 connection.cc:256] RPC call timeout handler was delayed by -1.3025875739999719s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19840000000000002s for a response
W20260709 13:14:40.632372  3997 connection.cc:256] RPC call timeout handler was delayed by -1.2901917189999494s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1887s for a response
W20260709 13:14:40.632730  3997 connection.cc:256] RPC call timeout handler was delayed by -1.2458875739998803s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20470000000000002s for a response
W20260709 13:14:40.633096  3997 connection.cc:256] RPC call timeout handler was delayed by -1.1864875740000116s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21130000000000002s for a response
W20260709 13:14:40.633581  3997 connection.cc:256] RPC call timeout handler was delayed by -1.1764689059998545s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17500000000000002s for a response
W20260709 13:14:40.633973  3997 connection.cc:256] RPC call timeout handler was delayed by -1.1547020969999267s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20550000000000002s for a response
W20260709 13:14:40.634356  3997 connection.cc:256] RPC call timeout handler was delayed by -1.0721875739998268s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22400000000000003s for a response
W20260709 13:14:40.634725  3997 connection.cc:256] RPC call timeout handler was delayed by -1.0667875739998181s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22460000000000002s for a response
W20260709 13:14:40.635094  3997 connection.cc:256] RPC call timeout handler was delayed by -1.0440851739999744s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17900000000000002s for a response
I20260709 13:14:40.573895  5486 leader_election.cc:290] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:40.613473  5532 log.cc:927] Time spent T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:14:40.550400  5550 raft_consensus.cc:3060] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:40.562892  5552 raft_consensus.cc:493] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:40.643787  4071 leader_election.cc:304] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:40.640060  4074 leader_election.cc:304] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:40.617506  5454 leader_election.cc:290] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:40.637475  5542 raft_consensus.cc:3060] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:40.606593  3951 raft_consensus.cc:2468] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:40.657317  4074 leader_election.cc:304] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
W20260709 13:14:40.616673  5455 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.980s	user 0.023s	sys 0.004s
I20260709 13:14:40.651196  3997 leader_election.cc:304] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
W20260709 13:14:40.656663  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 129204us
W20260709 13:14:40.662346  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 120450us
I20260709 13:14:40.648145  5472 raft_consensus.cc:2749] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:40.651479  5503 raft_consensus.cc:2804] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:40.652832  5552 raft_consensus.cc:3060] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:40.664258  3922 leader_election.cc:304] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:40.674239  4706 raft_consensus.cc:1275] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:40.677663  4030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511"
dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
mode: GRACEFUL
new_leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
 from {username='slave'} at 127.0.0.1:44232
I20260709 13:14:40.678339  4030 raft_consensus.cc:606] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Received request to transfer leadership to TS 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:40.678710  4030 raft_consensus.cc:614] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:40.669656  5521 consensus_queue.cc:237] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:40.683199  5546 leader_election.cc:290] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:40.664796  4074 leader_election.cc:304] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:40.656623  5558 raft_consensus.cc:2804] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:40.660154  5538 raft_consensus.cc:515] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:40.696099  5558 raft_consensus.cc:493] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:40.696573  5558 raft_consensus.cc:3060] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:40.697767  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:40.697912  5538 leader_election.cc:290] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:40.697964  5536 raft_consensus.cc:515] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:40.699769  5488 consensus_queue.cc:1048] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:40.700627  5536 leader_election.cc:290] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:40.700631  5486 consensus_queue.cc:1048] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:14:40.703167  4703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57692 (request call id 195) took 1690 ms. Trace:
W20260709 13:14:40.704072  3998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:40.703931  4703 rpcz_store.cc:276] 0709 13:14:39.013417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:39.014664 (+  1247us) service_pool.cc:224] Handling call
0709 13:14:39.039169 (+ 24505us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:40.119322 (+1080153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:40.702887 (+583565us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54006b1a54. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:14:40.703080 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2482372480}
I20260709 13:14:40.706983  4030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316"
dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
mode: GRACEFUL
new_leader_uuid: "d709ee666b774ec29aa732e508219938"
 from {username='slave'} at 127.0.0.1:44232
I20260709 13:14:40.707639  4030 raft_consensus.cc:606] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 LEADER]: Received request to transfer leadership to TS d709ee666b774ec29aa732e508219938
I20260709 13:14:40.652988  5516 consensus_queue.cc:1059] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:14:40.666975  3925 leader_election.cc:304] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:40.650314  5450 raft_consensus.cc:3060] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:40.668429  5340 raft_consensus.cc:3060] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:14:40.660588  5455 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.031s	user 0.023s	sys 0.005s
I20260709 13:14:40.655967  5404 raft_consensus.cc:2749] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:40.686018  5299 raft_consensus.cc:2804] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:40.686167  4099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45332 (request call id 1345) took 1421 ms. Trace:
I20260709 13:14:40.687402  5474 raft_consensus.cc:3055] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:40.665323  5453 raft_consensus.cc:515] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:40.659884  5475 raft_consensus.cc:2749] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:14:40.688308  5476 raft_consensus.cc:515] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:40.729449  3950 raft_consensus.cc:1240] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 3 LEADER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:40.595044  5528 rpcz_store.cc:276] 0709 13:14:37.239354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.256834 (+ 17480us) service_pool.cc:224] Handling call
0709 13:14:37.500698 (+243864us) log.cc:844] Serialized 501 byte log entry
0709 13:14:37.567803 (+ 67105us) spinlock_profiling.cc:243] Waited 6.36 ms on lock 0x7b18000acd80. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f15224fbc0a 00007f152bc3b219 00007f1522583a40 00007f152257e4e4 00007f152257e455 00007f15255c7b0b 00007f152564cb63 00007f1525674752 00007f152566c9fa
0709 13:14:37.648031 (+ 80228us) spinlock_profiling.cc:243] Waited 5.42 ms on lock 0x7b18000acd80. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f15225813f3 00007f15225837c1 00007f1522583779 00007f1522583709 00007f15225836d1 00007f15225829cd 000000000038f354 000000000038f199 00007f152256483a
0709 13:14:40.474246 (+2826215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60307,"raft.queue_time_us":68799,"raft.run_cpu_time_us":1439,"raft.run_wall_time_us":1438,"spinlock_wait_cycles":27077376,"thread_start_us":34374,"threads_started":1,"wal-append.queue_time_us":40868,"wal-append.run_cpu_time_us":1799,"wal-append.run_wall_time_us":1005495}
I20260709 13:14:40.692485  5485 raft_consensus.cc:3055] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:40.739984  5485 raft_consensus.cc:740] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:40.740198  5453 leader_election.cc:290] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:40.741848  5552 raft_consensus.cc:515] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:40.742607  3952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1420) took 1367 ms. Trace:
I20260709 13:14:40.743306  5493 consensus_queue.cc:1048] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:40.667243  5503 raft_consensus.cc:493] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:40.695161  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:40.724385  4099 rpcz_store.cc:276] 0709 13:14:39.250965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:39.251091 (+   126us) service_pool.cc:224] Handling call
0709 13:14:40.669255 (+1418164us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b540005b9d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:14:40.671791 (+  2536us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3025502208}
W20260709 13:14:40.726698  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 62505.2us
I20260709 13:14:40.748768  4101 raft_consensus.cc:2468] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 1.
I20260709 13:14:40.736234  3997 leader_election.cc:304] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:40.727401  5299 raft_consensus.cc:493] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:40.728992  5293 raft_consensus.cc:2749] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:14:40.746932  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 80033.4us
I20260709 13:14:40.728015  4071 leader_election.cc:400] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Vote denied by peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339) with higher term. Message: Invalid argument: T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 2. Current term is 3.
I20260709 13:14:40.749891  3922 leader_election.cc:304] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:40.713642  5472 consensus_queue.cc:1059] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:14:40.752887  4071 leader_election.cc:403] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:14:40.768857  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 51997.7us
I20260709 13:14:40.726379  5474 raft_consensus.cc:740] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:40.773777  3922 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
W20260709 13:14:40.761997  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 97258.8us
I20260709 13:14:40.767035  5454 consensus_queue.cc:1048] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:14:40.772040  3925 leader_election.cc:304] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:40.772209  5453 raft_consensus.cc:2804] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:40.772853  3844 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 97cf7690694c4d5988258ec1b641a2e6 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:40.724745  5499 consensus_queue.cc:1048] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:14:40.775588  4074 leader_election.cc:304] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
W20260709 13:14:40.776564  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 48748.1us
I20260709 13:14:40.781709  4707 raft_consensus.cc:1275] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:40.743052  3952 rpcz_store.cc:276] 0709 13:14:39.375454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:39.382282 (+  6828us) service_pool.cc:224] Handling call
0709 13:14:39.443046 (+ 60764us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:40.123814 (+680768us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:40.742352 (+618538us) spinlock_profiling.cc:243] Waited 679 ms on lock 0x7b54002873d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:14:40.742525 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1562493312}
I20260709 13:14:40.751827  5299 raft_consensus.cc:3060] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:40.777323  5557 consensus_queue.cc:1059] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:14:40.778036  5477 raft_consensus.cc:2804] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:40.778192  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:40.725572  5547 consensus_queue.cc:1048] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:14:40.774765  4672 leader_election.cc:304] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:40.748704  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:40.783630  4074 leader_election.cc:304] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:40.752192  5503 raft_consensus.cc:3060] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:40.808982  3997 leader_election.cc:304] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:40.811003  4071 leader_election.cc:304] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:14:40.850730  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 76060.4us
I20260709 13:14:40.731775  5517 consensus_queue.cc:1048] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:14:40.851285  4071 leader_election.cc:304] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:40.779417  5546 raft_consensus.cc:2804] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:14:40.818297  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 46326.7us
W20260709 13:14:40.817725  3844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 45045.6us
W20260709 13:14:40.867292  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 58407.1us
I20260709 13:14:40.810055  5527 raft_consensus.cc:3060] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:14:40.810290  5472 raft_consensus.cc:2749] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:40.873642  3997 leader_election.cc:304] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:40.809900  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:40.810258  5453 raft_consensus.cc:697] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 3 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:40.850446  5455 raft_consensus.cc:2804] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:40.830022  5477 raft_consensus.cc:493] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:40.781154  5498 consensus_queue.cc:1059] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.089s
I20260709 13:14:40.887890  5551 raft_consensus.cc:2749] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:40.887205  3997 leader_election.cc:304] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:14:40.868391  5546 raft_consensus.cc:493] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:40.891863  5455 raft_consensus.cc:697] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 3 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:40.867954  5538 raft_consensus.cc:2749] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:40.869032  5404 raft_consensus.cc:2804] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:40.871630  5301 raft_consensus.cc:2804] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:14:40.885548  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 102024us
I20260709 13:14:40.894666  5477 raft_consensus.cc:3060] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:40.829414  5516 consensus_queue.cc:1059] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:14:40.865998  5486 raft_consensus.cc:2804] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:14:40.905071  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 71853.3us
I20260709 13:14:40.908545  3997 leader_election.cc:304] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:40.888943  5557 raft_consensus.cc:2804] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:40.883728  5552 leader_election.cc:290] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:40.912998  3950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1426) took 1499 ms. Trace:
I20260709 13:14:40.938297  3950 rpcz_store.cc:276] 0709 13:14:39.413900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:39.414311 (+   411us) service_pool.cc:224] Handling call
0709 13:14:39.438691 (+ 24380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:40.732205 (+1293514us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:40.912745 (+180540us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b540042a254. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:14:40.912936 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2968041216}
I20260709 13:14:40.939437  5560 raft_consensus.cc:2749] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:40.939558  5568 consensus_queue.cc:1048] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.088s
I20260709 13:14:40.930203  3922 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
W20260709 13:14:40.930316  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:40.907724  5546 raft_consensus.cc:3060] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:40.943861  5521 raft_consensus.cc:2749] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:40.947809  5551 raft_consensus.cc:2749] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:40.948622  5474 consensus_queue.cc:260] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:40.909461  5301 raft_consensus.cc:697] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:40.904897  4102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34656 (request call id 90) took 1444 ms. Trace:
I20260709 13:14:40.956962  3997 leader_election.cc:304] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:40.962527  3922 leader_election.cc:304] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:40.964033  3922 leader_election.cc:304] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:40.965384  3922 leader_election.cc:304] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:14:40.916435  5486 raft_consensus.cc:493] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:40.916913  5562 consensus_queue.cc:1059] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.251s
I20260709 13:14:40.982965  4034 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330"
dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
mode: GRACEFUL
new_leader_uuid: "d709ee666b774ec29aa732e508219938"
 from {username='slave'} at 127.0.0.1:44232
I20260709 13:14:40.983822  4703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:40.993338  5517 raft_consensus.cc:3055] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:40.993894  5517 raft_consensus.cc:740] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:40.909409  5453 consensus_queue.cc:237] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:40.970417  5560 raft_consensus.cc:2749] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:40.998744  4034 raft_consensus.cc:606] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Received request to transfer leadership to TS d709ee666b774ec29aa732e508219938
W20260709 13:14:40.960247  4100 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45332 (request call id 1359) took 1615 ms (client timeout 1769 ms). Trace:
I20260709 13:14:40.951295  5542 raft_consensus.cc:515] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:40.998672  5476 leader_election.cc:290] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:40.969430  5538 consensus_queue.cc:1048] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:14:40.968842  5552 raft_consensus.cc:2749] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:40.998412  5486 raft_consensus.cc:3060] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:40.980777  5499 raft_consensus.cc:493] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:40.958405  5507 raft_consensus.cc:493] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:41.000967  5584 raft_consensus.cc:2749] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:14:41.007133  4100 rpcz_store.cc:269] 0709 13:14:39.342316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:39.348669 (+  6353us) service_pool.cc:224] Handling call
0709 13:14:40.941403 (+1592734us) spinlock_profiling.cc:243] Waited 873 ms on lock 0x7b54000406d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:14:40.957795 (+ 16392us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2008435584}
I20260709 13:14:41.012193  5455 consensus_queue.cc:237] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:41.023346  5560 raft_consensus.cc:2749] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:41.024135  5562 raft_consensus.cc:3055] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:41.024175  5474 raft_consensus.cc:3060] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:40.968045  4102 rpcz_store.cc:276] 0709 13:14:39.450547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:39.477925 (+ 27378us) service_pool.cc:224] Handling call
0709 13:14:39.527195 (+ 49270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:40.160371 (+633176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:40.880130 (+719759us) spinlock_profiling.cc:243] Waited 536 ms on lock 0x7b5400247cd4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:14:40.892511 (+ 12381us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1231650688}
I20260709 13:14:41.026275  3997 leader_election.cc:304] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:41.024691  5403 raft_consensus.cc:3055] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:41.024544  5562 raft_consensus.cc:740] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:41.075181  5562 consensus_queue.cc:260] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:41.075757  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 203767us
I20260709 13:14:41.012629  5475 raft_consensus.cc:3055] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:41.082530  4034 raft_consensus.cc:1275] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:14:41.079397  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 53243.5us
I20260709 13:14:41.086073  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:41.089505  4034 raft_consensus.cc:1275] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:41.092108  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:41.093094  4034 raft_consensus.cc:2393] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 4: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:14:41.095613  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:41.007159  5345 raft_consensus.cc:3055] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:41.008764  5542 leader_election.cc:290] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:41.007982  5528 raft_consensus.cc:3055] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:41.106571  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:41.115680  3997 leader_election.cc:304] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:14:41.110339  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:41.013513  5499 raft_consensus.cc:515] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:41.025628  5501 raft_consensus.cc:2764] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:14:41.112339  4032 raft_consensus.cc:1275] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:41.010334  5558 raft_consensus.cc:515] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:41.113638  5552 consensus_queue.cc:1059] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:41.114439  5546 raft_consensus.cc:515] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:41.112375  5562 raft_consensus.cc:3060] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:41.002619  5557 raft_consensus.cc:697] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:41.059070  5550 raft_consensus.cc:2764] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:14:41.121201  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:41.121308  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:41.126636  4025 raft_consensus.cc:2393] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 4: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
W20260709 13:14:41.127415  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 260911us
I20260709 13:14:41.099100  5475 raft_consensus.cc:740] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:41.071296  5403 raft_consensus.cc:740] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:41.062175  5340 raft_consensus.cc:2749] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:41.130785  3997 leader_election.cc:304] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:41.102596  5345 raft_consensus.cc:740] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:41.142021  5551 raft_consensus.cc:2749] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:41.014441  5507 raft_consensus.cc:515] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:41.142248  4029 raft_consensus.cc:1240] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:41.116318  5404 raft_consensus.cc:697] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:41.192312  5403 consensus_queue.cc:260] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:41.194226  5507 leader_election.cc:290] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:41.119163  5527 raft_consensus.cc:2749] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339) with higher term. Message: Invalid argument: T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 2. Current term is 3.
I20260709 13:14:41.194674  5558 leader_election.cc:290] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:41.194504  5591 consensus_queue.cc:1059] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:41.192521  5345 consensus_queue.cc:260] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:41.197434  5345 raft_consensus.cc:3060] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:41.199808  5527 consensus_queue.cc:1048] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:41.202508  5527 raft_consensus.cc:493] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:41.203101  5527 raft_consensus.cc:515] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:41.193794  5404 consensus_queue.cc:237] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:41.115489  5528 raft_consensus.cc:740] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:41.176784  3925 leader_election.cc:304] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
W20260709 13:14:41.190436  4073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:41.207106  3956 raft_consensus.cc:1240] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:41.210721  5521 raft_consensus.cc:493] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:14:41.211429  5552 raft_consensus.cc:2749] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:41.217665  5521 raft_consensus.cc:515] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:41.217752  5299 raft_consensus.cc:515] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:41.217268  5528 consensus_queue.cc:260] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:41.219844  5528 raft_consensus.cc:3060] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:41.220033  5521 leader_election.cc:290] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:14:41.211995  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 81289.3us
W20260709 13:14:41.224264  3998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:41.225404  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 81893.4us
I20260709 13:14:41.227749  3925 leader_election.cc:304] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:14:41.177829  5450 raft_consensus.cc:2749] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:41.013965  5301 consensus_queue.cc:237] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:41.134605  5293 consensus_queue.cc:1048] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.087s
I20260709 13:14:41.241951  3997 leader_election.cc:304] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:41.237195  5583 consensus_queue.cc:1048] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:14:41.237797  5454 raft_consensus.cc:2749] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:41.243680  5552 consensus_queue.cc:1048] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:41.142931  5501 consensus_queue.cc:1048] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.084s
I20260709 13:14:41.140724  5542 consensus_queue.cc:1048] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.080s
I20260709 13:14:41.246178  5557 consensus_queue.cc:237] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:41.284057  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:41.246603  5477 raft_consensus.cc:515] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:41.221657  5547 consensus_queue.cc:1059] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:14:41.249818  5299 leader_election.cc:290] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:14:41.270004  3997 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 2.453s (SENT) [suppressed 69 similar messages]
I20260709 13:14:41.274394  5486 raft_consensus.cc:515] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:41.262805  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:41.299945  5477 leader_election.cc:290] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:41.300247  3952 raft_consensus.cc:3060] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:41.251362  4701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:41.260366  5550 raft_consensus.cc:2749] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:41.263870  5560 raft_consensus.cc:2749] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:14:41.286566  5590 log.cc:927] Time spent T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:14:41.299609  5486 leader_election.cc:290] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:41.306671  3924 leader_election.cc:304] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:14:41.326802  5542 raft_consensus.cc:993] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2: : Instructing follower d709ee666b774ec29aa732e508219938 to start an election
I20260709 13:14:41.327301  5542 raft_consensus.cc:1081] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Signalling peer d709ee666b774ec29aa732e508219938 to start an election
I20260709 13:14:41.328389  5556 raft_consensus.cc:2749] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:41.332036  5486 raft_consensus.cc:493] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:41.332785  5536 raft_consensus.cc:993] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2: : Instructing follower d709ee666b774ec29aa732e508219938 to start an election
I20260709 13:14:41.332576  5486 raft_consensus.cc:515] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:41.333482  5521 raft_consensus.cc:1081] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 LEADER]: Signalling peer d709ee666b774ec29aa732e508219938 to start an election
I20260709 13:14:41.333107  5517 consensus_queue.cc:260] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:41.334587  5517 raft_consensus.cc:3060] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:41.334920  5486 leader_election.cc:290] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:41.313908  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:41.323340  4073 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:41.319914  5498 raft_consensus.cc:493] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:14:41.324961  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:41.325508  5472 consensus_queue.cc:1048] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:41.340719  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:41.342094  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:41.345089  4028 raft_consensus.cc:2393] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 2: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:14:41.346156  4709 raft_consensus.cc:1275] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:41.347599  4707 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330"
dest_uuid: "d709ee666b774ec29aa732e508219938"
 from {username='slave'} at 127.0.0.1:57692
I20260709 13:14:41.348244  4707 raft_consensus.cc:493] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:41.348587  4707 raft_consensus.cc:3060] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:41.320623  5503 raft_consensus.cc:515] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:41.356535  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:41.364567  5503 leader_election.cc:290] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:41.368685  5499 leader_election.cc:290] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:41.369400  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:41.370144  4102 raft_consensus.cc:3060] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:41.371323  5501 raft_consensus.cc:493] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:41.371919  5501 raft_consensus.cc:515] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:41.376593  3952 raft_consensus.cc:2468] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:41.377722  5501 leader_election.cc:290] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:14:41.380461  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:41.340385  5299 raft_consensus.cc:2749] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:41.397410  5345 consensus_queue.cc:1048] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:41.345293  5498 raft_consensus.cc:515] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:41.418367  4707 raft_consensus.cc:515] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:41.291754  5475 consensus_queue.cc:260] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:41.384058  4701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:41.435631  4103 raft_consensus.cc:1240] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 2. Current term is 3. Ops: []
W20260709 13:14:41.449035  5589 log.cc:927] Time spent T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 13:14:41.418848  4703 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316"
dest_uuid: "d709ee666b774ec29aa732e508219938"
 from {username='slave'} at 127.0.0.1:57692
I20260709 13:14:41.454231  5488 consensus_queue.cc:1059] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:41.456089  5558 raft_consensus.cc:3055] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:41.455207  5538 raft_consensus.cc:3055] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:41.478061  4703 raft_consensus.cc:493] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:41.492835  4703 raft_consensus.cc:3060] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:41.430099  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:14:41.497165  3922 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.009s	sys 0.061s
W20260709 13:14:41.497656  3922 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.009s	sys 0.061s
W20260709 13:14:41.498400  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 533075us
I20260709 13:14:41.499405  3922 leader_election.cc:304] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:41.503216  5546 leader_election.cc:290] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:41.503269  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:41.543286  3951 raft_consensus.cc:3060] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:14:41.537542  5453 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.010s	sys 0.008s
I20260709 13:14:41.503293  3953 raft_consensus.cc:1275] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:41.504159  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:41.512367  4708 raft_consensus.cc:1240] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:41.517094  5556 raft_consensus.cc:493] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:41.549989  5556 raft_consensus.cc:515] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:41.552860  5556 leader_election.cc:290] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:14:41.526228  4074 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.009s	sys 0.025s
W20260709 13:14:41.535779  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 265789us
W20260709 13:14:41.554183  4074 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.010s	sys 0.025s
W20260709 13:14:41.554885  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 643739us
I20260709 13:14:41.556274  3951 raft_consensus.cc:2468] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
W20260709 13:14:41.558889  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 59625.4us
I20260709 13:14:41.559084  5556 raft_consensus.cc:2749] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:41.559864  3922 leader_election.cc:304] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:41.560981  5293 raft_consensus.cc:2804] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:41.561378  5293 raft_consensus.cc:493] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:41.562407  4705 raft_consensus.cc:2468] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3.
I20260709 13:14:41.563691  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:14:41.546950  5453 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.011s	sys 0.009s
I20260709 13:14:41.566107  5498 leader_election.cc:290] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:41.561808  5293 raft_consensus.cc:3060] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:41.478302  5538 raft_consensus.cc:740] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:41.568531  5538 consensus_queue.cc:260] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:41.569568  5538 raft_consensus.cc:3060] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:14:41.575516  3922 connection.cc:256] RPC call timeout handler was delayed by -1.4156990079998195s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1769s for a response
I20260709 13:14:41.574246  3924 leader_election.cc:304] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:14:41.600167  3922 connection.cc:256] RPC call timeout handler was delayed by -1.4048990079998021s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1781s for a response
W20260709 13:14:41.600664  3922 connection.cc:256] RPC call timeout handler was delayed by -1.0988990079999894s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2121s for a response
I20260709 13:14:41.579595  5527 leader_election.cc:290] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:41.479131  5558 raft_consensus.cc:740] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
W20260709 13:14:41.591322  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:41.608299  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:41.622788  3925 leader_election.cc:304] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:14:41.604019  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:41.624531  4027 raft_consensus.cc:2468] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3.
I20260709 13:14:41.590627  4074 leader_election.cc:304] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:41.433624  5485 consensus_queue.cc:260] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:41.611004  3922 connection.cc:256] RPC call timeout handler was delayed by -1.0446489979999569s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18180000000000002s for a response
I20260709 13:14:41.630638  5485 raft_consensus.cc:3060] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:41.632969  5583 raft_consensus.cc:2749] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:41.648218  5592 consensus_queue.cc:1059] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:14:41.649134  5598 raft_consensus.cc:3055] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:41.649631  5598 raft_consensus.cc:740] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:41.650539  5598 consensus_queue.cc:260] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:41.652032  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:41.607327  5507 raft_consensus.cc:2804] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:41.655577  4071 leader_election.cc:304] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:14:41.660835  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:41.610355  5527 raft_consensus.cc:493] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:41.610739  5562 raft_consensus.cc:493] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:41.657220  4071 leader_election.cc:304] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:41.673770  4103 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "d709ee666b774ec29aa732e508219938"
 from {username='slave'} at 127.0.0.1:34352
W20260709 13:14:41.674446  5595 log.cc:927] Time spent T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.463s	user 0.003s	sys 0.000s
I20260709 13:14:41.674597  4103 raft_consensus.cc:606] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Received request to transfer leadership to TS d709ee666b774ec29aa732e508219938
I20260709 13:14:41.675101  4103 raft_consensus.cc:614] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:41.627921  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:41.683782  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:41.641482  5404 raft_consensus.cc:2749] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:14:41.684388  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:41.685587  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:41.684041  5475 raft_consensus.cc:3060] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:41.687435  5598 raft_consensus.cc:3060] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:41.707825  3953 raft_consensus.cc:1240] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:41.707630  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:41.707511  5558 consensus_queue.cc:260] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:41.708525  3951 raft_consensus.cc:2468] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 3.
I20260709 13:14:41.708997  5558 raft_consensus.cc:3060] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:41.709064  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:41.709463  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:41.695099  5489 raft_consensus.cc:3055] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:41.707844  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:41.667486  4074 leader_election.cc:400] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Vote denied by peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115) with higher term. Message: Invalid argument: T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 3. Current term is 4.
I20260709 13:14:41.604151  5597 consensus_queue.cc:1059] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.111s
I20260709 13:14:41.665997  5507 raft_consensus.cc:493] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:41.720559  3955 raft_consensus.cc:2393] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 3: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:41.710577  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:41.710521  4707 leader_election.cc:290] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:41.669575  5592 raft_consensus.cc:2804] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:41.685262  5301 raft_consensus.cc:2804] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:14:41.721101  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 53817.2us
W20260709 13:14:41.749583  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:41.710529  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:41.780942  3959 raft_consensus.cc:1240] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:41.783952  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:41.789695  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:41.686975  5517 consensus_queue.cc:1048] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.089s
I20260709 13:14:41.728912  5507 raft_consensus.cc:3060] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:41.769799  5404 raft_consensus.cc:493] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:41.814677  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:41.801162  3958 raft_consensus.cc:2393] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 4: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:14:41.785632  5592 raft_consensus.cc:697] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:41.686039  5527 raft_consensus.cc:515] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:41.718847  5489 raft_consensus.cc:740] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:14:41.775285  5550 raft_consensus.cc:493] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:41.809633  5609 log.cc:927] Time spent T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
W20260709 13:14:41.848812  3950 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.012s	sys 0.022s
W20260709 13:14:41.849148  3950 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.012s	sys 0.022s
W20260709 13:14:41.829854  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:41.832049  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:41.833489  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:41.780686  5591 raft_consensus.cc:493] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:41.839998  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:41.864912  4033 raft_consensus.cc:3060] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:41.865147  3955 raft_consensus.cc:2393] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 2: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
W20260709 13:14:41.840672  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:41.865183  4101 raft_consensus.cc:2468] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 3.
I20260709 13:14:41.699076  5562 raft_consensus.cc:515] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:41.868796  4101 raft_consensus.cc:1275] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:41.793043  5301 raft_consensus.cc:697] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:41.769701  5552 consensus_queue.cc:1059] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:14:41.811494  5403 raft_consensus.cc:3060] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:41.837555  3951 raft_consensus.cc:2393] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 3: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:41.893740  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
W20260709 13:14:41.848424  5455 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.010s	sys 0.028s
W20260709 13:14:41.924619  4034 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.028s	sys 0.072s
W20260709 13:14:41.925055  4034 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.028s	sys 0.072s
I20260709 13:14:41.835042  5345 raft_consensus.cc:493] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:41.915439  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:41.911646  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:41.835776  5551 raft_consensus.cc:493] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:41.950315  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:41.956661  3959 raft_consensus.cc:2393] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 3: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:14:41.867707  5472 raft_consensus.cc:493] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:41.834236  5404 raft_consensus.cc:515] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:42.064687  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:41.959667  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:41.887483  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:42.093112  3955 raft_consensus.cc:2393] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 4: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
W20260709 13:14:42.093252  4073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:41.786173  5581 consensus_queue.cc:1059] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.148s
I20260709 13:14:41.993966  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:42.018306  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:41.972038  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
W20260709 13:14:42.101794  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:41.868566  5550 raft_consensus.cc:515] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:42.114581  4107 raft_consensus.cc:2393] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 4: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
W20260709 13:14:42.109223  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:42.115048  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:42.111768  4033 raft_consensus.cc:2468] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
W20260709 13:14:41.923830  5455 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.010s	sys 0.028s
I20260709 13:14:42.125252  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:42.016180  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:42.125941  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:42.113481  3959 raft_consensus.cc:1240] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:14:42.222805  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:42.248809  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
W20260709 13:14:42.212694  4025 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.877s	user 0.040s	sys 0.102s
I20260709 13:14:41.878422  5591 raft_consensus.cc:515] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:42.277112  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:42.277704  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:42.278693  4025 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.943s	user 0.042s	sys 0.107s
I20260709 13:14:42.281556  4101 raft_consensus.cc:1275] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:42.284004  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:42.210490  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:42.088939  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:42.017004  5587 raft_consensus.cc:493] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:41.950734  3954 raft_consensus.cc:1240] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 3. Current term is 4. Ops: []
W20260709 13:14:42.273304  4027 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.000s	sys 0.009s
I20260709 13:14:42.275446  4100 raft_consensus.cc:1240] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:42.092310  5299 raft_consensus.cc:493] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.270001  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:42.105090  5486 raft_consensus.cc:493] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
W20260709 13:14:42.313812  4027 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.001s	sys 0.009s
I20260709 13:14:42.341704  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:42.342813  4033 raft_consensus.cc:2393] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 3: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
W20260709 13:14:42.293282  4102 consensus_meta.cc:287] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.923s	user 0.012s	sys 0.003s
W20260709 13:14:42.353034  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:42.353339  4028 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57"
dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
mode: GRACEFUL
new_leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
 from {username='slave'} at 127.0.0.1:44232
I20260709 13:14:42.354609  4028 raft_consensus.cc:606] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Received request to transfer leadership to TS 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:42.355039  4028 raft_consensus.cc:614] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:42.321709  3955 raft_consensus.cc:1240] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 2. Current term is 3. Ops: []
W20260709 13:14:42.325454  3952 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.824s	user 0.051s	sys 0.070s
I20260709 13:14:41.980551  5551 raft_consensus.cc:515] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:42.406955  5607 log.cc:927] Time spent T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:14:42.407734  5455 raft_consensus.cc:493] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.403168  3955 raft_consensus.cc:1240] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:14:42.418865  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:41.972957  5345 raft_consensus.cc:515] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:42.002796  4703 raft_consensus.cc:515] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:42.124120  5472 raft_consensus.cc:515] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:42.440366  4028 raft_consensus.cc:1275] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:42.448544  3955 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc"
dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
mode: GRACEFUL
new_leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:35222
I20260709 13:14:42.449393  3955 raft_consensus.cc:606] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Received request to transfer leadership to TS 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:42.449821  3955 raft_consensus.cc:614] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:42.032989  5489 consensus_queue.cc:260] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:14:42.458446  4709 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.011s	sys 0.046s
I20260709 13:14:42.458900  4033 raft_consensus.cc:1240] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 3. Current term is 4. Ops: []
W20260709 13:14:42.402486  3952 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.901s	user 0.051s	sys 0.071s
W20260709 13:14:42.464053  4709 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.012s	sys 0.046s
I20260709 13:14:42.361557  4102 raft_consensus.cc:2468] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 2.
I20260709 13:14:42.468607  4028 raft_consensus.cc:1240] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:42.479652  3955 raft_consensus.cc:1275] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:42.344568  5487 raft_consensus.cc:493] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:42.481909  4708 raft_consensus.cc:1240] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 1. Current term is 3. Ops: []
I20260709 13:14:42.489517  2843 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:14:42.332368  5299 raft_consensus.cc:515] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:42.292749  5301 consensus_queue.cc:237] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:42.249591  5592 consensus_queue.cc:237] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:42.513952  5528 consensus_meta.cc:287] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 1.294s	user 0.011s	sys 0.002s
I20260709 13:14:42.522775  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:42.491638  2843 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:42.323436  5587 raft_consensus.cc:515] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:42.345834  5486 raft_consensus.cc:515] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:42.471304  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:14:42.555459  4073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:42.558064  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:42.558952  5453 raft_consensus.cc:3055] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:42.559500  5453 raft_consensus.cc:740] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:42.559865  5562 leader_election.cc:290] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:42.560647  5453 consensus_queue.cc:260] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:42.562036  5453 raft_consensus.cc:3060] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:42.562359  5299 leader_election.cc:290] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:42.563367  4107 raft_consensus.cc:1240] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:14:42.497288  4102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34656 (request call id 109) took 1154 ms. Trace:
I20260709 13:14:42.445694  5455 raft_consensus.cc:515] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:42.496390  5581 raft_consensus.cc:493] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.544308  4105 raft_consensus.cc:1240] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 1. Current term is 2. Ops: []
W20260709 13:14:42.606038  4072 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.728s	user 0.016s	sys 0.038s
W20260709 13:14:42.589741  4030 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.984s	user 0.025s	sys 0.054s
W20260709 13:14:42.606413  4072 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.016s	sys 0.038s
W20260709 13:14:42.606571  4030 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.005s	user 0.026s	sys 0.054s
W20260709 13:14:42.601477  4029 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.878s	user 0.035s	sys 0.048s
W20260709 13:14:42.611359  4029 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.888s	user 0.035s	sys 0.048s
I20260709 13:14:42.550593  3953 raft_consensus.cc:3060] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:14:42.597718  4700 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.008s	user 0.025s	sys 0.056s
I20260709 13:14:42.594087  5560 raft_consensus.cc:493] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.624086  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:42.583770  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:42.499058  5487 raft_consensus.cc:515] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:42.625916  4107 raft_consensus.cc:1275] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:14:42.619750  4071 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.014s	sys 0.040s
W20260709 13:14:42.609444  5485 consensus_meta.cc:287] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 0.978s	user 0.008s	sys 0.004s
W20260709 13:14:42.648077  4034 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.006s	sys 0.040s
I20260709 13:14:42.605304  5527 leader_election.cc:290] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:14:42.633658  4032 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.046s	user 0.055s	sys 0.094s
W20260709 13:14:42.671962  4032 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.088s	user 0.057s	sys 0.095s
W20260709 13:14:42.624806  4700 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.035s	user 0.026s	sys 0.056s
W20260709 13:14:42.610236  4706 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.146s	user 0.047s	sys 0.109s
W20260709 13:14:42.652552  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:42.668526  4071 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.014s	sys 0.040s
W20260709 13:14:42.673986  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:42.668927  4034 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.007s	sys 0.041s
I20260709 13:14:42.680574  3955 raft_consensus.cc:1275] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:14:42.672744  5493 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.976s	user 0.024s	sys 0.043s
I20260709 13:14:42.626331  5299 raft_consensus.cc:493] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.594589  4102 rpcz_store.cc:276] 0709 13:14:41.337688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:41.345714 (+  8026us) service_pool.cc:224] Handling call
0709 13:14:42.492004 (+1146290us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:42.648553  5536 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.093s	user 0.070s	sys 0.078s
I20260709 13:14:42.690768  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:42.691033  4034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41312 (request call id 85) took 1369 ms. Trace:
I20260709 13:14:42.687021  4032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38304 (request call id 1556) took 1414 ms. Trace:
W20260709 13:14:42.686925  5493 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.990s	user 0.024s	sys 0.043s
W20260709 13:14:42.682001  4706 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.218s	user 0.047s	sys 0.114s
I20260709 13:14:42.692097  3954 raft_consensus.cc:2393] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 3: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:14:42.728873  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:42.710875  5591 leader_election.cc:290] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:42.731271  5516 raft_consensus.cc:3055] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:42.731933  5516 raft_consensus.cc:740] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:42.734978  4031 raft_consensus.cc:3055] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:42.735492  4031 raft_consensus.cc:740] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:42.736533  4031 consensus_queue.cc:260] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:42.738500  4025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41312 (request call id 86) took 1429 ms. Trace:
I20260709 13:14:42.738832  4030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41312 (request call id 87) took 1429 ms. Trace:
I20260709 13:14:42.739290  4030 rpcz_store.cc:276] 0709 13:14:41.309719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:41.311477 (+  1758us) service_pool.cc:224] Handling call
0709 13:14:41.339494 (+ 28017us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:41.399840 (+ 60346us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:14:41.601547 (+201707us) log.cc:844] Serialized 14 byte log entry
0709 13:14:42.607046 (+1005499us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:42.607111 (+    65us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:42.607173 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:42.738578 (+131405us) spinlock_profiling.cc:243] Waited 60.1 ms on lock 0x7b540026d4d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:14:42.738641 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:42.738771 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":182895,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":103,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":8202,"spinlock_wait_cycles":138217856,"thread_start_us":1174644,"threads_started":2}
W20260709 13:14:42.701301  5604 log.cc:927] Time spent T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 13:14:42.742661  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:42.626591  5562 raft_consensus.cc:493] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:42.744657  5562 raft_consensus.cc:515] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:42.746403  5455 leader_election.cc:290] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:42.683954  5498 raft_consensus.cc:493] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.747406  5498 raft_consensus.cc:515] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:42.748026  3950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1455) took 1542 ms. Trace:
I20260709 13:14:42.748585  3950 rpcz_store.cc:276] 0709 13:14:41.205913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:41.206036 (+   123us) service_pool.cc:224] Handling call
0709 13:14:41.227926 (+ 21890us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:41.257247 (+ 29321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:41.257280 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:41.278058 (+ 20778us) log.cc:844] Serialized 26 byte log entry
0709 13:14:41.849489 (+571431us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:14:41.849536 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:41.849622 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:42.747656 (+898034us) raft_consensus.cc:1685] finished
0709 13:14:42.747692 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:42.747915 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11484,"raft.queue_time_us":30083,"raft.run_cpu_time_us":361,"raft.run_wall_time_us":28526,"thread_start_us":571002,"threads_started":1,"wal-append.queue_time_us":1189326}
I20260709 13:14:42.750757  3952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1459) took 1252 ms. Trace:
I20260709 13:14:42.751384  3952 rpcz_store.cc:276] 0709 13:14:41.498807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:41.499227 (+   420us) service_pool.cc:224] Handling call
0709 13:14:41.499778 (+   551us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:41.500286 (+   508us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:41.500338 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:41.501012 (+   674us) log.cc:844] Serialized 26 byte log entry
0709 13:14:42.493963 (+992951us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:42.498604 (+  4641us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:42.546533 (+ 47929us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:42.750470 (+203937us) raft_consensus.cc:1685] finished
0709 13:14:42.750505 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:42.750679 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2680,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":106,"thread_start_us":969177,"threads_started":1,"wal-append.queue_time_us":1129456}
I20260709 13:14:42.630554  5517 raft_consensus.cc:493] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.753883  5517 raft_consensus.cc:515] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:42.756392  5517 leader_election.cc:290] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:42.756842  4709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57666 (request call id 319) took 1399 ms. Trace:
I20260709 13:14:42.757217  4709 rpcz_store.cc:276] 0709 13:14:41.357706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:41.357879 (+   173us) service_pool.cc:224] Handling call
0709 13:14:41.695886 (+338007us) spinlock_profiling.cc:243] Waited 23.1 ms on lock 0x7b5800003f98. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f1522549b71 00007f1522549a22 00007f152b462c09 00007f152a5bcee0 00007f152a6860ab 00007f152a686131 00007f152a647fc0 00007f152a632929 00007f152a6323d2 00007f1523ba9bd4
0709 13:14:41.696134 (+   248us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:41.696566 (+   432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:41.696591 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:41.697081 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 13:14:42.464602 (+767521us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:42.464658 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:42.464752 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:42.756538 (+291786us) raft_consensus.cc:1685] finished
0709 13:14:42.756563 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:42.756783 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9420,"raft.queue_time_us":650,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":2602,"spinlock_wait_cycles":53218688,"thread_start_us":681132,"threads_started":1,"wal-append.queue_time_us":975992}
W20260709 13:14:42.759066  5558 consensus_meta.cc:287] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 1.049s	user 0.012s	sys 0.000s
I20260709 13:14:42.687820  5527 raft_consensus.cc:493] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.733270  5516 consensus_queue.cc:260] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:42.760082  5527 raft_consensus.cc:515] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:42.760946  5516 raft_consensus.cc:3060] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:42.762603  5527 leader_election.cc:290] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:42.707870  4034 rpcz_store.cc:276] 0709 13:14:41.309077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:41.311213 (+  2136us) service_pool.cc:224] Handling call
0709 13:14:41.337326 (+ 26113us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:41.337578 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:14:41.925451 (+587873us) log.cc:844] Serialized 14 byte log entry
0709 13:14:42.677649 (+752198us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:42.677727 (+    78us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:42.677791 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:42.677889 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:42.678043 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44890,"prepare.queue_time_us":244890,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":782,"spinlock_wait_cycles":13754752,"thread_start_us":1294051,"threads_started":2}
I20260709 13:14:42.708009  4032 rpcz_store.cc:276] 0709 13:14:41.258333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:41.258863 (+   530us) service_pool.cc:224] Handling call
0709 13:14:41.259214 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:41.259417 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:14:41.584156 (+324739us) log.cc:844] Serialized 14 byte log entry
0709 13:14:42.672495 (+1088339us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:42.672561 (+    66us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:14:42.672604 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:42.672681 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:42.672818 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":322468,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":31,"raft.queue_time_us":515,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":4884,"thread_start_us":1390759,"threads_started":2}
I20260709 13:14:42.712060  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:42.766881  3959 raft_consensus.cc:2468] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 3.
W20260709 13:14:42.725728  3922 connection.cc:256] RPC call timeout handler was delayed by -1.0902899260001959s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16490000000000002s for a response
I20260709 13:14:42.760366  5499 raft_consensus.cc:493] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:42.737782  4031 raft_consensus.cc:3060] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:42.669943  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:42.610903  5581 raft_consensus.cc:515] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:42.739023  4025 rpcz_store.cc:276] 0709 13:14:41.309412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:41.309538 (+   126us) service_pool.cc:224] Handling call
0709 13:14:41.324849 (+ 15311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:41.334717 (+  9868us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:41.334751 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:41.335300 (+   549us) log.cc:844] Serialized 26 byte log entry
0709 13:14:42.279198 (+943898us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:42.347738 (+ 68540us) log.cc:844] Serialized 14 byte log entry
0709 13:14:42.348016 (+   278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:42.348112 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:42.528697 (+180585us) spinlock_profiling.cc:243] Waited 30.7 ms on lock 0x7b180035c920. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f15225813f3 00007f15225837c1 00007f1522583779 00007f1522583709 00007f15225836d1 00007f15225829cd 000000000038f354 000000000038f199 00007f152256483a
0709 13:14:42.738072 (+209375us) raft_consensus.cc:1685] finished
0709 13:14:42.738231 (+   159us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:42.738424 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9477,"prepare.queue_time_us":118994,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":59,"raft.queue_time_us":11121,"raft.run_cpu_time_us":405,"raft.run_wall_time_us":51588,"spinlock_wait_cycles":70603136,"thread_start_us":943422,"threads_started":1,"wal-append.queue_time_us":1291204}
I20260709 13:14:42.660296  5404 leader_election.cc:290] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:14:42.772500  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:42.787559  4708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57692 (request call id 212) took 1134 ms. Trace:
W20260709 13:14:42.704336  5536 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.164s	user 0.071s	sys 0.078s
I20260709 13:14:42.707140  4099 raft_consensus.cc:2468] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
I20260709 13:14:42.802347  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:42.690706  3951 raft_consensus.cc:1275] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:42.803748  4099 raft_consensus.cc:3060] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:14:42.774118  3922 connection.cc:256] RPC call timeout handler was delayed by -1.0164899260000766s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17310000000000003s for a response
I20260709 13:14:42.799041  4025 raft_consensus.cc:1240] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:42.780455  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:42.806859  3958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38612 (request call id 872) took 1099 ms. Trace:
I20260709 13:14:42.788136  4708 rpcz_store.cc:276] 0709 13:14:41.652909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:41.694326 (+ 41417us) service_pool.cc:224] Handling call
0709 13:14:41.694618 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:42.487302 (+792684us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:42.787218 (+299916us) spinlock_profiling.cc:243] Waited 787 ms on lock 0x7b5400630e54. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:14:42.787466 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1810152832}
W20260709 13:14:42.773072  5293 consensus_meta.cc:287] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 1.206s	user 0.013s	sys 0.009s
I20260709 13:14:42.807304  3958 rpcz_store.cc:276] 0709 13:14:41.767828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:41.817431 (+ 49603us) service_pool.cc:224] Handling call
0709 13:14:42.780242 (+962811us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b5800002d98. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f1522549b71 00007f1522549a22 00007f152b462c09 00007f152a5bcee0 00007f152a6860ab 00007f152a686131 00007f152a6340a0 00007f152a633984 00007f1523bae6d4 00007f1523bae662
0709 13:14:42.806776 (+ 26534us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52086528}
W20260709 13:14:42.777274  5538 consensus_meta.cc:287] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 1.207s	user 0.002s	sys 0.020s
I20260709 13:14:42.830027  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:42.830714  3959 raft_consensus.cc:2468] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:42.822985  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:42.832969  4031 raft_consensus.cc:2468] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 3.
W20260709 13:14:42.828578  5617 log.cc:927] Time spent T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 13:14:42.812692  4100 raft_consensus.cc:2468] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 3.
I20260709 13:14:42.714376  5299 raft_consensus.cc:515] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:42.844089  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:42.844866  3958 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 4.
I20260709 13:14:42.845037  4031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41312 (request call id 91) took 1120 ms. Trace:
I20260709 13:14:42.795867  5558 raft_consensus.cc:493] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:14:42.848699  3958 raft_consensus.cc:1275] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:42.831382  4034 raft_consensus.cc:2468] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3.
I20260709 13:14:42.836674  5562 leader_election.cc:290] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:42.785916  5455 raft_consensus.cc:493] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.833117  5550 leader_election.cc:290] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:42.648195  5560 raft_consensus.cc:515] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:42.798722  5485 raft_consensus.cc:493] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.785863  5499 raft_consensus.cc:515] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:42.839955  4104 raft_consensus.cc:2468] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 4.
I20260709 13:14:42.854115  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:42.896044  3959 raft_consensus.cc:2393] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 3: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:14:42.842941  4703 leader_election.cc:290] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:42.860028  5299 leader_election.cc:290] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:42.860772  4706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57666 (request call id 320) took 1460 ms. Trace:
I20260709 13:14:42.861722  5528 raft_consensus.cc:493] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:42.862433  5455 raft_consensus.cc:515] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:42.837386  5293 raft_consensus.cc:515] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:42.864624  5340 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:14:42.864972  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:42.866583  3953 raft_consensus.cc:2468] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 4.
W20260709 13:14:42.867357  3924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:42.884828  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:42.901382  4099 raft_consensus.cc:2468] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 3.
I20260709 13:14:42.898365  5474 raft_consensus.cc:493] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.845417  4031 rpcz_store.cc:276] 0709 13:14:41.713285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:42.114406 (+401121us) service_pool.cc:224] Handling call
0709 13:14:42.734795 (+620389us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b540022de20. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15255e5dc0 00007f1525671e18 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6
0709 13:14:42.833549 (+ 98754us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25567616}
I20260709 13:14:42.912699  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
W20260709 13:14:42.896539  4675 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.045s	sys 0.046s
I20260709 13:14:42.846446  5552 raft_consensus.cc:493] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.849951  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:42.849191  5538 raft_consensus.cc:493] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:14:42.856801  5551 leader_election.cc:290] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:42.908999  4027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38304 (request call id 1562) took 1316 ms. Trace:
I20260709 13:14:42.939054  4027 rpcz_store.cc:276] 0709 13:14:41.592617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:41.631977 (+ 39360us) service_pool.cc:224] Handling call
0709 13:14:41.632357 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:41.632724 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:41.632758 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:41.633211 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 13:14:42.330504 (+697293us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:42.330562 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:42.330667 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:42.908774 (+578107us) raft_consensus.cc:1685] finished
0709 13:14:42.908797 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:42.908938 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18923,"raft.queue_time_us":6377,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":4904,"thread_start_us":696865,"threads_started":1,"wal-append.queue_time_us":1198388}
W20260709 13:14:42.902103  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 474345us
W20260709 13:14:42.914007  4675 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.045s	sys 0.047s
I20260709 13:14:42.916733  3958 raft_consensus.cc:1240] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:14:42.856029  5558 raft_consensus.cc:515] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:42.931689  3953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38612 (request call id 868) took 1229 ms. Trace:
I20260709 13:14:42.932278  5474 raft_consensus.cc:515] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:42.917492  4100 raft_consensus.cc:3060] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:42.937952  3956 raft_consensus.cc:1240] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:14:42.926581  5596 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.020s	user 0.047s	sys 0.053s
I20260709 13:14:42.912304  4703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:57692 (request call id 209) took 1558 ms. Trace:
I20260709 13:14:42.949882  4672 leader_election.cc:304] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:42.898155  5485 raft_consensus.cc:515] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:42.970978  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:42.916175  5528 raft_consensus.cc:515] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:42.984182  3997 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.865s	user 0.027s	sys 0.030s
I20260709 13:14:42.985535  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:14:42.995012  3997 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.876s	user 0.028s	sys 0.030s
W20260709 13:14:42.995385  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 876270us
I20260709 13:14:42.995860  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:42.995193  3955 raft_consensus.cc:3060] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:42.952549  5488 raft_consensus.cc:493] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:43.040512  5488 raft_consensus.cc:515] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:43.042948  5488 leader_election.cc:290] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:43.044495  5632 log.cc:927] Time spent T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:14:42.970994  3953 rpcz_store.cc:276] 0709 13:14:41.702427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:42.522338 (+819911us) service_pool.cc:224] Handling call
0709 13:14:42.917896 (+395558us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:43.046097  4029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38304 (request call id 1559) took 1458 ms. Trace:
I20260709 13:14:43.046563  4029 rpcz_store.cc:276] 0709 13:14:41.591624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:41.591769 (+   145us) service_pool.cc:224] Handling call
0709 13:14:41.603985 (+ 12216us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:41.610504 (+  6519us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:41.610539 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:41.629741 (+ 19202us) log.cc:844] Serialized 26 byte log entry
0709 13:14:41.722910 (+ 93169us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b18003e40a0. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f1522563e07 00007f152b3beab9 00007f152258069b 00007f152257e93f 00007f1522580c02 00007f152520820b 00007f152520dd23 00007f152520e0d1 00007f1525629a0f
0709 13:14:42.611891 (+888981us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:14:42.611959 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:42.612065 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:43.045716 (+433651us) raft_consensus.cc:1685] finished
0709 13:14:43.045747 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:43.046019 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13440,"raft.queue_time_us":2547,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":16211,"spinlock_wait_cycles":23083264,"thread_start_us":888731,"threads_started":1,"wal-append.queue_time_us":1279538}
I20260709 13:14:43.049703  5485 leader_election.cc:290] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:43.051565  5558 leader_election.cc:290] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:43.054137  5581 leader_election.cc:290] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:42.972889  5498 leader_election.cc:290] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:42.938611  5538 raft_consensus.cc:515] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:42.995980  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:42.926607  5552 raft_consensus.cc:515] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:43.039927  5624 log.cc:927] Time spent T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
W20260709 13:14:42.980684  5596 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.074s	user 0.047s	sys 0.054s
I20260709 13:14:42.981887  5486 leader_election.cc:290] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:42.979036  5299 raft_consensus.cc:493] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
W20260709 13:14:43.071014  3997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:43.075846  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:43.083429  3956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38612 (request call id 856) took 1384 ms. Trace:
I20260709 13:14:43.077013  4074 leader_election.cc:304] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:42.984699  3951 raft_consensus.cc:1275] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:42.987879  5587 leader_election.cc:290] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:43.083853  3956 rpcz_store.cc:276] 0709 13:14:41.698823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:41.698938 (+   115us) service_pool.cc:224] Handling call
0709 13:14:41.699260 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:42.977578 (+1278318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:43.083124 (+105546us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b5400385754. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:14:43.083363 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2848148224}
I20260709 13:14:43.086155  5498 raft_consensus.cc:493] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:43.090582  5299 raft_consensus.cc:515] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:43.090863  5498 raft_consensus.cc:515] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:43.092010  4099 raft_consensus.cc:2468] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3.
I20260709 13:14:43.092765  5299 leader_election.cc:290] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:43.093283  5498 leader_election.cc:290] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:43.093216  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:43.086818  5551 consensus_queue.cc:1048] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:43.070252  5485 raft_consensus.cc:493] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.094441  5485 raft_consensus.cc:515] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:43.078506  5340 raft_consensus.cc:493] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.089504  3997 leader_election.cc:304] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:14:43.095811  5340 raft_consensus.cc:515] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:43.096055  5551 raft_consensus.cc:2749] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:43.096155  4100 raft_consensus.cc:2468] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3.
I20260709 13:14:43.096089  5499 leader_election.cc:290] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:43.097278  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:43.098076  5499 consensus_queue.cc:1048] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:43.098094  5340 leader_election.cc:290] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:43.100083  5485 leader_election.cc:290] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:43.100550  5455 leader_election.cc:290] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:43.100746  4099 raft_consensus.cc:2393] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 2: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:43.100524  3997 leader_election.cc:304] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:43.101372  5293 leader_election.cc:290] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:43.101760  5485 raft_consensus.cc:2804] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:43.101893  3997 leader_election.cc:304] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:43.102434  5485 raft_consensus.cc:697] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:43.103714  5485 consensus_queue.cc:237] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:43.106040  5340 raft_consensus.cc:2804] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:43.106488  5340 raft_consensus.cc:493] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:43.107010  5340 raft_consensus.cc:3060] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:43.109440  5551 consensus_queue.cc:1048] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:43.111519  3997 leader_election.cc:304] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:43.113005  5474 leader_election.cc:290] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:43.113837  5487 leader_election.cc:290] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:43.114336  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:43.114970  5551 raft_consensus.cc:2804] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:43.115723  5560 leader_election.cc:290] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:43.117707  5489 raft_consensus.cc:3060] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:43.118597  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:43.115985  3997 leader_election.cc:304] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:43.119943  4099 raft_consensus.cc:2393] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 4: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:14:43.120134  5548 raft_consensus.cc:2764] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:14:43.124290  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:43.125237  4099 raft_consensus.cc:2468] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 2.
I20260709 13:14:43.127679  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:43.130985  4099 raft_consensus.cc:2393] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 4: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
I20260709 13:14:43.134935  3997 leader_election.cc:304] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
W20260709 13:14:43.137049  4026 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.484s	user 0.083s	sys 0.182s
I20260709 13:14:43.136935  3997 leader_election.cc:304] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
W20260709 13:14:43.137595  4026 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.484s	user 0.083s	sys 0.182s
I20260709 13:14:43.146162  4104 raft_consensus.cc:2468] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 2.
I20260709 13:14:43.120807  5498 raft_consensus.cc:2749] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:43.148553  3997 leader_election.cc:304] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:43.150468  3997 leader_election.cc:304] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
W20260709 13:14:43.155498  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:42.982898  4703 rpcz_store.cc:276] 0709 13:14:41.343437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:41.345480 (+  2043us) service_pool.cc:224] Handling call
0709 13:14:42.901542 (+1556062us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:43.169874  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:43.081202  5558 raft_consensus.cc:493] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.084828  5581 raft_consensus.cc:493] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:43.173791  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 96869.2us
I20260709 13:14:43.172660  4107 raft_consensus.cc:2468] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 3.
I20260709 13:14:43.176282  4074 leader_election.cc:304] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
W20260709 13:14:43.135708  5453 consensus_meta.cc:287] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.573s	user 0.015s	sys 0.000s
I20260709 13:14:42.990710  5550 consensus_queue.cc:1059] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.133s
I20260709 13:14:43.117700  5551 raft_consensus.cc:697] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:43.178365  4708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:14:43.202072  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:43.200557  4708 raft_consensus.cc:2468] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 1.
W20260709 13:14:43.189759  5475 consensus_meta.cc:287] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 1.468s	user 0.012s	sys 0.003s
I20260709 13:14:43.168526  5546 raft_consensus.cc:2749] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:43.168157  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:43.219578  3955 raft_consensus.cc:2468] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 3.
I20260709 13:14:43.227279  4107 raft_consensus.cc:1240] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:43.224176  5503 raft_consensus.cc:2749] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:43.221306  5587 consensus_queue.cc:1059] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:14:43.230626  5587 raft_consensus.cc:3055] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:43.231040  5560 raft_consensus.cc:493] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:43.231721  4103 raft_consensus.cc:2410] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:14:43.232668  4100 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 4.
I20260709 13:14:43.233669  4103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45336 (request call id 908) took 1322 ms. Trace:
I20260709 13:14:43.233898  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:43.234612  4100 raft_consensus.cc:3060] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:43.234210  4103 rpcz_store.cc:276] 0709 13:14:41.911047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:41.911277 (+   230us) service_pool.cc:224] Handling call
0709 13:14:43.233422 (+1322145us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b540042efd4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:14:43.233599 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2953860864}
I20260709 13:14:43.247859  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:43.206156  5453 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.207749  5496 raft_consensus.cc:493] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.200558  5474 raft_consensus.cc:2749] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:14:43.237080  5507 consensus_meta.cc:287] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 1.396s	user 0.011s	sys 0.003s
I20260709 13:14:43.237838  5551 consensus_queue.cc:237] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:43.243098  4102 raft_consensus.cc:2468] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3.
I20260709 13:14:43.231065  5587 raft_consensus.cc:740] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:43.201020  5498 consensus_queue.cc:1059] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:14:43.295442  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:43.252521  5550 raft_consensus.cc:2749] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:14:43.266989  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:43.320848  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:43.197717  5558 raft_consensus.cc:515] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:43.290812  4107 raft_consensus.cc:1275] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:43.198112  5581 raft_consensus.cc:515] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:43.249665  5598 consensus_meta.cc:287] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 1.527s	user 0.006s	sys 0.008s
I20260709 13:14:43.285652  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:42.899984  4706 rpcz_store.cc:276] 0709 13:14:41.400539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:41.418205 (+ 17666us) service_pool.cc:224] Handling call
0709 13:14:41.462621 (+ 44416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:41.463048 (+   427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:41.463080 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:41.463650 (+   570us) log.cc:844] Serialized 26 byte log entry
0709 13:14:42.727326 (+1263676us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:42.727380 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:42.727482 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:42.860489 (+133007us) raft_consensus.cc:1685] finished
0709 13:14:42.860517 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:42.860693 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":740,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":115,"thread_start_us":1263155,"threads_started":1,"wal-append.queue_time_us":1394785}
I20260709 13:14:43.252787  4105 raft_consensus.cc:2393] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 4: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:43.250871  5546 raft_consensus.cc:2749] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:43.333666  4103 raft_consensus.cc:2468] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 3.
W20260709 13:14:43.251840  5403 consensus_meta.cc:287] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 1.337s	user 0.014s	sys 0.000s
I20260709 13:14:43.296528  5592 raft_consensus.cc:493] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:14:43.247877  5499 consensus_queue.cc:1059] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
I20260709 13:14:43.343559  4102 raft_consensus.cc:2468] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 3.
I20260709 13:14:43.284716  5453 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:14:43.340461  4071 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.014s	sys 0.015s
W20260709 13:14:43.356391  4071 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.014s	sys 0.015s
I20260709 13:14:43.339257  5498 raft_consensus.cc:2749] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:14:43.294374  5496 raft_consensus.cc:515] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:43.335179  5340 raft_consensus.cc:515] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:43.292487  5507 raft_consensus.cc:515] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:43.345892  5630 raft_consensus.cc:493] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.339936  5474 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
W20260709 13:14:43.361686  3922 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.013s	sys 0.006s
I20260709 13:14:43.249416  5560 raft_consensus.cc:515] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:43.400537  5507 leader_election.cc:290] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:14:43.365942  5301 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.004s	sys 0.014s
I20260709 13:14:43.401751  4102 raft_consensus.cc:1275] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:14:43.402163  5301 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.004s	sys 0.020s
W20260709 13:14:43.366221  3922 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.013s	sys 0.006s
W20260709 13:14:43.402917  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 598312us
W20260709 13:14:43.403884  3922 leader_election.cc:336] T 86669993fba94e65ba192aa115ed6e88 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.769s (SENT)
W20260709 13:14:43.404815  3922 leader_election.cc:336] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.781s (SENT)
W20260709 13:14:43.406041  5622 log.cc:927] Time spent T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.422s	user 0.001s	sys 0.001s
W20260709 13:14:43.406159  3922 leader_election.cc:336] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 2.186s (SENT)
I20260709 13:14:43.406646  3922 leader_election.cc:304] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
W20260709 13:14:43.362879  3998 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.005s	sys 0.013s
I20260709 13:14:43.409401  4107 raft_consensus.cc:1240] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:43.409767  3957 raft_consensus.cc:1240] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 2. Current term is 4. Ops: []
I20260709 13:14:43.412067  3957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38612 (request call id 859) took 1712 ms. Trace:
I20260709 13:14:43.412411  3957 rpcz_store.cc:276] 0709 13:14:41.699793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:41.703400 (+  3607us) service_pool.cc:224] Handling call
0709 13:14:41.703763 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:43.410104 (+1706341us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:43.411865 (+  1761us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b5400384d54. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:14:43.412015 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3923054848}
I20260709 13:14:43.358263  5528 leader_election.cc:290] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:43.362042  5493 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.010s	sys 0.031s
I20260709 13:14:43.358165  5503 raft_consensus.cc:493] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:14:43.358435  5546 raft_consensus.cc:3055] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:43.417371  5538 leader_election.cc:290] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:43.361074  5403 raft_consensus.cc:493] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.433039  4108 raft_consensus.cc:2468] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 3.
I20260709 13:14:43.362120  5594 raft_consensus.cc:493] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:43.424556  5493 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.011s	sys 0.032s
I20260709 13:14:43.424714  5635 raft_consensus.cc:493] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:43.427701  5301 raft_consensus.cc:493] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:43.435842  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 463876us
I20260709 13:14:43.351191  5592 raft_consensus.cc:515] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:14:43.453694  4000 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.008s	sys 0.017s
W20260709 13:14:43.456245  4000 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.008s	sys 0.017s
W20260709 13:14:43.436558  3998 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.011s	sys 0.013s
W20260709 13:14:43.362557  3925 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.003s	sys 0.025s
W20260709 13:14:43.456904  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:43.414458  5474 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:43.359508  5587 consensus_queue.cc:260] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:43.459872  3925 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.005s	sys 0.030s
I20260709 13:14:43.462860  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:43.464319  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:43.439960  5472 leader_election.cc:290] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:43.464507  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
W20260709 13:14:43.454360  5536 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.006s	sys 0.011s
I20260709 13:14:43.465521  4027 raft_consensus.cc:1275] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:14:43.440127  5403 raft_consensus.cc:515] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:43.434115  5546 raft_consensus.cc:740] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:43.476704  4033 raft_consensus.cc:1240] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:43.508958  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:14:43.488263  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 701579us
I20260709 13:14:43.488534  4031 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 4.
I20260709 13:14:43.489920  4029 raft_consensus.cc:3055] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:14:43.487620  4700 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.029s	sys 0.034s
W20260709 13:14:43.513494  4700 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.029s	sys 0.035s
I20260709 13:14:43.514479  4700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57680 (request call id 417) took 2046 ms. Trace:
I20260709 13:14:43.514622  5546 consensus_queue.cc:260] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:43.515132  5552 leader_election.cc:290] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:43.437865  5503 raft_consensus.cc:515] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:14:43.519191  4672 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.003s	sys 0.020s
I20260709 13:14:43.519560  4099 raft_consensus.cc:1240] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:43.519994  4028 raft_consensus.cc:1275] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:43.520219  4099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45336 (request call id 926) took 1070 ms. Trace:
I20260709 13:14:43.509661  4025 raft_consensus.cc:2468] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:43.415033  5630 raft_consensus.cc:515] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:43.467574  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:43.511147  4029 raft_consensus.cc:740] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:43.492097  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:14:43.519590  4672 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.004s	sys 0.020s
W20260709 13:14:43.509743  5536 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.007s	sys 0.015s
I20260709 13:14:43.440323  5594 raft_consensus.cc:515] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:43.518455  5625 log.cc:927] Time spent T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 13:14:43.517104  5640 log.cc:927] Time spent T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:14:43.461792  5538 raft_consensus.cc:493] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:43.466200  5582 consensus_queue.cc:1048] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.117s
I20260709 13:14:43.520817  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:43.653124  4706 raft_consensus.cc:2468] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:14:43.518766  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:43.515595  5487 raft_consensus.cc:493] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.658001  4030 raft_consensus.cc:2468] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
W20260709 13:14:43.551484  4675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:43.520541  4099 rpcz_store.cc:276] 0709 13:14:42.449509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:43.147650 (+698141us) service_pool.cc:224] Handling call
0709 13:14:43.519174 (+371524us) spinlock_profiling.cc:243] Waited 28.1 ms on lock 0x7b5800011798. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f1522549b71 00007f1522549a22 00007f152b462c09 00007f152a5bcee0 00007f152a6860ab 00007f152a686131 00007f152a647fc0 00007f152a632929 00007f152a6323d2 00007f1523ba9bd4
0709 13:14:43.519362 (+   188us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:43.519975 (+   613us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:43.520163 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64632576}
W20260709 13:14:43.560573  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 610774us
I20260709 13:14:43.659628  4675 leader_election.cc:304] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:43.560603  4034 raft_consensus.cc:2410] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:14:43.564570  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 53605.1us
I20260709 13:14:43.571198  5340 leader_election.cc:290] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:43.574208  5583 consensus_queue.cc:1048] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:14:43.574323  5293 raft_consensus.cc:493] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.574457  5403 leader_election.cc:290] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:43.574652  5345 leader_election.cc:290] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:43.616546  4703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:14:43.618371  5637 log.cc:927] Time spent T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
I20260709 13:14:43.619849  4708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:43.654702  5299 raft_consensus.cc:493] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.574715  4074 leader_election.cc:304] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:43.657378  5552 raft_consensus.cc:493] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:43.696656  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 122023us
I20260709 13:14:43.693567  4104 raft_consensus.cc:2955] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
W20260709 13:14:43.577301  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 171144us
I20260709 13:14:43.655279  5645 raft_consensus.cc:493] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:43.704335  4074 leader_election.cc:304] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:43.625389  5594 leader_election.cc:290] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:43.626987  4101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45336 (request call id 924) took 1184 ms. Trace:
I20260709 13:14:43.708086  4101 rpcz_store.cc:276] 0709 13:14:42.442749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:42.727377 (+284628us) service_pool.cc:224] Handling call
0709 13:14:42.727851 (+   474us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:42.728279 (+   428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:42.728315 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:42.728871 (+   556us) log.cc:844] Serialized 26 byte log entry
0709 13:14:43.198991 (+470120us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:14:43.199036 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:43.199119 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:43.626650 (+427531us) raft_consensus.cc:1685] finished
0709 13:14:43.626684 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:43.626907 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5320,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":145,"thread_start_us":433459,"threads_started":1,"wal-append.queue_time_us":666507}
I20260709 13:14:43.627712  4026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38304 (request call id 1561) took 2035 ms. Trace:
I20260709 13:14:43.710166  4026 rpcz_store.cc:276] 0709 13:14:41.592388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:41.637741 (+ 45353us) service_pool.cc:224] Handling call
0709 13:14:41.638423 (+   682us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:41.652266 (+ 13843us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:41.652306 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:41.652838 (+   532us) log.cc:844] Serialized 26 byte log entry
0709 13:14:43.138090 (+1485252us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:14:43.138152 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:43.138261 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:43.627431 (+489170us) raft_consensus.cc:1685] finished
0709 13:14:43.627460 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:43.627637 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26441,"raft.queue_time_us":25886,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":5196,"thread_start_us":1484789,"threads_started":1,"wal-append.queue_time_us":1700351}
I20260709 13:14:43.712631  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:43.631801  5558 leader_election.cc:290] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:43.633940  5503 leader_election.cc:290] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:43.635897  5560 leader_election.cc:290] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:43.635814  5475 consensus_queue.cc:1048] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:43.508639  4105 raft_consensus.cc:1240] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:14:43.463927  5301 raft_consensus.cc:515] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:43.637250  5453 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:43.578193  5455 raft_consensus.cc:493] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.764441  5455 raft_consensus.cc:515] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:43.765506  5301 leader_election.cc:290] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:43.766848  5597 raft_consensus.cc:493] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:43.767124  5455 leader_election.cc:290] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:43.578519  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:43.767917  5653 raft_consensus.cc:493] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:43.729193  4704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:43.768590  5560 raft_consensus.cc:493] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.769250  5560 raft_consensus.cc:515] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:43.770094  5489 consensus_meta.cc:287] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938: Time spent flushing consensus metadata: real 0.652s	user 0.014s	sys 0.000s
I20260709 13:14:43.573832  5507 raft_consensus.cc:2749] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:14:43.571952  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 421601us
I20260709 13:14:43.772212  5507 raft_consensus.cc:493] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
W20260709 13:14:43.597074  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:43.772745  5507 raft_consensus.cc:515] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:43.578833  5536 raft_consensus.cc:493] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:14:43.774096  5536 raft_consensus.cc:515] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:43.775104  5507 leader_election.cc:290] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:43.775713  5453 raft_consensus.cc:493] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.776255  5453 raft_consensus.cc:515] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:43.776748  5536 leader_election.cc:290] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:43.778376  5453 leader_election.cc:290] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:43.779139  5498 consensus_queue.cc:1059] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:43.730036  5645 raft_consensus.cc:515] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:43.780148  3922 leader_election.cc:304] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:43.780507  5498 raft_consensus.cc:3055] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:43.780922  5498 raft_consensus.cc:740] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:43.781463  3922 leader_election.cc:304] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:43.781709  5645 leader_election.cc:290] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:43.782032  5455 raft_consensus.cc:493] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.782284  5645 consensus_queue.cc:1048] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:43.782631  3922 leader_election.cc:304] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:43.782531  5455 raft_consensus.cc:515] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:43.771394  5560 leader_election.cc:290] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:43.783983  5560 raft_consensus.cc:2749] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:43.784660  5560 raft_consensus.cc:2749] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:43.784740  5455 leader_election.cc:290] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:43.785419  5455 raft_consensus.cc:2804] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:43.754043  5594 raft_consensus.cc:2804] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:43.785877  5455 raft_consensus.cc:697] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 3 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:43.786288  5594 raft_consensus.cc:493] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:43.786859  5594 raft_consensus.cc:3060] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:43.595901  5516 consensus_queue.cc:1059] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:14:43.642681  5592 leader_election.cc:290] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:43.649690  5496 leader_election.cc:290] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:43.458019  5635 raft_consensus.cc:515] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:14:43.651177  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:43.651571  5538 raft_consensus.cc:515] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:43.662861  4073 leader_election.cc:304] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:43.665411  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:43.664633  3925 leader_election.cc:304] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:43.666666  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:14:43.841598  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 177047us
I20260709 13:14:43.841706  4099 raft_consensus.cc:2468] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 2.
I20260709 13:14:43.677560  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:43.684476  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:43.843338  4107 raft_consensus.cc:2468] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 2.
I20260709 13:14:43.624159  4102 raft_consensus.cc:1240] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:43.722304  4074 leader_election.cc:304] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:43.685909  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:43.844530  5546 raft_consensus.cc:3060] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:43.668406  5472 consensus_queue.cc:1048] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:14:43.693132  4100 raft_consensus.cc:2468] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 3.
I20260709 13:14:43.713431  4026 raft_consensus.cc:2468] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 2.
W20260709 13:14:43.847698  4073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 184950us
I20260709 13:14:43.848270  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:43.848337  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:43.849046  4026 raft_consensus.cc:2468] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:43.849562  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:43.849869  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:43.750536  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:43.696843  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:43.705267  5552 raft_consensus.cc:515] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:43.705037  4703 raft_consensus.cc:2468] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:14:43.756597  5474 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:43.514930  4700 rpcz_store.cc:276] 0709 13:14:41.468340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:41.471707 (+  3367us) service_pool.cc:224] Handling call
0709 13:14:41.588765 (+117058us) spinlock_profiling.cc:243] Waited 2.51 ms on lock 0x7b5800003f98. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f1522549b71 00007f1522549a22 00007f152b462c09 00007f152a5bcee0 00007f152a6860ab 00007f152a686131 00007f152a647fc0 00007f152a632929 00007f152a6323d2 00007f1523ba9bd4
0709 13:14:41.588990 (+   225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:41.589229 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:14:42.710358 (+1121129us) log.cc:844] Serialized 14 byte log entry
0709 13:14:43.514062 (+803704us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:43.514148 (+    86us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:43.514204 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:43.514281 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:43.514417 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":901406,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"raft.queue_time_us":2580,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":144,"spinlock_wait_cycles":5764864,"thread_start_us":1811056,"threads_started":2,"wal-append.queue_time_us":964981}
I20260709 13:14:43.703219  5299 raft_consensus.cc:515] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:43.682134  5487 raft_consensus.cc:515] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:43.692412  5293 raft_consensus.cc:515] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:43.875370  5293 leader_election.cc:290] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:43.762411  5648 raft_consensus.cc:493] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:43.876214  5648 raft_consensus.cc:515] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:43.865618  5560 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:14:43.878074  5560 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:43.878996  5648 leader_election.cc:290] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:43.767491  5597 raft_consensus.cc:515] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:43.880260  5560 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:43.881551  5597 leader_election.cc:290] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:43.768414  4709 raft_consensus.cc:3060] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:43.845624  5583 raft_consensus.cc:493] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:43.596459  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:43.780306  5652 consensus_queue.cc:1059] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:14:43.577346  3924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:43.784089  5638 log.cc:927] Time spent T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.363s	user 0.001s	sys 0.000s
I20260709 13:14:43.706547  5345 raft_consensus.cc:2804] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:43.640712  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:43.808636  4701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:43.814270  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:43.904377  4031 raft_consensus.cc:2468] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:43.815014  3997 leader_election.cc:304] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
W20260709 13:14:43.905652  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 90795.3us
I20260709 13:14:43.906489  3997 leader_election.cc:304] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:14:43.817862  4029 consensus_queue.cc:260] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:43.908004  4029 raft_consensus.cc:3060] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:14:43.821491  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:43.868875  5501 raft_consensus.cc:493] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:43.830528  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 395026us
W20260709 13:14:43.767354  5639 log.cc:927] Time spent T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:14:43.836053  4108 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45336 (request call id 909) took 1906 ms (client timeout 1637 ms). Trace:
W20260709 13:14:43.917656  4108 rpcz_store.cc:269] 0709 13:14:41.929262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:41.929450 (+   188us) service_pool.cc:224] Handling call
0709 13:14:43.835345 (+1905895us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b5400200154. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:14:43.835518 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2833028992}
I20260709 13:14:43.851310  4034 raft_consensus.cc:2468] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
W20260709 13:14:43.852453  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:43.854699  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 132596us
I20260709 13:14:43.921301  4074 leader_election.cc:304] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:43.923027  4074 leader_election.cc:304] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:43.857034  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:43.850522  4026 raft_consensus.cc:2468] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 4.
I20260709 13:14:43.807049  5630 leader_election.cc:290] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:43.786911  5455 consensus_queue.cc:237] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:43.847364  5507 raft_consensus.cc:2804] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:43.846225  5403 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.768471  5653 raft_consensus.cc:515] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:43.862327  5598 raft_consensus.cc:2804] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:14:43.872350  5650 log.cc:927] Time spent T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:14:43.873132  5548 raft_consensus.cc:2804] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:43.887965  4027 raft_consensus.cc:2468] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:43.889014  4672 leader_election.cc:304] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:43.859772  5592 raft_consensus.cc:2804] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:43.896409  4709 raft_consensus.cc:2468] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 4.
I20260709 13:14:43.901075  4025 raft_consensus.cc:2468] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:43.823235  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:43.972416  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:43.781752  5498 consensus_queue.cc:260] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:43.916427  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:43.704377  5581 leader_election.cc:290] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:43.925262  3924 leader_election.cc:304] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:43.902493  5583 raft_consensus.cc:515] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:43.967459  5403 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:43.929388  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:43.947297  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:44.034693  4028 raft_consensus.cc:2468] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3.
I20260709 13:14:43.900631  5345 raft_consensus.cc:493] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:44.048986  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:44.049249  5345 raft_consensus.cc:3060] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:44.050279  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:44.050923  4026 raft_consensus.cc:2468] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 3.
I20260709 13:14:43.949278  4073 leader_election.cc:304] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:14:43.926194  4071 leader_election.cc:304] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
W20260709 13:14:43.951063  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 168496us
I20260709 13:14:44.052659  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:43.952864  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:43.960126  4029 raft_consensus.cc:2468] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 3.
I20260709 13:14:44.053892  4026 raft_consensus.cc:2468] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 2.
I20260709 13:14:44.053969  4103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34656 (request call id 116) took 1110 ms. Trace:
W20260709 13:14:43.962312  4675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:44.056260  4073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 107112us
I20260709 13:14:44.056934  4073 leader_election.cc:304] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:43.946660  5558 raft_consensus.cc:2804] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:14:43.968152  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 79269.1us
I20260709 13:14:44.058629  4672 leader_election.cc:304] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
W20260709 13:14:43.968152  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 45207.6us
I20260709 13:14:43.926697  5652 raft_consensus.cc:2804] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:43.917670  3997 leader_election.cc:304] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938
W20260709 13:14:43.989111  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 63962.9us
W20260709 13:14:44.064657  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 138528us
I20260709 13:14:44.066073  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:44.066862  4102 raft_consensus.cc:2393] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 4: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:43.988368  5496 raft_consensus.cc:2804] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:43.965551  5598 raft_consensus.cc:493] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:43.991209  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:44.071267  4027 raft_consensus.cc:2410] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:14:43.961573  5507 raft_consensus.cc:493] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:43.992905  5453 raft_consensus.cc:2804] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:43.995702  5647 raft_consensus.cc:493] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:43.996281  5487 leader_election.cc:290] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:43.999087  5635 leader_election.cc:290] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:14:43.999271  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.000895  5552 leader_election.cc:290] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:44.001091  5655 log.cc:927] Time spent T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:14:43.925978  5501 raft_consensus.cc:515] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:44.002213  4106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45336 (request call id 921) took 1699 ms. Trace:
I20260709 13:14:44.146102  4106 rpcz_store.cc:276] 0709 13:14:42.303328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:42.303895 (+   567us) service_pool.cc:224] Handling call
0709 13:14:42.359287 (+ 55392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:42.400248 (+ 40961us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:42.400296 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:42.440375 (+ 40079us) log.cc:844] Serialized 26 byte log entry
0709 13:14:42.914308 (+473933us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:14:42.914350 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:42.914422 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:44.001921 (+1087499us) raft_consensus.cc:1685] finished
0709 13:14:44.001952 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:44.002136 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":214,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":76665,"thread_start_us":418269,"threads_started":1,"wal-append.queue_time_us":874137}
I20260709 13:14:43.974192  5340 raft_consensus.cc:493] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:44.003468  5538 leader_election.cc:290] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:44.003950  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:44.004164  5548 raft_consensus.cc:697] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 3 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:14:44.008285  4032 raft_consensus.cc:2410] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:14:44.008917  5583 leader_election.cc:290] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:43.928828  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:44.009547  5587 raft_consensus.cc:3060] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:44.070895  5581 consensus_queue.cc:1048] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 13:14:44.010555  5536 raft_consensus.cc:3055] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:44.011382  5301 raft_consensus.cc:3055] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:44.022967  5299 leader_election.cc:290] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:44.029742  5498 raft_consensus.cc:3060] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:43.973917  5630 raft_consensus.cc:2804] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:43.970824  5592 raft_consensus.cc:493] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:44.032872  5594 raft_consensus.cc:515] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:44.008777  4031 raft_consensus.cc:2468] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 4.
I20260709 13:14:44.197178  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:44.198315  4031 raft_consensus.cc:2410] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:14:44.052920  3922 leader_election.cc:304] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
W20260709 13:14:43.956210  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:43.917203  5645 raft_consensus.cc:2749] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:14:44.036239  3925 leader_election.cc:304] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:44.063766  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:44.201174  4108 raft_consensus.cc:2468] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 3.
I20260709 13:14:43.975844  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:44.202190  4031 raft_consensus.cc:1240] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:44.054584  4103 rpcz_store.cc:276] 0709 13:14:42.943613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:43.409220 (+465607us) service_pool.cc:224] Handling call
0709 13:14:43.409469 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:43.519668 (+110199us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:14:43.840075 (+320407us) log.cc:844] Serialized 14 byte log entry
0709 13:14:44.019713 (+179638us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:44.019770 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:44.019816 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:44.053620 (+ 33804us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54001bab54. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:14:44.053692 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:44.053891 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63879,"prepare.queue_time_us":404556,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":69153,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":112,"spinlock_wait_cycles":252780800,"thread_start_us":393770,"threads_started":2,"wal-append.queue_time_us":208297}
I20260709 13:14:44.069753  4672 leader_election.cc:304] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
W20260709 13:14:44.202908  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 166761us
I20260709 13:14:44.183986  5301 raft_consensus.cc:740] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:44.203186  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
W20260709 13:14:44.067569  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 149962us
I20260709 13:14:44.077896  4675 leader_election.cc:304] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:44.079012  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:14:44.204949  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 127144us
I20260709 13:14:44.073594  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:44.073729  4099 raft_consensus.cc:1240] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:14:44.205595  4102 raft_consensus.cc:2468] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
W20260709 13:14:44.065235  5550 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:14:44.082468  4074 leader_election.cc:304] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:14:44.060969  5516 raft_consensus.cc:2804] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:44.095280  4034 raft_consensus.cc:1240] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:44.126605  4708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:44.194705  5630 raft_consensus.cc:493] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:44.196491  5592 raft_consensus.cc:3060] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:44.071165  5652 raft_consensus.cc:697] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:44.091830  5547 raft_consensus.cc:2804] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:44.129019  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:44.129807  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:44.129923  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:44.130194  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:14:44.217437  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 135072us
I20260709 13:14:44.218883  4026 raft_consensus.cc:2468] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:44.217447  4027 raft_consensus.cc:2468] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:44.080343  5507 raft_consensus.cc:3060] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:44.219731  4074 leader_election.cc:304] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:44.094959  5664 raft_consensus.cc:493] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:44.221683  5664 raft_consensus.cc:515] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:44.138734  4701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:44.139889  5653 leader_election.cc:290] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:44.140512  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:44.141546  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:44.065387  5582 raft_consensus.cc:2749] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:44.079841  5598 raft_consensus.cc:3060] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:44.068998  5496 raft_consensus.cc:493] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:44.231959  5496 raft_consensus.cc:3060] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:44.064657  5558 raft_consensus.cc:493] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:14:44.235780  5558 raft_consensus.cc:3060] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:44.237180  5403 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:44.238315  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:44.091388  5453 raft_consensus.cc:493] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:44.239773  5453 raft_consensus.cc:3060] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:44.071576  5551 raft_consensus.cc:2804] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:44.243853  5551 raft_consensus.cc:493] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:14:44.244295  5551 raft_consensus.cc:3060] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:44.160547  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:44.131350  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:44.246668  4033 raft_consensus.cc:2468] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 3.
I20260709 13:14:44.214877  5630 raft_consensus.cc:3060] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:44.250913  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:44.174858  4104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45336 (request call id 928) took 1700 ms. Trace:
I20260709 13:14:44.251955  4099 raft_consensus.cc:2468] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 4.
I20260709 13:14:44.253367  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:44.251857  4104 rpcz_store.cc:276] 0709 13:14:42.474245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:43.162309 (+688064us) service_pool.cc:224] Handling call
0709 13:14:43.237239 (+ 74930us) spinlock_profiling.cc:243] Waited 71.2 ms on lock 0x7b5800011798. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f1522549b71 00007f1522549a22 00007f152b462c09 00007f152a5bcee0 00007f152a6860ab 00007f152a686131 00007f152a647fc0 00007f152a632929 00007f152a6323d2 00007f1523ba9bd4
0709 13:14:43.237497 (+   258us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:43.237973 (+   476us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:43.238011 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:43.239322 (+  1311us) log.cc:844] Serialized 501 byte log entry
0709 13:14:43.693434 (+454112us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:43.861409 (+167975us) log.cc:844] Serialized 14 byte log entry
0709 13:14:43.861870 (+   461us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:43.861966 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:44.143224 (+281258us) raft_consensus.cc:1685] finished
0709 13:14:44.174523 (+ 31299us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:44.174768 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1200,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":12002,"spinlock_wait_cycles":163831552,"thread_start_us":391172,"threads_started":1,"wal-append.queue_time_us":659116}
I20260709 13:14:44.254297  4099 raft_consensus.cc:2368] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 3. Current term is 4.
I20260709 13:14:44.254655  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:44.255693  4104 raft_consensus.cc:2393] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 2: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:14:44.095283  5475 raft_consensus.cc:493] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:44.182330  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:44.256382  4106 raft_consensus.cc:2376] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 3. Re-sending same reply.
I20260709 13:14:44.164594  3856 catalog_manager.cc:5697] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 1 to 2, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 2 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:44.143435  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:44.188156  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:44.264119  4029 raft_consensus.cc:2468] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:44.189193  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:44.265398  4032 raft_consensus.cc:2468] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 3.
I20260709 13:14:44.048496  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:44.268096  4028 raft_consensus.cc:2410] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:14:44.199440  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 146613us
I20260709 13:14:44.183765  5536 raft_consensus.cc:740] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:44.202358  4025 raft_consensus.cc:2393] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 2: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
W20260709 13:14:44.203033  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 133359us
I20260709 13:14:44.263285  3856 catalog_manager.cc:5697] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:44.217011  5547 raft_consensus.cc:493] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:44.206496  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
W20260709 13:14:44.207021  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.207659  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:44.205612  3997 leader_election.cc:304] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:44.208388  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:44.208683  4031 raft_consensus.cc:1275] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:44.072399  3924 leader_election.cc:304] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:44.209852  4708 raft_consensus.cc:2468] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3.
I20260709 13:14:44.110621  5562 raft_consensus.cc:493] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:14:44.091221  5503 consensus_queue.cc:1048] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:14:44.212291  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:14:44.283834  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 78277.2us
I20260709 13:14:44.283967  4108 raft_consensus.cc:2468] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 3.
I20260709 13:14:44.110786  5647 raft_consensus.cc:515] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:44.159282  5340 raft_consensus.cc:515] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:44.070972  5660 raft_consensus.cc:2804] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:44.274662  5475 raft_consensus.cc:515] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:44.221127  5657 raft_consensus.cc:2804] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:44.277837  5547 raft_consensus.cc:3060] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:44.224202  3855 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52104 (request call id 201) took 9845 ms. Trace:
I20260709 13:14:44.212857  5516 raft_consensus.cc:493] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:44.226305  4027 raft_consensus.cc:1275] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:44.226399  5664 leader_election.cc:290] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:44.210427  5489 raft_consensus.cc:2804] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:44.230719  5501 leader_election.cc:290] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:44.172926  4030 raft_consensus.cc:3060] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:14:44.176092  3998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.324339  3925 leader_election.cc:304] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:44.330318  4675 leader_election.cc:304] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:44.331573  4675 leader_election.cc:304] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
W20260709 13:14:44.335953  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.278203  5676 raft_consensus.cc:2804] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:44.297758  3855 rpcz_store.cc:276] 0709 13:14:34.368645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:34.372584 (+  3939us) service_pool.cc:224] Handling call
0709 13:14:44.214178 (+9841594us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:40.909604 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:40.995142 (+ 85538us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:40.995181 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:14:40.995200 (+    19us) tablet.cc:662] Decoding operations
0709 13:14:40.996220 (+  1020us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:40.996305 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:40.996340 (+    35us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:14:40.997056 (+   716us) tablet.cc:701] Row locks acquired
0709 13:14:40.997072 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:14:40.997246 (+   174us) write_op.cc:270] Start()
0709 13:14:40.997379 (+   133us) write_op.cc:276] Timestamp: P: 1783602880997176 usec, L: 0
0709 13:14:40.997402 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:14:40.998137 (+   735us) log.cc:844] Serialized 3704 byte log entry
0709 13:14:43.415161 (+2417024us) op_driver.cc:464] REPLICATION: finished
0709 13:14:44.013580 (+598419us) write_op.cc:301] APPLY: starting
0709 13:14:44.013694 (+   114us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:44.014048 (+   354us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:44.015380 (+  1332us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:44.016834 (+  1454us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:44.017535 (+   701us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:14:44.017605 (+    70us) write_op.cc:312] APPLY: finished
0709 13:14:44.017986 (+   381us) log.cc:844] Serialized 71 byte log entry
0709 13:14:44.018196 (+   210us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:44.018382 (+   186us) write_op.cc:454] Released schema lock
0709 13:14:44.018449 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:44.018868 (+   419us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:44.018892 (+    24us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1826278,"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":592165,"apply.run_cpu_time_us":3850,"apply.run_wall_time_us":5299,"num_ops":9,"prepare.queue_time_us":204837,"prepare.run_cpu_time_us":34020,"prepare.run_wall_time_us":223209,"raft.queue_time_us":1434523,"raft.run_cpu_time_us":47384,"raft.run_wall_time_us":517688,"replication_time_us":2356973,"spinlock_wait_cycles":2304,"thread_start_us":1864287,"threads_started":4,"wal-append.queue_time_us":782336}]]}
I20260709 13:14:44.287678  5660 raft_consensus.cc:493] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:44.259526  4074 leader_election.cc:304] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
W20260709 13:14:44.345866  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 86466us
I20260709 13:14:44.346624  4074 leader_election.cc:304] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:44.269120  3922 leader_election.cc:304] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:44.264122  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:44.073036  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:44.273705  3856 catalog_manager.cc:5697] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 1 to 2, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 2 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:44.281631  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 209303us
I20260709 13:14:44.284592  3997 leader_election.cc:304] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:44.243239  5592 raft_consensus.cc:515] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:44.278600  4101 raft_consensus.cc:2468] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 3.
I20260709 13:14:44.202282  5583 raft_consensus.cc:2804] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:44.206929  5661 raft_consensus.cc:2764] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:14:44.353614  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:44.294798  5657 raft_consensus.cc:493] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:14:44.306376  5516 raft_consensus.cc:3060] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:44.310791  5647 leader_election.cc:290] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:44.311689  5670 log.cc:927] Time spent T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:14:44.312839  5340 leader_election.cc:290] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:44.287508  5546 raft_consensus.cc:2804] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:44.386257  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:14:44.316121  5672 log.cc:927] Time spent T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:14:44.288516  5562 raft_consensus.cc:515] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:44.283991  5641 raft_consensus.cc:2804] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:44.318367  4704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:44.215368  5455 raft_consensus.cc:2804] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:14:44.344373  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 69156.3us
I20260709 13:14:44.347493  4074 leader_election.cc:304] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:14:44.350524  3856 catalog_manager.cc:5697] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 1 to 2, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 2 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:44.358306  3955 raft_consensus.cc:2468] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 2.
W20260709 13:14:44.359011  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 90027.8us
W20260709 13:14:44.409461  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 62038.4us
I20260709 13:14:44.379828  5560 raft_consensus.cc:3060] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:44.354002  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:44.414508  3956 raft_consensus.cc:2468] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 2.
I20260709 13:14:44.380376  5499 raft_consensus.cc:2804] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:44.361356  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:44.377171  5472 raft_consensus.cc:2804] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:44.413194  3856 catalog_manager.cc:5697] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 1 to 2, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 2 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:44.418643  4103 raft_consensus.cc:2468] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
I20260709 13:14:44.419595  3856 catalog_manager.cc:5697] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 1 to 2, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 2 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:44.372063  4030 raft_consensus.cc:2468] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 4.
I20260709 13:14:44.353214  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:44.421841  3957 raft_consensus.cc:2468] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:44.301795  5528 raft_consensus.cc:493] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:44.342074  5676 raft_consensus.cc:493] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:44.347522  5662 raft_consensus.cc:2804] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:44.283341  5301 consensus_queue.cc:260] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:44.262261  5548 consensus_queue.cc:237] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:44.346552  5489 raft_consensus.cc:697] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 3 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:14:44.375270  5653 raft_consensus.cc:2804] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:44.402987  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:44.381403  5657 raft_consensus.cc:3060] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:44.410281  4074 leader_election.cc:304] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:44.410156  3922 leader_election.cc:304] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
W20260709 13:14:44.359887  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 75379.8us
I20260709 13:14:44.341728  5536 consensus_queue.cc:260] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:44.372932  5503 raft_consensus.cc:2804] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:44.347047  5660 raft_consensus.cc:3060] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:44.390333  5475 leader_election.cc:290] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:44.423561  3856 catalog_manager.cc:5697] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 1 to 2, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 2 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:44.392963  5546 raft_consensus.cc:493] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:44.394003  5583 raft_consensus.cc:697] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 3 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:44.408545  5455 raft_consensus.cc:493] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:44.467815  5455 raft_consensus.cc:3060] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:44.436797  5653 raft_consensus.cc:493] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:44.470929  5653 raft_consensus.cc:3060] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:44.439826  4074 leader_election.cc:304] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:44.473718  4074 leader_election.cc:304] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:44.474804  4074 leader_election.cc:304] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:44.437341  5594 leader_election.cc:290] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:44.412469  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:44.481129  3950 raft_consensus.cc:2468] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 2.
I20260709 13:14:44.444502  3922 leader_election.cc:304] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:44.446166  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:44.413058  5641 raft_consensus.cc:697] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 4 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:44.418944  5403 raft_consensus.cc:2804] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:44.448184  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:14:44.448385  4071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.482470  4029 raft_consensus.cc:2468] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3.
I20260709 13:14:44.420058  5499 raft_consensus.cc:493] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:44.420651  5472 raft_consensus.cc:493] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:44.450790  5562 leader_election.cc:290] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:44.459345  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:44.446256  5503 raft_consensus.cc:493] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:44.433224  5528 raft_consensus.cc:515] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:44.464478  5583 consensus_queue.cc:237] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:44.465292  5546 raft_consensus.cc:3060] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:44.342558  5652 consensus_queue.cc:237] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:44.442118  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:44.427645  5662 raft_consensus.cc:493] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
W20260709 13:14:44.540709  4675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.427325  5676 raft_consensus.cc:3060] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:44.451994  5597 raft_consensus.cc:2749] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:14:44.478163  5474 raft_consensus.cc:2749] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:44.507781  4030 raft_consensus.cc:2393] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 3: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:14:44.485204  5403 raft_consensus.cc:493] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:14:44.410035  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:44.453954  5642 raft_consensus.cc:2804] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:44.460379  5536 raft_consensus.cc:3060] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:44.434882  5558 raft_consensus.cc:515] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:44.460903  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:14:44.485354  5677 log.cc:927] Time spent T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
W20260709 13:14:44.529486  5679 log.cc:927] Time spent T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:14:44.535895  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:44.600270  3950 raft_consensus.cc:2468] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:44.537956  5453 raft_consensus.cc:515] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:44.512982  5503 raft_consensus.cc:3060] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:44.513181  5475 consensus_queue.cc:1059] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:14:44.567279  5403 raft_consensus.cc:3060] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:44.555528  5501 raft_consensus.cc:2749] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:14:44.486321  5299 consensus_queue.cc:1059] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.078s
I20260709 13:14:44.485108  5472 raft_consensus.cc:3060] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:44.487586  5499 raft_consensus.cc:3060] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:44.484906  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:44.519584  5582 raft_consensus.cc:2804] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:44.564383  5592 leader_election.cc:290] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:44.588941  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:44.595563  4704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
W20260709 13:14:44.596040  5678 log.cc:927] Time spent T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 13:14:44.596973  5528 leader_election.cc:290] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:44.550972  5662 raft_consensus.cc:3060] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:14:44.601168  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 126476us
W20260709 13:14:44.604050  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 157555us
I20260709 13:14:44.677469  4074 leader_election.cc:304] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
W20260709 13:14:44.604713  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.522219  5562 raft_consensus.cc:2804] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:44.568112  5581 raft_consensus.cc:493] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:44.614084  4101 raft_consensus.cc:1240] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 2. Current term is 3. Ops: []
W20260709 13:14:44.616927  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 172513us
I20260709 13:14:44.685138  3922 leader_election.cc:304] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:44.568010  5642 raft_consensus.cc:493] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:44.644440  3954 raft_consensus.cc:2468] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:44.648321  5547 raft_consensus.cc:515] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:44.641503  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:44.649729  5582 raft_consensus.cc:493] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:44.690645  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:44.689575  3957 raft_consensus.cc:2468] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:44.691819  3922 leader_election.cc:304] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:44.694300  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:44.695299  3922 leader_election.cc:304] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:44.695389  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:44.692731  4099 raft_consensus.cc:1275] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:44.676030  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:44.652709  3956 raft_consensus.cc:2468] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:44.696988  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:44.696988  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:44.697800  3956 raft_consensus.cc:2468] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 2.
I20260709 13:14:44.698314  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:44.698626  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:44.700439  3997 leader_election.cc:304] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:44.704820  3952 raft_consensus.cc:2393] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 3: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:14:44.705480  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:44.705662  4105 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:14:44.706094  3957 raft_consensus.cc:3060] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:44.707020  4707 raft_consensus.cc:2468] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 2.
I20260709 13:14:44.709941  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:44.711742  4108 raft_consensus.cc:2468] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 3.
I20260709 13:14:44.693753  5594 raft_consensus.cc:493] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:44.712600  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:44.722458  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:44.683341  5562 raft_consensus.cc:493] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:44.600353  5489 consensus_queue.cc:237] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:44.695361  5501 raft_consensus.cc:2804] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:44.696166  5642 raft_consensus.cc:3060] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:44.690954  5592 raft_consensus.cc:2804] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:44.689708  5641 consensus_queue.cc:237] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:44.736532  5340 raft_consensus.cc:2804] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:44.756069  5340 raft_consensus.cc:493] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:44.756578  5340 raft_consensus.cc:3060] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:44.714385  3953 raft_consensus.cc:2468] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:44.759783  4704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:44.737053  5562 raft_consensus.cc:3060] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:44.771981  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:44.734541  5654 raft_consensus.cc:2749] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:14:44.776754  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:44.763119  3953 raft_consensus.cc:1275] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:44.699643  5582 raft_consensus.cc:3060] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:14:44.707916  5683 log.cc:927] Time spent T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:14:44.706275  5558 leader_election.cc:290] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:44.699883  5560 raft_consensus.cc:2749] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:44.707300  5664 raft_consensus.cc:2804] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:44.741016  3957 raft_consensus.cc:2468] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:44.706383  4105 raft_consensus.cc:606] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Received request to transfer leadership to TS 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:44.789106  4702 raft_consensus.cc:1240] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 3 LEADER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 2. Current term is 3. Ops: []
W20260709 13:14:44.786396  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.689559  5299 consensus_queue.cc:1048] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:14:44.701717  5475 consensus_queue.cc:1048] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
W20260709 13:14:44.794945  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 99730.9us
I20260709 13:14:44.793332  5501 raft_consensus.cc:697] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 2 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:44.696533  5581 raft_consensus.cc:515] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:44.766791  5630 raft_consensus.cc:515] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:44.706784  5597 consensus_queue.cc:1048] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.077s
W20260709 13:14:44.790477  5678 log.cc:927] Time spent T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
W20260709 13:14:44.793041  5345 consensus_meta.cc:287] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.739s	user 0.012s	sys 0.002s
W20260709 13:14:44.848304  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 147968us
I20260709 13:14:44.849694  3997 leader_election.cc:304] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:44.726804  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:44.785779  5592 raft_consensus.cc:493] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:44.821578  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 118408us
W20260709 13:14:44.822264  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.824920  5698 raft_consensus.cc:493] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:44.735329  5594 raft_consensus.cc:515] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:44.826773  3956 raft_consensus.cc:2468] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 2.
I20260709 13:14:44.796674  3954 raft_consensus.cc:2468] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 4.
I20260709 13:14:44.836364  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:44.861526  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:44.862113  4027 raft_consensus.cc:3060] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:44.837425  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:44.836454  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:44.851128  3958 raft_consensus.cc:2468] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:44.851145  3997 leader_election.cc:304] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:14:44.826890  5664 raft_consensus.cc:697] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 4 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
W20260709 13:14:44.869822  3998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.862411  4031 raft_consensus.cc:2468] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 4.
I20260709 13:14:44.869210  4074 leader_election.cc:304] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:14:44.875655  5474 raft_consensus.cc:2749] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:44.818838  5516 raft_consensus.cc:515] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:44.853092  5592 raft_consensus.cc:3060] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:44.887869  3997 leader_election.cc:304] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:44.884647  3925 leader_election.cc:304] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:44.889593  4074 leader_election.cc:304] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
W20260709 13:14:44.900969  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 65373.2us
W20260709 13:14:44.895514  5598 consensus_meta.cc:287] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.633s	user 0.005s	sys 0.011s
W20260709 13:14:44.902020  5507 consensus_meta.cc:287] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.678s	user 0.009s	sys 0.004s
I20260709 13:14:44.893023  5453 leader_election.cc:290] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Requested vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:14:44.924125  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.870504  5698 raft_consensus.cc:515] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:44.913058  3997 leader_election.cc:400] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 election: Vote denied by peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843) with higher term. Message: Invalid argument: T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 3. Current term is 4.
I20260709 13:14:44.856962  5345 raft_consensus.cc:515] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:44.927479  3997 leader_election.cc:403] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:14:44.907171  5598 raft_consensus.cc:515] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:44.922379  4675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:44.908485  5596 log.cc:927] Time spent T 00000000000000000000000000000000 P af4ff34c238b4043994545a7eb56815f: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:14:44.909262  5528 raft_consensus.cc:2804] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:44.938196  4027 raft_consensus.cc:2468] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 4.
I20260709 13:14:44.919997  5538 raft_consensus.cc:2804] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:14:44.935328  5681 log.cc:927] Time spent T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
I20260709 13:14:44.885105  5695 consensus_queue.cc:1048] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
W20260709 13:14:44.955837  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 44338.8us
I20260709 13:14:44.956852  3997 leader_election.cc:304] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
W20260709 13:14:44.939033  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 52626.5us
I20260709 13:14:44.884047  5501 consensus_queue.cc:237] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:44.926930  5299 raft_consensus.cc:2804] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:44.918998  5699 raft_consensus.cc:2749] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:44.951994  5516 leader_election.cc:290] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:44.923219  5507 raft_consensus.cc:515] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:44.960144  3924 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:44.942397  5475 raft_consensus.cc:493] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:44.945400  5528 raft_consensus.cc:493] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:44.955926  5538 raft_consensus.cc:493] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:44.970916  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 69057.5us
I20260709 13:14:44.973560  3924 leader_election.cc:304] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:14:44.962908  5299 raft_consensus.cc:493] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:44.952713  5499 raft_consensus.cc:515] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:44.991335  3959 raft_consensus.cc:1240] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:44.996066  3924 leader_election.cc:304] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:14:44.959086  5704 raft_consensus.cc:2749] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843) with higher term. Message: Invalid argument: T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 3. Current term is 4.
I20260709 13:14:44.977885  5528 raft_consensus.cc:3060] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:44.987505  5701 raft_consensus.cc:2804] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:44.979272  5538 raft_consensus.cc:3060] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:44.993322  5630 leader_election.cc:290] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:14:45.056411  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 60485.4us
I20260709 13:14:45.057526  3924 leader_election.cc:304] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:14:44.985658  5487 consensus_queue.cc:1048] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:14:45.058279  4032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38304 (request call id 1575) took 1204 ms. Trace:
I20260709 13:14:44.983434  5340 raft_consensus.cc:515] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:45.008025  5693 log.cc:927] Time spent T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:14:45.010072  5516 raft_consensus.cc:493] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.016692  5698 leader_election.cc:290] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:45.000389  5581 leader_election.cc:290] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:45.023206  5700 raft_consensus.cc:2804] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:45.026933  5546 raft_consensus.cc:515] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:45.028021  4702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57692 (request call id 216) took 1561 ms. Trace:
W20260709 13:14:44.993057  5694 log.cc:927] Time spent T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
W20260709 13:14:45.099802  5496 consensus_meta.cc:287] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938: Time spent flushing consensus metadata: real 0.867s	user 0.008s	sys 0.004s
I20260709 13:14:44.990248  5299 raft_consensus.cc:3060] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:44.944501  5664 consensus_queue.cc:237] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:44.982890  5475 raft_consensus.cc:515] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:45.058691  4032 rpcz_store.cc:276] 0709 13:14:43.854214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:44.266210 (+411996us) service_pool.cc:224] Handling call
0709 13:14:44.266669 (+   459us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:44.266958 (+   289us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:44.266997 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:44.278662 (+ 11665us) log.cc:844] Serialized 26 byte log entry
0709 13:14:44.481164 (+202502us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:14:44.481199 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:44.481272 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:45.058049 (+576777us) raft_consensus.cc:1685] finished
0709 13:14:45.058072 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:45.058219 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":177255,"threads_started":1,"wal-append.queue_time_us":312669}
W20260709 13:14:45.060424  5703 log.cc:927] Time spent T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:14:45.018762  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:14:45.059021  5587 consensus_meta.cc:287] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.881s	user 0.011s	sys 0.003s
I20260709 13:14:45.040334  4073 leader_election.cc:304] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
W20260709 13:14:45.141989  4073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 134417us
I20260709 13:14:45.114199  5705 consensus_queue.cc:1059] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:14:45.117863  5719 raft_consensus.cc:2749] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:45.147416  5581 raft_consensus.cc:2749] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:14:45.152004  4071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:45.118669  5700 raft_consensus.cc:697] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:45.158272  5700 consensus_queue.cc:237] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:45.118989  5340 leader_election.cc:290] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:45.107896  4702 rpcz_store.cc:276] 0709 13:14:43.466614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:43.510169 (+ 43555us) service_pool.cc:224] Handling call
0709 13:14:43.797942 (+287773us) spinlock_profiling.cc:243] Waited 9.35 ms on lock 0x7b5800003f98. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f1522549b71 00007f1522549a22 00007f152b462c09 00007f152a5bcee0 00007f152a6860ab 00007f152a686131 00007f152a647fc0 00007f152a632929 00007f152a6323d2 00007f1523ba9bd4
0709 13:14:43.798291 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:44.828985 (+1030694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:45.027700 (+198715us) spinlock_profiling.cc:243] Waited 924 ms on lock 0x7b5400655754. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:14:45.027948 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2146499840}
I20260709 13:14:45.122036  5546 leader_election.cc:290] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:45.098276  5594 leader_election.cc:290] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:45.165608  5594 raft_consensus.cc:493] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:45.165756  5547 leader_election.cc:290] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:45.166240  5594 raft_consensus.cc:515] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:45.169369  5594 leader_election.cc:290] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:45.075030  5597 raft_consensus.cc:2804] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:45.140854  3950 raft_consensus.cc:2468] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:45.084398  5701 raft_consensus.cc:493] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:45.176844  5719 raft_consensus.cc:2749] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:45.177068  5701 raft_consensus.cc:3060] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:45.177665  5719 raft_consensus.cc:2749] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:14:45.185345  3999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 229287us
W20260709 13:14:45.186421  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 301857us
I20260709 13:14:45.074501  5548 consensus_queue.cc:1059] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:14:45.098866  5472 raft_consensus.cc:515] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:45.221578  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:45.223865  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
W20260709 13:14:45.193867  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 304317us
W20260709 13:14:45.190011  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 233245us
I20260709 13:14:45.226135  3997 leader_election.cc:304] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:45.227430  3997 leader_election.cc:304] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:45.233103  5699 raft_consensus.cc:2804] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:45.233716  5699 raft_consensus.cc:493] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:45.234171  5699 raft_consensus.cc:3060] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:45.240837  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:45.241995  4027 raft_consensus.cc:2393] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 4: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:14:45.242362  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:45.243994  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:45.244983  4031 raft_consensus.cc:2393] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 4: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:14:45.245885  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:45.246223  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:45.247017  4025 raft_consensus.cc:2468] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 2.
I20260709 13:14:45.248118  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:45.248435  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:45.251055  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:45.254655  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:45.255431  4029 raft_consensus.cc:3060] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:45.260418  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:45.269335  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:45.271051  4106 raft_consensus.cc:2368] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 for earlier term 2. Current term is 3.
W20260709 13:14:45.272858  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:45.243185  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:45.280272  4074 leader_election.cc:304] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:45.175057  5597 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:14:45.128078  5516 raft_consensus.cc:515] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:45.209957  5345 leader_election.cc:290] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:45.291558  4074 leader_election.cc:304] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:45.283087  4672 leader_election.cc:400] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 election: Vote denied by peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843) with higher term. Message: Invalid argument: T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 for earlier term 2. Current term is 3.
I20260709 13:14:45.292739  4672 leader_election.cc:403] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:14:45.138955  5403 raft_consensus.cc:515] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:45.295389  3922 leader_election.cc:304] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:45.136482  5496 raft_consensus.cc:515] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:45.301000  4029 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 5.
I20260709 13:14:45.302183  4025 raft_consensus.cc:1240] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:14:45.302297  4074 leader_election.cc:304] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
W20260709 13:14:45.285784  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 228367us
I20260709 13:14:45.268424  5598 leader_election.cc:290] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:45.314194  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:45.306465  4071 leader_election.cc:304] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:45.326249  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:45.328706  5716 raft_consensus.cc:3055] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:45.329312  5716 raft_consensus.cc:740] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:45.330350  5717 raft_consensus.cc:2804] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:45.330927  5717 raft_consensus.cc:493] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:45.331383  5717 raft_consensus.cc:3060] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:45.288565  5597 raft_consensus.cc:3060] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:14:45.292238  5455 consensus_meta.cc:287] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.824s	user 0.011s	sys 0.002s
W20260709 13:14:45.298045  5660 consensus_meta.cc:287] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.820s	user 0.009s	sys 0.002s
I20260709 13:14:45.352447  4103 raft_consensus.cc:1240] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:45.359859  4708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:45.291388  5594 raft_consensus.cc:493] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.297662  5548 raft_consensus.cc:3060] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:45.370054  4708 raft_consensus.cc:3060] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:14:45.364037  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 57667.9us
I20260709 13:14:45.298933  5581 raft_consensus.cc:2804] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:45.371742  5581 raft_consensus.cc:493] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:45.372140  5581 raft_consensus.cc:3060] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:45.376169  4071 leader_election.cc:304] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:45.298805  5674 raft_consensus.cc:2804] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:45.387850  4071 leader_election.cc:304] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
W20260709 13:14:45.343884  5536 consensus_meta.cc:287] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 0.759s	user 0.009s	sys 0.005s
I20260709 13:14:45.389209  4071 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: d709ee666b774ec29aa732e508219938
W20260709 13:14:45.362870  5551 consensus_meta.cc:287] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 1.109s	user 0.005s	sys 0.008s
I20260709 13:14:45.361691  5630 raft_consensus.cc:2804] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:14:45.400696  4672 leader_election.cc:336] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Timed out: RequestConsensusVote RPC to 127.2.198.193:35339 timed out after 1.738s (SENT)
I20260709 13:14:45.415061  5711 raft_consensus.cc:2804] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:45.417389  4029 raft_consensus.cc:1240] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:45.422749  4672 leader_election.cc:304] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:45.382036  5598 raft_consensus.cc:2764] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 13:14:45.385834  5498 consensus_meta.cc:287] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 1.192s	user 0.013s	sys 0.001s
W20260709 13:14:45.429502  3998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:45.418180  5507 leader_election.cc:290] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:45.442232  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:45.443207  4029 raft_consensus.cc:2393] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 4: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:14:45.430981  5472 leader_election.cc:290] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:14:45.393644  5503 consensus_meta.cc:287] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.767s	user 0.011s	sys 0.000s
I20260709 13:14:45.433228  5699 raft_consensus.cc:515] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:45.434970  5592 consensus_meta.cc:287] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.535s	user 0.007s	sys 0.000s
I20260709 13:14:45.435132  5496 leader_election.cc:290] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:45.435468  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:45.412565  5499 leader_election.cc:290] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:45.436980  5299 raft_consensus.cc:515] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:45.417972  5690 log.cc:927] Time spent T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.246s	user 0.001s	sys 0.000s
W20260709 13:14:45.446775  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 46117.7us
I20260709 13:14:45.360008  5345 consensus_queue.cc:1059] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.063s
I20260709 13:14:45.451581  4027 raft_consensus.cc:2468] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:45.341615  5704 consensus_queue.cc:1048] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.104s
I20260709 13:14:45.369074  5455 raft_consensus.cc:515] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:45.458019  4707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57680 (request call id 428) took 1364 ms. Trace:
I20260709 13:14:45.487780  4707 rpcz_store.cc:276] 0709 13:14:44.124173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:44.141235 (+ 17062us) service_pool.cc:224] Handling call
0709 13:14:45.457796 (+1316561us) spinlock_profiling.cc:243] Waited 478 ms on lock 0x7b54005b0ed4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:14:45.457938 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1099485568}
I20260709 13:14:45.464226  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:45.387965  5594 raft_consensus.cc:515] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:45.483853  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 254774us
I20260709 13:14:45.449164  5587 raft_consensus.cc:2804] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:14:45.502912  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:45.369273  5660 raft_consensus.cc:515] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:45.453945  5711 raft_consensus.cc:493] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
W20260709 13:14:45.509697  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:45.453473  5487 raft_consensus.cc:2749] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:45.459718  5475 leader_election.cc:290] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:45.514902  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:45.519130  5711 raft_consensus.cc:3060] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:45.518656  3997 leader_election.cc:304] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:45.419658  5551 raft_consensus.cc:515] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:45.456596  5592 raft_consensus.cc:515] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:45.474388  5546 raft_consensus.cc:493] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.524947  3997 leader_election.cc:304] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:14:45.451846  5503 raft_consensus.cc:515] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:45.533481  4099 raft_consensus.cc:2393] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 3: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
W20260709 13:14:45.512084  5562 consensus_meta.cc:287] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.748s	user 0.010s	sys 0.003s
I20260709 13:14:45.470798  5472 consensus_queue.cc:1059] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:14:45.510926  5587 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:14:45.547428  4026 raft_consensus.cc:1240] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:45.452634  5722 raft_consensus.cc:2749] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:45.551448  4107 raft_consensus.cc:2368] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 3. Current term is 4.
I20260709 13:14:45.536294  5562 raft_consensus.cc:515] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:45.553038  5642 consensus_meta.cc:287] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.760s	user 0.008s	sys 0.004s
I20260709 13:14:45.551108  5587 raft_consensus.cc:3060] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:45.552374  3954 raft_consensus.cc:1240] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:14:45.538755  5546 raft_consensus.cc:515] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:45.559413  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:45.595758  4104 raft_consensus.cc:2393] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 4: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:45.558741  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:14:45.601141  5657 consensus_meta.cc:287] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 1.147s	user 0.013s	sys 0.000s
I20260709 13:14:45.601668  5657 raft_consensus.cc:515] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:45.602861  4102 raft_consensus.cc:1240] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:45.605067  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:45.609367  5660 leader_election.cc:290] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:14:45.594808  5653 consensus_meta.cc:287] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 1.123s	user 0.007s	sys 0.008s
I20260709 13:14:45.609618  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:45.589396  5642 raft_consensus.cc:515] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:45.610394  3953 raft_consensus.cc:3060] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:45.610157  5653 raft_consensus.cc:515] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:45.612444  3955 raft_consensus.cc:2393] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 5: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:14:45.609439  5594 leader_election.cc:290] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:45.613420  5653 leader_election.cc:290] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:45.618175  5662 consensus_meta.cc:287] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938: Time spent flushing consensus metadata: real 0.923s	user 0.006s	sys 0.006s
I20260709 13:14:45.618829  5662 raft_consensus.cc:515] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:45.620237  4708 raft_consensus.cc:2468] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3.
I20260709 13:14:45.624794  5562 leader_election.cc:290] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:45.627172  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:45.628063  4025 raft_consensus.cc:3060] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:45.592583  5516 leader_election.cc:290] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:45.633253  5702 raft_consensus.cc:2749] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:45.633498  5299 leader_election.cc:290] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:45.625783  5701 raft_consensus.cc:515] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:45.638075  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:45.638928  4031 raft_consensus.cc:2468] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 4.
W20260709 13:14:45.641481  5712 log.cc:927] Time spent T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 13:14:45.644254  5592 leader_election.cc:290] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:45.644850  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:45.645664  4105 raft_consensus.cc:2393] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 5: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:45.646679  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:45.647610  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:45.648224  4028 raft_consensus.cc:3060] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:45.626654  5704 raft_consensus.cc:493] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.655658  5301 raft_consensus.cc:3060] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:45.647349  4105 raft_consensus.cc:2376] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3. Re-sending same reply.
I20260709 13:14:45.673867  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:45.677551  4106 raft_consensus.cc:2368] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 3. Current term is 4.
I20260709 13:14:45.688303  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:45.690982  3952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38606 (request call id 1484) took 1273 ms. Trace:
I20260709 13:14:45.691608  3952 rpcz_store.cc:276] 0709 13:14:44.417731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:44.418336 (+   605us) service_pool.cc:224] Handling call
0709 13:14:45.690709 (+1272373us) spinlock_profiling.cc:243] Waited 69.5 ms on lock 0x7b5400187ed4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:14:45.690901 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":159830400}
I20260709 13:14:45.693418  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:45.694303  3952 raft_consensus.cc:2468] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 3.
I20260709 13:14:45.679381  5675 raft_consensus.cc:3055] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:45.702502  3959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1482) took 1335 ms. Trace:
I20260709 13:14:45.668545  5642 leader_election.cc:290] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:45.708523  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:14:45.710670  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:45.707706  3959 rpcz_store.cc:276] 0709 13:14:44.367038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:44.367199 (+   161us) service_pool.cc:224] Handling call
0709 13:14:44.590770 (+223571us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b5800002d98. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f1522549b71 00007f1522549a22 00007f152b462c09 00007f152a5bcee0 00007f152a6860ab 00007f152a686131 00007f152a647fc0 00007f152a632929 00007f152a6323d2 00007f1523ba9bd4
0709 13:14:44.591013 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:44.994215 (+403202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:45.702196 (+707981us) spinlock_profiling.cc:243] Waited 400 ms on lock 0x7b540013a1d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:14:45.702425 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":925378048}
W20260709 13:14:45.697382  5676 consensus_meta.cc:287] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 1.122s	user 0.009s	sys 0.004s
I20260709 13:14:45.715763  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:45.718879  4031 raft_consensus.cc:3060] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:45.720750  5701 leader_election.cc:290] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:45.707561  5496 raft_consensus.cc:493] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:45.722123  3954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1503) took 1102 ms. Trace:
I20260709 13:14:45.722066  5496 raft_consensus.cc:515] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:45.722705  3954 rpcz_store.cc:276] 0709 13:14:44.620062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:45.020499 (+400437us) service_pool.cc:224] Handling call
0709 13:14:45.020869 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:45.593950 (+573081us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:45.721820 (+127870us) spinlock_profiling.cc:243] Waited 506 ms on lock 0x7b5400429854. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:14:45.722050 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1164758400}
I20260709 13:14:45.724109  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:45.686161  5657 leader_election.cc:290] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:45.707695  5699 leader_election.cc:290] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:45.729290  5699 raft_consensus.cc:2804] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:45.729686  5699 raft_consensus.cc:493] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:45.727825  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:14:45.730495  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:45.695510  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:14:45.717097  5582 consensus_meta.cc:287] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.915s	user 0.013s	sys 0.001s
I20260709 13:14:45.677981  5704 raft_consensus.cc:515] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:45.732173  5699 raft_consensus.cc:3060] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:45.718080  5675 raft_consensus.cc:740] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:45.725342  5662 leader_election.cc:290] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:45.727435  5676 raft_consensus.cc:515] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:45.770853  3955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38606 (request call id 1486) took 1344 ms. Trace:
I20260709 13:14:45.748576  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:14:45.750579  4675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:45.758282  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:45.752228  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:45.777113  3959 raft_consensus.cc:2393] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 5: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:14:45.777266  3957 raft_consensus.cc:2468] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 3.
I20260709 13:14:45.756652  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:45.778929  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:45.779464  3950 raft_consensus.cc:2368] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 for earlier term 2. Current term is 3.
I20260709 13:14:45.780249  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:45.781136  3957 raft_consensus.cc:2368] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 for earlier term 2. Current term is 3.
I20260709 13:14:45.781605  4103 raft_consensus.cc:2393] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 4: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:45.775588  3955 rpcz_store.cc:276] 0709 13:14:44.426564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:44.427844 (+  1280us) service_pool.cc:224] Handling call
0709 13:14:45.770571 (+1342727us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54003cd054. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:14:45.770768 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2497485568}
I20260709 13:14:45.782610  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:45.783571  4103 raft_consensus.cc:2368] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 3. Current term is 4.
I20260709 13:14:45.784478  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:45.787966  4103 raft_consensus.cc:2393] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 3: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:14:45.793241  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:14:45.751293  5538 consensus_meta.cc:287] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 0.669s	user 0.008s	sys 0.000s
I20260709 13:14:45.748929  5711 raft_consensus.cc:515] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:45.802939  5538 raft_consensus.cc:515] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:45.801844  4707 raft_consensus.cc:1240] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:45.768851  5536 raft_consensus.cc:493] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.805795  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:45.804584  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:45.810878  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:45.811404  3950 raft_consensus.cc:2468] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 3.
I20260709 13:14:45.811702  3955 raft_consensus.cc:2368] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 for earlier term 2. Current term is 3.
I20260709 13:14:45.739961  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:45.780967  5493 raft_consensus.cc:493] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:45.766729  5340 raft_consensus.cc:2804] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:45.753043  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:14:45.808604  5709 log.cc:927] Time spent T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.675s	user 0.005s	sys 0.000s
I20260709 13:14:45.808770  5711 leader_election.cc:290] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:45.808801  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:45.742755  5496 leader_election.cc:290] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:45.737015  5455 leader_election.cc:290] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:45.899606  5597 consensus_meta.cc:287] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.515s	user 0.008s	sys 0.004s
I20260709 13:14:45.914702  4107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45336 (request call id 953) took 1224 ms. Trace:
I20260709 13:14:45.915222  4107 rpcz_store.cc:276] 0709 13:14:44.690162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:44.690355 (+   193us) service_pool.cc:224] Handling call
0709 13:14:45.914441 (+1224086us) spinlock_profiling.cc:243] Waited 855 ms on lock 0x7b540042efd4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:14:45.914624 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1967576448}
I20260709 13:14:45.916594  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:45.791100  5582 raft_consensus.cc:515] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:45.918712  4028 raft_consensus.cc:2468] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 5.
I20260709 13:14:45.919319  4107 raft_consensus.cc:2368] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 for earlier term 2. Current term is 3.
I20260709 13:14:45.888283  5340 raft_consensus.cc:493] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:14:45.920367  5340 raft_consensus.cc:3060] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:45.920454  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:45.921183  4107 raft_consensus.cc:1813] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Handling vote request from an unknown peer f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:45.921823  4107 raft_consensus.cc:2410] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:14:45.922708  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:45.923722  4107 raft_consensus.cc:2393] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 3: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:45.924688  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:45.883160  5688 raft_consensus.cc:3055] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:45.926201  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:45.927237  4107 raft_consensus.cc:2393] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 3: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:45.771576  5581 raft_consensus.cc:515] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:45.924747  5704 leader_election.cc:290] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:45.945708  4103 raft_consensus.cc:2368] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 2. Current term is 3.
I20260709 13:14:45.736969  3952 raft_consensus.cc:2468] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
W20260709 13:14:44.461393  5647 consensus_queue.cc:1175] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" responder_term: 3 status { last_received { term: 3 index: 2 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:14:45.883364  5493 raft_consensus.cc:515] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:45.950502  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:45.904014  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:45.954682  4105 raft_consensus.cc:2393] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 2: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:14:45.903118  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:45.956686  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:45.957471  3955 raft_consensus.cc:2468] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 3.
I20260709 13:14:45.958528  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:45.928504  5597 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:45.962983  5597 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Requested vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:45.966723  5493 leader_election.cc:290] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:45.968042  3959 raft_consensus.cc:2468] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 3.
I20260709 13:14:45.959254  3955 raft_consensus.cc:2468] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 2.
I20260709 13:14:45.905203  4102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34656 (request call id 129) took 1629 ms. Trace:
I20260709 13:14:45.883442  5538 leader_election.cc:290] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:45.910751  3953 raft_consensus.cc:2468] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 3.
I20260709 13:14:45.975976  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:45.976656  5582 leader_election.cc:290] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:45.911026  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:45.912415  5587 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:45.977685  4099 raft_consensus.cc:2393] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 4: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:45.977583  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:45.978605  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:45.978945  5587 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:45.913024  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:45.979421  4099 raft_consensus.cc:2368] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 3. Current term is 4.
I20260709 13:14:45.979995  4108 raft_consensus.cc:2393] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 3: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:45.980558  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:45.980743  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:45.981292  4099 raft_consensus.cc:2393] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 4: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:45.981755  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:45.982445  4108 raft_consensus.cc:2393] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 3: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:45.976727  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:45.978557  3959 raft_consensus.cc:2468] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 2.
I20260709 13:14:45.751788  5592 raft_consensus.cc:493] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.980736  5340 raft_consensus.cc:515] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:45.815063  5699 raft_consensus.cc:515] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:45.967965  3954 raft_consensus.cc:2368] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 3. Current term is 4.
I20260709 13:14:45.988588  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:45.903359  5661 raft_consensus.cc:3055] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:45.989310  5661 raft_consensus.cc:740] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:14:45.989655  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:45.951524  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:45.949282  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:45.991637  3957 raft_consensus.cc:2376] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d709ee666b774ec29aa732e508219938 in term 3. Re-sending same reply.
I20260709 13:14:45.950527  5688 raft_consensus.cc:740] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:45.925294  5675 consensus_queue.cc:260] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:45.813730  4031 raft_consensus.cc:2468] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 4.
I20260709 13:14:45.970431  4102 rpcz_store.cc:276] 0709 13:14:44.275683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:44.276450 (+   767us) service_pool.cc:224] Handling call
0709 13:14:44.276721 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:45.603265 (+1326544us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:45.904944 (+301679us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54000e7c54. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:14:45.905143 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3049427200}
I20260709 13:14:45.993736  4102 raft_consensus.cc:1240] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:45.998802  4102 raft_consensus.cc:1240] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:46.001163  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:46.002094  3955 raft_consensus.cc:2468] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 3.
I20260709 13:14:46.008486  4025 raft_consensus.cc:2468] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 4.
I20260709 13:14:46.032135  5676 leader_election.cc:290] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:14:46.032519  5717 consensus_meta.cc:287] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 0.701s	user 0.009s	sys 0.003s
I20260709 13:14:45.990490  5661 consensus_queue.cc:260] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:46.033667  5661 raft_consensus.cc:3060] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:45.989487  3954 raft_consensus.cc:2393] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 3: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:14:46.036773  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:46.038311  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:45.892737  5536 raft_consensus.cc:515] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:46.041647  5536 leader_election.cc:290] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:46.043682  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:14:46.027025  5700 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.857s	user 0.039s	sys 0.052s
I20260709 13:14:46.012228  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:46.050956  3959 raft_consensus.cc:3060] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:46.053434  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:45.997037  5592 raft_consensus.cc:515] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:46.019966  5548 consensus_meta.cc:287] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938: Time spent flushing consensus metadata: real 0.633s	user 0.011s	sys 0.000s
I20260709 13:14:46.020897  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:46.021507  5675 raft_consensus.cc:3060] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:46.022313  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:46.066612  3957 raft_consensus.cc:3060] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:46.023231  5699 leader_election.cc:290] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:46.023741  4032 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.786s	user 0.042s	sys 0.086s
I20260709 13:14:46.026124  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:45.990501  5581 leader_election.cc:290] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:46.018437  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:14:46.078665  3923 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.044s	sys 0.045s
I20260709 13:14:46.000666  3953 raft_consensus.cc:2468] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 2.
W20260709 13:14:46.052209  5700 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.881s	user 0.040s	sys 0.052s
I20260709 13:14:46.056483  5493 raft_consensus.cc:493] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:46.026889  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:46.059089  3924 leader_election.cc:304] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:46.062317  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:45.988657  5340 leader_election.cc:290] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 election: Requested vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:46.062917  4672 leader_election.cc:400] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 election: Vote denied by peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843) with higher term. Message: Invalid argument: T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 for earlier term 2. Current term is 3.
I20260709 13:14:46.057443  5403 leader_election.cc:290] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:46.060906  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:46.075306  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:46.075837  3955 raft_consensus.cc:2468] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
W20260709 13:14:46.076280  4032 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.838s	user 0.042s	sys 0.086s
W20260709 13:14:46.079062  4030 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.842s	user 0.054s	sys 0.056s
W20260709 13:14:46.081723  3923 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.045s	sys 0.045s
I20260709 13:14:46.066655  5548 raft_consensus.cc:2749] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843) with higher term. Message: Invalid argument: T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 for earlier term 2. Current term is 3.
I20260709 13:14:46.069746  5551 leader_election.cc:290] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: Requested vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:46.088567  4672 leader_election.cc:403] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:14:46.093618  3950 raft_consensus.cc:2393] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 4: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:14:46.033423  5717 raft_consensus.cc:515] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:46.116917  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 54199us
W20260709 13:14:46.092327  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:46.107373  3957 raft_consensus.cc:2468] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 4.
I20260709 13:14:46.029246  4102 raft_consensus.cc:1275] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:46.093336  5718 raft_consensus.cc:2764] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:14:46.119946  5592 leader_election.cc:290] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:14:46.120606  5528 consensus_meta.cc:287] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 1.062s	user 0.009s	sys 0.003s
W20260709 13:14:46.125777  4030 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.889s	user 0.058s	sys 0.057s
I20260709 13:14:46.090699  4105 raft_consensus.cc:2393] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 4: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:46.128232  3950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38612 (request call id 902) took 1062 ms. Trace:
I20260709 13:14:46.066284  5648 consensus_queue.cc:1059] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:14:46.131503  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:46.182196  3950 rpcz_store.cc:276] 0709 13:14:45.066289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.057928 (+991639us) service_pool.cc:224] Handling call
0709 13:14:46.128157 (+ 70229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:46.184083  3950 raft_consensus.cc:1275] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:46.184764  3950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38612 (request call id 901) took 1118 ms. Trace:
I20260709 13:14:46.185168  3950 rpcz_store.cc:276] 0709 13:14:45.065954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.183281 (+1117327us) service_pool.cc:224] Handling call
0709 13:14:46.183724 (+   443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:46.184518 (+   794us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:46.184705 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:46.186839  3950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38612 (request call id 903) took 1120 ms. Trace:
I20260709 13:14:46.187247  3950 rpcz_store.cc:276] 0709 13:14:45.066634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.185980 (+1119346us) service_pool.cc:224] Handling call
0709 13:14:46.186323 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:46.186515 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:46.186546 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:46.186595 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:46.186628 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:46.186687 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:46.186787 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:46.135856  4707 raft_consensus.cc:1275] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:46.189064  3950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38612 (request call id 905) took 1121 ms. Trace:
I20260709 13:14:46.189476  3950 rpcz_store.cc:276] 0709 13:14:45.067351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.188304 (+1120953us) service_pool.cc:224] Handling call
0709 13:14:46.188628 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:46.188793 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:46.188815 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:46.188857 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:46.188885 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:46.188932 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:46.189021 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:46.166648  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:46.197386  4675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:46.115147  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:46.133620  5455 raft_consensus.cc:493] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.090479  4703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:46.225106  5403 raft_consensus.cc:493] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.213743  5592 raft_consensus.cc:493] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
W20260709 13:14:46.239346  4675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:46.189198  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:46.124382  5496 raft_consensus.cc:2749] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843) with higher term. Message: Invalid argument: T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 for earlier term 2. Current term is 3.
I20260709 13:14:46.213706  3954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35354 (request call id 103) took 1122 ms. Trace:
I20260709 13:14:46.093144  5493 raft_consensus.cc:515] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:46.225747  5716 consensus_queue.cc:260] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:46.116070  5688 consensus_queue.cc:260] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:46.255241  5688 raft_consensus.cc:3060] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:46.257318  5493 leader_election.cc:290] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:46.134006  5528 raft_consensus.cc:515] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:46.262480  5725 log.cc:927] Time spent T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:14:46.247578  5648 raft_consensus.cc:3055] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:46.241676  5455 raft_consensus.cc:515] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:46.132007  5662 consensus_queue.cc:1059] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.127s
I20260709 13:14:46.252063  3954 rpcz_store.cc:276] 0709 13:14:45.071364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.039387 (+968023us) service_pool.cc:224] Handling call
0709 13:14:46.193943 (+154556us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:46.276276  3954 raft_consensus.cc:1240] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:46.277064  5503 leader_election.cc:290] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:46.276969  3954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35354 (request call id 98) took 1207 ms. Trace:
I20260709 13:14:46.283578  3950 raft_consensus.cc:1275] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:46.284556  3954 rpcz_store.cc:276] 0709 13:14:45.069207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.275684 (+1206477us) service_pool.cc:224] Handling call
0709 13:14:46.276072 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:46.276692 (+   620us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:46.276908 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:46.285770  5528 leader_election.cc:290] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:46.286368  3954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35354 (request call id 107) took 1213 ms. Trace:
I20260709 13:14:46.286891  3954 rpcz_store.cc:276] 0709 13:14:45.072775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.285535 (+1212760us) service_pool.cc:224] Handling call
0709 13:14:46.285868 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:46.286043 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:46.286069 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:46.286121 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:46.286152 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:46.286204 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:46.286312 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:46.286383  5718 consensus_queue.cc:1048] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:46.246438  5403 raft_consensus.cc:515] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:46.246213  5592 raft_consensus.cc:515] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:46.290836  3952 raft_consensus.cc:1240] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:14:46.272971  5648 raft_consensus.cc:740] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:14:46.278486  3959 raft_consensus.cc:2468] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 4.
I20260709 13:14:46.156970  5708 consensus_queue.cc:1059] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.135s
W20260709 13:14:46.301826  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:46.287165  3950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38612 (request call id 906) took 1219 ms. Trace:
I20260709 13:14:46.320322  3950 rpcz_store.cc:276] 0709 13:14:45.067718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.190376 (+1122658us) service_pool.cc:224] Handling call
0709 13:14:46.283249 (+ 92873us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:46.284129 (+   880us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:46.287107 (+  2978us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:46.293121  4103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45332 (request call id 1418) took 1026 ms. Trace:
I20260709 13:14:46.322942  4103 rpcz_store.cc:276] 0709 13:14:45.266560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:45.792955 (+526395us) service_pool.cc:224] Handling call
0709 13:14:46.292891 (+499936us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54003aaf54. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:14:46.293046 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":348319104}
I20260709 13:14:46.314245  3924 leader_election.cc:304] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:46.328570  4074 leader_election.cc:304] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
W20260709 13:14:46.329574  3925 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.039s	user 0.015s	sys 0.054s
W20260709 13:14:46.329993  3925 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.040s	user 0.015s	sys 0.054s
W20260709 13:14:46.349969  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:46.351326  4074 leader_election.cc:304] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
W20260709 13:14:46.330348  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 1.04049e+06us
W20260709 13:14:46.360227  3922 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.058s	user 0.022s	sys 0.049s
W20260709 13:14:46.360687  3922 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.059s	user 0.022s	sys 0.049s
I20260709 13:14:46.338028  5719 raft_consensus.cc:2804] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:46.338835  5455 leader_election.cc:290] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:46.156555  5734 consensus_queue.cc:1059] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.236s
I20260709 13:14:46.358752  5301 raft_consensus.cc:2749] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:14:46.337814  5581 raft_consensus.cc:493] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:46.363828  3952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38612 (request call id 907) took 1294 ms. Trace:
I20260709 13:14:46.367800  5403 leader_election.cc:290] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:14:46.384660  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 1.0893e+06us
I20260709 13:14:46.380697  5719 raft_consensus.cc:697] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 3 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:46.379765  5648 consensus_queue.cc:260] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:14:46.411868  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 60625.3us
I20260709 13:14:46.412971  4074 leader_election.cc:304] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:14:46.427820  5711 raft_consensus.cc:2804] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:46.428381  5711 raft_consensus.cc:493] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:46.428431  4104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45336 (request call id 954) took 1737 ms. Trace:
I20260709 13:14:46.428843  5711 raft_consensus.cc:3060] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:46.429107  4104 rpcz_store.cc:276] 0709 13:14:44.690550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:44.690719 (+   169us) service_pool.cc:224] Handling call
0709 13:14:46.428125 (+1737406us) spinlock_profiling.cc:243] Waited 880 ms on lock 0x7b54000e8654. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:14:46.428341 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2024207616}
I20260709 13:14:46.409651  4026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41312 (request call id 94) took 2822 ms. Trace:
I20260709 13:14:46.438005  4026 rpcz_store.cc:276] 0709 13:14:43.587727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:44.219701 (+631974us) service_pool.cc:224] Handling call
0709 13:14:44.220038 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:45.550347 (+1330309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:46.409274 (+858927us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b540026d4d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:14:46.409560 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3052306176}
I20260709 13:14:46.442234  4074 leader_election.cc:304] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:46.391639  5717 leader_election.cc:290] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:46.385226  5581 raft_consensus.cc:515] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:46.452696  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:46.459317  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
W20260709 13:14:46.446652  5674 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.014s	user 0.019s	sys 0.036s
I20260709 13:14:46.466404  4104 raft_consensus.cc:1240] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 13:14:46.431903  5474 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.092s	user 0.008s	sys 0.038s
I20260709 13:14:46.443074  5648 raft_consensus.cc:3060] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:46.469812  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:46.470904  4102 raft_consensus.cc:2393] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 4: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:46.386451  3952 rpcz_store.cc:276] 0709 13:14:45.068041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.223195 (+1155154us) service_pool.cc:224] Handling call
0709 13:14:46.274194 (+ 50999us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:46.319523 (+ 45329us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:46.362519 (+ 42996us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:46.472820  4071 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.078s	user 0.016s	sys 0.081s
W20260709 13:14:46.562163  4071 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.167s	user 0.021s	sys 0.086s
W20260709 13:14:46.562984  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 1.17377e+06us
W20260709 13:14:46.507432  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:46.450268  5301 raft_consensus.cc:2749] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:14:46.461100  5403 raft_consensus.cc:2804] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:14:46.479930  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:46.470100  5674 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.045s	user 0.020s	sys 0.037s
I20260709 13:14:46.646844  3957 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0"
dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
mode: GRACEFUL
new_leader_uuid: "d709ee666b774ec29aa732e508219938"
 from {username='slave'} at 127.0.0.1:35222
I20260709 13:14:46.457078  5455 raft_consensus.cc:493] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
W20260709 13:14:46.472580  5474 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.133s	user 0.009s	sys 0.038s
W20260709 13:14:46.649871  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:46.654678  3957 raft_consensus.cc:606] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Received request to transfer leadership to TS d709ee666b774ec29aa732e508219938
I20260709 13:14:46.663910  3957 raft_consensus.cc:614] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:14:46.608050  5630 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.141s	user 0.003s	sys 0.015s
I20260709 13:14:46.687603  4071 leader_election.cc:304] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:46.691378  4071 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:14:46.655896  5717 raft_consensus.cc:493] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:14:46.648994  5403 raft_consensus.cc:493] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:46.654284  5674 raft_consensus.cc:697] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:46.662367  5301 raft_consensus.cc:493] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
W20260709 13:14:46.683599  5630 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.222s	user 0.004s	sys 0.015s
I20260709 13:14:46.664044  5676 raft_consensus.cc:493] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:46.723181  4675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:46.667341  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
W20260709 13:14:46.693231  5664 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.247s	user 0.012s	sys 0.020s
I20260709 13:14:46.681560  5738 raft_consensus.cc:493] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.676052  5689 raft_consensus.cc:493] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:46.721936  5403 raft_consensus.cc:3060] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:14:46.731359  5664 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.293s	user 0.013s	sys 0.020s
I20260709 13:14:46.727864  4105 raft_consensus.cc:2393] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 5: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:46.667702  5455 raft_consensus.cc:515] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:46.744766  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:46.731034  5676 raft_consensus.cc:515] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:46.726470  5630 raft_consensus.cc:697] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:46.720187  5717 raft_consensus.cc:515] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:46.730527  5301 raft_consensus.cc:515] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:46.694033  5719 consensus_queue.cc:237] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:14:46.759681  4675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:46.789028  3997 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.224s	user 0.012s	sys 0.032s
W20260709 13:14:46.835726  3997 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.274s	user 0.014s	sys 0.034s
W20260709 13:14:46.838506  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 1.27742e+06us
I20260709 13:14:46.738364  5592 leader_election.cc:290] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:14:46.737004  5498 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.192s	user 0.016s	sys 0.019s
W20260709 13:14:46.737763  5501 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.226s	user 0.013s	sys 0.039s
W20260709 13:14:46.789350  5583 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.263s	user 0.007s	sys 0.036s
W20260709 13:14:46.788848  5652 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.219s	user 0.016s	sys 0.028s
I20260709 13:14:46.851974  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:14:46.755155  5661 consensus_meta.cc:287] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938: Time spent flushing consensus metadata: real 0.721s	user 0.015s	sys 0.000s
I20260709 13:14:46.854879  5731 raft_consensus.cc:493] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.855481  5730 raft_consensus.cc:493] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
W20260709 13:14:46.832566  5489 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.150s	user 0.021s	sys 0.033s
I20260709 13:14:46.748852  5675 raft_consensus.cc:2804] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:46.753702  5737 raft_consensus.cc:493] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.860373  4704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:46.738771  5689 raft_consensus.cc:515] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:46.917078  5496 raft_consensus.cc:3055] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:46.917701  5496 raft_consensus.cc:740] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:14:46.917848  5689 leader_election.cc:290] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:46.832273  5740 raft_consensus.cc:493] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:46.862893  5501 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.357s	user 0.014s	sys 0.039s
W20260709 13:14:46.866533  5583 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.346s	user 0.011s	sys 0.036s
I20260709 13:14:46.767506  5550 raft_consensus.cc:493] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:46.838861  5581 leader_election.cc:290] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:14:46.864212  5498 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.324s	user 0.016s	sys 0.019s
W20260709 13:14:46.868050  5652 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.298s	user 0.018s	sys 0.030s
I20260709 13:14:46.739667  5738 raft_consensus.cc:515] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:46.866333  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:46.915032  5546 leader_election.cc:290] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:46.870654  5710 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.232s	user 0.002s	sys 0.025s
W20260709 13:14:46.887279  5489 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.201s	user 0.021s	sys 0.033s
I20260709 13:14:46.889010  5675 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:46.884595  5731 raft_consensus.cc:515] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:46.934775  5550 raft_consensus.cc:515] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:47.028029  5710 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.615s	user 0.004s	sys 0.025s
W20260709 13:14:46.935498  5641 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.988s	user 0.003s	sys 0.070s
I20260709 13:14:46.887027  5730 raft_consensus.cc:515] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:46.781654  5674 consensus_queue.cc:237] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:46.919934  5711 raft_consensus.cc:515] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:47.034169  5641 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.089s	user 0.003s	sys 0.070s
I20260709 13:14:47.025295  5597 raft_consensus.cc:3055] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:47.032863  5675 raft_consensus.cc:3060] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:46.923256  5740 raft_consensus.cc:515] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:47.048765  5455 leader_election.cc:290] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:47.053745  5597 raft_consensus.cc:740] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:46.934933  5737 raft_consensus.cc:515] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:46.955017  5496 consensus_queue.cc:260] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:47.084769  5716 raft_consensus.cc:3060] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:14:47.093057  5736 log.cc:927] Time spent T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.202s	user 0.000s	sys 0.000s
I20260709 13:14:47.095132  5740 leader_election.cc:290] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:47.096195  5597 consensus_queue.cc:260] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:47.097728  5597 raft_consensus.cc:3060] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:47.112826  5711 leader_election.cc:290] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:47.118614  5737 leader_election.cc:290] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:47.120635  5730 leader_election.cc:290] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:47.122470  5731 leader_election.cc:290] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:47.033547  5630 consensus_queue.cc:237] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:47.132720  5738 leader_election.cc:290] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:47.068542  5676 leader_election.cc:290] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:14:47.137020  5728 log.cc:927] Time spent T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.479s	user 0.010s	sys 0.003s
I20260709 13:14:47.137735  5717 leader_election.cc:290] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:14:47.140043  5688 consensus_meta.cc:287] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.884s	user 0.008s	sys 0.006s
W20260709 13:14:47.141258  5648 consensus_meta.cc:287] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938: Time spent flushing consensus metadata: real 0.582s	user 0.004s	sys 0.008s
W20260709 13:14:47.202940  3954 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.906s	user 0.058s	sys 0.085s
W20260709 13:14:47.204298  3954 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.908s	user 0.059s	sys 0.085s
W20260709 13:14:47.205255  3953 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.938s	user 0.008s	sys 0.000s
W20260709 13:14:47.206045  3953 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.944s	user 0.008s	sys 0.000s
W20260709 13:14:47.207000  3958 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.858s	user 0.004s	sys 0.023s
W20260709 13:14:47.207620  3958 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.859s	user 0.004s	sys 0.024s
W20260709 13:14:47.209756  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:47.212782  3955 raft_consensus.cc:1240] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 3 LEADER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:14:47.214128  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:47.214318  3956 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.127s	user 0.005s	sys 0.033s
W20260709 13:14:47.214854  3956 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.127s	user 0.005s	sys 0.033s
W20260709 13:14:47.214921  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:47.216590  3958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1500) took 2628 ms. Trace:
W20260709 13:14:47.212989  3998 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.499s	user 0.024s	sys 0.038s
I20260709 13:14:47.217310  3958 rpcz_store.cc:276] 0709 13:14:44.588300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:44.865042 (+276742us) service_pool.cc:224] Handling call
0709 13:14:44.883398 (+ 18356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:44.883631 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:14:45.137759 (+254128us) log.cc:844] Serialized 14 byte log entry
0709 13:14:47.208393 (+2070634us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:47.215714 (+  7321us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:14:47.215854 (+   140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:47.215988 (+   134us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:47.216398 (+   410us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78522,"prepare.queue_time_us":111439,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":61,"raft.queue_time_us":222174,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":29120,"thread_start_us":2312122,"threads_started":3,"wal-append.queue_time_us":928634}
W20260709 13:14:47.220093  3998 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.506s	user 0.024s	sys 0.038s
W20260709 13:14:47.220754  4101 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.135s	user 0.003s	sys 0.025s
W20260709 13:14:47.221290  4101 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.136s	user 0.003s	sys 0.025s
W20260709 13:14:47.235651  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:47.222183  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 369692us
W20260709 13:14:47.288760  4108 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.246s	user 0.042s	sys 0.028s
W20260709 13:14:47.289486  4108 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.260s	user 0.043s	sys 0.028s
I20260709 13:14:47.290859  5550 leader_election.cc:290] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:47.292807  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
W20260709 13:14:47.304687  4675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:47.305572  4675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:47.305970  4675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:47.306470  4675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:47.308476  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:47.308991  4026 raft_consensus.cc:2393] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 3: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
W20260709 13:14:47.309312  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:47.310649  5688 raft_consensus.cc:493] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:47.311474  4672 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.150s	user 0.017s	sys 0.021s
W20260709 13:14:47.312096  4672 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.188s	user 0.017s	sys 0.021s
W20260709 13:14:47.312855  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 1.18872e+06us
W20260709 13:14:47.310947  4030 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.032s	user 0.014s	sys 0.003s
W20260709 13:14:47.313903  4030 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.071s	user 0.015s	sys 0.003s
W20260709 13:14:47.315665  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:47.315868  5496 raft_consensus.cc:3060] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:47.315727  5738 raft_consensus.cc:493] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:47.317510  5738 raft_consensus.cc:515] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:47.311944  5688 raft_consensus.cc:515] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:47.319631  4032 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.102s	user 0.007s	sys 0.011s
W20260709 13:14:47.320127  4032 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.199s	user 0.007s	sys 0.011s
I20260709 13:14:47.322079  5738 leader_election.cc:290] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:47.321813  5717 consensus_queue.cc:1059] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:47.322525  5688 leader_election.cc:290] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:47.323258  5717 raft_consensus.cc:3055] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:47.323861  5717 raft_consensus.cc:740] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
W20260709 13:14:47.346238  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:47.352413  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
W20260709 13:14:47.353200  4708 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.811s	user 0.009s	sys 0.008s
I20260709 13:14:47.366408  5648 raft_consensus.cc:493] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:47.366726  5717 consensus_queue.cc:260] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:47.367645  5648 raft_consensus.cc:515] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:47.368887  5717 raft_consensus.cc:3060] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:47.369804  5301 leader_election.cc:290] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:47.372175  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:47.372457  5675 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:47.374116  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:47.374382  4105 raft_consensus.cc:2368] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 3. Current term is 4.
I20260709 13:14:47.382416  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:47.383951  4028 raft_consensus.cc:2393] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 4: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:14:47.385330  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:47.388340  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:47.389394  4027 raft_consensus.cc:3060] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:47.392987  4033 raft_consensus.cc:1240] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:47.375268  4026 raft_consensus.cc:2468] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 2.
W20260709 13:14:47.411144  4708 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.939s	user 0.010s	sys 0.009s
I20260709 13:14:47.406560  4031 raft_consensus.cc:1240] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:14:47.387084  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:47.379086  3997 leader_election.cc:304] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
W20260709 13:14:47.405259  3924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:47.408406  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:47.438445  4709 raft_consensus.cc:2468] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 3.
W20260709 13:14:47.438838  3951 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38606 (request call id 1477) took 3087 ms (client timeout 1909 ms). Trace:
W20260709 13:14:47.439443  3951 rpcz_store.cc:269] 0709 13:14:44.351102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:44.357874 (+  6772us) service_pool.cc:224] Handling call
0709 13:14:44.776582 (+418708us) spinlock_profiling.cc:243] Waited 2.38 ms on lock 0x7b5800002d98. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f1522549b71 00007f1522549eee 0000000000375939 00007f152a5bd1e0 00007f152a6860c4 00007f152a686131 00007f152a6340a0 00007f152a633984 00007f1523bae6d4 00007f1523bae662
0709 13:14:47.438278 (+2661696us) spinlock_profiling.cc:243] Waited 2.43 s on lock 0x7b54001680d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:14:47.438555 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5603436672}
I20260709 13:14:47.404136  5493 raft_consensus.cc:3055] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:14:47.396165  4672 connection.cc:256] RPC call timeout handler was delayed by -1.1073077280000234s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2149s for a response
I20260709 13:14:47.396293  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:47.410451  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:14:47.477398  4672 connection.cc:256] RPC call timeout handler was delayed by -1.0524077279999347s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.221s for a response
I20260709 13:14:47.426054  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:47.455456  5493 raft_consensus.cc:740] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:14:47.498970  4028 raft_consensus.cc:2410] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:14:47.500617  4025 raft_consensus.cc:2393] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 5: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:14:47.528236  4029 raft_consensus.cc:3060] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:14:47.524060  4707 raft_consensus.cc:2468] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 3.
I20260709 13:14:47.536798  4034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38290 (request call id 1427) took 4053 ms. Trace:
I20260709 13:14:47.540345  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:47.516425  5301 raft_consensus.cc:493] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.552400  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:14:47.554540  5503 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.172s	user 0.039s	sys 0.095s
I20260709 13:14:47.554800  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:14:47.555516  4107 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.816s	user 0.006s	sys 0.022s
I20260709 13:14:47.555927  4104 raft_consensus.cc:2468] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 2.
I20260709 13:14:47.556114  3955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38612 (request call id 898) took 2491 ms. Trace:
I20260709 13:14:47.556828  3955 rpcz_store.cc:276] 0709 13:14:45.065015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.091595 (+1026580us) service_pool.cc:224] Handling call
0709 13:14:46.091900 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:47.213749 (+1121849us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:47.538903 (+325154us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54000be5d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:14:47.555952 (+ 17049us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2575536512}
W20260709 13:14:47.555183  5503 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.242s	user 0.040s	sys 0.095s
W20260709 13:14:47.556013  4107 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.873s	user 0.007s	sys 0.022s
W20260709 13:14:47.540022  4672 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.198.193:35339 timed out after 2.020s (SENT) [suppressed 25 similar messages]
I20260709 13:14:47.545924  4709 raft_consensus.cc:2468] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
W20260709 13:14:47.573216  4071 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.807s	user 0.020s	sys 0.010s
W20260709 13:14:47.573777  4071 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.881s	user 0.020s	sys 0.011s
I20260709 13:14:47.537314  4034 rpcz_store.cc:276] 0709 13:14:43.483395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:44.212697 (+729302us) service_pool.cc:224] Handling call
0709 13:14:44.220856 (+  8159us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:46.856491 (+2635635us) spinlock_profiling.cc:243] Waited 534 ms on lock 0x7b54001d4820. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15255e5dc0 00007f15256701c0 00007f1525671231 00007f152566dd8f 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c
0709 13:14:46.856828 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:14:46.856856 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:46.856895 (+    39us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:14:46.856926 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:47.494287 (+637361us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54003b1854. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:14:47.499644 (+  5357us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:47.536558 (+ 36914us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9233,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":15900,"spinlock_wait_cycles":3971455744}
W20260709 13:14:47.575165  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 883818us
I20260709 13:14:47.575291  4102 raft_consensus.cc:1240] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:47.540483  5696 raft_consensus.cc:493] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:47.613602  3922 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.851s	user 0.014s	sys 0.040s
W20260709 13:14:47.620111  3922 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.951s	user 0.015s	sys 0.040s
I20260709 13:14:47.621618  5696 raft_consensus.cc:515] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:47.624356  5696 leader_election.cc:290] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:47.629726  4032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38290 (request call id 1445) took 2399 ms. Trace:
I20260709 13:14:47.630522  4032 rpcz_store.cc:276] 0709 13:14:45.230538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:45.237221 (+  6683us) service_pool.cc:224] Handling call
0709 13:14:45.237597 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:46.092724 (+855127us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:46.092757 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:46.121009 (+ 28252us) log.cc:844] Serialized 26 byte log entry
0709 13:14:47.320845 (+1199836us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:14:47.320946 (+   101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:47.321063 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:47.629276 (+308213us) raft_consensus.cc:1685] finished
0709 13:14:47.629314 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:47.629632 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":157573,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":27550,"thread_start_us":2053755,"threads_started":2,"wal-append.queue_time_us":1470700}
I20260709 13:14:47.632251  5750 raft_consensus.cc:2749] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:47.633113  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:47.633543  3954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35354 (request call id 112) took 2407 ms. Trace:
I20260709 13:14:47.634112  4700 raft_consensus.cc:2468] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 2.
I20260709 13:14:47.634239  3954 rpcz_store.cc:276] 0709 13:14:45.226384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.288129 (+1061745us) service_pool.cc:224] Handling call
0709 13:14:46.288449 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:46.289061 (+   612us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:46.289116 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:46.291025 (+  1909us) log.cc:844] Serialized 26 byte log entry
0709 13:14:47.205288 (+914263us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:47.518333 (+313045us) log.cc:844] Serialized 14 byte log entry
0709 13:14:47.540011 (+ 21678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:47.541315 (+  1304us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:47.633129 (+ 91814us) raft_consensus.cc:1685] finished
0709 13:14:47.633162 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:47.633442 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4288,"raft.queue_time_us":29033,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":110,"thread_start_us":1218037,"threads_started":2,"wal-append.queue_time_us":1279292}
W20260709 13:14:47.638190  5597 consensus_meta.cc:287] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.540s	user 0.008s	sys 0.010s
I20260709 13:14:47.643786  5301 raft_consensus.cc:515] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:47.646467  5301 leader_election.cc:290] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:14:47.656796  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:47.669062  4027 raft_consensus.cc:2468] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
W20260709 13:14:47.603833  5705 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.209s	user 0.032s	sys 0.055s
I20260709 13:14:47.599510  5675 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:14:47.700294  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 321549us
I20260709 13:14:47.707531  5550 raft_consensus.cc:493] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:47.713021  4099 raft_consensus.cc:1240] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 LEADER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:47.713471  5550 raft_consensus.cc:515] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:47.657922  5493 consensus_queue.cc:260] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:47.715011  5493 raft_consensus.cc:3060] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:14:47.715711  5719 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.018s	sys 0.003s
W20260709 13:14:47.727080  5719 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.870s	user 0.019s	sys 0.004s
W20260709 13:14:47.732707  4100 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.883s	user 0.023s	sys 0.028s
W20260709 13:14:47.733275  4100 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.942s	user 0.023s	sys 0.028s
W20260709 13:14:47.733487  5630 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.014s	sys 0.041s
W20260709 13:14:47.734802  5706 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.009s	sys 0.021s
W20260709 13:14:47.735417  5706 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.009s	sys 0.021s
I20260709 13:14:47.736395  3997 leader_election.cc:304] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
W20260709 13:14:47.736924  4073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 117310us
W20260709 13:14:47.737561  4101 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.013s	sys 0.049s
W20260709 13:14:47.737995  4101 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.013s	sys 0.049s
W20260709 13:14:47.670965  4706 consensus_meta.cc:287] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938: Time spent flushing consensus metadata: real 1.265s	user 0.017s	sys 0.004s
W20260709 13:14:47.727409  5705 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.455s	user 0.033s	sys 0.061s
W20260709 13:14:47.742868  3999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 143244us
I20260709 13:14:47.756634  5550 leader_election.cc:290] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:47.719811  5648 leader_election.cc:290] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:47.762499  4101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45336 (request call id 960) took 2218 ms. Trace:
I20260709 13:14:47.759267  4708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57680 (request call id 442) took 1341 ms. Trace:
I20260709 13:14:47.716460  5597 raft_consensus.cc:493] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
W20260709 13:14:47.773633  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:47.779464  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:47.766117  4708 rpcz_store.cc:276] 0709 13:14:46.403556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.427310 (+ 23754us) service_pool.cc:224] Handling call
0709 13:14:46.428367 (+  1057us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:46.440073 (+ 11706us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:46.440129 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:46.440761 (+   632us) log.cc:844] Serialized 26 byte log entry
0709 13:14:47.538499 (+1097738us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:47.568854 (+ 30355us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:47.582438 (+ 13584us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:47.722866 (+140428us) raft_consensus.cc:1685] finished
0709 13:14:47.722894 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:47.744287 (+ 21393us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11289,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":8614,"thread_start_us":955143,"threads_started":1,"wal-append.queue_time_us":1081407}
W20260709 13:14:47.784677  5743 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.011s	sys 0.022s
W20260709 13:14:47.785313  5743 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.011s	sys 0.023s
I20260709 13:14:47.785517  5550 raft_consensus.cc:2749] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:47.787693  4071 leader_election.cc:304] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:47.788722  5719 raft_consensus.cc:493] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.789501  5719 raft_consensus.cc:515] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:47.793756  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:47.794875  3951 raft_consensus.cc:2376] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 4. Re-sending same reply.
I20260709 13:14:47.795751  5741 raft_consensus.cc:493] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.796259  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:47.796645  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:47.797854  3950 raft_consensus.cc:2468] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 1.
I20260709 13:14:47.798239  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:47.799253  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:47.799831  5737 raft_consensus.cc:493] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:47.800165  3958 raft_consensus.cc:3060] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:47.800767  5737 raft_consensus.cc:515] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:47.804250  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:47.805529  3957 raft_consensus.cc:2393] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 4: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
W20260709 13:14:47.806164  5756 log.cc:927] Time spent T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:14:47.796838  5641 raft_consensus.cc:493] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:47.807435  5641 raft_consensus.cc:515] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:47.808955  5597 raft_consensus.cc:515] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:47.810340  3953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38612 (request call id 900) took 2744 ms. Trace:
I20260709 13:14:47.760843  5738 raft_consensus.cc:493] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.811416  5738 raft_consensus.cc:515] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:47.796669  5741 raft_consensus.cc:515] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:47.813943  3955 raft_consensus.cc:3060] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:47.813743  3999 leader_election.cc:304] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:47.829838  4029 raft_consensus.cc:2468] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
W20260709 13:14:47.836575  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:47.765415  4101 rpcz_store.cc:276] 0709 13:14:45.538599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.077143 (+538544us) service_pool.cc:224] Handling call
0709 13:14:46.077530 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:46.077784 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:14:47.222060 (+1144276us) log.cc:844] Serialized 14 byte log entry
0709 13:14:47.756380 (+534320us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:47.756490 (+   110us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:14:47.756632 (+   142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:47.756799 (+   167us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:47.757061 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":189,"prepare.queue_time_us":1524271,"prepare.run_cpu_time_us":296,"prepare.run_wall_time_us":54167,"raft.queue_time_us":6591,"thread_start_us":1651738,"threads_started":2}
I20260709 13:14:47.773191  4706 raft_consensus.cc:2468] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3.
W20260709 13:14:47.874814  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:47.883360  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:47.887814  3999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 127884us
I20260709 13:14:47.829171  5648 raft_consensus.cc:493] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.795751  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:47.893321  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:47.841416  5688 raft_consensus.cc:2749] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:14:47.898551  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:47.904760  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 371143us
I20260709 13:14:47.894063  4100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45332 (request call id 1427) took 1432 ms. Trace:
I20260709 13:14:47.923251  5719 leader_election.cc:290] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:47.914361  5750 raft_consensus.cc:2804] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:47.916357  4706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57680 (request call id 440) took 1814 ms. Trace:
I20260709 13:14:47.931806  5474 raft_consensus.cc:2749] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:14:47.934897  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 180555us
I20260709 13:14:47.932601  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:14:47.934324  3998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:47.929878  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:14:47.939105  5753 log.cc:927] Time spent T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.071s	user 0.001s	sys 0.001s
I20260709 13:14:47.810851  3953 rpcz_store.cc:276] 0709 13:14:45.065610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.115359 (+1049749us) service_pool.cc:224] Handling call
0709 13:14:46.118725 (+  3366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:46.119106 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:46.119138 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:46.189950 (+ 70812us) log.cc:844] Serialized 26 byte log entry
0709 13:14:47.207087 (+1017137us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:14:47.207233 (+   146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:47.207459 (+   226us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:47.809986 (+602527us) raft_consensus.cc:1685] finished
0709 13:14:47.810010 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:47.810267 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1431,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":135,"thread_start_us":947917,"threads_started":1,"wal-append.queue_time_us":1308453}
I20260709 13:14:47.941512  3952 raft_consensus.cc:2393] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 4: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:47.942440  5741 leader_election.cc:290] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:47.947391  5548 raft_consensus.cc:493] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:47.948098  5548 raft_consensus.cc:515] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:14:47.949599  5496 consensus_meta.cc:287] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938: Time spent flushing consensus metadata: real 0.633s	user 0.008s	sys 0.007s
I20260709 13:14:47.950700  5548 leader_election.cc:290] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:14:47.953322  5403 consensus_meta.cc:287] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 1.199s	user 0.010s	sys 0.014s
I20260709 13:14:47.953861  5403 raft_consensus.cc:515] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:47.955578  4103 raft_consensus.cc:2410] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:14:47.957213  4071 leader_election.cc:304] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:14:47.960160  4101 raft_consensus.cc:1240] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:47.960633  4106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45332 (request call id 1426) took 1508 ms. Trace:
I20260709 13:14:47.961886  5675 raft_consensus.cc:2804] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:47.961050  4106 rpcz_store.cc:276] 0709 13:14:46.452498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.453458 (+   960us) service_pool.cc:224] Handling call
0709 13:14:47.444815 (+991357us) spinlock_profiling.cc:243] Waited 3.31 ms on lock 0x7b5800011798. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f1522549b71 00007f1522549a22 00007f152b462c09 00007f152a5bcee0 00007f152a6860ab 00007f152a686131 00007f152a647fc0 00007f152a632929 00007f152a6323d2 00007f1523ba9bd4
0709 13:14:47.445467 (+   652us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:47.446119 (+   652us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:47.446156 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:47.447081 (+   925us) log.cc:844] Serialized 26 byte log entry
0709 13:14:47.778781 (+331700us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:14:47.778820 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:47.778894 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:47.960160 (+181266us) raft_consensus.cc:1685] finished
0709 13:14:47.960183 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:47.960422 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7624448,"thread_start_us":330872,"threads_started":1,"wal-append.queue_time_us":491146}
I20260709 13:14:47.962378  5675 raft_consensus.cc:493] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:14:47.962834  5675 raft_consensus.cc:3060] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:47.962906  4030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38290 (request call id 1444) took 2732 ms. Trace:
I20260709 13:14:47.964155  4672 leader_election.cc:400] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 election: Vote denied by peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339) with higher term. Message: Invalid argument: T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 for earlier term 2. Current term is 3.
I20260709 13:14:47.963393  4030 rpcz_store.cc:276] 0709 13:14:45.230193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:45.235684 (+  5491us) service_pool.cc:224] Handling call
0709 13:14:45.236129 (+   445us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:46.131170 (+895041us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:46.131225 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:46.165831 (+ 34606us) log.cc:844] Serialized 26 byte log entry
0709 13:14:47.314930 (+1149099us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:14:47.315064 (+   134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:47.315273 (+   209us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:47.962664 (+647391us) raft_consensus.cc:1685] finished
0709 13:14:47.962686 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:47.962846 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":133092,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":14815,"thread_start_us":1965849,"threads_started":2,"wal-append.queue_time_us":1738460}
W20260709 13:14:47.967657  5766 log.cc:927] Time spent T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.281s	user 0.001s	sys 0.001s
W20260709 13:14:47.969694  4704 consensus_meta.cc:287] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938: Time spent flushing consensus metadata: real 0.534s	user 0.011s	sys 0.003s
I20260709 13:14:47.970082  4704 raft_consensus.cc:2468] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 4.
I20260709 13:14:47.971077  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:47.971331  3953 raft_consensus.cc:1275] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:14:47.971481  5771 log.cc:927] Time spent T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:14:47.934796  4706 rpcz_store.cc:276] 0709 13:14:46.093697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.115511 (+ 21814us) service_pool.cc:224] Handling call
0709 13:14:47.904558 (+1789047us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:47.971226  3922 leader_election.cc:304] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:14:47.973440  5705 raft_consensus.cc:2749] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:47.977250  3922 leader_election.cc:400] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Vote denied by peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843) with higher term. Message: Invalid argument: T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 3. Current term is 4.
W20260709 13:14:47.977545  4673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:47.977737  3922 leader_election.cc:403] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 13:14:47.978189  4673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:47.978595  5705 raft_consensus.cc:2749] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843) with higher term. Message: Invalid argument: T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 3. Current term is 4.
I20260709 13:14:47.931005  5750 raft_consensus.cc:493] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:47.979936  5750 raft_consensus.cc:3060] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:47.981109  4703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57680 (request call id 444) took 1247 ms. Trace:
I20260709 13:14:47.981282  3922 leader_election.cc:304] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:14:47.981562  4703 rpcz_store.cc:276] 0709 13:14:46.733275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:47.979776 (+1246501us) service_pool.cc:224] Handling call
0709 13:14:47.980255 (+   479us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:47.980558 (+   303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:47.980593 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:47.980657 (+    64us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:47.980699 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:47.980770 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:47.980892 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:47.982275  5705 raft_consensus.cc:2749] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:47.984144  3922 leader_election.cc:304] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:47.985132  5705 raft_consensus.cc:2749] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:47.986946  3922 leader_election.cc:400] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Vote denied by peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843) with higher term. Message: Invalid argument: T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 3. Current term is 4.
I20260709 13:14:47.988379  3922 leader_election.cc:304] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:47.991477  4073 leader_election.cc:304] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:47.991909  3954 raft_consensus.cc:2368] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 for earlier term 2. Current term is 3.
I20260709 13:14:47.992831  4073 leader_election.cc:304] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:47.993961  5674 raft_consensus.cc:2804] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:47.994396  5674 raft_consensus.cc:493] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:47.994766  5674 raft_consensus.cc:3060] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:47.996364  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:47.998695  4706 raft_consensus.cc:1240] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 3. Current term is 4. Ops: []
W20260709 13:14:48.000573  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 264479us
I20260709 13:14:48.001686  3997 leader_election.cc:304] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
W20260709 13:14:48.002688  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 43558.5us
I20260709 13:14:48.007122  5738 leader_election.cc:290] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:48.008303  5737 leader_election.cc:290] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:48.010959  5688 raft_consensus.cc:2804] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:48.011896  4108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45332 (request call id 1423) took 2732 ms. Trace:
I20260709 13:14:48.012343  4108 rpcz_store.cc:276] 0709 13:14:45.279896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:45.982991 (+703095us) service_pool.cc:224] Handling call
0709 13:14:45.983267 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:45.985465 (+  2198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:45.985505 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:45.998202 (+ 12697us) log.cc:844] Serialized 26 byte log entry
0709 13:14:47.290294 (+1292092us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:14:47.758058 (+467764us) log.cc:844] Serialized 14 byte log entry
0709 13:14:47.830544 (+ 72486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:47.838486 (+  7942us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:47.943664 (+105178us) raft_consensus.cc:1685] finished
0709 13:14:47.943683 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:48.011816 (+ 68133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21144,"prepare.queue_time_us":478662,"prepare.run_cpu_time_us":133,"prepare.run_wall_time_us":38225,"raft.queue_time_us":26363,"raft.run_cpu_time_us":430,"raft.run_wall_time_us":32617,"thread_start_us":1727535,"threads_started":2,"wal-append.queue_time_us":1712974}
I20260709 13:14:47.943265  5648 raft_consensus.cc:515] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:48.007212  5674 raft_consensus.cc:515] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:48.016476  4105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45332 (request call id 1432) took 1496 ms. Trace:
I20260709 13:14:48.016933  4105 rpcz_store.cc:276] 0709 13:14:46.520358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.786251 (+265893us) service_pool.cc:224] Handling call
0709 13:14:48.016191 (+1229940us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b5400247cd4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:14:48.016385 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1011618688}
I20260709 13:14:48.017477  5648 leader_election.cc:290] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:48.018872  3957 raft_consensus.cc:2468] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 4.
I20260709 13:14:48.018867  5674 leader_election.cc:290] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:48.011410  5688 raft_consensus.cc:493] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:47.923609  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:48.007081  3958 raft_consensus.cc:2468] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 4.
I20260709 13:14:48.023772  4107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45332 (request call id 1429) took 1568 ms. Trace:
I20260709 13:14:47.991937  4672 leader_election.cc:304] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:48.021145  4708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:14:48.028409  4675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:48.028898  4675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:48.029184  4675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:48.029443  4675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:48.032308  3955 raft_consensus.cc:2468] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
I20260709 13:14:48.031461  3956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1502) took 3421 ms. Trace:
W20260709 13:14:48.037565  4675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:48.027382  5688 raft_consensus.cc:3060] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:48.034127  3956 rpcz_store.cc:276] 0709 13:14:44.610174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:45.017318 (+407144us) service_pool.cc:224] Handling call
0709 13:14:45.017830 (+   512us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:47.215753 (+2197923us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:47.215824 (+    71us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:47.217155 (+  1331us) log.cc:844] Serialized 26 byte log entry
0709 13:14:47.471881 (+254726us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:47.882051 (+410170us) log.cc:844] Serialized 14 byte log entry
0709 13:14:47.887877 (+  5826us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:47.902568 (+ 14691us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:47.938689 (+ 36121us) raft_consensus.cc:1685] finished
0709 13:14:47.938820 (+   131us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:48.031364 (+ 92544us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41440,"prepare.queue_time_us":303350,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":61,"raft.queue_time_us":167540,"raft.run_cpu_time_us":402,"raft.run_wall_time_us":23599,"thread_start_us":2743394,"threads_started":3,"wal-append.queue_time_us":694927}
W20260709 13:14:48.047685  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:48.047804  5786 raft_consensus.cc:3060] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:48.051714  5784 raft_consensus.cc:493] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:14:48.051898  4708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:48.041471  5738 raft_consensus.cc:493] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:48.053427  5738 raft_consensus.cc:515] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:48.035710  5705 raft_consensus.cc:2749] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:14:48.052531  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 60471us
I20260709 13:14:48.057523  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:48.044057  3999 leader_election.cc:304] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:48.062686  4709 raft_consensus.cc:2393] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 4: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
I20260709 13:14:48.061667  4672 leader_election.cc:304] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:48.058841  5648 raft_consensus.cc:493] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:48.067909  5648 raft_consensus.cc:515] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:48.069453  5757 raft_consensus.cc:2749] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:48.062888  3924 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:48.071075  5648 leader_election.cc:290] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:48.071724  3924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:48.056617  5403 leader_election.cc:290] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:14:48.064109  5717 consensus_meta.cc:287] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 0.695s	user 0.013s	sys 0.003s
I20260709 13:14:48.024183  4107 rpcz_store.cc:276] 0709 13:14:46.455328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.455480 (+   152us) service_pool.cc:224] Handling call
0709 13:14:46.470296 (+ 14816us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:46.472245 (+  1949us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:46.472287 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:46.590859 (+118572us) log.cc:844] Serialized 26 byte log entry
0709 13:14:47.741527 (+1150668us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:14:47.828883 (+ 87356us) log.cc:844] Serialized 14 byte log entry
0709 13:14:47.881666 (+ 52783us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:47.893857 (+ 12191us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:48.013690 (+119833us) spinlock_profiling.cc:243] Waited 6.46 ms on lock 0x7b18002d80e0. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f15225813f3 00007f15225837c1 00007f1522583779 00007f1522583709 00007f15225836d1 00007f15225829cd 000000000038f354 000000000038f199 00007f152256483a
0709 13:14:48.020189 (+  6499us) raft_consensus.cc:1685] finished
0709 13:14:48.023518 (+  3329us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:48.023707 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21170,"prepare.queue_time_us":47319,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":3715,"raft.queue_time_us":66691,"raft.run_cpu_time_us":454,"raft.run_wall_time_us":88929,"spinlock_wait_cycles":14855552,"thread_start_us":888804,"threads_started":1,"wal-append.queue_time_us":924742}
I20260709 13:14:48.072903  5705 raft_consensus.cc:2804] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:14:48.089233  3999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 52568.1us
I20260709 13:14:48.084300  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:48.090691  4709 raft_consensus.cc:3060] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:48.064695  5738 leader_election.cc:290] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:48.086342  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 82824.3us
W20260709 13:14:48.092662  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 91184.1us
I20260709 13:14:48.095235  5717 raft_consensus.cc:493] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:14:48.096125  5717 raft_consensus.cc:515] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:48.099138  5717 leader_election.cc:290] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:48.099751  5550 raft_consensus.cc:2804] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:14:48.100188  4074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:48.101336  4030 raft_consensus.cc:1240] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:48.101352  4074 leader_election.cc:304] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:48.102468  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:48.103217  4707 raft_consensus.cc:3060] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:48.100204  5550 raft_consensus.cc:493] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:14:48.103580  4074 leader_election.cc:304] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:48.103935  5550 raft_consensus.cc:3060] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:48.104225  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:48.104641  4074 leader_election.cc:304] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:48.107121  5597 leader_election.cc:290] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:48.108028  5767 raft_consensus.cc:2804] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:48.107967  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:48.108680  5767 raft_consensus.cc:697] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:48.109166  5503 raft_consensus.cc:2804] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:48.110003  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:48.109795  5767 consensus_queue.cc:237] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:48.110823  4030 raft_consensus.cc:2393] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 5: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:14:48.111950  5630 raft_consensus.cc:2804] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:48.113847  4099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45332 (request call id 1421) took 2846 ms. Trace:
I20260709 13:14:48.114545  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:48.133316  4029 raft_consensus.cc:3060] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:48.133352  4707 raft_consensus.cc:2468] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 4.
I20260709 13:14:48.114189  4099 rpcz_store.cc:276] 0709 13:14:45.267453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:45.981757 (+714304us) service_pool.cc:224] Handling call
0709 13:14:45.982029 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:47.713652 (+1731623us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:48.113513 (+399861us) spinlock_profiling.cc:243] Waited 1.72 s on lock 0x7b54001b9754. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:14:48.113745 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3952026496}
I20260709 13:14:48.060952  5784 raft_consensus.cc:515] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:48.154032  5784 leader_election.cc:290] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:48.138509  5705 raft_consensus.cc:697] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 3 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:48.155768  5705 consensus_queue.cc:237] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:48.156827  4034 raft_consensus.cc:1275] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:48.158130  5757 raft_consensus.cc:2804] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:48.158703  5757 raft_consensus.cc:493] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:48.159271  5757 raft_consensus.cc:3060] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:47.920831  4100 rpcz_store.cc:276] 0709 13:14:46.452811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.457532 (+  4721us) service_pool.cc:224] Handling call
0709 13:14:46.649332 (+191800us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:46.679989 (+ 30657us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:46.687509 (+  7520us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:46.749566 (+ 62057us) log.cc:844] Serialized 26 byte log entry
0709 13:14:47.733865 (+984299us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:14:47.733989 (+   124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:47.734163 (+   174us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:47.820183 (+ 86020us) raft_consensus.cc:1685] finished
0709 13:14:47.820208 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:47.885138 (+ 64930us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":944051,"threads_started":1,"wal-append.queue_time_us":1015858}
I20260709 13:14:48.142010  4073 leader_election.cc:304] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
W20260709 13:14:48.168201  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 180042us
I20260709 13:14:48.177153  4071 leader_election.cc:304] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: d709ee666b774ec29aa732e508219938
W20260709 13:14:48.178243  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 116647us
I20260709 13:14:48.138108  5630 raft_consensus.cc:697] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:48.169787  5503 raft_consensus.cc:697] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:48.204341  3922 leader_election.cc:304] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:48.215663  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:48.221349  5403 raft_consensus.cc:493] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:48.224498  5403 raft_consensus.cc:515] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:48.230598  4033 raft_consensus.cc:1240] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 2. Current term is 3. Ops: []
W20260709 13:14:48.221006  4073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 82081.7us
W20260709 13:14:48.232143  5769 log.cc:927] Time spent T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.307s	user 0.004s	sys 0.001s
I20260709 13:14:48.237836  4025 raft_consensus.cc:1240] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:48.240623  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:48.241000  4026 raft_consensus.cc:1240] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:48.241590  4025 raft_consensus.cc:2393] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 2: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:14:48.240774  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:48.242933  4027 raft_consensus.cc:2410] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:14:48.243969  4030 raft_consensus.cc:2393] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 4: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
W20260709 13:14:48.252393  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 55620.7us
I20260709 13:14:48.255985  5741 raft_consensus.cc:2749] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:14:48.256114  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 57815.1us
I20260709 13:14:48.262998  4028 raft_consensus.cc:1240] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:48.263784  5794 raft_consensus.cc:2804] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:48.258476  4672 leader_election.cc:304] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:48.264371  5794 raft_consensus.cc:697] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:48.264860  5493 raft_consensus.cc:2804] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:48.265309  5493 raft_consensus.cc:493] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:48.265707  5493 raft_consensus.cc:3060] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:48.266122  5789 raft_consensus.cc:2804] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:48.266673  5789 raft_consensus.cc:697] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:48.267746  5789 consensus_queue.cc:237] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:48.222041  5706 raft_consensus.cc:493] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:48.270256  5706 raft_consensus.cc:515] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:48.273255  3997 leader_election.cc:304] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:48.227414  5403 leader_election.cc:290] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:48.265627  5794 consensus_queue.cc:237] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:48.280128  5503 consensus_queue.cc:237] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:48.275027  4706 raft_consensus.cc:1275] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:14:48.284466  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 119698us
I20260709 13:14:48.288594  5792 raft_consensus.cc:2749] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:14:48.306078  3999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 141707us
W20260709 13:14:48.307488  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:48.226521  5630 consensus_queue.cc:237] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:48.267405  5550 raft_consensus.cc:515] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:48.307902  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:14:48.309738  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 168072us
I20260709 13:14:48.315475  4029 raft_consensus.cc:2410] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:14:48.317233  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:48.324476  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:48.326834  5550 leader_election.cc:290] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 election: Requested vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:48.329999  4703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:48.330663  4703 raft_consensus.cc:2468] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 4.
W20260709 13:14:48.332427  4672 leader_election.cc:336] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Timed out: RequestConsensusVote RPC to 127.2.198.193:35339 timed out after 1.858s (SENT)
I20260709 13:14:48.336185  5706 leader_election.cc:290] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:48.337607  4103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45332 (request call id 1433) took 1774 ms. Trace:
I20260709 13:14:48.338063  4103 rpcz_store.cc:276] 0709 13:14:46.563249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.851643 (+288394us) service_pool.cc:224] Handling call
0709 13:14:48.337333 (+1485690us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400196754. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:14:48.337534 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2499365632}
I20260709 13:14:48.341324  5641 leader_election.cc:290] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:14:48.347306  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:48.350013  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:48.352792  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 97339.5us
W20260709 13:14:48.360603  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 150452us
I20260709 13:14:48.378417  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:48.373483  3857 catalog_manager.cc:5697] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 reported cstate change: term changed from 1 to 3, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to d709ee666b774ec29aa732e508219938 (127.2.198.196). New cstate: current_term: 3 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:48.380029  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:48.379434  4100 raft_consensus.cc:2468] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 3.
I20260709 13:14:48.381958  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:48.355932  5641 consensus_queue.cc:1048] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:14:48.383315  3857 catalog_manager.cc:5697] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 reported cstate change: term changed from 1 to 2, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to d709ee666b774ec29aa732e508219938 (127.2.198.196). New cstate: current_term: 2 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:14:48.386781  4704 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57692 (request call id 232) took 2297 ms (client timeout 1903 ms). Trace:
W20260709 13:14:48.387305  4704 rpcz_store.cc:269] 0709 13:14:46.079503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.080312 (+   809us) service_pool.cc:224] Handling call
0709 13:14:46.860191 (+779879us) spinlock_profiling.cc:243] Waited 3.09 ms on lock 0x7b5800003f98. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f1522549b71 00007f1522549a22 00007f152b462c09 00007f152a5bcee0 00007f152a6860ab 00007f152a686131 00007f152a6340a0 00007f152a633984 00007f1523bae6d4 00007f1523bae662
0709 13:14:48.319420 (+1459229us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b540032cdd4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:14:48.369942 (+ 50522us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":771716096}
I20260709 13:14:48.398860  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:48.410607  4672 leader_election.cc:304] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
W20260709 13:14:48.411772  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 97722.2us
I20260709 13:14:48.425415  4034 raft_consensus.cc:2468] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 4.
I20260709 13:14:48.433171  5675 raft_consensus.cc:515] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:14:48.435617  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:48.435802  4103 raft_consensus.cc:1240] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:48.436461  5750 raft_consensus.cc:515] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:48.438673  5750 leader_election.cc:290] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:48.440840  5688 raft_consensus.cc:515] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:48.441437  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:48.443029  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:48.443897  4027 raft_consensus.cc:2393] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 4: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:48.405499  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:48.447913  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:48.451886  4027 raft_consensus.cc:1275] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:14:48.452368  4027 pending_rounds.cc:85] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2: Aborting all ops after (but not including) 1
I20260709 13:14:48.452618  4027 pending_rounds.cc:107] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:14:48.452908  4027 raft_consensus.cc:2889] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:48.455734  4028 raft_consensus.cc:1240] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:48.459317  4703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:48.459745  5474 consensus_queue.cc:1048] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:48.460337  5757 raft_consensus.cc:515] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:48.455528  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:48.393620  5737 raft_consensus.cc:493] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:48.463449  5737 raft_consensus.cc:515] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:14:48.433264  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 61103.5us
I20260709 13:14:48.463428  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:48.443203  5688 leader_election.cc:290] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:14:48.478379  4675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:48.486892  4675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:48.481907  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:48.489279  4029 raft_consensus.cc:2393] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 4: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:14:48.489553  4709 raft_consensus.cc:2468] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 4.
I20260709 13:14:48.492125  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:14:48.488348  4672 leader_election.cc:336] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Timed out: RequestConsensusVote RPC to 127.2.198.193:35339 timed out after 1.990s (SENT)
I20260709 13:14:48.490154  4025 raft_consensus.cc:2468] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3.
I20260709 13:14:48.491151  4073 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:48.395489  5786 raft_consensus.cc:2749] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:48.496806  4032 raft_consensus.cc:1240] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:48.484949  5757 leader_election.cc:290] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:48.500195  3922 leader_election.cc:304] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:48.513360  5737 leader_election.cc:290] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:48.513940  4706 raft_consensus.cc:2393] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 3: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
I20260709 13:14:48.515379  3997 leader_election.cc:304] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:48.516167  5675 leader_election.cc:290] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:14:48.517597  4675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:48.521171  5705 raft_consensus.cc:2749] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:48.521785  3922 leader_election.cc:400] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Vote denied by peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843) with higher term. Message: Invalid argument: T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 3. Current term is 4.
I20260709 13:14:48.522104  3922 leader_election.cc:403] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:14:48.519735  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:48.495865  4027 raft_consensus.cc:2393] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 2: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
W20260709 13:14:48.412678  3999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 61126.6us
I20260709 13:14:48.525225  4025 raft_consensus.cc:2410] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:14:48.534614  3999 leader_election.cc:304] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:48.536363  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:48.538630  3922 leader_election.cc:304] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
W20260709 13:14:48.539939  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 51644us
I20260709 13:14:48.541846  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:48.525270  5705 raft_consensus.cc:2749] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843) with higher term. Message: Invalid argument: T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 3. Current term is 4.
I20260709 13:14:48.544376  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:48.544256  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:48.529850  5786 raft_consensus.cc:2749] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:48.541818  5688 raft_consensus.cc:2804] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:14:48.558063  4074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:48.558686  4025 raft_consensus.cc:1275] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:14:48.559685  4704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:48.564013  4704 raft_consensus.cc:2468] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3.
I20260709 13:14:48.564172  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:48.565048  4707 raft_consensus.cc:2376] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 4. Re-sending same reply.
I20260709 13:14:48.565634  3924 leader_election.cc:304] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:48.566629  5688 raft_consensus.cc:697] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:48.551852  5741 raft_consensus.cc:3060] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:48.567802  5688 consensus_queue.cc:237] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:48.570842  5705 raft_consensus.cc:2804] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:48.571251  5705 raft_consensus.cc:493] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:48.548874  5503 raft_consensus.cc:493] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:48.572515  3999 leader_election.cc:304] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:48.572070  5503 raft_consensus.cc:515] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:48.573051  5496 raft_consensus.cc:2804] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:48.575086  5496 raft_consensus.cc:493] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:48.576031  5503 leader_election.cc:290] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:48.547959  5757 consensus_queue.cc:1059] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:14:48.576529  5705 raft_consensus.cc:3060] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:48.576849  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
W20260709 13:14:48.580296  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 65132.2us
I20260709 13:14:48.581704  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:48.582844  5750 raft_consensus.cc:2804] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:48.583847  4703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:48.583937  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:48.584631  4029 raft_consensus.cc:2393] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 5: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:48.602021  4707 raft_consensus.cc:2468] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 4.
I20260709 13:14:48.551944  5550 raft_consensus.cc:2804] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:14:48.587841  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 54942.4us
I20260709 13:14:48.588965  4032 raft_consensus.cc:2410] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:14:48.594990  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:48.604728  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 126141us
I20260709 13:14:48.590209  5496 raft_consensus.cc:3060] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:48.603506  5550 raft_consensus.cc:493] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:14:48.612661  5550 raft_consensus.cc:3060] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:48.612844  4025 raft_consensus.cc:1240] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:48.613339  3997 leader_election.cc:304] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:48.606599  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:48.609350  5675 consensus_queue.cc:1059] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:48.616883  5675 raft_consensus.cc:3055] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:48.617272  5675 raft_consensus.cc:740] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:48.618361  5675 consensus_queue.cc:260] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:48.551502  5493 raft_consensus.cc:515] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:48.603431  5792 raft_consensus.cc:493] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:48.620612  5792 raft_consensus.cc:515] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:48.621860  4071 leader_election.cc:304] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:48.622119  4704 raft_consensus.cc:1240] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:48.610270  5801 consensus_queue.cc:1059] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:14:48.626235  4703 raft_consensus.cc:2368] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 3. Current term is 4.
I20260709 13:14:48.626472  5792 leader_election.cc:290] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:48.627924  4073 leader_election.cc:304] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:48.628588  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:48.627959  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:48.592360  5737 raft_consensus.cc:493] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:48.636945  5474 raft_consensus.cc:3055] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:48.637533  5474 raft_consensus.cc:740] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:48.635169  5641 consensus_queue.cc:1059] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:14:48.637699  5548 raft_consensus.cc:3055] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:48.638163  5548 raft_consensus.cc:740] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:14:48.638341  5641 raft_consensus.cc:3055] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:48.638765  5641 raft_consensus.cc:740] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:48.638608  5474 consensus_queue.cc:260] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:48.637053  5801 raft_consensus.cc:2804] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:48.639727  5801 raft_consensus.cc:493] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:48.640118  5801 raft_consensus.cc:3060] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:48.640820  5474 raft_consensus.cc:3060] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:48.644239  5493 leader_election.cc:290] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:48.646123  3997 leader_election.cc:400] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 election: Vote denied by peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339) with higher term. Message: Invalid argument: T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 3. Current term is 4.
I20260709 13:14:48.646073  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:48.646584  3997 leader_election.cc:403] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:14:48.646835  4107 raft_consensus.cc:3060] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:48.632158  5750 raft_consensus.cc:697] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:48.645717  5641 consensus_queue.cc:260] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:48.631461  5737 raft_consensus.cc:515] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:48.649441  5641 raft_consensus.cc:3060] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:48.639043  5548 consensus_queue.cc:260] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:48.650952  5548 raft_consensus.cc:3060] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:48.651191  5737 leader_election.cc:290] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:48.648106  5750 consensus_queue.cc:237] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:48.659936  4107 raft_consensus.cc:2468] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 3.
I20260709 13:14:48.666595  4672 leader_election.cc:304] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:48.671339  5791 raft_consensus.cc:3060] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:48.675591  4030 raft_consensus.cc:1240] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:48.679194  3999 leader_election.cc:400] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 election: Vote denied by peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117) with higher term. Message: Invalid argument: T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 3. Current term is 4.
I20260709 13:14:48.663806  5784 raft_consensus.cc:2749] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:48.679687  3999 leader_election.cc:403] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:14:48.649502  5675 raft_consensus.cc:3060] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:48.659227  5705 raft_consensus.cc:515] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:48.685384  3856 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52094 (request call id 198) took 10417 ms. Trace:
I20260709 13:14:48.682934  3922 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
W20260709 13:14:48.693203  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 57184.5us
I20260709 13:14:48.680766  5493 raft_consensus.cc:2804] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:48.686187  5786 raft_consensus.cc:3060] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:48.686360  5741 raft_consensus.cc:2749] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:48.693084  5737 raft_consensus.cc:2749] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:48.694972  5630 raft_consensus.cc:2804] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:48.705606  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:48.697896  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:48.709813  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
W20260709 13:14:48.710055  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 88349.3us
W20260709 13:14:48.709841  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:48.714419  4030 raft_consensus.cc:2468] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 4.
I20260709 13:14:48.706125  5493 raft_consensus.cc:697] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [term 3 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:14:48.721849  5493 consensus_queue.cc:237] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:48.695420  5496 raft_consensus.cc:515] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:48.730134  4708 raft_consensus.cc:1240] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:48.705085  5630 raft_consensus.cc:493] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:48.739352  3997 leader_election.cc:304] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:48.741451  3997 leader_election.cc:304] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:48.742444  5784 raft_consensus.cc:2804] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:48.742911  5784 raft_consensus.cc:493] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:48.743300  5784 raft_consensus.cc:3060] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:48.739449  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:48.752379  5792 raft_consensus.cc:2749] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:48.752166  5784 raft_consensus.cc:515] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:48.753449  5792 consensus_queue.cc:1048] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:48.754643  5784 leader_election.cc:290] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:48.752384  4071 leader_election.cc:304] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:48.765388  5705 leader_election.cc:290] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 election: Requested vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:48.766481  4708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:48.767199  4708 raft_consensus.cc:3060] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:48.767827  5474 raft_consensus.cc:2749] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:14:48.685803  3856 rpcz_store.cc:276] 0709 13:14:38.267528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:38.267781 (+   253us) service_pool.cc:224] Handling call
0709 13:14:38.305104 (+ 37323us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b5400002490. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f1522549b71 00007f152254a0b2 00007f152b4c3a89 00007f152b45bda6 00007f152b42d088 00007f152b52b37e 00007f15299ec2a4 00007f15299ec232 00007f15299ec161 00007f15299ec0dc
0709 13:14:38.357663 (+ 52559us) spinlock_profiling.cc:243] Waited 39.8 ms on lock 0x7b5400002490. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f1522549e9c 00007f152254a0f6 00007f152b4c3a89 00007f152b45bda6 00007f152b42d088 00007f152b52b37e 00007f15299ec2a4 00007f15299ec232 00007f15299ec161 00007f15299ec0dc
0709 13:14:48.685113 (+10327450us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:44.605450 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:44.606297 (+   847us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:44.606350 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:14:44.606378 (+    28us) tablet.cc:662] Decoding operations
0709 13:14:44.688882 (+ 82504us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:44.700245 (+ 11363us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:44.713340 (+ 13095us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:14:44.779494 (+ 66154us) tablet.cc:701] Row locks acquired
0709 13:14:44.779530 (+    36us) write_op.cc:260] PREPARE: finished
0709 13:14:44.779770 (+   240us) write_op.cc:270] Start()
0709 13:14:44.779940 (+   170us) write_op.cc:276] Timestamp: P: 1783602884779716 usec, L: 0
0709 13:14:44.779973 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:14:44.832919 (+ 52946us) log.cc:844] Serialized 2860 byte log entry
0709 13:14:45.341895 (+508976us) op_driver.cc:464] REPLICATION: finished
0709 13:14:47.076412 (+1734517us) write_op.cc:301] APPLY: starting
0709 13:14:47.078121 (+  1709us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:47.088233 (+ 10112us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:47.088403 (+   170us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:47.089581 (+  1178us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:47.089879 (+   298us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:14:47.089945 (+    66us) write_op.cc:312] APPLY: finished
0709 13:14:47.090293 (+   348us) log.cc:844] Serialized 59 byte log entry
0709 13:14:47.786022 (+695729us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:47.786509 (+   487us) write_op.cc:454] Released schema lock
0709 13:14:47.786641 (+   132us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:47.787469 (+   828us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:47.787503 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6015,"reported_tablets":20,"spinlock_wait_cycles":132999680,"child_traces":[["op",{"apply.queue_time_us":1700665,"apply.run_cpu_time_us":36919,"apply.run_wall_time_us":715929,"num_ops":7,"prepare.queue_time_us":141601,"prepare.run_cpu_time_us":6502,"prepare.run_wall_time_us":242104,"replication_time_us":509032,"thread_start_us":2520877,"threads_started":4,"wal-append.queue_time_us":791500}]]}
I20260709 13:14:48.766851  4071 leader_election.cc:304] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
W20260709 13:14:48.771612  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 74924.6us
I20260709 13:14:48.773557  3922 leader_election.cc:400] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843) with higher term. Message: Invalid argument: T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 2. Current term is 3.
I20260709 13:14:48.773895  3922 leader_election.cc:403] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:48.783871  5741 raft_consensus.cc:3060] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:14:48.786235  5674 raft_consensus.cc:2804] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:48.786958  5674 raft_consensus.cc:697] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:48.788053  5674 consensus_queue.cc:237] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:48.790038  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:48.790555  5706 consensus_queue.cc:1059] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:48.736370  5630 raft_consensus.cc:3060] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:48.794144  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:48.795003  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:48.795897  4074 leader_election.cc:304] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:14:48.797923  4071 leader_election.cc:304] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:48.798962  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:48.809262  5548 consensus_queue.cc:1048] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:48.823833  4708 raft_consensus.cc:2468] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 4.
I20260709 13:14:48.826072  3924 leader_election.cc:304] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:48.825932  5706 consensus_queue.cc:1059] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:48.828294  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:48.830185  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:48.830391  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:48.771199  5641 consensus_queue.cc:1059] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:14:48.830509  5403 raft_consensus.cc:2804] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:48.836374  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:48.827255  5798 raft_consensus.cc:2749] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:48.835013  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:48.833997  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:48.834239  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:48.838544  4028 raft_consensus.cc:3060] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:48.834820  4032 raft_consensus.cc:2393] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 3: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:14:48.836390  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:48.840314  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:48.840930  4032 raft_consensus.cc:2468] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 2.
I20260709 13:14:48.838662  4034 raft_consensus.cc:2468] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 2.
I20260709 13:14:48.843278  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:48.843408  5403 raft_consensus.cc:697] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:48.843469  5820 consensus_queue.cc:1048] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:48.844741  5403 consensus_queue.cc:237] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:48.836629  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:48.855731  4030 raft_consensus.cc:2468] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:48.849445  4034 raft_consensus.cc:2376] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3. Re-sending same reply.
I20260709 13:14:48.851403  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:48.793442  5801 raft_consensus.cc:515] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:48.859997  4032 raft_consensus.cc:1275] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:14:48.862838  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:48.863646  4027 raft_consensus.cc:2393] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 4: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:14:48.864751  5548 consensus_queue.cc:1059] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:48.865901  5548 raft_consensus.cc:3055] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:48.866245  5548 raft_consensus.cc:740] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:14:48.860561  5641 raft_consensus.cc:3055] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:14:48.882793  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:48.884061  4675 leader_election.cc:304] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
W20260709 13:14:48.900250  4675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:48.862596  5741 raft_consensus.cc:2749] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843) with higher term. Message: Invalid argument: T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 2. Current term is 3.
I20260709 13:14:48.911571  4708 raft_consensus.cc:1240] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 2. Current term is 3. Ops: []
W20260709 13:14:48.911885  4675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:48.875481  5786 raft_consensus.cc:2749] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117) with higher term. Message: Invalid argument: T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 3. Current term is 4.
I20260709 13:14:48.913079  4033 raft_consensus.cc:2468] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:48.881134  5705 raft_consensus.cc:3055] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:14:48.915428  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 89466.5us
I20260709 13:14:48.884065  5496 leader_election.cc:290] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:48.917398  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:48.920297  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:48.886487  5641 raft_consensus.cc:740] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
W20260709 13:14:48.917426  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 95962.9us
I20260709 13:14:48.899214  5757 raft_consensus.cc:2804] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:48.867209  5548 consensus_queue.cc:260] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:48.921104  4107 raft_consensus.cc:3060] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:48.922147  4025 raft_consensus.cc:2468] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 4.
I20260709 13:14:48.916827  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:48.927870  3922 leader_election.cc:400] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Vote denied by peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843) with higher term. Message: Invalid argument: T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 3. Current term is 4.
I20260709 13:14:48.891952  5550 raft_consensus.cc:515] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:14:48.929937  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:48.931049  5786 consensus_queue.cc:1059] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:48.918434  5822 raft_consensus.cc:2804] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:48.920074  5705 raft_consensus.cc:740] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:48.923074  5757 raft_consensus.cc:493] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:48.941606  4029 raft_consensus.cc:1240] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:48.943620  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:48.944537  4027 raft_consensus.cc:2376] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3. Re-sending same reply.
W20260709 13:14:48.948010  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 83671.7us
I20260709 13:14:48.923838  5792 consensus_queue.cc:1048] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:14:48.937772  5822 raft_consensus.cc:697] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 4 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:48.947929  5757 raft_consensus.cc:3060] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:48.957763  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:48.965627  4107 raft_consensus.cc:2468] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 4.
I20260709 13:14:48.966975  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:48.938133  5821 consensus_queue.cc:1059] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:14:48.968938  4032 raft_consensus.cc:1240] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:48.970031  4030 raft_consensus.cc:1275] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:14:48.968954  4027 raft_consensus.cc:2393] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 5: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:14:48.971143  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:48.968494  4672 leader_election.cc:304] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:48.975507  4030 raft_consensus.cc:2393] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 4: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:14:48.975921  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:48.976183  5801 leader_election.cc:290] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:48.976449  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:48.976928  4026 raft_consensus.cc:2410] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:14:48.982327  4031 raft_consensus.cc:1275] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260709 13:14:48.984663  5706 raft_consensus.cc:3055] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:48.985136  5706 raft_consensus.cc:740] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:48.988507  4028 raft_consensus.cc:2468] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 5.
I20260709 13:14:48.992561  4074 leader_election.cc:304] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:14:48.994490  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:48.945590  5737 consensus_queue.cc:1059] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:14:48.999821  4034 pending_rounds.cc:85] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2: Aborting all ops after (but not including) 1
I20260709 13:14:49.018676  4034 pending_rounds.cc:107] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:14:49.019093  4034 raft_consensus.cc:2889] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:49.000383  5706 consensus_queue.cc:260] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:14:49.020152  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 63937.9us
I20260709 13:14:48.988116  5815 raft_consensus.cc:2804] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:48.964712  5641 consensus_queue.cc:260] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:49.005934  5550 leader_election.cc:290] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: Requested vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:49.007911  4708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:49.029590  4708 raft_consensus.cc:3060] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:49.029363  4704 raft_consensus.cc:1240] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [term 3 LEADER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:49.031258  5822 consensus_queue.cc:237] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:49.009459  4703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:49.009945  5821 raft_consensus.cc:3055] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:49.040887  5821 raft_consensus.cc:740] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:49.041208  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:49.042177  3951 raft_consensus.cc:2393] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 5: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:14:49.013111  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:49.014396  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:49.015239  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:49.016016  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:49.016827  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:49.018133  4027 raft_consensus.cc:2393] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 5: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:14:48.973568  5791 raft_consensus.cc:2749] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339) with higher term. Message: Invalid argument: T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 3. Current term is 4.
I20260709 13:14:49.022537  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:49.022665  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:49.017643  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:49.017526  5496 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.024355  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:49.072726  3950 raft_consensus.cc:3060] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:49.027935  5815 raft_consensus.cc:697] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 4 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:14:49.026535  5750 raft_consensus.cc:3055] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:49.027837  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:49.088387  4028 raft_consensus.cc:3060] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:49.039255  4708 raft_consensus.cc:2468] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 5.
W20260709 13:14:49.089561  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 68224.2us
W20260709 13:14:49.040156  4675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:49.009517  5675 raft_consensus.cc:3060] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:49.010599  4074 leader_election.cc:304] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:49.040401  4033 raft_consensus.cc:1275] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:14:49.037459  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 82038.6us
I20260709 13:14:49.040467  5641 raft_consensus.cc:3060] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:49.065377  3957 raft_consensus.cc:2393] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 4: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:14:49.065163  3954 raft_consensus.cc:3060] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:49.046969  3958 raft_consensus.cc:2468] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 4.
W20260709 13:14:49.070205  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:49.024765  4700 raft_consensus.cc:1275] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:48.992034  5630 raft_consensus.cc:515] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:49.093742  4073 leader_election.cc:304] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:49.088164  5750 raft_consensus.cc:740] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:49.099193  3952 raft_consensus.cc:2393] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 4: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:14:49.099624  5750 consensus_queue.cc:260] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:49.049269  5706 raft_consensus.cc:3060] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:49.041867  5821 consensus_queue.cc:260] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:49.029855  5757 raft_consensus.cc:515] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:14:49.108393  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 97838.3us
I20260709 13:14:49.148550  4074 leader_election.cc:304] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
W20260709 13:14:49.134069  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:49.153057  3997 connection.cc:256] RPC call timeout handler was delayed by -2.51207336199991s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22040000000000004s for a response
I20260709 13:14:49.019333  5705 consensus_queue.cc:260] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:49.156032  4028 raft_consensus.cc:2468] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 5.
I20260709 13:14:49.174922  3950 raft_consensus.cc:2468] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 4.
I20260709 13:14:49.175684  3954 raft_consensus.cc:2468] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 5.
I20260709 13:14:49.146754  3955 raft_consensus.cc:2468] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 4.
I20260709 13:14:49.157761  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:49.158551  3925 leader_election.cc:304] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:49.175683  5791 raft_consensus.cc:493] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.159643  5801 raft_consensus.cc:2804] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:49.149950  5474 raft_consensus.cc:2804] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:49.164068  4074 leader_election.cc:304] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:14:49.164812  4103 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "649df91131174f00af0e0a0240f80adb"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:14:49.101227  3953 raft_consensus.cc:3060] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:49.091063  5496 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:49.155609  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:14:49.168603  3997 connection.cc:256] RPC call timeout handler was delayed by -1.8659241810000822s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17070000000000002s for a response
W20260709 13:14:49.171276  3998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:49.070451  5550 consensus_queue.cc:1059] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:14:49.178246  3951 raft_consensus.cc:3060] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:49.101217  5750 raft_consensus.cc:3060] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:49.211962  5737 raft_consensus.cc:2749] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:14:49.213548  3997 connection.cc:256] RPC call timeout handler was delayed by -1.6373241810001673s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19610000000000002s for a response
W20260709 13:14:49.219602  3997 connection.cc:256] RPC call timeout handler was delayed by -1.6373241810001673s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19610000000000002s for a response
I20260709 13:14:49.178588  5503 raft_consensus.cc:2804] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:49.211846  4103 raft_consensus.cc:606] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Received request to transfer leadership to TS 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:49.223129  4103 raft_consensus.cc:614] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:49.224663  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:14:49.226097  3997 connection.cc:256] RPC call timeout handler was delayed by -1.5455241810000189s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20630000000000004s for a response
I20260709 13:14:49.209496  5688 raft_consensus.cc:493] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.182291  5801 raft_consensus.cc:493] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:49.234917  5801 raft_consensus.cc:3060] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:14:49.228312  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 69919.3us
I20260709 13:14:49.145797  5828 consensus_queue.cc:1059] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.077s
I20260709 13:14:49.236696  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:49.237259  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:49.237715  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:49.238184  3950 raft_consensus.cc:2410] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:14:49.238376  3954 raft_consensus.cc:2468] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 1.
I20260709 13:14:49.239275  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:49.239715  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:49.240135  3954 raft_consensus.cc:2410] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:14:49.226794  3922 leader_election.cc:304] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:49.225574  5674 raft_consensus.cc:2749] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:49.241014  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:49.217907  5784 raft_consensus.cc:493] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.241600  3957 raft_consensus.cc:3060] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:49.241828  5784 raft_consensus.cc:515] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:49.222744  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:49.244144  3952 raft_consensus.cc:3060] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:49.215282  5821 raft_consensus.cc:3060] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:49.209292  5794 raft_consensus.cc:493] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:49.250151  5794 raft_consensus.cc:515] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:49.229028  5815 consensus_queue.cc:237] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:49.253077  5820 raft_consensus.cc:3055] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:49.253563  5820 raft_consensus.cc:740] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:49.254499  5820 consensus_queue.cc:260] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:49.231035  5688 raft_consensus.cc:515] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:49.263329  3997 connection.cc:256] RPC call timeout handler was delayed by -1.5455241810000189s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20630000000000004s for a response
I20260709 13:14:49.232671  5496 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:49.233862  5819 log.cc:927] Time spent T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.372s	user 0.000s	sys 0.004s
I20260709 13:14:49.234285  5548 raft_consensus.cc:3060] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:14:49.263777  3997 connection.cc:256] RPC call timeout handler was delayed by -1.543724181000016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20650000000000002s for a response
I20260709 13:14:49.239287  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:49.262403  5648 raft_consensus.cc:493] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:49.226336  5503 raft_consensus.cc:493] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:49.286943  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:14:49.283437  3997 connection.cc:256] RPC call timeout handler was delayed by -1.543724181000016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20650000000000002s for a response
W20260709 13:14:49.287696  3997 connection.cc:256] RPC call timeout handler was delayed by -1.5157733619998908s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3311s for a response
W20260709 13:14:49.288075  3997 connection.cc:256] RPC call timeout handler was delayed by -1.4024241810000149s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2222s for a response
W20260709 13:14:49.288362  3997 connection.cc:256] RPC call timeout handler was delayed by -1.0118241810000654s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2656s for a response
W20260709 13:14:49.288669  3997 connection.cc:256] RPC call timeout handler was delayed by -1.0118241810000654s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2656s for a response
I20260709 13:14:49.283823  3950 raft_consensus.cc:2468] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 2.
I20260709 13:14:49.293089  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:49.212049  5791 raft_consensus.cc:515] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:49.300056  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:49.301530  4103 raft_consensus.cc:2468] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 4.
I20260709 13:14:49.304805  3925 leader_election.cc:304] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:49.309120  3925 leader_election.cc:304] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:14:49.294848  5830 raft_consensus.cc:2749] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:49.292423  5503 raft_consensus.cc:3060] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:49.314376  3925 leader_election.cc:304] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:14:49.286998  5823 consensus_queue.cc:1059] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:14:49.318434  4672 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:49.321030  3997 leader_election.cc:400] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 election: Vote denied by peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843) with higher term. Message: Invalid argument: T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 3. Current term is 4.
I20260709 13:14:49.321514  3997 leader_election.cc:403] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:14:49.314332  5820 raft_consensus.cc:3060] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:49.317842  5831 raft_consensus.cc:2749] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:49.328678  4708 raft_consensus.cc:3060] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 4 LEARNER]: Advancing to term 5
I20260709 13:14:49.336796  3954 raft_consensus.cc:2393] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 3: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:14:49.291240  5648 raft_consensus.cc:515] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:49.336768  5841 raft_consensus.cc:2804] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:49.349531  5841 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:49.349941  5841 raft_consensus.cc:3060] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:49.330147  5794 leader_election.cc:290] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:49.319895  5784 leader_election.cc:290] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:49.351359  5784 raft_consensus.cc:2749] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843) with higher term. Message: Invalid argument: T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 3. Current term is 4.
I20260709 13:14:49.354928  5823 raft_consensus.cc:3060] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:49.359875  5630 leader_election.cc:290] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:49.361742  5791 leader_election.cc:290] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:49.382678  5757 leader_election.cc:290] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:49.385205  5630 consensus_queue.cc:1048] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:14:49.387369  5836 log.cc:927] Time spent T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.152s	user 0.002s	sys 0.005s
I20260709 13:14:49.394608  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:49.400566  3954 raft_consensus.cc:3060] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:49.395753  5741 raft_consensus.cc:3055] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:49.402619  5741 raft_consensus.cc:740] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:49.403754  5741 consensus_queue.cc:260] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:49.405181  5741 raft_consensus.cc:3060] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:49.401535  5688 leader_election.cc:290] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:49.401997  5705 raft_consensus.cc:3060] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:49.413298  4703 raft_consensus.cc:1240] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:49.415462  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:49.415328  5630 consensus_queue.cc:1059] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:49.416184  4026 raft_consensus.cc:3060] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:49.416905  5630 raft_consensus.cc:3055] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:49.417414  5630 raft_consensus.cc:740] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:49.418462  5630 consensus_queue.cc:260] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:49.420150  5630 raft_consensus.cc:3060] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:14:49.423487  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 259503us
I20260709 13:14:49.424928  4074 leader_election.cc:304] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:49.425729  5688 raft_consensus.cc:2804] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:49.426184  5688 raft_consensus.cc:493] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:49.426578  5688 raft_consensus.cc:3060] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:49.427400  5648 leader_election.cc:290] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:14:49.428068  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 113768us
I20260709 13:14:49.429100  5831 consensus_queue.cc:1048] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:14:49.430826  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:49.432133  5831 consensus_queue.cc:1059] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:49.433352  5826 raft_consensus.cc:3055] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:49.433724  5826 raft_consensus.cc:740] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:49.433815  3925 leader_election.cc:304] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:14:49.434695  5826 consensus_queue.cc:260] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:49.401592  3857 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44680 (request call id 118) took 10949 ms. Trace:
I20260709 13:14:49.453358  4074 leader_election.cc:304] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:49.465490  3959 raft_consensus.cc:2468] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
W20260709 13:14:49.454931  4675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:49.458400  3957 raft_consensus.cc:2468] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 5.
I20260709 13:14:49.477547  4708 raft_consensus.cc:1275] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 5 LEARNER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:14:49.483302  4026 raft_consensus.cc:2468] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 5.
I20260709 13:14:49.487414  4675 leader_election.cc:304] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:49.485054  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:49.495921  4074 leader_election.cc:304] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:49.474567  3952 raft_consensus.cc:2468] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 4.
I20260709 13:14:49.474596  5831 raft_consensus.cc:2804] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:49.474408  5737 raft_consensus.cc:2764] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:14:49.484797  3855 catalog_manager.cc:5697] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 2 to 4, leader changed from 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 4 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:49.503958  3954 raft_consensus.cc:2468] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 4.
I20260709 13:14:49.507061  4074 leader_election.cc:304] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:14:49.474005  3951 raft_consensus.cc:2468] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 4.
W20260709 13:14:49.509295  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 282587us
I20260709 13:14:49.465101  3857 rpcz_store.cc:276] 0709 13:14:38.452376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:38.452557 (+   181us) service_pool.cc:224] Handling call
0709 13:14:38.626704 (+174147us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b54004287a8. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b860331 00007f152b85b3fc 00007f152b42d1b4 00007f152b52b37e 00007f15299ec2a4 00007f15299ec232 00007f15299ec161 00007f15299ec0dc 00007f15299eb392 00007f15239a948c 00007f15239a88c6
0709 13:14:49.401505 (+10774801us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:48.566371 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:48.567321 (+   950us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:48.567400 (+    79us) write_op.cc:435] Acquired schema lock
0709 13:14:48.567453 (+    53us) tablet.cc:662] Decoding operations
0709 13:14:48.607397 (+ 39944us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:48.607505 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:48.607552 (+    47us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:14:48.608063 (+   511us) tablet.cc:701] Row locks acquired
0709 13:14:48.608114 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:14:48.608321 (+   207us) write_op.cc:270] Start()
0709 13:14:48.608556 (+   235us) write_op.cc:276] Timestamp: P: 1783602888608257 usec, L: 0
0709 13:14:48.608594 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:14:48.609524 (+   930us) log.cc:844] Serialized 919 byte log entry
0709 13:14:48.824196 (+214672us) op_driver.cc:464] REPLICATION: finished
0709 13:14:49.003954 (+179758us) write_op.cc:301] APPLY: starting
0709 13:14:49.004081 (+   127us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:49.004258 (+   177us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:49.004406 (+   148us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:49.004950 (+   544us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:49.005298 (+   348us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:14:49.005358 (+    60us) write_op.cc:312] APPLY: finished
0709 13:14:49.005680 (+   322us) log.cc:844] Serialized 29 byte log entry
0709 13:14:49.005886 (+   206us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:49.005997 (+   111us) write_op.cc:454] Released schema lock
0709 13:14:49.006052 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:49.006555 (+   503us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:49.006597 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":347863,"reported_tablets":6,"spinlock_wait_cycles":34277760,"child_traces":[["op",{"apply.queue_time_us":168838,"apply.run_cpu_time_us":2560,"apply.run_wall_time_us":2561,"num_ops":2,"prepare.queue_time_us":177335,"prepare.run_cpu_time_us":4463,"prepare.run_wall_time_us":43634,"replication_time_us":202920,"thread_start_us":252688,"threads_started":2}]]}
I20260709 13:14:49.499224  5828 consensus_queue.cc:1243] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer 6f5b5e4ed72944ecbda200012d141dc2 log is divergent from this leader: its last log entry 2.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:14:49.521719  3855 catalog_manager.cc:5697] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 1 to 3, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 3 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:49.505004  5831 raft_consensus.cc:493] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:49.531488  5831 raft_consensus.cc:3060] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:49.534940  5503 raft_consensus.cc:515] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:49.537413  3953 raft_consensus.cc:2468] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:49.508545  5798 raft_consensus.cc:2804] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:49.538381  3956 raft_consensus.cc:2368] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 3. Current term is 4.
I20260709 13:14:49.510000  5675 raft_consensus.cc:2749] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:49.514628  5474 raft_consensus.cc:697] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:49.521835  3925 leader_election.cc:304] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:49.540233  5675 raft_consensus.cc:2749] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:49.540479  5474 consensus_queue.cc:237] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:49.541049  5503 leader_election.cc:290] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:49.503775  5548 raft_consensus.cc:2804] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:49.543627  5548 raft_consensus.cc:697] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 5 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:14:49.545300  3955 raft_consensus.cc:2410] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:14:49.544845  5548 consensus_queue.cc:237] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:49.525175  3954 raft_consensus.cc:1275] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260709 13:14:49.528334  3951 raft_consensus.cc:1275] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:14:49.491997  5801 raft_consensus.cc:515] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:49.520619  5826 raft_consensus.cc:3060] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:49.505105  5849 consensus_queue.cc:1048] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:14:49.536067  3958 raft_consensus.cc:3055] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:49.552109  3855 catalog_manager.cc:5697] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:49.552950  3958 raft_consensus.cc:740] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:49.530066  5841 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:49.550227  3950 raft_consensus.cc:1275] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:14:49.577332  3950 pending_rounds.cc:85] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059: Aborting all ops after (but not including) 2
W20260709 13:14:49.577657  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 55888us
I20260709 13:14:49.577991  3950 pending_rounds.cc:107] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:14:49.578680  3950 raft_consensus.cc:2889] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:49.546653  5550 consensus_queue.cc:1243] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer d709ee666b774ec29aa732e508219938 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:14:49.580799  5849 consensus_queue.cc:1243] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer 6f5b5e4ed72944ecbda200012d141dc2 log is divergent from this leader: its last log entry 2.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:14:49.585654  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 268010us
I20260709 13:14:49.583057  3925 leader_election.cc:304] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:49.584949  3855 catalog_manager.cc:5697] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 2 to 3, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 3 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:49.622274  4104 raft_consensus.cc:1275] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:14:49.627182  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 44217.7us
I20260709 13:14:49.628304  3925 leader_election.cc:304] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:49.591076  5737 raft_consensus.cc:2749] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:14:49.623471  3855 catalog_manager.cc:5697] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:49.624648  3958 consensus_queue.cc:260] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:49.598984  5798 raft_consensus.cc:697] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
W20260709 13:14:49.646226  3922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:49.596088  5674 consensus_queue.cc:1048] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:14:49.663290  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:49.664371  3955 raft_consensus.cc:2468] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 1.
I20260709 13:14:49.665537  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:49.645587  3855 catalog_manager.cc:5697] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 2 to 3, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 3 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:49.650776  5842 raft_consensus.cc:2804] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:49.650779  4034 raft_consensus.cc:3055] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:49.672798  4034 raft_consensus.cc:740] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:49.652247  3997 leader_election.cc:304] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:49.654798  5493 consensus_queue.cc:1048] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:49.647722  5822 raft_consensus.cc:2749] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:14:49.630432  5830 raft_consensus.cc:2749] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:14:49.609592  5496 consensus_queue.cc:1048] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
W20260709 13:14:49.676607  3998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:49.678755  3855 catalog_manager.cc:5697] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 2 to 3, leader changed from 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 3 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:49.681244  3958 raft_consensus.cc:3060] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:49.681183  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:49.679524  4071 leader_election.cc:304] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:49.682088  3950 raft_consensus.cc:2393] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 4: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:49.623828  5550 consensus_queue.cc:1048] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:14:49.691680  5842 raft_consensus.cc:697] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:49.692849  5842 consensus_queue.cc:237] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:49.697679  4071 leader_election.cc:304] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:49.699728  5675 raft_consensus.cc:2749] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:49.699932  5839 raft_consensus.cc:493] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.700518  5675 raft_consensus.cc:2749] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:14:49.702941  4704 raft_consensus.cc:1275] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:49.705626  4071 leader_election.cc:304] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:49.706557  5503 raft_consensus.cc:2804] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:49.706955  5503 raft_consensus.cc:493] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:49.707304  5503 raft_consensus.cc:3060] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:49.710788  5843 raft_consensus.cc:2749] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:49.678671  4034 consensus_queue.cc:260] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:14:49.715611  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:49.718390  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 211397us
I20260709 13:14:49.720561  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:49.721589  3955 raft_consensus.cc:2468] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 3.
I20260709 13:14:49.700640  5839 raft_consensus.cc:515] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:49.724769  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:49.725579  3950 raft_consensus.cc:2393] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 4: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:14:49.726742  4034 raft_consensus.cc:3060] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:14:49.728793  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 100612us
I20260709 13:14:49.730803  4033 raft_consensus.cc:1240] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 13:14:49.732050  3925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:49.676127  5820 raft_consensus.cc:493] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.739917  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:49.720185  3855 catalog_manager.cc:5697] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 1 to 3, leader changed from 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 3 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:14:49.738965  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:49.747848  3950 raft_consensus.cc:2468] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 5.
I20260709 13:14:49.749047  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:14:49.751754  3924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:49.737922  4074 leader_election.cc:304] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:49.744210  5830 consensus_queue.cc:1059] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:14:49.796330  5830 raft_consensus.cc:3055] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:49.796806  5830 raft_consensus.cc:740] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:49.797325  5839 leader_election.cc:290] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:49.797773  5830 consensus_queue.cc:260] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:49.798846  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:49.799201  5830 raft_consensus.cc:3060] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:14:49.758447  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 52885.8us
I20260709 13:14:49.802534  4071 leader_election.cc:304] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:49.812389  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:49.813498  3953 raft_consensus.cc:2393] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 3: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:49.814688  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:49.816124  5840 raft_consensus.cc:493] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.816926  5840 raft_consensus.cc:515] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:49.817631  5841 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:49.820883  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:49.821970  3954 raft_consensus.cc:2393] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 5: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:14:49.827828  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:49.827939  5798 consensus_queue.cc:237] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:49.829276  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 110177us
I20260709 13:14:49.829974  4071 leader_election.cc:304] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:49.830549  5849 raft_consensus.cc:2804] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:49.831002  4074 leader_election.cc:304] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:49.831858  5852 raft_consensus.cc:2749] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:49.832136  5846 raft_consensus.cc:2749] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:49.832652  5852 consensus_queue.cc:1048] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:49.833254  4071 leader_election.cc:304] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:49.756875  5820 raft_consensus.cc:515] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:49.834647  5853 raft_consensus.cc:2749] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:49.835717  5854 consensus_queue.cc:1048] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:14:49.753800  3855 catalog_manager.cc:5697] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:49.836925  4103 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:14:49.837543  4103 raft_consensus.cc:606] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Received request to transfer leadership to TS 6f5b5e4ed72944ecbda200012d141dc2
W20260709 13:14:49.799790  3997 leader_election.cc:336] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Timed out: RequestConsensusVote RPC to 127.2.198.193:35339 timed out after 1.707s (SENT)
I20260709 13:14:49.836004  5820 leader_election.cc:290] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:49.793051  4104 raft_consensus.cc:1275] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:49.801487  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:49.759682  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:49.842110  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:49.842963  3950 raft_consensus.cc:2468] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 4.
I20260709 13:14:49.823194  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:49.850217  4071 leader_election.cc:304] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:14:49.850664  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 50923.4us
I20260709 13:14:49.851281  4071 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:14:49.850934  3855 catalog_manager.cc:5697] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:49.852937  3855 catalog_manager.cc:5697] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 2 to 3, leader changed from 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 3 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:49.854236  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:49.854878  4026 raft_consensus.cc:2468] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 4.
I20260709 13:14:49.833564  5831 raft_consensus.cc:515] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:49.856787  5674 raft_consensus.cc:2804] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:49.856976  5820 raft_consensus.cc:493] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:49.857462  5674 raft_consensus.cc:697] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:49.857642  5820 raft_consensus.cc:515] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:49.858744  5831 leader_election.cc:290] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:49.858479  5674 consensus_queue.cc:237] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:49.859728  5675 raft_consensus.cc:2749] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:14:49.854959  5630 raft_consensus.cc:2804] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:49.860474  5675 raft_consensus.cc:493] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:49.852582  4071 leader_election.cc:304] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:14:49.854918  3855 catalog_manager.cc:5697] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:49.862358  3925 leader_election.cc:304] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:49.864852  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:49.875110  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:49.860956  5675 raft_consensus.cc:515] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:49.880993  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:14:49.897156  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 44656.6us
I20260709 13:14:49.898087  4071 leader_election.cc:304] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:49.879113  3950 raft_consensus.cc:2376] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d709ee666b774ec29aa732e508219938 in term 4. Re-sending same reply.
I20260709 13:14:49.771391  3958 raft_consensus.cc:1275] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 13:14:49.904882  3958 pending_rounds.cc:85] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059: Aborting all ops after (but not including) 4
I20260709 13:14:49.914898  3958 pending_rounds.cc:107] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059: Aborting uncommitted NO_OP operation due to leader change: 4.5
I20260709 13:14:49.915302  3958 raft_consensus.cc:2889] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:49.915190  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:49.917937  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
W20260709 13:14:49.918452  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 56640.5us
I20260709 13:14:49.927126  3957 raft_consensus.cc:2468] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 4.
I20260709 13:14:49.928228  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:49.912623  5830 raft_consensus.cc:493] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.930187  5846 raft_consensus.cc:2804] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:49.930032  5830 raft_consensus.cc:515] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:49.930760  5794 consensus_queue.cc:1059] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:49.931481  5820 leader_election.cc:290] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:14:49.932476  5823 consensus_meta.cc:287] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.577s	user 0.011s	sys 0.000s
I20260709 13:14:49.932945  5823 raft_consensus.cc:2749] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:49.913147  5840 leader_election.cc:290] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:49.877379  5688 raft_consensus.cc:515] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:49.939673  3922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:49.941416  5688 leader_election.cc:290] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:49.942116  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:49.942378  5801 leader_election.cc:290] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:49.880620  5705 raft_consensus.cc:2804] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:49.943738  5705 raft_consensus.cc:493] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:49.944168  5705 raft_consensus.cc:3060] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:49.945444  4103 raft_consensus.cc:1240] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:49.946609  5830 leader_election.cc:290] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:49.947844  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:49.948146  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:49.948693  5675 leader_election.cc:290] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:49.949369  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:49.950477  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:49.951036  3950 raft_consensus.cc:2468] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 3.
I20260709 13:14:49.880430  5630 raft_consensus.cc:697] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:49.962041  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:49.946645  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:49.958014  3956 raft_consensus.cc:2468] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 4.
I20260709 13:14:49.949246  5675 consensus_queue.cc:1048] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:49.924386  4071 leader_election.cc:304] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:49.947876  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:49.966403  5846 raft_consensus.cc:697] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:49.966849  4100 raft_consensus.cc:2393] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 5: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:49.966922  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:49.967515  5846 consensus_queue.cc:237] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:49.972518  4104 raft_consensus.cc:2393] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 4: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:49.979110  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:49.979598  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:49.981307  3958 raft_consensus.cc:2393] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 4: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
I20260709 13:14:49.982448  4108 raft_consensus.cc:1240] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:49.975343  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:49.985106  3950 raft_consensus.cc:2393] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 3: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:14:49.986690  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:49.920849  5403 raft_consensus.cc:2804] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:49.992651  4099 raft_consensus.cc:2393] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 3: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:49.989671  3953 raft_consensus.cc:2468] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 5.
I20260709 13:14:49.994302  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:49.994853  3953 raft_consensus.cc:3060] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:49.997424  3957 raft_consensus.cc:2468] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 4.
I20260709 13:14:49.990634  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:50.009156  4106 raft_consensus.cc:3060] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:14:49.966480  5829 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:14:49.962020  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:50.013945  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:50.017355  3958 raft_consensus.cc:3060] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:50.017974  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:50.014194  4103 raft_consensus.cc:1240] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:50.014184  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:49.994516  4672 leader_election.cc:304] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:50.021225  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:49.880489  5853 consensus_queue.cc:1048] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.102s
I20260709 13:14:50.022039  4028 raft_consensus.cc:2468] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3.
I20260709 13:14:49.982237  5801 raft_consensus.cc:3055] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:50.041715  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:50.030673  3925 leader_election.cc:304] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:50.020321  3950 raft_consensus.cc:2468] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 4.
W20260709 13:14:50.043272  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 48854.7us
I20260709 13:14:50.043462  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:50.044373  3950 raft_consensus.cc:2468] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:50.044562  4672 leader_election.cc:304] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:50.045425  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:50.045819  4672 leader_election.cc:304] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:50.046030  3950 raft_consensus.cc:2376] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d709ee666b774ec29aa732e508219938 in term 4. Re-sending same reply.
I20260709 13:14:50.027020  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:50.047056  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:50.025591  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:50.047876  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:50.048341  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:50.048548  4706 raft_consensus.cc:2468] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 2.
I20260709 13:14:49.978132  5849 raft_consensus.cc:697] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:50.050097  3951 raft_consensus.cc:1275] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:50.050041  5849 consensus_queue.cc:237] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:50.047911  3959 raft_consensus.cc:3060] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:14:50.053930  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:50.054581  4707 raft_consensus.cc:2468] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 4.
I20260709 13:14:50.026413  4704 raft_consensus.cc:1240] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 5 LEADER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:50.055861  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:50.022457  4703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:50.056887  5863 raft_consensus.cc:2749] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:50.057721  5863 raft_consensus.cc:2804] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:50.058202  5863 raft_consensus.cc:697] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 4 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:14:50.058521  5823 raft_consensus.cc:2804] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:50.058979  5823 raft_consensus.cc:493] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:50.034196  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:50.060652  4675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:50.061389  5757 raft_consensus.cc:2749] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:50.062079  3924 leader_election.cc:304] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:50.025179  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:50.025095  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:50.018877  5854 raft_consensus.cc:2804] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:50.041982  5801 raft_consensus.cc:740] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:50.059427  5823 raft_consensus.cc:3060] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:50.064184  3924 leader_election.cc:304] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
W20260709 13:14:50.060556  5826 consensus_meta.cc:287] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.506s	user 0.006s	sys 0.004s
I20260709 13:14:50.060465  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:50.066109  4102 raft_consensus.cc:2468] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 3.
I20260709 13:14:50.067449  3959 raft_consensus.cc:2468] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:50.038671  3953 raft_consensus.cc:2468] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 5.
I20260709 13:14:50.077159  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:50.071110  3954 raft_consensus.cc:2468] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 3.
I20260709 13:14:50.063810  3950 raft_consensus.cc:2468] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 4.
I20260709 13:14:50.078016  4108 raft_consensus.cc:3060] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:50.072170  3958 raft_consensus.cc:2468] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:50.079737  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:50.073338  4672 leader_election.cc:304] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:50.074601  3957 raft_consensus.cc:3060] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:50.022609  5403 raft_consensus.cc:697] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:50.080399  4028 raft_consensus.cc:2468] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:50.063513  5821 raft_consensus.cc:2804] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:50.017812  5548 consensus_queue.cc:1048] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:14:50.083163  4026 raft_consensus.cc:1275] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:14:50.083137  4672 leader_election.cc:304] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:50.081835  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:50.100921  4672 leader_election.cc:304] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:50.101909  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:50.102746  4030 raft_consensus.cc:3060] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:50.106419  4672 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:50.074150  4034 raft_consensus.cc:1275] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:14:50.110173  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:50.111249  4034 raft_consensus.cc:2393] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 4: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:14:50.123788  3959 raft_consensus.cc:1240] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:50.131750  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:50.131783  3955 raft_consensus.cc:2468] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 4.
I20260709 13:14:50.134791  4027 raft_consensus.cc:1275] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:14:50.105691  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:50.137022  4032 raft_consensus.cc:3060] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:50.076964  5822 raft_consensus.cc:2749] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:14:50.141235  4025 raft_consensus.cc:1275] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:14:50.143857  3957 raft_consensus.cc:2468] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:50.132133  4028 pending_rounds.cc:85] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2: Aborting all ops after (but not including) 3
I20260709 13:14:50.141793  3950 raft_consensus.cc:1275] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:14:50.142257  4672 leader_election.cc:304] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:50.078642  5854 raft_consensus.cc:697] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:50.148319  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:50.149354  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
W20260709 13:14:50.152460  3925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:50.168098  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:50.173918  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:50.086413  5821 raft_consensus.cc:493] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:50.066839  5503 raft_consensus.cc:515] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:50.059155  5863 consensus_queue.cc:237] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:50.082542  5493 raft_consensus.cc:2749] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:50.195809  3951 raft_consensus.cc:1240] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:14:50.208123  3950 raft_consensus.cc:1275] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:14:50.216647  3959 raft_consensus.cc:1275] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:14:50.219467  3957 raft_consensus.cc:1275] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:14:50.145992  5841 raft_consensus.cc:2749] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:50.082422  4100 raft_consensus.cc:2468] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 4.
I20260709 13:14:50.217247  3959 pending_rounds.cc:85] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059: Aborting all ops after (but not including) 5
I20260709 13:14:50.241587  3959 pending_rounds.cc:107] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:14:50.241999  3959 raft_consensus.cc:2889] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:14:50.142347  5792 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:14:50.149233  4101 raft_consensus.cc:2468] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 4.
I20260709 13:14:50.064042  5630 consensus_queue.cc:237] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:50.118460  5757 raft_consensus.cc:2804] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:50.145256  4028 pending_rounds.cc:107] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 2.4
W20260709 13:14:50.225675  3924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:50.148241  5839 raft_consensus.cc:2804] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:50.197516  5821 raft_consensus.cc:3060] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:50.189723  5801 consensus_queue.cc:260] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:50.148013  5815 consensus_queue.cc:1048] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 13:14:50.300611  3950 raft_consensus.cc:1275] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:50.316114  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:50.322067  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:50.292999  5548 raft_consensus.cc:2749] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:50.268405  5757 raft_consensus.cc:493] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:50.308560  4105 raft_consensus.cc:1240] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:50.325110  5757 raft_consensus.cc:3060] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:50.251976  3952 raft_consensus.cc:1240] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 4 LEADER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:50.288242  4028 raft_consensus.cc:2917] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Aborting config change with OpId 2.4: Aborted: Op aborted by new leader
I20260709 13:14:50.332542  4028 raft_consensus.cc:2889] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:50.335943  4032 raft_consensus.cc:2468] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
W20260709 13:14:50.364924  3997 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.036s	sys 0.082s
I20260709 13:14:50.331992  5839 raft_consensus.cc:697] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 5 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
W20260709 13:14:50.365684  3997 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.037s	sys 0.082s
W20260709 13:14:50.366092  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 514665us
I20260709 13:14:50.338960  5801 raft_consensus.cc:3060] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:50.368070  5493 raft_consensus.cc:493] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:50.268769  5403 consensus_queue.cc:237] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:14:50.408842  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 266683us
W20260709 13:14:50.407480  5864 log.cc:927] Time spent T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:14:50.400472  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:50.340137  5854 consensus_queue.cc:237] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:50.441743  5868 log.cc:927] Time spent T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
W20260709 13:14:50.442075  5875 log.cc:927] Time spent T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 13:14:50.440991  3997 leader_election.cc:336] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Timed out: RequestConsensusVote RPC to 127.2.198.193:35339 timed out after 2.222s (SENT)
I20260709 13:14:50.448611  4106 raft_consensus.cc:2468] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 4.
I20260709 13:14:50.449007  3997 leader_election.cc:304] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:50.454437  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:50.455308  4106 raft_consensus.cc:2393] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 4: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:50.413341  5493 raft_consensus.cc:515] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:14:50.461393  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 537054us
I20260709 13:14:50.463616  4030 raft_consensus.cc:2468] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:50.459806  5493 leader_election.cc:290] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:50.471141  5705 consensus_meta.cc:287] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.527s	user 0.004s	sys 0.004s
I20260709 13:14:50.464982  5847 raft_consensus.cc:2749] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:50.491699  4071 leader_election.cc:400] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Vote denied by peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339) with higher term. Message: Invalid argument: T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 3. Current term is 4.
W20260709 13:14:50.475914  5866 log.cc:927] Time spent T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 13:14:50.477730  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:14:50.478274  5867 log.cc:927] Time spent T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:14:50.487283  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:50.514600  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:14:50.490116  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 62319.6us
I20260709 13:14:50.492122  4071 leader_election.cc:403] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:14:50.515964  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:50.517174  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:14:50.517402  3997 leader_election.cc:336] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Timed out: RequestConsensusVote RPC to 127.2.198.193:35339 timed out after 3.008s (SENT)
I20260709 13:14:50.517803  4106 raft_consensus.cc:2468] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 4.
I20260709 13:14:50.517565  5821 raft_consensus.cc:515] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:50.517895  3997 leader_election.cc:304] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:50.518843  3956 raft_consensus.cc:2393] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 in current term 3: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:14:50.519083  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:50.496031  5858 raft_consensus.cc:493] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:50.496933  3958 raft_consensus.cc:1275] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:14:50.445128  5839 consensus_queue.cc:237] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:50.530483  5858 raft_consensus.cc:515] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:50.533335  5858 leader_election.cc:290] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:50.507185  4101 raft_consensus.cc:2468] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 4.
I20260709 13:14:50.507473  4108 raft_consensus.cc:2468] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 4.
I20260709 13:14:50.511925  4672 leader_election.cc:304] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:50.537941  4672 leader_election.cc:304] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:50.491281  5705 raft_consensus.cc:515] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:50.519830  5550 raft_consensus.cc:2749] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:14:50.457026  5503 leader_election.cc:290] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:50.520007  3953 raft_consensus.cc:1240] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:50.510922  5823 raft_consensus.cc:515] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:14:50.521068  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 58933.8us
I20260709 13:14:50.521555  5842 raft_consensus.cc:2749] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339) with higher term. Message: Invalid argument: T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 3. Current term is 4.
I20260709 13:14:50.521932  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:50.522097  5821 leader_election.cc:290] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:50.524000  3959 raft_consensus.cc:1240] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:14:50.527015  4708 raft_consensus.cc:1275] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:14:50.527766  4106 raft_consensus.cc:2468] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 2.
I20260709 13:14:50.550103  4071 leader_election.cc:304] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:50.515202  5876 consensus_queue.cc:1048] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:14:50.541028  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:50.546825  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:50.551745  4071 leader_election.cc:304] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:50.553762  4108 raft_consensus.cc:2410] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:14:50.546876  5841 raft_consensus.cc:3060] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:50.536696  5858 raft_consensus.cc:493] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:50.557828  3922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:50.552140  5496 consensus_queue.cc:1048] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:14:50.562117  5884 raft_consensus.cc:2804] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:50.562685  5884 raft_consensus.cc:493] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:50.563124  5884 raft_consensus.cc:3060] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:14:50.563591  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:50.565246  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:50.566500  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:50.572616  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:50.573463  4102 raft_consensus.cc:2368] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 2. Current term is 3.
W20260709 13:14:50.579463  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:50.595419  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:50.608569  4073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 56193.2us
I20260709 13:14:50.609414  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:14:50.610390  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 59343.3us
I20260709 13:14:50.611280  4071 leader_election.cc:304] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:50.612071  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:50.613067  4102 raft_consensus.cc:2410] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:14:50.549305  5815 raft_consensus.cc:2804] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:50.554494  5688 consensus_queue.cc:1048] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.017s
W20260709 13:14:50.619259  3924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:50.619959  4071 leader_election.cc:304] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:50.624053  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:50.574267  5550 raft_consensus.cc:493] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:50.628706  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:50.629686  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:50.630214  3922 leader_election.cc:304] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:50.631940  4102 raft_consensus.cc:2468] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 4.
I20260709 13:14:50.552688  5846 consensus_queue.cc:1048] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 13:14:50.552713  5852 consensus_queue.cc:1048] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 13:14:50.630338  4104 raft_consensus.cc:2468] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 3.
I20260709 13:14:50.621516  5801 raft_consensus.cc:2804] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:50.555162  5798 consensus_queue.cc:1048] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 13:14:50.657084  5865 raft_consensus.cc:1064] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc: attempting to promote NON_VOTER d709ee666b774ec29aa732e508219938 to VOTER
I20260709 13:14:50.639755  3922 leader_election.cc:304] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:50.640727  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:50.661368  4102 raft_consensus.cc:2410] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:14:50.639107  5403 raft_consensus.cc:2804] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:50.568843  5822 consensus_queue.cc:1048] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:14:50.618984  5815 raft_consensus.cc:493] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:50.638782  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:50.623754  5853 raft_consensus.cc:2804] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:50.649736  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:50.649860  5849 consensus_queue.cc:1048] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:50.642436  5820 raft_consensus.cc:2749] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:50.652092  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:50.640504  5826 raft_consensus.cc:493] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:50.680493  5826 raft_consensus.cc:515] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:50.653925  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:50.654072  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:50.635627  5550 raft_consensus.cc:515] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:50.653951  4074 leader_election.cc:304] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:50.592371  5858 raft_consensus.cc:515] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:50.664076  4672 leader_election.cc:304] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:50.670843  5829 raft_consensus.cc:2749] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:50.673502  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:50.705267  4102 raft_consensus.cc:2410] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:14:50.686754  5826 leader_election.cc:290] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:50.682921  5853 raft_consensus.cc:697] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:50.687788  4104 raft_consensus.cc:1240] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:14:50.688076  5550 leader_election.cc:290] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:50.688331  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:50.672396  5815 raft_consensus.cc:3060] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:50.692201  4103 raft_consensus.cc:1240] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:50.719594  4106 raft_consensus.cc:1275] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:50.683293  4105 raft_consensus.cc:2468] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3.
W20260709 13:14:50.696906  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 51448.2us
W20260709 13:14:50.657603  5865 raft_consensus.cc:1068] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc: Unable to promote non-voter d709ee666b774ec29aa732e508219938: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:14:50.699697  5886 log.cc:927] Time spent T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:14:50.643479  5674 consensus_queue.cc:1048] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:14:50.738703  4030 raft_consensus.cc:1275] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:14:50.715399  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 61529.6us
I20260709 13:14:50.666419  5630 consensus_queue.cc:1048] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:14:50.714591  5876 raft_consensus.cc:2804] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:50.730959  3997 leader_election.cc:304] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:50.732817  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:50.734615  4025 raft_consensus.cc:1275] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:14:50.735010  4034 raft_consensus.cc:1275] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:14:50.721894  5843 raft_consensus.cc:493] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:50.737696  4100 raft_consensus.cc:1240] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:50.668661  5801 raft_consensus.cc:697] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:50.762544  5801 consensus_queue.cc:237] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:50.679297  5403 raft_consensus.cc:697] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:50.742221  4103 raft_consensus.cc:1240] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:50.743394  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:50.769423  4032 raft_consensus.cc:2468] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 3.
I20260709 13:14:50.737280  3955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38612 (request call id 932) took 1034 ms. Trace:
I20260709 13:14:50.745805  4025 pending_rounds.cc:85] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2: Aborting all ops after (but not including) 1
I20260709 13:14:50.747572  4029 raft_consensus.cc:1275] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:14:50.770363  4025 pending_rounds.cc:107] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:14:50.770267  3955 rpcz_store.cc:276] 0709 13:14:49.690735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:49.739586 (+ 48851us) service_pool.cc:224] Handling call
0709 13:14:50.725086 (+985500us) spinlock_profiling.cc:243] Waited 341 ms on lock 0x7b5400188dd4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:14:50.725188 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":783924096}
I20260709 13:14:50.770845  4025 raft_consensus.cc:2889] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:50.755158  4106 raft_consensus.cc:1275] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:14:50.771370  4106 pending_rounds.cc:85] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Aborting all ops after (but not including) 4
I20260709 13:14:50.771672  4106 pending_rounds.cc:107] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Aborting uncommitted NO_OP operation due to leader change: 3.5
W20260709 13:14:50.771502  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 131894us
I20260709 13:14:50.772027  4106 raft_consensus.cc:2889] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:50.720057  5798 raft_consensus.cc:2804] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:50.684361  5757 raft_consensus.cc:515] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:14:50.822625  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 68269.6us
I20260709 13:14:50.746456  5876 raft_consensus.cc:493] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:50.758778  5826 raft_consensus.cc:493] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:50.760591  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:50.761389  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:50.738206  5792 raft_consensus.cc:493] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:50.758181  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:14:50.832837  3925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:50.741500  5503 consensus_queue.cc:1048] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.084s
I20260709 13:14:50.839653  3922 leader_election.cc:304] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:50.843627  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:50.844344  4034 raft_consensus.cc:3060] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:50.747009  5852 consensus_queue.cc:1048] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.089s
W20260709 13:14:50.835011  5868 log.cc:927] Time spent T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:14:50.835834  5876 raft_consensus.cc:3060] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:50.772965  5688 consensus_queue.cc:1048] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.078s
I20260709 13:14:50.853511  5820 raft_consensus.cc:2804] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:50.819415  5798 raft_consensus.cc:493] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:50.837307  5865 raft_consensus.cc:493] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:50.777243  5843 raft_consensus.cc:515] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:50.826226  5842 consensus_queue.cc:1048] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
W20260709 13:14:50.899515  3924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:50.840901  5826 raft_consensus.cc:515] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:50.904464  4073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 59983.2us
I20260709 13:14:50.856686  5493 consensus_queue.cc:1048] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:14:50.845124  5792 raft_consensus.cc:515] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:14:50.903399  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 51389.4us
I20260709 13:14:50.886370  5798 raft_consensus.cc:3060] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:50.881640  5820 raft_consensus.cc:493] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:50.907591  5820 raft_consensus.cc:3060] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:50.917740  5858 leader_election.cc:290] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:50.922487  5843 leader_election.cc:290] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:50.925035  5896 log.cc:927] Time spent T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 13:14:50.925160  5826 leader_election.cc:290] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:50.928649  5792 leader_election.cc:290] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:50.929359  4704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:50.852350  3922 leader_election.cc:304] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:50.953806  4034 raft_consensus.cc:2468] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 5.
I20260709 13:14:50.955824  3925 leader_election.cc:304] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:50.929675  5894 raft_consensus.cc:2764] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:14:50.854148  5900 raft_consensus.cc:493] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:50.968690  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 116470us
I20260709 13:14:50.969889  3922 leader_election.cc:400] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843) with higher term. Message: Invalid argument: T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 2. Current term is 3.
I20260709 13:14:50.970269  3922 leader_election.cc:403] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:14:50.974411  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:50.900341  5865 raft_consensus.cc:515] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:50.842749  5853 consensus_queue.cc:237] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:50.959712  5858 raft_consensus.cc:2749] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:50.940649  4704 raft_consensus.cc:2468] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 3.
I20260709 13:14:50.998709  5829 raft_consensus.cc:2749] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843) with higher term. Message: Invalid argument: T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 2. Current term is 3.
I20260709 13:14:50.960671  5908 raft_consensus.cc:2804] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:51.003353  3922 leader_election.cc:304] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
W20260709 13:14:51.006523  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 168833us
I20260709 13:14:50.983765  4700 raft_consensus.cc:1240] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 5 LEADER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:51.009418  3922 leader_election.cc:304] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:51.030885  5829 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:51.031204  3999 leader_election.cc:304] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:51.031517  5829 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:51.032377  5550 raft_consensus.cc:2804] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:51.032809  5550 raft_consensus.cc:493] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:51.033180  5550 raft_consensus.cc:3060] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:51.033691  5829 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:51.034147  5823 leader_election.cc:290] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:51.034291  5829 raft_consensus.cc:493] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:51.034871  5829 raft_consensus.cc:515] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:51.036578  5548 consensus_queue.cc:1059] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:51.037557  5548 raft_consensus.cc:3055] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:51.037902  5548 raft_consensus.cc:740] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:14:51.039134  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:51.039803  4034 raft_consensus.cc:3060] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:14:51.039880  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:51.040633  4025 raft_consensus.cc:2468] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3.
I20260709 13:14:51.042253  5841 raft_consensus.cc:2749] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:51.043318  5550 raft_consensus.cc:515] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:51.044528  5820 raft_consensus.cc:515] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:51.046784  5820 leader_election.cc:290] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:51.047369  4704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:50.980556  5900 raft_consensus.cc:515] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:14:51.047982  4704 raft_consensus.cc:3060] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:51.049551  5900 leader_election.cc:290] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:51.050486  5903 log.cc:927] Time spent T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:14:51.047888  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:51.051625  4026 raft_consensus.cc:2468] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3.
I20260709 13:14:50.930138  5403 consensus_queue.cc:237] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:51.055428  3925 leader_election.cc:304] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:51.057479  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:51.057695  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:51.058667  4026 raft_consensus.cc:2393] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 4: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:14:51.063843  3925 leader_election.cc:304] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:51.065086  5841 raft_consensus.cc:493] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:51.065634  5841 raft_consensus.cc:515] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:51.015255  5826 raft_consensus.cc:2749] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:14:51.067893  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 352582us
I20260709 13:14:51.072407  4034 raft_consensus.cc:2468] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 5.
I20260709 13:14:51.072480  4707 raft_consensus.cc:2468] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3.
I20260709 13:14:51.038875  5548 consensus_queue.cc:260] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:51.016474  5858 raft_consensus.cc:2749] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:51.085054  3925 leader_election.cc:304] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:51.029479  5908 raft_consensus.cc:697] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 5 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:51.091368  3997 leader_election.cc:304] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:51.069654  5820 raft_consensus.cc:2804] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:51.053351  5550 leader_election.cc:290] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:51.076609  5900 raft_consensus.cc:2804] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:51.088688  5757 leader_election.cc:290] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:51.114315  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 101461us
I20260709 13:14:51.094590  5822 raft_consensus.cc:493] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:51.075330  5675 consensus_queue.cc:1048] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:14:51.086731  5842 consensus_queue.cc:1048] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:14:51.105710  5900 raft_consensus.cc:493] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:51.146929  3997 leader_election.cc:304] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:14:51.154672  3924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:51.100564  5847 raft_consensus.cc:2749] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:51.102362  5820 raft_consensus.cc:493] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:51.102540  4703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:51.111765  5548 raft_consensus.cc:3060] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:51.179869  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:51.218257  5919 raft_consensus.cc:493] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:51.218943  5919 raft_consensus.cc:515] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:14:51.191516  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:51.220345  4104 raft_consensus.cc:1240] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:51.181825  3997 leader_election.cc:304] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:51.223026  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:51.223385  5550 raft_consensus.cc:2804] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:51.179217  5900 raft_consensus.cc:3060] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:51.223815  4026 raft_consensus.cc:2468] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 5.
I20260709 13:14:51.224174  5550 raft_consensus.cc:493] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:51.224633  5550 raft_consensus.cc:3060] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:14:51.226084  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 44349.8us
I20260709 13:14:51.226619  4675 leader_election.cc:304] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:51.216842  5841 leader_election.cc:290] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:51.228195  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:51.234314  4101 raft_consensus.cc:3055] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:51.234871  4101 raft_consensus.cc:740] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:51.095009  5876 raft_consensus.cc:515] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:14:51.271644  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 45105.9us
I20260709 13:14:51.275213  5841 raft_consensus.cc:2804] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:51.223722  5899 raft_consensus.cc:2804] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:51.275772  5841 raft_consensus.cc:493] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:51.276192  5841 raft_consensus.cc:3060] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:51.276314  3953 raft_consensus.cc:1275] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:51.277601  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:51.278553  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:51.279268  3951 raft_consensus.cc:3060] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:51.279578  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:51.280490  5909 consensus_queue.cc:1048] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.206s
I20260709 13:14:51.235889  4101 consensus_queue.cc:260] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:51.283492  4101 raft_consensus.cc:3060] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:14:51.287014  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 59575.6us
I20260709 13:14:51.183712  5820 raft_consensus.cc:3060] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:51.304600  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:51.305570  3959 raft_consensus.cc:2393] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 4: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
W20260709 13:14:51.285727  5866 log.cc:927] Time spent T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:14:51.311838  3997 leader_election.cc:304] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:51.281491  5919 leader_election.cc:290] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:51.159370  5822 raft_consensus.cc:515] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:14:51.298702  5884 consensus_meta.cc:287] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.724s	user 0.002s	sys 0.010s
W20260709 13:14:51.321144  5910 log.cc:927] Time spent T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 13:14:51.327684  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:51.297250  5899 raft_consensus.cc:697] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 5 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:51.327478  3951 raft_consensus.cc:2468] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 5.
I20260709 13:14:51.332836  3959 raft_consensus.cc:1275] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:51.336934  3952 raft_consensus.cc:1240] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 4. Current term is 5. Ops: []
W20260709 13:14:51.350919  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 46918.9us
I20260709 13:14:51.351243  5917 raft_consensus.cc:2804] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:51.350462  5895 raft_consensus.cc:2804] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:14:51.311684  5815 consensus_meta.cc:287] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938: Time spent flushing consensus metadata: real 0.570s	user 0.009s	sys 0.003s
I20260709 13:14:51.372562  3951 raft_consensus.cc:1275] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:14:51.314643  5865 leader_election.cc:290] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:51.352269  5926 raft_consensus.cc:493] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:51.403045  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:51.401806  4026 raft_consensus.cc:1275] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:51.351974  5920 raft_consensus.cc:493] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:51.420696  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:51.358129  5858 raft_consensus.cc:493] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:51.410194  3997 leader_election.cc:304] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:51.424671  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:51.421759  4104 raft_consensus.cc:2468] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 4.
I20260709 13:14:51.414615  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:14:51.411979  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 326952us
I20260709 13:14:51.435789  4031 raft_consensus.cc:1275] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:14:51.401121  5895 raft_consensus.cc:493] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:51.426460  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:51.440805  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:51.455816  3959 raft_consensus.cc:1275] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:51.459705  4025 raft_consensus.cc:2410] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:14:51.354221  5884 raft_consensus.cc:515] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:51.461719  4031 raft_consensus.cc:2468] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 4.
I20260709 13:14:51.430346  5865 raft_consensus.cc:493] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:51.427816  5829 leader_election.cc:290] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:51.468400  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 52895.7us
I20260709 13:14:51.425697  5917 raft_consensus.cc:697] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:51.473589  3997 leader_election.cc:304] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:51.459203  5895 raft_consensus.cc:3060] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:51.349045  5908 consensus_queue.cc:237] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:51.478839  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:51.415856  5815 raft_consensus.cc:515] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:14:51.482767  5911 log.cc:927] Time spent T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:14:51.482864  5876 leader_election.cc:290] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:51.483804  5922 raft_consensus.cc:493] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:51.478785  5823 raft_consensus.cc:493] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:51.475030  5865 raft_consensus.cc:515] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:51.497295  5912 raft_consensus.cc:2804] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:14:51.502177  5916 log.cc:927] Time spent T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.466s	user 0.004s	sys 0.000s
I20260709 13:14:51.479082  5899 consensus_queue.cc:237] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:51.502764  4708 raft_consensus.cc:1240] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:51.458313  5403 consensus_queue.cc:1048] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:14:51.503465  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:51.519757  4031 raft_consensus.cc:3060] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:51.436995  5858 raft_consensus.cc:515] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:51.514825  4074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:51.461051  5675 consensus_queue.cc:1048] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:14:51.529331  4709 raft_consensus.cc:1240] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 4. Current term is 5. Ops: []
W20260709 13:14:51.534734  3925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:51.536396  3925 leader_election.cc:304] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:14:51.518675  5798 consensus_meta.cc:287] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.601s	user 0.009s	sys 0.003s
I20260709 13:14:51.514139  5912 raft_consensus.cc:493] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:51.429323  5920 raft_consensus.cc:515] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:51.517838  5474 raft_consensus.cc:493] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:51.440615  5926 raft_consensus.cc:515] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:51.526755  5823 raft_consensus.cc:515] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:51.552050  5912 raft_consensus.cc:3060] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:51.527383  5922 raft_consensus.cc:515] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:51.557593  5900 raft_consensus.cc:515] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:51.581904  5928 raft_consensus.cc:493] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:51.582557  5815 leader_election.cc:290] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:51.583015  5923 log.cc:927] Time spent T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:14:51.583717  5900 leader_election.cc:290] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:51.560510  5474 raft_consensus.cc:515] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:51.553386  5798 raft_consensus.cc:515] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:51.576294  5822 leader_election.cc:290] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:51.607481  5922 leader_election.cc:290] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:51.576493  5917 consensus_queue.cc:237] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:51.582592  5928 raft_consensus.cc:515] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:51.612933  5931 log.cc:927] Time spent T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:14:51.613731  5900 raft_consensus.cc:2804] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:14:51.582640  5934 log.cc:927] Time spent T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:14:51.626605  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
W20260709 13:14:51.648168  5938 log.cc:927] Time spent T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:14:51.649344  5550 raft_consensus.cc:515] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:51.652420  5884 leader_election.cc:290] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:14:51.715418  4704 consensus_meta.cc:287] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938: Time spent flushing consensus metadata: real 0.667s	user 0.011s	sys 0.000s
I20260709 13:14:51.725593  4704 raft_consensus.cc:2468] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 4.
I20260709 13:14:51.653916  5865 leader_election.cc:290] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:51.655961  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:51.657110  5920 leader_election.cc:290] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:51.730533  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:51.658456  5858 leader_election.cc:290] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:51.731251  4107 raft_consensus.cc:3060] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:51.669113  5841 raft_consensus.cc:515] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:14:51.622439  5935 log.cc:927] Time spent T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.066s	user 0.001s	sys 0.001s
I20260709 13:14:51.693253  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:51.712327  4708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:51.746408  4708 raft_consensus.cc:2468] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3.
W20260709 13:14:51.715935  3924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:51.717487  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:51.617147  5909 raft_consensus.cc:493] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:51.640811  5829 raft_consensus.cc:493] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:51.734531  3922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:51.736279  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
W20260709 13:14:51.664705  5906 log.cc:927] Time spent T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.505s	user 0.000s	sys 0.002s
W20260709 13:14:51.749145  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 212744us
I20260709 13:14:51.758502  4104 raft_consensus.cc:3060] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:51.718314  5821 raft_consensus.cc:493] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:51.758564  4031 raft_consensus.cc:2468] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 4.
I20260709 13:14:51.761943  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:51.762734  3957 raft_consensus.cc:2376] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d709ee666b774ec29aa732e508219938 in term 3. Re-sending same reply.
I20260709 13:14:51.764449  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:51.765102  3958 raft_consensus.cc:3060] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:51.717212  5900 raft_consensus.cc:493] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:51.770689  4102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45332 (request call id 1451) took 1225 ms. Trace:
I20260709 13:14:51.743975  5822 raft_consensus.cc:493] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:51.766399  4675 leader_election.cc:304] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:51.753539  5858 raft_consensus.cc:493] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:51.745378  4703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:51.777237  4102 rpcz_store.cc:276] 0709 13:14:50.545253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.713407 (+168154us) service_pool.cc:224] Handling call
0709 13:14:50.713774 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:50.714058 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:14:50.735881 (+ 21823us) log.cc:844] Serialized 14 byte log entry
0709 13:14:51.496842 (+760961us) spinlock_profiling.cc:243] Waited 1.67 ms on lock 0x7b180000ce20. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f1522563e07 00007f152b3beab9 00007f152258069b 00007f152257e93f 00007f1522580c02 00007f152520820b 00007f152520dd23 00007f152520e23a 00007f1525678a2a
0709 13:14:51.666745 (+169903us) spinlock_profiling.cc:243] Waited 6.96 ms on lock 0x7b180000ce20. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f15225813f3 00007f15225837c1 00007f1522583779 00007f1522583709 00007f15225836d1 00007f15225829cd 000000000038f354 000000000038f199 00007f152256483a
0709 13:14:51.770288 (+103543us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:51.770356 (+    68us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:14:51.770408 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:51.770476 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:51.770629 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":17433,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":3059,"raft.queue_time_us":13319,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":2310,"spinlock_wait_cycles":19862144,"thread_start_us":234787,"threads_started":2,"wal-append.queue_time_us":886986}
I20260709 13:14:51.786422  3922 leader_election.cc:304] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:51.789352  3959 raft_consensus.cc:1275] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:14:51.790541  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:51.791507  3958 raft_consensus.cc:2468] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 5.
I20260709 13:14:51.776578  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:51.792693  3958 raft_consensus.cc:1240] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:51.793036  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:51.755649  5936 raft_consensus.cc:493] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:51.796206  3922 leader_election.cc:304] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:51.796797  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:51.798588  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:51.770274  5920 raft_consensus.cc:493] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:51.779085  5900 raft_consensus.cc:3060] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:51.806793  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:51.808774  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:51.809412  3959 raft_consensus.cc:2468] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:51.815027  5960 raft_consensus.cc:2804] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:51.815835  5960 raft_consensus.cc:697] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [term 4 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:14:51.817703  3924 leader_election.cc:304] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:51.818569  5960 consensus_queue.cc:237] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:51.819054  3924 leader_election.cc:304] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:51.793635  4031 raft_consensus.cc:3060] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:51.795596  3958 raft_consensus.cc:1275] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:51.817699  5908 raft_consensus.cc:2749] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:14:51.827109  5820 consensus_meta.cc:287] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.512s	user 0.002s	sys 0.010s
I20260709 13:14:51.821619  5908 raft_consensus.cc:2804] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:51.828863  4107 raft_consensus.cc:2468] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 5.
I20260709 13:14:51.829983  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:51.831604  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:51.804813  5936 raft_consensus.cc:515] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:51.836788  5908 raft_consensus.cc:697] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 3 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:51.838399  5936 leader_election.cc:290] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:51.838121  5908 consensus_queue.cc:237] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:51.835412  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:51.766930  5829 raft_consensus.cc:515] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:51.771447  5821 raft_consensus.cc:515] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:51.839165  5951 raft_consensus.cc:2749] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:14:51.829422  5853 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.780s	user 0.005s	sys 0.013s
I20260709 13:14:51.838953  5820 raft_consensus.cc:515] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:51.858258  5550 leader_election.cc:290] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:51.804703  4700 raft_consensus.cc:1240] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 5. Current term is 6. Ops: []
W20260709 13:14:51.869665  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 67327.2us
I20260709 13:14:51.877346  4071 leader_election.cc:304] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:51.870050  3956 raft_consensus.cc:1240] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 5 LEADER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:51.807499  5823 leader_election.cc:290] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:51.803840  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:51.874275  4101 raft_consensus.cc:2468] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 4.
I20260709 13:14:51.788244  5822 raft_consensus.cc:515] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:51.846616  5826 raft_consensus.cc:2804] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:51.888834  4031 raft_consensus.cc:2468] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 4.
W20260709 13:14:51.876272  5853 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.005s	sys 0.014s
I20260709 13:14:51.808187  5920 raft_consensus.cc:515] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:51.807389  5858 raft_consensus.cc:515] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:51.890182  3925 leader_election.cc:304] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:51.779532  5909 raft_consensus.cc:515] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:51.902248  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:51.902710  3953 raft_consensus.cc:2393] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 5: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
W20260709 13:14:51.902755  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 83776.4us
I20260709 13:14:51.908015  4071 leader_election.cc:304] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:51.879341  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:51.932132  3924 leader_election.cc:304] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:14:51.888834  5823 raft_consensus.cc:493] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:51.941802  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:51.938449  4071 leader_election.cc:304] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:51.891317  5826 raft_consensus.cc:493] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:51.955312  4031 raft_consensus.cc:2468] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 5.
I20260709 13:14:51.883505  5865 consensus_queue.cc:1048] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:14:51.910051  5794 raft_consensus.cc:2749] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:14:51.958828  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 197273us
W20260709 13:14:51.960554  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 194222us
I20260709 13:14:51.964109  3925 leader_election.cc:304] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:14:51.974285  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 178197us
I20260709 13:14:51.976130  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:51.950233  5853 raft_consensus.cc:2749] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:51.944114  5798 leader_election.cc:290] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:51.947445  5936 raft_consensus.cc:493] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:51.956727  5951 raft_consensus.cc:2749] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:51.957038  5826 raft_consensus.cc:3060] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:51.956964  5841 leader_election.cc:290] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:51.984251  4031 raft_consensus.cc:2410] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:14:51.995180  5933 log.cc:927] Time spent T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.492s	user 0.005s	sys 0.002s
I20260709 13:14:51.963331  5705 leader_election.cc:290] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:52.039278  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 62106.8us
W20260709 13:14:52.070848  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:52.157941  4709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57692 (request call id 253) took 1592 ms. Trace:
I20260709 13:14:52.175169  4709 rpcz_store.cc:276] 0709 13:14:50.565559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.566048 (+   489us) service_pool.cc:224] Handling call
0709 13:14:50.566475 (+   427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:51.529870 (+963395us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:52.157551 (+627681us) spinlock_profiling.cc:243] Waited 963 ms on lock 0x7b540032cdd4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:14:52.157838 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2213833600}
I20260709 13:14:52.175734  3922 leader_election.cc:304] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:52.160298  5474 leader_election.cc:290] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:52.165940  5926 leader_election.cc:290] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:52.171422  5915 log.cc:927] Time spent T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.884s	user 0.000s	sys 0.012s
I20260709 13:14:51.950848  5823 raft_consensus.cc:515] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:52.181183  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:52.185997  5930 raft_consensus.cc:2804] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:52.186142  3922 leader_election.cc:304] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
W20260709 13:14:52.194876  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 219369us
I20260709 13:14:52.186038  5926 raft_consensus.cc:2804] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:52.187595  5945 raft_consensus.cc:2749] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:51.965750  5849 consensus_queue.cc:1048] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.211s
I20260709 13:14:52.195438  3922 leader_election.cc:304] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:51.998898  5675 consensus_queue.cc:1048] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.191s
I20260709 13:14:52.028120  5936 raft_consensus.cc:515] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:52.187907  5905 raft_consensus.cc:2804] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:52.186951  5953 consensus_queue.cc:1048] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.231s
W20260709 13:14:52.244347  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 48714.4us
I20260709 13:14:52.203174  5926 raft_consensus.cc:493] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:52.243939  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 279899us
I20260709 13:14:52.207729  5928 leader_election.cc:290] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:52.305186  4033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38290 (request call id 1518) took 1520 ms. Trace:
I20260709 13:14:52.316852  4033 rpcz_store.cc:276] 0709 13:14:50.728902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.729072 (+   170us) service_pool.cc:224] Handling call
0709 13:14:50.729651 (+   579us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:50.768548 (+ 38897us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:50.768585 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:50.820049 (+ 51464us) log.cc:844] Serialized 26 byte log entry
0709 13:14:50.997539 (+177490us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:14:50.997603 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:50.997703 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:52.170693 (+1172990us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b4400022b4c. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f15224a7c85 00007f15224a86a2 00007f152521a1db 00007f1525215aaf 00007f152520986e 00007f1525208bb6 00007f15252087d8 00007f1525212221 00007f15252121d9 00007f1525212169
0709 13:14:52.239892 (+ 69199us) raft_consensus.cc:1685] finished
0709 13:14:52.239915 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:52.249275 (+  9360us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20153,"raft.queue_time_us":36087,"raft.run_cpu_time_us":6588,"raft.run_wall_time_us":69172,"spinlock_wait_cycles":25722624,"thread_start_us":149157,"threads_started":1,"wal-append.queue_time_us":318003}
W20260709 13:14:52.311740  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 66538.5us
I20260709 13:14:52.208061  5899 raft_consensus.cc:2804] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:52.323845  4033 raft_consensus.cc:1240] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 4. Current term is 5. Ops: []
W20260709 13:14:52.324924  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 129605us
I20260709 13:14:52.326591  3922 leader_election.cc:304] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:14:52.211740  5705 consensus_queue.cc:1048] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.094s
I20260709 13:14:52.352082  4030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38290 (request call id 1522) took 1193 ms. Trace:
I20260709 13:14:52.247248  5821 leader_election.cc:290] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:52.341322  4672 leader_election.cc:336] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Timed out: RequestConsensusVote RPC to 127.2.198.193:35339 timed out after 1.597s (SENT)
I20260709 13:14:52.250411  5926 raft_consensus.cc:3060] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:52.353399  4030 rpcz_store.cc:276] 0709 13:14:51.158171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.169106 (+ 10935us) service_pool.cc:224] Handling call
0709 13:14:51.169537 (+   431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:51.169937 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:51.169961 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:51.170482 (+   521us) log.cc:844] Serialized 26 byte log entry
0709 13:14:51.415378 (+244896us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:14:51.415420 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:51.415486 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:51.994344 (+578858us) spinlock_profiling.cc:243] Waited 1.95 ms on lock 0x7b4400022b4c. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f15224a7c85 00007f15224a86a2 00007f152521a1db 00007f1525215aaf 00007f152520986e 00007f1525208bb6 00007f15252087d8 00007f1525212221 00007f15252121d9 00007f1525212169
0709 13:14:52.323934 (+329590us) raft_consensus.cc:1685] finished
0709 13:14:52.323963 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:52.351927 (+ 27964us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8867,"raft.queue_time_us":112,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":39405,"spinlock_wait_cycles":4488064,"thread_start_us":123296,"threads_started":1,"wal-append.queue_time_us":236217}
I20260709 13:14:52.340052  4071 leader_election.cc:304] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:52.360149  4672 leader_election.cc:304] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:52.259135  5905 raft_consensus.cc:697] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:52.327791  5899 raft_consensus.cc:493] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:52.320313  5474 raft_consensus.cc:493] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:52.380995  5675 raft_consensus.cc:2804] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:52.328434  5815 raft_consensus.cc:493] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
W20260709 13:14:52.394848  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 68351.1us
I20260709 13:14:52.373374  5820 leader_election.cc:290] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:52.368875  5829 leader_election.cc:290] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:52.358912  5928 consensus_queue.cc:1059] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:14:52.389019  5899 raft_consensus.cc:3060] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:52.395985  5675 raft_consensus.cc:493] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:52.396426  5858 leader_election.cc:290] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:52.390187  5930 raft_consensus.cc:697] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 4 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:52.395685  5794 consensus_queue.cc:1048] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:14:52.454201  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:52.433079  5945 raft_consensus.cc:2749] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:52.451041  5820 raft_consensus.cc:493] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:52.451603  5928 consensus_queue.cc:1243] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer f1c75790cedf4f52a3463a255c7da059 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 13:14:52.447306  4104 consensus_meta.cc:287] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.685s	user 0.010s	sys 0.011s
I20260709 13:14:52.449354  3922 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:14:52.480010  4104 raft_consensus.cc:2468] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 4.
I20260709 13:14:52.460494  5909 leader_election.cc:290] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:14:52.455415  5952 log.cc:927] Time spent T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.478s	user 0.001s	sys 0.000s
I20260709 13:14:52.401422  5474 raft_consensus.cc:515] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:52.461391  5898 raft_consensus.cc:493] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:52.452631  5823 leader_election.cc:290] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:52.487165  5898 raft_consensus.cc:515] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:52.489094  5891 log.cc:927] Time spent T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 1.417s	user 0.000s	sys 0.005s
I20260709 13:14:52.490119  5898 leader_election.cc:290] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:52.490341  5965 raft_consensus.cc:2749] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:14:52.484565  5967 log.cc:927] Time spent T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.269s	user 0.003s	sys 0.001s
W20260709 13:14:52.491065  5950 log.cc:927] Time spent T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.487s	user 0.002s	sys 0.000s
I20260709 13:14:52.492399  5959 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:52.493044  5959 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:52.495597  5962 consensus_queue.cc:1059] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.259s
I20260709 13:14:52.499239  3953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38606 (request call id 1570) took 1261 ms. Trace:
I20260709 13:14:52.495754  5976 raft_consensus.cc:2749] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:52.499683  3953 rpcz_store.cc:276] 0709 13:14:51.237375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.277322 (+ 39947us) service_pool.cc:224] Handling call
0709 13:14:52.498921 (+1221599us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b540042a254. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:14:52.499108 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1435766656}
W20260709 13:14:52.496958  5966 log.cc:927] Time spent T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
I20260709 13:14:52.501538  5976 raft_consensus.cc:3055] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:52.502002  5976 raft_consensus.cc:740] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:52.404181  5815 raft_consensus.cc:515] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:52.487317  5936 leader_election.cc:290] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:52.498107  5829 raft_consensus.cc:493] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:52.447854  5675 raft_consensus.cc:3060] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:52.453130  4105 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "d709ee666b774ec29aa732e508219938"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:14:52.455726  5841 raft_consensus.cc:493] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
W20260709 13:14:52.499171  5912 consensus_meta.cc:287] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 0.920s	user 0.010s	sys 0.002s
I20260709 13:14:52.526789  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:52.536145  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:14:52.528229  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 79221.2us
W20260709 13:14:52.534519  3957 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.005s	sys 0.004s
I20260709 13:14:52.536823  3953 raft_consensus.cc:3060] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:52.537343  3922 leader_election.cc:304] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:52.502898  5976 consensus_queue.cc:260] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:52.529227  5829 raft_consensus.cc:515] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:14:52.538674  3957 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.006s	sys 0.005s
I20260709 13:14:52.540072  4672 leader_election.cc:304] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:52.548475  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:52.558393  3954 raft_consensus.cc:2393] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 3: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
W20260709 13:14:52.555153  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 1.08165e+06us
I20260709 13:14:52.494988  5705 raft_consensus.cc:493] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:14:52.471276  5820 raft_consensus.cc:515] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:52.554632  4027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38290 (request call id 1528) took 1150 ms. Trace:
I20260709 13:14:52.560390  3997 leader_election.cc:304] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:52.564405  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:52.566766  3922 leader_election.cc:304] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:52.576970  4709 raft_consensus.cc:2410] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:14:52.529945  5823 raft_consensus.cc:2749] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:14:52.571270  3999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 1.02982e+06us
I20260709 13:14:52.528885  5959 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:52.536396  5936 raft_consensus.cc:493] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:52.550846  3953 raft_consensus.cc:2468] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 4.
W20260709 13:14:52.582948  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:52.574894  4027 rpcz_store.cc:276] 0709 13:14:51.404116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.404352 (+   236us) service_pool.cc:224] Handling call
0709 13:14:51.426813 (+ 22461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:51.427060 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:14:51.457574 (+ 30514us) log.cc:844] Serialized 14 byte log entry
0709 13:14:52.554079 (+1096505us) spinlock_profiling.cc:243] Waited 5.66 ms on lock 0x7b180035d880. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f15224fbc0a 00007f152bc3b219 00007f1522583a40 00007f152257e4e4 00007f152257e455 00007f1525666060 00007f1525678716 00007f1525689287 00007f1525689208
0709 13:14:52.554238 (+   159us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:52.554294 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:52.554353 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:52.554427 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:52.554563 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6530,"prepare.queue_time_us":35281,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":4751,"raft.queue_time_us":1107043,"spinlock_wait_cycles":13027584}
I20260709 13:14:52.541903  5474 leader_election.cc:290] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:52.552579  5829 leader_election.cc:290] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:52.542346  5974 raft_consensus.cc:3055] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:55.373358  5974 raft_consensus.cc:740] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:55.374496  5974 consensus_queue.cc:260] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:52.472114  5905 consensus_queue.cc:237] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:52.590296  5820 leader_election.cc:290] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:52.544956  5930 consensus_queue.cc:237] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:52.582619  5879 raft_consensus.cc:2804] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:14:52.596199  5900 consensus_meta.cc:287] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.767s	user 0.012s	sys 0.000s
I20260709 13:14:52.596043  5941 raft_consensus.cc:2749] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:52.596906  5985 raft_consensus.cc:493] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:52.599267  5895 consensus_meta.cc:287] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 1.095s	user 0.005s	sys 0.007s
I20260709 13:14:55.380915  5900 raft_consensus.cc:515] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:55.381349  5985 raft_consensus.cc:515] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:55.381461  5895 raft_consensus.cc:515] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:55.383117  5985 leader_election.cc:290] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:55.383268  5900 leader_election.cc:290] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:55.383694  5895 leader_election.cc:290] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:52.602555  5899 raft_consensus.cc:515] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:52.592329  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:55.460623  3954 raft_consensus.cc:2468] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 4.
W20260709 13:14:55.461323  3954 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38606 (request call id 1587) took 2949 ms (client timeout 2056 ms). Trace:
W20260709 13:14:55.461711  3954 rpcz_store.cc:269] 0709 13:14:52.512312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:52.591869 (+ 79557us) service_pool.cc:224] Handling call
0709 13:14:55.461230 (+2869361us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:55.462946  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:14:52.599134  4071 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.198.193:35339 timed out after 1.718s (SENT) [suppressed 23 similar messages]
I20260709 13:14:52.658089  5959 raft_consensus.cc:493] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:55.466666  5959 raft_consensus.cc:515] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:55.469749  5959 leader_election.cc:290] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:52.538112  4105 raft_consensus.cc:606] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Received request to transfer leadership to TS d709ee666b774ec29aa732e508219938
W20260709 13:14:53.659925  5986 log.cc:927] Time spent T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.687s	user 0.002s	sys 0.000s
I20260709 13:14:55.472186  4105 raft_consensus.cc:614] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:14:55.066376  3951 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38606 (request call id 1584) took 2555 ms (client timeout 2199 ms). Trace:
W20260709 13:14:55.473366  3951 rpcz_store.cc:269] 0709 13:14:52.510424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.066079 (+2555655us) service_pool.cc:211] Skipping call since client already timed out
0709 13:14:55.066262 (+   183us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:14:55.474969  3951 raft_consensus.cc:1275] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:14:55.475461  5928 raft_consensus.cc:493] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.476262  5928 raft_consensus.cc:515] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:55.268462  5969 log.cc:927] Time spent T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 2.825s	user 0.011s	sys 0.020s
I20260709 13:14:55.343443  4708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57666 (request call id 381) took 3578 ms. Trace:
W20260709 13:14:55.371049  4073 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.796s	user 0.015s	sys 0.030s
W20260709 13:14:55.478679  4073 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.904s	user 0.016s	sys 0.031s
I20260709 13:14:55.478368  4708 rpcz_store.cc:276] 0709 13:14:51.764791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.764923 (+   132us) service_pool.cc:224] Handling call
0709 13:14:55.342736 (+3577813us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b5800003f98. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f1522549b71 00007f1522549a22 00007f152b462c09 00007f152a5bcee0 00007f152a6860ab 00007f152a686131 00007f152a647fc0 00007f152a632929 00007f152a6323d2 00007f1523ba9bd4
0709 13:14:55.342940 (+   204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:55.343112 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:55.343149 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:55.343179 (+    30us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:55.343203 (+    24us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.343245 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:55.343362 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5089024}
I20260709 13:14:55.480301  3957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1572) took 3707 ms. Trace:
I20260709 13:14:55.391944  3956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35354 (request call id 143) took 3632 ms. Trace:
I20260709 13:14:55.480758  3957 rpcz_store.cc:276] 0709 13:14:51.772492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.782443 (+  9951us) service_pool.cc:224] Handling call
0709 13:14:51.782771 (+   328us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:51.794196 (+ 11425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:51.794236 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:51.804347 (+ 10111us) log.cc:844] Serialized 52 byte log entry
0709 13:14:51.941662 (+137315us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:14:51.959879 (+ 18217us) log.cc:844] Serialized 14 byte log entry
0709 13:14:51.979023 (+ 19144us) log.cc:844] Serialized 14 byte log entry
0709 13:14:52.556270 (+577247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:52.556353 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:55.267559 (+2711206us) spinlock_profiling.cc:243] Waited 8.71 ms on lock 0x7b4400022b4c. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f15224a7c85 00007f15224a86a2 00007f152521a1db 00007f1525215aaf 00007f152520986e 00007f1525208bb6 00007f15252087d8 00007f1525212221 00007f15252121d9 00007f1525212169
0709 13:14:55.480050 (+212491us) raft_consensus.cc:1685] finished
0709 13:14:55.480077 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:55.480235 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15939,"prepare.queue_time_us":73590,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":96,"raft.queue_time_us":444331,"raft.run_cpu_time_us":332,"raft.run_wall_time_us":5005,"spinlock_wait_cycles":20039040,"thread_start_us":637210,"threads_started":2,"wal-append.queue_time_us":415079}
I20260709 13:14:55.481980  3956 rpcz_store.cc:276] 0709 13:14:51.759348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.763702 (+  4354us) service_pool.cc:224] Handling call
0709 13:14:51.764008 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:51.878334 (+114326us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.391486 (+3513152us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b54001694d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:14:55.391848 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":243220736}
I20260709 13:14:55.483865  3956 raft_consensus.cc:1275] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:55.484470  3956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1585) took 2973 ms. Trace:
I20260709 13:14:55.484809  3956 rpcz_store.cc:276] 0709 13:14:52.510700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.483022 (+2972322us) service_pool.cc:224] Handling call
0709 13:14:55.483423 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:55.484212 (+   789us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.484401 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:55.485869  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:55.486235  3956 raft_consensus.cc:1240] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:14:55.486985  3956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1588) took 2974 ms. Trace:
W20260709 13:14:55.394654  5958 log.cc:927] Time spent T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 3.367s	user 0.006s	sys 0.036s
I20260709 13:14:55.488907  5954 raft_consensus.cc:493] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.489494  5954 raft_consensus.cc:515] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:55.490381  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:55.491986  5954 leader_election.cc:290] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:55.492132  4073 leader_election.cc:304] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:14:55.493104  5913 raft_consensus.cc:2749] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:14:55.404737  3958 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.867s	user 0.035s	sys 0.013s
I20260709 13:14:55.417186  4707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57666 (request call id 379) took 3669 ms. Trace:
I20260709 13:14:55.421610  3950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35354 (request call id 142) took 3662 ms. Trace:
W20260709 13:14:55.495770  3925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:55.496429  3925 connection.cc:256] RPC call timeout handler was delayed by -1.8402040070000112s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1553s for a response
W20260709 13:14:55.497088  3925 connection.cc:256] RPC call timeout handler was delayed by -1.7916040069999326s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1607s for a response
W20260709 13:14:55.497423  3925 connection.cc:256] RPC call timeout handler was delayed by -1.621504006999885s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1796s for a response
I20260709 13:14:55.495702  3950 rpcz_store.cc:276] 0709 13:14:51.759025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.763483 (+  4458us) service_pool.cc:224] Handling call
0709 13:14:51.781202 (+ 17719us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:51.889715 (+108513us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:51.889754 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:51.890328 (+   574us) log.cc:844] Serialized 26 byte log entry
0709 13:14:52.202193 (+311865us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:52.202243 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.421092 (+3218849us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b5400187ed4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:14:55.421149 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:55.421209 (+    60us) raft_consensus.cc:1685] finished
0709 13:14:55.421228 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:55.421529 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20859,"raft.queue_time_us":2790,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":7925,"spinlock_wait_cycles":248546176,"thread_start_us":311400,"threads_started":1,"wal-append.queue_time_us":547332,"wal-append.run_cpu_time_us":2243,"wal-append.run_wall_time_us":1189192}
W20260709 13:14:55.497716  3925 connection.cc:256] RPC call timeout handler was delayed by -1.5297040069999639s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1898s for a response
W20260709 13:14:55.498056  3925 connection.cc:256] RPC call timeout handler was delayed by -1.4728516130001026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1646s for a response
I20260709 13:14:55.500480  5928 leader_election.cc:290] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:14:55.501048  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 2.90173e+06us
I20260709 13:14:52.615288  5815 leader_election.cc:290] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:14:52.693861  5826 consensus_meta.cc:287] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.519s	user 0.006s	sys 0.006s
I20260709 13:14:55.506815  5826 raft_consensus.cc:515] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:55.385651  5879 raft_consensus.cc:697] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 5 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:14:55.385895  5899 leader_election.cc:290] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:55.418418  5920 leader_election.cc:290] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:55.822973  5895 raft_consensus.cc:493] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:55.823647  5895 raft_consensus.cc:515] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:55.825927  5895 leader_election.cc:290] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:55.826406  5895 raft_consensus.cc:493] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:55.826848  5895 raft_consensus.cc:515] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:52.576748  5922 raft_consensus.cc:493] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:14:55.829239  5922 raft_consensus.cc:515] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:52.806932  5926 raft_consensus.cc:515] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:55.834870  5926 leader_election.cc:290] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:52.622527  5936 raft_consensus.cc:515] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:55.838415  5936 leader_election.cc:290] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:14:53.676905  5675 consensus_meta.cc:287] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 1.138s	user 0.009s	sys 0.004s
I20260709 13:14:52.578933  5705 raft_consensus.cc:515] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:55.840952  5675 raft_consensus.cc:515] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:55.843001  5705 leader_election.cc:290] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:52.539113  5841 raft_consensus.cc:515] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:52.548511  5912 raft_consensus.cc:515] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:52.827306  5965 raft_consensus.cc:493] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.853655  5550 raft_consensus.cc:493] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.853931  5965 raft_consensus.cc:515] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:55.854215  5550 raft_consensus.cc:515] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:55.442070  5983 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.856204  5550 leader_election.cc:290] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:55.856427  5983 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:55.857180  5894 raft_consensus.cc:2804] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:55.857111  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:55.857863  5894 raft_consensus.cc:697] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:55.857972  4027 raft_consensus.cc:2468] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 1.
I20260709 13:14:55.858764  5983 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:55.472823  4105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:34352 (request call id 10) took 3084 ms. Trace:
I20260709 13:14:55.859388  4105 rpcz_store.cc:276] 0709 13:14:52.388177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:52.404442 (+ 16265us) service_pool.cc:224] Handling call
0709 13:14:55.472725 (+3068283us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:55.859836  4030 raft_consensus.cc:1275] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:55.475596  3951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1581) took 2966 ms. Trace:
I20260709 13:14:55.860391  3951 rpcz_store.cc:276] 0709 13:14:52.509477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.474208 (+2964731us) service_pool.cc:224] Handling call
0709 13:14:55.474586 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:55.475318 (+   732us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.475517 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:55.860863  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:55.861500  4030 raft_consensus.cc:2468] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 4.
W20260709 13:14:55.100538  5972 log.cc:927] Time spent T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 2.713s	user 0.013s	sys 0.016s
W20260709 13:14:55.427119  3955 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.903s	user 0.013s	sys 0.071s
W20260709 13:14:55.863051  3955 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.339s	user 0.014s	sys 0.071s
I20260709 13:14:55.494333  4704 raft_consensus.cc:1240] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:55.864725  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:55.865533  4033 raft_consensus.cc:2393] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 in current term 4: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:14:55.865607  3952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1573) took 4092 ms. Trace:
W20260709 13:14:55.502261  3958 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.964s	user 0.036s	sys 0.013s
I20260709 13:14:55.866778  4033 raft_consensus.cc:1275] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:55.866930  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:55.867449  3958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1579) took 3358 ms. Trace:
I20260709 13:14:55.867631  4702 raft_consensus.cc:2468] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3.
I20260709 13:14:55.868186  4709 raft_consensus.cc:1275] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:14:55.868592  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:55.868989  4701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:55.869736  5945 raft_consensus.cc:2749] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:55.870699  5965 leader_election.cc:290] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:55.501116  5976 raft_consensus.cc:3060] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:55.858878  5894 consensus_queue.cc:237] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:55.871822  3924 leader_election.cc:304] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:55.494815  4707 rpcz_store.cc:276] 0709 13:14:51.748245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.748426 (+   181us) service_pool.cc:224] Handling call
0709 13:14:55.416201 (+3667775us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b5800003f98. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f1522549b71 00007f1522549a22 00007f152b462c09 00007f152a5bcee0 00007f152a6860ab 00007f152a686131 00007f152a647fc0 00007f152a632929 00007f152a6323d2 00007f1523ba9bd4
0709 13:14:55.416502 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:55.416749 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:55.416781 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:55.416831 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:55.416870 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.416936 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:55.417100 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4611968}
I20260709 13:14:55.502661  5913 consensus_queue.cc:1059] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:55.508177  4071 leader_election.cc:304] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:55.875933  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:55.511736  5921 raft_consensus.cc:493] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:14:55.517978  5928 raft_consensus.cc:493] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.521790  6003 raft_consensus.cc:493] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.552214  4034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38290 (request call id 1524) took 4371 ms. Trace:
I20260709 13:14:55.867862  3958 rpcz_store.cc:276] 0709 13:14:52.508808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:52.508933 (+   125us) service_pool.cc:224] Handling call
0709 13:14:52.509317 (+   384us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:52.520141 (+ 10824us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:52.520177 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:52.520904 (+   727us) log.cc:844] Serialized 52 byte log entry
0709 13:14:55.867084 (+3346180us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:14:55.867127 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.867216 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:55.867257 (+    41us) raft_consensus.cc:1685] finished
0709 13:14:55.867270 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:55.867394 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14681,"raft.queue_time_us":122,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":16729,"thread_start_us":3329048,"threads_started":1,"wal-append.queue_time_us":143718,"wal-append.run_cpu_time_us":2345,"wal-append.run_wall_time_us":1017260}
I20260709 13:14:55.876822  4034 rpcz_store.cc:276] 0709 13:14:51.180558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.180804 (+   246us) service_pool.cc:224] Handling call
0709 13:14:51.181170 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:51.181550 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:51.181579 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:52.170176 (+988597us) spinlock_profiling.cc:243] Waited 9.67 ms on lock 0x7b48000cda58. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152a597aa1 00007f152a58eb37 00007f152a58e9ca 00007f152a68626f 00007f152a685f37 00007f152a69a55c 00007f152a69a508 00007f152a69a488 00007f152a69a443 00007f152a6996ec 00007f15295c3a96
0709 13:14:52.597619 (+427443us) spinlock_profiling.cc:243] Waited 9.44 ms on lock 0x7b180035db20. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f152254f2a6 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1523f67a11 00007f1523f77372 00007f15256a9a01 00007f152566e43a
0709 13:14:52.603052 (+  5433us) spinlock_profiling.cc:243] Waited 51.1 ms on lock 0x7b2c00034798. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1523f67a11 00007f1523f77372 00007f15256a9a01 00007f152566e43a 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2
0709 13:14:55.489988 (+2886936us) log.cc:844] Serialized 26 byte log entry
0709 13:14:55.551655 (+ 61667us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:14:55.551733 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.551846 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:55.551902 (+    56us) raft_consensus.cc:1685] finished
0709 13:14:55.551919 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:55.552098 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":449824,"raft.queue_time_us":2064,"raft.run_cpu_time_us":8568,"raft.run_wall_time_us":887179,"spinlock_wait_cycles":161462400,"thread_start_us":61183,"threads_started":1,"wal-append.queue_time_us":59178}
I20260709 13:14:55.878832  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:55.553849  6004 raft_consensus.cc:493] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.557420  5815 raft_consensus.cc:493] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:55.558619  3950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1589) took 3045 ms. Trace:
I20260709 13:14:55.560262  4026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38290 (request call id 1531) took 4142 ms. Trace:
I20260709 13:14:55.563663  5829 raft_consensus.cc:493] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.892432  5936 raft_consensus.cc:2804] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:55.893059  5936 raft_consensus.cc:493] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:55.892745  5829 raft_consensus.cc:515] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:55.893462  5936 raft_consensus.cc:3060] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:55.893158  6004 raft_consensus.cc:515] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:55.564384  5944 raft_consensus.cc:493] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:14:55.891245  5928 raft_consensus.cc:515] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:55.571152  4025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38290 (request call id 1534) took 3943 ms. Trace:
I20260709 13:14:55.590185  5822 leader_election.cc:290] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:55.593899  5999 raft_consensus.cc:493] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:55.593936  4675 connection.cc:256] RPC call timeout handler was delayed by -1.7974498140001742s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2017s for a response
I20260709 13:14:55.897338  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:14:55.595266  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 3.02841e+06us
I20260709 13:14:55.892014  3950 rpcz_store.cc:276] 0709 13:14:52.512944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.498085 (+2985141us) service_pool.cc:224] Handling call
0709 13:14:55.498476 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:55.522409 (+ 23933us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:55.522445 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:55.522932 (+   487us) log.cc:844] Serialized 26 byte log entry
0709 13:14:55.556572 (+ 33640us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:14:55.556612 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.556699 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:55.558318 (+  1619us) raft_consensus.cc:1685] finished
0709 13:14:55.558348 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:55.558551 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":209564,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":179,"thread_start_us":56736,"threads_started":2,"wal-append.queue_time_us":33659}
I20260709 13:14:55.595829  5959 raft_consensus.cc:493] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
W20260709 13:14:55.598434  3953 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38606 (request call id 1577) took 3111 ms (client timeout 1934 ms). Trace:
I20260709 13:14:55.603833  5955 raft_consensus.cc:493] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.604477  3957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1586) took 3093 ms. Trace:
I20260709 13:14:55.609548  3959 raft_consensus.cc:1240] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 3. Current term is 4. Ops: []
W20260709 13:14:55.625945  4672 connection.cc:256] RPC call timeout handler was delayed by -2.712880708000057s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2138s for a response
W20260709 13:14:55.899871  3953 rpcz_store.cc:269] 0709 13:14:52.497632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:52.507957 (+ 10325us) service_pool.cc:224] Handling call
0709 13:14:55.598322 (+3090365us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:55.645072  5852 raft_consensus.cc:493] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.651777  4100 pending_rounds.cc:85] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Aborting all ops after (but not including) 5
I20260709 13:14:55.693708  5858 raft_consensus.cc:493] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.907109  4100 pending_rounds.cc:107] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:14:55.907505  4100 raft_consensus.cc:2889] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:55.696177  4031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38290 (request call id 1539) took 3813 ms. Trace:
W20260709 13:14:55.697054  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 57523.3us
I20260709 13:14:55.892118  4026 rpcz_store.cc:276] 0709 13:14:51.417932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.420169 (+  2237us) service_pool.cc:224] Handling call
0709 13:14:51.420518 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:51.549041 (+128523us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:14:51.559381 (+ 10340us) log.cc:844] Serialized 14 byte log entry
0709 13:14:55.520324 (+3960943us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:55.520979 (+   655us) log.cc:844] Serialized 26 byte log entry
0709 13:14:55.557497 (+ 36518us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:14:55.557534 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.557599 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:55.559982 (+  2383us) raft_consensus.cc:1685] finished
0709 13:14:55.560001 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:55.560182 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4919433,"prepare.queue_time_us":3296,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":60,"raft.queue_time_us":4110651,"raft.run_cpu_time_us":342,"raft.run_wall_time_us":6515,"thread_start_us":313582,"threads_started":3,"wal-append.queue_time_us":274433,"wal-append.run_cpu_time_us":1527,"wal-append.run_wall_time_us":1053677}
W20260709 13:14:55.699895  5992 log.cc:927] Time spent T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 3.015s	user 0.007s	sys 0.013s
I20260709 13:14:55.911777  4031 rpcz_store.cc:276] 0709 13:14:51.882572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:52.229087 (+346515us) service_pool.cc:224] Handling call
0709 13:14:52.238532 (+  9445us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:52.238749 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:14:52.287276 (+ 48527us) log.cc:844] Serialized 14 byte log entry
0709 13:14:55.694886 (+3407610us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:55.695830 (+   944us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:55.695888 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.695970 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:55.696112 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3349340,"prepare.queue_time_us":80991,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":3534580,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"thread_start_us":32299,"threads_started":1}
I20260709 13:14:55.896350  5999 raft_consensus.cc:515] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:55.707212  5820 raft_consensus.cc:493] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.917687  5852 raft_consensus.cc:515] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:55.918026  5820 raft_consensus.cc:515] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:55.715242  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:55.716830  5961 raft_consensus.cc:493] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:55.747673  5962 raft_consensus.cc:493] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.771927  4703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57680 (request call id 481) took 3854 ms. Trace:
I20260709 13:14:55.770617  6017 raft_consensus.cc:493] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
W20260709 13:14:55.794996  5970 log.cc:927] Time spent T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 3.360s	user 0.008s	sys 0.023s
I20260709 13:14:55.801389  5930 raft_consensus.cc:493] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.802627  5879 consensus_queue.cc:237] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:55.815380  5974 raft_consensus.cc:3060] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:55.848855  3954 raft_consensus.cc:2393] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 6: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:14:55.848254  5912 leader_election.cc:290] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:55.851755  5922 leader_election.cc:290] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:55.852972  4032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41312 (request call id 147) took 4172 ms. Trace:
I20260709 13:14:55.955250  4032 rpcz_store.cc:276] 0709 13:14:51.680995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.756963 (+ 75968us) service_pool.cc:224] Handling call
0709 13:14:51.757319 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:51.757563 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:14:51.757855 (+   292us) log.cc:844] Serialized 14 byte log entry
0709 13:14:55.852581 (+4094726us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:55.852649 (+    68us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:55.852702 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.852772 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:55.852905 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4094475,"prepare.queue_time_us":343,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":7915,"raft.queue_time_us":4094691,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99}
I20260709 13:14:55.853003  6011 raft_consensus.cc:493] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:55.931901  5757 raft_consensus.cc:493] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:55.896350  5822 consensus_queue.cc:1048] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:14:55.864826  4704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57666 (request call id 378) took 4129 ms. Trace:
I20260709 13:14:55.487323  3956 rpcz_store.cc:276] 0709 13:14:52.512662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.485624 (+2972962us) service_pool.cc:224] Handling call
0709 13:14:55.485985 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:55.486696 (+   711us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.486930 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:55.505306  5954 raft_consensus.cc:493] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:55.017017  5847 raft_consensus.cc:493] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:55.862495  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:55.511178  5826 leader_election.cc:290] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 election: Requested vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:14:55.879204  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 371107us
I20260709 13:14:55.879393  4034 raft_consensus.cc:2468] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 4.
I20260709 13:14:55.845899  5841 leader_election.cc:290] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:55.571096  5823 raft_consensus.cc:493] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:56.010201  5823 raft_consensus.cc:515] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:55.895329  5829 leader_election.cc:290] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:55.902595  3957 rpcz_store.cc:276] 0709 13:14:52.511189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.483085 (+2971896us) service_pool.cc:224] Handling call
0709 13:14:55.483504 (+   419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:55.554455 (+ 70951us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:55.554493 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:55.555088 (+   595us) log.cc:844] Serialized 26 byte log entry
0709 13:14:55.604084 (+ 48996us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:14:55.604137 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.604224 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:55.604269 (+    45us) raft_consensus.cc:1685] finished
0709 13:14:55.604281 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:55.604416 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":196813,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"spinlock_wait_cycles":16256,"thread_start_us":90773,"threads_started":2,"wal-append.queue_time_us":24827}
I20260709 13:14:55.859021  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:56.012980  4027 raft_consensus.cc:2368] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 3. Current term is 4.
I20260709 13:14:55.980021  4706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57666 (request call id 377) took 4239 ms. Trace:
I20260709 13:14:56.013942  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:55.914129  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:56.013864  4706 rpcz_store.cc:276] 0709 13:14:51.718779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.720751 (+  1972us) service_pool.cc:224] Handling call
0709 13:14:55.719259 (+3998508us) spinlock_profiling.cc:243] Waited 9.36 ms on lock 0x7b5800003f98. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f1522549b71 00007f1522549a22 00007f152b462c09 00007f152a5bcee0 00007f152a6860ab 00007f152a686131 00007f152a647fc0 00007f152a632929 00007f152a6323d2 00007f1523ba9bd4
0709 13:14:55.719571 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:55.870210 (+150639us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:55.870250 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:55.870304 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:55.870342 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.935653 (+ 65311us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b54006810d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:14:55.938664 (+  3011us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:55.957290 (+ 18626us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":319316480}
I20260709 13:14:55.708995  5900 raft_consensus.cc:2749] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:55.917743  3959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1580) took 3408 ms. Trace:
I20260709 13:14:56.015694  3959 rpcz_store.cc:276] 0709 13:14:52.509160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:52.521013 (+ 11853us) service_pool.cc:224] Handling call
0709 13:14:52.535822 (+ 14809us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:55.906486 (+3370664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.917475 (+ 10989us) spinlock_profiling.cc:243] Waited 3.07 s on lock 0x7b5400429d54. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:14:55.917676 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7068465408}
W20260709 13:14:55.919914  4672 connection.cc:256] RPC call timeout handler was delayed by -1.8364259309998943s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2017s for a response
I20260709 13:14:55.919955  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:14:56.019734  4672 connection.cc:256] RPC call timeout handler was delayed by -1.7435342500000388s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15410000000000001s for a response
I20260709 13:14:55.920523  4033 raft_consensus.cc:2468] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 4.
I20260709 13:14:55.948577  5962 raft_consensus.cc:515] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:56.021185  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:56.022152  4033 raft_consensus.cc:2410] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:14:55.995329  5999 leader_election.cc:290] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:55.895989  4025 rpcz_store.cc:276] 0709 13:14:51.627254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.728835 (+101581us) service_pool.cc:224] Handling call
0709 13:14:51.729154 (+   319us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:55.516031 (+3786877us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:55.516063 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:55.516781 (+   718us) log.cc:844] Serialized 52 byte log entry
0709 13:14:55.569385 (+ 52604us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:14:55.569433 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.569514 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:55.570906 (+  1392us) raft_consensus.cc:1685] finished
0709 13:14:55.570929 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:55.571085 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3963423,"raft.queue_time_us":3941897,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":190,"thread_start_us":45263,"threads_started":1,"wal-append.queue_time_us":44632}
I20260709 13:14:56.025380  4025 raft_consensus.cc:3055] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:56.025772  4025 raft_consensus.cc:740] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:56.026628  4025 consensus_queue.cc:260] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:55.895507  6004 leader_election.cc:290] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:55.926671  3950 raft_consensus.cc:1240] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:55.849786  5675 leader_election.cc:290] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:55.923159  3999 leader_election.cc:304] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
W20260709 13:14:56.030388  3999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 107357us
I20260709 13:14:55.934213  3922 leader_election.cc:304] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:55.891384  5474 raft_consensus.cc:2749] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:55.906775  5941 raft_consensus.cc:493] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.942198  3855 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52092 (request call id 205) took 9295 ms. Trace:
I20260709 13:14:55.891840  5815 raft_consensus.cc:515] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:55.856784  5917 raft_consensus.cc:493] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:14:55.954612  4701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:55.861454  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:14:55.968585  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 70315.2us
I20260709 13:14:55.935142  5965 raft_consensus.cc:493] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:55.987299  5852 leader_election.cc:290] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:55.903985  6003 raft_consensus.cc:515] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:55.895814  5944 raft_consensus.cc:515] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:55.940328  6001 raft_consensus.cc:493] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:55.866056  3952 rpcz_store.cc:276] 0709 13:14:51.772787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.777925 (+  5138us) service_pool.cc:224] Handling call
0709 13:14:51.806623 (+ 28698us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:51.875230 (+ 68607us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:14:51.940557 (+ 65327us) log.cc:844] Serialized 14 byte log entry
0709 13:14:52.239306 (+298749us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:52.383462 (+144156us) log.cc:844] Serialized 26 byte log entry
0709 13:14:52.404977 (+ 21515us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:52.448373 (+ 43396us) log.cc:844] Serialized 14 byte log entry
0709 13:14:52.461888 (+ 13515us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:52.483135 (+ 21247us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:55.099932 (+2616797us) spinlock_profiling.cc:243] Waited 65.3 ms on lock 0x7b4400022b4c. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f15224a7c85 00007f15224a86a2 00007f152521a1db 00007f1525215aaf 00007f152520986e 00007f1525208bb6 00007f15252087d8 00007f1525212221 00007f15252121d9 00007f1525212169
0709 13:14:55.865383 (+765451us) raft_consensus.cc:1685] finished
0709 13:14:55.865409 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:55.865545 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22801,"prepare.queue_time_us":46274,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":100,"raft.queue_time_us":237842,"raft.run_cpu_time_us":510,"raft.run_wall_time_us":47153,"spinlock_wait_cycles":150256512,"thread_start_us":242647,"threads_started":1,"wal-append.queue_time_us":383940}
I20260709 13:14:55.928252  5843 consensus_queue.cc:1059] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:14:55.995036  5954 raft_consensus.cc:515] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:55.995471  3955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1565) took 4763 ms. Trace:
I20260709 13:14:55.997188  5928 leader_election.cc:290] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:14:55.998581  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 3.43818e+06us
I20260709 13:14:55.951572  5930 raft_consensus.cc:515] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:55.920480  5955 raft_consensus.cc:515] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:55.924942  5858 raft_consensus.cc:515] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:56.172683  5858 leader_election.cc:290] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:56.174033  5820 leader_election.cc:290] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:56.001433  4030 raft_consensus.cc:2468] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 5.
I20260709 13:14:56.006181  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:55.920313  5959 raft_consensus.cc:515] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:55.984689  4704 rpcz_store.cc:276] 0709 13:14:51.738919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.758315 (+ 19396us) service_pool.cc:224] Handling call
0709 13:14:55.493867 (+3735552us) spinlock_profiling.cc:243] Waited 7.75 ms on lock 0x7b5800003f98. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f1522549b71 00007f1522549a22 00007f152b462c09 00007f152a5bcee0 00007f152a6860ab 00007f152a686131 00007f152a647fc0 00007f152a632929 00007f152a6323d2 00007f1523ba9bd4
0709 13:14:55.494095 (+   228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:55.864542 (+370447us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.864758 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17822080}
I20260709 13:14:56.014971  4026 raft_consensus.cc:2468] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
W20260709 13:14:56.020141  4672 connection.cc:256] RPC call timeout handler was delayed by -1.7128443069998411s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15410000000000001s for a response
I20260709 13:14:56.032954  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:56.183593  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:56.184252  4026 raft_consensus.cc:3060] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:14:56.034263  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 100227us
W20260709 13:14:56.030406  3954 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38606 (request call id 1582) took 3520 ms (client timeout 4106 ms). Trace:
W20260709 13:14:56.191735  3954 rpcz_store.cc:269] 0709 13:14:52.509854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.462597 (+2952743us) service_pool.cc:224] Handling call
0709 13:14:56.030184 (+567587us) spinlock_profiling.cc:243] Waited 385 ms on lock 0x7b54003cd054. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:14:56.030335 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":885675904}
I20260709 13:14:56.036047  4033 raft_consensus.cc:1275] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:56.039738  4029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38290 (request call id 1533) took 4413 ms. Trace:
I20260709 13:14:56.105605  4025 raft_consensus.cc:3060] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:55.919368  5921 raft_consensus.cc:515] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:14:56.131006  4071 connection.cc:256] RPC call timeout handler was delayed by -2.0716488399998525s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17170000000000002s for a response
I20260709 13:14:56.193593  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:14:56.194013  4071 connection.cc:256] RPC call timeout handler was delayed by -1.8763488399997641s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19340000000000002s for a response
W20260709 13:14:56.194403  4071 connection.cc:256] RPC call timeout handler was delayed by -1.7665488399998139s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2056s for a response
W20260709 13:14:56.194691  4071 connection.cc:256] RPC call timeout handler was delayed by -1.6378488399998332s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21989999999999998s for a response
W20260709 13:14:56.195076  4071 connection.cc:256] RPC call timeout handler was delayed by -1.5890068039998368s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2021s for a response
W20260709 13:14:56.195520  4071 connection.cc:256] RPC call timeout handler was delayed by -1.4252068039997994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2203s for a response
I20260709 13:14:56.130441  5894 consensus_queue.cc:1059] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:14:56.196694  4071 leader_election.cc:304] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:55.940848  5961 raft_consensus.cc:515] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:56.135869  3951 raft_consensus.cc:2468] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 4.
I20260709 13:14:56.192914  4029 rpcz_store.cc:276] 0709 13:14:51.626888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.726498 (+ 99610us) service_pool.cc:224] Handling call
0709 13:14:51.726834 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:55.737191 (+4010357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:55.737216 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:55.738310 (+  1094us) log.cc:844] Serialized 26 byte log entry
0709 13:14:55.958390 (+220080us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:14:55.958443 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.976537 (+ 18094us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:56.039468 (+ 62931us) raft_consensus.cc:1685] finished
0709 13:14:56.039492 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:56.039676 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3942514,"raft.queue_time_us":4121429,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":3753,"thread_start_us":253721,"threads_started":2,"wal-append.queue_time_us":242166}
I20260709 13:14:56.001298  5847 raft_consensus.cc:515] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:56.104607  6019 raft_consensus.cc:2804] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:56.111640  5798 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:14:56.129366  5826 raft_consensus.cc:2804] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:56.239907  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:56.240860  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:56.241707  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:56.242532  4101 raft_consensus.cc:2410] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:14:56.139658  4701 raft_consensus.cc:2468] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 5.
I20260709 13:14:56.150812  5843 raft_consensus.cc:3055] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:56.151767  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:55.949970  6017 raft_consensus.cc:515] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:56.147795  3955 rpcz_store.cc:276] 0709 13:14:51.232076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.280503 (+ 48427us) service_pool.cc:224] Handling call
0709 13:14:51.280832 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:51.297640 (+ 16808us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:14:52.523105 (+1225465us) spinlock_profiling.cc:243] Waited 5.1 ms on lock 0x7b180023ff80. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f15252164bc 00007f152256448b 00007f152b3beab9 00007f152258069b 00007f152257e93f 00007f152257e455 00007f15290663c7 00007f15256789a7 00007f15256880bf
0709 13:14:52.523285 (+   180us) log.cc:844] Serialized 14 byte log entry
0709 13:14:55.863494 (+3340209us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:55.864048 (+   554us) log.cc:844] Serialized 26 byte log entry
0709 13:14:55.921067 (+ 57019us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:14:55.921112 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.921190 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:55.995109 (+ 73919us) raft_consensus.cc:1685] finished
0709 13:14:55.995212 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:55.995370 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50633,"prepare.queue_time_us":112149,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":33764,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":35187,"spinlock_wait_cycles":11740032,"thread_start_us":3475162,"threads_started":3,"wal-append.queue_time_us":281386,"wal-append.run_cpu_time_us":1557,"wal-append.run_wall_time_us":1001759}
I20260709 13:14:56.162946  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:56.168766  5944 leader_election.cc:290] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:56.169896  5895 leader_election.cc:290] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:56.170177  5930 leader_election.cc:290] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:56.175082  3957 raft_consensus.cc:1275] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:55.999647  5757 raft_consensus.cc:515] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:56.176712  4034 raft_consensus.cc:2468] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 4.
I20260709 13:14:56.140712  5965 raft_consensus.cc:515] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:56.152100  6003 leader_election.cc:290] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:56.200266  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:56.228214  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:56.287367  4099 raft_consensus.cc:3060] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:56.287766  3951 raft_consensus.cc:2393] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 4: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:14:56.110037  5865 raft_consensus.cc:493] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:56.231880  3950 raft_consensus.cc:2393] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 5: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:14:56.233250  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:56.234130  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:56.001276  6011 raft_consensus.cc:515] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:56.049171  3855 rpcz_store.cc:276] 0709 13:14:46.649622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.656944 (+  7322us) service_pool.cc:224] Handling call
0709 13:14:55.941520 (+9284576us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:50.342197 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:50.452273 (+110076us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:50.456638 (+  4365us) write_op.cc:435] Acquired schema lock
0709 13:14:50.460434 (+  3796us) tablet.cc:662] Decoding operations
0709 13:14:50.485669 (+ 25235us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:50.485738 (+    69us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:50.485767 (+    29us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:14:50.490730 (+  4963us) tablet.cc:701] Row locks acquired
0709 13:14:50.490747 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:14:50.499868 (+  9121us) write_op.cc:270] Start()
0709 13:14:50.500007 (+   139us) write_op.cc:276] Timestamp: P: 1783602890499805 usec, L: 0
0709 13:14:50.500026 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:14:50.500798 (+   772us) log.cc:844] Serialized 4790 byte log entry
0709 13:14:50.988046 (+487248us) op_driver.cc:464] REPLICATION: finished
0709 13:14:51.281240 (+293194us) write_op.cc:301] APPLY: starting
0709 13:14:51.281329 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:51.281640 (+   311us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:51.331784 (+ 50144us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:51.333680 (+  1896us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:51.334086 (+   406us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 13:14:51.334165 (+    79us) write_op.cc:312] APPLY: finished
0709 13:14:51.334621 (+   456us) log.cc:844] Serialized 89 byte log entry
0709 13:14:51.335928 (+  1307us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:51.336166 (+   238us) write_op.cc:454] Released schema lock
0709 13:14:51.336243 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:51.336747 (+   504us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:51.336781 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4693,"reported_tablets":24,"child_traces":[["op",{"apply.queue_time_us":280881,"apply.run_cpu_time_us":5002,"apply.run_wall_time_us":55489,"num_ops":12,"prepare.queue_time_us":346646,"prepare.run_cpu_time_us":15861,"prepare.run_wall_time_us":292971,"raft.queue_time_us":224275,"raft.run_cpu_time_us":7393,"raft.run_wall_time_us":192271,"replication_time_us":458710,"thread_start_us":612907,"threads_started":4,"wal-append.queue_time_us":179305,"wal-append.run_cpu_time_us":63466,"wal-append.run_wall_time_us":1658458}]]}
W20260709 13:14:56.255098  6018 log.cc:927] Time spent T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:14:56.248123  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:56.252748  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:14:56.254494  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 57899us
I20260709 13:14:56.250686  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:56.254415  5843 raft_consensus.cc:740] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:56.254287  5798 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:56.267764  3952 raft_consensus.cc:2468] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 4.
I20260709 13:14:56.137660  5917 raft_consensus.cc:515] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:56.126853  5941 raft_consensus.cc:515] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:56.147598  5841 consensus_queue.cc:1059] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.096s
I20260709 13:14:56.177124  3997 leader_election.cc:304] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:56.281976  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:56.236017  5858 raft_consensus.cc:493] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:56.237982  5829 raft_consensus.cc:493] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:56.285782  3922 leader_election.cc:304] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:14:56.286458  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:56.226500  5912 consensus_queue.cc:1048] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:14:56.288796  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:56.416640  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:56.417765  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:56.417943  4030 raft_consensus.cc:2410] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:14:56.418445  3951 raft_consensus.cc:2468] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 4.
I20260709 13:14:56.420435  4108 raft_consensus.cc:3060] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:56.147917  6001 raft_consensus.cc:515] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:56.306317  3958 raft_consensus.cc:2468] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
W20260709 13:14:56.426282  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 249198us
I20260709 13:14:56.345559  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:56.424150  4102 raft_consensus.cc:2410] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:14:56.424862  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:56.431347  4103 raft_consensus.cc:2468] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 4.
I20260709 13:14:56.422154  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:56.419286  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:14:56.426137  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 140448us
I20260709 13:14:56.426985  4033 raft_consensus.cc:2410] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:14:56.424813  3924 leader_election.cc:304] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:14:56.551736  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 127098us
I20260709 13:14:56.553416  4709 raft_consensus.cc:1240] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:14:56.460804  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:56.433398  5829 raft_consensus.cc:515] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:56.479710  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:56.487036  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:56.556000  4030 raft_consensus.cc:2410] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:14:55.941105  4703 rpcz_store.cc:276] 0709 13:14:51.918005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.920158 (+  2153us) service_pool.cc:224] Handling call
0709 13:14:51.960911 (+ 40753us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:51.985563 (+ 24652us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:14:52.205749 (+220186us) log.cc:844] Serialized 14 byte log entry
0709 13:14:55.733829 (+3528080us) spinlock_profiling.cc:243] Waited 25 ms on lock 0x7b18003cfd00. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f1522563e07 00007f152b3beab9 00007f152258069b 00007f152257e93f 00007f1522580c02 00007f152520820b 00007f152520dd23 00007f152520e23a 00007f1525678a2a
0709 13:14:55.771348 (+ 37519us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:55.771425 (+    77us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:55.771498 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.771627 (+   129us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:55.771827 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":149819,"prepare.queue_time_us":165082,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":62,"raft.queue_time_us":921,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":403,"spinlock_wait_cycles":57520896,"thread_start_us":35410,"threads_started":1,"wal-append.queue_time_us":3561807}
I20260709 13:14:56.431579  6003 raft_consensus.cc:2749] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:56.521570  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:56.463351  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:56.305644  6013 raft_consensus.cc:3055] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:56.431643  5894 raft_consensus.cc:2804] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:14:56.542151  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:56.575120  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:56.436070  4034 raft_consensus.cc:2468] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3.
I20260709 13:14:56.305368  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:56.546154  4025 raft_consensus.cc:1275] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:14:56.576284  4028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38290 (request call id 1532) took 4954 ms. Trace:
I20260709 13:14:56.576393  4100 raft_consensus.cc:1275] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:56.366580  4026 raft_consensus.cc:2468] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 5.
I20260709 13:14:56.548506  4027 raft_consensus.cc:2393] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 5: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:14:56.283922  6004 raft_consensus.cc:493] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:56.279663  5884 raft_consensus.cc:2804] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:56.282963  6019 raft_consensus.cc:697] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:56.576746  4028 rpcz_store.cc:276] 0709 13:14:51.621529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.656143 (+ 34614us) service_pool.cc:224] Handling call
0709 13:14:51.656505 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:55.728013 (+4071508us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:55.728047 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:55.728753 (+   706us) log.cc:844] Serialized 26 byte log entry
0709 13:14:55.925505 (+196752us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:14:55.925545 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.925614 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:56.576062 (+650448us) raft_consensus.cc:1685] finished
0709 13:14:56.576086 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:56.576222 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4051919,"raft.queue_time_us":4190696,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":2175,"thread_start_us":256176,"threads_started":2,"wal-append.queue_time_us":255904}
I20260709 13:14:56.571046  3955 raft_consensus.cc:2468] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 4.
I20260709 13:14:56.582196  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:56.571780  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:56.576630  4025 pending_rounds.cc:85] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2: Aborting all ops after (but not including) 1
I20260709 13:14:56.584198  4025 pending_rounds.cc:107] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:14:56.584578  4025 raft_consensus.cc:2889] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:56.584790  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:56.546270  4099 raft_consensus.cc:2468] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 5.
I20260709 13:14:56.270457  5826 raft_consensus.cc:697] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 4 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:56.602873  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:56.601680  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:56.603089  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:56.603992  4103 raft_consensus.cc:2468] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 4.
I20260709 13:14:56.604748  3922 leader_election.cc:304] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:56.605000  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:56.591167  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:56.434680  5858 raft_consensus.cc:515] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:56.596354  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:56.596760  5954 leader_election.cc:290] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:56.596962  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:56.598284  5962 leader_election.cc:290] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:56.599390  5898 raft_consensus.cc:3055] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:14:56.290218  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:56.599888  4704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:56.570093  5822 raft_consensus.cc:2804] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:56.600907  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:56.602166  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:56.437420  5865 raft_consensus.cc:515] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:56.606423  3922 leader_election.cc:304] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:14:56.703998  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 97688us
I20260709 13:14:56.704172  3954 raft_consensus.cc:3060] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:56.581668  6013 raft_consensus.cc:740] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:56.615583  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:56.861246  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:56.582324  5894 raft_consensus.cc:493] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:56.618310  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:56.862392  4031 raft_consensus.cc:2410] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:14:56.623864  5849 consensus_queue.cc:1059] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:56.624953  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:56.863078  4103 raft_consensus.cc:3060] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:56.626068  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:56.864287  4029 raft_consensus.cc:2410] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:14:56.571076  5930 raft_consensus.cc:493] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:56.601686  5829 leader_election.cc:290] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:56.605716  4034 raft_consensus.cc:2468] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 5.
I20260709 13:14:56.583475  5884 raft_consensus.cc:493] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:56.762807  4108 raft_consensus.cc:2468] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 5.
I20260709 13:14:56.855098  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:14:56.864923  3959 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.833s	user 0.000s	sys 0.043s
W20260709 13:14:56.875260  3959 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.856s	user 0.000s	sys 0.044s
I20260709 13:14:56.870256  3922 leader_election.cc:304] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
W20260709 13:14:56.613415  6030 log.cc:927] Time spent T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.147s	user 0.000s	sys 0.005s
I20260709 13:14:56.861851  4028 raft_consensus.cc:2376] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 5. Re-sending same reply.
I20260709 13:14:56.616225  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:56.617558  5820 raft_consensus.cc:2749] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:56.876909  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:56.881421  4708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57680 (request call id 487) took 1105 ms. Trace:
I20260709 13:14:56.883002  3953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1593) took 1115 ms. Trace:
I20260709 13:14:56.869128  4675 leader_election.cc:304] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:56.887677  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:56.896497  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:56.621143  5898 raft_consensus.cc:740] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
W20260709 13:14:56.897541  4707 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.056s	sys 0.071s
W20260709 13:14:57.023164  4707 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.056s	sys 0.071s
I20260709 13:14:57.019163  4033 raft_consensus.cc:2468] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 4.
I20260709 13:14:56.923643  3922 leader_election.cc:304] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:14:57.024106  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 126232us
I20260709 13:14:57.024909  3922 leader_election.cc:304] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:56.918221  4106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34656 (request call id 181) took 1437 ms. Trace:
I20260709 13:14:56.921283  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:56.887295  5884 raft_consensus.cc:3060] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:56.631944  5822 raft_consensus.cc:493] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:56.628364  5847 leader_election.cc:290] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:56.874306  5962 raft_consensus.cc:2804] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:56.861161  5474 raft_consensus.cc:493] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:56.614964  6004 raft_consensus.cc:515] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:56.702396  4105 raft_consensus.cc:2468] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 5.
I20260709 13:14:56.637925  6011 leader_election.cc:290] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:14:56.944427  4672 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.019s	sys 0.054s
W20260709 13:14:57.061658  4672 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.019s	sys 0.062s
I20260709 13:14:56.983695  5965 leader_election.cc:290] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:56.968477  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:56.631178  5954 consensus_queue.cc:1059] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.312s
I20260709 13:14:56.922973  5829 raft_consensus.cc:2749] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:14:57.030244  3952 raft_consensus.cc:1275] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:14:56.876333  5894 raft_consensus.cc:3060] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:56.963423  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:56.944609  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:56.990826  5921 leader_election.cc:290] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:57.064407  5820 raft_consensus.cc:2804] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:57.020426  4108 raft_consensus.cc:2410] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:14:56.917675  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 497724us
I20260709 13:14:56.895236  5930 raft_consensus.cc:515] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:57.026062  4101 raft_consensus.cc:2410] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:14:57.093329  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:56.702942  5974 raft_consensus.cc:493] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.025486  4106 rpcz_store.cc:276] 0709 13:14:55.480900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.646040 (+165140us) service_pool.cc:224] Handling call
0709 13:14:55.646429 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:56.256359 (+609930us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:56.256410 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:56.256469 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:56.256547 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:56.917844 (+661297us) spinlock_profiling.cc:243] Waited 610 ms on lock 0x7b540042e0d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:14:56.917916 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:56.918140 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1402097920}
I20260709 13:14:56.926505  3957 raft_consensus.cc:1275] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:57.094339  4030 raft_consensus.cc:2410] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:14:57.049381  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 180309us
I20260709 13:14:57.057646  3954 raft_consensus.cc:2468] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 4.
W20260709 13:14:57.062040  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 794045us
I20260709 13:14:56.714195  5826 consensus_queue.cc:237] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:56.984477  5815 leader_election.cc:290] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:56.990399  5757 leader_election.cc:290] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:56.980860  5917 leader_election.cc:290] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:57.077282  5961 leader_election.cc:290] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:57.073118  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:57.030790  6017 leader_election.cc:290] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:56.900452  4708 rpcz_store.cc:276] 0709 13:14:55.775822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.775988 (+   166us) service_pool.cc:224] Handling call
0709 13:14:55.776354 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:56.250207 (+473853us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:56.250239 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:56.250281 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:56.250313 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:56.881035 (+630722us) spinlock_profiling.cc:243] Waited 474 ms on lock 0x7b5400681ad4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:14:56.881124 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:56.881334 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1089273600}
I20260709 13:14:56.901126  3953 rpcz_store.cc:276] 0709 13:14:55.767716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.945257 (+177541us) service_pool.cc:224] Handling call
0709 13:14:55.945711 (+   454us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:56.270078 (+324367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:56.270110 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:56.270154 (+    44us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:14:56.270186 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:56.882730 (+612544us) spinlock_profiling.cc:243] Waited 324 ms on lock 0x7b5400385254. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:14:56.882794 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:56.882922 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":745500416}
I20260709 13:14:57.054689  5962 raft_consensus.cc:493] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:57.031064  5822 raft_consensus.cc:3060] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:56.702860  5843 consensus_queue.cc:260] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:14:57.095432  3997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.048s	sys 0.120s
I20260709 13:14:57.072008  5965 raft_consensus.cc:493] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.098342  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:57.022455  5959 leader_election.cc:290] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:57.125810  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:57.128273  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:14:57.102847  5936 consensus_meta.cc:287] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 1.203s	user 0.014s	sys 0.003s
I20260709 13:14:57.062933  5474 raft_consensus.cc:515] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:57.094489  6011 raft_consensus.cc:493] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
W20260709 13:14:57.138859  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.140327  6004 leader_election.cc:290] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:14:57.124953  5976 consensus_meta.cc:287] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 1.233s	user 0.014s	sys 0.005s
I20260709 13:14:57.106395  5820 raft_consensus.cc:697] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 5 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:57.096764  5954 consensus_queue.cc:1048] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 13:14:56.971266  6019 consensus_queue.cc:237] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:57.152611  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:57.168424  4030 raft_consensus.cc:2468] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3.
I20260709 13:14:56.995909  6013 consensus_queue.cc:260] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:57.149493  4104 raft_consensus.cc:3060] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:14:57.147415  3997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.048s	sys 0.120s
I20260709 13:14:57.126590  5829 raft_consensus.cc:2804] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:57.124338  5941 leader_election.cc:290] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:57.145321  5503 consensus_queue.cc:1048] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:14:57.156665  4073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 256765us
I20260709 13:14:57.146617  5962 raft_consensus.cc:3060] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:57.174063  4106 raft_consensus.cc:1275] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:14:57.172324  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 622600us
I20260709 13:14:57.157642  5841 raft_consensus.cc:2804] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:57.093152  5898 consensus_queue.cc:260] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:57.158165  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:57.179385  5823 leader_election.cc:290] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:57.161486  5858 leader_election.cc:290] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:57.149690  5912 consensus_queue.cc:1059] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:14:57.167711  6011 raft_consensus.cc:515] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:57.164707  5936 raft_consensus.cc:515] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:57.184127  5944 raft_consensus.cc:3055] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:57.104636  5974 raft_consensus.cc:515] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:57.199297  4099 raft_consensus.cc:1275] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:14:57.203806  5841 raft_consensus.cc:493] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:57.202181  4104 raft_consensus.cc:2468] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
I20260709 13:14:57.413480  4104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45332 (request call id 1490) took 1199 ms. Trace:
I20260709 13:14:57.413978  4104 rpcz_store.cc:276] 0709 13:14:56.214140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.098070 (+883930us) service_pool.cc:224] Handling call
0709 13:14:57.413393 (+315323us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:57.202252  4074 leader_election.cc:304] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:57.205219  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:57.230523  4707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57666 (request call id 382) took 1333 ms. Trace:
I20260709 13:14:57.415639  4026 raft_consensus.cc:2468] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3.
I20260709 13:14:57.416989  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:57.415558  4707 rpcz_store.cc:276] 0709 13:14:55.896838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.906773 (+  9935us) service_pool.cc:224] Handling call
0709 13:14:55.939003 (+ 32230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:55.939250 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:14:56.129147 (+189897us) log.cc:844] Serialized 14 byte log entry
0709 13:14:57.227418 (+1098271us) log.cc:844] Serialized 14 byte log entry
0709 13:14:57.229915 (+  2497us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:57.229999 (+    84us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:57.230087 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.230215 (+   128us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:57.230423 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":329138,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":331233,"raft.run_cpu_time_us":341,"raft.run_wall_time_us":137289,"thread_start_us":1268438,"threads_started":4,"wal-append.queue_time_us":934439}
I20260709 13:14:57.158061  6042 raft_consensus.cc:493] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:57.245175  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:14:57.246426  4032 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.002s	sys 0.028s
I20260709 13:14:57.425137  4030 raft_consensus.cc:2393] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 4: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:14:57.378329  6013 raft_consensus.cc:3060] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:57.171046  5829 raft_consensus.cc:493] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:57.170780  5865 leader_election.cc:290] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:57.161181  5757 consensus_queue.cc:1048] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.101s
I20260709 13:14:57.384356  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:14:57.404294  4025 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.014s	sys 0.063s
W20260709 13:14:57.435237  4025 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.803s	user 0.015s	sys 0.063s
I20260709 13:14:57.435515  4031 raft_consensus.cc:2393] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 4: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:14:57.204506  5913 raft_consensus.cc:493] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:14:57.199043  3997 leader_election.cc:304] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: d709ee666b774ec29aa732e508219938
W20260709 13:14:57.406071  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 310501us
I20260709 13:14:57.195295  5894 raft_consensus.cc:515] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:57.417754  4026 raft_consensus.cc:2468] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3.
W20260709 13:14:57.418594  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 321904us
I20260709 13:14:57.439738  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:57.440938  4026 raft_consensus.cc:2410] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:14:57.422752  4103 consensus_meta.cc:287] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.559s	user 0.009s	sys 0.000s
I20260709 13:14:57.159667  5965 raft_consensus.cc:515] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:57.263486  4108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45332 (request call id 1489) took 1049 ms. Trace:
I20260709 13:14:57.442312  4108 rpcz_store.cc:276] 0709 13:14:56.213911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.176281 (+962370us) service_pool.cc:224] Handling call
0709 13:14:57.262714 (+ 86433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:57.262991 (+   277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:57.263029 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:57.263104 (+    75us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:14:57.263158 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.263231 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:57.263395 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:57.401881  5898 raft_consensus.cc:3060] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:57.429958  4033 raft_consensus.cc:2410] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:14:57.431334  3950 raft_consensus.cc:2368] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 for earlier term 4. Current term is 5.
I20260709 13:14:57.401834  5944 raft_consensus.cc:740] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
W20260709 13:14:57.454389  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 255476us
I20260709 13:14:57.454226  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:57.457154  4030 raft_consensus.cc:2468] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3.
I20260709 13:14:57.458894  4103 raft_consensus.cc:2468] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 4.
I20260709 13:14:57.426024  5841 raft_consensus.cc:3060] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:57.460407  4103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45332 (request call id 1485) took 1247 ms. Trace:
W20260709 13:14:57.435961  6033 log.cc:927] Time spent T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 13:14:57.466384  3925 leader_election.cc:336] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Timed out: RequestConsensusVote RPC to 127.2.198.194:46115 timed out after 1.553s (SENT)
I20260709 13:14:57.491940  3925 leader_election.cc:304] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:57.466878  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:57.494851  3951 raft_consensus.cc:2410] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:14:57.462481  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:57.495983  4026 raft_consensus.cc:2410] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:14:57.467790  4103 rpcz_store.cc:276] 0709 13:14:56.212961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:56.604655 (+391694us) service_pool.cc:224] Handling call
0709 13:14:57.460324 (+855669us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:57.480330  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:57.497336  4030 raft_consensus.cc:3060] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:57.453824  5913 raft_consensus.cc:515] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:57.478206  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:57.469961  4708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:57.499212  3951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38606 (request call id 1603) took 1448 ms. Trace:
I20260709 13:14:57.504421  3951 rpcz_store.cc:276] 0709 13:14:56.052014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:56.570651 (+518637us) service_pool.cc:224] Handling call
0709 13:14:57.466723 (+896072us) spinlock_profiling.cc:243] Waited 5.44 ms on lock 0x7b5800002d98. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f1522549b71 00007f1522549eee 0000000000375939 00007f152a5bd1e0 00007f152a6860c4 00007f152a686131 00007f152a6340a0 00007f152a633984 00007f1523bae6d4 00007f1523bae662
0709 13:14:57.499123 (+ 32400us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12503424}
I20260709 13:14:57.441159  5829 raft_consensus.cc:3060] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:57.432080  4105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45332 (request call id 1498) took 1179 ms. Trace:
I20260709 13:14:57.477810  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:57.464232  6043 raft_consensus.cc:2804] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:57.555773  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:57.499372  5900 raft_consensus.cc:2749] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:57.434158  6042 raft_consensus.cc:515] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:57.559039  5954 raft_consensus.cc:2804] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:57.429150  5820 consensus_queue.cc:237] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:57.569574  5954 raft_consensus.cc:493] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:57.574905  5930 leader_election.cc:290] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:57.587706  5954 raft_consensus.cc:3060] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:14:57.571235  5884 consensus_meta.cc:287] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.505s	user 0.009s	sys 0.003s
I20260709 13:14:57.588687  5884 raft_consensus.cc:515] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:57.589588  4701 raft_consensus.cc:3055] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:57.590073  4701 raft_consensus.cc:740] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:14:57.569017  6042 leader_election.cc:290] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:57.561290  6047 raft_consensus.cc:493] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.521474  6038 consensus_queue.cc:1048] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 13:14:57.581918  6043 raft_consensus.cc:697] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:57.476366  5944 consensus_queue.cc:260] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:57.625764  6043 consensus_queue.cc:237] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:57.603897  5884 leader_election.cc:290] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:57.645810  5936 leader_election.cc:290] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:57.610152  6047 raft_consensus.cc:515] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:14:57.517221  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 492362us
I20260709 13:14:57.556715  4026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38290 (request call id 1553) took 1601 ms. Trace:
I20260709 13:14:57.558116  4033 raft_consensus.cc:1240] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 3. Current term is 4. Ops: []
W20260709 13:14:57.559705  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 471942us
I20260709 13:14:57.606202  5474 leader_election.cc:290] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:57.658726  5913 leader_election.cc:290] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:57.658886  5965 leader_election.cc:290] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:14:57.818591  5822 consensus_meta.cc:287] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.661s	user 0.007s	sys 0.004s
I20260709 13:14:57.801899  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:57.827014  5965 consensus_queue.cc:1048] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
W20260709 13:14:57.764849  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:57.764672  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 568884us
I20260709 13:14:57.811318  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:57.827818  4026 rpcz_store.cc:276] 0709 13:14:55.955090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.525158 (+1570068us) service_pool.cc:224] Handling call
0709 13:14:57.544126 (+ 18968us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:57.556306 (+ 12180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:57.556348 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:57.556397 (+    49us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:14:57.556439 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.556513 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:57.556651 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":713,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":11829}
W20260709 13:14:57.778256  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:57.744544  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.562315  4031 raft_consensus.cc:2410] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:14:57.842993  4030 raft_consensus.cc:2468] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
I20260709 13:14:57.843997  4030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38304 (request call id 1685) took 1245 ms. Trace:
I20260709 13:14:57.844339  4030 rpcz_store.cc:276] 0709 13:14:56.598314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.463686 (+865372us) service_pool.cc:224] Handling call
0709 13:14:57.843858 (+380172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:57.796164  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:14:57.789245  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 194897us
W20260709 13:14:57.790197  4675 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.198.194:46115 timed out after 1.881s (SENT) [suppressed 16 similar messages]
W20260709 13:14:57.742870  3997 connection.cc:256] RPC call timeout handler was delayed by -7.1043500739999672s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1574s for a response
I20260709 13:14:57.730887  3955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1599) took 1703 ms. Trace:
I20260709 13:14:57.747278  4025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38290 (request call id 1551) took 1811 ms. Trace:
I20260709 13:14:57.799263  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
W20260709 13:14:57.853688  3997 connection.cc:256] RPC call timeout handler was delayed by -7.088150073999941s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1592s for a response
W20260709 13:14:57.854177  3997 connection.cc:256] RPC call timeout handler was delayed by -7.0692500739999105s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1613s for a response
W20260709 13:14:57.856050  3997 connection.cc:256] RPC call timeout handler was delayed by -7.0656500739999046s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1617s for a response
I20260709 13:14:57.856761  6013 raft_consensus.cc:493] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.827039  5822 raft_consensus.cc:515] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:57.858002  6013 raft_consensus.cc:515] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:57.679857  6050 log.cc:927] Time spent T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
W20260709 13:14:57.862000  3997 connection.cc:256] RPC call timeout handler was delayed by -7.0602500739998959s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1623s for a response
I20260709 13:14:57.524224  4105 rpcz_store.cc:276] 0709 13:14:56.246796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.085167 (+838371us) service_pool.cc:224] Handling call
0709 13:14:57.426352 (+341185us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:57.864296  3997 connection.cc:256] RPC call timeout handler was delayed by -7.0440500740000971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16410000000000002s for a response
I20260709 13:14:57.865767  5894 leader_election.cc:290] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:57.866780  5894 raft_consensus.cc:493] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.869531  4071 leader_election.cc:304] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:57.872093  5474 raft_consensus.cc:2804] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:57.872994  5474 raft_consensus.cc:697] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:57.873488  4104 raft_consensus.cc:2393] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 in current term 3: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
W20260709 13:14:57.875226  6065 log.cc:927] Time spent T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 13:14:57.875020  6061 consensus_queue.cc:1048] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:57.847848  3955 rpcz_store.cc:276] 0709 13:14:56.026847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:56.612842 (+585995us) service_pool.cc:224] Handling call
0709 13:14:56.629676 (+ 16834us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:56.629926 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:14:57.262057 (+632131us) log.cc:844] Serialized 14 byte log entry
0709 13:14:57.729544 (+467487us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:57.729700 (+   156us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:14:57.729925 (+   225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.730113 (+   188us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:57.730518 (+   405us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":494006,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":50,"raft.queue_time_us":84583,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":318,"thread_start_us":839375,"threads_started":2,"wal-append.queue_time_us":396959}
I20260709 13:14:57.690042  6011 leader_election.cc:290] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:57.877421  4074 leader_election.cc:304] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:57.877765  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:14:57.830087  5962 raft_consensus.cc:515] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:57.880949  5962 leader_election.cc:290] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:57.881263  5822 leader_election.cc:290] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 election: Requested vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:57.874858  5474 consensus_queue.cc:237] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:57.663308  5954 raft_consensus.cc:515] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:57.886036  3959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1598) took 1879 ms. Trace:
I20260709 13:14:57.886662  3959 rpcz_store.cc:276] 0709 13:14:56.006669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:56.017916 (+ 11247us) service_pool.cc:224] Handling call
0709 13:14:56.018239 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:56.018651 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:14:56.875747 (+857096us) log.cc:844] Serialized 14 byte log entry
0709 13:14:57.168293 (+292546us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:57.169024 (+   731us) log.cc:844] Serialized 26 byte log entry
0709 13:14:57.169223 (+   199us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:14:57.169275 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.169368 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:57.885495 (+716127us) raft_consensus.cc:1685] finished
0709 13:14:57.885550 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:57.885799 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2733,"prepare.queue_time_us":1056014,"prepare.run_cpu_time_us":248,"prepare.run_wall_time_us":9139,"raft.queue_time_us":4230,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":27523,"thread_start_us":1039813,"threads_started":2,"wal-append.queue_time_us":470047}
I20260709 13:14:57.888340  5954 leader_election.cc:290] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:57.888278  6055 consensus_queue.cc:1059] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:57.882946  4108 raft_consensus.cc:2410] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:14:57.883023  6053 raft_consensus.cc:2804] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:14:57.884478  3997 connection.cc:256] RPC call timeout handler was delayed by -6.84965007400001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1857s for a response
I20260709 13:14:57.884349  6019 raft_consensus.cc:493] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
W20260709 13:14:57.895677  3997 connection.cc:256] RPC call timeout handler was delayed by -6.8082500739999432s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19030000000000002s for a response
W20260709 13:14:57.896229  3997 connection.cc:256] RPC call timeout handler was delayed by -6.7650500739998733s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19510000000000002s for a response
W20260709 13:14:57.896634  3997 connection.cc:256] RPC call timeout handler was delayed by -6.7155500740000207s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2006s for a response
I20260709 13:14:57.884339  4074 leader_election.cc:400] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Vote denied by peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115) with higher term. Message: Invalid argument: T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 3. Current term is 4.
I20260709 13:14:57.897490  4074 leader_election.cc:403] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:14:57.898797  4102 raft_consensus.cc:1275] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:14:57.898950  4033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38290 (request call id 1552) took 1956 ms. Trace:
I20260709 13:14:57.899482  4033 rpcz_store.cc:276] 0709 13:14:55.941898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.520524 (+1578626us) service_pool.cc:224] Handling call
0709 13:14:57.557853 (+ 37329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:57.860516 (+302663us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.898692 (+ 38176us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:57.900103  3997 connection.cc:256] RPC call timeout handler was delayed by -6.6993500739999945s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20240000000000002s for a response
I20260709 13:14:57.893594  6053 raft_consensus.cc:493] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:57.903045  3997 connection.cc:256] RPC call timeout handler was delayed by -6.6750500739999552s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20510000000000003s for a response
I20260709 13:14:57.899772  6013 leader_election.cc:290] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:57.904733  3997 connection.cc:256] RPC call timeout handler was delayed by -6.6264500739998766s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21050000000000002s for a response
I20260709 13:14:57.905650  6034 consensus_queue.cc:1059] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:57.912284  6034 consensus_queue.cc:1243] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [LEADER]: Peer f1c75790cedf4f52a3463a255c7da059 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:14:57.908077  5894 raft_consensus.cc:515] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:57.908715  4030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38290 (request call id 1557) took 1885 ms. Trace:
I20260709 13:14:57.913081  6019 raft_consensus.cc:515] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:57.903955  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 113956us
I20260709 13:14:57.912226  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:57.906459  4101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45332 (request call id 1480) took 1698 ms. Trace:
I20260709 13:14:57.907446  4672 leader_election.cc:304] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:57.913322  4030 rpcz_store.cc:276] 0709 13:14:56.023751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.907233 (+1883482us) service_pool.cc:224] Handling call
0709 13:14:57.907940 (+   707us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:57.908339 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:57.908365 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:57.908425 (+    60us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:14:57.908467 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.908521 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:57.908627 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:58.079787  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:14:57.932422  3997 connection.cc:256] RPC call timeout handler was delayed by -6.5940500740000516s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2141s for a response
I20260709 13:14:58.098533  4031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38304 (request call id 1702) took 1045 ms. Trace:
I20260709 13:14:58.106792  3953 raft_consensus.cc:2376] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 4. Re-sending same reply.
I20260709 13:14:58.107028  4031 rpcz_store.cc:276] 0709 13:14:56.858817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.443527 (+584710us) service_pool.cc:224] Handling call
0709 13:14:57.902659 (+459132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:58.063728  3955 raft_consensus.cc:2368] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 4. Current term is 5.
W20260709 13:14:58.108240  3997 connection.cc:256] RPC call timeout handler was delayed by -6.575150074000021s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2162s for a response
I20260709 13:14:57.914460  4101 rpcz_store.cc:276] 0709 13:14:56.208037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.100929 (+892892us) service_pool.cc:224] Handling call
0709 13:14:57.101294 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:57.426380 (+325086us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:57.426427 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:57.427074 (+   647us) log.cc:844] Serialized 26 byte log entry
0709 13:14:57.765896 (+338822us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:57.853674 (+ 87778us) log.cc:844] Serialized 14 byte log entry
0709 13:14:57.903300 (+ 49626us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.905874 (+  2574us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:57.905939 (+    65us) raft_consensus.cc:1685] finished
0709 13:14:57.905963 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:57.906214 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4529,"prepare.queue_time_us":142960,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":71,"raft.queue_time_us":84167,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"thread_start_us":749228,"threads_started":3,"wal-append.queue_time_us":258117}
I20260709 13:14:57.968855  3957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35354 (request call id 146) took 1732 ms. Trace:
W20260709 13:14:58.102422  5841 consensus_meta.cc:287] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938: Time spent flushing consensus metadata: real 0.583s	user 0.010s	sys 0.007s
I20260709 13:14:58.078655  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:58.022269  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:14:58.108716  3997 connection.cc:256] RPC call timeout handler was delayed by -6.545450073999973s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2195s for a response
W20260709 13:14:57.965272  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 59921.2us
I20260709 13:14:57.930862  5894 leader_election.cc:290] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:58.109566  5841 raft_consensus.cc:515] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:58.119777  3959 raft_consensus.cc:2393] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 4: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:57.904038  6053 raft_consensus.cc:3060] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:14:57.967922  6074 log.cc:927] Time spent T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
W20260709 13:14:58.057121  5895 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.457s	user 0.006s	sys 0.017s
I20260709 13:14:58.080663  4703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:58.133464  6043 raft_consensus.cc:493] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:58.134815  6054 raft_consensus.cc:2804] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:58.134893  6043 raft_consensus.cc:515] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:58.135577  6054 raft_consensus.cc:493] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:58.109357  3957 rpcz_store.cc:276] 0709 13:14:56.236423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.097339 (+860916us) service_pool.cc:224] Handling call
0709 13:14:57.097744 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:57.097967 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:14:57.521078 (+423111us) log.cc:844] Serialized 14 byte log entry
0709 13:14:57.916156 (+395078us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:57.933136 (+ 16980us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:57.968238 (+ 35102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.968367 (+   129us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:57.968587 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14796,"prepare.queue_time_us":68376,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":49860,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":7581,"thread_start_us":746528,"threads_started":2,"wal-append.queue_time_us":320421}
I20260709 13:14:58.136076  6054 raft_consensus.cc:3060] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:57.968305  5820 raft_consensus.cc:493] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:58.137357  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 230209us
I20260709 13:14:57.933010  5962 raft_consensus.cc:493] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
W20260709 13:14:58.131832  5895 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.532s	user 0.008s	sys 0.019s
I20260709 13:14:58.154858  6019 leader_election.cc:290] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:58.077663  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 440944us
W20260709 13:14:58.132331  3997 connection.cc:256] RPC call timeout handler was delayed by -6.5202500739999323s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2223s for a response
I20260709 13:14:58.143174  3951 raft_consensus.cc:2393] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 3: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:14:58.152153  4026 raft_consensus.cc:1240] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 4. Current term is 5. Ops: []
W20260709 13:14:58.164629  3997 connection.cc:256] RPC call timeout handler was delayed by -5.8146500739999283s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3007s for a response
W20260709 13:14:58.174523  3997 connection.cc:256] RPC call timeout handler was delayed by -5.7072806809999292s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21789999999999998s for a response
I20260709 13:14:58.152825  5820 raft_consensus.cc:515] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:58.177338  4026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38290 (request call id 1559) took 2147 ms. Trace:
I20260709 13:14:58.177932  4026 rpcz_store.cc:276] 0709 13:14:56.024426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:58.140193 (+2115767us) service_pool.cc:224] Handling call
0709 13:14:58.151742 (+ 11549us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:58.166223 (+ 14481us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:58.171678 (+  5455us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:58.179670  3997 connection.cc:256] RPC call timeout handler was delayed by -5.5830806809999558s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23170000000000002s for a response
W20260709 13:14:58.187258  4675 leader_election.cc:336] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Timed out: RequestConsensusVote RPC to 127.2.198.194:46115 timed out after 2.017s (SENT)
W20260709 13:14:58.204859  3997 connection.cc:256] RPC call timeout handler was delayed by -5.1834806809999918s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2761s for a response
I20260709 13:14:58.152618  5962 raft_consensus.cc:515] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:58.165169  5894 raft_consensus.cc:493] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
W20260709 13:14:58.220435  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 54583.9us
I20260709 13:14:58.233325  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:58.245487  3997 leader_election.cc:304] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
W20260709 13:14:58.247941  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 364022us
I20260709 13:14:58.250720  5895 raft_consensus.cc:2749] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:14:58.253273  5798 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:58.257899  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:58.258896  3951 raft_consensus.cc:2468] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 4.
I20260709 13:14:58.259696  5898 consensus_queue.cc:1059] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:14:58.261195  5820 leader_election.cc:290] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:58.262050  6011 consensus_queue.cc:1059] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:58.263098  5962 leader_election.cc:290] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:58.263710  6011 raft_consensus.cc:3055] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:58.241900  6043 leader_election.cc:290] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:58.279060  5955 leader_election.cc:290] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:58.273653  5895 raft_consensus.cc:493] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.266892  6011 raft_consensus.cc:740] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:58.271829  6063 consensus_queue.cc:1059] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:14:58.272709  5894 raft_consensus.cc:515] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:58.281081  4074 leader_election.cc:304] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:58.292469  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:58.286751  3997 leader_election.cc:304] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:14:58.294384  3951 raft_consensus.cc:1240] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 2. Current term is 4. Ops: []
I20260709 13:14:58.280536  5898 raft_consensus.cc:3055] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:14:58.297626  3925 leader_election.cc:336] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Timed out: RequestConsensusVote RPC to 127.2.198.194:46115 timed out after 1.607s (SENT)
W20260709 13:14:58.302891  5829 consensus_meta.cc:287] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.733s	user 0.016s	sys 0.003s
I20260709 13:14:58.302363  4026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38304 (request call id 1665) took 2274 ms. Trace:
I20260709 13:14:58.312638  4026 rpcz_store.cc:276] 0709 13:14:56.026041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:58.211668 (+2185627us) service_pool.cc:224] Handling call
0709 13:14:58.268274 (+ 56606us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:58.296855 (+ 28581us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:58.296899 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:58.300194 (+  3295us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:14:58.300239 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:58.300306 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:58.300419 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:58.315292  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 44934.9us
I20260709 13:14:58.316531  4074 leader_election.cc:304] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:58.316996  5841 leader_election.cc:290] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:58.313220  3959 raft_consensus.cc:2468] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 3.
I20260709 13:14:58.315745  4026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38304 (request call id 1668) took 2241 ms. Trace:
W20260709 13:14:58.332008  4730 debug-util.cc:398] Leaking SignalData structure 0x7b08002f7220 after lost signal to thread 2846
W20260709 13:14:58.336828  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.382378  6083 raft_consensus.cc:2749] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:14:58.385617  6088 log.cc:927] Time spent T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.053s	user 0.003s	sys 0.002s
I20260709 13:14:58.340708  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:58.289307  5895 raft_consensus.cc:515] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:58.319034  6011 consensus_queue.cc:260] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:58.302102  5503 raft_consensus.cc:3060] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:58.300515  5898 raft_consensus.cc:740] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
W20260709 13:14:58.382805  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 116216us
I20260709 13:14:58.383249  6082 consensus_queue.cc:1048] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:58.383909  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:58.322891  4026 rpcz_store.cc:276] 0709 13:14:56.074704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:58.314252 (+2239548us) service_pool.cc:224] Handling call
0709 13:14:58.314859 (+   607us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:58.315311 (+   452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:58.315342 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:58.315409 (+    67us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:58.315442 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:58.315505 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:58.315686 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:58.386382  3959 raft_consensus.cc:3060] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:58.399773  6091 raft_consensus.cc:2764] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:14:58.401093  4703 raft_consensus.cc:3060] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:58.401291  4026 raft_consensus.cc:1275] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:14:58.402176  4026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38304 (request call id 1674) took 2163 ms. Trace:
I20260709 13:14:58.402622  4026 rpcz_store.cc:276] 0709 13:14:56.238292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:58.399775 (+2161483us) service_pool.cc:224] Handling call
0709 13:14:58.400698 (+   923us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:58.401854 (+  1156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:58.402084 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:58.403753  3951 raft_consensus.cc:3060] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:58.404969  4026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38304 (request call id 1677) took 1975 ms. Trace:
I20260709 13:14:58.405470  4026 rpcz_store.cc:276] 0709 13:14:56.429928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:58.403531 (+1973603us) service_pool.cc:224] Handling call
0709 13:14:58.404053 (+   522us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:58.404580 (+   527us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:58.404616 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:58.404699 (+    83us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:58.404734 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:58.404790 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:58.404909 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:58.407114  4030 raft_consensus.cc:1240] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:58.409010  6011 raft_consensus.cc:3060] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:58.414464  3951 raft_consensus.cc:2468] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 6.
I20260709 13:14:58.416059  4704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:58.416970  4704 raft_consensus.cc:2393] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 4: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:14:58.417017  3959 raft_consensus.cc:2468] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 4.
I20260709 13:14:58.421111  4032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38290 (request call id 1544) took 2565 ms. Trace:
I20260709 13:14:58.421448  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:58.421732  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:58.434468  4030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38290 (request call id 1560) took 2409 ms. Trace:
I20260709 13:14:58.434937  4030 rpcz_store.cc:276] 0709 13:14:56.024697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:58.406249 (+2381552us) service_pool.cc:224] Handling call
0709 13:14:58.406783 (+   534us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:58.426937 (+ 20154us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:58.434358 (+  7421us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:58.435532  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:58.422212  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:58.438985  4704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:58.443466  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:58.424917  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:14:58.446264  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 126975us
I20260709 13:14:58.433554  6083 raft_consensus.cc:493] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.447391  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:58.424896  5894 leader_election.cc:290] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:58.446630  5955 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:58.450574  3959 raft_consensus.cc:1240] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:14:58.450826  4708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:58.446790  5962 raft_consensus.cc:493] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:58.454922  6090 raft_consensus.cc:2804] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:58.455511  6090 raft_consensus.cc:493] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:58.455179  5962 raft_consensus.cc:515] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:58.455996  6090 raft_consensus.cc:3060] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:58.457495  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:58.458676  3957 raft_consensus.cc:3060] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:58.462435  3953 raft_consensus.cc:1240] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:14:58.452589  4034 raft_consensus.cc:2468] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 4.
I20260709 13:14:58.421564  4032 rpcz_store.cc:276] 0709 13:14:55.855191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.957002 (+101811us) service_pool.cc:224] Handling call
0709 13:14:56.001757 (+ 44755us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:56.269766 (+268009us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:14:56.290003 (+ 20237us) log.cc:844] Serialized 14 byte log entry
0709 13:14:57.424935 (+1134932us) log.cc:844] Serialized 14 byte log entry
0709 13:14:57.425152 (+   217us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:57.425203 (+    51us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:14:57.425264 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:58.420580 (+995316us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b54001e9bd4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:14:58.420644 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:58.420857 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8760,"prepare.queue_time_us":359025,"prepare.run_cpu_time_us":154,"prepare.run_wall_time_us":4071,"raft.queue_time_us":459123,"raft.run_cpu_time_us":378,"raft.run_wall_time_us":35534,"spinlock_wait_cycles":615636736,"thread_start_us":1125513,"threads_started":2,"wal-append.queue_time_us":766744}
I20260709 13:14:58.453591  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:58.392676  5829 raft_consensus.cc:515] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:58.469746  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 89163.8us
I20260709 13:14:58.422888  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:58.474987  3955 raft_consensus.cc:2468] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 3.
I20260709 13:14:58.478760  5944 raft_consensus.cc:3060] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:14:58.479344  4730 debug-util.cc:398] Leaking SignalData structure 0x7b08002f7900 after lost signal to thread 3891
I20260709 13:14:58.450704  5955 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:58.481094  6001 leader_election.cc:290] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:14:58.481418  4730 debug-util.cc:398] Leaking SignalData structure 0x7b08000aa500 after lost signal to thread 3983
W20260709 13:14:58.481845  4730 debug-util.cc:398] Leaking SignalData structure 0x7b08003d8820 after lost signal to thread 3984
I20260709 13:14:58.482115  5955 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:58.482457  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:58.483410  4707 raft_consensus.cc:3060] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:58.485498  5829 leader_election.cc:290] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:58.488946  4071 leader_election.cc:304] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:58.443107  6053 raft_consensus.cc:515] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:58.491137  4730 debug-util.cc:398] Leaking SignalData structure 0x7b0800385320 after lost signal to thread 4058
I20260709 13:14:58.502390  4033 raft_consensus.cc:1240] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:58.491225  4071 leader_election.cc:304] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: d709ee666b774ec29aa732e508219938
W20260709 13:14:58.507472  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 54228.9us
I20260709 13:14:58.500011  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:58.500996  4708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:58.525869  3955 raft_consensus.cc:2468] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 4.
I20260709 13:14:58.499096  4703 raft_consensus.cc:1275] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:58.528312  4074 leader_election.cc:304] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:58.532580  4033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38290 (request call id 1558) took 2508 ms. Trace:
I20260709 13:14:58.498303  5503 raft_consensus.cc:2749] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115) with higher term. Message: Invalid argument: T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 3. Current term is 4.
W20260709 13:14:58.493274  6037 log.cc:927] Time spent T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 1.348s	user 0.000s	sys 0.003s
I20260709 13:14:58.533433  4033 rpcz_store.cc:276] 0709 13:14:56.024150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:58.501620 (+2477470us) service_pool.cc:224] Handling call
0709 13:14:58.502093 (+   473us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:58.531559 (+ 29466us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:58.532498 (+   939us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:58.475054  3952 raft_consensus.cc:2468] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 4.
I20260709 13:14:58.506861  5895 leader_election.cc:290] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:58.501117  6047 leader_election.cc:290] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:14:58.536206  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 250091us
I20260709 13:14:58.505036  5962 leader_election.cc:290] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:58.495848  5865 raft_consensus.cc:2749] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:58.544734  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:58.549067  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:58.552084  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:58.549849  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:14:58.558223  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 108002us
I20260709 13:14:58.507757  6013 consensus_queue.cc:1059] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:14:58.468822  6083 raft_consensus.cc:515] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:58.571435  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:58.572273  3959 raft_consensus.cc:2368] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 for earlier term 5. Current term is 6.
I20260709 13:14:58.573079  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:58.574162  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:58.575196  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:58.576388  3997 leader_election.cc:304] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:14:58.577404  6055 raft_consensus.cc:2804] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:14:58.577344  4730 debug-util.cc:398] Leaking SignalData structure 0x7b080039e5a0 after lost signal to thread 4132
I20260709 13:14:58.578258  6053 leader_election.cc:290] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:58.578431  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:58.579627  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:14:58.580199  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 89221.2us
I20260709 13:14:58.593477  4033 raft_consensus.cc:2468] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:58.580659  6086 raft_consensus.cc:3055] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:14:58.580729  3925 leader_election.cc:336] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Timed out: RequestConsensusVote RPC to 127.2.198.194:46115 timed out after 1.646s (SENT)
I20260709 13:14:58.582996  3955 raft_consensus.cc:2468] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 3.
I20260709 13:14:58.584669  3959 raft_consensus.cc:2468] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 4.
I20260709 13:14:58.509675  5898 consensus_queue.cc:260] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:58.570925  3957 raft_consensus.cc:2468] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 4.
I20260709 13:14:58.585726  4030 raft_consensus.cc:2468] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 3.
I20260709 13:14:58.585760  4032 raft_consensus.cc:2468] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:58.594848  3951 raft_consensus.cc:2393] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 in current term 4: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:14:58.600247  4707 raft_consensus.cc:2468] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
I20260709 13:14:58.585289  6055 raft_consensus.cc:493] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:58.587677  6047 raft_consensus.cc:2804] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:57.848239  4025 rpcz_store.cc:276] 0709 13:14:55.935576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:56.613032 (+677456us) service_pool.cc:224] Handling call
0709 13:14:56.613399 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:56.613697 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:14:57.435681 (+821984us) log.cc:844] Serialized 14 byte log entry
0709 13:14:57.745905 (+310224us) log.cc:844] Serialized 14 byte log entry
0709 13:14:57.746249 (+   344us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:57.746322 (+    73us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:57.746453 (+   131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.746605 (+   152us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:57.746923 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":342158,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":23278,"raft.queue_time_us":100395,"thread_start_us":1112015,"threads_started":2,"wal-append.queue_time_us":233339}
I20260709 13:14:58.599264  6086 raft_consensus.cc:740] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:58.614193  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:58.614923  4033 raft_consensus.cc:2468] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 3.
I20260709 13:14:58.612368  6013 raft_consensus.cc:2764] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
W20260709 13:14:58.626145  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 107932us
W20260709 13:14:58.627513  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 51332.3us
I20260709 13:14:58.628640  3997 leader_election.cc:304] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:58.606992  6055 raft_consensus.cc:3060] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:58.586606  6054 raft_consensus.cc:515] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:58.627571  5898 raft_consensus.cc:3060] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:58.611306  6047 raft_consensus.cc:493] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:14:58.632795  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:58.634966  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:58.638139  4031 raft_consensus.cc:3055] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:58.638366  6054 leader_election.cc:290] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:58.638561  4031 raft_consensus.cc:740] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:58.640028  4704 raft_consensus.cc:2368] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 4. Current term is 5.
I20260709 13:14:58.641290  3958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1605) took 2532 ms. Trace:
I20260709 13:14:58.641719  3958 rpcz_store.cc:276] 0709 13:14:56.109168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:56.967740 (+858572us) service_pool.cc:224] Handling call
0709 13:14:56.980116 (+ 12376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:57.408323 (+428207us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:14:57.446439 (+ 38116us) log.cc:844] Serialized 14 byte log entry
0709 13:14:57.734651 (+288212us) log.cc:844] Serialized 14 byte log entry
0709 13:14:57.734979 (+   328us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:57.735039 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:57.735152 (+   113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:58.640853 (+905701us) spinlock_profiling.cc:243] Waited 428 ms on lock 0x7b54003ff554. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:14:58.640904 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:58.641075 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":134068,"prepare.run_cpu_time_us":129,"prepare.run_wall_time_us":2130,"raft.queue_time_us":160517,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":217,"spinlock_wait_cycles":984056704,"thread_start_us":286615,"threads_started":1,"wal-append.queue_time_us":247226}
I20260709 13:14:58.644811  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:58.646610  3956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1595) took 2875 ms. Trace:
I20260709 13:14:58.648275  6013 raft_consensus.cc:2764] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:14:58.648120  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:58.649457  4025 raft_consensus.cc:2468] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 4.
I20260709 13:14:58.650498  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:58.648087  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:58.652554  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:58.653191  4028 raft_consensus.cc:2468] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 4.
I20260709 13:14:58.654304  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:58.601260  5895 consensus_queue.cc:1048] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:14:58.657491  5944 consensus_queue.cc:1048] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:58.660108  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:14:58.661353  4730 debug-util.cc:398] Leaking SignalData structure 0x7b080022ed00 after lost signal to thread 4733
W20260709 13:14:58.664314  4027 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38290 (request call id 1555) took 2673 ms (client timeout 3519 ms). Trace:
I20260709 13:14:58.652872  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:58.664616  4706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57666 (request call id 390) took 1204 ms. Trace:
W20260709 13:14:58.664788  4027 rpcz_store.cc:269] 0709 13:14:55.990873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:56.013614 (+ 22741us) service_pool.cc:224] Handling call
0709 13:14:58.663880 (+2650266us) spinlock_profiling.cc:243] Waited 534 ms on lock 0x7b540026ded4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:14:58.664080 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1227131136}
I20260709 13:14:58.665861  4099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45332 (request call id 1494) took 2447 ms. Trace:
I20260709 13:14:58.666316  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:58.666296  4099 rpcz_store.cc:276] 0709 13:14:56.218804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.187946 (+969142us) service_pool.cc:224] Handling call
0709 13:14:57.188330 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:57.405644 (+217314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:58.665413 (+1259769us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b5400019854. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:14:58.665665 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24301952}
I20260709 13:14:58.667883  4026 raft_consensus.cc:1275] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:14:58.668319  4027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38304 (request call id 1683) took 2118 ms. Trace:
I20260709 13:14:58.669844  6094 raft_consensus.cc:1064] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc: attempting to promote NON_VOTER d709ee666b774ec29aa732e508219938 to VOTER
I20260709 13:14:58.670070  6086 consensus_queue.cc:260] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:58.669860  6011 raft_consensus.cc:3055] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:58.677052  6011 raft_consensus.cc:740] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:14:58.678472  6011 consensus_queue.cc:260] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:58.680351  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 69357us
I20260709 13:14:58.681051  4034 raft_consensus.cc:1275] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:14:58.681748  4034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38304 (request call id 1695) took 1825 ms. Trace:
I20260709 13:14:58.682094  4034 rpcz_store.cc:276] 0709 13:14:56.856426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:58.680243 (+1823817us) service_pool.cc:224] Handling call
0709 13:14:58.680671 (+   428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:58.681465 (+   794us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:58.681676 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:58.682009  4701 consensus_queue.cc:260] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:58.683293  4701 raft_consensus.cc:3060] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:58.687973  4032 raft_consensus.cc:3060] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:14:58.688591  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 60149.3us
I20260709 13:14:58.647001  3956 rpcz_store.cc:276] 0709 13:14:55.772443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.974561 (+202118us) service_pool.cc:224] Handling call
0709 13:14:55.975100 (+   539us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:56.152834 (+177734us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:56.152872 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:56.227997 (+ 75125us) log.cc:844] Serialized 52 byte log entry
0709 13:14:56.619870 (+391873us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:14:56.619938 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:58.492215 (+1872277us) spinlock_profiling.cc:243] Waited 5.5 ms on lock 0x7b4400022b4c. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f15224a7c85 00007f15224a86a2 00007f152521a1db 00007f1525215aaf 00007f152520986e 00007f1525208bb6 00007f15252087d8 00007f1525212221 00007f15252121d9 00007f1525212169
0709 13:14:58.646073 (+153858us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b5400216bd4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:14:58.646132 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:58.646186 (+    54us) raft_consensus.cc:1685] finished
0709 13:14:58.646199 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:58.646411 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3417,"raft.queue_time_us":760,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":72881,"spinlock_wait_cycles":420258432,"thread_start_us":336616,"threads_started":1,"wal-append.queue_time_us":893795}
I20260709 13:14:58.668680  4027 rpcz_store.cc:276] 0709 13:14:56.549799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:58.667323 (+2117524us) service_pool.cc:224] Handling call
0709 13:14:58.667703 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:58.667957 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:58.667984 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:58.668047 (+    63us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:14:58.668081 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:58.668134 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:58.668236 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:58.609789  6083 leader_election.cc:290] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:58.655406  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:58.694018  4028 raft_consensus.cc:2410] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:14:58.664979  4033 raft_consensus.cc:2468] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 3.
I20260709 13:14:58.681766  3922 leader_election.cc:304] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:58.696750  3999 leader_election.cc:400] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Vote denied by peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117) with higher term. Message: Invalid argument: T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 4. Current term is 5.
I20260709 13:14:58.697149  3999 leader_election.cc:403] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:14:58.699779  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 67956us
I20260709 13:14:58.675211  5974 leader_election.cc:290] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:58.697829  6019 raft_consensus.cc:3060] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:14:58.708632  4071 leader_election.cc:304] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:58.707798  4031 consensus_queue.cc:260] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:58.706614  6094 consensus_queue.cc:237] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:58.635910  6047 raft_consensus.cc:3060] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:58.708269  6011 raft_consensus.cc:3060] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:58.718926  4028 raft_consensus.cc:1275] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:14:58.719076  4031 raft_consensus.cc:3060] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:58.719208  4027 raft_consensus.cc:1240] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:14:58.723479  5820 raft_consensus.cc:2749] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:14:58.725694  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 164281us
I20260709 13:14:58.720880  4028 pending_rounds.cc:85] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2: Aborting all ops after (but not including) 5
I20260709 13:14:58.711433  6086 raft_consensus.cc:3060] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:58.728960  4675 leader_election.cc:304] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:58.665081  4706 rpcz_store.cc:276] 0709 13:14:57.460183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.463803 (+  3620us) service_pool.cc:224] Handling call
0709 13:14:57.471690 (+  7887us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:57.567853 (+ 96163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:57.567907 (+    54us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:57.567991 (+    84us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:57.568057 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:58.664137 (+1096080us) spinlock_profiling.cc:243] Waited 95.8 ms on lock 0x7b5400598654. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:14:58.664205 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:58.664396 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":220305152}
I20260709 13:14:58.726704  4028 pending_rounds.cc:107] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2: Aborting uncommitted NO_OP operation due to leader change: 4.6
W20260709 13:14:58.732252  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 117288us
I20260709 13:14:58.722509  5474 raft_consensus.cc:493] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.733916  4028 raft_consensus.cc:2889] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:58.732625  3924 leader_election.cc:304] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:14:58.739341  6020 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.001s	user 0.012s	sys 0.019s
W20260709 13:14:58.746377  6020 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.146s	user 0.012s	sys 0.019s
I20260709 13:14:58.752218  4675 leader_election.cc:304] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:58.744798  6054 raft_consensus.cc:2804] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:58.750630  5962 raft_consensus.cc:2804] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:14:58.754045  5974 raft_consensus.cc:2804] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:58.771934  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:14:58.776247  3954 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38606 (request call id 1607) took 2666 ms (client timeout 2136 ms). Trace:
W20260709 13:14:58.776813  3954 rpcz_store.cc:269] 0709 13:14:56.109697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:56.192603 (+ 82906us) service_pool.cc:224] Handling call
0709 13:14:58.767399 (+2574796us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b54003205d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:14:58.775964 (+  8565us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":643076480}
I20260709 13:14:58.778507  3953 raft_consensus.cc:1240] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:58.754822  5474 raft_consensus.cc:515] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:58.755993  5944 consensus_queue.cc:1048] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:14:58.781605  5474 leader_election.cc:290] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:58.762308  6054 raft_consensus.cc:493] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:58.782437  6054 raft_consensus.cc:3060] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:58.786760  5843 raft_consensus.cc:3060] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:14:58.788034  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:58.788828  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 68156.6us
I20260709 13:14:58.789878  3997 leader_election.cc:304] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:58.790156  5954 consensus_queue.cc:1048] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:58.790431  5798 consensus_queue.cc:1048] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:58.769523  5974 raft_consensus.cc:493] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:58.793331  5974 raft_consensus.cc:3060] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:58.793613  6083 raft_consensus.cc:3060] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:58.811374  4026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38304 (request call id 1680) took 2365 ms. Trace:
I20260709 13:14:58.811941  4026 rpcz_store.cc:276] 0709 13:14:56.446450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:58.406519 (+1960069us) service_pool.cc:224] Handling call
0709 13:14:58.667406 (+260887us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:58.668270 (+   864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:58.811119 (+142849us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b540026ded0. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566d8ad 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:14:58.811296 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":598954752}
I20260709 13:14:58.816234  4029 raft_consensus.cc:2468] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 3.
I20260709 13:14:58.816905  6043 raft_consensus.cc:493] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.817536  6043 raft_consensus.cc:515] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:58.820266  4672 leader_election.cc:304] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:58.821415  5757 raft_consensus.cc:2749] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:14:58.822050  6034 consensus_queue.cc:1048] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:58.792270  5962 raft_consensus.cc:697] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 6 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:14:58.823848  5962 consensus_queue.cc:237] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:58.831009  6043 leader_election.cc:290] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:14:58.834482  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 195250us
I20260709 13:14:58.837208  4701 raft_consensus.cc:1275] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
W20260709 13:14:58.838829  3950 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35354 (request call id 148) took 2601 ms (client timeout 2435 ms). Trace:
I20260709 13:14:58.807530  4071 leader_election.cc:304] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
W20260709 13:14:58.839648  4073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.843832  4025 raft_consensus.cc:1275] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:14:58.835500  4074 leader_election.cc:304] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
W20260709 13:14:58.854223  3950 rpcz_store.cc:269] 0709 13:14:56.237038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:56.421923 (+184885us) service_pool.cc:224] Handling call
0709 13:14:58.838429 (+2416506us) spinlock_profiling.cc:243] Waited 888 ms on lock 0x7b5400188dd4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:14:58.838620 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2041323904}
I20260709 13:14:58.851105  6083 raft_consensus.cc:2749] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:58.853261  4032 raft_consensus.cc:2410] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:14:58.866732  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 114624us
I20260709 13:14:58.869163  4025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38304 (request call id 1681) took 2317 ms. Trace:
I20260709 13:14:58.847077  6054 raft_consensus.cc:515] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:58.869547  4025 rpcz_store.cc:276] 0709 13:14:56.542834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:58.661162 (+2118328us) service_pool.cc:224] Handling call
0709 13:14:58.843398 (+182236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:58.855075 (+ 11677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:58.859640 (+  4565us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b54001db350. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566d8ad 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:14:58.859774 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":418153856}
I20260709 13:14:58.869916  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:58.858080  4701 pending_rounds.cc:85] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938: Aborting all ops after (but not including) 5
I20260709 13:14:58.871899  3922 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:14:58.877974  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:58.882128  4029 raft_consensus.cc:2393] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 5: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:14:58.884188  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:58.885154  4030 raft_consensus.cc:2468] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3.
I20260709 13:14:58.873545  4701 pending_rounds.cc:107] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938: Aborting uncommitted NO_OP operation due to leader change: 4.6
W20260709 13:14:58.898599  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 63200.5us
W20260709 13:14:58.900090  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 97032.1us
I20260709 13:14:58.907260  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:14:58.915915  6098 log.cc:927] Time spent T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:14:58.952689  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:58.952919  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:14:58.955792  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 152347us
W20260709 13:14:58.955832  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 164295us
I20260709 13:14:58.955861  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:58.897189  5798 raft_consensus.cc:2749] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:58.950364  4106 raft_consensus.cc:2468] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 4.
I20260709 13:14:58.898447  4701 raft_consensus.cc:2889] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:58.964671  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:58.965840  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:58.960093  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:58.967803  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:58.919886  6019 raft_consensus.cc:2749] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117) with higher term. Message: Invalid argument: T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 4. Current term is 5.
W20260709 13:14:58.982148  3925 leader_election.cc:336] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Timed out: RequestConsensusVote RPC to 127.2.198.194:46115 timed out after 1.796s (SENT)
I20260709 13:14:58.896101  3857 catalog_manager.cc:5697] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:58.985025  4027 raft_consensus.cc:2468] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 4.
I20260709 13:14:58.986093  3922 leader_election.cc:304] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:58.985622  3857 catalog_manager.cc:5697] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:58.987380  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:58.983462  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:58.902573  6090 raft_consensus.cc:515] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:58.994874  6090 leader_election.cc:290] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:58.995519  5884 raft_consensus.cc:2749] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:58.989233  3925 leader_election.cc:304] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:58.956812  5822 raft_consensus.cc:2749] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:14:59.002542  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 44280.7us
I20260709 13:14:58.925566  6047 raft_consensus.cc:515] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:59.010730  5921 consensus_queue.cc:1059] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:14:59.011678  5879 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
W20260709 13:14:59.012487  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 58063.1us
I20260709 13:14:59.013060  5820 raft_consensus.cc:2749] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:59.015684  4025 raft_consensus.cc:2468] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 4.
I20260709 13:14:59.017204  4029 raft_consensus.cc:2393] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 4: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:14:59.019879  4701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57680 (request call id 494) took 2596 ms. Trace:
I20260709 13:14:59.023104  4071 leader_election.cc:304] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:59.025105  6095 raft_consensus.cc:2749] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:59.026471  6054 leader_election.cc:290] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:14:58.922379  5974 raft_consensus.cc:515] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:59.032703  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
W20260709 13:14:59.041538  3925 leader_election.cc:336] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Timed out: RequestConsensusVote RPC to 127.2.198.194:46115 timed out after 1.898s (SENT)
I20260709 13:14:59.047909  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:14:59.048478  4104 raft_consensus.cc:1240] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 4. Current term is 5. Ops: []
W20260709 13:14:59.048632  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.025141  3857 catalog_manager.cc:5697] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 1 to 5, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 5 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:59.053334  4032 raft_consensus.cc:2468] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 4.
I20260709 13:14:59.071045  3925 leader_election.cc:304] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:59.071345  4031 raft_consensus.cc:1275] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
W20260709 13:14:59.071519  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 85567.7us
I20260709 13:14:59.071848  4031 pending_rounds.cc:85] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2: Aborting all ops after (but not including) 3
I20260709 13:14:59.076817  4031 pending_rounds.cc:107] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:14:59.077289  4031 raft_consensus.cc:2889] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:59.096189  4675 leader_election.cc:304] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:59.103140  4031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38290 (request call id 1563) took 3077 ms. Trace:
I20260709 13:14:59.103554  4031 rpcz_store.cc:276] 0709 13:14:56.025499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:58.637324 (+2611825us) service_pool.cc:224] Handling call
0709 13:14:58.637805 (+   481us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:59.102807 (+465002us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:59.103076 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:59.106997  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 115664us
W20260709 13:14:59.112473  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 137224us
I20260709 13:14:59.098762  6095 raft_consensus.cc:2749] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:59.102409  5675 raft_consensus.cc:2804] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:14:59.111023  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 88034.2us
I20260709 13:14:59.050242  5757 consensus_queue.cc:1048] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:14:59.036085  4701 rpcz_store.cc:276] 0709 13:14:56.423930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:56.427625 (+  3695us) service_pool.cc:224] Handling call
0709 13:14:56.577822 (+150197us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:57.589464 (+1011642us) spinlock_profiling.cc:243] Waited 362 ms on lock 0x7b54005b0a20. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15255e5dc0 00007f15256701c0 00007f1525671231 00007f152566dd8f 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c
0709 13:14:58.656707 (+1067243us) spinlock_profiling.cc:243] Waited 7.6 ms on lock 0x7b4c001150c0. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152393aa20 00007f152394ba29 00007f1523911644 00007f1523938f2d 00007f1523938b93 00007f152566918b 00007f1525669cb5 00007f1525664f30 00007f15256667de 00007f1525670b49 00007f1525671416
0709 13:14:59.000488 (+343781us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:59.019788 (+ 19300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":850836096}
I20260709 13:14:59.120558  3857 catalog_manager.cc:5697] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 3 to 4, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 4 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:59.132050  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:14:59.114327  6054 raft_consensus.cc:2804] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:59.098536  6055 raft_consensus.cc:515] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:59.147382  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 94479.7us
W20260709 13:14:59.148766  4672 leader_election.cc:336] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Timed out: RequestConsensusVote RPC to 127.2.198.193:35339 timed out after 1.541s (SENT)
I20260709 13:14:59.149259  4672 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
W20260709 13:14:59.150830  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 115388us
I20260709 13:14:59.152607  3997 leader_election.cc:304] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:14:59.113943  5921 consensus_queue.cc:1059] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:14:59.146569  3857 catalog_manager.cc:5697] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:59.133720  5675 raft_consensus.cc:697] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:59.141294  6054 raft_consensus.cc:493] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:14:59.178561  5675 consensus_queue.cc:237] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:14:59.183595  3998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.188486  5757 raft_consensus.cc:2749] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:14:59.189018  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.189146  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:59.175781  3857 catalog_manager.cc:5697] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 2 to 4, leader changed from d709ee666b774ec29aa732e508219938 (127.2.198.196) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 4 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:59.158644  5820 raft_consensus.cc:493] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.194931  3857 catalog_manager.cc:5697] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 1 to 5, leader changed from 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 5 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:59.195662  5884 consensus_queue.cc:1059] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:59.195871  5820 raft_consensus.cc:515] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:59.194963  4074 leader_election.cc:304] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:14:59.198098  4074 leader_election.cc:304] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:14:59.198293  5820 leader_election.cc:290] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:59.199122  5474 raft_consensus.cc:2804] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:59.199600  5474 raft_consensus.cc:493] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:14:59.200017  5898 raft_consensus.cc:3055] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:59.200549  5898 raft_consensus.cc:740] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:59.201432  4074 leader_election.cc:304] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:14:59.201618  5898 consensus_queue.cc:260] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:59.202864  4074 leader_election.cc:304] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:59.203083  5898 raft_consensus.cc:3060] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:59.203890  5798 raft_consensus.cc:2804] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:59.204341  5798 raft_consensus.cc:493] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:14:59.204769  5798 raft_consensus.cc:3060] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:59.198328  5822 consensus_queue.cc:1048] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:14:59.207926  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:59.208704  3955 raft_consensus.cc:2468] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 4.
I20260709 13:14:59.200018  5474 raft_consensus.cc:3060] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:59.213003  5921 raft_consensus.cc:2804] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:59.213488  5921 raft_consensus.cc:493] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:14:59.213935  5921 raft_consensus.cc:3060] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:59.174821  6019 raft_consensus.cc:2749] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:59.219174  4703 raft_consensus.cc:1240] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:59.220187  6093 raft_consensus.cc:2749] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:14:59.235074  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 109961us
I20260709 13:14:59.173069  6054 raft_consensus.cc:3060] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:14:59.249451  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 86245us
I20260709 13:14:59.236392  6094 raft_consensus.cc:3055] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:59.252992  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:59.240819  6047 leader_election.cc:290] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:59.254895  6094 raft_consensus.cc:740] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:59.292997  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:59.292245  3857 catalog_manager.cc:5697] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 1 to 3, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 3 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:14:59.307345  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 58794.5us
I20260709 13:14:59.308720  3954 raft_consensus.cc:3060] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:59.267758  5974 leader_election.cc:290] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:14:59.308981  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 160233us
I20260709 13:14:59.294885  5999 raft_consensus.cc:2749] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:14:59.321182  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 159092us
I20260709 13:14:59.312151  6047 raft_consensus.cc:493] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.323909  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:59.329685  3953 raft_consensus.cc:3060] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:59.330318  4672 leader_election.cc:304] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:59.321627  3857 catalog_manager.cc:5697] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: config changed from index 4 to 5, term changed from 2 to 3, leader changed from 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) to d709ee666b774ec29aa732e508219938 (127.2.198.196), VOTER f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) evicted. New cstate: current_term: 3 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
W20260709 13:14:59.328483  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 125715us
I20260709 13:14:59.338922  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:59.339627  3997 leader_election.cc:304] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:14:59.340242  4107 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:14:59.340723  6019 raft_consensus.cc:2749] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:14:59.341049  4107 raft_consensus.cc:606] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 LEADER]: Received request to transfer leadership to TS 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:14:59.343142  3997 leader_election.cc:304] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:59.345439  3925 leader_election.cc:304] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:59.348186  4074 leader_election.cc:304] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
W20260709 13:14:59.352569  3998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.360934  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:59.364291  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:59.384759  3857 catalog_manager.cc:5697] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 2 to 3, leader changed from 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 3 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:59.356194  6055 leader_election.cc:290] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:59.397367  3951 raft_consensus.cc:3060] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:59.358623  5962 raft_consensus.cc:2749] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:59.360247  5974 raft_consensus.cc:2749] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:59.407958  3953 raft_consensus.cc:2468] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 5.
I20260709 13:14:59.410254  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:59.378939  6083 raft_consensus.cc:2749] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:14:59.428334  3925 leader_election.cc:304] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
W20260709 13:14:59.428440  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 98363us
I20260709 13:14:59.421727  6034 raft_consensus.cc:2804] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:59.422523  2843 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 13:14:59.429172  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 86186.4us
W20260709 13:14:59.414374  4675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:59.436561  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 88474.4us
I20260709 13:14:59.443001  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:59.362003  6047 raft_consensus.cc:515] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:59.458494  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:59.472880  3951 raft_consensus.cc:2468] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 5.
I20260709 13:14:59.436259  6034 raft_consensus.cc:493] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:59.364326  6094 consensus_queue.cc:260] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:59.493101  3925 leader_election.cc:304] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:14:59.494040  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:14:59.462184  6107 log.cc:927] Time spent T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.241s	user 0.000s	sys 0.002s
I20260709 13:14:59.494491  6034 raft_consensus.cc:3060] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:59.497774  3857 catalog_manager.cc:5697] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 2 to 4, leader changed from 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 4 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
W20260709 13:14:59.506778  6116 log.cc:927] Time spent T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:14:59.507671  4708 raft_consensus.cc:1275] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 5 LEARNER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:14:59.512362  4705 raft_consensus.cc:1240] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 4. Current term is 6. Ops: [4.6-4.6]
I20260709 13:14:59.514986  6047 leader_election.cc:290] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:59.515703  3953 raft_consensus.cc:3060] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:59.520041  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:14:59.520876  3951 raft_consensus.cc:2393] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 5: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
W20260709 13:14:59.515729  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 65892us
I20260709 13:14:59.523851  2843 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:59.524041  3997 leader_election.cc:304] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:59.525620  3997 leader_election.cc:304] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
W20260709 13:14:59.527639  6114 log.cc:927] Time spent T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.218s	user 0.003s	sys 0.000s
I20260709 13:14:59.533995  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:59.497411  4701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:59.546959  3953 raft_consensus.cc:2468] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 5.
W20260709 13:14:59.565901  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 105010us
I20260709 13:14:59.566854  3925 leader_election.cc:304] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:59.563129  5820 raft_consensus.cc:2749] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:59.572207  3925 leader_election.cc:304] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:59.573136  5822 raft_consensus.cc:2804] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:59.574164  5822 raft_consensus.cc:493] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:59.574712  5822 raft_consensus.cc:3060] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:59.511337  5798 raft_consensus.cc:515] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:59.578270  5798 leader_election.cc:290] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:59.580519  5962 raft_consensus.cc:2804] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:14:59.581317  5962 raft_consensus.cc:697] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 6 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
W20260709 13:14:59.581872  6122 log.cc:927] Time spent T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:14:59.582834  5962 consensus_queue.cc:237] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:59.585955  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:14:59.590605  4071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.551451  6094 raft_consensus.cc:3060] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:59.549674  6115 raft_consensus.cc:2804] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:59.602427  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:14:59.603024  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:59.603962  3925 leader_election.cc:304] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:59.604502  3953 raft_consensus.cc:3060] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:14:59.562156  3857 catalog_manager.cc:5697] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 1 to 4, leader changed from 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 4 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:59.612439  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 156453us
I20260709 13:14:59.624619  4675 leader_election.cc:304] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:14:59.559361  4704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:59.598383  4703 raft_consensus.cc:1275] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:59.649101  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:14:59.595233  5798 consensus_queue.cc:1048] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:14:59.631949  6127 raft_consensus.cc:493] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.655941  3857 catalog_manager.cc:5697] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 3 to 4, leader changed from d709ee666b774ec29aa732e508219938 (127.2.198.196) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 4 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:59.667004  3953 raft_consensus.cc:2468] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 5.
I20260709 13:14:59.642580  4704 raft_consensus.cc:2468] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 6.
I20260709 13:14:59.670473  3956 raft_consensus.cc:1275] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:14:59.673125  3997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.637300  6055 consensus_queue.cc:1048] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:14:59.627079  6095 consensus_queue.cc:1059] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:14:59.651173  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:59.662521  5820 raft_consensus.cc:2749] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:59.678097  3954 raft_consensus.cc:2468] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 5.
I20260709 13:14:59.646483  5474 raft_consensus.cc:515] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:59.683314  3857 catalog_manager.cc:5697] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 2 to 4, leader changed from 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 4 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:59.673193  6084 raft_consensus.cc:3055] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:14:59.692318  4672 leader_election.cc:400] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 election: Vote denied by peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339) with higher term. Message: Invalid argument: T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 for earlier term 5. Current term is 6.
I20260709 13:14:59.691643  3857 catalog_manager.cc:5697] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 1 to 4, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 4 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:59.692689  4672 leader_election.cc:403] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:14:59.653928  5999 consensus_queue.cc:1059] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:14:59.696125  4071 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
W20260709 13:14:59.686678  6108 log.cc:927] Time spent T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.515s	user 0.003s	sys 0.000s
I20260709 13:14:59.664253  6127 raft_consensus.cc:515] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:59.699998  3954 raft_consensus.cc:1240] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 5 LEADER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:14:59.702587  6054 raft_consensus.cc:515] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:14:59.709635  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 48785.3us
I20260709 13:14:59.717677  4071 leader_election.cc:304] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:59.693044  6084 raft_consensus.cc:740] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:59.724274  4071 leader_election.cc:304] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:14:59.687475  6135 raft_consensus.cc:2804] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:59.734292  4071 leader_election.cc:304] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:59.735119  5954 raft_consensus.cc:2804] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:59.735929  4702 raft_consensus.cc:1275] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:14:59.744547  3954 raft_consensus.cc:1275] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:14:59.696424  6132 raft_consensus.cc:2749] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:14:59.779409  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 45306.2us
I20260709 13:14:59.749394  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:14:59.749969  6128 raft_consensus.cc:2749] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:14:59.750545  6138 log.cc:927] Time spent T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:14:59.752004  3956 raft_consensus.cc:1240] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 5. Current term is 6. Ops: []
W20260709 13:14:59.756845  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 64691.2us
I20260709 13:14:59.760282  6125 raft_consensus.cc:2804] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:59.761464  5474 leader_election.cc:290] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:59.721844  3857 catalog_manager.cc:5697] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:14:59.765794  6019 consensus_queue.cc:1048] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:59.776611  4073 leader_election.cc:304] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:14:59.782505  4701 raft_consensus.cc:2468] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:14:59.786687  6120 raft_consensus.cc:2749] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339) with higher term. Message: Invalid argument: T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 for earlier term 5. Current term is 6.
I20260709 13:14:59.787532  5954 raft_consensus.cc:697] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:59.710948  6047 raft_consensus.cc:2749] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:59.796808  4672 leader_election.cc:304] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:59.723507  5822 raft_consensus.cc:515] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:59.823587  4071 leader_election.cc:304] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:14:59.839246  3997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:59.830819  3999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 53356.8us
I20260709 13:14:59.781076  5798 raft_consensus.cc:2749] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:14:59.834308  3857 catalog_manager.cc:5697] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:59.823572  6121 raft_consensus.cc:2804] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:59.843281  4071 leader_election.cc:304] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:14:59.850625  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 53888.6us
W20260709 13:14:59.853716  3998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:59.857928  3998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.839970  6125 raft_consensus.cc:697] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
W20260709 13:14:59.898645  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 176367us
I20260709 13:14:59.897045  4700 raft_consensus.cc:1240] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:59.845853  6132 raft_consensus.cc:493] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.845083  5675 raft_consensus.cc:2804] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:59.848202  6128 raft_consensus.cc:2749] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:59.849995  6121 raft_consensus.cc:493] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:59.911398  4672 leader_election.cc:304] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:14:59.844866  6123 consensus_queue.cc:1048] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 13:14:59.926955  3857 catalog_manager.cc:5697] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 1 to 3, leader changed from 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) to d709ee666b774ec29aa732e508219938 (127.2.198.196). New cstate: current_term: 3 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
W20260709 13:14:59.915469  5921 consensus_meta.cc:287] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.701s	user 0.014s	sys 0.000s
I20260709 13:14:59.911628  6121 raft_consensus.cc:3060] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:59.916404  5675 raft_consensus.cc:697] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:14:59.937940  5898 raft_consensus.cc:2804] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:59.940874  5921 raft_consensus.cc:515] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:14:59.944512  5954 consensus_queue.cc:237] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:59.957032  6154 consensus_queue.cc:1048] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:14:59.957775  6139 log.cc:927] Time spent T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:14:59.959811  4106 raft_consensus.cc:1240] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:59.952899  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:59.937135  5999 raft_consensus.cc:2749] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:59.851104  6084 consensus_queue.cc:260] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:59.944744  6054 leader_election.cc:290] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 election: Requested vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:14:59.959323  5921 leader_election.cc:290] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:14:59.960161  6148 consensus_queue.cc:1048] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:14:59.913528  6132 raft_consensus.cc:515] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:14:59.994515  3857 catalog_manager.cc:5697] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 2 to 5, leader changed from 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 5 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
W20260709 13:15:00.046774  4071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:00.051599  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 75417.1us
W20260709 13:15:00.054888  4073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:00.059679  4073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:00.045666  6151 log.cc:927] Time spent T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 13:14:59.982280  6156 raft_consensus.cc:493] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.979116  5898 raft_consensus.cc:697] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:00.063247  3857 catalog_manager.cc:5697] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:00.047452  6084 raft_consensus.cc:3060] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:00.070750  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:14:59.978209  6083 raft_consensus.cc:493] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:00.048159  6127 leader_election.cc:290] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:00.047274  6147 raft_consensus.cc:493] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:14:59.960835  6125 consensus_queue.cc:237] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:00.070747  6034 consensus_meta.cc:287] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938: Time spent flushing consensus metadata: real 0.568s	user 0.013s	sys 0.000s
I20260709 13:15:00.091671  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:00.090883  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:00.073720  6135 raft_consensus.cc:697] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:00.086431  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:15:00.090837  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 193926us
I20260709 13:15:00.096858  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:00.094290  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:00.098748  4027 raft_consensus.cc:2468] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 4.
I20260709 13:15:00.102255  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:00.103969  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:00.106613  4672 leader_election.cc:304] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:00.103710  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:00.110247  4034 raft_consensus.cc:3060] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:00.111886  3857 catalog_manager.cc:5697] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 2 to 4, leader changed from 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 4 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
W20260709 13:15:00.114243  6152 log.cc:927] Time spent T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:15:00.114073  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:00.120535  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:15:00.125058  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 76620us
I20260709 13:15:00.096064  5822 leader_election.cc:290] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:00.054013  5675 consensus_queue.cc:237] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:00.108695  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:00.129297  4672 leader_election.cc:304] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:00.114228  6153 log.cc:927] Time spent T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:15:00.132423  3925 leader_election.cc:304] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:00.135844  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:00.137140  3857 catalog_manager.cc:5697] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:00.142625  3857 catalog_manager.cc:5697] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:00.074873  6156 raft_consensus.cc:515] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:00.152593  4672 leader_election.cc:304] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
W20260709 13:15:00.153952  6158 log.cc:927] Time spent T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:15:00.154877  6135 consensus_queue.cc:237] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:00.157065  6161 raft_consensus.cc:2804] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:00.157716  6161 raft_consensus.cc:697] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 5 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:00.158715  6161 consensus_queue.cc:237] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:00.127650  6128 raft_consensus.cc:2804] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:00.096701  6034 raft_consensus.cc:515] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:00.161980  6034 leader_election.cc:290] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:00.164103  6130 log.cc:927] Time spent T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.602s	user 0.005s	sys 0.000s
I20260709 13:15:00.165644  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:00.166519  4104 raft_consensus.cc:2393] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 in current term 3: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:00.091691  6155 consensus_queue.cc:1048] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:15:00.169185  6160 consensus_queue.cc:1048] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:00.170745  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:00.171679  3952 raft_consensus.cc:2368] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 4. Current term is 5.
I20260709 13:15:00.172132  4033 raft_consensus.cc:2468] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 3.
I20260709 13:15:00.171921  5898 consensus_queue.cc:237] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:00.172677  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:00.174116  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:00.175608  3952 raft_consensus.cc:1240] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:00.175742  4705 raft_consensus.cc:2468] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 4.
I20260709 13:15:00.176546  6132 leader_election.cc:290] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:00.177219  3952 raft_consensus.cc:1275] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:00.178143  5822 consensus_queue.cc:1048] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:00.178544  3952 raft_consensus.cc:1240] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:00.092123  6147 raft_consensus.cc:515] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:00.180922  6155 consensus_queue.cc:1048] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:00.181548  6155 consensus_queue.cc:1243] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer 8952c48a6f3a43968f7d77f7bfc4d1bc log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:15:00.181980  6147 leader_election.cc:290] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:00.171654  4034 raft_consensus.cc:2468] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 5.
I20260709 13:15:00.097842  6083 raft_consensus.cc:515] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:15:00.152788  6148 raft_consensus.cc:2804] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:00.159732  6128 raft_consensus.cc:493] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:00.149549  3925 leader_election.cc:304] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:00.190094  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:00.198474  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:00.216799  4104 raft_consensus.cc:1240] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:00.222172  4034 raft_consensus.cc:3060] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:00.223524  4107 raft_consensus.cc:1240] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:00.200878  6128 raft_consensus.cc:3060] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:00.185400  6162 raft_consensus.cc:2749] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:00.187793  6148 raft_consensus.cc:493] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:00.232986  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:00.198856  5921 raft_consensus.cc:493] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:00.226733  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:00.217993  6083 leader_election.cc:290] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:00.229923  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
W20260709 13:15:00.240378  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 90917.4us
I20260709 13:15:00.242553  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:00.244921  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:00.236907  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:00.247150  3925 leader_election.cc:304] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:00.252252  4034 raft_consensus.cc:2468] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 5.
I20260709 13:15:00.237481  6148 raft_consensus.cc:3060] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:00.254143  4029 raft_consensus.cc:3060] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:00.260155  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:00.258631  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:00.260829  4034 raft_consensus.cc:2468] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 6.
I20260709 13:15:00.262027  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:00.262872  4034 raft_consensus.cc:3060] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:00.267035  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:00.247872  5921 raft_consensus.cc:515] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:00.268507  6167 raft_consensus.cc:2749] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:00.270303  5921 leader_election.cc:290] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:00.271585  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:00.271903  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:00.272225  4101 raft_consensus.cc:3060] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:00.272495  4100 raft_consensus.cc:3060] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:00.275650  6166 raft_consensus.cc:493] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:00.276235  6166 raft_consensus.cc:515] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:00.277805  4105 raft_consensus.cc:1275] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:15:00.278470  6157 log.cc:927] Time spent T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 13:15:00.278622  6166 leader_election.cc:290] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:00.279012  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:00.295121  4034 raft_consensus.cc:2468] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 4.
I20260709 13:15:00.297065  3997 leader_election.cc:304] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:00.265479  5962 raft_consensus.cc:2749] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:00.301927  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:00.305366  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:00.314792  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:00.301792  5757 raft_consensus.cc:3055] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:15:00.310017  6094 consensus_meta.cc:287] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.692s	user 0.007s	sys 0.007s
I20260709 13:15:00.303793  6115 raft_consensus.cc:493] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:00.297482  3925 leader_election.cc:304] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:00.325413  4101 raft_consensus.cc:2410] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:15:00.355913  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 58521.3us
I20260709 13:15:00.282291  3952 raft_consensus.cc:2393] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 in current term 4: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:00.343654  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:00.360831  6124 raft_consensus.cc:493] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.361464  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:00.361392  6124 raft_consensus.cc:515] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:00.362242  4105 raft_consensus.cc:2376] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 4. Re-sending same reply.
I20260709 13:15:00.359104  4099 raft_consensus.cc:2468] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 5.
I20260709 13:15:00.363647  5820 raft_consensus.cc:2804] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:00.364177  5820 raft_consensus.cc:493] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:00.364594  5820 raft_consensus.cc:3060] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:00.368499  6156 leader_election.cc:290] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:00.371840  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:00.372072  4102 raft_consensus.cc:2468] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 4.
I20260709 13:15:00.373283  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:00.374650  4102 raft_consensus.cc:1240] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:00.377677  3925 leader_election.cc:304] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:00.377939  4672 leader_election.cc:304] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:00.364070  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:00.379009  4104 raft_consensus.cc:2393] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 5: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:00.363705  4108 raft_consensus.cc:2468] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 4.
I20260709 13:15:00.385257  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:00.342031  6147 raft_consensus.cc:2764] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:15:00.332974  6166 raft_consensus.cc:493] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.386075  4100 raft_consensus.cc:2468] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 5.
I20260709 13:15:00.387506  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:00.351711  6154 raft_consensus.cc:493] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.389206  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:00.363392  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:00.392135  4028 raft_consensus.cc:2468] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 4.
I20260709 13:15:00.350879  5757 raft_consensus.cc:740] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:00.357784  6115 raft_consensus.cc:3060] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:00.358035  5921 raft_consensus.cc:493] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.398075  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:00.399629  4672 leader_election.cc:304] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:00.385370  6167 raft_consensus.cc:2749] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:15:00.406837  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 144897us
W20260709 13:15:00.409744  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 53131.9us
I20260709 13:15:00.410483  3925 leader_election.cc:304] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:00.394404  6086 consensus_queue.cc:1048] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
W20260709 13:15:00.432603  3998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:00.435957  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:00.406929  5921 raft_consensus.cc:515] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:00.438846  6169 raft_consensus.cc:2749] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:00.439507  6167 raft_consensus.cc:2804] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:00.440017  6167 raft_consensus.cc:493] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:00.440109  6034 raft_consensus.cc:2749] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:00.440448  4104 pending_rounds.cc:85] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Aborting all ops after (but not including) 1
I20260709 13:15:00.440809  4104 pending_rounds.cc:107] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:15:00.441068  4104 raft_consensus.cc:2889] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:00.402812  6154 raft_consensus.cc:515] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:00.447696  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:00.454643  4101 raft_consensus.cc:1275] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:15:00.455107  4101 pending_rounds.cc:85] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Aborting all ops after (but not including) 5
I20260709 13:15:00.455487  4101 pending_rounds.cc:107] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:15:00.407423  6124 leader_election.cc:290] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:00.456179  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:00.455899  4101 raft_consensus.cc:2889] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:00.460160  4029 raft_consensus.cc:2468] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 5.
I20260709 13:15:00.400933  6166 raft_consensus.cc:515] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:00.464792  4029 raft_consensus.cc:1240] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:00.397084  6121 raft_consensus.cc:515] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:00.466501  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:00.471969  3997 leader_election.cc:400] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: Vote denied by peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339) with higher term. Message: Invalid argument: T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 4. Current term is 5.
I20260709 13:15:00.472318  4106 raft_consensus.cc:2393] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 5: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:00.472419  3997 leader_election.cc:403] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:15:00.488082  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:00.492947  4033 raft_consensus.cc:3055] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:00.493491  4033 raft_consensus.cc:740] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:00.493938  3954 raft_consensus.cc:1240] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:00.440470  6167 raft_consensus.cc:3060] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:00.497143  4028 raft_consensus.cc:1275] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:00.496572  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:00.505290  4029 raft_consensus.cc:2468] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 5.
I20260709 13:15:00.512920  6135 raft_consensus.cc:493] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.513857  6135 raft_consensus.cc:515] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:00.515853  4108 raft_consensus.cc:1217] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Deduplicated request from leader. Original: 1.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 13:15:00.516434  4108 raft_consensus.cc:1240] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:15:00.516777  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:00.517473  3958 raft_consensus.cc:2468] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 5.
I20260709 13:15:00.518290  4033 consensus_queue.cc:260] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:00.527997  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:00.541821  6173 log.cc:927] Time spent T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
W20260709 13:15:00.542721  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 79576.3us
I20260709 13:15:00.543701  4033 raft_consensus.cc:3060] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:00.546270  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:00.544333  4071 leader_election.cc:304] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:00.552661  6135 leader_election.cc:290] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:00.555141  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:00.562450  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:00.495232  6095 consensus_queue.cc:1048] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:15:00.578791  3997 leader_election.cc:304] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:00.579622  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:00.574510  6147 raft_consensus.cc:3060] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:00.593005  4071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:00.593575  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:00.594483  4108 raft_consensus.cc:2410] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:15:00.578315  5944 raft_consensus.cc:2804] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:00.606237  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:00.621779  4107 raft_consensus.cc:1240] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 4. Current term is 5. Ops: []
W20260709 13:15:00.623330  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 75533.2us
I20260709 13:15:00.605240  6083 raft_consensus.cc:2749] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:15:00.624624  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 214205us
I20260709 13:15:00.607226  5944 raft_consensus.cc:493] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:00.687029  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:00.687443  4033 raft_consensus.cc:1275] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:15:00.690973  4033 pending_rounds.cc:85] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2: Aborting all ops after (but not including) 2
I20260709 13:15:00.690843  3997 leader_election.cc:304] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:00.691273  4033 pending_rounds.cc:107] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:15:00.691563  4033 raft_consensus.cc:2889] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:00.690310  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:00.682651  5944 raft_consensus.cc:3060] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:00.695317  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:00.713625  3925 leader_election.cc:304] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:00.702668  6156 raft_consensus.cc:2749] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:00.750408  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:00.755291  4107 raft_consensus.cc:2393] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 4: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
W20260709 13:15:00.759810  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 77438.4us
W20260709 13:15:00.769558  6191 log.cc:927] Time spent T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:15:00.752614  6095 raft_consensus.cc:2804] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:00.747991  5820 raft_consensus.cc:515] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:00.782233  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:00.753543  6190 consensus_queue.cc:1059] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.253s
W20260709 13:15:00.804157  6128 consensus_meta.cc:287] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938: Time spent flushing consensus metadata: real 0.563s	user 0.015s	sys 0.000s
I20260709 13:15:00.808769  3997 leader_election.cc:304] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:00.816176  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:00.766685  6121 leader_election.cc:290] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:15:00.817018  6194 log.cc:927] Time spent T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 13:15:00.819245  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:00.819658  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:00.782915  6182 log.cc:927] Time spent T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
I20260709 13:15:00.848922  5474 raft_consensus.cc:3055] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:00.822423  5757 consensus_queue.cc:260] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:00.823947  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:00.824800  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:00.764401  6166 leader_election.cc:290] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:00.782542  6095 raft_consensus.cc:493] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:00.865473  6095 raft_consensus.cc:3060] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:00.771068  6148 consensus_meta.cc:287] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.504s	user 0.011s	sys 0.000s
I20260709 13:15:00.867714  5944 raft_consensus.cc:515] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:00.867969  6148 raft_consensus.cc:515] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:00.868383  4073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:00.764967  6155 raft_consensus.cc:493] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
W20260709 13:15:00.845420  6193 log.cc:927] Time spent T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:15:00.870419  6177 raft_consensus.cc:2764] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:15:00.844871  6128 raft_consensus.cc:515] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:00.871882  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:00.872407  4704 raft_consensus.cc:1240] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:15:00.873250  6128 leader_election.cc:290] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:00.873392  3956 raft_consensus.cc:1240] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:00.855172  6201 raft_consensus.cc:493] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:00.849380  5474 raft_consensus.cc:740] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:00.856719  5820 leader_election.cc:290] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:00.855234  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:00.859817  5757 raft_consensus.cc:3060] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:00.862622  6168 log.cc:927] Time spent T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.553s	user 0.003s	sys 0.000s
I20260709 13:15:00.864215  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:00.873318  4701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
W20260709 13:15:00.840929  6084 consensus_meta.cc:287] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.761s	user 0.006s	sys 0.007s
I20260709 13:15:00.855368  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:00.879432  4033 raft_consensus.cc:2393] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 4: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:00.870015  6148 leader_election.cc:290] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:00.889971  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:00.885223  6201 raft_consensus.cc:515] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:00.897192  4701 raft_consensus.cc:3060] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:00.897938  3997 leader_election.cc:304] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:00.898805  6154 leader_election.cc:290] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:00.870015  5944 leader_election.cc:290] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:00.903118  6083 consensus_queue.cc:1059] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:15:00.911827  6083 raft_consensus.cc:3055] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:00.912220  6083 raft_consensus.cc:740] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:00.913151  6083 consensus_queue.cc:260] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:00.914453  6083 raft_consensus.cc:3060] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:00.916035  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:00.917766  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:00.918910  4107 raft_consensus.cc:2393] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 4: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:00.919950  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:00.920082  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:00.920629  4034 raft_consensus.cc:1275] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:00.921615  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:00.921795  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:00.922354  4034 raft_consensus.cc:2468] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
I20260709 13:15:00.923278  4032 raft_consensus.cc:1275] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:15:00.924196  4031 raft_consensus.cc:1240] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:00.924902  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:00.926599  5921 leader_election.cc:290] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:00.920780  4033 raft_consensus.cc:2393] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 4: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:00.921720  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:00.940956  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:00.941906  4101 raft_consensus.cc:2410] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:00.941774  6143 raft_consensus.cc:3055] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:00.942322  6143 raft_consensus.cc:740] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:00.943363  4101 raft_consensus.cc:1240] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 LEADER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:15:00.944505  4033 raft_consensus.cc:1275] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:00.944666  4101 raft_consensus.cc:1240] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 LEADER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:00.945873  4101 raft_consensus.cc:1240] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 4. Current term is 5. Ops: []
W20260709 13:15:00.948210  4074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:00.955765  4101 raft_consensus.cc:1240] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 2. Current term is 4. Ops: []
I20260709 13:15:00.957960  4099 raft_consensus.cc:2468] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 5.
W20260709 13:15:00.960122  4073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 91104.9us
I20260709 13:15:00.960278  4074 leader_election.cc:304] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:00.960777  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:00.964263  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:00.966558  4675 leader_election.cc:304] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:00.870440  6155 raft_consensus.cc:515] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:15:00.968046  4675 leader_election.cc:304] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:00.966630  4033 raft_consensus.cc:3060] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:00.970988  3925 leader_election.cc:304] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:00.976184  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:00.983425  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:00.985033  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:00.985697  4034 raft_consensus.cc:3060] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:00.990314  3998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:00.948891  4105 raft_consensus.cc:2468] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 4.
I20260709 13:15:00.996713  4034 raft_consensus.cc:2468] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 7.
W20260709 13:15:01.013980  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 53862.6us
I20260709 13:15:01.014828  4074 leader_election.cc:304] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:01.015435  6201 leader_election.cc:290] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:01.004205  5954 raft_consensus.cc:2804] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:01.016394  5954 raft_consensus.cc:493] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:01.016853  5954 raft_consensus.cc:3060] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:01.016979  4705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57680 (request call id 503) took 1417 ms. Trace:
I20260709 13:15:01.017463  4705 rpcz_store.cc:276] 0709 13:14:59.593571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:59.602185 (+  8614us) service_pool.cc:224] Handling call
0709 13:15:00.997194 (+1395009us) spinlock_profiling.cc:243] Waited 492 ms on lock 0x7b5400598654. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:01.007932 (+ 10738us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1131970432}
I20260709 13:15:00.959401  6047 raft_consensus.cc:493] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.019279  4106 raft_consensus.cc:2468] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 6.
I20260709 13:15:01.019151  6047 raft_consensus.cc:515] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:01.020143  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
W20260709 13:15:01.020442  6115 consensus_meta.cc:287] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.613s	user 0.008s	sys 0.004s
I20260709 13:15:01.020853  6115 raft_consensus.cc:515] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:01.022347  6047 leader_election.cc:290] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:15:01.023373  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 52504.1us
I20260709 13:15:01.007299  6128 raft_consensus.cc:2804] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:01.029435  4074 leader_election.cc:304] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:01.030613  6121 raft_consensus.cc:2749] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:01.031275  3925 leader_election.cc:304] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:01.016099  6055 consensus_queue.cc:1059] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:01.032081  6148 consensus_queue.cc:1048] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:01.032434  6121 raft_consensus.cc:2749] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:01.033669  6124 raft_consensus.cc:3055] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:01.033753  6148 raft_consensus.cc:2749] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:01.034199  6124 raft_consensus.cc:740] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:01.034950  4074 leader_election.cc:304] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:01.035369  6172 log.cc:927] Time spent T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.734s	user 0.003s	sys 0.000s
I20260709 13:15:01.035296  6124 consensus_queue.cc:260] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:01.036782  6124 raft_consensus.cc:3060] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:01.042673  3950 raft_consensus.cc:1275] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:15:01.044624  4073 leader_election.cc:304] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:01.030555  6192 log.cc:927] Time spent T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.356s	user 0.000s	sys 0.003s
I20260709 13:15:01.046875  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:01.048065  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:01.048938  6128 raft_consensus.cc:697] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 3 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:01.049240  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:01.050441  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:01.050348  6128 consensus_queue.cc:237] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:00.897419  5474 consensus_queue.cc:260] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:00.966317  5675 raft_consensus.cc:493] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.963071  6135 raft_consensus.cc:2804] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:01.065864  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:15:01.054091  3998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:01.032470  3925 leader_election.cc:304] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:15:01.080823  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 48435.5us
I20260709 13:15:01.078692  3954 raft_consensus.cc:1240] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 3. Current term is 4. Ops: []
W20260709 13:15:01.087700  4071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:01.088812  5798 raft_consensus.cc:2804] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:15:01.089118  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 54261.9us
I20260709 13:15:01.089432  5798 raft_consensus.cc:697] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:01.090605  4074 leader_election.cc:304] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:01.090480  5798 consensus_queue.cc:237] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:01.091902  6125 raft_consensus.cc:2749] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:01.096212  4033 raft_consensus.cc:2468] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 5.
I20260709 13:15:01.098742  4033 raft_consensus.cc:1275] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:15:00.999114  6094 raft_consensus.cc:493] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.113897  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:01.114705  3951 raft_consensus.cc:3060] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:01.054661  6034 raft_consensus.cc:2804] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:01.113052  3925 leader_election.cc:304] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:01.023027  6115 leader_election.cc:290] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:01.119627  4030 raft_consensus.cc:3055] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:01.125538  4030 raft_consensus.cc:740] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:00.943261  6143 consensus_queue.cc:260] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:01.121598  5999 consensus_queue.cc:1059] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:01.121945  4704 raft_consensus.cc:1240] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:01.121248  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:01.117652  5962 consensus_queue.cc:1059] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
W20260709 13:15:01.111589  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 213810us
I20260709 13:15:01.121208  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:01.134514  3951 raft_consensus.cc:2468] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 6.
I20260709 13:15:01.120333  4033 raft_consensus.cc:1275] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:01.068327  4701 raft_consensus.cc:2468] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 7.
I20260709 13:15:01.104516  6148 raft_consensus.cc:2804] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:01.148054  3924 leader_election.cc:304] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:01.077157  6121 raft_consensus.cc:2749] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:01.182080  6148 raft_consensus.cc:493] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:01.155311  4030 consensus_queue.cc:260] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:01.182818  6148 raft_consensus.cc:3060] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:01.183430  4030 raft_consensus.cc:3060] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:01.183693  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:01.117929  6034 raft_consensus.cc:493] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
W20260709 13:15:01.162807  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 70367.7us
I20260709 13:15:01.185330  6034 raft_consensus.cc:3060] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:01.186226  4074 leader_election.cc:304] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:01.186821  3925 leader_election.cc:304] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:01.188709  6123 raft_consensus.cc:2804] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:01.189258  6123 raft_consensus.cc:493] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:01.189667  6123 raft_consensus.cc:3060] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:01.155215  6167 consensus_meta.cc:287] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.635s	user 0.012s	sys 0.001s
W20260709 13:15:01.197008  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 143054us
I20260709 13:15:01.151763  6197 raft_consensus.cc:2749] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:15:01.195281  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 47353.4us
I20260709 13:15:01.196599  4074 leader_election.cc:304] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:01.118321  6141 consensus_queue.cc:1048] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.076s
I20260709 13:15:01.102519  5675 raft_consensus.cc:515] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:01.224406  4074 leader_election.cc:304] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:01.224846  5921 raft_consensus.cc:2749] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:01.225217  5675 leader_election.cc:290] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:01.225564  5921 consensus_queue.cc:1048] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:01.226066  4074 leader_election.cc:304] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:01.226862  4709 raft_consensus.cc:2468] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 5.
I20260709 13:15:01.204227  4672 leader_election.cc:304] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:01.119357  6094 raft_consensus.cc:515] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:01.229728  5999 raft_consensus.cc:2804] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:01.230265  5999 raft_consensus.cc:697] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 4 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:01.231729  6155 leader_election.cc:290] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:01.232698  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:01.233434  4026 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 5.
I20260709 13:15:01.233904  5798 raft_consensus.cc:2749] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:01.218109  3957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1635) took 1746 ms. Trace:
I20260709 13:15:01.234622  3957 rpcz_store.cc:276] 0709 13:14:59.471966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:59.706726 (+234760us) service_pool.cc:224] Handling call
0709 13:14:59.707051 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:59.707304 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:14:59.707649 (+   345us) log.cc:844] Serialized 14 byte log entry
0709 13:15:00.817003 (+1109354us) spinlock_profiling.cc:243] Waited 9.53 ms on lock 0x7b180046c120. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f15225813f3 00007f15225837c1 00007f1522583779 00007f1522583709 00007f15225836d1 00007f15225829cd 000000000038f354 000000000038f199 00007f152256483a
0709 13:15:00.935088 (+118085us) spinlock_profiling.cc:243] Waited 7.78 ms on lock 0x7b180046c120. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f152254f2a6 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f15252164bc 00007f152256448b
0709 13:15:01.217089 (+282001us) spinlock_profiling.cc:243] Waited 2.97 ms on lock 0x7b180046c120. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f15252164bc 00007f152256448b 00007f152b3beab9 00007f152258069b 00007f152257e93f 00007f152257e455 00007f1525666060 00007f1525678716 00007f1525689287
0709 13:15:01.217476 (+   387us) log.cc:844] Serialized 14 byte log entry
0709 13:15:01.217672 (+   196us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:01.217719 (+    47us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:01.217786 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:01.217880 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:01.218034 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":17286,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":89,"raft.queue_time_us":46143,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":5412,"spinlock_wait_cycles":46652928,"thread_start_us":402099,"threads_started":2,"wal-append.queue_time_us":427500}
I20260709 13:15:01.236591  6095 raft_consensus.cc:515] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:01.237715  3925 leader_election.cc:304] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:01.238047  3955 raft_consensus.cc:1240] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:01.238906  6095 leader_election.cc:290] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:01.239112  6201 raft_consensus.cc:2804] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:01.239732  6201 raft_consensus.cc:493] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:01.240011  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:01.240294  6201 raft_consensus.cc:3060] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:01.240847  4026 raft_consensus.cc:3060] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:01.202701  5822 raft_consensus.cc:2804] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:01.243986  5822 raft_consensus.cc:493] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:01.244611  5822 raft_consensus.cc:3060] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:01.244843  6115 raft_consensus.cc:2804] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:01.245499  6115 raft_consensus.cc:697] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 5 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:01.246414  6115 consensus_queue.cc:237] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:01.160115  6166 consensus_queue.cc:1048] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.088s
W20260709 13:15:01.247742  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 47135.4us
I20260709 13:15:01.249508  3997 leader_election.cc:304] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:15:01.211949  4673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:01.231287  5999 consensus_queue.cc:237] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:01.232879  6084 raft_consensus.cc:2749] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:01.219880  6154 raft_consensus.cc:3060] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:01.236121  4074 leader_election.cc:304] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:01.255976  3924 leader_election.cc:304] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:01.222669  6055 consensus_queue.cc:1048] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:01.222407  5474 raft_consensus.cc:3060] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:01.265300  4026 raft_consensus.cc:2468] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 5.
W20260709 13:15:01.270308  4673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:01.197363  6143 raft_consensus.cc:3060] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:01.250223  3952 raft_consensus.cc:1275] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:15:01.260017  6210 raft_consensus.cc:2804] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:01.279570  4030 raft_consensus.cc:1275] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:01.272944  5921 raft_consensus.cc:2804] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:01.273146  5962 raft_consensus.cc:2749] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:01.262097  5757 consensus_queue.cc:1059] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:15:01.204835  6167 raft_consensus.cc:515] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:01.296795  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:01.280381  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 268521us
W20260709 13:15:01.297807  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 44343.2us
I20260709 13:15:01.298648  3997 leader_election.cc:304] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:01.275909  6190 consensus_queue.cc:1048] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:15:01.308961  3925 leader_election.cc:304] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:01.316421  3958 raft_consensus.cc:1240] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:01.282584  6210 raft_consensus.cc:493] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:01.294137  5921 raft_consensus.cc:697] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:01.329674  3997 leader_election.cc:304] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:01.315210  6218 raft_consensus.cc:2749] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:01.312727  6135 raft_consensus.cc:697] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:01.319407  6095 raft_consensus.cc:2804] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:01.333690  6095 raft_consensus.cc:697] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 5 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:01.335191  6167 leader_election.cc:290] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:01.334903  6095 consensus_queue.cc:237] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:01.338219  3998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:01.332371  6034 raft_consensus.cc:515] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:01.343693  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:01.330487  6210 raft_consensus.cc:3060] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:01.351814  3997 leader_election.cc:304] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:01.353410  6217 raft_consensus.cc:2764] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:15:01.373557  4706 raft_consensus.cc:1240] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:01.378211  4032 raft_consensus.cc:2410] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:15:01.377579  3997 leader_election.cc:304] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:01.386859  6227 raft_consensus.cc:2749] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:15:01.387982  6147 consensus_meta.cc:287] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 0.782s	user 0.009s	sys 0.004s
I20260709 13:15:01.388453  6147 raft_consensus.cc:2749] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339) with higher term. Message: Invalid argument: T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 4. Current term is 5.
I20260709 13:15:01.388651  3997 leader_election.cc:400] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Vote denied by peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339) with higher term. Message: Invalid argument: T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 4. Current term is 5.
I20260709 13:15:01.389331  5822 raft_consensus.cc:515] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:01.390362  6227 consensus_queue.cc:1059] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:01.398165  6227 raft_consensus.cc:3055] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:01.398550  6227 raft_consensus.cc:740] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:01.385336  6034 leader_election.cc:290] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:01.391813  6218 consensus_queue.cc:1059] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:01.391914  5921 consensus_queue.cc:237] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:01.392786  3997 leader_election.cc:304] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:01.377684  6083 raft_consensus.cc:2804] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:01.376083  5954 raft_consensus.cc:515] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:01.415743  6217 raft_consensus.cc:2749] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:15:01.419267  6213 log.cc:927] Time spent T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
W20260709 13:15:01.420482  6196 log.cc:927] Time spent T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.694s	user 0.003s	sys 0.000s
I20260709 13:15:01.420674  6135 consensus_queue.cc:237] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:01.421733  6083 raft_consensus.cc:697] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:01.422029  6189 raft_consensus.cc:3055] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:01.422472  6189 raft_consensus.cc:740] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:01.422678  6083 consensus_queue.cc:237] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:01.429212  5954 leader_election.cc:290] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:01.362018  6167 raft_consensus.cc:493] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.430827  6167 raft_consensus.cc:515] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:01.399577  6227 consensus_queue.cc:260] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:01.434386  6227 raft_consensus.cc:3060] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:01.436748  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:01.437690  4033 raft_consensus.cc:2410] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:15:01.457430  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 158896us
I20260709 13:15:01.464562  4704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:01.423405  6189 consensus_queue.cc:260] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:01.466024  6189 raft_consensus.cc:3060] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:01.446802  5822 leader_election.cc:290] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Requested vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:01.482275  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:01.489532  4701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:01.489820  6201 raft_consensus.cc:515] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:01.492022  4709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57680 (request call id 509) took 1110 ms. Trace:
I20260709 13:15:01.492779  6214 raft_consensus.cc:3055] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:01.493268  6214 raft_consensus.cc:740] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:01.475795  6154 raft_consensus.cc:2749] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:01.492470  4709 rpcz_store.cc:276] 0709 13:15:00.381730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:00.383082 (+  1352us) service_pool.cc:224] Handling call
0709 13:15:01.491870 (+1108788us) spinlock_profiling.cc:243] Waited 778 ms on lock 0x7b5400680e54. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:01.491964 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1789874432}
I20260709 13:15:01.493465  6145 raft_consensus.cc:493] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.500932  3924 leader_election.cc:304] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:01.474901  6034 consensus_queue.cc:1048] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:15:01.511920  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:01.457325  6148 raft_consensus.cc:515] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:01.515137  6197 raft_consensus.cc:2804] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:01.525553  6197 raft_consensus.cc:493] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:01.525993  6197 raft_consensus.cc:3060] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:01.526937  6148 leader_election.cc:290] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:01.514217  6145 raft_consensus.cc:515] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:01.517537  6123 raft_consensus.cc:515] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:01.529959  6145 leader_election.cc:290] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:01.531479  6123 leader_election.cc:290] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:15:01.520221  6223 log.cc:927] Time spent T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:15:01.532827  6201 leader_election.cc:290] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:01.537947  4073 leader_election.cc:304] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:01.539642  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:01.542116  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:01.542878  4033 raft_consensus.cc:3060] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:01.548385  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:01.549582  4029 raft_consensus.cc:2410] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:01.494578  6210 raft_consensus.cc:515] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:01.593174  4033 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
I20260709 13:15:01.609382  6210 leader_election.cc:290] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:01.619524  6215 raft_consensus.cc:3055] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:01.620219  6215 raft_consensus.cc:740] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:01.621357  6215 consensus_queue.cc:260] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:01.630923  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:15:01.643163  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 202339us
I20260709 13:15:01.623279  6215 raft_consensus.cc:3060] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:01.677064  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:01.601011  6055 raft_consensus.cc:2749] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:01.644026  3924 leader_election.cc:304] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
W20260709 13:15:01.699362  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 55157.8us
W20260709 13:15:01.727614  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 83686.6us
I20260709 13:15:01.707762  4100 raft_consensus.cc:1240] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:01.636828  6167 leader_election.cc:290] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:01.751967  3951 raft_consensus.cc:1275] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:15:01.749614  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:01.749063  4071 leader_election.cc:304] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:01.757438  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:01.752844  3954 raft_consensus.cc:2468] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 4.
I20260709 13:15:01.758191  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:15:01.760480  4673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:01.762159  4106 raft_consensus.cc:1275] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:15:01.763653  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:15:01.769431  3997 connection.cc:256] RPC call timeout handler was delayed by -1.5901799319999554s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2629s for a response
W20260709 13:15:01.770216  3997 connection.cc:256] RPC call timeout handler was delayed by -1.4866799320000155s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27440000000000003s for a response
I20260709 13:15:01.786654  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:01.748991  5999 raft_consensus.cc:493] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:01.787922  4071 leader_election.cc:304] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:01.788276  5999 raft_consensus.cc:515] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:01.791671  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:01.791818  6219 raft_consensus.cc:493] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.767808  5798 consensus_queue.cc:1048] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:15:01.792394  6084 consensus_queue.cc:1059] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:01.792356  6219 raft_consensus.cc:515] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:01.793483  5954 raft_consensus.cc:3055] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:01.793889  5954 raft_consensus.cc:740] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:01.791500  6190 raft_consensus.cc:2804] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:01.794963  6219 leader_election.cc:290] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:01.795193  6190 raft_consensus.cc:697] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:01.796272  6190 consensus_queue.cc:237] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:01.798651  6094 leader_election.cc:290] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:01.741789  5820 raft_consensus.cc:2749] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:01.743669  5474 raft_consensus.cc:493] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.810509  3997 leader_election.cc:304] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:01.753504  6128 raft_consensus.cc:493] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:01.795037  6241 log.cc:927] Time spent T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:15:01.776614  6055 raft_consensus.cc:2749] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:01.777220  6227 raft_consensus.cc:493] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:01.787075  5884 consensus_queue.cc:1059] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.027s
W20260709 13:15:01.813999  6143 consensus_meta.cc:287] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.538s	user 0.011s	sys 0.000s
I20260709 13:15:01.812484  4705 raft_consensus.cc:3060] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:01.812707  6135 raft_consensus.cc:2749] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:01.819377  3952 raft_consensus.cc:1275] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:15:01.861374  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 71807.6us
I20260709 13:15:01.814910  5474 raft_consensus.cc:515] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:01.818475  6128 raft_consensus.cc:515] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:01.887871  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:01.888414  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:01.892984  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:01.893913  4104 raft_consensus.cc:2393] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 4: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:01.900703  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:01.904827  6055 consensus_queue.cc:1048] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:01.907232  5474 leader_election.cc:290] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:01.910836  6123 consensus_queue.cc:1059] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:15:01.911659  6235 log.cc:927] Time spent T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:15:01.912334  5999 leader_election.cc:290] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:01.913770  6094 raft_consensus.cc:3055] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:01.914291  6094 raft_consensus.cc:740] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:01.916049  4705 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
I20260709 13:15:01.858798  6227 raft_consensus.cc:515] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:01.919032  6227 leader_election.cc:290] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:01.921125  6197 raft_consensus.cc:515] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:01.924049  6248 log.cc:927] Time spent T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:15:01.924214  6224 log.cc:927] Time spent T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:15:01.931054  6128 leader_election.cc:290] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:01.904040  5798 consensus_queue.cc:1048] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:15:01.932740  6135 consensus_queue.cc:1059] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:01.933755  6135 raft_consensus.cc:3055] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:01.934120  6135 raft_consensus.cc:740] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
W20260709 13:15:01.934332  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 47157.3us
I20260709 13:15:01.935396  3997 leader_election.cc:304] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:01.936651  3997 leader_election.cc:304] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:01.939492  3997 leader_election.cc:304] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:01.941638  3997 leader_election.cc:304] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:01.951402  3997 leader_election.cc:304] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
W20260709 13:15:01.913889  6245 log.cc:927] Time spent T 00000000000000000000000000000000 P af4ff34c238b4043994545a7eb56815f: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:15:01.962847  3997 leader_election.cc:304] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:02.028117  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 158052us
I20260709 13:15:02.035233  3997 leader_election.cc:304] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:01.940784  6132 raft_consensus.cc:2749] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:01.942469  6227 raft_consensus.cc:2749] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:01.935079  6135 consensus_queue.cc:260] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:01.944481  6210 raft_consensus.cc:2749] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:01.955687  6083 raft_consensus.cc:3060] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:02.159433  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 128406us
I20260709 13:15:02.160264  3959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1651) took 1119 ms. Trace:
I20260709 13:15:02.168632  3959 rpcz_store.cc:276] 0709 13:15:01.040430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:01.042921 (+  2491us) service_pool.cc:224] Handling call
0709 13:15:01.043435 (+   514us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:01.070526 (+ 27091us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:01.070569 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:01.100923 (+ 30354us) log.cc:844] Serialized 564 byte log entry
0709 13:15:01.203983 (+103060us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:01.204106 (+   123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:02.029049 (+824943us) spinlock_profiling.cc:243] Waited 26.5 ms on lock 0x7b54003ff554. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:02.029127 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:02.029198 (+    71us) raft_consensus.cc:1685] finished
0709 13:15:02.029220 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:02.160150 (+130930us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61024640,"thread_start_us":82755,"threads_started":1,"wal-append.queue_time_us":200453}
I20260709 13:15:01.923441  6197 leader_election.cc:290] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Requested vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:01.915218  6094 consensus_queue.cc:260] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:01.996198  6218 raft_consensus.cc:2749] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:02.171979  5944 raft_consensus.cc:3055] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:02.172302  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:02.172438  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:02.180811  4100 raft_consensus.cc:3060] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:02.172695  4105 raft_consensus.cc:1275] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:02.173621  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:02.174517  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:02.174598  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:02.183411  4108 raft_consensus.cc:2468] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
I20260709 13:15:02.175788  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:02.176709  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 298386us
I20260709 13:15:02.008095  6216 raft_consensus.cc:2749] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:02.175593  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:02.038434  6145 raft_consensus.cc:493] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:02.197959  4673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:02.207271  3922 connection.cc:256] RPC call timeout handler was delayed by -1.1697379879999517s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1794s for a response
W20260709 13:15:02.214910  3922 connection.cc:256] RPC call timeout handler was delayed by -1.0878379880000466s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1885s for a response
I20260709 13:15:02.211356  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:02.212245  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:02.216323  4099 raft_consensus.cc:3060] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:02.213824  4071 leader_election.cc:304] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:02.203836  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:02.232970  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:02.176429  6149 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:02.241906  4102 raft_consensus.cc:1240] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:02.179613  5944 raft_consensus.cc:740] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:02.196161  4704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:02.162693  5962 consensus_queue.cc:1059] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:15:02.226348  6094 raft_consensus.cc:3060] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:02.230598  6218 raft_consensus.cc:2749] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:02.273416  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:02.274433  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:02.278347  4103 raft_consensus.cc:3060] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:02.238780  6135 raft_consensus.cc:3060] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:02.205814  6047 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.012s	sys 0.014s
I20260709 13:15:02.275940  4100 raft_consensus.cc:2468] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 5.
I20260709 13:15:02.283397  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:02.210407  6145 raft_consensus.cc:515] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:02.294350  4102 raft_consensus.cc:2393] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 5: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:02.272173  6210 raft_consensus.cc:493] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:02.298455  4108 raft_consensus.cc:1275] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:15:02.275853  6216 raft_consensus.cc:493] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:02.289796  6047 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.013s	sys 0.015s
I20260709 13:15:02.280185  6177 raft_consensus.cc:493] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:02.291708  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 72592.9us
I20260709 13:15:02.304607  4099 raft_consensus.cc:2468] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 5.
I20260709 13:15:02.280932  6149 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:02.333181  4103 raft_consensus.cc:2468] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7.
I20260709 13:15:02.306083  5675 raft_consensus.cc:2804] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:02.310438  6095 raft_consensus.cc:493] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:02.303764  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:02.303478  6210 raft_consensus.cc:515] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:02.327709  6047 consensus_queue.cc:1048] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:15:02.340186  5675 raft_consensus.cc:493] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:02.339581  5822 raft_consensus.cc:493] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:02.304546  6216 raft_consensus.cc:515] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:02.335372  5944 consensus_queue.cc:260] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:02.356921  5944 raft_consensus.cc:3060] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:02.358322  6210 leader_election.cc:290] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:02.353209  5675 raft_consensus.cc:3060] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:02.305596  6177 raft_consensus.cc:515] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:02.372969  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:02.389518  6254 consensus_queue.cc:1048] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.087s
I20260709 13:15:02.393901  6216 leader_election.cc:290] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:02.396163  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:02.397919  6145 leader_election.cc:290] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:02.401944  6177 leader_election.cc:290] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:02.414111  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:02.372170  6261 raft_consensus.cc:493] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:02.348891  6095 raft_consensus.cc:515] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:02.417198  3958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1656) took 1355 ms. Trace:
I20260709 13:15:02.381640  6265 raft_consensus.cc:493] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:02.421070  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:02.421517  6149 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:02.423174  3957 raft_consensus.cc:1275] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:15:02.423200  3958 rpcz_store.cc:276] 0709 13:15:01.061356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:01.076869 (+ 15513us) service_pool.cc:224] Handling call
0709 13:15:01.115165 (+ 38296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:01.319241 (+204076us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:02.416905 (+1097664us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b54000f28d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:02.417129 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":462311680}
I20260709 13:15:02.424463  4107 raft_consensus.cc:2468] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 5.
W20260709 13:15:02.427752  4032 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41312 (request call id 191) took 1442 ms (client timeout 1706 ms). Trace:
W20260709 13:15:02.428279  4032 rpcz_store.cc:269] 0709 13:15:00.980872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:01.019788 (+ 38916us) service_pool.cc:224] Handling call
0709 13:15:02.417156 (+1397368us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b54001d9a54. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:02.423095 (+  5939us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":820990848}
I20260709 13:15:02.424692  3924 leader_election.cc:304] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:02.422096  6261 raft_consensus.cc:515] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:02.363631  5822 raft_consensus.cc:515] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:02.439076  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:02.439260  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:02.445053  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:02.440240  4706 raft_consensus.cc:2393] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 5: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
I20260709 13:15:02.447515  6261 leader_election.cc:290] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:02.435885  3952 raft_consensus.cc:2468] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 5.
I20260709 13:15:02.440835  6145 raft_consensus.cc:2804] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:02.457013  6145 raft_consensus.cc:697] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 6 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:02.430814  5798 raft_consensus.cc:493] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:02.440642  5822 leader_election.cc:290] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:02.482072  5944 consensus_queue.cc:1059] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:02.483121  4071 leader_election.cc:304] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:02.430330  6265 raft_consensus.cc:515] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:02.483767  6269 consensus_queue.cc:1048] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:02.497926  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:02.433668  5675 raft_consensus.cc:515] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:02.476956  6047 raft_consensus.cc:493] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:02.458138  6145 consensus_queue.cc:237] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:02.502074  6083 raft_consensus.cc:2749] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:02.520759  3958 raft_consensus.cc:1240] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 3. Current term is 4. Ops: []
W20260709 13:15:02.519344  6215 consensus_meta.cc:287] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 0.775s	user 0.005s	sys 0.008s
I20260709 13:15:02.514243  6254 raft_consensus.cc:2804] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:02.476651  5798 raft_consensus.cc:515] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:02.534835  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 499708us
W20260709 13:15:02.534214  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 314021us
I20260709 13:15:02.535979  3997 leader_election.cc:304] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:02.536816  3922 connection.cc:256] RPC call timeout handler was delayed by -1.0545379879999928s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1922s for a response
I20260709 13:15:02.493988  5474 raft_consensus.cc:2955] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 2 to 6, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
W20260709 13:15:02.539656  3922 connection.cc:256] RPC call timeout handler was delayed by -1.0140379880001547s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1967s for a response
W20260709 13:15:02.541327  4074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:02.528643  5944 raft_consensus.cc:493] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:02.518793  6047 raft_consensus.cc:515] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:02.534833  6254 raft_consensus.cc:493] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:02.546583  6083 raft_consensus.cc:2804] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:02.575896  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:02.581446  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:02.555668  6254 raft_consensus.cc:3060] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:02.583458  3958 raft_consensus.cc:1240] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:02.587504  4102 raft_consensus.cc:1240] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 LEADER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:02.588603  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:02.589182  3997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:02.589038  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:02.589946  4103 raft_consensus.cc:1240] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:02.590093  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:02.591001  4102 raft_consensus.cc:1275] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:02.592353  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:02.594528  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:02.595726  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:02.596925  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:02.597381  3922 leader_election.cc:304] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:02.598266  6266 raft_consensus.cc:2749] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:02.598765  3922 leader_election.cc:304] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:02.599817  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:02.600433  4100 raft_consensus.cc:2468] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 5.
I20260709 13:15:02.601305  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:02.600054  3922 leader_election.cc:304] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:02.602095  4108 raft_consensus.cc:2368] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 4. Current term is 5.
I20260709 13:15:02.602401  5962 raft_consensus.cc:2749] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:02.602759  6197 raft_consensus.cc:2749] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:02.603132  5962 consensus_queue.cc:1048] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:02.603672  3922 leader_election.cc:304] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:02.604542  6197 raft_consensus.cc:2749] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:02.605786  3922 leader_election.cc:304] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:02.607816  6149 raft_consensus.cc:2749] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:02.608114  3922 leader_election.cc:304] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:02.608906  6197 raft_consensus.cc:2804] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:02.609230  5675 leader_election.cc:290] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:02.609392  6197 raft_consensus.cc:697] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 4 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:02.610373  6197 consensus_queue.cc:237] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:02.610823  5798 leader_election.cc:290] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:02.545490  6124 consensus_queue.cc:1059] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:15:02.616295  3922 leader_election.cc:304] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:02.617144  6154 raft_consensus.cc:2749] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:15:02.617810  4673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:02.619575  6277 raft_consensus.cc:493] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:02.619761  6047 leader_election.cc:290] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:02.607230  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:02.620183  6277 raft_consensus.cc:515] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:02.622447  6277 leader_election.cc:290] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:02.622946  6277 raft_consensus.cc:493] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:02.624924  6265 leader_election.cc:290] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:02.624836  6277 raft_consensus.cc:515] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:02.625761  6095 leader_election.cc:290] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:02.620370  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:02.628211  6277 leader_election.cc:290] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:02.628439  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:02.629513  6177 raft_consensus.cc:493] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:02.629866  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:02.630124  6177 raft_consensus.cc:515] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:02.631146  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:02.631848  6217 raft_consensus.cc:493] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:02.632645  6177 leader_election.cc:290] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:02.633569  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:02.633800  4099 raft_consensus.cc:2376] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 4. Re-sending same reply.
I20260709 13:15:02.634238  3957 raft_consensus.cc:3060] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:02.635222  6277 consensus_queue.cc:1059] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:02.636050  6277 consensus_queue.cc:1243] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer 8952c48a6f3a43968f7d77f7bfc4d1bc log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:15:02.636257  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:02.636518  6177 raft_consensus.cc:3055] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:02.620438  4704 raft_consensus.cc:2468] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 5.
I20260709 13:15:02.636972  6177 raft_consensus.cc:740] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:02.638087  3924 leader_election.cc:304] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:02.639008  6177 consensus_queue.cc:260] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:02.641062  6177 raft_consensus.cc:3060] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:02.632580  6216 raft_consensus.cc:493] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:02.622869  6215 raft_consensus.cc:493] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:02.618983  3922 leader_election.cc:304] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:02.637018  3959 raft_consensus.cc:2468] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 2.
I20260709 13:15:02.645042  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:02.645983  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:02.647053  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:02.648504  4034 raft_consensus.cc:1240] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:02.648727  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:02.652127  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:02.652537  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:02.632417  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:02.653717  3958 raft_consensus.cc:2468] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 4.
I20260709 13:15:02.649456  4030 raft_consensus.cc:2468] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 4.
I20260709 13:15:02.654690  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:02.655946  3951 raft_consensus.cc:3060] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:02.656239  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:02.659780  4034 raft_consensus.cc:1240] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:15:02.660566  3922 leader_election.cc:304] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:02.660825  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:02.661341  4034 raft_consensus.cc:3060] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:02.661500  4031 raft_consensus.cc:1275] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:15:02.666198  3953 raft_consensus.cc:1240] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:02.672457  3953 raft_consensus.cc:1275] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:02.673035  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:02.674382  3922 leader_election.cc:304] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:02.674685  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:02.675382  3997 leader_election.cc:304] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:02.675765  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:02.676101  3953 raft_consensus.cc:1240] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:02.677610  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:02.678429  3959 raft_consensus.cc:2468] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 5.
I20260709 13:15:02.685251  3997 leader_election.cc:304] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:02.687436  3922 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:02.688668  3922 leader_election.cc:304] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:02.690330  4031 raft_consensus.cc:1275] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:02.694047  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:02.694380  4027 raft_consensus.cc:1240] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:02.694908  4103 raft_consensus.cc:2393] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 5: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:02.696465  3922 leader_election.cc:304] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:02.700119  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:02.704239  4032 raft_consensus.cc:3060] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:02.706350  4071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:02.709167  4034 raft_consensus.cc:2468] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 5.
I20260709 13:15:02.718444  3997 leader_election.cc:304] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:02.655471  6083 raft_consensus.cc:697] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:02.660037  5798 raft_consensus.cc:493] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:02.735584  3958 raft_consensus.cc:1240] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:02.734810  3951 raft_consensus.cc:2468] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 5.
I20260709 13:15:02.739099  5798 raft_consensus.cc:515] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:02.742328  6210 raft_consensus.cc:2749] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:02.744370  5798 leader_election.cc:290] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:02.693533  6115 raft_consensus.cc:2749] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:02.695047  6154 raft_consensus.cc:2749] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:02.693989  6141 raft_consensus.cc:2804] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:02.749154  4032 raft_consensus.cc:2468] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 6.
I20260709 13:15:02.716893  6266 raft_consensus.cc:2749] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:02.699666  6265 raft_consensus.cc:2749] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:02.749827  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:02.641685  5954 consensus_queue.cc:260] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:02.686414  6215 raft_consensus.cc:515] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:02.716284  5962 raft_consensus.cc:2804] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:02.726624  6218 raft_consensus.cc:2749] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:02.662889  6216 raft_consensus.cc:515] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:02.632438  6217 raft_consensus.cc:515] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:02.723515  6149 raft_consensus.cc:493] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:02.737404  6132 raft_consensus.cc:2749] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:02.578284  5944 raft_consensus.cc:515] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:02.722175  6263 consensus_queue.cc:1059] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.068s
I20260709 13:15:02.739490  6135 raft_consensus.cc:493] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:02.764556  3956 raft_consensus.cc:2468] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 4.
I20260709 13:15:02.767277  3952 raft_consensus.cc:1240] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 6 LEADER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:02.752264  6210 raft_consensus.cc:493] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:02.750837  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 167983us
I20260709 13:15:02.776119  6141 raft_consensus.cc:697] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 5 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:02.779403  6149 raft_consensus.cc:515] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:02.778563  4029 raft_consensus.cc:1275] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:15:02.777745  5954 raft_consensus.cc:3060] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:02.795316  6047 raft_consensus.cc:493] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:02.806221  6288 raft_consensus.cc:3055] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:02.795349  5962 raft_consensus.cc:697] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 5 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:02.807336  6210 raft_consensus.cc:515] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:02.807648  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 89331.7us
I20260709 13:15:02.746095  6264 consensus_queue.cc:1048] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 13:15:02.813120  5944 leader_election.cc:290] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:02.829150  3997 leader_election.cc:304] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:15:02.826442  3957 raft_consensus.cc:2468] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 5.
I20260709 13:15:02.819295  6263 raft_consensus.cc:493] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:02.842550  6273 log.cc:927] Time spent T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:15:02.842586  6263 raft_consensus.cc:515] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:02.845748  6263 leader_election.cc:290] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:02.811285  6115 raft_consensus.cc:2804] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:15:02.851493  6284 log.cc:927] Time spent T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:15:02.819252  6135 raft_consensus.cc:515] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:02.853667  6135 leader_election.cc:290] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:02.836987  6141 consensus_queue.cc:237] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:02.818688  6288 raft_consensus.cc:740] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:02.811371  6261 raft_consensus.cc:493] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:02.864926  6263 raft_consensus.cc:2804] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:02.857692  6288 consensus_queue.cc:260] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:02.865520  6263 raft_consensus.cc:493] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:02.866030  6263 raft_consensus.cc:3060] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:02.866195  6288 raft_consensus.cc:3060] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:02.867830  5962 consensus_queue.cc:237] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:02.869282  6210 leader_election.cc:290] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:02.871943  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 172033us
I20260709 13:15:02.876219  3997 leader_election.cc:400] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: Vote denied by peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843) with higher term. Message: Invalid argument: T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 4. Current term is 5.
I20260709 13:15:02.876642  3997 leader_election.cc:403] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:15:02.882638  4030 raft_consensus.cc:1275] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:15:02.871122  4704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:02.821856  6047 raft_consensus.cc:515] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:02.892983  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 70915.5us
I20260709 13:15:02.886291  6124 raft_consensus.cc:493] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:02.901057  6127 raft_consensus.cc:3055] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:15:02.907472  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:02.909787  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:02.910702  4034 raft_consensus.cc:2468] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:15:02.874176  6261 raft_consensus.cc:515] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:02.858012  6083 consensus_queue.cc:237] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:02.927142  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 230735us
I20260709 13:15:02.928570  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:02.941520  4030 raft_consensus.cc:3060] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:02.954285  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 89589.3us
W20260709 13:15:02.954918  4073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:02.959939  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:02.960974  4034 raft_consensus.cc:2468] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:15:02.907846  6127 raft_consensus.cc:740] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:02.915338  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:02.977275  4030 raft_consensus.cc:2468] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 5.
I20260709 13:15:02.978596  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:02.979615  4107 raft_consensus.cc:2468] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 5.
I20260709 13:15:02.986193  3922 leader_election.cc:304] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
W20260709 13:15:02.989158  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:02.991781  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:02.912003  6124 raft_consensus.cc:515] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:02.995668  4100 raft_consensus.cc:1240] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:02.998302  4108 raft_consensus.cc:1240] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:02.991430  3922 leader_election.cc:304] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:03.007805  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:03.008638  4706 raft_consensus.cc:2468] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 5.
I20260709 13:15:03.008859  6263 raft_consensus.cc:515] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:03.012502  6261 leader_election.cc:290] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:03.013351  4030 raft_consensus.cc:2468] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 5.
I20260709 13:15:03.013531  6261 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:03.014108  6261 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:02.995213  6147 raft_consensus.cc:493] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:03.016032  6147 raft_consensus.cc:515] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:02.981045  6132 raft_consensus.cc:2749] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843) with higher term. Message: Invalid argument: T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 4. Current term is 5.
I20260709 13:15:03.018129  6147 leader_election.cc:290] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:03.018996  6263 leader_election.cc:290] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 election: Requested vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:02.992470  5798 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:03.020845  5798 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:03.021049  6254 raft_consensus.cc:515] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:02.945058  6295 consensus_queue.cc:1059] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:15:03.024561  6295 raft_consensus.cc:493] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:03.025216  6295 raft_consensus.cc:515] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:02.995879  6201 raft_consensus.cc:2749] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:02.973286  6215 leader_election.cc:290] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:03.043121  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:03.047326  4030 raft_consensus.cc:2393] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 in current term 6: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:03.052345  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:03.054472  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 63121.2us
I20260709 13:15:03.057039  3922 leader_election.cc:304] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
W20260709 13:15:03.057631  3997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:02.990734  4705 raft_consensus.cc:2468] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 5.
I20260709 13:15:03.023470  5798 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:15:03.068305  4673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:03.032210  4105 raft_consensus.cc:2468] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 4.
I20260709 13:15:03.063179  6215 raft_consensus.cc:493] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:02.972944  6287 consensus_queue.cc:1048] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 13:15:03.050441  6149 leader_election.cc:290] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:03.071659  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:03.077163  6215 raft_consensus.cc:515] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:03.074910  6295 leader_election.cc:290] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:03.063097  6201 raft_consensus.cc:2749] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:03.079875  4709 raft_consensus.cc:2468] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 2.
I20260709 13:15:03.069959  6266 raft_consensus.cc:2749] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:03.070802  6254 leader_election.cc:290] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:03.091886  4028 raft_consensus.cc:1275] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:15:03.092094  3924 leader_election.cc:304] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:03.077481  6264 raft_consensus.cc:493] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.083499  6215 leader_election.cc:290] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:03.087888  6132 raft_consensus.cc:493] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:03.084559  6261 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:03.113626  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:03.116394  4108 raft_consensus.cc:2468] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 4.
W20260709 13:15:03.113756  4672 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.198.193:35339 timed out after 1.674s (SENT) [suppressed 24 similar messages]
I20260709 13:15:03.084656  6124 leader_election.cc:290] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:03.116641  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:03.066452  6127 consensus_queue.cc:260] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:03.118592  4672 leader_election.cc:304] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:03.110881  6292 raft_consensus.cc:2804] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:03.118870  4032 raft_consensus.cc:2468] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 1.
I20260709 13:15:03.110785  6047 leader_election.cc:290] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:15:03.131970  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 75043us
I20260709 13:15:03.112569  6264 raft_consensus.cc:515] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:03.122895  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:03.117049  6132 raft_consensus.cc:515] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:03.134328  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:03.206265  4032 raft_consensus.cc:2410] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:15:03.125444  6261 raft_consensus.cc:2804] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:03.207743  6261 raft_consensus.cc:493] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:03.207908  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 90529.8us
I20260709 13:15:03.208297  6261 raft_consensus.cc:3060] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:03.155018  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:15:03.129011  6293 log.cc:927] Time spent T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:15:03.121737  6292 raft_consensus.cc:493] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:03.149857  4025 raft_consensus.cc:1240] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:03.210595  4033 raft_consensus.cc:2410] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:15:03.213934  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 80805.2us
I20260709 13:15:03.217542  3922 leader_election.cc:304] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:03.221971  6155 consensus_queue.cc:1048] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:15:03.134756  6127 raft_consensus.cc:3060] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:03.162966  6177 consensus_meta.cc:287] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 0.521s	user 0.013s	sys 0.000s
I20260709 13:15:03.134727  6296 consensus_queue.cc:1059] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.086s
I20260709 13:15:03.219725  6292 raft_consensus.cc:3060] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:03.224545  6148 raft_consensus.cc:2749] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:15:03.226323  4674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:03.241780  3925 leader_election.cc:304] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:03.242066  6296 raft_consensus.cc:3055] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:03.242669  6296 raft_consensus.cc:740] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:03.240981  6292 raft_consensus.cc:515] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:03.242950  6145 raft_consensus.cc:2749] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:03.254985  4704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:03.255769  4704 raft_consensus.cc:3060] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:03.260627  3922 leader_election.cc:304] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:15:03.261772  6216 leader_election.cc:290] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:03.261960  3922 leader_election.cc:304] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:03.265997  4706 raft_consensus.cc:1240] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:03.267302  4701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:03.267518  6115 raft_consensus.cc:493] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:03.268002  6115 raft_consensus.cc:3060] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:03.242643  6148 consensus_queue.cc:1059] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:15:03.272585  3922 leader_election.cc:304] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:03.273878  4031 raft_consensus.cc:1275] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:15:03.274708  4031 pending_rounds.cc:85] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2: Aborting all ops after (but not including) 2
I20260709 13:15:03.274959  4031 pending_rounds.cc:107] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:15:03.275199  4031 raft_consensus.cc:2889] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:03.128859  6295 consensus_queue.cc:1059] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.097s
I20260709 13:15:03.279465  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:03.281268  4675 leader_election.cc:304] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:03.282219  4034 raft_consensus.cc:2468] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 5.
I20260709 13:15:03.282922  3999 leader_election.cc:304] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:03.273171  6307 consensus_queue.cc:1048] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:15:03.286017  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
W20260709 13:15:03.287961  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 162624us
I20260709 13:15:03.288789  4672 leader_election.cc:304] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:03.286662  4705 raft_consensus.cc:3060] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:03.264415  6132 leader_election.cc:290] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:03.147652  6302 consensus_queue.cc:1059] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.144s
I20260709 13:15:03.277062  6197 raft_consensus.cc:2804] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:03.290287  3997 leader_election.cc:304] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:03.290078  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:03.300498  4672 leader_election.cc:304] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:03.285356  6177 raft_consensus.cc:493] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.301002  3997 leader_election.cc:304] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:15:03.282541  6145 raft_consensus.cc:2804] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:03.300681  4027 raft_consensus.cc:2468] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 3.
I20260709 13:15:03.273839  6292 leader_election.cc:290] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:03.287139  6266 raft_consensus.cc:2749] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:03.288987  6216 raft_consensus.cc:2804] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:03.292544  6127 raft_consensus.cc:2749] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:03.304200  6132 raft_consensus.cc:2749] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:03.312845  4701 raft_consensus.cc:1275] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:15:03.313235  6217 leader_election.cc:290] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:03.313512  4106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34656 (request call id 214) took 1684 ms. Trace:
I20260709 13:15:03.308631  6216 raft_consensus.cc:493] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:03.314103  6216 raft_consensus.cc:3060] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:03.315464  6244 log.cc:927] Time spent T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 1.453s	user 0.002s	sys 0.016s
I20260709 13:15:03.304970  6303 raft_consensus.cc:3055] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:03.316226  6303 raft_consensus.cc:740] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:03.316270  6257 consensus_queue.cc:1048] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:03.317251  6303 consensus_queue.cc:260] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:03.318604  6303 raft_consensus.cc:3060] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:03.293521  5954 consensus_queue.cc:1059] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:15:03.320675  5954 raft_consensus.cc:3055] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:03.321040  5954 raft_consensus.cc:740] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:03.321882  5954 consensus_queue.cc:260] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:03.329634  5954 raft_consensus.cc:3060] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:03.329708  4701 raft_consensus.cc:1240] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:03.308450  6288 raft_consensus.cc:2804] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:03.310041  6145 raft_consensus.cc:697] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 7 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:03.333878  6145 consensus_queue.cc:237] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:03.313969  4106 rpcz_store.cc:276] 0709 13:15:01.629093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:01.637522 (+  8429us) service_pool.cc:224] Handling call
0709 13:15:01.716248 (+ 78726us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:01.762619 (+ 46371us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:03.313283 (+1550664us) spinlock_profiling.cc:243] Waited 45.5 ms on lock 0x7b54000406d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:03.313450 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":104561920}
I20260709 13:15:03.308588  6197 raft_consensus.cc:697] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 5 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:03.304205  6295 raft_consensus.cc:2804] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:03.344663  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:03.345721  3954 raft_consensus.cc:2410] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:15:03.347110  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:03.348615  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:03.355363  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:03.358518  3954 raft_consensus.cc:2468] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 3.
I20260709 13:15:03.358551  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:03.358518  3953 raft_consensus.cc:2468] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 5.
I20260709 13:15:03.359687  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:03.347874  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:03.347469  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:03.362249  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:03.362613  3956 raft_consensus.cc:2393] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 5: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:03.358620  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:03.363495  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:03.364605  3955 raft_consensus.cc:2393] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 4: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:03.360292  3954 raft_consensus.cc:2376] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d709ee666b774ec29aa732e508219938 in term 5. Re-sending same reply.
I20260709 13:15:03.367087  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:03.337479  4704 raft_consensus.cc:2468] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3.
I20260709 13:15:03.307672  6177 raft_consensus.cc:515] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:03.368965  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:03.337153  6197 consensus_queue.cc:237] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:03.371019  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:03.372058  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:15:03.400512  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 103867us
I20260709 13:15:03.374087  5974 raft_consensus.cc:3055] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:03.376789  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:03.376929  6264 leader_election.cc:290] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:03.343837  6265 raft_consensus.cc:493] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.341692  4705 raft_consensus.cc:2468] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 6.
I20260709 13:15:03.342584  6292 raft_consensus.cc:493] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:03.369561  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:03.389842  6177 leader_election.cc:290] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:03.346149  6266 consensus_queue.cc:1059] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:15:03.390225  6167 raft_consensus.cc:3055] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:03.475616  6167 raft_consensus.cc:740] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:03.475883  6265 raft_consensus.cc:515] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:03.476677  6167 consensus_queue.cc:260] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:03.478006  6167 raft_consensus.cc:3060] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:03.477736  6261 raft_consensus.cc:515] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:03.398293  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:03.479871  3955 raft_consensus.cc:2468] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 4.
I20260709 13:15:03.465118  6310 raft_consensus.cc:2764] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:15:03.479803  6214 consensus_queue.cc:260] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:03.481110  3951 raft_consensus.cc:1275] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:03.481612  6214 raft_consensus.cc:3060] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:03.481834  5822 consensus_queue.cc:1175] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6f5b5e4ed72944ecbda200012d141dc2" responder_term: 5 status { last_received { term: 5 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 5 index: 6 } }
I20260709 13:15:03.372690  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:15:03.483402  6262 log.cc:927] Time spent T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 1.148s	user 0.002s	sys 0.002s
I20260709 13:15:03.471148  6115 raft_consensus.cc:515] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:03.486785  6115 leader_election.cc:290] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:03.486874  6264 raft_consensus.cc:493] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.487459  6264 raft_consensus.cc:515] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:03.470999  5974 raft_consensus.cc:740] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:03.489578  6264 leader_election.cc:290] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:03.490257  5974 consensus_queue.cc:260] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:03.466952  3950 raft_consensus.cc:2393] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 in current term 5: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:03.344864  6295 raft_consensus.cc:493] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:03.467937  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:03.467373  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:03.377148  3924 leader_election.cc:304] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:03.406252  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:15:03.493069  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 116034us
W20260709 13:15:03.468838  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 166726us
I20260709 13:15:03.470149  3956 raft_consensus.cc:2393] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 4: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:03.470757  3997 leader_election.cc:304] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:03.471642  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:03.473703  5820 raft_consensus.cc:493] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:03.474823  6292 raft_consensus.cc:515] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:03.496198  4672 leader_election.cc:304] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:03.497092  6316 consensus_queue.cc:1048] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:15:03.495074  5974 raft_consensus.cc:3060] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:03.498093  6177 raft_consensus.cc:2749] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:03.499568  3997 leader_election.cc:304] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:03.501392  4672 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:03.494660  6034 raft_consensus.cc:493] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.504876  6127 raft_consensus.cc:2804] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:03.505517  6127 raft_consensus.cc:697] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 5 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:03.505357  5820 raft_consensus.cc:515] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:03.507964  3953 raft_consensus.cc:2410] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:15:03.494792  5921 raft_consensus.cc:493] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:03.509256  6055 raft_consensus.cc:493] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.509760  6055 raft_consensus.cc:515] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:03.504621  6034 raft_consensus.cc:515] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:03.508919  5921 raft_consensus.cc:515] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:03.494213  6295 raft_consensus.cc:3060] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:03.506677  6127 consensus_queue.cc:237] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:03.495169  6115 raft_consensus.cc:2804] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:03.469574  6216 raft_consensus.cc:515] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:03.516598  3997 leader_election.cc:304] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:03.516891  3957 raft_consensus.cc:2410] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:03.517361  6217 raft_consensus.cc:2749] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:03.512861  5820 leader_election.cc:290] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:03.519038  4705 raft_consensus.cc:1240] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:03.515843  6302 raft_consensus.cc:2804] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:03.520152  6034 leader_election.cc:290] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:03.521669  6055 leader_election.cc:290] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:03.524876  6292 leader_election.cc:290] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:03.525913  6316 consensus_queue.cc:1048] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:03.544467  6177 raft_consensus.cc:2804] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:03.526472  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:03.545747  6216 leader_election.cc:290] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:03.527987  5921 leader_election.cc:290] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:03.529181  6115 raft_consensus.cc:697] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 3 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:03.546422  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:03.547165  6115 consensus_queue.cc:237] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:03.533135  3997 leader_election.cc:304] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:03.549553  4033 raft_consensus.cc:1275] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:03.549502  3997 leader_election.cc:304] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:03.536684  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:03.551158  4030 raft_consensus.cc:2410] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:15:03.551735  4073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:03.537674  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:03.552311  4025 raft_consensus.cc:2468] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 1.
I20260709 13:15:03.539469  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:03.540150  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:03.541538  4028 raft_consensus.cc:1240] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:03.543027  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:03.554584  4026 raft_consensus.cc:3060] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:15:03.543582  6302 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:03.544870  6177 raft_consensus.cc:493] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:03.526998  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:03.560065  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:03.556282  3997 leader_election.cc:304] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:03.557132  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:03.564826  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:03.565497  4103 raft_consensus.cc:3060] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:03.566452  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:03.567849  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:15:03.569988  4073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:03.570066  3997 leader_election.cc:304] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:03.578220  4033 raft_consensus.cc:1275] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:15:03.580549  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:03.580457  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:03.581969  3958 raft_consensus.cc:3060] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:03.582355  3951 raft_consensus.cc:1275] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:03.554121  6261 leader_election.cc:290] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:03.558889  6302 raft_consensus.cc:3060] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:03.558017  6263 raft_consensus.cc:2804] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:03.562566  6177 raft_consensus.cc:3060] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:03.587466  3954 raft_consensus.cc:2468] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 6.
I20260709 13:15:03.590806  4026 raft_consensus.cc:2468] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3.
I20260709 13:15:03.564136  6264 raft_consensus.cc:493] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.574043  6217 raft_consensus.cc:2749] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:03.598419  4103 raft_consensus.cc:2468] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 6.
I20260709 13:15:03.564255  6216 raft_consensus.cc:2749] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:03.593760  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:03.577643  6227 raft_consensus.cc:3060] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:03.599916  4672 leader_election.cc:304] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
W20260709 13:15:03.602810  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 106066us
I20260709 13:15:03.627789  3925 leader_election.cc:304] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:03.565840  6166 consensus_queue.cc:1059] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:15:03.629361  4675 leader_election.cc:304] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:03.594623  6263 raft_consensus.cc:493] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:03.631879  6148 consensus_queue.cc:1048] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:03.632740  6315 raft_consensus.cc:2804] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:03.633188  6315 raft_consensus.cc:493] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:03.633587  6315 raft_consensus.cc:3060] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:03.633934  6166 raft_consensus.cc:3055] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:03.602355  6266 consensus_queue.cc:1059] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:15:03.634377  6166 raft_consensus.cc:740] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:03.595073  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:03.642338  4032 raft_consensus.cc:1240] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:03.635205  4675 leader_election.cc:304] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:03.634724  6266 raft_consensus.cc:3055] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:03.662245  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:03.605032  6167 consensus_queue.cc:1048] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:15:03.666898  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:03.601428  6264 raft_consensus.cc:515] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:03.664825  4073 leader_election.cc:304] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:03.636483  6263 raft_consensus.cc:3060] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:03.681628  4033 raft_consensus.cc:3060] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:03.635902  6189 raft_consensus.cc:2749] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:15:03.640115  6312 log.cc:927] Time spent T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.339s	user 0.003s	sys 0.000s
I20260709 13:15:03.668550  4709 raft_consensus.cc:2393] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 6: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
I20260709 13:15:03.635597  6261 raft_consensus.cc:2804] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:03.687811  3999 leader_election.cc:304] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:03.662513  5820 consensus_queue.cc:1059] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:15:03.691239  6261 raft_consensus.cc:697] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 6 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:03.691159  4701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:03.692394  6261 consensus_queue.cc:237] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:03.680624  6055 consensus_queue.cc:1048] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:15:03.697736  3924 leader_election.cc:304] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:03.668022  6303 raft_consensus.cc:2804] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:03.663820  6266 raft_consensus.cc:740] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:03.688817  4704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:03.719805  4033 raft_consensus.cc:2468] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 6.
I20260709 13:15:03.698478  5921 raft_consensus.cc:2804] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:03.705344  6307 raft_consensus.cc:2749] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:03.700065  6132 raft_consensus.cc:3060] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:03.723924  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:03.725541  4033 raft_consensus.cc:2410] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 for term 8 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:15:03.637679  6166 consensus_queue.cc:260] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:03.705950  6303 raft_consensus.cc:493] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:03.728170  4675 leader_election.cc:304] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:03.716990  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:03.734210  4033 raft_consensus.cc:1275] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:15:03.734731  4033 pending_rounds.cc:85] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2: Aborting all ops after (but not including) 2
I20260709 13:15:03.734928  4033 pending_rounds.cc:107] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:15:03.735152  4033 raft_consensus.cc:2889] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:03.740909  3958 raft_consensus.cc:2468] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 6.
I20260709 13:15:03.730691  5921 raft_consensus.cc:697] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:03.733134  6303 raft_consensus.cc:3060] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:03.765937  3924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:03.766742  6177 raft_consensus.cc:515] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:03.768895  6227 raft_consensus.cc:2749] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:03.778702  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:03.779340  3956 raft_consensus.cc:3060] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:03.746992  6266 consensus_queue.cc:260] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:03.789091  4708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:03.791103  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:03.793040  6177 leader_election.cc:290] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:03.794133  6265 leader_election.cc:290] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:03.796661  3997 leader_election.cc:304] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:03.798604  3997 leader_election.cc:304] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:03.799234  4074 connection.cc:256] RPC call timeout handler was delayed by -1.0350403380000444s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1663s for a response
W20260709 13:15:03.800096  6317 log.cc:927] Time spent T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:15:03.802701  6263 raft_consensus.cc:515] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:03.808132  5921 consensus_queue.cc:237] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:03.809238  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:03.809352  6288 raft_consensus.cc:493] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:03.809949  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:03.810827  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:03.814237  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:03.814546  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:15:03.815759  4074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:03.818466  4030 raft_consensus.cc:1240] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:03.820001  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:15:03.820232  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 50022.7us
I20260709 13:15:03.819986  6086 raft_consensus.cc:493] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.824493  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:03.824769  6211 raft_consensus.cc:3060] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:03.825630  4071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:03.825870  3955 raft_consensus.cc:1275] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 13:15:03.838268  4071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:03.835741  4027 raft_consensus.cc:2468] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 4.
I20260709 13:15:03.821471  3997 leader_election.cc:304] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:03.836354  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:03.842238  3997 leader_election.cc:304] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:03.844321  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:03.849423  4672 leader_election.cc:304] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:03.853533  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:03.853729  3956 raft_consensus.cc:2468] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 4.
I20260709 13:15:03.854781  3950 raft_consensus.cc:1240] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:03.856443  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:03.857846  4101 raft_consensus.cc:1240] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:15:03.858392  4106 raft_consensus.cc:1240] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:03.858428  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:03.754909  6148 consensus_queue.cc:1048] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.076s
I20260709 13:15:03.862040  4025 raft_consensus.cc:2393] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 6: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:03.861480  3958 raft_consensus.cc:1240] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:03.860705  4101 raft_consensus.cc:1275] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:15:03.863832  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:03.837464  6055 raft_consensus.cc:493] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.822528  6227 raft_consensus.cc:2749] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:03.866881  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:03.881533  4107 raft_consensus.cc:2393] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 5: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:03.867631  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:03.882217  4103 raft_consensus.cc:2376] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 5. Re-sending same reply.
I20260709 13:15:03.861364  5954 raft_consensus.cc:493] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.869089  6220 raft_consensus.cc:493] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.868479  6296 consensus_queue.cc:260] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:03.846972  6086 raft_consensus.cc:515] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:03.869566  6123 raft_consensus.cc:493] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.847138  6217 raft_consensus.cc:2749] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:03.856060  6216 raft_consensus.cc:2804] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:03.870393  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:03.871347  6263 leader_election.cc:290] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:03.890651  3997 leader_election.cc:304] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:03.866359  4100 raft_consensus.cc:1275] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:03.904604  3955 raft_consensus.cc:1275] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:03.838007  6288 raft_consensus.cc:3060] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:03.885489  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:03.837807  5974 raft_consensus.cc:493] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:03.893900  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:03.915346  4103 raft_consensus.cc:1275] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:03.896133  4074 leader_election.cc:304] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:03.868233  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:03.921674  4104 raft_consensus.cc:2410] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:15:03.906392  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 54106.6us
I20260709 13:15:03.792335  6315 raft_consensus.cc:515] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:03.911409  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:03.938139  3952 raft_consensus.cc:2468] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 5.
I20260709 13:15:03.861630  6177 consensus_queue.cc:1048] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:15:03.901749  6261 raft_consensus.cc:2804] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:03.917426  6264 leader_election.cc:290] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:03.902068  6277 consensus_queue.cc:1048] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:15:03.921428  6227 raft_consensus.cc:2804] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:03.955683  6261 raft_consensus.cc:697] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 6 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:03.895740  6055 raft_consensus.cc:515] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:03.956700  6261 consensus_queue.cc:237] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:03.957868  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:03.958500  6055 leader_election.cc:290] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:03.936298  5974 raft_consensus.cc:515] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:03.960508  5974 leader_election.cc:290] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:03.920969  6216 raft_consensus.cc:697] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:03.897953  6220 raft_consensus.cc:515] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:03.897684  5954 raft_consensus.cc:515] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:03.908968  6123 raft_consensus.cc:515] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:03.953975  6296 raft_consensus.cc:3060] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:03.997558  4102 raft_consensus.cc:1275] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:15:04.007979  4031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38290 (request call id 1627) took 1337 ms. Trace:
I20260709 13:15:04.008484  4031 rpcz_store.cc:276] 0709 13:15:02.670950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.692555 (+ 21605us) service_pool.cc:224] Handling call
0709 13:15:02.692843 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:03.275743 (+582900us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:04.001709 (+725966us) spinlock_profiling.cc:243] Waited 581 ms on lock 0x7b54000a3cd4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:04.007896 (+  6187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1335303552}
I20260709 13:15:03.991904  6227 raft_consensus.cc:697] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:04.018944  6132 raft_consensus.cc:2749] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:15:04.052912  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 190135us
W20260709 13:15:04.063290  4073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 211323us
W20260709 13:15:04.064977  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 174408us
W20260709 13:15:04.069455  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:04.078030  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 181970us
I20260709 13:15:04.079070  4074 leader_election.cc:304] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:04.068641  4071 leader_election.cc:304] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:04.026471  6216 consensus_queue.cc:237] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:04.074708  6086 leader_election.cc:290] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:04.114389  4708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:15:04.115586  4073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:04.120774  4708 raft_consensus.cc:2468] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 4.
I20260709 13:15:04.103931  6315 leader_election.cc:290] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:04.106348  6132 raft_consensus.cc:493] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.067385  6227 consensus_queue.cc:237] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:04.122834  5954 leader_election.cc:290] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:04.124603  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:15:04.153795  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 85236.3us
W20260709 13:15:04.153999  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 71940.3us
I20260709 13:15:04.153759  6123 leader_election.cc:290] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:04.158839  6132 raft_consensus.cc:515] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:04.159821  6177 raft_consensus.cc:493] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:04.168267  5921 raft_consensus.cc:2804] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:15:04.184767  6325 log.cc:927] Time spent T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
W20260709 13:15:04.201418  6332 log.cc:927] Time spent T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:15:04.158497  6336 consensus_queue.cc:1048] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:15:04.191526  6277 raft_consensus.cc:493] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:04.196208  5921 raft_consensus.cc:493] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:04.192189  6177 raft_consensus.cc:515] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:04.223417  6329 log.cc:927] Time spent T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
W20260709 13:15:04.221606  6214 consensus_meta.cc:287] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938: Time spent flushing consensus metadata: real 0.739s	user 0.013s	sys 0.001s
W20260709 13:15:04.240419  6337 log.cc:927] Time spent T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:15:04.243311  6303 raft_consensus.cc:515] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:04.244405  6330 log.cc:927] Time spent T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:15:04.245216  6264 raft_consensus.cc:493] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:04.227782  6341 raft_consensus.cc:493] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:04.245806  6264 raft_consensus.cc:515] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:04.246191  6341 raft_consensus.cc:515] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:04.248099  6264 leader_election.cc:290] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:04.246093  6303 leader_election.cc:290] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:04.248610  6341 leader_election.cc:290] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:04.224380  6277 raft_consensus.cc:515] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:04.249796  6323 log.cc:927] Time spent T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.266s	user 0.003s	sys 0.000s
I20260709 13:15:04.250936  6277 leader_election.cc:290] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:04.253109  6177 leader_election.cc:290] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:04.253345  6166 raft_consensus.cc:3060] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:04.254263  6295 consensus_meta.cc:287] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938: Time spent flushing consensus metadata: real 0.723s	user 0.011s	sys 0.002s
W20260709 13:15:04.254488  6302 consensus_meta.cc:287] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938: Time spent flushing consensus metadata: real 0.655s	user 0.011s	sys 0.001s
I20260709 13:15:04.254737  6295 raft_consensus.cc:515] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:04.251446  6132 leader_election.cc:290] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:04.254926  6302 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:04.258039  4709 raft_consensus.cc:1240] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:04.261797  6302 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:04.222301  5921 raft_consensus.cc:3060] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:04.293404  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 120799us
I20260709 13:15:04.276823  6231 raft_consensus.cc:493] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.295459  6231 raft_consensus.cc:515] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:04.296345  6295 leader_election.cc:290] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:04.298944  4704 raft_consensus.cc:2468] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 5.
I20260709 13:15:04.294684  4071 leader_election.cc:304] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:04.307406  4028 raft_consensus.cc:1275] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:04.292546  3951 raft_consensus.cc:2468] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 4.
I20260709 13:15:04.287959  6132 raft_consensus.cc:493] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.291025  6211 raft_consensus.cc:2749] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:04.303704  5962 raft_consensus.cc:493] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:04.313457  6201 raft_consensus.cc:493] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.326874  6277 raft_consensus.cc:493] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:04.311125  6288 raft_consensus.cc:515] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:04.348414  3959 raft_consensus.cc:2410] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:15:04.338205  6296 consensus_queue.cc:1048] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:15:04.344311  5757 raft_consensus.cc:2749] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:04.345497  4701 raft_consensus.cc:1240] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:04.335381  6132 raft_consensus.cc:515] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:04.364753  6211 raft_consensus.cc:493] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:04.345166  6201 raft_consensus.cc:515] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:04.345490  6277 raft_consensus.cc:515] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:04.380689  6266 raft_consensus.cc:3060] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:04.382694  6211 raft_consensus.cc:515] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:04.416765  4702 raft_consensus.cc:1240] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 3. Current term is 4. Ops: []
W20260709 13:15:04.418958  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:04.418789  6197 consensus_queue.cc:1059] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:04.420450  6189 raft_consensus.cc:3055] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:04.420935  6189 raft_consensus.cc:740] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:04.421906  6189 consensus_queue.cc:260] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:04.425158  6296 consensus_queue.cc:1059] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:04.398160  4026 raft_consensus.cc:1275] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:15:04.394939  6327 log.cc:927] Time spent T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.386s	user 0.001s	sys 0.000s
I20260709 13:15:04.389981  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:04.342147  5962 raft_consensus.cc:515] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:04.388346  3953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38612 (request call id 994) took 1038 ms. Trace:
I20260709 13:15:04.434340  4028 raft_consensus.cc:2468] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 4.
I20260709 13:15:04.397006  6220 leader_election.cc:290] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:04.404520  4706 raft_consensus.cc:1275] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:04.441536  3925 leader_election.cc:304] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:04.385458  6201 leader_election.cc:290] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:04.439910  3953 rpcz_store.cc:276] 0709 13:15:03.350314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:03.369345 (+ 19031us) service_pool.cc:224] Handling call
0709 13:15:04.388097 (+1018752us) spinlock_profiling.cc:243] Waited 32.7 ms on lock 0x7b54002873d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:04.388274 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":75251584}
I20260709 13:15:04.392851  6148 raft_consensus.cc:493] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.426163  6227 raft_consensus.cc:493] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:04.448338  4703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:04.440266  6166 consensus_queue.cc:1048] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:15:04.452353  6148 raft_consensus.cc:515] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:04.453722  6296 raft_consensus.cc:2804] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:04.454082  5962 leader_election.cc:290] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:04.454430  6201 raft_consensus.cc:493] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:04.454641  6288 leader_election.cc:290] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:04.403496  5921 raft_consensus.cc:515] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:04.467144  6201 raft_consensus.cc:515] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:04.469264  5921 leader_election.cc:290] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:04.456256  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:04.464671  6296 raft_consensus.cc:493] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:04.470714  6296 raft_consensus.cc:3060] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:04.472707  6148 leader_election.cc:290] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:04.464094  6227 raft_consensus.cc:515] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:04.478556  6227 leader_election.cc:290] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:04.482921  4033 raft_consensus.cc:1240] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:04.485033  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:04.489794  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:04.490844  3999 leader_election.cc:304] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:04.492583  4029 raft_consensus.cc:1240] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 LEADER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:04.499382  6214 consensus_queue.cc:1059] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:04.500633  6302 raft_consensus.cc:3055] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:04.501157  6302 raft_consensus.cc:740] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
W20260709 13:15:04.503892  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 62450.6us
I20260709 13:15:04.502465  6302 consensus_queue.cc:260] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:04.507053  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:04.507216  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:04.470609  6201 leader_election.cc:290] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:04.507939  4033 raft_consensus.cc:2468] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 5.
I20260709 13:15:04.509441  4026 raft_consensus.cc:2468] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 5.
I20260709 13:15:04.507766  4029 raft_consensus.cc:2468] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 5.
I20260709 13:15:04.496271  6227 raft_consensus.cc:2749] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:04.514537  3925 leader_election.cc:304] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:04.513785  6365 consensus_queue.cc:1048] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:15:04.516682  6364 raft_consensus.cc:2804] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:04.517112  6364 raft_consensus.cc:493] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:04.516966  3925 leader_election.cc:304] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:04.517685  6364 raft_consensus.cc:3060] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:04.510622  6303 consensus_queue.cc:1059] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:15:04.521025  6303 consensus_queue.cc:1243] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [LEADER]: Peer 6f5b5e4ed72944ecbda200012d141dc2 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:15:04.521605  6303 raft_consensus.cc:3055] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:04.522032  6303 raft_consensus.cc:740] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:04.528251  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:04.529008  4032 raft_consensus.cc:2468] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3.
I20260709 13:15:04.531780  6302 raft_consensus.cc:3060] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:04.514865  4675 leader_election.cc:304] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:04.536912  3999 leader_election.cc:304] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:04.539958  6216 raft_consensus.cc:493] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.540632  6201 raft_consensus.cc:2804] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:04.548229  6201 raft_consensus.cc:493] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:04.548636  6201 raft_consensus.cc:3060] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:04.551690  6216 raft_consensus.cc:515] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:04.553998  6216 leader_election.cc:290] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:04.542449  6228 raft_consensus.cc:2804] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:04.549278  6288 raft_consensus.cc:2804] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:15:04.576818  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 365750us
I20260709 13:15:04.595531  4074 leader_election.cc:304] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:04.577602  6352 consensus_queue.cc:1048] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:04.579813  6335 raft_consensus.cc:2749] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:15:04.580470  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 285915us
I20260709 13:15:04.602658  4025 raft_consensus.cc:1275] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:04.581218  6357 raft_consensus.cc:2804] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:15:04.584875  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:04.587826  6216 raft_consensus.cc:493] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:04.597270  4074 leader_election.cc:304] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:04.522981  6303 consensus_queue.cc:260] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:04.603307  4071 leader_election.cc:304] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:04.618340  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:04.612486  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:04.621933  3956 raft_consensus.cc:2468] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 5.
I20260709 13:15:04.624157  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:04.623072  6334 raft_consensus.cc:2804] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:04.626387  6115 raft_consensus.cc:493] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:04.626957  6115 raft_consensus.cc:515] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:04.629102  6115 leader_election.cc:290] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:04.635761  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:04.636154  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:04.636626  3950 raft_consensus.cc:2393] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 4: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:04.637313  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:04.640506  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:04.642294  3958 raft_consensus.cc:3060] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:04.641590  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:04.660570  4074 leader_election.cc:304] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:04.593865  6288 raft_consensus.cc:493] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:04.603137  6228 raft_consensus.cc:697] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 5 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:04.665448  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:15:04.660877  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 121770us
I20260709 13:15:04.666133  3958 raft_consensus.cc:2468] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 6.
I20260709 13:15:04.610001  6357 raft_consensus.cc:493] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:04.610585  6339 raft_consensus.cc:2749] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:04.666906  3925 leader_election.cc:304] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:04.638082  6055 raft_consensus.cc:2804] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:15:04.675630  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 50739.4us
I20260709 13:15:04.623003  6316 consensus_queue.cc:1048] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:15:04.665829  6288 raft_consensus.cc:3060] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:04.654933  6334 raft_consensus.cc:697] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:04.665486  6303 raft_consensus.cc:3060] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:04.634485  6216 raft_consensus.cc:515] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:04.669039  6266 raft_consensus.cc:493] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.676193  6340 raft_consensus.cc:2804] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:04.696410  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:04.671634  6357 raft_consensus.cc:3060] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:04.701567  3952 raft_consensus.cc:2410] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:15:04.684860  6149 raft_consensus.cc:2804] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:04.703857  6149 raft_consensus.cc:493] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:04.704264  6149 raft_consensus.cc:3060] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:04.671308  6345 consensus_queue.cc:1048] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:15:04.671969  5954 consensus_queue.cc:1048] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:15:04.692687  6277 leader_election.cc:290] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:04.715204  4071 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:04.717948  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:04.721626  3952 raft_consensus.cc:2393] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 in current term 5: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:04.699142  6055 raft_consensus.cc:697] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:04.703200  6340 raft_consensus.cc:493] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:04.728317  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 128933us
I20260709 13:15:04.722530  6123 raft_consensus.cc:493] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.731854  6123 raft_consensus.cc:515] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:04.732923  6334 consensus_queue.cc:237] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:04.734236  6123 leader_election.cc:290] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:04.735819  6123 raft_consensus.cc:493] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.736464  6123 raft_consensus.cc:515] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:04.738174  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:04.738677  6211 leader_election.cc:290] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:04.741953  6123 leader_election.cc:290] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:04.731130  3997 leader_election.cc:304] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:04.702706  6266 raft_consensus.cc:515] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:04.743280  6034 raft_consensus.cc:493] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.755098  6211 raft_consensus.cc:2804] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:04.755393  6034 raft_consensus.cc:515] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:04.756204  6266 leader_election.cc:290] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:04.756731  3997 leader_election.cc:304] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:04.730592  6339 consensus_queue.cc:1048] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:15:04.757747  4704 raft_consensus.cc:1275] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:04.730301  6349 raft_consensus.cc:2749] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:04.759056  6034 leader_election.cc:290] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:04.755800  6211 raft_consensus.cc:697] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
W20260709 13:15:04.759953  6373 log.cc:927] Time spent T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:15:04.714761  5822 raft_consensus.cc:493] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.694429  6364 raft_consensus.cc:515] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:04.716225  6132 leader_election.cc:290] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:04.760286  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:04.866921  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:04.864073  6201 raft_consensus.cc:515] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:04.868875  3955 raft_consensus.cc:2393] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 6: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:04.869045  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:04.871204  3956 raft_consensus.cc:2393] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 6: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:04.783998  4073 leader_election.cc:304] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:04.872583  3997 leader_election.cc:304] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:04.872660  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 145853us
I20260709 13:15:04.875449  3997 leader_election.cc:304] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:04.875522  4071 leader_election.cc:304] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:15:04.856114  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 189275us
I20260709 13:15:04.877162  3997 leader_election.cc:304] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:04.885829  4031 raft_consensus.cc:1275] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 13:15:04.886238  4031 pending_rounds.cc:85] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2: Aborting all ops after (but not including) 2
I20260709 13:15:04.886466  4031 pending_rounds.cc:107] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 13:15:04.886722  4031 raft_consensus.cc:2889] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:04.889681  4030 raft_consensus.cc:1275] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:04.887344  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:04.890865  4026 raft_consensus.cc:2468] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3.
I20260709 13:15:04.893797  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:04.894518  4033 raft_consensus.cc:2468] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 5.
I20260709 13:15:04.747143  6216 leader_election.cc:290] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:04.730747  6340 raft_consensus.cc:3060] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:04.902606  6155 raft_consensus.cc:493] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.903132  6155 raft_consensus.cc:515] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:04.904255  4073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 120388us
I20260709 13:15:04.905254  6155 leader_election.cc:290] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:04.906036  6350 raft_consensus.cc:2804] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:04.906481  6350 raft_consensus.cc:493] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:04.906824  6350 raft_consensus.cc:3060] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:04.762516  6145 raft_consensus.cc:3055] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:04.909704  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:04.913977  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:04.914446  4033 raft_consensus.cc:3060] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:04.748524  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:04.871114  6201 leader_election.cc:290] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:04.913008  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:04.759142  6277 raft_consensus.cc:2749] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:04.759294  6231 leader_election.cc:290] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:04.883404  6227 raft_consensus.cc:2804] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:15:04.926108  6370 log.cc:927] Time spent T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:15:04.921403  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:04.939580  4102 raft_consensus.cc:2468] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 5.
I20260709 13:15:04.939697  4033 raft_consensus.cc:2468] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
I20260709 13:15:04.920290  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:04.882382  5822 raft_consensus.cc:515] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:04.926432  6227 raft_consensus.cc:493] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:04.878906  6177 raft_consensus.cc:2749] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:04.927043  4706 raft_consensus.cc:2468] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 4.
I20260709 13:15:04.899078  6345 raft_consensus.cc:2804] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:04.913785  6145 raft_consensus.cc:740] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:04.895464  6365 raft_consensus.cc:493] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:04.928166  6149 raft_consensus.cc:515] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:04.730798  6228 consensus_queue.cc:237] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:04.930274  6296 raft_consensus.cc:515] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:04.898025  6266 raft_consensus.cc:493] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:04.930763  6380 consensus_queue.cc:1048] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:04.931504  4107 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "f1c75790cedf4f52a3463a255c7da059"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:15:05.014258  4107 raft_consensus.cc:606] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Received request to transfer leadership to TS f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:05.014716  4107 raft_consensus.cc:614] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:15:04.938320  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:04.896484  6132 raft_consensus.cc:2749] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:04.952958  6345 raft_consensus.cc:493] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:04.948227  4674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:04.883589  5944 consensus_queue.cc:1048] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
W20260709 13:15:05.010327  6382 log.cc:927] Time spent T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:15:04.985437  4701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:04.967195  4672 leader_election.cc:304] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
W20260709 13:15:05.052372  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 85273.6us
I20260709 13:15:05.010352  6364 leader_election.cc:290] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:04.916640  6143 raft_consensus.cc:493] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.993501  3952 raft_consensus.cc:1275] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:04.994138  3999 leader_election.cc:304] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
W20260709 13:15:05.056023  3999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 81477.9us
I20260709 13:15:04.916832  6335 consensus_queue.cc:1059] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
W20260709 13:15:04.998806  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 161995us
W20260709 13:15:05.057089  3922 leader_election.cc:336] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.715s (SENT)
I20260709 13:15:05.011155  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:05.013104  4031 raft_consensus.cc:1275] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:05.059768  4102 raft_consensus.cc:2468] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 5.
I20260709 13:15:04.760845  6211 consensus_queue.cc:237] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:04.951699  6334 raft_consensus.cc:493] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.930297  3925 leader_election.cc:304] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:04.969296  6216 raft_consensus.cc:493] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.948868  6227 raft_consensus.cc:3060] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:05.040526  6374 log.cc:927] Time spent T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
W20260709 13:15:05.046870  4674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:05.047876  5822 leader_election.cc:290] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:04.898459  6055 consensus_queue.cc:237] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:05.086086  6379 log.cc:927] Time spent T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:15:05.087796  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:05.061311  4672 leader_election.cc:304] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:05.088660  3953 raft_consensus.cc:2393] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 5: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:05.034197  6345 raft_consensus.cc:3060] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:05.089659  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:15:05.051764  6369 log.cc:927] Time spent T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
W20260709 13:15:05.055397  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 383241us
I20260709 13:15:05.008293  6365 raft_consensus.cc:515] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:05.031726  6384 raft_consensus.cc:493] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
W20260709 13:15:05.074458  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 144247us
I20260709 13:15:05.075790  4701 raft_consensus.cc:2410] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:15:05.076157  6148 raft_consensus.cc:2804] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:05.076565  6364 raft_consensus.cc:493] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:05.078166  6340 raft_consensus.cc:515] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:05.080374  6216 raft_consensus.cc:515] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:15:05.081001  6149 leader_election.cc:290] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:05.073377  6350 raft_consensus.cc:515] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:05.062204  6143 raft_consensus.cc:515] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:05.083838  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:04.907508  5954 consensus_queue.cc:1059] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 13:15:05.092253  3952 raft_consensus.cc:1240] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:05.018078  6266 raft_consensus.cc:515] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:05.097201  4102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "d709ee666b774ec29aa732e508219938"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:15:05.062340  6132 raft_consensus.cc:2804] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:15:05.131848  6325 log.cc:927] Time spent T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:15:05.054549  6145 consensus_queue.cc:260] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:05.094868  6331 raft_consensus.cc:2749] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:05.133497  6357 raft_consensus.cc:515] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:05.073283  6334 raft_consensus.cc:515] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:05.138581  4074 leader_election.cc:304] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:05.151906  3959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38606 (request call id 1703) took 1284 ms. Trace:
I20260709 13:15:05.076187  6189 raft_consensus.cc:3060] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:05.140810  3925 leader_election.cc:304] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:05.075814  4706 raft_consensus.cc:1240] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:05.329312  6132 raft_consensus.cc:493] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:05.136479  6384 raft_consensus.cc:515] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:05.329941  6132 raft_consensus.cc:3060] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:05.273046  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:05.332412  6384 leader_election.cc:290] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:05.294013  4701 raft_consensus.cc:1275] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:05.275580  6292 raft_consensus.cc:493] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.124770  6214 raft_consensus.cc:2804] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:05.137269  6148 raft_consensus.cc:493] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:05.151893  6302 raft_consensus.cc:2804] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:05.303757  6296 leader_election.cc:290] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:05.260636  5822 raft_consensus.cc:493] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.155342  6364 raft_consensus.cc:515] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:05.214956  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:05.235903  4106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45332 (request call id 1552) took 1376 ms. Trace:
I20260709 13:15:05.158149  6201 raft_consensus.cc:493] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
W20260709 13:15:05.333501  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 192806us
I20260709 13:15:05.336140  3959 rpcz_store.cc:276] 0709 13:15:03.843896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:03.844031 (+   135us) service_pool.cc:224] Handling call
0709 13:15:05.098754 (+1254723us) spinlock_profiling.cc:243] Waited 502 ms on lock 0x7b5400187ed4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:05.127855 (+ 29101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1154260864}
I20260709 13:15:05.336166  6149 consensus_queue.cc:1048] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:15:05.336345  6148 raft_consensus.cc:3060] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:05.366580  6149 raft_consensus.cc:493] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:05.367354  6149 raft_consensus.cc:515] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:05.339401  6143 leader_election.cc:290] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:05.370625  6149 leader_election.cc:290] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:05.372474  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:05.373334  3959 raft_consensus.cc:2468] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 4.
I20260709 13:15:05.374413  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:05.378139  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:05.379607  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:05.332670  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:05.351816  3953 raft_consensus.cc:2468] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 6.
I20260709 13:15:05.386333  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:05.345767  4102 raft_consensus.cc:606] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Received request to transfer leadership to TS d709ee666b774ec29aa732e508219938
I20260709 13:15:05.339401  6357 leader_election.cc:290] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:05.388331  4102 raft_consensus.cc:614] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:05.333038  6390 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:05.393210  6390 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:05.334285  6214 raft_consensus.cc:493] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:05.352029  4106 rpcz_store.cc:276] 0709 13:15:03.859316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:03.864463 (+  5147us) service_pool.cc:224] Handling call
0709 13:15:03.864876 (+   413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:04.764863 (+899987us) spinlock_profiling.cc:243] Waited 6.54 ms on lock 0x7b1800483b20. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f15252164bc 00007f152256448b 00007f152b3beab9 00007f152258069b 00007f152257e93f 00007f152257e455 00007f1525666060 00007f1525666bfb 00007f152567164b
0709 13:15:04.765031 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:04.765077 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:04.765587 (+   510us) log.cc:844] Serialized 26 byte log entry
0709 13:15:05.032622 (+267035us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:05.091643 (+ 59021us) log.cc:844] Serialized 14 byte log entry
0709 13:15:05.091930 (+   287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:05.092043 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:05.092083 (+    40us) raft_consensus.cc:1685] finished
0709 13:15:05.103599 (+ 11516us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:05.235814 (+132215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33894,"prepare.queue_time_us":63701,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":177020,"raft.run_cpu_time_us":347,"raft.run_wall_time_us":37060,"spinlock_wait_cycles":15046528,"thread_start_us":421795,"threads_started":2,"wal-append.queue_time_us":317985}
I20260709 13:15:05.336004  6350 leader_election.cc:290] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:05.340330  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:05.357787  3925 leader_election.cc:304] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:15:05.327859  6353 log.cc:927] Time spent T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 1.030s	user 0.004s	sys 0.003s
W20260709 13:15:05.395855  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 257359us
I20260709 13:15:05.423499  4074 leader_election.cc:304] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:05.422336  3952 raft_consensus.cc:2468] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 4.
I20260709 13:15:05.428226  4073 leader_election.cc:304] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:05.157783  6389 raft_consensus.cc:493] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:05.235589  6055 raft_consensus.cc:493] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:05.431131  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 73456.1us
I20260709 13:15:05.394786  5822 raft_consensus.cc:515] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:05.336066  5954 raft_consensus.cc:3055] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:05.437664  3952 raft_consensus.cc:1275] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:05.333806  6287 raft_consensus.cc:493] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:05.434315  6143 raft_consensus.cc:493] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:05.452972  6216 leader_election.cc:290] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:05.421413  6357 raft_consensus.cc:2749] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:05.453444  4074 leader_election.cc:304] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:05.426911  6214 raft_consensus.cc:3060] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:05.289744  6227 raft_consensus.cc:515] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:05.333418  6391 raft_consensus.cc:2804] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:05.421653  6211 raft_consensus.cc:493] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.334033  6292 raft_consensus.cc:515] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:05.423805  6115 consensus_queue.cc:1048] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:15:05.441293  6296 raft_consensus.cc:2804] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:05.394793  6380 consensus_queue.cc:1059] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 13:15:05.439900  5954 raft_consensus.cc:740] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:05.434077  6149 raft_consensus.cc:493] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:05.460613  6287 raft_consensus.cc:515] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:05.421881  6201 raft_consensus.cc:515] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:05.453372  6143 raft_consensus.cc:515] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:05.444187  6055 raft_consensus.cc:515] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:05.496244  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:15:05.498587  3951 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38606 (request call id 1706) took 1642 ms (client timeout 1805 ms). Trace:
I20260709 13:15:05.500054  3954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1700) took 1668 ms. Trace:
I20260709 13:15:05.502767  3954 rpcz_store.cc:276] 0709 13:15:03.831274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:03.831531 (+   257us) service_pool.cc:224] Handling call
0709 13:15:04.220895 (+389364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:04.221155 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:04.221194 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:04.221254 (+    60us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:04.221291 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:04.221342 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:05.499831 (+1278489us) spinlock_profiling.cc:243] Waited 389 ms on lock 0x7b54000f32d0. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566d8ad 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:05.499980 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":894722304}
I20260709 13:15:05.498194  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:05.494833  4108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45332 (request call id 1551) took 1635 ms. Trace:
I20260709 13:15:05.501077  4672 leader_election.cc:304] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:05.487738  3959 raft_consensus.cc:2468] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 4.
W20260709 13:15:05.498090  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:05.490278  6339 raft_consensus.cc:2749] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:05.494817  6292 leader_election.cc:290] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:05.481863  6340 leader_election.cc:290] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:05.491014  6364 leader_election.cc:290] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:15:05.480679  6288 consensus_meta.cc:287] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 0.778s	user 0.013s	sys 0.000s
I20260709 13:15:05.493078  6390 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:05.485631  6287 leader_election.cc:290] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:05.496451  6148 raft_consensus.cc:515] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:05.470824  6211 raft_consensus.cc:515] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:05.510102  6227 leader_election.cc:290] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:05.514228  6148 leader_election.cc:290] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:05.514600  6211 leader_election.cc:290] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:05.514922  3955 raft_consensus.cc:2393] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 5: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:05.515213  4672 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:05.515372  6132 raft_consensus.cc:515] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:05.517745  6132 leader_election.cc:290] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: Requested vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:05.506404  4108 rpcz_store.cc:276] 0709 13:15:03.858918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:03.859025 (+   107us) service_pool.cc:224] Handling call
0709 13:15:03.868898 (+  9873us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:04.082685 (+213787us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:04.082718 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:04.112063 (+ 29345us) log.cc:844] Serialized 52 byte log entry
0709 13:15:04.221436 (+109373us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:04.229616 (+  8180us) log.cc:844] Serialized 14 byte log entry
0709 13:15:04.531661 (+302045us) spinlock_profiling.cc:243] Waited 2.78 ms on lock 0x7b1800443b00. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f15225813f3 00007f15225837c1 00007f1522583779 00007f1522583709 00007f15225836d1 00007f15225829cd 000000000038f354 000000000038f199 00007f152256483a
0709 13:15:04.578927 (+ 47266us) log.cc:844] Serialized 14 byte log entry
0709 13:15:04.579150 (+   223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:04.579249 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:05.204267 (+625018us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b4400022b4c. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f15224a7c85 00007f15224a86a2 00007f152521a1db 00007f1525215aaf 00007f152520986e 00007f1525208bb6 00007f15252087d8 00007f1525212221 00007f15252121d9 00007f1525212169
0709 13:15:05.494606 (+290339us) raft_consensus.cc:1685] finished
0709 13:15:05.494627 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:05.494771 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":369075,"prepare.queue_time_us":8356,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":91,"raft.queue_time_us":545809,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":7918,"spinlock_wait_cycles":43012224,"thread_start_us":270842,"threads_started":2,"wal-append.queue_time_us":102544}
I20260709 13:15:05.511826  6303 raft_consensus.cc:493] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.456605  6398 raft_consensus.cc:2749] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:05.520761  3958 raft_consensus.cc:1240] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:05.471669  6357 raft_consensus.cc:2749] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:15:05.521679  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 68372.8us
W20260709 13:15:05.501901  3951 rpcz_store.cc:269] 0709 13:15:03.855821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:03.856134 (+   313us) service_pool.cc:224] Handling call
0709 13:15:05.498430 (+1642296us) spinlock_profiling.cc:243] Waited 435 ms on lock 0x7b54000befd4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:05.498530 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1000919424}
I20260709 13:15:05.464800  6391 raft_consensus.cc:493] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:05.518908  6214 raft_consensus.cc:515] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:05.539424  4074 leader_election.cc:304] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:05.539952  3951 raft_consensus.cc:1240] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:15:05.540717  4073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 112627us
I20260709 13:15:05.494786  6252 raft_consensus.cc:493] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.493748  5822 leader_election.cc:290] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:05.482295  6365 leader_election.cc:290] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:05.552178  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:05.552541  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:05.553488  4102 raft_consensus.cc:2393] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 5: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:05.546397  3951 raft_consensus.cc:1275] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:15:05.497157  6302 raft_consensus.cc:493] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:05.497480  6266 leader_election.cc:290] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:05.558419  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:05.526412  6034 raft_consensus.cc:2749] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:05.440986  6389 raft_consensus.cc:515] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:05.495743  6376 raft_consensus.cc:493] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:05.550843  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:05.554805  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:05.555467  3951 pending_rounds.cc:85] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059: Aborting all ops after (but not including) 6
I20260709 13:15:05.545182  6407 raft_consensus.cc:2804] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:05.573379  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:05.567788  3951 pending_rounds.cc:107] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:15:05.575870  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:05.576805  4102 raft_consensus.cc:2468] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 5.
I20260709 13:15:05.576848  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:05.577767  4107 raft_consensus.cc:2468] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 5.
I20260709 13:15:05.575901  3951 raft_consensus.cc:2889] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:05.578807  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:05.580132  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:05.572220  4104 raft_consensus.cc:2368] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 5. Current term is 6.
I20260709 13:15:05.577965  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:05.580120  3951 raft_consensus.cc:1240] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:05.482872  6149 raft_consensus.cc:515] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:05.583927  3951 raft_consensus.cc:1275] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:05.584026  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:05.589522  4100 raft_consensus.cc:1275] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:05.586798  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:05.546828  6391 raft_consensus.cc:3060] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:05.525914  6288 raft_consensus.cc:515] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:05.552516  6143 leader_election.cc:290] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:05.528868  6303 raft_consensus.cc:515] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:05.588927  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:05.589859  4101 raft_consensus.cc:1240] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:05.563084  6302 raft_consensus.cc:3060] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:05.594628  4102 raft_consensus.cc:2468] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 5.
I20260709 13:15:05.582413  6407 raft_consensus.cc:493] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:05.599572  6328 raft_consensus.cc:2749] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:05.557158  6350 consensus_queue.cc:1048] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:15:05.552204  6252 raft_consensus.cc:515] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:05.602782  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:05.626766  4105 raft_consensus.cc:2368] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 4. Current term is 5.
I20260709 13:15:05.613051  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:05.602360  6055 leader_election.cc:290] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:05.624869  4034 raft_consensus.cc:2468] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 5.
I20260709 13:15:05.629918  4071 leader_election.cc:304] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:05.553408  5954 consensus_queue.cc:260] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:05.585677  6376 raft_consensus.cc:515] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:05.639714  4071 leader_election.cc:304] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:05.640579  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:05.641551  4108 raft_consensus.cc:2468] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 4.
I20260709 13:15:05.623361  6407 raft_consensus.cc:3060] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:05.628249  6296 raft_consensus.cc:697] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 6 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:05.636037  6334 leader_election.cc:290] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:05.654120  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:05.651955  5974 raft_consensus.cc:2749] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:05.650942  4674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:05.649168  6055 raft_consensus.cc:2804] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:05.648161  5954 raft_consensus.cc:3060] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:05.648839  6201 leader_election.cc:290] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:05.657469  6404 log.cc:927] Time spent T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:15:05.663230  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:05.669697  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:05.662381  6055 raft_consensus.cc:493] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:05.673002  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
W20260709 13:15:05.675302  6345 consensus_meta.cc:287] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.586s	user 0.009s	sys 0.000s
I20260709 13:15:05.678696  4105 raft_consensus.cc:3060] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:05.673614  6214 leader_election.cc:290] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:05.675786  6389 leader_election.cc:290] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:05.676860  6303 leader_election.cc:290] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:05.680168  6410 consensus_queue.cc:1059] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:15:05.680464  6149 leader_election.cc:290] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:05.681098  6288 leader_election.cc:290] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 election: Requested vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:05.685251  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:05.692556  6350 raft_consensus.cc:3055] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:05.692978  6350 raft_consensus.cc:740] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:05.694118  6350 consensus_queue.cc:260] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:05.712220  6252 leader_election.cc:290] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:05.713637  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:05.714614  4101 raft_consensus.cc:2468] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 7.
I20260709 13:15:05.715839  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:05.716837  4107 raft_consensus.cc:2368] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 4. Current term is 5.
I20260709 13:15:05.730543  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:05.682235  6055 raft_consensus.cc:3060] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:05.748256  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:05.746699  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:05.752036  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:05.752036  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:05.749284  4031 raft_consensus.cc:2468] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 5.
I20260709 13:15:05.753072  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:05.753366  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:05.753790  4027 raft_consensus.cc:3060] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:05.754190  4107 raft_consensus.cc:2368] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 5. Current term is 6.
I20260709 13:15:05.752454  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:05.755033  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:05.756942  3950 raft_consensus.cc:2468] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 4.
I20260709 13:15:05.759734  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:05.759889  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:05.760383  4025 raft_consensus.cc:3060] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:15:05.760596  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:05.760519  4028 raft_consensus.cc:3060] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:05.761286  4026 raft_consensus.cc:2468] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
I20260709 13:15:05.765267  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:05.766074  4709 raft_consensus.cc:3060] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:05.767695  3922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:05.770295  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:05.771162  4026 raft_consensus.cc:2468] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 4.
I20260709 13:15:05.785995  4105 raft_consensus.cc:2468] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 6.
I20260709 13:15:05.787051  4108 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:15:05.787823  4672 leader_election.cc:304] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:05.789233  6409 consensus_queue.cc:1048] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:15:05.744342  6350 raft_consensus.cc:3060] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:05.753445  6252 raft_consensus.cc:493] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.796363  6376 leader_election.cc:290] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:05.736720  6296 consensus_queue.cc:237] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:05.801524  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:05.823246  4026 raft_consensus.cc:2393] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 6: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:05.804286  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:05.823849  4707 raft_consensus.cc:2468] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
I20260709 13:15:05.794339  4103 raft_consensus.cc:2468] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 4.
I20260709 13:15:05.808708  4108 raft_consensus.cc:606] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Received request to transfer leadership to TS 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:05.825568  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:05.826002  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:05.826551  4026 raft_consensus.cc:3060] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:15:05.826622  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:05.772996  6261 consensus_queue.cc:1048] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:15:05.817082  3922 leader_election.cc:304] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:05.824913  6189 consensus_queue.cc:1048] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:15:05.828397  6411 consensus_queue.cc:1059] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:15:05.822173  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:05.829304  6411 raft_consensus.cc:3055] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:05.822417  6266 consensus_queue.cc:1048] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:15:05.829739  6411 raft_consensus.cc:740] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:05.757144  6334 consensus_queue.cc:1059] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 13:15:05.832701  6334 raft_consensus.cc:3055] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:05.737874  6345 raft_consensus.cc:515] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:05.836933  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:05.816570  4101 raft_consensus.cc:1275] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:15:05.838166  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:05.838737  4101 raft_consensus.cc:3060] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:05.821502  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:05.840330  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:05.824072  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:05.841452  4032 raft_consensus.cc:2468] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 4.
I20260709 13:15:05.841619  4026 raft_consensus.cc:2468] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 5.
I20260709 13:15:05.814246  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:05.843618  4708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:05.757205  6316 consensus_queue.cc:1048] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:15:05.847729  3922 leader_election.cc:304] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:05.813640  6034 raft_consensus.cc:2804] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:05.852805  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:05.851902  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:05.852581  4105 raft_consensus.cc:1275] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:05.856158  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:05.856220  4026 raft_consensus.cc:2468] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
I20260709 13:15:05.858302  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:05.859509  4708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:05.864924  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:05.870194  4707 raft_consensus.cc:2393] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 5: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
I20260709 13:15:05.870873  4026 raft_consensus.cc:2468] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3.
I20260709 13:15:05.873134  4027 raft_consensus.cc:2468] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
I20260709 13:15:05.874528  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:05.861891  3922 leader_election.cc:304] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:05.833110  6334 raft_consensus.cc:740] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:05.795205  6391 raft_consensus.cc:515] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:05.875276  4027 raft_consensus.cc:2468] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 5.
I20260709 13:15:05.834468  4701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:05.881450  4106 raft_consensus.cc:2393] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 6: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:05.885218  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:05.890365  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:05.886171  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:05.892817  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:05.830844  6411 consensus_queue.cc:260] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:05.893755  4105 raft_consensus.cc:2368] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 5. Current term is 6.
I20260709 13:15:05.895807  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:05.891520  4032 raft_consensus.cc:2468] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 5.
I20260709 13:15:05.851670  6197 raft_consensus.cc:2749] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:05.854910  6389 raft_consensus.cc:493] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.905958  4101 raft_consensus.cc:2468] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 5.
I20260709 13:15:05.823261  6252 raft_consensus.cc:515] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:05.910641  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:05.911664  4026 raft_consensus.cc:2468] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 4.
I20260709 13:15:05.915717  3956 raft_consensus.cc:1240] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:05.868572  6287 raft_consensus.cc:2749] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:05.855406  6390 consensus_queue.cc:1048] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:15:05.897737  6292 raft_consensus.cc:2749] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:05.928292  4707 raft_consensus.cc:1275] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:05.867997  6148 consensus_queue.cc:1048] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 13:15:05.926255  6411 raft_consensus.cc:3060] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:05.949038  3952 raft_consensus.cc:2468] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 6.
I20260709 13:15:05.936640  3925 leader_election.cc:304] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:05.936997  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:05.931236  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:05.950435  4105 raft_consensus.cc:2393] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 5: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:05.941794  6211 raft_consensus.cc:493] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:05.943056  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:05.943372  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:05.951877  4032 raft_consensus.cc:2468] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 4.
I20260709 13:15:05.943966  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:05.952440  4028 raft_consensus.cc:2468] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 5.
I20260709 13:15:05.945467  3953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35354 (request call id 196) took 1285 ms. Trace:
I20260709 13:15:05.953168  3953 rpcz_store.cc:276] 0709 13:15:04.659619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.388866 (+729247us) service_pool.cc:224] Handling call
0709 13:15:05.389184 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:05.468736 (+ 79552us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:05.468778 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:05.468839 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:05.468885 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:05.944401 (+475516us) spinlock_profiling.cc:243] Waited 3.35 ms on lock 0x7b1800450700. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f152254f2a6 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419
0709 13:15:05.945204 (+   803us) spinlock_profiling.cc:243] Waited 73 ms on lock 0x7b54001694d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:05.945258 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:05.945406 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6294,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":5237,"spinlock_wait_cycles":175698560}
I20260709 13:15:05.954015  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:05.918051  6336 raft_consensus.cc:3055] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:05.955161  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:05.955368  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:05.901926  6288 raft_consensus.cc:493] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:05.895066  6149 consensus_queue.cc:1048] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:15:05.958295  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:15:05.958541  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 79971.9us
I20260709 13:15:05.980654  3925 leader_election.cc:304] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:05.981480  3922 leader_election.cc:400] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Vote denied by peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843) with higher term. Message: Invalid argument: T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 5. Current term is 6.
I20260709 13:15:05.981873  3922 leader_election.cc:403] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:15:05.982023  6166 raft_consensus.cc:2804] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:05.901784  5962 consensus_queue.cc:1048] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:15:05.981755  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:05.996094  4028 raft_consensus.cc:3060] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:05.981690  3925 leader_election.cc:304] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:05.983403  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:05.997692  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:05.998747  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:05.983310  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:05.985194  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:05.991029  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:05.998417  3925 leader_election.cc:304] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:06.002064  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:06.003857  4032 raft_consensus.cc:2393] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 5: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:05.918908  6389 raft_consensus.cc:515] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:06.001489  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 139626us
I20260709 13:15:06.007129  4029 raft_consensus.cc:1240] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:15:06.008848  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:06.005673  3925 leader_election.cc:304] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:06.010126  3925 leader_election.cc:304] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:06.011130  3925 leader_election.cc:304] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:06.011468  4709 raft_consensus.cc:2468] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 5.
I20260709 13:15:05.957316  6336 raft_consensus.cc:740] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:06.025293  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:06.027163  4100 raft_consensus.cc:2376] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 5. Re-sending same reply.
I20260709 13:15:06.028350  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:05.993963  6155 raft_consensus.cc:2804] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:06.029012  4100 raft_consensus.cc:2468] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 5.
I20260709 13:15:06.039932  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:05.993848  6132 raft_consensus.cc:493] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:06.024446  4028 raft_consensus.cc:2468] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 5.
I20260709 13:15:05.994164  6166 raft_consensus.cc:493] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:05.994469  6292 raft_consensus.cc:3060] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:06.050383  4033 raft_consensus.cc:2468] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 5.
I20260709 13:15:05.956719  6211 raft_consensus.cc:515] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:06.051218  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:06.007589  6364 raft_consensus.cc:2804] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:06.006390  6034 raft_consensus.cc:697] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 6 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:05.983299  6288 raft_consensus.cc:515] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:06.000401  6397 consensus_queue.cc:1048] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:15:05.996034  6302 raft_consensus.cc:515] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:06.022766  6143 raft_consensus.cc:2804] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:06.026538  6266 raft_consensus.cc:2804] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:06.029155  4073 leader_election.cc:304] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
W20260709 13:15:06.068424  3922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:06.102507  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:06.113382  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:06.042248  6155 raft_consensus.cc:493] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:06.073254  6413 log.cc:927] Time spent T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
W20260709 13:15:06.103489  4674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:06.125067  4073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 96007.4us
I20260709 13:15:06.125984  4708 raft_consensus.cc:1240] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:06.126000  4026 raft_consensus.cc:2468] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 4.
I20260709 13:15:06.103295  6231 raft_consensus.cc:493] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.086522  6376 raft_consensus.cc:493] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.048681  6197 raft_consensus.cc:2804] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:06.104508  6166 raft_consensus.cc:3060] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:06.130268  4074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:06.131057  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:06.029631  6261 consensus_queue.cc:1048] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.091s
I20260709 13:15:06.106395  6364 raft_consensus.cc:493] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:06.103946  6421 raft_consensus.cc:2804] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:06.030390  6407 raft_consensus.cc:515] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:06.129061  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:06.161269  4025 raft_consensus.cc:2468] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 5.
I20260709 13:15:06.122293  6345 leader_election.cc:290] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:06.120493  6266 raft_consensus.cc:697] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 5 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:06.127475  6155 raft_consensus.cc:3060] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:06.177651  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 166586us
I20260709 13:15:06.106791  6143 raft_consensus.cc:493] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:06.259886  6143 raft_consensus.cc:3060] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:06.150661  6391 leader_election.cc:290] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:06.193081  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:06.196964  6211 leader_election.cc:290] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:06.112576  6336 consensus_queue.cc:260] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:06.198756  6416 log.cc:927] Time spent T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:15:06.200444  6055 raft_consensus.cc:515] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:06.129581  6420 raft_consensus.cc:493] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:06.202907  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:06.132422  6410 raft_consensus.cc:2804] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:06.218928  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:06.132458  6227 raft_consensus.cc:493] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:06.177217  6364 raft_consensus.cc:3060] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:06.243113  3925 leader_election.cc:304] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:15:06.292758  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 49794.9us
I20260709 13:15:06.207002  6252 leader_election.cc:290] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:06.065985  6132 raft_consensus.cc:515] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:06.217160  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:06.170475  4071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:06.299626  4108 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:15:06.300206  4108 raft_consensus.cc:606] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Received request to transfer leadership to TS 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:06.300535  4108 raft_consensus.cc:614] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:06.301993  4108 raft_consensus.cc:1275] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:06.266427  4672 leader_election.cc:304] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:06.305320  4101 raft_consensus.cc:2468] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
I20260709 13:15:06.155923  6197 raft_consensus.cc:493] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:06.306567  6197 raft_consensus.cc:3060] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:06.306905  4101 raft_consensus.cc:1240] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:15:06.210696  6422 log.cc:927] Time spent T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:15:06.212998  6389 leader_election.cc:290] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:06.309819  6389 raft_consensus.cc:493] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:06.310436  6389 raft_consensus.cc:515] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:06.311156  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
W20260709 13:15:06.204864  6417 log.cc:927] Time spent T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:15:06.176746  6421 raft_consensus.cc:493] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:06.314337  4030 raft_consensus.cc:1240] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:06.314599  6421 raft_consensus.cc:3060] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:06.138388  6231 raft_consensus.cc:515] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:06.317575  4030 raft_consensus.cc:1240] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:15:06.320437  4104 raft_consensus.cc:1240] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:06.326395  4101 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:15:06.328938  4101 raft_consensus.cc:606] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 LEADER]: Received request to transfer leadership to TS 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:06.330659  2843 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:15:06.259295  6292 raft_consensus.cc:2749] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843) with higher term. Message: Invalid argument: T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 5. Current term is 6.
I20260709 13:15:06.217550  6407 leader_election.cc:290] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:06.206699  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:06.332842  4705 raft_consensus.cc:2393] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 5: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
I20260709 13:15:06.293493  3925 leader_election.cc:304] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:06.335183  3925 leader_election.cc:304] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:06.215749  6034 consensus_queue.cc:237] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:06.297899  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:06.337036  4100 raft_consensus.cc:2393] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 5: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:06.339285  6252 raft_consensus.cc:2804] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:06.339834  6252 raft_consensus.cc:493] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:06.340276  6252 raft_consensus.cc:3060] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:06.346732  3925 leader_election.cc:304] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:06.270721  6211 raft_consensus.cc:493] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:06.146081  6376 raft_consensus.cc:515] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:06.382020  3958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1724) took 1308 ms. Trace:
W20260709 13:15:06.382465  3922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:06.384027  4034 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41312 (request call id 228) took 1624 ms (client timeout 1901 ms). Trace:
W20260709 13:15:06.384541  4034 rpcz_store.cc:269] 0709 13:15:04.759780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:04.759955 (+   175us) service_pool.cc:224] Handling call
0709 13:15:06.383867 (+1623912us) spinlock_profiling.cc:243] Waited 758 ms on lock 0x7b54001dae54. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:06.383970 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1742589312}
I20260709 13:15:06.382666  3958 rpcz_store.cc:276] 0709 13:15:05.073561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.528740 (+455179us) service_pool.cc:224] Handling call
0709 13:15:05.539226 (+ 10486us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:05.615196 (+ 75970us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:05.615242 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:05.615305 (+    63us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:05.615357 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.381675 (+766318us) spinlock_profiling.cc:243] Waited 75.7 ms on lock 0x7b5400385254. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:06.381741 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:06.381935 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":174138240}
I20260709 13:15:06.394771  6231 leader_election.cc:290] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:06.396183  6427 raft_consensus.cc:2804] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:06.396782  6427 raft_consensus.cc:493] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:06.397276  6427 raft_consensus.cc:3060] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:06.315460  6391 raft_consensus.cc:2804] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:06.412611  4074 leader_election.cc:304] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:06.419512  4074 leader_election.cc:304] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:06.373195  6380 raft_consensus.cc:2804] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:06.319828  6288 leader_election.cc:290] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:06.316265  6410 raft_consensus.cc:697] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:06.416375  6261 raft_consensus.cc:2749] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:06.296458  6227 raft_consensus.cc:515] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:06.443945  6431 raft_consensus.cc:493] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.449455  6055 leader_election.cc:290] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:06.452056  6376 leader_election.cc:290] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:06.273469  6266 consensus_queue.cc:237] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:06.415894  6336 raft_consensus.cc:3060] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:06.297088  6420 raft_consensus.cc:515] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:06.455974  6380 raft_consensus.cc:493] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:06.405364  6211 raft_consensus.cc:515] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:06.515210  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:06.515413  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:06.515973  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:06.524457  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:06.468906  6432 raft_consensus.cc:2749] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:06.531224  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:06.532707  3997 leader_election.cc:304] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:06.513432  6380 raft_consensus.cc:3060] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:06.554147  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:15:06.551640  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 132218us
I20260709 13:15:06.551512  3997 leader_election.cc:304] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
W20260709 13:15:06.554890  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 288558us
I20260709 13:15:06.505505  6288 raft_consensus.cc:493] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:06.469357  6407 raft_consensus.cc:2749] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:06.556840  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:06.561978  3958 raft_consensus.cc:2468] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 5.
I20260709 13:15:06.557842  3997 leader_election.cc:304] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:06.558876  4074 leader_election.cc:304] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:06.533425  6302 leader_election.cc:290] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:06.569329  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:06.549050  6425 raft_consensus.cc:493] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.572310  4074 leader_election.cc:304] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:06.568499  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 221864us
I20260709 13:15:06.571080  3958 raft_consensus.cc:2468] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 6.
I20260709 13:15:06.553339  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:15:06.569777  6411 consensus_meta.cc:287] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.616s	user 0.007s	sys 0.005s
I20260709 13:15:06.578689  4074 leader_election.cc:304] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:06.562430  6429 raft_consensus.cc:493] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:06.561220  6350 raft_consensus.cc:493] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:06.475155  6431 raft_consensus.cc:515] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:06.592703  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:06.570392  6433 raft_consensus.cc:493] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:06.572279  6352 raft_consensus.cc:2749] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:15:06.599191  4071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:06.577855  6407 raft_consensus.cc:2749] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:06.595973  4074 leader_election.cc:304] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:06.565574  6288 raft_consensus.cc:515] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:06.630519  3958 raft_consensus.cc:1275] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:06.596501  6055 raft_consensus.cc:2749] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:06.590519  6446 raft_consensus.cc:2804] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:06.590850  6432 raft_consensus.cc:493] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:06.634100  6446 raft_consensus.cc:493] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:06.634284  6432 raft_consensus.cc:515] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:06.634754  6446 raft_consensus.cc:3060] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:06.637002  6432 leader_election.cc:290] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:06.637909  3954 raft_consensus.cc:1240] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 6 LEADER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:06.630333  4705 raft_consensus.cc:2393] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 4: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
I20260709 13:15:06.608028  6391 raft_consensus.cc:697] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 6 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:06.609258  6433 raft_consensus.cc:515] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:06.649312  6252 raft_consensus.cc:515] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:06.654335  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:06.596573  6438 raft_consensus.cc:493] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:06.679783  3959 raft_consensus.cc:2393] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 6: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:06.607293  6034 raft_consensus.cc:493] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:06.632804  5921 raft_consensus.cc:2749] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:06.671072  6420 leader_election.cc:290] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:06.688572  6034 raft_consensus.cc:515] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:06.690074  6433 leader_election.cc:290] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:06.672029  6252 leader_election.cc:290] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:06.671823  6197 raft_consensus.cc:515] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:06.691033  6433 raft_consensus.cc:2749] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:15:06.662388  4674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:06.692134  4704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57692 (request call id 285) took 1970 ms. Trace:
W20260709 13:15:06.692544  6430 log.cc:927] Time spent T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:15:06.693316  6197 leader_election.cc:290] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:06.697702  6427 raft_consensus.cc:515] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:06.700246  3954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1718) took 1628 ms. Trace:
I20260709 13:15:06.700770  3954 rpcz_store.cc:276] 0709 13:15:05.071897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.523356 (+451459us) service_pool.cc:224] Handling call
0709 13:15:05.523719 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:06.638345 (+1114626us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.699898 (+ 61553us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400217fd4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:06.700146 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2561968512}
W20260709 13:15:06.704028  6412 log.cc:927] Time spent T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.908s	user 0.002s	sys 0.000s
I20260709 13:15:06.705528  4099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45336 (request call id 1042) took 1153 ms. Trace:
I20260709 13:15:06.664004  6132 leader_election.cc:290] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:06.574702  6410 consensus_queue.cc:237] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:06.708112  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:06.709487  6391 consensus_queue.cc:237] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:06.710621  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:15:06.650841  6439 log.cc:927] Time spent T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:15:06.597020  6350 raft_consensus.cc:515] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:06.682742  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 105340us
I20260709 13:15:06.651871  6440 raft_consensus.cc:493] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:06.577513  6425 raft_consensus.cc:515] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:06.692633  4704 rpcz_store.cc:276] 0709 13:15:04.721500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:04.723093 (+  1593us) service_pool.cc:224] Handling call
0709 13:15:04.753941 (+ 30848us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:04.758303 (+  4362us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.691742 (+1933439us) spinlock_profiling.cc:243] Waited 3.36 ms on lock 0x7b54004e0a54. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:06.692036 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7722240}
I20260709 13:15:06.676059  6447 raft_consensus.cc:2749] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:15:06.673496  6395 log.cc:927] Time spent T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 1.355s	user 0.009s	sys 0.001s
I20260709 13:15:06.705935  4099 rpcz_store.cc:276] 0709 13:15:05.552697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.552877 (+   180us) service_pool.cc:224] Handling call
0709 13:15:05.557345 (+  4468us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:05.573161 (+ 15816us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:05.573192 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:05.590137 (+ 16945us) log.cc:844] Serialized 26 byte log entry
0709 13:15:05.655267 (+ 65130us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:05.655316 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:05.655402 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:06.703306 (+1047904us) spinlock_profiling.cc:243] Waited 4.15 ms on lock 0x7b4400022b4c. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f15224a7c85 00007f15224a86a2 00007f152521a1db 00007f1525215aaf 00007f152520986e 00007f1525208bb6 00007f15252087d8 00007f1525212221 00007f15252121d9 00007f1525212169
0709 13:15:06.705185 (+  1879us) raft_consensus.cc:1685] finished
0709 13:15:06.705210 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:06.705456 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6905,"raft.queue_time_us":9752,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":9020,"spinlock_wait_cycles":9537408,"thread_start_us":42570,"threads_started":1,"wal-append.queue_time_us":70373}
W20260709 13:15:06.716558  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 158820us
I20260709 13:15:06.749770  3997 leader_election.cc:304] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:06.694875  6446 raft_consensus.cc:515] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:06.686723  6428 log.cc:927] Time spent T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.153s	user 0.001s	sys 0.001s
I20260709 13:15:06.727326  3925 leader_election.cc:304] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:06.645061  4074 leader_election.cc:304] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:06.761988  4071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:06.597389  6429 raft_consensus.cc:515] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:06.705983  6143 raft_consensus.cc:515] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:06.660715  6432 consensus_queue.cc:1059] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
W20260709 13:15:07.062394  4071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:07.081662  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 354420us
I20260709 13:15:07.082883  3925 leader_election.cc:304] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:07.086246  6211 leader_election.cc:290] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:07.095323  6307 raft_consensus.cc:2804] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:07.096086  6307 raft_consensus.cc:697] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 5 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:06.969414  6349 raft_consensus.cc:2749] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:07.027899  6433 raft_consensus.cc:2749] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:06.968415  6302 raft_consensus.cc:493] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:06.739902  6440 raft_consensus.cc:515] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:07.133533  6441 raft_consensus.cc:2804] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:07.087594  4706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57680 (request call id 549) took 1331 ms. Trace:
W20260709 13:15:07.156519  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 48409.5us
I20260709 13:15:07.157779  3925 leader_election.cc:304] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:07.200719  6429 leader_election.cc:290] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:07.138597  6439 log.cc:927] Time spent T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:15:07.119714  6427 leader_election.cc:290] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:07.257063  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 507342us
W20260709 13:15:07.258404  6377 log.cc:927] Time spent T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 2.356s	user 0.026s	sys 0.026s
W20260709 13:15:07.259644  3952 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35354 (request call id 200) took 1479 ms (client timeout 1760 ms). Trace:
W20260709 13:15:07.260070  3952 rpcz_store.cc:269] 0709 13:15:05.780466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.780640 (+   174us) service_pool.cc:224] Handling call
0709 13:15:07.259443 (+1478803us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b5400187ed4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:07.259586 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":243856768}
I20260709 13:15:07.263533  4708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57680 (request call id 553) took 1450 ms. Trace:
I20260709 13:15:07.264122  4708 rpcz_store.cc:276] 0709 13:15:05.813061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.892807 (+ 79746us) service_pool.cc:224] Handling call
0709 13:15:05.893119 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:06.132699 (+239580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:07.263194 (+1130495us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b5400598654. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:07.263451 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":534947072}
I20260709 13:15:07.265462  4034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41312 (request call id 234) took 1064 ms. Trace:
I20260709 13:15:07.265872  4034 rpcz_store.cc:276] 0709 13:15:06.201073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.426522 (+225449us) service_pool.cc:224] Handling call
0709 13:15:06.469507 (+ 42985us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:06.480476 (+ 10969us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:06.480523 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:06.480582 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:06.480627 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:07.265200 (+784573us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b540026d4d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:07.265258 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:07.265399 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24593664}
W20260709 13:15:07.258496  4106 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45336 (request call id 1040) took 1706 ms (client timeout 1639 ms). Trace:
W20260709 13:15:07.269917  4106 rpcz_store.cc:269] 0709 13:15:05.551732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.551912 (+   180us) service_pool.cc:224] Handling call
0709 13:15:07.258181 (+1706269us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x7b54001bb054. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:07.258381 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":755104000}
I20260709 13:15:06.723191  6438 raft_consensus.cc:515] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:07.287679  6252 raft_consensus.cc:2804] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:07.288410  6252 raft_consensus.cc:493] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:07.288909  6252 raft_consensus.cc:3060] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:07.300031  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 142381us
I20260709 13:15:07.258399  3997 leader_election.cc:304] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:07.315158  6429 raft_consensus.cc:2804] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:07.315900  6429 raft_consensus.cc:493] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:07.316761  6429 raft_consensus.cc:3060] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:07.322052  6220 raft_consensus.cc:493] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:07.322929  6220 raft_consensus.cc:515] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:07.324045  4071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:07.325151  4030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41312 (request call id 232) took 1192 ms. Trace:
I20260709 13:15:07.325647  4030 rpcz_store.cc:276] 0709 13:15:06.132703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.318803 (+186100us) service_pool.cc:224] Handling call
0709 13:15:06.319053 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:06.383850 (+ 64797us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:06.383881 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:06.383919 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:06.383953 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:07.324879 (+940926us) spinlock_profiling.cc:243] Waited 64.6 ms on lock 0x7b5400388954. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:07.324934 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:07.325085 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":148533120}
W20260709 13:15:07.338109  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 79813.7us
W20260709 13:15:07.257192  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 612297us
I20260709 13:15:07.340811  4074 leader_election.cc:304] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:07.229759  6441 raft_consensus.cc:697] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 5 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
W20260709 13:15:07.241080  6155 consensus_meta.cc:287] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.969s	user 0.013s	sys 0.000s
I20260709 13:15:07.345322  4028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38290 (request call id 1656) took 1398 ms. Trace:
I20260709 13:15:07.345528  3997 leader_election.cc:400] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843) with higher term. Message: Invalid argument: T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 4. Current term is 5.
W20260709 13:15:07.334944  6166 consensus_meta.cc:287] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 1.158s	user 0.013s	sys 0.000s
I20260709 13:15:07.349119  3997 leader_election.cc:403] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:07.351178  3997 leader_election.cc:304] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:07.354171  3997 leader_election.cc:400] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843) with higher term. Message: Invalid argument: T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 4. Current term is 5.
I20260709 13:15:07.159296  6302 raft_consensus.cc:515] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:07.097136  6307 consensus_queue.cc:237] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:07.344403  6123 raft_consensus.cc:2749] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:07.345752  4028 rpcz_store.cc:276] 0709 13:15:05.946964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.160499 (+213535us) service_pool.cc:224] Handling call
0709 13:15:06.160982 (+   483us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:06.328305 (+167323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:06.328350 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:06.329157 (+   807us) log.cc:844] Serialized 26 byte log entry
0709 13:15:06.364606 (+ 35449us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:06.365059 (+   453us) log.cc:844] Serialized 14 byte log entry
0709 13:15:06.365303 (+   244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.365412 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:07.345101 (+979689us) raft_consensus.cc:1685] finished
0709 13:15:07.345125 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:07.345261 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2133,"prepare.queue_time_us":309,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":249305,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":8487,"thread_start_us":201594,"threads_started":2,"wal-append.queue_time_us":202388}
W20260709 13:15:07.344488  6428 log.cc:927] Time spent T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:15:07.160586  4706 rpcz_store.cc:276] 0709 13:15:05.749121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.754187 (+  5066us) service_pool.cc:224] Handling call
0709 13:15:06.710426 (+956239us) spinlock_profiling.cc:243] Waited 2.69 ms on lock 0x7b5800003f98. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f1522549b71 00007f1522549a22 00007f152b462c09 00007f152a5bcee0 00007f152a6860ab 00007f152a686131 00007f152a6340a0 00007f152a633984 00007f1523bae6d4 00007f1523bae662
0709 13:15:07.080566 (+370140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6196480}
I20260709 13:15:07.355265  3997 leader_election.cc:304] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:07.368647  3997 leader_election.cc:400] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 election: Vote denied by peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843) with higher term. Message: Invalid argument: T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 5. Current term is 6.
I20260709 13:15:07.369014  3997 leader_election.cc:403] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:15:07.371842  3997 leader_election.cc:304] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:07.385196  3997 leader_election.cc:304] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:07.350015  6433 consensus_queue.cc:1059] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:15:07.349674  6155 raft_consensus.cc:515] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:07.354174  6166 raft_consensus.cc:515] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:07.417600  3953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35354 (request call id 201) took 1408 ms. Trace:
I20260709 13:15:07.369591  6447 raft_consensus.cc:2804] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:15:07.380290  4674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:07.371573  6145 raft_consensus.cc:3060] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:07.421406  3953 rpcz_store.cc:276] 0709 13:15:06.008933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.009063 (+   130us) service_pool.cc:224] Handling call
0709 13:15:06.009381 (+   318us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:06.025443 (+ 16062us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:06.025492 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:06.026229 (+   737us) log.cc:844] Serialized 52 byte log entry
0709 13:15:06.319596 (+293367us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:06.403879 (+ 84283us) log.cc:844] Serialized 14 byte log entry
0709 13:15:06.404141 (+   262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.404246 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:07.417226 (+1012980us) raft_consensus.cc:1685] finished
0709 13:15:07.417262 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:07.417505 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":94343,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":58,"raft.queue_time_us":111497,"raft.run_cpu_time_us":362,"raft.run_wall_time_us":14292,"thread_start_us":266771,"threads_started":1,"wal-append.queue_time_us":418187}
I20260709 13:15:07.384227  6391 raft_consensus.cc:493] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:07.386540  6211 raft_consensus.cc:2804] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:07.397857  6350 leader_election.cc:290] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:07.386618  6123 consensus_queue.cc:1059] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:15:07.423866  6447 raft_consensus.cc:493] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:07.424604  6454 raft_consensus.cc:493] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
W20260709 13:15:07.443722  6410 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.006s	sys 0.030s
W20260709 13:15:07.454743  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 67037.4us
I20260709 13:15:07.435654  6446 leader_election.cc:290] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:07.453414  5822 raft_consensus.cc:493] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:07.418552  6441 consensus_queue.cc:237] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:07.451709  6380 consensus_meta.cc:287] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.886s	user 0.011s	sys 0.000s
I20260709 13:15:07.448114  6447 raft_consensus.cc:3060] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:07.436841  6391 raft_consensus.cc:515] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:07.457798  6451 raft_consensus.cc:2764] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:15:07.475970  6391 leader_election.cc:290] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:07.477487  6438 leader_election.cc:290] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:07.479897  6431 leader_election.cc:290] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:07.480388  6302 leader_election.cc:290] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:07.481155  3956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1719) took 2409 ms. Trace:
I20260709 13:15:07.481568  3956 rpcz_store.cc:276] 0709 13:15:05.072041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.522719 (+450678us) service_pool.cc:224] Handling call
0709 13:15:05.523137 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:05.916298 (+393161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:07.480879 (+1564581us) spinlock_profiling.cc:243] Waited 392 ms on lock 0x7b5400429854. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:07.481092 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":902185344}
W20260709 13:15:07.485030  4103 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45336 (request call id 1045) took 1929 ms (client timeout 1521 ms). Trace:
W20260709 13:15:07.485461  4103 rpcz_store.cc:269] 0709 13:15:05.553659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.554162 (+   503us) service_pool.cc:224] Handling call
0709 13:15:07.483377 (+1929215us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b5400198054. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:07.483480 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":506219776}
I20260709 13:15:07.486089  3955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1720) took 2413 ms. Trace:
I20260709 13:15:07.445156  6326 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:07.447983  6143 leader_election.cc:290] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:07.473673  4104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45336 (request call id 1064) took 1759 ms. Trace:
W20260709 13:15:07.454074  6410 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.006s	sys 0.030s
I20260709 13:15:07.486493  3955 rpcz_store.cc:276] 0709 13:15:05.072193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.516201 (+444008us) service_pool.cc:224] Handling call
0709 13:15:05.516539 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:05.538751 (+ 22212us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:15:05.545018 (+  6267us) log.cc:844] Serialized 14 byte log entry
0709 13:15:06.096829 (+551811us) log.cc:844] Serialized 14 byte log entry
0709 13:15:06.105285 (+  8456us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:06.105363 (+    78us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:06.105440 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:07.485865 (+1380425us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b540013a1d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:07.485910 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:07.486030 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20552,"prepare.queue_time_us":280507,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":98,"raft.queue_time_us":20957,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":12505,"spinlock_wait_cycles":30479616,"thread_start_us":538077,"threads_started":2,"wal-append.queue_time_us":378562,"wal-append.run_cpu_time_us":6116,"wal-append.run_wall_time_us":1275098}
W20260709 13:15:07.489686  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 104584us
I20260709 13:15:07.492695  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:07.523952  3997 leader_election.cc:304] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:07.505892  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:07.506714  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:07.527628  3997 leader_election.cc:304] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:07.528570  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:07.532343  6431 consensus_queue.cc:1048] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:07.534454  6431 raft_consensus.cc:2749] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:07.535295  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
W20260709 13:15:07.458355  6435 log.cc:927] Time spent T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:15:07.536455  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:07.537457  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
W20260709 13:15:07.537906  6421 consensus_meta.cc:287] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 1.215s	user 0.013s	sys 0.000s
I20260709 13:15:07.487406  6326 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:07.496954  4104 rpcz_store.cc:276] 0709 13:15:05.714440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.714573 (+   133us) service_pool.cc:224] Handling call
0709 13:15:05.714889 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:06.320908 (+606019us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:07.473371 (+1152463us) spinlock_profiling.cc:243] Waited 605 ms on lock 0x7b5400196c54. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:07.473599 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1392091904}
I20260709 13:15:07.542013  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:07.526005  4108 raft_consensus.cc:2468] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 5.
I20260709 13:15:07.544111  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:07.544878  4108 raft_consensus.cc:2468] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 5.
I20260709 13:15:07.546336  4108 raft_consensus.cc:1275] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:07.547526  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:07.549487  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:07.551257  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:07.462350  6458 log.cc:927] Time spent T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:15:07.552297  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:07.556128  4102 raft_consensus.cc:2410] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
W20260709 13:15:07.458942  6457 log.cc:927] Time spent T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:15:07.489996  6364 consensus_meta.cc:287] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 1.170s	user 0.014s	sys 0.000s
I20260709 13:15:07.463757  6446 raft_consensus.cc:2749] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:07.562958  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:07.448889  6252 raft_consensus.cc:515] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:07.472338  6295 raft_consensus.cc:493] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:07.472630  6462 raft_consensus.cc:493] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:07.564788  4104 raft_consensus.cc:2368] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 5. Current term is 6.
I20260709 13:15:07.561995  3957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35354 (request call id 197) took 2902 ms. Trace:
I20260709 13:15:07.578452  3957 rpcz_store.cc:276] 0709 13:15:04.659883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.390106 (+730223us) service_pool.cc:224] Handling call
0709 13:15:05.390397 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:05.435297 (+ 44900us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:05.435344 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:05.435405 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:05.435458 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:07.561667 (+2126209us) spinlock_profiling.cc:243] Waited 44.6 ms on lock 0x7b54001685d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:07.561738 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:07.561913 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":102605696}
I20260709 13:15:07.465489  6155 leader_election.cc:290] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:07.468219  6440 leader_election.cc:290] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:07.472908  6425 leader_election.cc:290] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:07.472514  6450 raft_consensus.cc:2749] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843) with higher term. Message: Invalid argument: T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 5. Current term is 6.
I20260709 13:15:07.538321  6421 raft_consensus.cc:515] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:07.561775  6447 raft_consensus.cc:515] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:07.459789  6456 raft_consensus.cc:2749] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843) with higher term. Message: Invalid argument: T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 4. Current term is 5.
I20260709 13:15:07.456717  5822 raft_consensus.cc:515] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:07.666860  4100 raft_consensus.cc:2468] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 4.
I20260709 13:15:07.464433  6380 raft_consensus.cc:515] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:07.564246  6220 leader_election.cc:290] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:07.676192  6380 leader_election.cc:290] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:07.677958  6252 leader_election.cc:290] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:07.672677  6440 raft_consensus.cc:493] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:07.680472  6440 raft_consensus.cc:515] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:07.682835  6440 leader_election.cc:290] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:07.688917  4029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41312 (request call id 237) took 1486 ms. Trace:
W20260709 13:15:07.689913  4071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:07.670481  6433 raft_consensus.cc:2804] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:07.564913  6364 raft_consensus.cc:515] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:07.689320  4029 rpcz_store.cc:276] 0709 13:15:06.202196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.450769 (+248573us) service_pool.cc:224] Handling call
0709 13:15:06.451124 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:06.451528 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:06.456155 (+  4627us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:06.456811 (+   656us) log.cc:844] Serialized 26 byte log entry
0709 13:15:06.740883 (+284072us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:06.740991 (+   108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.741095 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:07.688686 (+947591us) raft_consensus.cc:1685] finished
0709 13:15:07.688711 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:07.688850 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26683,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":24631,"thread_start_us":283666,"threads_started":1,"wal-append.queue_time_us":896857}
I20260709 13:15:07.650796  6143 raft_consensus.cc:493] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
W20260709 13:15:07.693831  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 166320us
I20260709 13:15:07.645231  6295 raft_consensus.cc:515] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:07.692157  6336 consensus_meta.cc:287] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 1.191s	user 0.012s	sys 0.000s
I20260709 13:15:07.699898  3997 leader_election.cc:304] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:07.671096  6211 raft_consensus.cc:697] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:07.668188  6462 raft_consensus.cc:515] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:07.453512  6454 raft_consensus.cc:515] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:07.704521  3951 raft_consensus.cc:2393] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 5: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:07.705614  6450 raft_consensus.cc:2804] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:07.707015  6456 consensus_queue.cc:1048] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:15:07.709113  6450 raft_consensus.cc:493] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:07.709581  6450 raft_consensus.cc:3060] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:07.706076  6389 leader_election.cc:290] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:07.705335  3997 leader_election.cc:304] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:07.692601  6429 raft_consensus.cc:515] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:07.697513  6433 raft_consensus.cc:493] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:07.714285  3997 leader_election.cc:304] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:07.716444  3997 leader_election.cc:304] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:07.700671  6143 raft_consensus.cc:515] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:07.713253  6433 raft_consensus.cc:3060] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:07.725857  3997 leader_election.cc:304] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:07.715325  6389 raft_consensus.cc:2749] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:07.736676  6462 leader_election.cc:290] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:07.717272  6465 raft_consensus.cc:2804] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:07.737356  6465 raft_consensus.cc:493] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:07.719786  5822 leader_election.cc:290] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:07.733094  6474 raft_consensus.cc:2804] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:07.766511  6474 raft_consensus.cc:493] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:07.766920  6474 raft_consensus.cc:3060] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:07.764380  6465 raft_consensus.cc:3060] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:07.771613  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 45840.8us
I20260709 13:15:07.734987  6326 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:07.772786  3997 leader_election.cc:304] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:07.765489  6470 raft_consensus.cc:2749] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:07.779142  3997 leader_election.cc:304] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:07.783900  6446 raft_consensus.cc:2749] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:07.784833  6446 consensus_queue.cc:1059] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:07.785040  3997 leader_election.cc:304] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:07.785706  6446 raft_consensus.cc:3055] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:07.786057  6446 raft_consensus.cc:740] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:07.786242  3997 leader_election.cc:304] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:07.786886  6446 consensus_queue.cc:260] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:07.787838  6389 raft_consensus.cc:2749] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:07.788055  6446 raft_consensus.cc:3060] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:07.788793  6389 raft_consensus.cc:2804] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:07.789287  6389 raft_consensus.cc:493] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:07.789768  6389 raft_consensus.cc:3060] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:07.774596  6228 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.729s	user 0.029s	sys 0.030s
I20260709 13:15:07.778478  6456 raft_consensus.cc:2749] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:07.747684  6211 consensus_queue.cc:237] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:07.799957  6228 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.754s	user 0.029s	sys 0.030s
I20260709 13:15:07.798173  6421 leader_election.cc:290] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:07.817247  6429 leader_election.cc:290] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:07.824098  6295 leader_election.cc:290] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:07.804359  6447 leader_election.cc:290] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:07.829527  3997 leader_election.cc:304] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:07.830336  6447 raft_consensus.cc:2749] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:07.830482  6334 consensus_queue.cc:260] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:07.818445  6364 leader_election.cc:290] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:07.831645  3997 leader_election.cc:304] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:07.832026  6334 raft_consensus.cc:3060] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:07.832824  6447 raft_consensus.cc:2749] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:07.802351  6470 consensus_queue.cc:1048] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:15:07.835702  6447 raft_consensus.cc:493] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:07.836225  6447 raft_consensus.cc:515] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:07.838819  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:07.841977  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:07.842043  4028 raft_consensus.cc:1240] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:07.842252  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:07.843703  4029 raft_consensus.cc:1275] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:07.844324  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:07.845177  4028 raft_consensus.cc:2468] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 5.
I20260709 13:15:07.846895  4030 raft_consensus.cc:1275] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:07.849917  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:07.850628  4034 raft_consensus.cc:3060] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:07.850013  4033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38304 (request call id 1833) took 1926 ms. Trace:
I20260709 13:15:07.851337  4033 rpcz_store.cc:276] 0709 13:15:05.923522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.979194 (+ 55672us) service_pool.cc:224] Handling call
0709 13:15:07.849849 (+1870655us) spinlock_profiling.cc:243] Waited 50.4 ms on lock 0x7b54001d9f54. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:07.849956 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":115878784}
I20260709 13:15:07.861014  4032 raft_consensus.cc:2410] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:15:07.864223  6389 raft_consensus.cc:515] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:07.865002  6143 leader_election.cc:290] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:07.866901  6389 leader_election.cc:290] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:07.870570  6288 leader_election.cc:290] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:07.875496  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:07.880049  4034 raft_consensus.cc:2468] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 5.
I20260709 13:15:07.884972  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:07.885860  4028 raft_consensus.cc:2468] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 3.
I20260709 13:15:07.889972  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:07.873559  6388 raft_consensus.cc:493] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:07.874531  6350 raft_consensus.cc:3055] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:07.895452  4033 raft_consensus.cc:3060] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:07.890708  6315 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.905s	user 0.015s	sys 0.012s
I20260709 13:15:07.882742  6447 leader_election.cc:290] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:07.903290  4033 raft_consensus.cc:1275] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:07.906900  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:07.893221  6350 raft_consensus.cc:740] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:07.908541  4033 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 6.
I20260709 13:15:07.911396  6350 consensus_queue.cc:260] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:07.912451  6350 raft_consensus.cc:3060] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:07.908242  6450 raft_consensus.cc:515] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:07.921833  6450 leader_election.cc:290] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:07.904428  6315 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.919s	user 0.016s	sys 0.012s
I20260709 13:15:07.925066  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:07.926044  6465 raft_consensus.cc:515] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:07.932440  4033 raft_consensus.cc:2468] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 6.
I20260709 13:15:07.896888  6388 raft_consensus.cc:515] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:07.935201  6465 leader_election.cc:290] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:07.935202  6388 leader_election.cc:290] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:07.950210  6227 leader_election.cc:290] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:15:07.954747  3951 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38612 (request call id 1023) took 1439 ms (client timeout 1834 ms). Trace:
W20260709 13:15:07.955201  3951 rpcz_store.cc:269] 0709 13:15:06.515018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.515150 (+   132us) service_pool.cc:224] Handling call
0709 13:15:07.954544 (+1439394us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54000f2dd4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:07.954674 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2717847424}
W20260709 13:15:07.990991  6481 log.cc:927] Time spent T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:15:07.991940  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:07.997527  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:07.962389  6397 raft_consensus.cc:493] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:07.996282  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:08.005853  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:07.927043  6474 raft_consensus.cc:515] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:08.008015  6397 raft_consensus.cc:515] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:07.964269  6433 raft_consensus.cc:515] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:08.009389  6474 leader_election.cc:290] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:08.012955  6336 raft_consensus.cc:493] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.014163  6397 leader_election.cc:290] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:08.017134  6451 raft_consensus.cc:3055] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:08.016043  6336 raft_consensus.cc:515] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:08.018000  6451 raft_consensus.cc:740] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:08.020040  6433 leader_election.cc:290] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:08.020150  6451 consensus_queue.cc:260] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:08.021695  6451 raft_consensus.cc:3060] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:08.022846  6454 leader_election.cc:290] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:08.024901  6432 raft_consensus.cc:993] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc: : Instructing follower 6f5b5e4ed72944ecbda200012d141dc2 to start an election
I20260709 13:15:08.025355  6357 raft_consensus.cc:1081] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Signalling peer 6f5b5e4ed72944ecbda200012d141dc2 to start an election
W20260709 13:15:08.030025  6467 log.cc:927] Time spent T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.330s	user 0.004s	sys 0.000s
W20260709 13:15:08.030804  6459 log.cc:927] Time spent T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.615s	user 0.000s	sys 0.002s
W20260709 13:15:08.030997  6482 log.cc:927] Time spent T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:15:08.073298  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:08.076107  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:08.077618  4027 raft_consensus.cc:2393] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 5: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:08.080163  4030 raft_consensus.cc:1240] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:08.089732  4031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41312 (request call id 233) took 1911 ms. Trace:
I20260709 13:15:08.092631  4107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45332 (request call id 1597) took 1980 ms. Trace:
I20260709 13:15:08.093710  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:08.094834  4026 raft_consensus.cc:3060] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:08.099960  3999 leader_election.cc:304] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:08.102672  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:08.102927  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:08.104235  4032 raft_consensus.cc:2393] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 5: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
W20260709 13:15:08.102720  4674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:08.105933  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:08.109499  4029 raft_consensus.cc:1275] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:15:08.113137  3950 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35354 (request call id 192) took 3475 ms (client timeout 1592 ms). Trace:
W20260709 13:15:08.113703  3950 rpcz_store.cc:269] 0709 13:15:04.637443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:04.641252 (+  3809us) service_pool.cc:224] Handling call
0709 13:15:08.112578 (+3471326us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b5400320ad4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:08.112792 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2304860416}
I20260709 13:15:08.115315  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:08.116585  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:08.118708  4708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:15:08.120399  3997 leader_election.cc:336] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.592s (SENT)
I20260709 13:15:08.120814  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:08.123206  3997 leader_election.cc:400] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 election: Vote denied by peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843) with higher term. Message: Invalid argument: T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 5. Current term is 6.
I20260709 13:15:08.124317  4034 raft_consensus.cc:1240] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:08.124333  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:08.126564  2843 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:08.125886  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:08.132464  3997 leader_election.cc:403] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:15:08.133517  6227 consensus_queue.cc:1048] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:08.136318  6431 raft_consensus.cc:493] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:08.133620  6450 raft_consensus.cc:493] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:08.090468  4031 rpcz_store.cc:276] 0709 13:15:06.178051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.373971 (+195920us) service_pool.cc:224] Handling call
0709 13:15:06.374408 (+   437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:06.549709 (+175301us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:06.549749 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:06.549799 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:06.549841 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:08.089034 (+1539193us) spinlock_profiling.cc:243] Waited 175 ms on lock 0x7b54000ff5d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:08.089121 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:08.089452 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":402550656}
I20260709 13:15:08.147842  6427 raft_consensus.cc:493] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:08.148061  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:08.131040  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:08.150002  6474 consensus_queue.cc:1048] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:08.150342  6450 raft_consensus.cc:515] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:08.151644  6427 raft_consensus.cc:515] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:08.151659  6465 raft_consensus.cc:3060] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:08.151171  6474 consensus_queue.cc:1243] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer d709ee666b774ec29aa732e508219938 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:15:08.156627  3857 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52104 (request call id 202) took 12005 ms (client timeout 15000 ms). Trace:
I20260709 13:15:08.157079  6427 leader_election.cc:290] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:08.143419  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:08.161927  6450 leader_election.cc:290] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:08.165966  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:08.166607  6166 leader_election.cc:290] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:08.174539  6466 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.143050  6431 raft_consensus.cc:515] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:08.175520  6466 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:08.176324  3948 tablet_service.cc:1558] Processing DeleteTablet for tablet 97cf7690694c4d5988258ec1b641a2e6 with delete_type TABLET_DATA_TOMBSTONED (TS f1c75790cedf4f52a3463a255c7da059 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:38604
I20260709 13:15:08.183832  6466 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:08.178444  6357 raft_consensus.cc:493] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:08.184986  6227 raft_consensus.cc:2749] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843) with higher term. Message: Invalid argument: T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 5. Current term is 6.
I20260709 13:15:08.179242  6407 raft_consensus.cc:493] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
W20260709 13:15:08.185387  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 62460.3us
I20260709 13:15:08.186353  6407 raft_consensus.cc:515] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:08.188098  6307 raft_consensus.cc:493] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:08.188930  6307 raft_consensus.cc:515] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:08.189544  6407 leader_election.cc:290] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:08.179947  6376 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:08.191449  6307 leader_election.cc:290] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:08.193536  6324 raft_consensus.cc:493] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.194145  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:08.194361  6324 raft_consensus.cc:515] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:08.195097  4100 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 6.
I20260709 13:15:08.196378  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:08.197119  4105 raft_consensus.cc:2468] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 5.
I20260709 13:15:08.197479  6324 leader_election.cc:290] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:08.093168  4107 rpcz_store.cc:276] 0709 13:15:06.111665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.657388 (+545723us) service_pool.cc:224] Handling call
0709 13:15:06.657786 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:06.658153 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:06.658184 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:06.658740 (+   556us) log.cc:844] Serialized 26 byte log entry
0709 13:15:06.736222 (+ 77482us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:06.736322 (+   100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.736488 (+   166us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:08.030123 (+1293635us) spinlock_profiling.cc:243] Waited 1.41 ms on lock 0x7b4400022b4c. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f15224a7c85 00007f15224a86a2 00007f152521a1db 00007f1525215aaf 00007f152520986e 00007f1525208bb6 00007f15252087d8 00007f1525212221 00007f15252121d9 00007f1525212169
0709 13:15:08.091726 (+ 61603us) raft_consensus.cc:1685] finished
0709 13:15:08.091788 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:08.092298 (+   510us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25991,"raft.queue_time_us":1711,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":2062,"spinlock_wait_cycles":3246976,"thread_start_us":76799,"threads_started":1,"wal-append.queue_time_us":694318}
I20260709 13:15:08.180190  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:08.200345  6336 leader_election.cc:290] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:08.191342  6376 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:08.184994  6357 raft_consensus.cc:515] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:08.207010  6220 consensus_queue.cc:1059] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:08.208196  6220 raft_consensus.cc:493] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:08.208714  6350 raft_consensus.cc:3055] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:08.209256  6350 raft_consensus.cc:740] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:08.209040  6220 raft_consensus.cc:515] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:08.187162  6034 leader_election.cc:290] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:08.210763  6350 consensus_queue.cc:260] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:08.212512  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:08.213600  4709 raft_consensus.cc:2468] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 5.
I20260709 13:15:08.213886  6350 raft_consensus.cc:3060] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:08.179085  6431 leader_election.cc:290] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:08.180477  6331 raft_consensus.cc:493] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:08.216357  6331 raft_consensus.cc:515] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:08.169018  4032 raft_consensus.cc:1240] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:08.224733  6220 leader_election.cc:290] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:15:08.220196  3999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 75369.9us
I20260709 13:15:08.192056  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:08.237717  4025 raft_consensus.cc:3060] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:08.242736  4707 pending_rounds.cc:85] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938: Aborting all ops after (but not including) 5
I20260709 13:15:08.243165  4707 pending_rounds.cc:107] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:15:08.243449  4707 raft_consensus.cc:2889] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:08.237762  6261 raft_consensus.cc:493] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.244760  6261 raft_consensus.cc:515] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:08.246853  6376 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:08.247393  6261 leader_election.cc:290] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:08.248473  6331 leader_election.cc:290] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:08.206981  6357 leader_election.cc:290] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:08.249774  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:08.251374  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:08.252501  4107 raft_consensus.cc:2468] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 4.
I20260709 13:15:08.254673  4025 raft_consensus.cc:2468] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
I20260709 13:15:08.260113  4672 leader_election.cc:304] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
W20260709 13:15:08.263667  3997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:08.264714  3997 leader_election.cc:304] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:08.266355  6431 raft_consensus.cc:2749] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:08.267796  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:15:08.271816  3924 connection.cc:256] RPC call timeout handler was delayed by -1.0212335159999384s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1723s for a response
I20260709 13:15:08.273548  6411 raft_consensus.cc:493] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.263092  4672 leader_election.cc:304] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:08.273810  5962 raft_consensus.cc:493] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.282539  6324 raft_consensus.cc:2804] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:08.283923  6324 raft_consensus.cc:493] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:08.284329  6324 raft_consensus.cc:3060] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:08.286823  6465 raft_consensus.cc:2749] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:08.288635  3955 raft_consensus.cc:1240] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:08.289330  4672 leader_election.cc:304] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:08.292142  6411 raft_consensus.cc:515] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:08.294878  3997 leader_election.cc:304] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:08.295969  6465 raft_consensus.cc:3060] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:08.302352  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:08.302665  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:08.303263  4104 raft_consensus.cc:2468] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 6.
I20260709 13:15:08.304040  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:08.304240  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:08.304538  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:08.157284  3857 rpcz_store.cc:269] 0709 13:14:56.150689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:56.150895 (+   206us) service_pool.cc:224] Handling call
0709 13:15:08.156256 (+12005361us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:00.598609 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:00.762512 (+163903us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:00.762586 (+    74us) write_op.cc:435] Acquired schema lock
0709 13:15:00.762623 (+    37us) tablet.cc:662] Decoding operations
0709 13:15:00.885435 (+122812us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:00.929025 (+ 43590us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:00.932420 (+  3395us) tablet.cc:685] Acquiring locks for 23 operations
0709 13:15:01.244366 (+311946us) tablet.cc:701] Row locks acquired
0709 13:15:01.244422 (+    56us) write_op.cc:260] PREPARE: finished
0709 13:15:01.244644 (+   222us) write_op.cc:270] Start()
0709 13:15:01.495930 (+251286us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b54004287a8. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152ba2a9e1 00007f152ba2964c 00007f15290b9624 00007f15290a4286 00007f15290a3d58 00007f15290a89f1 00007f15290a89a9 00007f15290a8939 00007f15290a8901 00007f15290a7b2d 000000000038f354
0709 13:15:01.496222 (+   292us) write_op.cc:276] Timestamp: P: 1783602901244564 usec, L: 0
0709 13:15:01.496251 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:15:01.516941 (+ 20690us) log.cc:844] Serialized 9086 byte log entry
0709 13:15:02.451619 (+934678us) op_driver.cc:464] REPLICATION: finished
0709 13:15:02.684268 (+232649us) write_op.cc:301] APPLY: starting
0709 13:15:02.684394 (+   126us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:02.684946 (+   552us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:02.684996 (+    50us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:02.854722 (+169726us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:02.855198 (+   476us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=23
0709 13:15:02.855246 (+    48us) write_op.cc:312] APPLY: finished
0709 13:15:02.895744 (+ 40498us) log.cc:844] Serialized 158 byte log entry
0709 13:15:02.919865 (+ 24121us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:02.953979 (+ 34114us) write_op.cc:454] Released schema lock
0709 13:15:02.981421 (+ 27442us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:03.066572 (+ 85151us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:03.069386 (+  2814us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":82,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":232195,"apply.run_cpu_time_us":8647,"apply.run_wall_time_us":366724,"num_ops":23,"prepare.queue_time_us":169810,"prepare.run_cpu_time_us":28287,"prepare.run_wall_time_us":1178787,"raft.queue_time_us":134142,"raft.run_cpu_time_us":21898,"raft.run_wall_time_us":144669,"replication_time_us":946747,"spinlock_wait_cycles":29257856,"thread_start_us":351603,"threads_started":4,"wal-append.queue_time_us":282767,"wal-append.run_cpu_time_us":12942,"wal-append.run_wall_time_us":2102962}]]}
I20260709 13:15:08.305047  4099 raft_consensus.cc:2393] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 5: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:08.305207  4102 raft_consensus.cc:2468] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 5.
I20260709 13:15:08.295061  6411 leader_election.cc:290] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:08.310302  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:08.311457  4103 raft_consensus.cc:3060] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:08.312203  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:08.313148  4027 raft_consensus.cc:2393] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 5: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:08.301512  4672 leader_election.cc:304] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:08.331097  4026 raft_consensus.cc:2468] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
I20260709 13:15:08.333081  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:08.333425  3950 raft_consensus.cc:1240] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:15:08.334143  3955 raft_consensus.cc:2468] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 5.
I20260709 13:15:08.333112  3951 raft_consensus.cc:1240] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 5. Current term is 6. Ops: []
W20260709 13:15:08.339286  3925 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.198.194:46115 timed out after 2.632s (SENT) [suppressed 18 similar messages]
I20260709 13:15:08.277854  5962 raft_consensus.cc:515] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:08.345706  6324 raft_consensus.cc:515] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:08.346627  5962 leader_election.cc:290] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:08.350755  4071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:08.351352  4071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:08.361886  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:08.358273  4073 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:08.359848  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
W20260709 13:15:08.373063  4073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 138803us
I20260709 13:15:08.355337  6357 raft_consensus.cc:493] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.387684  6453 raft_consensus.cc:2749] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:08.380961  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:15:08.389890  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 88511.7us
I20260709 13:15:08.389273  3951 raft_consensus.cc:2468] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 5.
I20260709 13:15:08.381285  6376 raft_consensus.cc:2804] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:08.388504  6357 raft_consensus.cc:515] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:08.406311  6357 leader_election.cc:290] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:08.408018  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:08.411072  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:08.393505  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:08.416723  4103 raft_consensus.cc:2468] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 6.
I20260709 13:15:08.421140  6492 tablet_replica.cc:333] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:15:08.421173  6315 raft_consensus.cc:2749] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:08.423499  3957 raft_consensus.cc:2393] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 6: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:08.396144  6324 leader_election.cc:290] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:08.398522  6376 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:08.431262  4704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:08.431584  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:08.439863  4105 raft_consensus.cc:3060] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:08.433288  6376 raft_consensus.cc:3060] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:08.445858  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:08.443792  6451 raft_consensus.cc:493] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:08.444408  4672 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:08.444656  4101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45332 (request call id 1596) took 2333 ms. Trace:
I20260709 13:15:08.445367  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
W20260709 13:15:08.449800  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 110694us
I20260709 13:15:08.451594  4704 raft_consensus.cc:1275] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:08.462098  3955 raft_consensus.cc:1240] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:08.463935  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:08.455706  6261 raft_consensus.cc:2804] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:08.471586  4103 raft_consensus.cc:3060] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:08.449833  4101 rpcz_store.cc:276] 0709 13:15:06.110659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.337880 (+227221us) service_pool.cc:224] Handling call
0709 13:15:06.338180 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:06.379586 (+ 41406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:06.379622 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:06.380039 (+   417us) log.cc:844] Serialized 26 byte log entry
0709 13:15:08.015409 (+1635370us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b480009c0d8. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152a597aa1 00007f152a58eb37 00007f152a58e9ca 00007f152a68626f 00007f152a685f37 00007f152a69a55c 00007f152a69a508 00007f152a69a488 00007f152a69a443 00007f152a6996ec 00007f15295c3a96
0709 13:15:08.167963 (+152554us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b180047a280. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f1522563e07 00007f152b3beab9 00007f152258069b 00007f152257e93f 00007f1522580c02 00007f152520820b 00007f152520dd23 00007f152520e0d1 00007f1525629a0f
0709 13:15:08.395630 (+227667us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:08.395711 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:08.395831 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:08.442478 (+ 46647us) raft_consensus.cc:1685] finished
0709 13:15:08.442498 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:08.444433 (+  1935us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40996,"raft.queue_time_us":42088,"raft.run_cpu_time_us":22995,"raft.run_wall_time_us":1612258,"spinlock_wait_cycles":61098496,"thread_start_us":170456,"threads_started":1,"wal-append.queue_time_us":2038910}
I20260709 13:15:08.475246  6348 raft_consensus.cc:493] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.475507  6437 raft_consensus.cc:2804] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:08.476297  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:08.475983  6348 raft_consensus.cc:515] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:08.476013  6331 consensus_queue.cc:1048] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:15:08.478703  3922 connection.cc:256] RPC call timeout handler was delayed by -1.4694797120000658s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22240000000000004s for a response
I20260709 13:15:08.478899  6348 leader_election.cc:290] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:08.476001  6437 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:08.480048  6437 raft_consensus.cc:3060] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:08.482561  6307 raft_consensus.cc:493] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.483518  6411 raft_consensus.cc:493] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:08.484649  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:08.485468  3951 raft_consensus.cc:2468] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 5.
I20260709 13:15:08.485773  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:08.483217  6307 raft_consensus.cc:515] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:08.484398  6411 raft_consensus.cc:515] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:08.487353  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:08.490686  4672 leader_election.cc:304] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:08.492962  4031 raft_consensus.cc:1240] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:08.493300  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:08.495071  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:08.496362  3855 catalog_manager.cc:5697] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:08.498319  3855 catalog_manager.cc:5697] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 3 to 4, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 4 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:08.483909  6296 raft_consensus.cc:493] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.509774  4105 raft_consensus.cc:2468] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 6.
I20260709 13:15:08.468245  6451 raft_consensus.cc:515] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:08.512882  5757 raft_consensus.cc:2804] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:08.513411  5757 raft_consensus.cc:493] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:08.512251  3855 catalog_manager.cc:5697] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 1 to 2, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 2 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:08.500188  6465 raft_consensus.cc:2749] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:08.513878  5757 raft_consensus.cc:3060] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:08.517534  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:08.521062  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:08.523741  6261 raft_consensus.cc:493] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:08.524338  6261 raft_consensus.cc:3060] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:08.527642  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:08.527947  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:08.529059  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:08.529436  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:08.533550  3955 raft_consensus.cc:3060] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:08.529349  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:08.545742  3954 raft_consensus.cc:2393] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 5: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:08.545938  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:08.550112  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:08.542820  6296 raft_consensus.cc:515] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:08.561566  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:08.567942  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:08.562772  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:08.569698  3956 raft_consensus.cc:3060] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:08.570245  4105 raft_consensus.cc:1275] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:08.584342  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:08.586519  4031 raft_consensus.cc:2393] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 7: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:08.548064  3855 catalog_manager.cc:5697] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 1 to 2, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 2 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:08.603978  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:08.611696  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:08.615526  4103 raft_consensus.cc:2468] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 6.
I20260709 13:15:08.617743  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:08.562330  6447 raft_consensus.cc:493] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:08.622496  6324 consensus_queue.cc:1048] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:08.631688  4099 raft_consensus.cc:2393] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 5: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:08.632920  4026 raft_consensus.cc:3060] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:08.634500  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:08.635381  3958 raft_consensus.cc:2393] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 7: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:08.637869  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:08.653069  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:08.654132  4027 raft_consensus.cc:3060] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:08.656450  5954 raft_consensus.cc:493] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.657235  5954 raft_consensus.cc:515] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:08.670568  3953 raft_consensus.cc:2393] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 5: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:08.640115  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:08.664134  6465 raft_consensus.cc:493] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:08.682005  4031 raft_consensus.cc:2393] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 6: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:08.679579  6465 raft_consensus.cc:515] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:08.690215  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:08.691445  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:08.692057  3954 raft_consensus.cc:2468] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 5.
I20260709 13:15:08.692447  6465 leader_election.cc:290] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:08.695827  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:08.701756  3997 leader_election.cc:304] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
W20260709 13:15:08.703595  6495 log.cc:927] Time spent T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 13:15:08.717226  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 228323us
I20260709 13:15:08.717530  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:08.728272  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:08.724119  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:08.725301  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:08.706605  3855 catalog_manager.cc:5697] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 4 to 5, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to d709ee666b774ec29aa732e508219938 (127.2.198.196). New cstate: current_term: 5 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:15:08.731889  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:08.737732  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:08.739142  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:08.734691  4104 raft_consensus.cc:3060] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:08.739423  6451 leader_election.cc:290] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:08.745743  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:08.748477  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:08.749554  4103 raft_consensus.cc:2393] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 5: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:08.745412  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:08.722297  6465 raft_consensus.cc:2749] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:08.756712  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:08.761162  3855 catalog_manager.cc:5697] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 2 to 3, leader changed from 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) to d709ee666b774ec29aa732e508219938 (127.2.198.196). New cstate: current_term: 3 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:15:08.771782  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:08.720149  6447 raft_consensus.cc:515] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:08.754168  6411 leader_election.cc:290] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:08.778816  3953 raft_consensus.cc:1275] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:08.781288  6447 leader_election.cc:290] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:08.783596  6307 leader_election.cc:290] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:08.785826  4103 raft_consensus.cc:1275] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:08.787125  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:08.788280  4106 raft_consensus.cc:1275] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:15:08.788589  6496 log.cc:927] Time spent T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 13:15:08.792675  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:08.799419  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:08.804911  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:08.810387  4025 raft_consensus.cc:2468] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 5.
I20260709 13:15:08.768781  6296 leader_election.cc:290] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:08.831123  4704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:08.830158  3955 raft_consensus.cc:2468] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 5.
I20260709 13:15:08.833397  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:08.832680  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:08.842584  4107 raft_consensus.cc:1240] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:15:08.843667  4704 raft_consensus.cc:2468] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 3.
I20260709 13:15:08.844113  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:08.845081  3999 leader_election.cc:304] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:08.845939  6447 raft_consensus.cc:2804] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:08.846302  6447 raft_consensus.cc:493] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:08.846616  6447 raft_consensus.cc:3060] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:08.848093  3956 raft_consensus.cc:2468] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 6.
I20260709 13:15:08.849596  4026 raft_consensus.cc:2468] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
I20260709 13:15:08.855038  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
W20260709 13:15:08.857084  4071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:08.860908  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:08.861645  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:08.862298  4030 raft_consensus.cc:2468] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 3.
I20260709 13:15:08.839905  3855 catalog_manager.cc:5697] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 2 to 3, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 3 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:08.833837  5954 leader_election.cc:290] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:08.878692  4104 raft_consensus.cc:2468] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 6.
I20260709 13:15:08.877982  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:08.888345  4026 raft_consensus.cc:1275] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:15:08.889894  4704 raft_consensus.cc:1240] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:08.886392  6350 raft_consensus.cc:493] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:08.895969  4031 raft_consensus.cc:1275] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:15:08.897365  3956 raft_consensus.cc:1240] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:08.905337  4031 raft_consensus.cc:1240] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:08.891322  6348 raft_consensus.cc:493] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:08.916071  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 147009us
I20260709 13:15:08.897357  6350 raft_consensus.cc:515] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:08.918277  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 229854us
I20260709 13:15:08.920914  3951 raft_consensus.cc:1240] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:08.911163  6296 raft_consensus.cc:493] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:08.922009  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:08.925992  6437 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:08.926903  6296 raft_consensus.cc:515] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:08.930830  4031 raft_consensus.cc:2393] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 6: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:08.932866  3922 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
W20260709 13:15:08.940893  4071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:08.942916  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:08.939126  3855 catalog_manager.cc:5697] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 1 to 4, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 4 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:08.914374  5757 raft_consensus.cc:515] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:08.945024  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:08.945544  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:08.945968  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:08.947875  4034 raft_consensus.cc:2468] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
W20260709 13:15:08.954520  6500 log.cc:927] Time spent T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.164s	user 0.003s	sys 0.001s
I20260709 13:15:08.954713  6296 leader_election.cc:290] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:08.956341  6307 raft_consensus.cc:2749] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:08.952265  4031 raft_consensus.cc:2468] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 4.
I20260709 13:15:08.962664  3956 raft_consensus.cc:2410] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:15:08.927978  6348 raft_consensus.cc:515] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:08.970760  4027 raft_consensus.cc:2468] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 4.
I20260709 13:15:08.973182  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:08.974704  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:08.975337  4104 raft_consensus.cc:2468] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 6.
I20260709 13:15:08.977588  5757 leader_election.cc:290] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:08.977747  6507 raft_consensus.cc:493] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:08.978447  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 47186.1us
I20260709 13:15:08.973344  3855 catalog_manager.cc:5697] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 2 to 3, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 3 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:08.982268  3997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:08.984762  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:08.978374  6507 raft_consensus.cc:515] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:08.997913  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:09.000831  3997 leader_election.cc:304] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:08.979269  6261 raft_consensus.cc:515] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:09.019408  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:09.027034  6465 raft_consensus.cc:2804] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:09.027699  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:09.028825  3952 raft_consensus.cc:2393] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 6: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:09.006325  6350 leader_election.cc:290] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:09.006971  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:09.007763  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:09.007882  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:09.027802  6465 raft_consensus.cc:493] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:09.035756  4707 raft_consensus.cc:1240] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:09.036020  6465 raft_consensus.cc:3060] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:09.009011  3959 raft_consensus.cc:1240] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:09.025215  3855 catalog_manager.cc:5697] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 1 to 2, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 2 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:09.009111  6348 leader_election.cc:290] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:09.038578  6348 consensus_queue.cc:1059] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:09.009410  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:09.039867  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:09.040298  3958 raft_consensus.cc:2410] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:15:09.035998  3950 raft_consensus.cc:2468] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 5.
I20260709 13:15:09.008654  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:09.041821  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:09.042482  3958 raft_consensus.cc:2376] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 5. Re-sending same reply.
I20260709 13:15:09.044850  3922 leader_election.cc:304] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:09.047015  3922 leader_election.cc:304] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:09.047979  6307 raft_consensus.cc:2749] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:09.048547  6492 raft_consensus.cc:2243] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:09.049675  6492 raft_consensus.cc:2272] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:09.000254  6507 leader_election.cc:290] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:09.058483  6437 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:09.064234  3922 leader_election.cc:304] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:09.053617  6447 raft_consensus.cc:515] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:09.065223  6307 raft_consensus.cc:2764] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:15:09.066366  4029 raft_consensus.cc:1240] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:09.067107  6447 leader_election.cc:290] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:09.073020  6261 leader_election.cc:290] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:15:09.062817  6376 consensus_meta.cc:287] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.617s	user 0.004s	sys 0.007s
I20260709 13:15:09.079764  3997 leader_election.cc:304] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:09.042611  6350 raft_consensus.cc:3055] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:09.054358  6492 ts_tablet_manager.cc:1916] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:09.086562  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:09.080739  6307 raft_consensus.cc:2749] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:09.084702  6350 raft_consensus.cc:740] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:09.107837  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:09.109591  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:15:09.110353  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 66865.2us
I20260709 13:15:09.084537  6376 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:09.113399  4073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 86464.9us
I20260709 13:15:09.107218  6447 raft_consensus.cc:2749] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:09.092680  6465 raft_consensus.cc:515] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:09.117015  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 52961us
I20260709 13:15:09.118120  6515 raft_consensus.cc:493] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
W20260709 13:15:09.118455  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 109983us
I20260709 13:15:09.118739  6515 raft_consensus.cc:515] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:09.121017  6515 leader_election.cc:290] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:09.122691  3956 raft_consensus.cc:1240] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:09.123281  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:09.125214  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:09.125857  4100 raft_consensus.cc:3060] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:15:09.133009  6447 consensus_queue.cc:1059] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:09.133651  3956 raft_consensus.cc:1240] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:09.133993  6447 raft_consensus.cc:3055] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:09.135083  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:09.134423  6447 raft_consensus.cc:740] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:09.136740  6447 consensus_queue.cc:260] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:09.137992  6447 raft_consensus.cc:3060] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:09.134387  6307 raft_consensus.cc:2955] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 6 LEADER]: Committing config change with OpId 5.6: config changed from index 2 to 6, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:15:09.139649  5757 consensus_queue.cc:1048] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:09.141952  4104 raft_consensus.cc:2393] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 in current term 6: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:09.143857  3924 leader_election.cc:304] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:09.147406  4675 leader_election.cc:304] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:09.115885  6350 consensus_queue.cc:260] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:09.148635  6261 raft_consensus.cc:2804] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:09.149029  6465 leader_election.cc:290] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:09.149114  6261 raft_consensus.cc:493] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:09.149690  6261 raft_consensus.cc:3060] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:09.148906  6350 raft_consensus.cc:3060] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:09.153170  3997 leader_election.cc:304] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:09.153630  6296 consensus_queue.cc:1048] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:15:09.155820  3997 leader_election.cc:304] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:09.156755  6507 raft_consensus.cc:2804] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:09.157193  6507 raft_consensus.cc:493] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:09.157589  6507 raft_consensus.cc:3060] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:09.158171  3924 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:09.159808  6411 raft_consensus.cc:2804] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:09.160239  6411 raft_consensus.cc:493] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:09.160723  6411 raft_consensus.cc:3060] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:09.160661  3924 leader_election.cc:304] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:09.160383  4675 leader_election.cc:304] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:09.161852  5962 raft_consensus.cc:3060] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:09.162578  6437 raft_consensus.cc:2804] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:09.163045  6437 raft_consensus.cc:493] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:09.163404  6437 raft_consensus.cc:3060] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:09.163733  6296 consensus_queue.cc:1059] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:09.165046  6166 raft_consensus.cc:2749] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:09.168227  6376 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:09.172708  6437 raft_consensus.cc:515] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:09.174723  6507 raft_consensus.cc:515] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:09.176331  6261 raft_consensus.cc:515] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:09.177564  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:09.185412  4707 raft_consensus.cc:3060] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:09.178556  6411 raft_consensus.cc:515] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:09.193809  5962 raft_consensus.cc:2749] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:09.197176  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:09.201366  6437 leader_election.cc:290] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:09.207175  6411 leader_election.cc:290] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:09.183694  6465 raft_consensus.cc:2749] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:09.212121  6451 raft_consensus.cc:493] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.226545  6451 raft_consensus.cc:515] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:09.228700  6451 leader_election.cc:290] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:09.214794  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:09.215325  6431 raft_consensus.cc:493] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:09.230185  4709 raft_consensus.cc:2393] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 6: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
I20260709 13:15:09.230239  6431 raft_consensus.cc:515] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:09.232528  4071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:09.232779  6431 leader_election.cc:290] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:09.217891  4027 raft_consensus.cc:1240] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:09.220754  6520 consensus_queue.cc:1048] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:09.235508  6520 consensus_queue.cc:1059] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:09.221441  4074 leader_election.cc:304] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:09.236837  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:09.237774  4027 raft_consensus.cc:2393] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 6: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
W20260709 13:15:09.237816  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 133588us
I20260709 13:15:09.237910  6515 raft_consensus.cc:2749] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:09.238709  6376 raft_consensus.cc:493] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:09.239437  6376 raft_consensus.cc:515] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:09.240161  6515 consensus_queue.cc:1059] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:09.241415  6357 raft_consensus.cc:3055] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:09.241796  6357 raft_consensus.cc:740] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:09.242220  6432 consensus_queue.cc:1048] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:09.242754  6357 consensus_queue.cc:260] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:09.244185  6357 raft_consensus.cc:3060] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:09.244663  4074 leader_election.cc:304] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:09.246949  6432 raft_consensus.cc:2804] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:09.247386  6432 raft_consensus.cc:493] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:09.239938  6507 leader_election.cc:290] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:09.248052  6515 consensus_queue.cc:1048] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:09.247819  6432 raft_consensus.cc:3060] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:09.249197  6376 leader_election.cc:290] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:09.249375  4100 raft_consensus.cc:2468] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 6.
I20260709 13:15:09.251371  4672 leader_election.cc:304] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:09.239873  3997 leader_election.cc:304] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:09.211732  4707 raft_consensus.cc:2468] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 4.
I20260709 13:15:09.252470  6034 raft_consensus.cc:2804] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:09.256062  4074 leader_election.cc:304] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:09.256907  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:09.259996  3999 leader_election.cc:304] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
W20260709 13:15:09.270171  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 44885us
I20260709 13:15:09.271766  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:09.272712  4031 raft_consensus.cc:2410] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:15:09.255290  6296 consensus_queue.cc:1243] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer d709ee666b774ec29aa732e508219938 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:15:09.275689  4034 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8"
dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:38290
I20260709 13:15:09.286239  4034 raft_consensus.cc:493] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:09.286713  4034 raft_consensus.cc:3060] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:09.287739  4074 leader_election.cc:304] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:09.289444  6350 raft_consensus.cc:2749] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:09.276573  4709 raft_consensus.cc:2393] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 6: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
I20260709 13:15:09.292150  6348 consensus_queue.cc:1059] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:09.276962  4026 raft_consensus.cc:1240] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 4. Current term is 5. Ops: []
W20260709 13:15:09.277417  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 59171.9us
I20260709 13:15:09.293321  6350 raft_consensus.cc:3055] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:09.293736  6350 raft_consensus.cc:740] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:09.277813  3997 leader_election.cc:304] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:09.296887  6465 raft_consensus.cc:2804] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:09.273384  6034 raft_consensus.cc:697] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 6 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:09.278538  4027 raft_consensus.cc:1240] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 4. Current term is 5. Ops: []
W20260709 13:15:09.274260  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 61545.4us
I20260709 13:15:09.279116  6166 consensus_queue.cc:1059] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:09.268908  6507 raft_consensus.cc:2804] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:09.273027  6431 raft_consensus.cc:2804] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:09.316329  3997 leader_election.cc:304] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:09.284050  6492 ts_tablet_manager.cc:1929] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:15:09.285385  5954 raft_consensus.cc:2804] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:09.294749  3925 leader_election.cc:304] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:09.317313  6492 log.cc:1199] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059: Deleting WAL directory at /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/ts-0-root/wals/97cf7690694c4d5988258ec1b641a2e6
I20260709 13:15:09.317566  5954 raft_consensus.cc:697] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:09.319159  6492 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38604 (request call id 78) took 1149 ms. Trace:
I20260709 13:15:09.318998  5954 consensus_queue.cc:237] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:09.319832  6492 rpcz_store.cc:276] 0709 13:15:08.173646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:08.175843 (+  2197us) service_pool.cc:224] Handling call
0709 13:15:08.413790 (+237947us) ts_tablet_manager.cc:1151] Deleting tablet 97cf7690694c4d5988258ec1b641a2e6
0709 13:15:08.420369 (+  6579us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:15:09.257186 (+836817us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:09.283896 (+ 26710us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:09.319032 (+ 35136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":625425,"tablet-delete.queue_time_us":226112,"thread_start_us":144305,"threads_started":1}
W20260709 13:15:09.321688  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:09.302018  4034 raft_consensus.cc:515] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:09.323220  3841 catalog_manager.cc:5028] TS f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): tablet 97cf7690694c4d5988258ec1b641a2e6 (table test-workload [id=8a2760e8528448a780fea6ccf25816cb]) successfully deleted
I20260709 13:15:09.323755  6527 consensus_queue.cc:1059] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:09.324528  4034 leader_election.cc:290] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:09.324792  6527 raft_consensus.cc:3055] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:09.325315  6527 raft_consensus.cc:740] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:09.274866  6411 raft_consensus.cc:3055] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:09.326267  6166 raft_consensus.cc:3055] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:09.331650  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:09.328321  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:09.329288  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:09.341465  4026 raft_consensus.cc:2468] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 5.
I20260709 13:15:09.330284  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:09.329687  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:09.329653  3925 leader_election.cc:304] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:09.294807  6350 consensus_queue.cc:260] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:09.346352  4029 raft_consensus.cc:1240] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 3. Current term is 5. Ops: []
I20260709 13:15:09.347932  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:09.358170  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:09.359198  4100 raft_consensus.cc:3060] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:09.361617  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 46257.7us
I20260709 13:15:09.364563  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:09.368500  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:09.369529  4707 raft_consensus.cc:2468] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 4.
I20260709 13:15:09.373713  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:09.328390  6451 raft_consensus.cc:2804] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:09.376276  4027 raft_consensus.cc:1240] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:09.379935  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:09.329393  6261 leader_election.cc:290] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:09.328835  6521 raft_consensus.cc:2804] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:09.326730  6411 raft_consensus.cc:740] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:09.391366  4030 raft_consensus.cc:2468] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 6.
I20260709 13:15:09.384658  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:09.389449  4028 raft_consensus.cc:2468] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 5.
I20260709 13:15:09.391151  4707 raft_consensus.cc:1240] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:09.339943  6166 raft_consensus.cc:740] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
W20260709 13:15:09.381438  4071 leader_election.cc:336] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Timed out: RequestConsensusVote RPC to 127.2.198.193:35339 timed out after 1.641s (SENT)
I20260709 13:15:09.391994  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:09.408811  4034 raft_consensus.cc:2393] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 8: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:09.407801  4071 leader_election.cc:304] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:09.330499  6296 consensus_queue.cc:1059] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:15:09.411459  4031 raft_consensus.cc:2468] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 5.
W20260709 13:15:09.411528  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 73209.4us
W20260709 13:15:09.449498  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 133311us
I20260709 13:15:09.429201  4704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:09.449837  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:09.459901  3997 leader_election.cc:304] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:09.384697  6507 raft_consensus.cc:697] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:09.461537  3922 leader_election.cc:304] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:09.470332  4100 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 7.
I20260709 13:15:09.473407  4704 raft_consensus.cc:2368] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 6. Current term is 7.
I20260709 13:15:09.477855  4031 raft_consensus.cc:1240] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 5. Current term is 6. Ops: []
W20260709 13:15:09.479737  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 150169us
W20260709 13:15:09.453619  6499 log.cc:927] Time spent T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:15:09.423722  6447 raft_consensus.cc:493] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:09.426256  6431 raft_consensus.cc:697] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:09.481686  4027 raft_consensus.cc:2468] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:15:09.326365  6527 consensus_queue.cc:260] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:09.461639  6465 raft_consensus.cc:697] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:09.492931  4031 raft_consensus.cc:1240] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 5. Current term is 6. Ops: [3.3-5.4]
I20260709 13:15:09.481256  6350 raft_consensus.cc:3060] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:09.480875  6515 raft_consensus.cc:2749] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:09.501780  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:09.502470  4028 raft_consensus.cc:2468] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 4.
I20260709 13:15:09.503756  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:09.513566  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:09.515226  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:09.518622  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:09.519997  4033 raft_consensus.cc:2410] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:15:09.523655  6522 raft_consensus.cc:3055] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:09.524107  6522 raft_consensus.cc:740] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:09.525108  6522 consensus_queue.cc:260] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:09.527791  6526 log.cc:927] Time spent T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:15:09.528422  5954 consensus_queue.cc:1059] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:09.529785  6348 raft_consensus.cc:3055] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:09.530278  6348 raft_consensus.cc:740] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:09.531289  6348 consensus_queue.cc:260] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:09.532503  6348 raft_consensus.cc:3060] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:09.536870  6523 log.cc:927] Time spent T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:15:09.539945  6166 consensus_queue.cc:260] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:09.542477  6166 raft_consensus.cc:3060] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:09.543154  6515 consensus_queue.cc:1059] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:09.543952  6507 consensus_queue.cc:237] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:09.544246  6465 consensus_queue.cc:237] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:09.545404  6515 raft_consensus.cc:3055] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:09.546334  6515 raft_consensus.cc:740] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:09.526557  6522 raft_consensus.cc:3060] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:09.490628  6520 raft_consensus.cc:2749] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:09.516932  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:09.549013  4074 leader_election.cc:304] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:09.552484  4675 leader_election.cc:304] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:09.561968  4675 leader_election.cc:304] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:09.552513  4031 raft_consensus.cc:1240] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:15:09.490131  6530 raft_consensus.cc:493] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:09.563434  6530 raft_consensus.cc:515] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:09.566444  6530 leader_election.cc:290] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:09.555985  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:09.488669  6034 consensus_queue.cc:237] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:09.574472  4028 raft_consensus.cc:3060] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:09.582829  4026 raft_consensus.cc:2468] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 7.
I20260709 13:15:09.591418  4074 leader_election.cc:304] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:09.574003  6532 raft_consensus.cc:2749] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:09.593902  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:09.601598  6531 raft_consensus.cc:2804] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:09.495668  6447 raft_consensus.cc:515] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:09.615355  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 155591us
I20260709 13:15:09.647341  3997 leader_election.cc:304] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
W20260709 13:15:09.648311  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 161645us
I20260709 13:15:09.619248  6348 raft_consensus.cc:2749] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:09.619875  6512 consensus_queue.cc:1059] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:09.627251  6376 consensus_queue.cc:1059] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:09.628472  4074 leader_election.cc:304] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:09.634121  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:09.638279  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
W20260709 13:15:09.593894  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 212490us
I20260709 13:15:09.594050  6261 raft_consensus.cc:2749] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:09.593658  5757 raft_consensus.cc:2804] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:15:09.645222  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:09.657054  3925 leader_election.cc:304] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:09.650183  4675 leader_election.cc:304] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:09.655613  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:09.660871  4034 raft_consensus.cc:2376] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6. Re-sending same reply.
I20260709 13:15:09.497749  6411 consensus_queue.cc:260] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:09.656047  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 233581us
I20260709 13:15:09.654867  4026 raft_consensus.cc:3060] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:09.594599  6451 raft_consensus.cc:697] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:09.648079  5954 raft_consensus.cc:2804] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:09.671741  4029 raft_consensus.cc:2468] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 5.
I20260709 13:15:09.648492  6527 raft_consensus.cc:3060] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:09.547272  6515 consensus_queue.cc:260] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:09.665122  5757 raft_consensus.cc:493] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:09.676931  5954 raft_consensus.cc:493] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:09.675808  6521 raft_consensus.cc:697] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 6 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:09.708596  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:09.708516  6451 consensus_queue.cc:237] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:09.709872  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:09.711146  6537 raft_consensus.cc:493] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.682533  6453 raft_consensus.cc:2804] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:09.721439  3924 leader_election.cc:304] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:09.736104  4026 raft_consensus.cc:2410] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 13:15:09.736990  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:09.745253  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 120406us
W20260709 13:15:09.748044  4071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:09.737910  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:09.704371  5757 raft_consensus.cc:3060] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:09.702976  6512 raft_consensus.cc:2804] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:09.712476  5954 raft_consensus.cc:3060] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:09.722585  3922 leader_election.cc:304] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:09.726075  6537 raft_consensus.cc:515] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:09.759415  6411 raft_consensus.cc:3060] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:09.768481  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:09.771368  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 120932us
W20260709 13:15:09.771906  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 50602.6us
I20260709 13:15:09.752593  6453 raft_consensus.cc:697] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 7 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:09.760268  6512 raft_consensus.cc:493] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:09.712317  6432 raft_consensus.cc:515] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:09.653033  6431 consensus_queue.cc:237] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:09.792604  6539 raft_consensus.cc:493] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:09.793066  6516 raft_consensus.cc:3055] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:09.875487  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:09.780419  6543 raft_consensus.cc:493] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:09.793871  6447 leader_election.cc:290] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:09.880556  6447 raft_consensus.cc:2804] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:09.880960  6447 raft_consensus.cc:493] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:09.881333  6447 raft_consensus.cc:3060] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:09.792001  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 163639us
W20260709 13:15:09.797379  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 125695us
I20260709 13:15:09.884011  4074 leader_election.cc:304] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
W20260709 13:15:09.798544  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 151236us
I20260709 13:15:09.885176  4074 leader_election.cc:304] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:09.885535  3997 leader_election.cc:304] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:09.886277  4074 leader_election.cc:304] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:15:09.887739  6521 consensus_queue.cc:237] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:09.799837  6531 raft_consensus.cc:697] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:09.890527  6531 consensus_queue.cc:237] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:09.891475  3925 leader_election.cc:304] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:09.892196  6348 raft_consensus.cc:3055] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:09.892621  6348 raft_consensus.cc:740] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:09.892771  3925 leader_election.cc:304] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:09.893793  3925 leader_election.cc:304] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
W20260709 13:15:09.792160  6534 log.cc:927] Time spent T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:15:09.797186  6515 raft_consensus.cc:3060] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:09.935356  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 67951.7us
I20260709 13:15:09.791778  6296 raft_consensus.cc:2804] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:09.941898  3924 leader_election.cc:400] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 election: Vote denied by peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117) with higher term. Message: Invalid argument: T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 6. Current term is 7.
I20260709 13:15:09.942276  3924 leader_election.cc:403] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:15:09.867681  6520 raft_consensus.cc:2804] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:15:09.957691  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 251679us
I20260709 13:15:09.958839  3922 leader_election.cc:304] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:09.855937  6465 raft_consensus.cc:493] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:09.868860  6512 raft_consensus.cc:3060] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:09.955582  3925 raft_consensus.cc:2686] T 97cf7690694c4d5988258ec1b641a2e6 P f1c75790cedf4f52a3463a255c7da059: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:15:09.983517  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 89821.1us
I20260709 13:15:09.926810  6537 leader_election.cc:290] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:09.872203  6516 raft_consensus.cc:740] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:09.895102  6532 raft_consensus.cc:2749] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:10.017755  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 44322.2us
I20260709 13:15:09.941336  6545 raft_consensus.cc:2804] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:09.941649  6296 raft_consensus.cc:493] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:09.956393  6451 raft_consensus.cc:493] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.046187  6554 raft_consensus.cc:2804] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:10.044667  4704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:09.893654  6348 consensus_queue.cc:260] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:10.004132  6535 raft_consensus.cc:3055] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:10.060894  6537 raft_consensus.cc:2749] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:10.062705  6554 raft_consensus.cc:493] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:10.129238  6554 raft_consensus.cc:3060] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:10.048067  6545 raft_consensus.cc:493] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:10.131204  6545 raft_consensus.cc:3060] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:10.066692  6357 raft_consensus.cc:2804] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:10.132465  6357 raft_consensus.cc:493] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:10.132961  6357 raft_consensus.cc:3060] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:10.087432  6538 raft_consensus.cc:493] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.134613  6538 raft_consensus.cc:515] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:10.095907  6516 consensus_queue.cc:260] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:10.090525  6533 consensus_queue.cc:1059] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.135s
I20260709 13:15:10.136713  6516 raft_consensus.cc:3060] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:15:10.091634  6536 raft_consensus.cc:2804] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:10.137715  6536 raft_consensus.cc:697] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 6 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:10.138751  6536 consensus_queue.cc:237] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:10.093932  6550 log.cc:927] Time spent T 00000000000000000000000000000000 P af4ff34c238b4043994545a7eb56815f: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 13:15:10.000414  6465 raft_consensus.cc:515] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:09.956182  6539 raft_consensus.cc:515] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:10.091372  6541 raft_consensus.cc:3060] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:10.120132  6570 raft_consensus.cc:2804] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:10.120812  6551 raft_consensus.cc:2749] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:10.065455  6376 consensus_queue.cc:1059] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:15:09.957307  6543 raft_consensus.cc:515] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:10.084668  6453 consensus_queue.cc:237] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:10.092151  6559 raft_consensus.cc:493] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.227099  6559 raft_consensus.cc:515] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:10.140988  6533 raft_consensus.cc:3055] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:10.229445  6533 raft_consensus.cc:740] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
W20260709 13:15:10.180212  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:10.064882  6296 raft_consensus.cc:3060] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:10.255826  4031 raft_consensus.cc:1240] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:10.069763  6451 raft_consensus.cc:515] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:10.108592  6535 raft_consensus.cc:740] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
W20260709 13:15:10.267774  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:10.215551  6570 raft_consensus.cc:493] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:10.289476  6567 consensus_queue.cc:1059] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:15:10.276295  6376 raft_consensus.cc:3055] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:10.298825  6324 raft_consensus.cc:3055] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:15:10.306012  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:10.313971  6324 raft_consensus.cc:740] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:10.314581  6529 raft_consensus.cc:493] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.313144  6376 raft_consensus.cc:740] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:10.318427  6376 consensus_queue.cc:260] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:10.230604  6533 consensus_queue.cc:260] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:10.287930  6570 raft_consensus.cc:3060] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:10.315243  6529 raft_consensus.cc:515] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:10.334055  6376 raft_consensus.cc:3060] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:10.342175  6556 consensus_queue.cc:1059] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.081s
I20260709 13:15:10.343552  6324 consensus_queue.cc:260] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:10.345261  6324 raft_consensus.cc:3060] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:10.370332  6535 consensus_queue.cc:260] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:10.404515  4033 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.008s	sys 0.002s
W20260709 13:15:10.411412  4033 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.009s	sys 0.002s
I20260709 13:15:10.422921  6551 raft_consensus.cc:493] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
W20260709 13:15:10.424664  4073 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.023s	sys 0.096s
W20260709 13:15:10.425149  4073 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.023s	sys 0.096s
W20260709 13:15:10.426287  4073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:10.426997  4073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:10.440490  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 481755us
I20260709 13:15:10.423892  6551 raft_consensus.cc:515] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:10.453647  4071 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.074s	sys 0.138s
W20260709 13:15:10.454207  4071 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.074s	sys 0.138s
W20260709 13:15:10.455282  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 194616us
W20260709 13:15:10.456179  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 700594us
W20260709 13:15:10.457234  4071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:10.457715  4071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:10.429752  6560 raft_consensus.cc:3055] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:15:10.451354  6034 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.032s	sys 0.088s
I20260709 13:15:10.441720  6348 raft_consensus.cc:3060] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:10.475494  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:10.479228  4074 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.018s	sys 0.053s
W20260709 13:15:10.480707  4074 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.018s	sys 0.053s
W20260709 13:15:10.481853  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 594360us
I20260709 13:15:10.504679  6549 raft_consensus.cc:493] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:10.505348  6549 raft_consensus.cc:515] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:10.507012  6533 raft_consensus.cc:3060] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:10.491639  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 507211us
W20260709 13:15:10.472803  6034 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.032s	sys 0.089s
I20260709 13:15:10.460395  6535 raft_consensus.cc:3060] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:10.461588  6560 raft_consensus.cc:740] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:10.520031  4033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41312 (request call id 257) took 1004 ms. Trace:
I20260709 13:15:10.523885  3922 leader_election.cc:304] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:10.474824  6432 leader_election.cc:290] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:10.525703  4033 rpcz_store.cc:276] 0709 13:15:09.507267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:09.520980 (+ 13713us) service_pool.cc:224] Handling call
0709 13:15:09.521425 (+   445us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:09.700359 (+178934us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:09.700394 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:09.746949 (+ 46555us) log.cc:844] Serialized 26 byte log entry
0709 13:15:10.412098 (+665149us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:10.445193 (+ 33095us) log.cc:844] Serialized 14 byte log entry
0709 13:15:10.454843 (+  9650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:10.454917 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:10.511916 (+ 56999us) raft_consensus.cc:1685] finished
0709 13:15:10.511935 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:10.512072 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48751,"prepare.queue_time_us":32935,"prepare.run_cpu_time_us":2848,"prepare.run_wall_time_us":3575,"raft.queue_time_us":210946,"raft.run_cpu_time_us":361,"raft.run_wall_time_us":33941,"thread_start_us":679126,"threads_started":2,"wal-append.queue_time_us":705532}
I20260709 13:15:10.540719  6560 consensus_queue.cc:260] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:10.541813  6551 leader_election.cc:290] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:10.541977  6560 raft_consensus.cc:3060] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:10.546797  3925 leader_election.cc:304] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:10.545099  4704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:10.547888  4704 raft_consensus.cc:2393] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 7: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
I20260709 13:15:10.530824  6553 raft_consensus.cc:493] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:10.533370  6531 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.016s	sys 0.054s
I20260709 13:15:10.532570  6520 raft_consensus.cc:697] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 5 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
W20260709 13:15:10.586508  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 62720.8us
I20260709 13:15:10.587071  3922 leader_election.cc:304] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
W20260709 13:15:10.579154  5757 consensus_meta.cc:287] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938: Time spent flushing consensus metadata: real 0.806s	user 0.014s	sys 0.009s
I20260709 13:15:10.546267  6537 consensus_queue.cc:1048] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:15:10.593230  5757 raft_consensus.cc:515] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:10.593729  6563 log.cc:927] Time spent T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:15:10.591609  4704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:15:10.583732  6531 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.016s	sys 0.055s
I20260709 13:15:10.538522  6307 consensus_queue.cc:1048] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.051s
W20260709 13:15:10.604578  6558 log.cc:927] Time spent T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:15:10.607899  6571 raft_consensus.cc:2749] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:10.612087  5757 leader_election.cc:290] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:10.614794  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:10.586174  6549 leader_election.cc:290] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:10.615449  4033 raft_consensus.cc:3060] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:10.589826  6465 leader_election.cc:290] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:10.616056  6566 consensus_queue.cc:1059] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:10.616612  3925 leader_election.cc:304] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:10.617434  6520 consensus_queue.cc:237] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:10.617939  3925 leader_election.cc:304] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:10.617959  6572 raft_consensus.cc:2804] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:10.604485  6540 raft_consensus.cc:2804] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:10.619693  6537 consensus_queue.cc:1059] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:10.620085  6540 raft_consensus.cc:493] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:10.620478  6540 raft_consensus.cc:3060] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:10.620566  6350 consensus_meta.cc:287] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 1.116s	user 0.003s	sys 0.016s
I20260709 13:15:10.621245  6350 raft_consensus.cc:3055] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:10.621577  6350 raft_consensus.cc:740] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
W20260709 13:15:10.622483  4028 consensus_meta.cc:287] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 1.007s	user 0.016s	sys 0.005s
I20260709 13:15:10.622331  6350 consensus_queue.cc:260] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:10.622852  4028 raft_consensus.cc:2468] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 7.
I20260709 13:15:10.623330  6530 raft_consensus.cc:493] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.624120  4025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41312 (request call id 259) took 1111 ms. Trace:
I20260709 13:15:10.623936  6530 raft_consensus.cc:515] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:10.624944  3922 leader_election.cc:304] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:10.624635  4025 rpcz_store.cc:276] 0709 13:15:09.512405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:09.645618 (+133213us) service_pool.cc:224] Handling call
0709 13:15:09.677420 (+ 31802us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:09.699483 (+ 22063us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:09.699525 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:09.707191 (+  7666us) log.cc:844] Serialized 26 byte log entry
0709 13:15:09.797318 (+ 90127us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:09.896994 (+ 99676us) log.cc:844] Serialized 14 byte log entry
0709 13:15:09.935357 (+ 38363us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:09.935448 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:10.614585 (+679137us) raft_consensus.cc:1685] finished
0709 13:15:10.614608 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:10.623941 (+  9333us) spinlock_profiling.cc:243] Waited 18.4 ms on lock 0x7b54000901d0. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566d8ad 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:10.624062 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7257,"prepare.queue_time_us":129372,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":9689,"raft.queue_time_us":169057,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":14270,"spinlock_wait_cycles":42234240,"thread_start_us":89352,"threads_started":1,"wal-append.queue_time_us":751312}
I20260709 13:15:10.627933  6546 raft_consensus.cc:2804] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:10.628439  6546 raft_consensus.cc:697] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 6 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:10.629330  6546 consensus_queue.cc:237] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:10.629787  6530 leader_election.cc:290] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:10.619262  3925 leader_election.cc:304] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:15:10.583532  6539 leader_election.cc:290] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:10.623454  4028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41312 (request call id 258) took 1115 ms. Trace:
W20260709 13:15:10.594861  6522 consensus_meta.cc:287] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 1.015s	user 0.022s	sys 0.000s
I20260709 13:15:10.546169  5962 consensus_queue.cc:1059] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:15:10.634173  4028 rpcz_store.cc:276] 0709 13:15:09.507534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:09.513291 (+  5757us) service_pool.cc:224] Handling call
0709 13:15:10.623344 (+1110053us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:10.634752  4033 raft_consensus.cc:2468] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 5.
I20260709 13:15:10.639482  4675 leader_election.cc:304] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:10.600553  6451 leader_election.cc:290] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:10.600276  6538 leader_election.cc:290] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:10.652262  3958 raft_consensus.cc:2468] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 6.
W20260709 13:15:10.680729  3997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:10.681628  6451 raft_consensus.cc:493] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:10.682427  6451 raft_consensus.cc:515] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:10.685763  6451 leader_election.cc:290] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:10.651983  4675 leader_election.cc:304] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:10.642349  6544 raft_consensus.cc:2749] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:10.639170  6348 raft_consensus.cc:493] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:10.642534  6034 raft_consensus.cc:2804] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:10.583680  6553 raft_consensus.cc:515] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:10.710796  6544 raft_consensus.cc:2804] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:10.711403  6544 raft_consensus.cc:493] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:10.711901  6544 raft_consensus.cc:3060] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:10.714416  6529 leader_election.cc:290] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:10.690238  6522 raft_consensus.cc:2749] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:10.714659  6573 raft_consensus.cc:493] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:10.696527  6538 raft_consensus.cc:2804] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:10.673995  6432 consensus_queue.cc:1059] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
W20260709 13:15:10.778090  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 287821us
I20260709 13:15:10.783663  4034 raft_consensus.cc:1240] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 3. Current term is 5. Ops: []
I20260709 13:15:10.783944  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
W20260709 13:15:10.784493  4074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:10.784642  4029 raft_consensus.cc:3060] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:10.785956  4026 raft_consensus.cc:1275] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:15:10.792832  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 167962us
I20260709 13:15:10.793787  3922 leader_election.cc:304] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
W20260709 13:15:10.797895  4672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:10.798877  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 179678us
W20260709 13:15:10.799903  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:10.774698  6565 log.cc:927] Time spent T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 13:15:10.768131  6376 raft_consensus.cc:493] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.803567  3925 leader_election.cc:304] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
W20260709 13:15:10.805994  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 100000us
I20260709 13:15:10.772030  6034 raft_consensus.cc:697] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 5 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:10.709944  6348 raft_consensus.cc:515] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:10.799355  6447 consensus_meta.cc:287] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 0.918s	user 0.016s	sys 0.066s
I20260709 13:15:10.868423  6432 raft_consensus.cc:493] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.868552  6447 raft_consensus.cc:515] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:10.869200  6432 raft_consensus.cc:515] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:10.870946  6447 leader_election.cc:290] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:10.871435  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:10.872434  6537 raft_consensus.cc:493] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:10.873179  6537 raft_consensus.cc:515] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:10.876039  6537 leader_election.cc:290] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:10.876900  6432 leader_election.cc:290] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:15:10.878240  6166 consensus_meta.cc:287] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 1.335s	user 0.004s	sys 0.019s
W20260709 13:15:10.878935  6548 log.cc:927] Time spent T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.345s	user 0.001s	sys 0.000s
I20260709 13:15:10.879928  6559 leader_election.cc:290] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:10.880846  4027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38290 (request call id 1707) took 1380 ms. Trace:
I20260709 13:15:10.884806  6350 raft_consensus.cc:3060] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:10.881381  4027 rpcz_store.cc:276] 0709 13:15:09.500623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:09.500772 (+   149us) service_pool.cc:224] Handling call
0709 13:15:09.505563 (+  4791us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:09.565008 (+ 59445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:09.565052 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:09.565682 (+   630us) log.cc:844] Serialized 26 byte log entry
0709 13:15:09.610893 (+ 45211us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:09.611666 (+   773us) log.cc:844] Serialized 14 byte log entry
0709 13:15:09.667804 (+ 56138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:09.681307 (+ 13503us) spinlock_profiling.cc:243] Waited 59.1 ms on lock 0x7b54003b1354. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:09.681354 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:10.880452 (+1199098us) raft_consensus.cc:1685] finished
0709 13:15:10.880570 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:10.880751 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":258,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":260345,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":125,"spinlock_wait_cycles":135836928,"thread_start_us":100508,"threads_started":2,"wal-append.queue_time_us":885207}
I20260709 13:15:10.888715  6553 leader_election.cc:290] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:10.889868  4704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:10.890549  4704 raft_consensus.cc:2468] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 7.
I20260709 13:15:10.891502  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:10.892711  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:15:10.894213  6411 consensus_meta.cc:287] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 1.025s	user 0.017s	sys 0.000s
W20260709 13:15:10.898054  6512 consensus_meta.cc:287] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.834s	user 0.009s	sys 0.011s
I20260709 13:15:10.825464  6556 raft_consensus.cc:493] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:10.827153  6574 log.cc:927] Time spent T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:15:10.912117  4704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:10.801303  6538 raft_consensus.cc:697] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 7 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:10.777580  6573 raft_consensus.cc:515] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:10.848326  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 44857.6us
I20260709 13:15:10.849120  6536 raft_consensus.cc:2749] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:10.849812  6584 raft_consensus.cc:2749] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:10.850845  6522 raft_consensus.cc:493] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:10.795584  6529 raft_consensus.cc:493] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.852571  6543 leader_election.cc:290] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:15:10.855129  6357 consensus_meta.cc:287] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.722s	user 0.012s	sys 0.021s
I20260709 13:15:10.855957  6034 consensus_queue.cc:237] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:10.931749  4027 raft_consensus.cc:1240] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:10.931955  4033 raft_consensus.cc:1275] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:15:10.858472  6554 consensus_meta.cc:287] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.728s	user 0.007s	sys 0.021s
I20260709 13:15:10.819777  6376 raft_consensus.cc:515] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:10.860857  6527 consensus_meta.cc:287] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 1.167s	user 0.011s	sys 0.008s
I20260709 13:15:10.863715  4025 raft_consensus.cc:1275] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:15:10.866333  6570 consensus_meta.cc:287] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.545s	user 0.007s	sys 0.006s
I20260709 13:15:10.898404  6537 raft_consensus.cc:493] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:10.778607  6572 raft_consensus.cc:697] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 4 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:10.943506  6537 raft_consensus.cc:515] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:10.945137  6573 leader_election.cc:290] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:10.945688  6537 leader_election.cc:290] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:10.945884  6545 consensus_meta.cc:287] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.806s	user 0.024s	sys 0.025s
I20260709 13:15:10.931326  6529 raft_consensus.cc:515] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:10.947516  4027 raft_consensus.cc:1275] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:10.899873  3999 leader_election.cc:304] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
W20260709 13:15:10.900967  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 67210.1us
W20260709 13:15:10.901501  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 75350.9us
I20260709 13:15:10.949580  4029 raft_consensus.cc:2468] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 6.
I20260709 13:15:10.841069  4071 leader_election.cc:304] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:10.921701  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:10.922899  4026 raft_consensus.cc:1275] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:10.928651  6522 raft_consensus.cc:515] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:10.934530  6566 raft_consensus.cc:493] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:10.934405  6357 raft_consensus.cc:515] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:10.955495  4034 raft_consensus.cc:2368] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 6. Current term is 7.
W20260709 13:15:10.923908  4074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:10.928699  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:15:10.928181  6296 consensus_meta.cc:287] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.645s	user 0.008s	sys 0.011s
I20260709 13:15:10.946274  6545 raft_consensus.cc:515] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:10.961030  6589 raft_consensus.cc:493] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:10.957392  6540 raft_consensus.cc:515] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:10.977197  6589 raft_consensus.cc:515] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:10.977576  6555 consensus_queue.cc:1048] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:10.978482  6545 leader_election.cc:290] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:10.979152  6540 leader_election.cc:290] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:10.958606  6522 leader_election.cc:290] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:10.975843  6590 raft_consensus.cc:493] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:10.964205  6570 raft_consensus.cc:515] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:10.981436  6590 raft_consensus.cc:515] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:10.981835  4105 raft_consensus.cc:1240] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:10.960234  6376 leader_election.cc:290] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:10.956455  6529 leader_election.cc:290] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:10.976136  6515 consensus_meta.cc:287] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 1.033s	user 0.008s	sys 0.013s
I20260709 13:15:10.986403  6590 leader_election.cc:290] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:10.986796  6560 raft_consensus.cc:493] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.987006  6590 raft_consensus.cc:493] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:10.988206  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 147224us
I20260709 13:15:10.987501  6560 raft_consensus.cc:515] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:10.989149  4071 leader_election.cc:304] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:10.990017  6573 raft_consensus.cc:2749] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:10.990638  6560 leader_election.cc:290] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:10.990803  6573 raft_consensus.cc:2749] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:10.987499  6590 raft_consensus.cc:515] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:10.989966  6570 leader_election.cc:290] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:10.992678  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:10.993079  6590 leader_election.cc:290] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:10.991281  6357 leader_election.cc:290] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:10.968027  4032 raft_consensus.cc:2468] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 4.
W20260709 13:15:10.995054  3999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 95273us
I20260709 13:15:10.913944  6512 raft_consensus.cc:515] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:10.998588  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 49087.7us
W20260709 13:15:10.998879  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:10.949658  6521 raft_consensus.cc:493] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.002624  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:10.922133  6556 raft_consensus.cc:515] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:11.032361  6535 consensus_meta.cc:287] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.503s	user 0.010s	sys 0.000s
I20260709 13:15:11.003306  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:11.044744  4099 raft_consensus.cc:3060] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:10.938817  6554 raft_consensus.cc:515] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:11.034392  4071 leader_election.cc:304] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:11.036051  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:11.048765  4108 raft_consensus.cc:2468] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 5.
I20260709 13:15:11.037734  6512 leader_election.cc:290] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:11.032219  3922 leader_election.cc:304] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:10.957690  6348 leader_election.cc:290] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:11.052544  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:11.038472  4102 raft_consensus.cc:1275] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:10.940805  6572 consensus_queue.cc:237] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:11.055171  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:11.045200  4025 raft_consensus.cc:1240] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 LEADER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:11.046108  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:11.051656  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:11.056128  4107 raft_consensus.cc:3060] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:11.056740  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:11.056852  6589 leader_election.cc:290] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:11.057569  4108 raft_consensus.cc:2393] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 7: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
I20260709 13:15:11.058367  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:11.058982  6554 leader_election.cc:290] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:11.060151  4700 raft_consensus.cc:1240] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:11.061941  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:11.063127  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 46601.3us
I20260709 13:15:11.061904  4071 leader_election.cc:304] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:11.063592  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:11.065886  4105 raft_consensus.cc:2393] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 6: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:11.066896  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:11.066977  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:11.067145  4071 leader_election.cc:304] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:11.068094  4105 raft_consensus.cc:2468] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 6.
I20260709 13:15:11.072208  4106 raft_consensus.cc:2393] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 5: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:11.073393  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:11.049911  6571 raft_consensus.cc:3055] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:11.074586  4102 raft_consensus.cc:2410] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:15:11.079631  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 47510.5us
I20260709 13:15:11.003615  6527 consensus_queue.cc:1048] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
W20260709 13:15:11.083242  3997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:11.087934  3997 leader_election.cc:304] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:11.089818  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:11.090397  4105 raft_consensus.cc:2468] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 6.
I20260709 13:15:11.091722  6588 raft_consensus.cc:2749] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:11.091903  6582 raft_consensus.cc:493] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.092254  3922 leader_election.cc:304] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:11.092538  6582 raft_consensus.cc:515] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:11.093055  5962 consensus_queue.cc:1059] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:11.093817  6546 consensus_queue.cc:1048] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:11.095160  6582 leader_election.cc:290] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:11.095917  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:11.097051  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:11.097817  4029 raft_consensus.cc:2468] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 7.
I20260709 13:15:11.098677  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:11.100734  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:11.101284  4033 raft_consensus.cc:3060] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:11.101671  4100 raft_consensus.cc:1275] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:10.958137  6538 consensus_queue.cc:237] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:11.114889  3997 leader_election.cc:304] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:11.109804  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:11.116425  3997 leader_election.cc:304] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:10.960819  6566 raft_consensus.cc:515] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:11.110914  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:10.995975  6296 raft_consensus.cc:515] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:11.114157  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:11.131258  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:11.104365  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:11.118278  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:11.132211  4034 raft_consensus.cc:3060] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:11.119707  3997 leader_election.cc:304] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:11.111581  4105 raft_consensus.cc:1275] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:11.079404  6571 raft_consensus.cc:740] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:11.123502  4099 raft_consensus.cc:2468] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 6.
I20260709 13:15:11.127730  6529 raft_consensus.cc:2749] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:11.117628  6553 consensus_queue.cc:1048] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:15:11.126353  6588 raft_consensus.cc:3060] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:11.126706  6549 raft_consensus.cc:3060] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:11.127116  6547 raft_consensus.cc:2804] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:11.082626  6348 raft_consensus.cc:2749] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:15:11.137382  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 210583us
I20260709 13:15:11.146540  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:11.062649  6521 raft_consensus.cc:515] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:11.157629  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 68365.9us
I20260709 13:15:11.179414  4034 raft_consensus.cc:2468] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 7.
W20260709 13:15:11.159226  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 92185us
I20260709 13:15:11.179957  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:11.180712  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:11.180896  4027 raft_consensus.cc:2468] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 5.
I20260709 13:15:11.181891  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:11.181998  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:11.182307  4034 raft_consensus.cc:2468] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 4.
I20260709 13:15:11.183163  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:11.120729  4106 raft_consensus.cc:2468] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 6.
I20260709 13:15:11.138170  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:11.183606  4034 raft_consensus.cc:3060] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:11.118749  6559 raft_consensus.cc:2804] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:11.179459  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:11.158710  4107 raft_consensus.cc:2468] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 7.
I20260709 13:15:11.185415  4101 raft_consensus.cc:1275] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:15:11.189919  4027 raft_consensus.cc:1240] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:11.191251  4033 raft_consensus.cc:2468] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 6.
I20260709 13:15:11.145879  6543 raft_consensus.cc:2749] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:11.223938  4074 leader_election.cc:304] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:11.193146  4071 leader_election.cc:304] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:11.197153  3905 auto_rebalancer.cc:629] Failed to schedule move for tablet 13ea3a969108486bbbaaaf3697e1d3b5: Illegal state: Replica 8952c48a6f3a43968f7d77f7bfc4d1bc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:11.201601  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:11.203994  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:11.225685  4071 leader_election.cc:304] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:11.204739  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:11.205426  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:11.206169  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:11.226876  4071 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:15:11.207113  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:11.227996  3952 raft_consensus.cc:2468] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 5.
I20260709 13:15:11.208045  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:11.229566  3954 raft_consensus.cc:2468] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 3.
I20260709 13:15:11.229884  4025 raft_consensus.cc:1275] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:11.165292  6512 raft_consensus.cc:2749] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:11.210934  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:11.239398  6357 raft_consensus.cc:2749] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:11.217028  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:11.218120  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:11.240445  4706 raft_consensus.cc:2468] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 7.
I20260709 13:15:11.241132  3958 raft_consensus.cc:1240] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:15:11.242213  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:11.218869  4708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:11.235530  6571 consensus_queue.cc:260] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:11.249302  6573 raft_consensus.cc:2804] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:11.249740  6573 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:11.249790  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:11.250249  6573 raft_consensus.cc:3060] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:11.250756  4101 raft_consensus.cc:2410] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:15:11.251708  3925 leader_election.cc:400] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 election: Vote denied by peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115) with higher term. Message: Invalid argument: T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 6. Current term is 7.
I20260709 13:15:11.235414  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:11.252494  3954 raft_consensus.cc:3060] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:11.219053  6566 leader_election.cc:290] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:11.172072  6591 raft_consensus.cc:2749] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:15:11.173861  5954 consensus_meta.cc:287] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 1.227s	user 0.024s	sys 0.008s
I20260709 13:15:11.152786  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:11.208906  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:11.227396  3957 raft_consensus.cc:2468] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 5.
I20260709 13:15:11.222831  5757 consensus_queue.cc:1059] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
W20260709 13:15:11.233096  6533 consensus_meta.cc:287] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.726s	user 0.014s	sys 0.000s
I20260709 13:15:11.172415  6547 raft_consensus.cc:493] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:11.233242  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:11.234356  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:11.234557  6560 raft_consensus.cc:2804] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:11.166734  6545 raft_consensus.cc:493] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.167726  6515 consensus_queue.cc:1048] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.068s
I20260709 13:15:11.145749  6520 consensus_queue.cc:1059] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.079s
I20260709 13:15:11.232981  6376 raft_consensus.cc:2749] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:11.232963  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:11.292133  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:11.292397  3950 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 7.
I20260709 13:15:11.293478  4708 raft_consensus.cc:1275] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:11.286218  5954 raft_consensus.cc:515] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:11.288864  6543 raft_consensus.cc:493] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.296298  6543 raft_consensus.cc:515] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:11.297819  6521 leader_election.cc:290] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:11.298660  6543 leader_election.cc:290] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:11.299531  3924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:11.286818  6547 raft_consensus.cc:3060] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:11.290166  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:11.229797  5962 consensus_queue.cc:1048] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:15:11.186544  6559 raft_consensus.cc:493] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:11.230180  6535 consensus_queue.cc:1059] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
W20260709 13:15:11.187070  6541 consensus_meta.cc:287] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.963s	user 0.020s	sys 0.009s
I20260709 13:15:11.234591  6556 leader_election.cc:290] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:11.213346  6570 consensus_queue.cc:1059] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:11.240542  3956 raft_consensus.cc:2393] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 in current term 5: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:11.243386  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:15:11.222299  6594 log.cc:927] Time spent T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:15:11.231683  4074 leader_election.cc:304] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:11.248672  4704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:11.253003  3925 leader_election.cc:304] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:11.129662  6544 raft_consensus.cc:515] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:11.324508  3958 raft_consensus.cc:2468] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 5.
I20260709 13:15:11.267434  4073 leader_election.cc:304] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:11.328428  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:11.279940  4034 raft_consensus.cc:2468] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7.
I20260709 13:15:11.283808  4108 raft_consensus.cc:2468] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 6.
I20260709 13:15:11.286777  6597 consensus_queue.cc:1048] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:15:11.236784  6589 consensus_queue.cc:1048] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:11.292158  3952 raft_consensus.cc:3060] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:11.301043  4104 raft_consensus.cc:2393] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 6: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:11.304904  3954 raft_consensus.cc:2468] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 7.
W20260709 13:15:11.302018  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 70073.3us
I20260709 13:15:11.265851  6571 raft_consensus.cc:3060] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:11.316442  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:11.318534  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:11.335068  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:15:11.301573  6516 consensus_meta.cc:287] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 1.163s	user 0.022s	sys 0.031s
W20260709 13:15:11.325865  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 100780us
W20260709 13:15:11.326937  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 74006.8us
I20260709 13:15:11.290488  6307 raft_consensus.cc:3055] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:11.329102  3950 raft_consensus.cc:2468] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 3.
I20260709 13:15:11.316874  6559 raft_consensus.cc:3060] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:11.289089  6545 raft_consensus.cc:515] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:11.334455  4071 leader_election.cc:304] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:11.319350  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:11.335304  3959 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 7.
I20260709 13:15:11.317111  6560 raft_consensus.cc:697] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:11.336122  3956 raft_consensus.cc:2393] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 in current term 5: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:11.346490  3925 leader_election.cc:304] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:11.336397  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:15:11.347878  4073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 80551.9us
I20260709 13:15:11.323680  6541 raft_consensus.cc:2749] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117) with higher term. Message: Invalid argument: T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 6. Current term is 7.
I20260709 13:15:11.359763  3953 raft_consensus.cc:2468] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 7.
I20260709 13:15:11.351565  6591 raft_consensus.cc:2804] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:11.360762  6591 raft_consensus.cc:493] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:11.361112  6591 raft_consensus.cc:3060] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:11.362039  6544 leader_election.cc:290] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:11.363332  4071 leader_election.cc:304] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:11.364677  4071 leader_election.cc:304] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:11.364753  3955 raft_consensus.cc:3060] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:11.366973  4071 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:11.318604  5954 leader_election.cc:290] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:11.349399  6307 raft_consensus.cc:740] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:11.369201  6296 leader_election.cc:290] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:11.369876  6549 raft_consensus.cc:2749] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:11.369445  6307 consensus_queue.cc:260] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:11.370821  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:11.371984  3950 raft_consensus.cc:2410] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:15:11.372239  6585 raft_consensus.cc:2749] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:11.372519  6554 raft_consensus.cc:2749] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:11.374423  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:11.375281  4071 leader_election.cc:304] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:11.350737  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 130054us
I20260709 13:15:11.351450  4074 leader_election.cc:304] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:11.353674  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:11.353770  3925 leader_election.cc:304] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:11.373090  4704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:11.380367  3955 raft_consensus.cc:2468] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 7.
I20260709 13:15:11.354127  3954 raft_consensus.cc:2393] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 in current term 5: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:11.331723  6533 raft_consensus.cc:2804] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:11.354112  4073 leader_election.cc:304] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:11.348960  6348 raft_consensus.cc:2804] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:11.372963  6585 raft_consensus.cc:3060] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:11.384052  4708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
W20260709 13:15:11.384537  3905 auto_rebalancer.cc:629] Failed to schedule move for tablet 256a58e0d11d473c899ea90e30dbd511: Illegal state: Replica 8952c48a6f3a43968f7d77f7bfc4d1bc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:11.385056  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:11.385452  6307 raft_consensus.cc:3060] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:11.385493  6554 raft_consensus.cc:2749] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:11.397773  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:11.402527  3957 raft_consensus.cc:3060] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:11.328863  6543 consensus_queue.cc:1048] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
W20260709 13:15:11.403823  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 50158.1us
I20260709 13:15:11.404721  3925 leader_election.cc:304] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:11.405069  6560 consensus_queue.cc:237] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:11.403126  3956 raft_consensus.cc:1240] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:11.411113  4071 leader_election.cc:304] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:15:11.411935  6296 raft_consensus.cc:2804] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:11.412470  6296 raft_consensus.cc:493] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:11.413038  6296 raft_consensus.cc:3060] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:11.414495  3925 leader_election.cc:304] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:11.415089  6597 consensus_queue.cc:1048] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:15:11.390013  6348 raft_consensus.cc:493] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:11.419914  6348 raft_consensus.cc:3060] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:11.420042  6544 raft_consensus.cc:2804] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:11.420637  6544 raft_consensus.cc:697] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 7 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:11.420890  6545 leader_election.cc:290] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:11.421633  6544 consensus_queue.cc:237] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:11.428460  5962 consensus_queue.cc:1059] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:11.429625  5962 raft_consensus.cc:3055] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:11.429986  5962 raft_consensus.cc:740] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:11.429733  6573 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:11.409515  6589 raft_consensus.cc:2749] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:11.431587  6547 raft_consensus.cc:515] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:11.433527  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 82147.5us
I20260709 13:15:11.434943  3952 raft_consensus.cc:2468] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 6.
I20260709 13:15:11.437391  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:11.437906  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
W20260709 13:15:11.438664  4672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:11.438664  4033 raft_consensus.cc:2393] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 5: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
I20260709 13:15:11.439172  4027 raft_consensus.cc:1240] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 6. Current term is 7. Ops: [5.3-6.4]
I20260709 13:15:11.430934  5962 consensus_queue.cc:260] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:11.434942  4074 leader_election.cc:304] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:11.444377  4034 raft_consensus.cc:1240] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:15:11.448248  4103 raft_consensus.cc:2468] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 5.
I20260709 13:15:11.390976  6533 raft_consensus.cc:493] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:11.449802  4073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 95764.9us
I20260709 13:15:11.389595  6572 raft_consensus.cc:2804] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:11.456646  6572 raft_consensus.cc:493] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:11.457142  4073 leader_election.cc:304] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:11.450332  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:11.453537  4034 raft_consensus.cc:1240] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:11.454617  4030 raft_consensus.cc:2468] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 8.
I20260709 13:15:11.459941  3925 leader_election.cc:304] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:11.462718  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:11.463462  3952 raft_consensus.cc:2376] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d709ee666b774ec29aa732e508219938 in term 7. Re-sending same reply.
I20260709 13:15:11.463694  6533 raft_consensus.cc:3060] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:11.464946  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 53879.5us
I20260709 13:15:11.449024  6549 raft_consensus.cc:493] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.466794  6549 raft_consensus.cc:515] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:11.467235  6512 raft_consensus.cc:3055] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:11.467695  6512 raft_consensus.cc:740] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:11.467772  5954 raft_consensus.cc:2804] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:11.468281  5954 raft_consensus.cc:493] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:11.468710  5954 raft_consensus.cc:3060] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:11.468621  6512 consensus_queue.cc:260] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:11.469990  6549 leader_election.cc:290] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:11.470163  6512 raft_consensus.cc:3060] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:11.463928  6572 raft_consensus.cc:3060] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:11.471761  6515 raft_consensus.cc:2804] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:11.472491  6515 raft_consensus.cc:697] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:11.473519  6515 consensus_queue.cc:237] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:11.476758  4074 leader_election.cc:304] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:11.476833  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:11.480089  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:11.480435  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:11.481303  4033 raft_consensus.cc:2410] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:15:11.482101  4032 raft_consensus.cc:1275] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:11.482575  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
W20260709 13:15:11.483042  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:11.485493  6376 raft_consensus.cc:493] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.485507  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:11.489298  3952 raft_consensus.cc:1275] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:15:11.489840  3950 raft_consensus.cc:2376] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d709ee666b774ec29aa732e508219938 in term 7. Re-sending same reply.
I20260709 13:15:11.490473  3956 raft_consensus.cc:1275] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:11.484783  3997 leader_election.cc:304] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:11.490648  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:11.491331  3952 raft_consensus.cc:2468] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 7.
I20260709 13:15:11.488725  6376 raft_consensus.cc:515] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:11.493551  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:11.494282  3958 raft_consensus.cc:2468] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 6.
I20260709 13:15:11.495215  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:11.492632  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:11.505962  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:11.493040  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:11.492471  6431 raft_consensus.cc:2764] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:15:11.506676  4108 raft_consensus.cc:2468] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 6.
I20260709 13:15:11.506786  4074 leader_election.cc:304] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:11.495720  6570 raft_consensus.cc:493] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.496632  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:11.497588  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:11.504747  4071 leader_election.cc:304] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:11.507098  3959 raft_consensus.cc:2468] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 4.
I20260709 13:15:11.495456  6376 leader_election.cc:290] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:11.510913  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:11.512100  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:11.454901  6432 raft_consensus.cc:2749] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:11.461743  6516 raft_consensus.cc:2749] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:11.519375  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:11.491422  3997 leader_election.cc:304] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
W20260709 13:15:11.527164  3925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:11.528823  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:11.475831  6554 raft_consensus.cc:2749] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:11.536780  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:11.538955  4107 raft_consensus.cc:2468] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 5.
I20260709 13:15:11.495795  6315 raft_consensus.cc:3055] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:11.531127  3997 leader_election.cc:304] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:11.536734  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:11.487516  6544 raft_consensus.cc:2804] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:11.540407  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:11.490206  6556 raft_consensus.cc:2804] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:11.537199  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:11.552382  3950 raft_consensus.cc:2468] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 7.
I20260709 13:15:11.552644  4032 raft_consensus.cc:2468] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 5.
I20260709 13:15:11.504034  6357 raft_consensus.cc:2749] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:11.478343  6520 consensus_queue.cc:1059] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 13:15:11.553380  3924 leader_election.cc:304] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:11.534547  3925 leader_election.cc:304] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:11.545936  4099 consensus_queue.cc:237] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:15:11.549170  3952 raft_consensus.cc:2468] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 7.
I20260709 13:15:11.550992  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:11.560195  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:11.461998  6527 consensus_queue.cc:1059] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.071s
I20260709 13:15:11.560705  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:11.538767  6447 raft_consensus.cc:2804] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:15:11.570159  3855 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52094 (request call id 199) took 13820 ms (client timeout 15000 ms). Trace:
I20260709 13:15:11.531128  6560 raft_consensus.cc:2749] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:11.486639  6584 consensus_queue.cc:1059] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:15:11.540858  6376 raft_consensus.cc:2804] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:11.540627  4104 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1851e462889842a49d577d585d278117"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:15:11.586634  4104 raft_consensus.cc:606] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Received request to transfer leadership to TS 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:11.587052  4104 raft_consensus.cc:614] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:11.576815  3856 catalog_manager.cc:5697] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 reported cstate change: term changed from 3 to 4, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 4 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:15:11.525043  6570 raft_consensus.cc:515] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:11.581807  6532 raft_consensus.cc:3055] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:11.537760  6589 consensus_queue.cc:1048] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:15:11.527462  6350 consensus_queue.cc:1048] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:15:11.551681  5962 raft_consensus.cc:3060] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:11.583853  3956 raft_consensus.cc:2410] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:15:11.551782  6315 raft_consensus.cc:740] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:11.572891  6556 raft_consensus.cc:697] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:11.573145  6447 raft_consensus.cc:493] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:11.561556  6588 raft_consensus.cc:2749] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:11.586241  6376 raft_consensus.cc:493] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:11.562071  6549 raft_consensus.cc:2804] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:11.567207  6522 raft_consensus.cc:2749] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:11.562906  6573 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:11.662127  3856 catalog_manager.cc:5697] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 reported cstate change: term changed from 4 to 5, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to d709ee666b774ec29aa732e508219938 (127.2.198.196). New cstate: current_term: 5 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:11.618175  6527 raft_consensus.cc:493] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.593703  3997 leader_election.cc:304] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:11.541914  6529 consensus_queue.cc:1048] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:15:11.571337  6582 raft_consensus.cc:2749] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:11.610838  3954 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 7.
W20260709 13:15:11.620195  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 113480us
W20260709 13:15:11.624899  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 120372us
W20260709 13:15:11.634063  3922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:11.675684  4071 leader_election.cc:304] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:11.586211  5954 raft_consensus.cc:515] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:11.553428  6544 raft_consensus.cc:493] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:11.571398  6431 consensus_queue.cc:1048] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:15:11.607896  6521 raft_consensus.cc:3055] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:11.601792  6532 raft_consensus.cc:740] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:11.628376  6516 raft_consensus.cc:493] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:11.671787  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 123441us
I20260709 13:15:11.662094  6447 raft_consensus.cc:3060] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:11.665962  6604 log.cc:927] Time spent T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:15:11.670141  6547 leader_election.cc:290] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:11.700991  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:11.699263  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:11.664677  6376 raft_consensus.cc:3060] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:11.600742  6296 raft_consensus.cc:515] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:11.683302  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:11.705348  3951 raft_consensus.cc:2468] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 4.
I20260709 13:15:11.684650  4107 raft_consensus.cc:1240] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:11.682186  6521 raft_consensus.cc:740] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:11.686625  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:11.687709  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:11.698033  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:11.678174  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:11.698783  3856 catalog_manager.cc:5697] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 reported cstate change: term changed from 4 to 5, leader changed from 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) to d709ee666b774ec29aa732e508219938 (127.2.198.196). New cstate: current_term: 5 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:11.697831  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:11.709960  4105 raft_consensus.cc:2393] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 6: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:11.698419  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:11.683290  6544 raft_consensus.cc:3060] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:11.714203  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:11.710284  4106 raft_consensus.cc:2468] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
W20260709 13:15:11.573297  3855 rpcz_store.cc:269] 0709 13:14:57.737920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.738274 (+   354us) service_pool.cc:224] Handling call
0709 13:15:11.557544 (+13819270us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:09.489113 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:09.532379 (+ 43266us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:09.532454 (+    75us) write_op.cc:435] Acquired schema lock
0709 13:15:09.532476 (+    22us) tablet.cc:662] Decoding operations
0709 13:15:09.533814 (+  1338us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:09.533925 (+   111us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:09.533956 (+    31us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:15:09.535196 (+  1240us) tablet.cc:701] Row locks acquired
0709 13:15:09.535265 (+    69us) write_op.cc:260] PREPARE: finished
0709 13:15:09.535448 (+   183us) write_op.cc:270] Start()
0709 13:15:09.573074 (+ 37626us) write_op.cc:276] Timestamp: P: 1783602909535373 usec, L: 0
0709 13:15:09.573102 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:15:09.573911 (+   809us) log.cc:844] Serialized 4010 byte log entry
0709 13:15:10.612150 (+1038239us) op_driver.cc:464] REPLICATION: finished
0709 13:15:10.880696 (+268546us) write_op.cc:301] APPLY: starting
0709 13:15:10.880813 (+   117us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:10.881118 (+   305us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:10.881247 (+   129us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:10.882649 (+  1402us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:10.882983 (+   334us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:15:10.883045 (+    62us) write_op.cc:312] APPLY: finished
0709 13:15:10.883440 (+   395us) log.cc:844] Serialized 77 byte log entry
0709 13:15:10.917185 (+ 33745us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:10.927723 (+ 10538us) write_op.cc:454] Released schema lock
0709 13:15:10.938479 (+ 10756us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:11.035778 (+ 97299us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:11.035824 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":360,"reported_tablets":35,"child_traces":[["op",{"apply.queue_time_us":205726,"apply.run_cpu_time_us":4185,"apply.run_wall_time_us":155040,"num_ops":10,"prepare.queue_time_us":367647,"prepare.run_cpu_time_us":24741,"prepare.run_wall_time_us":213767,"raft.queue_time_us":416365,"raft.run_cpu_time_us":15079,"raft.run_wall_time_us":95833,"replication_time_us":1038839,"thread_start_us":742839,"threads_started":4,"wal-append.queue_time_us":185829}]]}
I20260709 13:15:11.707791  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:11.684942  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:11.721316  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:11.721944  4105 raft_consensus.cc:2468] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 5.
I20260709 13:15:11.722298  4107 raft_consensus.cc:1240] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:15:11.700961  6554 raft_consensus.cc:2804] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:11.720240  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:11.723080  6554 raft_consensus.cc:493] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:11.723274  4101 raft_consensus.cc:2468] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
I20260709 13:15:11.723719  6554 raft_consensus.cc:3060] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:11.724449  4101 raft_consensus.cc:1240] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:11.722411  4103 raft_consensus.cc:1240] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:11.711233  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:11.725695  4104 raft_consensus.cc:2393] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 5: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:11.725910  4101 raft_consensus.cc:1275] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:11.680371  6527 raft_consensus.cc:515] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:11.728510  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:11.729936  3953 raft_consensus.cc:2393] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 6: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:11.730621  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:11.730682  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:11.731626  4106 raft_consensus.cc:2368] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 5. Current term is 6.
I20260709 13:15:11.732720  4071 leader_election.cc:304] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:11.735342  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:11.735996  4100 raft_consensus.cc:3060] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:11.697932  6516 raft_consensus.cc:515] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:11.719897  6547 raft_consensus.cc:2804] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:11.743160  4103 raft_consensus.cc:1275] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:15:11.743574  4103 pending_rounds.cc:85] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Aborting all ops after (but not including) 3
I20260709 13:15:11.743882  3954 raft_consensus.cc:2393] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 6: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:11.743813  4103 pending_rounds.cc:107] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:15:11.744417  4103 raft_consensus.cc:2889] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:11.748535  6296 leader_election.cc:290] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:11.750679  6516 leader_election.cc:290] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:11.751986  6570 leader_election.cc:290] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:11.691519  6315 consensus_queue.cc:260] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:11.752133  6521 consensus_queue.cc:260] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:11.753305  6315 raft_consensus.cc:3060] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:11.753510  6521 raft_consensus.cc:3060] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:11.756057  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:11.757030  3950 raft_consensus.cc:2393] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 7: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
I20260709 13:15:11.765532  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:11.767095  4104 raft_consensus.cc:2468] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 5.
I20260709 13:15:11.769937  3957 raft_consensus.cc:2468] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 6.
I20260709 13:15:11.757938  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:11.772389  3856 catalog_manager.cc:5697] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 reported cstate change: term changed from 2 to 3, leader changed from 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 3 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:15:11.775940  6348 raft_consensus.cc:515] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:11.782229  4073 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:11.790153  4101 raft_consensus.cc:1275] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:15:11.790562  4101 pending_rounds.cc:85] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Aborting all ops after (but not including) 3
I20260709 13:15:11.790783  4101 pending_rounds.cc:107] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:15:11.791034  4101 raft_consensus.cc:2889] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:11.773145  4100 raft_consensus.cc:2468] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7.
I20260709 13:15:11.742830  6610 raft_consensus.cc:2749] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:11.794270  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:11.795060  6572 raft_consensus.cc:515] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:11.795276  3856 catalog_manager.cc:5697] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 reported cstate change: term changed from 3 to 4, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 4 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:15:11.796264  3958 raft_consensus.cc:1240] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:11.795756  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:11.797415  6572 leader_election.cc:290] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:11.796953  3856 catalog_manager.cc:5697] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 reported cstate change: term changed from 1 to 4, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to d709ee666b774ec29aa732e508219938 (127.2.198.196). New cstate: current_term: 4 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:11.797802  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:11.802496  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:11.803413  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:11.804333  3957 raft_consensus.cc:2376] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 6. Re-sending same reply.
I20260709 13:15:11.784170  4107 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:15:11.764964  6547 raft_consensus.cc:493] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:11.756253  6532 consensus_queue.cc:260] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:11.806021  3856 catalog_manager.cc:5697] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:11.810521  5954 leader_election.cc:290] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:11.809999  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:11.813956  4104 raft_consensus.cc:1275] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:15:11.843375  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:11.880678  4028 raft_consensus.cc:1275] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:11.881599  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:11.882252  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:11.883037  4102 raft_consensus.cc:3060] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:11.884459  4101 raft_consensus.cc:1240] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:11.886675  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:11.887650  4101 raft_consensus.cc:2468] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
I20260709 13:15:11.889292  4074 leader_election.cc:304] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:11.890684  4672 leader_election.cc:304] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:11.892481  4672 leader_election.cc:304] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:11.898784  4704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:11.899680  4704 raft_consensus.cc:2393] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 6: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
I20260709 13:15:11.802006  6560 raft_consensus.cc:2749] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:15:11.810266  6616 log.cc:927] Time spent T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:15:11.920045  4104 raft_consensus.cc:1240] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:11.740675  6556 consensus_queue.cc:237] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:11.828598  6527 leader_election.cc:290] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:11.909708  6631 raft_consensus.cc:2749] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:11.924729  6453 consensus_queue.cc:1048] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:11.853657  6547 raft_consensus.cc:3060] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:11.909710  6630 raft_consensus.cc:2749] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:11.928921  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:11.947670  4102 raft_consensus.cc:2468] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
I20260709 13:15:11.948458  3957 raft_consensus.cc:2393] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 6: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:11.943117  6573 raft_consensus.cc:2749] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:11.826741  6591 raft_consensus.cc:515] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:11.931489  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:11.934422  3955 raft_consensus.cc:2468] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 6.
I20260709 13:15:11.798411  6533 raft_consensus.cc:515] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:11.937386  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 48207.8us
I20260709 13:15:11.940754  4071 leader_election.cc:304] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:11.931154  6348 leader_election.cc:290] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:11.935161  6447 raft_consensus.cc:515] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:11.954996  4074 leader_election.cc:304] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:11.947758  6549 raft_consensus.cc:697] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
W20260709 13:15:11.950980  6559 consensus_meta.cc:287] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 0.583s	user 0.011s	sys 0.001s
W20260709 13:15:11.994385  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 53746.6us
I20260709 13:15:11.999630  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:12.000715  3957 raft_consensus.cc:2368] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 5. Current term is 6.
W20260709 13:15:11.961169  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 367533us
I20260709 13:15:12.005811  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:12.006317  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:15:12.009337  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 56714.6us
I20260709 13:15:12.009341  4032 raft_consensus.cc:1240] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:11.989863  6560 raft_consensus.cc:2749] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:12.013375  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:15:12.001703  6580 log.cc:927] Time spent T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:15:11.999348  6570 raft_consensus.cc:2804] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:12.020210  6554 raft_consensus.cc:515] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:12.010259  6512 consensus_meta.cc:287] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.540s	user 0.011s	sys 0.003s
W20260709 13:15:12.011876  6616 log.cc:927] Time spent T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 13:15:12.033888  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 141497us
I20260709 13:15:12.054600  4672 leader_election.cc:304] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:12.033686  3997 leader_election.cc:304] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:12.036813  4034 raft_consensus.cc:1275] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:12.044602  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:12.045239  6628 consensus_queue.cc:1048] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:15:12.047884  3924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:12.056609  3997 leader_election.cc:304] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:12.062788  3957 raft_consensus.cc:2468] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 6.
I20260709 13:15:12.062934  4107 raft_consensus.cc:606] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Received request to transfer leadership to TS 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:12.063441  4107 raft_consensus.cc:614] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:12.063563  3997 leader_election.cc:304] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:12.065121  4071 leader_election.cc:304] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:15:12.066128  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:12.066859  4034 raft_consensus.cc:2468] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 5.
I20260709 13:15:12.068571  6560 raft_consensus.cc:2804] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:12.061131  6623 raft_consensus.cc:2804] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:12.069226  6560 raft_consensus.cc:697] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:12.070616  6447 leader_election.cc:290] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:12.070374  6560 consensus_queue.cc:237] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:12.071740  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:12.073248  6376 raft_consensus.cc:515] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:12.061848  3952 raft_consensus.cc:2468] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 6.
I20260709 13:15:12.075850  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:12.077531  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:12.033123  6570 raft_consensus.cc:493] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.008080  6559 raft_consensus.cc:515] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:12.078606  3997 leader_election.cc:304] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:12.080535  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:12.084374  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:12.085273  4028 raft_consensus.cc:2468] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 5.
I20260709 13:15:12.120983  4034 raft_consensus.cc:1275] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:15:12.071863  6612 raft_consensus.cc:2804] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:12.139753  6612 raft_consensus.cc:493] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:12.139889  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:12.140246  6612 raft_consensus.cc:3060] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:12.140878  3953 raft_consensus.cc:2393] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 5: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:12.141927  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:12.142620  4074 leader_election.cc:304] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:12.082132  6570 raft_consensus.cc:3060] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:12.143813  4074 leader_election.cc:304] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:12.120927  6623 raft_consensus.cc:697] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:12.148669  6623 consensus_queue.cc:237] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:12.151504  6566 raft_consensus.cc:2804] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:12.152033  6566 raft_consensus.cc:493] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.152179  6573 raft_consensus.cc:2804] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:12.152482  6566 raft_consensus.cc:3060] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:12.152766  6573 raft_consensus.cc:493] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.153259  6573 raft_consensus.cc:3060] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:12.060158  6547 raft_consensus.cc:515] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:12.156100  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:12.156811  4106 raft_consensus.cc:2376] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 7. Re-sending same reply.
I20260709 13:15:12.157630  6547 leader_election.cc:290] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:12.158406  4102 raft_consensus.cc:1240] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:15:12.162565  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:15:12.122069  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 67636.5us
W20260709 13:15:12.166561  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 76843.6us
I20260709 13:15:12.167143  4071 leader_election.cc:304] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:12.164209  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:12.125178  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:12.124795  3952 raft_consensus.cc:2468] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 5.
I20260709 13:15:12.126811  6624 raft_consensus.cc:2804] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:12.169554  3957 raft_consensus.cc:2393] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 5: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:12.122537  6603 consensus_queue.cc:1048] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:15:12.128053  6554 leader_election.cc:290] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:12.129053  6591 leader_election.cc:290] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:12.129379  6632 raft_consensus.cc:2749] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:12.130779  6533 leader_election.cc:290] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:12.132314  6544 raft_consensus.cc:515] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:12.187608  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:12.188355  3957 raft_consensus.cc:2468] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 6.
W20260709 13:15:12.133509  6585 consensus_meta.cc:287] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.725s	user 0.007s	sys 0.005s
I20260709 13:15:12.142583  3953 raft_consensus.cc:2468] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 7.
I20260709 13:15:12.168506  6627 raft_consensus.cc:2804] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:12.174841  6624 raft_consensus.cc:493] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.175196  4672 leader_election.cc:304] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:12.172987  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:12.198887  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:12.181219  4708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:12.181702  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:12.182991  4029 raft_consensus.cc:2368] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 5. Current term is 6.
I20260709 13:15:12.199911  4708 raft_consensus.cc:3060] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:12.199941  4028 raft_consensus.cc:3060] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:12.200690  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:12.178094  3955 raft_consensus.cc:2468] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 6.
I20260709 13:15:12.179473  6350 raft_consensus.cc:2749] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:12.186591  4073 consensus_peers.cc:597] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117): Couldn't send request to peer d709ee666b774ec29aa732e508219938. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 649df91131174f00af0e0a0240f80adb. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:12.012651  6549 consensus_queue.cc:237] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:12.201633  3953 raft_consensus.cc:2468] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 4.
I20260709 13:15:12.221571  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:12.211097  4105 raft_consensus.cc:1240] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 LEADER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:12.211136  4030 raft_consensus.cc:1275] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:15:12.212201  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:12.224280  4025 raft_consensus.cc:3060] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:15:12.213281  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:12.224987  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:12.214027  3952 raft_consensus.cc:2393] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 5: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:12.226572  3953 raft_consensus.cc:3060] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:12.226922  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:12.216358  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:12.225850  4030 raft_consensus.cc:3060] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:12.230805  3950 raft_consensus.cc:2368] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 8. Current term is 9.
I20260709 13:15:12.235735  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:12.236562  3952 raft_consensus.cc:2368] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 5. Current term is 6.
W20260709 13:15:12.239854  3924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:12.219554  6627 raft_consensus.cc:697] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:12.195977  6624 raft_consensus.cc:3060] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:12.241665  6622 raft_consensus.cc:2804] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:12.251272  6622 raft_consensus.cc:493] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:12.251685  6622 raft_consensus.cc:3060] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:12.253512  3951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35354 (request call id 208) took 1053 ms. Trace:
I20260709 13:15:12.254174  3951 rpcz_store.cc:276] 0709 13:15:11.199877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.208576 (+  8699us) service_pool.cc:224] Handling call
0709 13:15:12.253219 (+1044643us) spinlock_profiling.cc:243] Waited 435 ms on lock 0x7b54002184d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:12.253413 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":999877888}
W20260709 13:15:12.255702  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 80582.3us
I20260709 13:15:12.257863  4672 leader_election.cc:304] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:12.268692  5757 raft_consensus.cc:2749] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:12.195596  6585 raft_consensus.cc:2749] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:12.246181  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:12.246840  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:12.272970  3957 raft_consensus.cc:2393] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 4: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
W20260709 13:15:12.273994  3922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:12.276623  3956 raft_consensus.cc:2468] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 6.
I20260709 13:15:12.249213  6376 leader_election.cc:290] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:12.281836  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:12.282581  4099 raft_consensus.cc:3060] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:12.283697  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:12.284201  3952 raft_consensus.cc:2393] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 5: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:12.230585  6556 raft_consensus.cc:493] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.294680  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:12.285789  3922 leader_election.cc:304] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:12.289784  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:12.298612  4025 raft_consensus.cc:2468] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
I20260709 13:15:12.289844  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:12.291106  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:12.305761  3959 raft_consensus.cc:2468] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 5.
I20260709 13:15:12.246706  6559 leader_election.cc:290] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:12.301429  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 176424us
I20260709 13:15:12.304297  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:12.308152  3922 leader_election.cc:304] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:12.287590  4028 raft_consensus.cc:2468] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 8.
I20260709 13:15:12.249164  6532 raft_consensus.cc:3060] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:12.220530  6591 consensus_queue.cc:1048] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 13:15:12.301904  4103 raft_consensus.cc:2468] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 8.
I20260709 13:15:12.319021  4672 leader_election.cc:304] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:12.307020  6533 raft_consensus.cc:2749] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:12.321476  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:12.322525  3951 raft_consensus.cc:2468] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 7.
I20260709 13:15:12.313256  3925 leader_election.cc:304] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:12.269487  6521 consensus_queue.cc:1059] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:15:12.332525  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:12.333199  4672 leader_election.cc:304] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:12.246192  6348 consensus_queue.cc:1048] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 13:15:12.335971  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:12.336853  4031 raft_consensus.cc:3060] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:15:12.338850  4672 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:12.346629  4099 raft_consensus.cc:2468] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
I20260709 13:15:12.301496  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:12.312654  4074 leader_election.cc:304] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:12.351738  3956 raft_consensus.cc:3060] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:12.320045  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:12.319682  3922 leader_election.cc:304] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:12.351599  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:12.358772  6376 raft_consensus.cc:2804] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:12.359666  6376 raft_consensus.cc:697] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:12.360697  6376 consensus_queue.cc:237] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:12.362586  6296 raft_consensus.cc:3055] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:12.363054  6296 raft_consensus.cc:740] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:12.352221  6453 raft_consensus.cc:2804] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:12.364472  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:12.365232  3951 raft_consensus.cc:3060] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:12.366575  6582 consensus_queue.cc:1059] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:12.367502  6613 raft_consensus.cc:2804] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:12.374109  3953 raft_consensus.cc:2468] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 8.
I20260709 13:15:12.377259  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:12.378070  3959 raft_consensus.cc:2468] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 6.
I20260709 13:15:12.378245  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:12.328073  6546 raft_consensus.cc:2749] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:15:12.381834  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 62280.6us
I20260709 13:15:12.382874  3922 leader_election.cc:304] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:12.384099  4108 raft_consensus.cc:1240] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 LEADER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:15:12.358853  6612 raft_consensus.cc:515] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:12.386286  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:12.386987  3952 raft_consensus.cc:3060] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:12.386922  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:12.248847  6627 consensus_queue.cc:237] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:12.418756  4031 raft_consensus.cc:2468] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
I20260709 13:15:12.309203  6556 raft_consensus.cc:515] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:12.390831  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:12.321516  6603 consensus_queue.cc:1059] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:15:12.352064  6538 consensus_queue.cc:1048] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:15:12.352291  6554 raft_consensus.cc:493] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.398070  6566 raft_consensus.cc:515] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:12.380961  6559 consensus_queue.cc:1048] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:15:12.338672  6572 raft_consensus.cc:2804] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:12.406464  6570 raft_consensus.cc:515] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:12.406949  6612 leader_election.cc:290] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:12.407734  4025 raft_consensus.cc:1240] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:12.412241  6296 consensus_queue.cc:260] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:12.403533  3997 leader_election.cc:304] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:12.352465  6585 raft_consensus.cc:493] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.422212  3922 leader_election.cc:304] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:12.423801  3959 raft_consensus.cc:3060] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:12.423947  4030 raft_consensus.cc:2468] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
I20260709 13:15:12.388490  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:12.358160  3957 raft_consensus.cc:2468] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 6.
I20260709 13:15:12.429011  4708 raft_consensus.cc:2468] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 8.
I20260709 13:15:12.431490  3956 raft_consensus.cc:2468] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 5.
I20260709 13:15:12.436004  3951 raft_consensus.cc:2468] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 8.
I20260709 13:15:12.428555  6546 raft_consensus.cc:2749] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:12.416692  6533 raft_consensus.cc:2749] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:15:12.477595  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 74164.6us
I20260709 13:15:12.470017  4031 raft_consensus.cc:1275] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:12.452898  3952 raft_consensus.cc:2468] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 8.
I20260709 13:15:12.478551  3997 leader_election.cc:304] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:12.485641  4030 raft_consensus.cc:1275] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:15:12.485918  3956 raft_consensus.cc:1275] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:12.487875  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:12.488691  3957 raft_consensus.cc:3055] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:12.489044  3957 raft_consensus.cc:740] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:12.490907  3952 raft_consensus.cc:1275] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:15:12.493106  3997 leader_election.cc:400] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Vote denied by peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339) with higher term. Message: Invalid argument: T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 5. Current term is 6.
I20260709 13:15:12.493594  3997 leader_election.cc:403] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:12.496353  4030 raft_consensus.cc:1240] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:12.496644  3957 consensus_queue.cc:260] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:12.511016  3957 raft_consensus.cc:3060] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:12.451282  6554 raft_consensus.cc:515] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:12.483810  6034 raft_consensus.cc:2764] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:15:12.497516  6547 raft_consensus.cc:3060] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:12.533979  4073 leader_election.cc:304] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:12.490124  6447 raft_consensus.cc:2749] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:12.524104  6540 raft_consensus.cc:3055] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:12.502867  6549 raft_consensus.cc:2749] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339) with higher term. Message: Invalid argument: T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 5. Current term is 6.
I20260709 13:15:12.504410  4031 raft_consensus.cc:1240] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 6. Current term is 7. Ops: [5.3-6.4]
I20260709 13:15:12.495587  6296 raft_consensus.cc:3060] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:12.486912  6624 raft_consensus.cc:515] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:12.530109  3957 raft_consensus.cc:2410] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:15:12.515046  3997 leader_election.cc:304] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:12.532294  4704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:12.548243  4704 raft_consensus.cc:3060] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:12.528288  6582 consensus_queue.cc:1243] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer 8952c48a6f3a43968f7d77f7bfc4d1bc log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:15:12.542795  6613 raft_consensus.cc:697] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 6 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:12.510656  6533 raft_consensus.cc:493] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.511059  6453 raft_consensus.cc:697] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 7 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:12.484704  6585 raft_consensus.cc:515] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:12.590363  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 75536.2us
I20260709 13:15:12.593146  3957 raft_consensus.cc:1240] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:12.596930  3997 leader_election.cc:304] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:12.584980  6604 log.cc:927] Time spent T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:15:12.544845  6540 raft_consensus.cc:740] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:12.587658  6559 raft_consensus.cc:493] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:12.637725  4033 raft_consensus.cc:1240] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:15:12.544695  6572 raft_consensus.cc:697] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 6 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:12.547885  6546 raft_consensus.cc:2749] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:12.547298  6609 raft_consensus.cc:2804] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:12.584861  6612 raft_consensus.cc:2749] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:12.633663  3957 raft_consensus.cc:1275] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:12.649820  3957 raft_consensus.cc:1275] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:15:12.633315  6540 consensus_queue.cc:260] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:12.645085  3925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:12.647174  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 50406.2us
I20260709 13:15:12.654167  3997 leader_election.cc:304] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:12.634645  6559 raft_consensus.cc:515] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:12.638732  6549 raft_consensus.cc:3060] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:12.594792  6533 raft_consensus.cc:515] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:12.668490  6638 log.cc:927] Time spent T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:15:12.669412  3958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1788) took 1176 ms. Trace:
I20260709 13:15:12.670423  3957 raft_consensus.cc:1240] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:12.669866  6613 consensus_queue.cc:237] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:12.670083  6453 consensus_queue.cc:237] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:12.671998  6624 leader_election.cc:290] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:12.597972  6622 raft_consensus.cc:515] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:12.674384  6622 leader_election.cc:290] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:12.674896  6585 leader_election.cc:290] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:12.675066  6572 consensus_queue.cc:237] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:12.676757  6554 leader_election.cc:290] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:12.599202  6573 raft_consensus.cc:515] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:12.679232  6573 leader_election.cc:290] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:12.655715  6609 raft_consensus.cc:697] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:12.679957  3954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38612 (request call id 1048) took 1005 ms. Trace:
I20260709 13:15:12.663712  6447 raft_consensus.cc:2749] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:12.680320  3954 rpcz_store.cc:276] 0709 13:15:11.674290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.677899 (+  3609us) service_pool.cc:224] Handling call
0709 13:15:12.679773 (+1001874us) spinlock_profiling.cc:243] Waited 33.6 ms on lock 0x7b5400429854. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:12.679902 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":77355264}
I20260709 13:15:12.663297  6540 raft_consensus.cc:3060] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:12.680325  6609 consensus_queue.cc:237] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:12.690038  4108 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:15:12.669828  3958 rpcz_store.cc:276] 0709 13:15:11.493381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.592314 (+ 98933us) service_pool.cc:224] Handling call
0709 13:15:11.604056 (+ 11742us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:11.796705 (+192649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:12.669130 (+872425us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b54002873d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:12.669331 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":441596288}
I20260709 13:15:12.690863  4108 raft_consensus.cc:606] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Received request to transfer leadership to TS 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:12.691239  4108 raft_consensus.cc:614] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:12.691365  3959 raft_consensus.cc:2468] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 7.
I20260709 13:15:12.692094  3951 raft_consensus.cc:1240] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:12.694769  6559 leader_election.cc:290] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:15:12.696065  6636 log.cc:927] Time spent T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.448s	user 0.001s	sys 0.001s
I20260709 13:15:12.697140  4108 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:15:12.697773  4108 raft_consensus.cc:606] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Received request to transfer leadership to TS 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:12.698079  4108 raft_consensus.cc:614] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:12.698596  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:12.702023  4106 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "d709ee666b774ec29aa732e508219938"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:15:12.702521  6570 leader_election.cc:290] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:12.702620  4106 raft_consensus.cc:606] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Received request to transfer leadership to TS d709ee666b774ec29aa732e508219938
W20260709 13:15:12.708591  6640 log.cc:927] Time spent T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:15:12.709389  6566 leader_election.cc:290] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:12.711015  2843 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:15:12.703230  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 281106us
I20260709 13:15:12.731667  2843 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:15:12.735618  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:12.739464  4704 raft_consensus.cc:2468] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 8.
W20260709 13:15:12.750875  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 96792.5us
I20260709 13:15:12.752483  3997 leader_election.cc:304] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:12.757015  6623 raft_consensus.cc:2764] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:15:12.760243  6549 raft_consensus.cc:2749] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:12.761520  4706 raft_consensus.cc:1240] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:12.764189  3953 raft_consensus.cc:2410] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:15:12.766451  3953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38612 (request call id 1089) took 1003 ms. Trace:
I20260709 13:15:12.766829  3953 rpcz_store.cc:276] 0709 13:15:11.763397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:12.388178 (+624781us) service_pool.cc:224] Handling call
0709 13:15:12.766256 (+378078us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b5400217fd4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:12.766394 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":662423424}
I20260709 13:15:12.767571  6547 raft_consensus.cc:2749] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:12.771056  3999 leader_election.cc:304] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:12.771260  3997 leader_election.cc:304] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:12.751252  6522 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.004s	user 0.015s	sys 0.000s
W20260709 13:15:12.773958  6522 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.027s	user 0.015s	sys 0.000s
I20260709 13:15:12.774151  6376 consensus_queue.cc:1059] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:12.774539  6547 raft_consensus.cc:2804] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:12.775131  6547 raft_consensus.cc:697] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:12.775333  6376 raft_consensus.cc:3055] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:12.775772  6376 raft_consensus.cc:740] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:12.777868  3997 leader_election.cc:304] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:12.779816  3950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38612 (request call id 1073) took 1035 ms. Trace:
I20260709 13:15:12.780207  3950 rpcz_store.cc:276] 0709 13:15:11.744121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.797518 (+ 53397us) service_pool.cc:224] Handling call
0709 13:15:12.779608 (+982090us) spinlock_profiling.cc:243] Waited 424 ms on lock 0x7b5400383e54. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:12.779751 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":975661440}
I20260709 13:15:12.780637  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:12.783852  4104 raft_consensus.cc:1240] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:12.784798  4105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45332 (request call id 1631) took 1095 ms. Trace:
I20260709 13:15:12.779969  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:12.785171  4105 rpcz_store.cc:276] 0709 13:15:11.689006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.722541 (+ 33535us) service_pool.cc:224] Handling call
0709 13:15:11.722829 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:12.222521 (+499692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:12.784547 (+562026us) spinlock_profiling.cc:243] Waited 488 ms on lock 0x7b54002599d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:12.784730 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1122367232}
I20260709 13:15:12.798408  3925 leader_election.cc:304] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:12.799924  3925 leader_election.cc:304] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:12.803267  4030 raft_consensus.cc:1240] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:12.803755  6559 raft_consensus.cc:2749] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:12.777145  6650 raft_consensus.cc:493] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.807053  6650 raft_consensus.cc:515] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:12.807590  3997 leader_election.cc:304] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:12.808674  4704 raft_consensus.cc:1275] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:12.809105  6623 raft_consensus.cc:2749] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:12.809276  6650 leader_election.cc:290] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:12.809551  6567 consensus_queue.cc:1059] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:12.810676  3997 leader_election.cc:400] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Vote denied by peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339) with higher term. Message: Invalid argument: T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 5. Current term is 6.
I20260709 13:15:12.810775  6567 raft_consensus.cc:3055] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:12.811091  3997 leader_election.cc:403] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:12.811282  6567 raft_consensus.cc:740] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:12.789135  6549 raft_consensus.cc:2749] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:12.776618  6376 consensus_queue.cc:260] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:12.812443  6567 consensus_queue.cc:260] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:12.813513  6376 raft_consensus.cc:3060] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:12.814260  6549 raft_consensus.cc:2749] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339) with higher term. Message: Invalid argument: T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 5. Current term is 6.
I20260709 13:15:12.776098  6547 consensus_queue.cc:237] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:12.815896  6658 ts_tablet_manager.cc:933] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938: Initiating tablet copy from peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:12.817785  3997 leader_election.cc:304] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:12.825598  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:12.826053  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:12.826297  4104 raft_consensus.cc:3060] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:12.826658  4106 raft_consensus.cc:3060] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:12.827419  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:12.828229  4107 raft_consensus.cc:3060] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:12.832104  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:12.836928  4102 raft_consensus.cc:2393] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 6: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
W20260709 13:15:12.838428  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:12.848205  4032 raft_consensus.cc:1240] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:15:12.849418  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
W20260709 13:15:12.849701  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 77432.8us
I20260709 13:15:12.850003  4032 raft_consensus.cc:3060] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:12.851181  4108 raft_consensus.cc:1240] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 4. Current term is 5. Ops: []
W20260709 13:15:12.834685  6661 log.cc:927] Time spent T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:15:12.831935  6654 raft_consensus.cc:2804] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:12.854549  4104 raft_consensus.cc:2468] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 7.
I20260709 13:15:12.867365  4107 raft_consensus.cc:2468] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 7.
I20260709 13:15:12.834327  6447 raft_consensus.cc:2804] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:12.832127  6540 raft_consensus.cc:2804] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:12.875319  6453 consensus_queue.cc:1059] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:15:12.879124  4074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:12.852846  6543 raft_consensus.cc:493] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:12.882110  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 80770.6us
I20260709 13:15:12.882427  6573 raft_consensus.cc:493] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.835987  6624 consensus_queue.cc:1059] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:15:12.835109  6527 consensus_queue.cc:1048] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:15:12.893448  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:12.893781  3922 leader_election.cc:304] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:12.896358  4028 raft_consensus.cc:1240] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 LEADER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 4. Current term is 5. Ops: []
W20260709 13:15:12.893988  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:12.897280  3922 leader_election.cc:400] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843) with higher term. Message: Invalid argument: T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 5. Current term is 6.
I20260709 13:15:12.897531  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:12.904722  3997 leader_election.cc:304] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:12.898196  4028 raft_consensus.cc:3060] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:12.907183  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
W20260709 13:15:12.915747  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:12.924517  4027 raft_consensus.cc:2393] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 6: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:12.915220  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:12.924573  4106 raft_consensus.cc:2468] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 6.
I20260709 13:15:12.887014  6540 raft_consensus.cc:697] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 6 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:12.853699  6570 consensus_queue.cc:1048] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:15:12.932206  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:12.895179  6650 raft_consensus.cc:493] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:12.937418  4027 raft_consensus.cc:2410] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:15:12.898190  6573 raft_consensus.cc:515] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:12.940883  6573 leader_election.cc:290] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:12.911964  6654 raft_consensus.cc:697] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 6 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:12.941866  6658 tablet_copy_client.cc:323] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938: tablet copy: Beginning tablet copy session from remote peer at address 127.2.198.195:37843
I20260709 13:15:12.942461  6654 consensus_queue.cc:237] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:12.943162  6541 raft_consensus.cc:3055] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:12.898322  6656 consensus_queue.cc:1048] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
W20260709 13:15:12.945602  6645 log.cc:927] Time spent T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.302s	user 0.000s	sys 0.001s
W20260709 13:15:12.930151  6655 log.cc:927] Time spent T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.262s	user 0.004s	sys 0.000s
I20260709 13:15:12.930837  6447 raft_consensus.cc:697] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:12.947968  6544 leader_election.cc:290] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:12.905930  6572 consensus_queue.cc:1048] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:15:12.948897  3955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38612 (request call id 1055) took 1272 ms. Trace:
I20260709 13:15:12.948815  6652 consensus_queue.cc:1059] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:15:12.949385  3955 rpcz_store.cc:276] 0709 13:15:11.676078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:12.071405 (+395327us) service_pool.cc:224] Handling call
0709 13:15:12.948691 (+877286us) spinlock_profiling.cc:243] Waited 65.4 ms on lock 0x7b54000bd6d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:12.948829 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":150309632}
I20260709 13:15:12.950181  6572 raft_consensus.cc:3055] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:12.950558  6572 raft_consensus.cc:740] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:12.943570  6541 raft_consensus.cc:740] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
W20260709 13:15:12.958889  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 54250.9us
I20260709 13:15:12.960940  4032 raft_consensus.cc:2468] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 6.
I20260709 13:15:12.962790  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:12.911763  6659 raft_consensus.cc:2749] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:12.886590  6512 consensus_queue.cc:1059] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:15:12.976564  6512 raft_consensus.cc:3055] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:12.954056  4028 raft_consensus.cc:2468] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 6.
I20260709 13:15:12.963649  4032 raft_consensus.cc:2468] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 5.
I20260709 13:15:12.964794  4074 leader_election.cc:304] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:12.960000  3997 leader_election.cc:304] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:12.987517  3997 leader_election.cc:304] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:12.894858  6543 raft_consensus.cc:515] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:12.937003  6570 consensus_queue.cc:1243] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer d709ee666b774ec29aa732e508219938 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:15:12.970942  6447 consensus_queue.cc:237] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:12.929018  6653 consensus_queue.cc:1059] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:15:12.895108  6296 consensus_queue.cc:1059] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:15:13.030843  4117 tablet_copy_service.cc:140] P 8952c48a6f3a43968f7d77f7bfc4d1bc: Received BeginTabletCopySession request for tablet 649df91131174f00af0e0a0240f80adb from peer d709ee666b774ec29aa732e508219938 ({username='slave'} at 127.0.0.1:34656)
I20260709 13:15:13.031373  6296 raft_consensus.cc:3055] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:13.031622  4117 tablet_copy_service.cc:161] P 8952c48a6f3a43968f7d77f7bfc4d1bc: Beginning new tablet copy session on tablet 649df91131174f00af0e0a0240f80adb from peer d709ee666b774ec29aa732e508219938 at {username='slave'} at 127.0.0.1:34656: session id = d709ee666b774ec29aa732e508219938-649df91131174f00af0e0a0240f80adb
I20260709 13:15:13.031873  6296 raft_consensus.cc:740] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:13.032433  4104 raft_consensus.cc:1275] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:13.009546  6529 raft_consensus.cc:2804] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:13.034199  6659 raft_consensus.cc:3055] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:13.034577  6659 raft_consensus.cc:740] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:13.035394  6659 consensus_queue.cc:260] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:13.037125  4707 pending_rounds.cc:85] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938: Aborting all ops after (but not including) 5
I20260709 13:15:13.037452  4707 pending_rounds.cc:107] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:15:13.037715  4707 raft_consensus.cc:2889] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:12.951385  6572 consensus_queue.cc:260] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:13.038734  6572 raft_consensus.cc:3060] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:12.991667  3997 leader_election.cc:336] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Timed out: RequestConsensusVote RPC to 127.2.198.193:35339 timed out after 1.557s (SENT)
I20260709 13:15:13.008188  4074 leader_election.cc:304] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:13.024012  6554 raft_consensus.cc:493] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:13.040227  6554 raft_consensus.cc:515] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:13.040730  4074 leader_election.cc:304] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:13.041661  4074 leader_election.cc:304] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:13.042891  6554 leader_election.cc:290] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:15:12.958815  6615 log.cc:927] Time spent T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 1.210s	user 0.000s	sys 0.006s
I20260709 13:15:12.952553  6522 consensus_queue.cc:1048] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:15:13.025058  4106 raft_consensus.cc:1275] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:13.009021  6628 raft_consensus.cc:2804] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:13.025424  6573 raft_consensus.cc:2804] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:13.045033  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:13.046128  3997 leader_election.cc:304] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:12.969419  4027 raft_consensus.cc:1275] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:15:12.977005  6512 raft_consensus.cc:740] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:13.054678  4033 raft_consensus.cc:2468] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 6.
I20260709 13:15:13.032912  6296 consensus_queue.cc:260] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:13.062459  6296 raft_consensus.cc:3060] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:13.062377  6512 consensus_queue.cc:260] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:15:13.064625  6512 raft_consensus.cc:3060] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:13.069059  6612 raft_consensus.cc:2749] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:13.056742  6516 raft_consensus.cc:2804] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:15:13.056257  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 138424us
I20260709 13:15:12.966172  6532 consensus_queue.cc:1048] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.086s
I20260709 13:15:13.051612  6554 raft_consensus.cc:2749] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:12.916741  6627 consensus_queue.cc:1059] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.136s
W20260709 13:15:13.069221  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 77589.4us
I20260709 13:15:12.966140  6650 raft_consensus.cc:515] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:13.056206  6348 raft_consensus.cc:2804] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:13.052871  6629 raft_consensus.cc:493] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.092768  3922 leader_election.cc:304] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
W20260709 13:15:13.107511  3997 leader_election.cc:336] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Timed out: RequestConsensusVote RPC to 127.2.198.193:35339 timed out after 1.963s (SENT)
I20260709 13:15:13.101722  6543 leader_election.cc:290] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:13.113803  3922 leader_election.cc:304] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:13.090633  6628 raft_consensus.cc:697] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:13.104447  6547 raft_consensus.cc:493] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.103734  6549 raft_consensus.cc:2804] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:13.094306  6516 raft_consensus.cc:493] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:13.129719  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 230310us
I20260709 13:15:13.103838  6529 raft_consensus.cc:697] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:13.132865  6516 raft_consensus.cc:3060] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:13.136356  6533 leader_election.cc:290] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:13.133590  3997 leader_election.cc:336] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Timed out: RequestConsensusVote RPC to 127.2.198.193:35339 timed out after 2.178s (SENT)
I20260709 13:15:13.128706  6654 raft_consensus.cc:2749] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:13.177167  6547 raft_consensus.cc:515] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:13.115345  6629 raft_consensus.cc:515] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:13.105913  6541 consensus_queue.cc:260] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:13.110550  6540 consensus_queue.cc:237] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:13.129400  6527 raft_consensus.cc:2804] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:13.156418  6628 consensus_queue.cc:237] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:13.239467  3997 leader_election.cc:304] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:13.240231  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:13.240898  4032 raft_consensus.cc:1240] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:13.270928  4027 raft_consensus.cc:3060] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:13.242014  3955 raft_consensus.cc:1275] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:15:13.254161  6667 log.cc:927] Time spent T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.127s	user 0.003s	sys 0.003s
I20260709 13:15:13.243235  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:13.277055  3958 raft_consensus.cc:3060] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:13.243578  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:13.247951  6549 raft_consensus.cc:697] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
W20260709 13:15:13.263389  6666 log.cc:927] Time spent T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.155s	user 0.003s	sys 0.004s
W20260709 13:15:13.249071  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 113665us
W20260709 13:15:13.311162  3925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:13.312021  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 178462us
W20260709 13:15:13.312510  3925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:13.312760  3997 leader_election.cc:336] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Timed out: RequestConsensusVote RPC to 127.2.198.193:35339 timed out after 2.212s (SENT)
W20260709 13:15:13.313930  3997 leader_election.cc:336] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Timed out: RequestConsensusVote RPC to 127.2.198.193:35339 timed out after 2.236s (SENT)
I20260709 13:15:13.314396  3997 leader_election.cc:304] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:13.115419  6623 raft_consensus.cc:3055] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:13.255316  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:15:13.261883  3924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:13.262262  6296 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:13.259887  6613 consensus_queue.cc:1048] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:15:13.262301  6629 leader_election.cc:290] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:15:13.267688  6651 log.cc:927] Time spent T 00000000000000000000000000000000 P af4ff34c238b4043994545a7eb56815f: Append to log took a long time: real 0.502s	user 0.000s	sys 0.009s
W20260709 13:15:13.269009  6662 log.cc:927] Time spent T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.211s	user 0.002s	sys 0.004s
I20260709 13:15:13.272312  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:13.341670  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:13.342494  3955 raft_consensus.cc:3060] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:13.242892  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:13.277719  3953 raft_consensus.cc:3060] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:15:13.344069  4028 raft_consensus.cc:2468] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 5.
I20260709 13:15:13.244700  3954 raft_consensus.cc:1240] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 5. Current term is 6. Ops: []
W20260709 13:15:13.348495  3997 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.198.193:35339 timed out after 2.361s (SENT) [suppressed 47 similar messages]
I20260709 13:15:13.352198  3958 raft_consensus.cc:2468] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 4.
I20260709 13:15:13.353708  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:13.354561  3958 raft_consensus.cc:2468] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 6.
I20260709 13:15:13.321653  6623 raft_consensus.cc:740] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:13.274348  6527 raft_consensus.cc:493] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:13.330670  4027 raft_consensus.cc:2468] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9.
I20260709 13:15:13.335817  6529 consensus_queue.cc:237] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:13.337635  6516 raft_consensus.cc:515] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:13.348228  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:13.362932  3953 raft_consensus.cc:2468] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 6.
I20260709 13:15:13.365092  3954 raft_consensus.cc:3060] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:13.364326  4675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:13.366284  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:13.368134  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:13.369583  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:13.370153  3958 raft_consensus.cc:2468] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 5.
I20260709 13:15:13.339741  6676 raft_consensus.cc:2749] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:13.376314  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:13.377826  3955 raft_consensus.cc:2468] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 6.
I20260709 13:15:13.377858  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:13.379707  3958 raft_consensus.cc:2376] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 6. Re-sending same reply.
W20260709 13:15:13.381944  6670 log.cc:927] Time spent T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:15:13.364204  6624 consensus_queue.cc:1048] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:15:13.385049  6549 consensus_queue.cc:237] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:13.355769  6296 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:13.388309  6296 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:13.355739  6543 raft_consensus.cc:2749] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:13.364266  6527 raft_consensus.cc:3060] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:13.397605  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:13.404420  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:13.400720  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:15:13.404989  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 46838.3us
I20260709 13:15:13.408192  3954 raft_consensus.cc:2468] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 6.
W20260709 13:15:13.409801  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 98709.8us
I20260709 13:15:13.410342  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:13.411455  3954 raft_consensus.cc:3060] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:13.416966  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:13.417786  3955 raft_consensus.cc:2468] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 7.
I20260709 13:15:13.418999  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:13.389312  6547 leader_election.cc:290] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:13.420440  3955 raft_consensus.cc:2410] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:15:13.420898  4672 leader_election.cc:304] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:13.424624  3954 raft_consensus.cc:2468] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 7.
I20260709 13:15:13.425813  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:13.426316  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:13.419180  6623 consensus_queue.cc:260] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:13.428781  3954 raft_consensus.cc:1240] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:13.430543  3954 raft_consensus.cc:1275] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:13.435432  3955 raft_consensus.cc:1275] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:13.436757  3955 raft_consensus.cc:1275] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:15:13.434309  3999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 70415.4us
I20260709 13:15:13.444484  3955 raft_consensus.cc:1240] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:13.444736  4708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:13.427810  6613 raft_consensus.cc:2804] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:13.424575  6628 consensus_queue.cc:1048] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:15:13.470438  3958 raft_consensus.cc:1275] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:13.447325  6296 raft_consensus.cc:493] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.467221  6650 leader_election.cc:290] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:13.483991  3958 raft_consensus.cc:1275] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:15:13.481921  6612 raft_consensus.cc:493] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
W20260709 13:15:13.497066  6685 log.cc:927] Time spent T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
W20260709 13:15:13.501566  6675 log.cc:927] Time spent T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:15:13.503486  6614 consensus_queue.cc:1048] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 13:15:13.505715  6614 consensus_queue.cc:1048] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:13.507223  6690 consensus_queue.cc:1059] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 13:15:13.477648  6296 raft_consensus.cc:515] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:13.483933  6679 raft_consensus.cc:493] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:13.520437  3958 raft_consensus.cc:1275] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:15:13.520879  3958 pending_rounds.cc:85] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059: Aborting all ops after (but not including) 2
I20260709 13:15:13.521173  3958 pending_rounds.cc:107] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:15:13.521458  3958 raft_consensus.cc:2889] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:13.508713  6516 leader_election.cc:290] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:15:13.527254  6680 log.cc:927] Time spent T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
W20260709 13:15:13.534646  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 97887.3us
I20260709 13:15:13.547905  6296 leader_election.cc:290] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:13.525490  6679 raft_consensus.cc:515] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:13.550859  6659 raft_consensus.cc:3060] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:13.525588  6612 raft_consensus.cc:515] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:13.557098  6612 leader_election.cc:290] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:15:13.553509  4029 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38304 (request call id 1888) took 2365 ms (client timeout 1742 ms). Trace:
I20260709 13:15:13.553292  6657 raft_consensus.cc:493] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
W20260709 13:15:13.558027  4029 rpcz_store.cc:269] 0709 13:15:11.177146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.179127 (+  1981us) service_pool.cc:224] Handling call
0709 13:15:13.542180 (+2363053us) spinlock_profiling.cc:243] Waited 996 ms on lock 0x7b5400109d54. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:13.542343 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2290639744}
I20260709 13:15:13.558256  6657 raft_consensus.cc:515] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:13.560472  6642 log.cc:927] Time spent T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.921s	user 0.000s	sys 0.002s
I20260709 13:15:13.561230  6657 leader_election.cc:290] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:13.561623  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:13.551477  6527 raft_consensus.cc:515] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:13.562315  4707 raft_consensus.cc:2468] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 4.
I20260709 13:15:13.563334  3999 leader_election.cc:304] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:13.564474  6527 leader_election.cc:290] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:13.566461  6612 raft_consensus.cc:2804] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:13.567039  6612 raft_consensus.cc:493] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:13.567447  6612 raft_consensus.cc:3060] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:13.568094  4100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45336 (request call id 1132) took 1420 ms. Trace:
I20260709 13:15:13.568604  4100 rpcz_store.cc:276] 0709 13:15:12.147970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:12.154472 (+  6502us) service_pool.cc:224] Handling call
0709 13:15:12.154890 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:12.155149 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:12.155179 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:12.168404 (+ 13225us) log.cc:844] Serialized 26 byte log entry
0709 13:15:12.459804 (+291400us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:12.459869 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:12.460005 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:13.559728 (+1099723us) spinlock_profiling.cc:243] Waited 4.91 ms on lock 0x7b4400022b4c. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f15224a7c85 00007f15224a86a2 00007f152521a1db 00007f1525215aaf 00007f152520986e 00007f1525208bb6 00007f15252087d8 00007f1525212221 00007f15252121d9 00007f1525212169
0709 13:15:13.567621 (+  7893us) raft_consensus.cc:1685] finished
0709 13:15:13.567654 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:13.567943 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11289344,"thread_start_us":269934,"threads_started":1,"wal-append.queue_time_us":354199}
I20260709 13:15:13.599848  6629 consensus_queue.cc:1048] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:13.600373  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:13.628886  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:15:13.658357  6696 log.cc:927] Time spent T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:15:13.659839  4708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:15:13.624176  6698 log.cc:927] Time spent T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:15:13.667310  4034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38290 (request call id 1739) took 1484 ms. Trace:
I20260709 13:15:13.663091  6529 raft_consensus.cc:493] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.615695  6613 raft_consensus.cc:697] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 4 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:13.681115  4034 rpcz_store.cc:276] 0709 13:15:12.183200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:13.666151 (+1482951us) service_pool.cc:224] Handling call
0709 13:15:13.666539 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:13.666814 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:13.666856 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:13.666918 (+    62us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:13.666967 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:13.667046 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:13.667203 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:13.689891  3950 raft_consensus.cc:1240] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:13.661630  6653 raft_consensus.cc:493] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.692395  6296 raft_consensus.cc:493] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.706348  6559 raft_consensus.cc:3055] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:13.707028  6559 raft_consensus.cc:740] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:13.710675  4025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38304 (request call id 1913) took 1511 ms. Trace:
I20260709 13:15:13.711277  4025 rpcz_store.cc:276] 0709 13:15:12.198955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:12.380084 (+181129us) service_pool.cc:224] Handling call
0709 13:15:12.380498 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:12.468138 (+ 87640us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:13.710269 (+1242131us) spinlock_profiling.cc:243] Waited 26.9 ms on lock 0x7b54001dbd54. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:13.710570 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61873536}
W20260709 13:15:13.716368  4103 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45332 (request call id 1644) took 1950 ms (client timeout 2120 ms). Trace:
W20260709 13:15:13.716835  4103 rpcz_store.cc:269] 0709 13:15:11.766218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.767322 (+  1104us) service_pool.cc:224] Handling call
0709 13:15:13.716136 (+1948814us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b54002d8554. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:13.716277 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1146608512}
I20260709 13:15:13.691743  6529 raft_consensus.cc:515] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:13.720907  6529 leader_election.cc:290] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:13.726879  3997 leader_election.cc:336] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Timed out: RequestConsensusVote RPC to 127.2.198.193:35339 timed out after 2.151s (SENT)
I20260709 13:15:13.730661  6679 leader_election.cc:290] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:13.730791  6559 consensus_queue.cc:260] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:13.731988  6559 raft_consensus.cc:3060] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:13.733855  4706 raft_consensus.cc:1275] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:15:13.735698  6543 consensus_queue.cc:1048] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:13.738242  6613 consensus_queue.cc:237] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:13.740852  4117 tablet_copy_source_session.cc:215] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:13.727432  3997 leader_election.cc:304] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:13.731338  6679 raft_consensus.cc:493] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:13.694856  6657 consensus_queue.cc:1059] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:15:13.758116  3997 leader_election.cc:304] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:13.723214  6612 raft_consensus.cc:515] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:13.753903  6549 raft_consensus.cc:2749] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:13.763266  6543 raft_consensus.cc:2749] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:13.753170  6296 raft_consensus.cc:515] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:13.770326  4675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:13.696811  6653 raft_consensus.cc:515] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:13.756987  6529 raft_consensus.cc:493] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.783685  3953 raft_consensus.cc:2410] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:15:13.784669  6612 leader_election.cc:290] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: Requested vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:13.786108  3997 leader_election.cc:304] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:13.785982  3925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:13.787439  3997 leader_election.cc:304] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:13.788666  3997 leader_election.cc:304] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:15:13.792531  3997 leader_election.cc:304] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:13.760326  6679 raft_consensus.cc:515] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:13.792261  6612 raft_consensus.cc:2749] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:13.793467  6628 raft_consensus.cc:2749] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:13.793788  6624 raft_consensus.cc:2804] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:13.786607  6627 consensus_queue.cc:1048] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:15:13.796850  6549 raft_consensus.cc:2749] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:13.791473  6529 raft_consensus.cc:515] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:13.780556  6706 consensus_queue.cc:1048] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:15:13.809127  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:13.827519  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:13.828723  6679 leader_election.cc:290] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:13.830248  6653 leader_election.cc:290] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:13.806207  6543 consensus_queue.cc:1059] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:15:13.838591  6296 leader_election.cc:290] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:13.812731  6624 raft_consensus.cc:493] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:13.839447  6624 raft_consensus.cc:3060] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:13.840791  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:13.841069  6529 leader_election.cc:290] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:13.812002  6547 consensus_queue.cc:1048] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:15:13.845778  3925 leader_election.cc:304] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:13.846799  3925 leader_election.cc:304] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:13.848961  4025 raft_consensus.cc:1275] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:13.855163  3950 raft_consensus.cc:1240] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:13.856331  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:13.861625  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:13.865450  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:13.867628  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:13.867952  4025 raft_consensus.cc:1275] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:13.867911  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:13.870532  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:13.868312  4030 raft_consensus.cc:2468] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 4.
W20260709 13:15:13.859163  6707 log.cc:927] Time spent T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:15:13.872816  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:13.875000  3950 raft_consensus.cc:2376] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 7. Re-sending same reply.
I20260709 13:15:13.824787  6612 consensus_queue.cc:1048] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:15:13.876215  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:13.866147  6296 raft_consensus.cc:2804] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:13.877424  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:13.880693  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:13.885269  4030 raft_consensus.cc:2468] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
I20260709 13:15:13.872999  6659 raft_consensus.cc:2804] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:13.889957  4025 raft_consensus.cc:1275] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:15:13.858984  6324 consensus_queue.cc:1059] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:15:13.891258  3997 leader_election.cc:304] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:13.892249  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:13.879794  6527 raft_consensus.cc:493] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.897105  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:13.898599  4031 raft_consensus.cc:1275] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:13.899325  4030 raft_consensus.cc:2468] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7.
I20260709 13:15:13.905444  4675 leader_election.cc:304] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:13.884784  6296 raft_consensus.cc:493] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:13.875041  6672 consensus_queue.cc:1059] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:15:13.915508  3954 raft_consensus.cc:1275] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:15:13.925267  3954 raft_consensus.cc:1275] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:15:13.918126  3952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1793) took 2184 ms. Trace:
I20260709 13:15:13.909732  4675 leader_election.cc:304] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:13.910383  6690 raft_consensus.cc:2749] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:13.910142  6697 consensus_queue.cc:1048] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:13.899156  6659 raft_consensus.cc:697] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:13.912875  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:13.913151  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:13.907755  6527 raft_consensus.cc:515] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:13.909369  6650 raft_consensus.cc:493] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.908325  6296 raft_consensus.cc:3060] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:13.932034  3958 raft_consensus.cc:2410] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:15:13.927717  3952 rpcz_store.cc:276] 0709 13:15:11.733243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:12.492429 (+759186us) service_pool.cc:224] Handling call
0709 13:15:12.509111 (+ 16682us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:12.749364 (+240253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:12.749409 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:12.750043 (+   634us) log.cc:844] Serialized 26 byte log entry
0709 13:15:13.720386 (+970343us) spinlock_profiling.cc:243] Waited 9.08 ms on lock 0x7b180010f3c0. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f1522563e07 00007f152b3beab9 00007f152258069b 00007f152257e93f 00007f1522580c02 00007f152520820b 00007f152520dd23 00007f152520e0d1 00007f1525629a0f
0709 13:15:13.785773 (+ 65387us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:13.785825 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:13.917785 (+131960us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b54000befd4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:13.917839 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:13.917888 (+    49us) raft_consensus.cc:1685] finished
0709 13:15:13.917904 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:13.918055 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":296,"raft.queue_time_us":1345,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":2659,"spinlock_wait_cycles":571494528,"thread_start_us":65160,"threads_started":1,"wal-append.queue_time_us":1060413}
W20260709 13:15:13.933706  6663 log.cc:927] Time spent T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 1.022s	user 0.003s	sys 0.000s
I20260709 13:15:13.946942  3953 raft_consensus.cc:2468] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 5.
I20260709 13:15:13.919999  6672 raft_consensus.cc:3055] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:13.956590  6672 raft_consensus.cc:740] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:13.954926  6650 raft_consensus.cc:515] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:13.918725  4700 raft_consensus.cc:2468] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 4.
I20260709 13:15:13.962796  6527 leader_election.cc:290] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:13.952912  6573 raft_consensus.cc:697] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
W20260709 13:15:13.934828  6641 log.cc:927] Time spent T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 1.338s	user 0.005s	sys 0.000s
I20260709 13:15:13.918604  5757 raft_consensus.cc:3055] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:15:13.973968  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:13.975144  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:13.974674  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 79510us
W20260709 13:15:13.982831  4074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:13.931491  6034 raft_consensus.cc:493] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:13.955133  6609 raft_consensus.cc:493] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.954946  6348 raft_consensus.cc:697] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:13.970839  6690 raft_consensus.cc:2804] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:13.965044  6512 raft_consensus.cc:493] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:13.927527  6624 raft_consensus.cc:515] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:13.984036  3925 leader_election.cc:304] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:13.974614  5757 raft_consensus.cc:740] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:13.984114  6566 raft_consensus.cc:493] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.931496  6659 consensus_queue.cc:237] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:13.999636  3925 leader_election.cc:304] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
W20260709 13:15:14.088622  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 89143.2us
I20260709 13:15:14.098619  4026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41312 (request call id 294) took 2015 ms. Trace:
I20260709 13:15:14.099099  4026 rpcz_store.cc:276] 0709 13:15:12.082958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:12.086316 (+  3358us) service_pool.cc:224] Handling call
0709 13:15:12.086779 (+   463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:12.121486 (+ 34707us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:12.121523 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:12.164192 (+ 42669us) log.cc:844] Serialized 26 byte log entry
0709 13:15:12.258037 (+ 93845us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b48000cda58. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152a597aa1 00007f152a58eb37 00007f152a58e9ca 00007f152a68626f 00007f152a685f37 00007f152a69a55c 00007f152a69a508 00007f152a69a488 00007f152a69a443 00007f152a6996ec 00007f15295c3a96
0709 13:15:12.325423 (+ 67386us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:12.325484 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:12.325581 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:13.934198 (+1608617us) spinlock_profiling.cc:243] Waited 30.4 ms on lock 0x7b4400022b4c. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f15224a7c85 00007f15224a86a2 00007f152521a1db 00007f1525215aaf 00007f152520986e 00007f1525208bb6 00007f15252087d8 00007f1525212221 00007f15252121d9 00007f1525212169
0709 13:15:14.098376 (+164178us) raft_consensus.cc:1685] finished
0709 13:15:14.098399 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:14.098553 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34202,"raft.queue_time_us":38868,"raft.run_cpu_time_us":3171,"raft.run_wall_time_us":132157,"spinlock_wait_cycles":73694336,"thread_start_us":160792,"threads_started":1,"wal-append.queue_time_us":334369}
I20260709 13:15:14.083137  5962 raft_consensus.cc:2749] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:13.990618  6034 raft_consensus.cc:515] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:14.109805  4672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:14.110031  3998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:13.990793  6609 raft_consensus.cc:515] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:13.997027  6512 raft_consensus.cc:515] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:14.087098  6631 raft_consensus.cc:493] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.081259  6566 raft_consensus.cc:515] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:14.132858  3957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1800) took 2192 ms. Trace:
I20260709 13:15:14.099056  6723 raft_consensus.cc:2749] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:14.106423  6560 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.138062  3957 rpcz_store.cc:276] 0709 13:15:11.940068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:12.650585 (+710517us) service_pool.cc:224] Handling call
0709 13:15:12.670227 (+ 19642us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:12.670814 (+   587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:14.132579 (+1461765us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b54002873d0. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566d8ad 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:14.132776 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44362496}
I20260709 13:15:14.104418  6727 raft_consensus.cc:493] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:14.149135  6727 raft_consensus.cc:515] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:14.152683  6624 leader_election.cc:290] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:14.111167  6610 raft_consensus.cc:493] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:14.153843  6610 raft_consensus.cc:515] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:14.137243  6516 raft_consensus.cc:493] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:14.182284  6722 log.cc:927] Time spent T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
W20260709 13:15:14.182870  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:14.117697  6348 consensus_queue.cc:237] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:14.183789  6556 leader_election.cc:290] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:14.185384  6556 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.185904  6556 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:14.188720  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 297545us
I20260709 13:15:14.189175  6628 raft_consensus.cc:2749] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:14.190093  6706 consensus_queue.cc:1059] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:14.191006  6706 raft_consensus.cc:3055] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:14.191846  6559 consensus_queue.cc:1048] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:14.192438  6690 raft_consensus.cc:493] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:14.192874  6690 raft_consensus.cc:3060] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:14.094116  6573 consensus_queue.cc:237] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:14.195581  3999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 266338us
W20260709 13:15:14.196743  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:14.165763  6727 leader_election.cc:290] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:14.137612  5962 consensus_queue.cc:1048] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:15:14.208425  4026 raft_consensus.cc:1275] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:15:14.211292  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:14.211966  4025 raft_consensus.cc:3060] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:14.216993  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:14.217703  4028 raft_consensus.cc:2468] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
I20260709 13:15:14.219998  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:14.221145  4028 raft_consensus.cc:2410] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 9 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:15:14.193429  6559 consensus_queue.cc:1048] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:15:14.223284  6610 leader_election.cc:290] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:14.228713  6034 leader_election.cc:290] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:13.752583  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:14.230175  6609 leader_election.cc:290] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:14.230203  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:14.231761  6566 leader_election.cc:290] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:14.232820  6567 raft_consensus.cc:3060] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:14.233120  6512 leader_election.cc:290] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:14.234745  6447 raft_consensus.cc:493] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:14.235949  3951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38612 (request call id 1059) took 2558 ms. Trace:
I20260709 13:15:14.236332  3951 rpcz_store.cc:276] 0709 13:15:11.678033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:12.484927 (+806894us) service_pool.cc:224] Handling call
0709 13:15:12.691900 (+206973us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:12.692496 (+   596us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:14.235747 (+1543251us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b54001879d0. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566d8ad 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:14.235887 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":475127680}
I20260709 13:15:14.144237  6631 raft_consensus.cc:515] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:14.191370  6706 raft_consensus.cc:740] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:14.238942  6631 leader_election.cc:290] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:14.239225  6706 consensus_queue.cc:260] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:14.156299  6560 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:14.240651  6706 raft_consensus.cc:3060] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:14.242403  6560 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:14.179822  6516 raft_consensus.cc:515] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:14.210527  3999 leader_election.cc:304] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:14.258343  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:14.259661  3954 raft_consensus.cc:2468] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 8.
I20260709 13:15:14.261369  4672 leader_election.cc:304] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:14.263861  3954 raft_consensus.cc:1240] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 5. Current term is 6. Ops: []
W20260709 13:15:14.222779  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 132769us
W20260709 13:15:14.266116  3999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 55653.2us
I20260709 13:15:14.267992  6516 leader_election.cc:290] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:14.271685  4032 raft_consensus.cc:1240] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:14.277987  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:14.282644  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:14.280272  3925 leader_election.cc:304] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:14.280854  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:14.235309  6447 raft_consensus.cc:515] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:14.284963  4106 raft_consensus.cc:3060] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:14.285255  4025 raft_consensus.cc:2468] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 6.
I20260709 13:15:14.285684  3925 leader_election.cc:304] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:14.291857  4108 raft_consensus.cc:1275] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:15:14.294950  4105 raft_consensus.cc:1240] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:15:14.297412  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:14.298383  4105 raft_consensus.cc:2393] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 6: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:14.270627  6538 raft_consensus.cc:2804] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:14.359473  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:14.499495  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:14.434494  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:14.495203  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:14.500041  3958 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.002s	sys 0.018s
W20260709 13:15:14.505192  3958 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.003s	sys 0.018s
I20260709 13:15:14.374265  4106 raft_consensus.cc:2468] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9.
I20260709 13:15:14.505692  4101 raft_consensus.cc:1275] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
W20260709 13:15:14.500849  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 115956us
I20260709 13:15:14.507474  4101 pending_rounds.cc:85] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc: Aborting all ops after (but not including) 4
I20260709 13:15:14.507875  4101 pending_rounds.cc:107] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 5.5
I20260709 13:15:14.508159  4101 raft_consensus.cc:2917] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Aborting config change with OpId 5.5: Aborted: Op aborted by new leader
I20260709 13:15:14.272213  6688 raft_consensus.cc:2804] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:14.508924  4071 leader_election.cc:304] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:14.333343  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:14.508657  4101 raft_consensus.cc:2889] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:14.334473  4104 raft_consensus.cc:1275] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:14.510581  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:14.520730  4100 raft_consensus.cc:2393] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 6: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:14.315825  4105 raft_consensus.cc:1275] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:14.522353  4105 raft_consensus.cc:1240] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:15:14.430563  3956 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.000s	sys 0.018s
W20260709 13:15:14.523695  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:14.502861  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:14.526414  4102 raft_consensus.cc:3060] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:14.529042  3956 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.000s	sys 0.022s
W20260709 13:15:14.499905  5954 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.013s	sys 0.007s
W20260709 13:15:14.498132  6725 log.cc:927] Time spent T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:15:14.368312  6529 raft_consensus.cc:493] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.502614  6538 raft_consensus.cc:493] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:14.385671  6566 raft_consensus.cc:493] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:14.587899  6538 raft_consensus.cc:3060] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:14.588449  3998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:14.588202  6566 raft_consensus.cc:515] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:14.590826  6566 leader_election.cc:290] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:14.291271  6521 consensus_queue.cc:1048] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.248s
I20260709 13:15:14.401016  6676 raft_consensus.cc:493] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:14.592607  6529 raft_consensus.cc:515] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:14.592770  6676 raft_consensus.cc:515] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:14.595053  6529 leader_election.cc:290] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:14.520826  4106 raft_consensus.cc:1275] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:15:14.597692  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:14.598301  4106 raft_consensus.cc:2468] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 7.
I20260709 13:15:14.599148  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:14.299711  6703 consensus_queue.cc:1059] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.300s
I20260709 13:15:14.539798  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:14.600754  4108 raft_consensus.cc:2410] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for term 7 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:15:14.600656  4071 leader_election.cc:304] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:14.601769  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:14.602524  4108 raft_consensus.cc:2393] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 4: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:14.602327  4071 leader_election.cc:304] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:14.353828  6556 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:14.603492  6556 raft_consensus.cc:2804] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:14.536731  6573 consensus_queue.cc:1059] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:14.540884  6688 raft_consensus.cc:697] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:14.605510  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:14.358889  6677 raft_consensus.cc:2804] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:14.540045  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:14.385597  6516 raft_consensus.cc:493] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:14.630072  4074 leader_election.cc:304] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:14.494426  6718 raft_consensus.cc:493] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:14.493973  6447 leader_election.cc:290] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:14.534756  4101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:34646 (request call id 11) took 3005 ms. Trace:
W20260709 13:15:14.561271  4672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:14.562973  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:14.584012  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:14.291625  6540 raft_consensus.cc:2804] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:14.595479  6729 consensus_queue.cc:1048] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:14.367491  6559 raft_consensus.cc:493] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:14.596189  6612 raft_consensus.cc:493] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:14.536100  5954 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.014s	sys 0.008s
I20260709 13:15:14.604036  6556 raft_consensus.cc:697] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:14.603531  4071 leader_election.cc:304] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:14.605933  4106 raft_consensus.cc:2393] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 6: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:14.289882  6512 raft_consensus.cc:493] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:14.635236  6609 raft_consensus.cc:2804] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:14.637526  6610 consensus_queue.cc:1048] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:14.638584  4074 leader_election.cc:304] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:14.531594  6554 raft_consensus.cc:493] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.642809  4105 raft_consensus.cc:2393] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 4: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:14.649778  4099 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 7.
I20260709 13:15:14.651877  6540 raft_consensus.cc:493] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:14.540459  6560 raft_consensus.cc:2804] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:14.662137  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:14.648633  4101 rpcz_store.cc:276] 0709 13:15:11.516728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.517573 (+   845us) service_pool.cc:224] Handling call
0709 13:15:11.680952 (+163379us) log.cc:844] Serialized 506 byte log entry
0709 13:15:14.521760 (+2840808us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":97109,"raft.queue_time_us":98322,"raft.run_cpu_time_us":1925,"raft.run_wall_time_us":1926,"thread_start_us":96553,"threads_started":1,"wal-append.queue_time_us":180092,"wal-append.run_cpu_time_us":2482,"wal-append.run_wall_time_us":1005149}
I20260709 13:15:14.548998  6730 raft_consensus.cc:493] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:14.663615  4102 raft_consensus.cc:2468] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7.
I20260709 13:15:14.604871  6573 raft_consensus.cc:3055] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:14.611397  6624 raft_consensus.cc:493] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:14.473963  6689 raft_consensus.cc:493] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:14.616708  6728 raft_consensus.cc:493] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
W20260709 13:15:14.675357  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 71928.1us
W20260709 13:15:14.724087  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 85607.5us
I20260709 13:15:14.725960  4102 raft_consensus.cc:1275] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:15:14.647467  6677 raft_consensus.cc:493] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:14.654799  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:14.535307  6734 consensus_queue.cc:1048] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.148s
I20260709 13:15:14.721330  4100 raft_consensus.cc:1240] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:15:14.719857  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:14.642594  6566 consensus_queue.cc:1048] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:15:14.732102  4032 raft_consensus.cc:1275] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:15:14.815584  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:14.826082  3997 leader_election.cc:304] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:14.732980  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:14.735209  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:14.736317  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:14.673877  6676 leader_election.cc:290] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:14.616326  6538 raft_consensus.cc:515] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:14.790815  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:14.794132  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:14.723814  6573 raft_consensus.cc:740] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:14.793081  4108 raft_consensus.cc:1275] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:15:14.792346  6673 log.cc:927] Time spent T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:15:14.759785  4101 raft_consensus.cc:1275] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:15:14.653221  6718 raft_consensus.cc:515] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:14.761895  3959 raft_consensus.cc:2468] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 6.
I20260709 13:15:14.780443  4106 raft_consensus.cc:2468] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 6.
I20260709 13:15:14.672919  6541 raft_consensus.cc:3060] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:14.805612  6532 raft_consensus.cc:493] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.806181  5962 raft_consensus.cc:493] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:14.794133  6624 raft_consensus.cc:515] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:14.807263  6672 consensus_queue.cc:260] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:14.807672  6745 raft_consensus.cc:493] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:14.808534  4734 heartbeater.cc:646] Failed to heartbeat to 127.2.198.254:36531 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.2.198.254:36531 timed out after 15.000s (SENT)
I20260709 13:15:14.612524  6688 consensus_queue.cc:237] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:14.804301  6650 leader_election.cc:290] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:14.667632  6559 raft_consensus.cc:515] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:14.811136  3925 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.016s	sys 0.034s
W20260709 13:15:14.770066  3905 auto_rebalancer.cc:629] Failed to schedule move for tablet 649df91131174f00af0e0a0240f80adb: Aborted: Op aborted by new leader
I20260709 13:15:14.762794  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:14.871704  4108 raft_consensus.cc:1275] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:14.790817  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:14.833331  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:15:14.879752  3925 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.016s	sys 0.034s
W20260709 13:15:14.882016  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 595383us
I20260709 13:15:14.845813  6540 raft_consensus.cc:3060] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:14.886301  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 126194us
I20260709 13:15:14.663406  6648 raft_consensus.cc:493] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:14.748739  6733 raft_consensus.cc:2749] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:14.782975  6570 raft_consensus.cc:2804] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:15:14.811864  6567 consensus_meta.cc:287] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938: Time spent flushing consensus metadata: real 0.579s	user 0.014s	sys 0.001s
I20260709 13:15:14.681542  6512 raft_consensus.cc:515] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:14.758924  6677 raft_consensus.cc:3060] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:14.816226  6723 raft_consensus.cc:493] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.678413  6609 raft_consensus.cc:493] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:14.841302  3997 leader_election.cc:304] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:14.883024  3925 leader_election.cc:304] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:14.655848  6516 raft_consensus.cc:515] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:14.853013  6529 raft_consensus.cc:2804] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:15:14.896071  6747 log.cc:927] Time spent T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:15:14.936257  6521 raft_consensus.cc:2804] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:14.937879  6521 raft_consensus.cc:493] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:14.896816  6718 leader_election.cc:290] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:14.938297  6521 raft_consensus.cc:3060] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:14.897657  6624 leader_election.cc:290] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:14.854094  6729 consensus_queue.cc:1048] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:15:14.899375  6559 leader_election.cc:290] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:15:14.900054  6737 log.cc:927] Time spent T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:15:14.902313  6573 consensus_queue.cc:260] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:14.866677  6532 raft_consensus.cc:515] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:14.853515  6628 consensus_queue.cc:1048] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 13:15:14.886746  6650 raft_consensus.cc:493] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.904516  4034 raft_consensus.cc:2468] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 5.
I20260709 13:15:14.904875  6522 raft_consensus.cc:493] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.879730  6745 raft_consensus.cc:515] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:14.871631  5962 raft_consensus.cc:515] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:14.907466  6538 leader_election.cc:290] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:14.905426  3956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1802) took 2714 ms. Trace:
W20260709 13:15:14.971338  6296 consensus_meta.cc:287] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.996s	user 0.014s	sys 0.001s
I20260709 13:15:14.925200  4707 raft_consensus.cc:2468] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
I20260709 13:15:14.926235  3958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38612 (request call id 1122) took 1038 ms. Trace:
I20260709 13:15:14.752599  6730 raft_consensus.cc:515] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:14.758674  6689 raft_consensus.cc:515] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:14.983129  6559 raft_consensus.cc:493] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:14.928776  6690 consensus_meta.cc:287] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938: Time spent flushing consensus metadata: real 0.735s	user 0.011s	sys 0.003s
I20260709 13:15:14.893014  6731 raft_consensus.cc:493] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
W20260709 13:15:14.897694  6720 log.cc:927] Time spent T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.911s	user 0.004s	sys 0.000s
I20260709 13:15:14.929863  6723 raft_consensus.cc:515] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:14.930497  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 89335.8us
I20260709 13:15:14.988394  3956 rpcz_store.cc:276] 0709 13:15:12.190876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:12.658452 (+467576us) service_pool.cc:224] Handling call
0709 13:15:12.658751 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:12.818575 (+159824us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:15:13.842708 (+1024133us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b1800474a00. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f1522563e07 00007f152b3beab9 00007f152258069b 00007f152257e93f 00007f152257e455 00007f15290663c7 00007f15256789a7 00007f15256880bf 00007f1525688038
0709 13:15:13.867197 (+ 24489us) log.cc:844] Serialized 14 byte log entry
0709 13:15:14.532549 (+665352us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:14.532631 (+    82us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:14.532703 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:14.905108 (+372405us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b54001883d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:14.905161 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:14.905312 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66673,"prepare.queue_time_us":500240,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":52,"raft.queue_time_us":148881,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":30186,"spinlock_wait_cycles":283813120,"thread_start_us":668492,"threads_started":2,"wal-append.queue_time_us":1051593}
I20260709 13:15:14.871832  6556 consensus_queue.cc:237] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:14.930886  3950 raft_consensus.cc:2410] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:15:14.671964  6612 raft_consensus.cc:515] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:14.758884  6728 raft_consensus.cc:515] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:14.860335  6554 raft_consensus.cc:515] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:14.931092  6447 raft_consensus.cc:2749] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:14.931977  6609 raft_consensus.cc:3060] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:14.935735  6529 raft_consensus.cc:493] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:14.920785  4071 leader_election.cc:304] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:14.945505  6541 raft_consensus.cc:493] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.942118  6570 raft_consensus.cc:697] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:15.002149  3997 leader_election.cc:304] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:15.013525  3956 raft_consensus.cc:1275] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:15.012634  4029 raft_consensus.cc:1275] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:15:15.018329  4103 raft_consensus.cc:2468] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
I20260709 13:15:15.033260  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:14.991005  3958 rpcz_store.cc:276] 0709 13:15:13.887452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:13.949787 (+ 62335us) service_pool.cc:224] Handling call
0709 13:15:13.950176 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:13.953634 (+  3458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:13.953665 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:13.963390 (+  9725us) log.cc:844] Serialized 26 byte log entry
0709 13:15:14.506213 (+542823us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:14.657013 (+150800us) log.cc:844] Serialized 14 byte log entry
0709 13:15:14.663285 (+  6272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:14.663370 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:14.925972 (+262602us) raft_consensus.cc:1685] finished
0709 13:15:14.925995 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:14.926146 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":152375,"prepare.queue_time_us":150714,"prepare.run_wall_time_us":54,"raft.queue_time_us":9994,"raft.run_cpu_time_us":309,"raft.run_wall_time_us":17294,"spinlock_wait_cycles":8074112,"thread_start_us":523690,"threads_started":1,"wal-append.queue_time_us":923756}
I20260709 13:15:14.921638  6648 raft_consensus.cc:515] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:15.026450  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 105746us
I20260709 13:15:14.996526  6689 leader_election.cc:290] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:14.993160  6614 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.940047  6754 consensus_queue.cc:1048] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.081s
I20260709 13:15:15.021148  6744 raft_consensus.cc:493] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.990983  6748 raft_consensus.cc:493] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.030578  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:15.063381  4033 raft_consensus.cc:2468] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7.
I20260709 13:15:15.029402  6529 raft_consensus.cc:3060] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:14.994796  6730 leader_election.cc:290] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:15.035611  3958 raft_consensus.cc:1275] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:15:15.009037  6296 raft_consensus.cc:515] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:15.031952  6541 raft_consensus.cc:515] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:15.040580  3997 leader_election.cc:304] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:14.998369  6560 raft_consensus.cc:697] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:15.038084  6612 leader_election.cc:290] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:15.000164  6723 leader_election.cc:290] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:14.989101  6522 raft_consensus.cc:515] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:14.994380  5962 leader_election.cc:290] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:15.026990  6348 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.000s	sys 0.022s
I20260709 13:15:15.029141  5954 raft_consensus.cc:2749] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:14.988698  6650 raft_consensus.cc:515] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:15.069049  3953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38612 (request call id 1125) took 1178 ms. Trace:
I20260709 13:15:14.997210  6690 raft_consensus.cc:515] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:14.995913  6559 raft_consensus.cc:515] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:15.084465  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:15.122277  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:15.122911  4102 raft_consensus.cc:2468] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 6.
I20260709 13:15:15.068897  6573 raft_consensus.cc:3060] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:15.064158  6624 raft_consensus.cc:2749] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:15.088821  6527 raft_consensus.cc:493] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:14.997764  6731 raft_consensus.cc:515] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:15.101679  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:15.073953  6733 raft_consensus.cc:493] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:15.108619  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 73310.7us
I20260709 13:15:15.109292  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:15.110033  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:15.112131  6612 consensus_queue.cc:1048] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:15.077608  6648 leader_election.cc:290] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:15.117064  3997 leader_election.cc:304] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:15.062839  6614 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:15.115664  3953 rpcz_store.cc:276] 0709 13:15:13.890348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:13.976066 (+ 85718us) service_pool.cc:224] Handling call
0709 13:15:13.991223 (+ 15157us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:13.991620 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:13.991667 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:13.996570 (+  4903us) log.cc:844] Serialized 26 byte log entry
0709 13:15:14.577003 (+580433us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:14.577070 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:14.577190 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:15.068733 (+491543us) raft_consensus.cc:1685] finished
0709 13:15:15.068767 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:15.068967 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82076,"raft.queue_time_us":88,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":4651,"thread_start_us":465920,"threads_started":1,"wal-append.queue_time_us":553361}
W20260709 13:15:15.116106  6348 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.816s	user 0.000s	sys 0.023s
I20260709 13:15:15.121009  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:15.084299  6689 raft_consensus.cc:2749] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:15.114333  6570 consensus_queue.cc:237] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:15.127735  6718 consensus_queue.cc:1048] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.131s
I20260709 13:15:15.126109  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:15.130438  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:15.260561  6745 leader_election.cc:290] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:15.261057  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:15.261648  6648 raft_consensus.cc:493] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:15.066118  6748 raft_consensus.cc:515] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:15.262228  6648 raft_consensus.cc:515] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:15.263051  6731 leader_election.cc:290] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:15.243194  6538 raft_consensus.cc:493] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:15.263823  6748 leader_election.cc:290] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:15.264406  6648 leader_election.cc:290] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:15.264571  6748 raft_consensus.cc:493] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.218086  4106 raft_consensus.cc:2468] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 5.
W20260709 13:15:15.265246  6752 log.cc:927] Time spent T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 13:15:15.265213  6770 raft_consensus.cc:493] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
W20260709 13:15:15.243206  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 126237us
I20260709 13:15:15.265980  6770 raft_consensus.cc:515] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:15.268371  6770 leader_election.cc:290] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:15.236989  6527 raft_consensus.cc:515] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:15.218844  3952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38612 (request call id 1123) took 1330 ms. Trace:
I20260709 13:15:15.268198  3997 leader_election.cc:304] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:15.269140  3952 rpcz_store.cc:276] 0709 13:15:13.888928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:13.971951 (+ 83023us) service_pool.cc:224] Handling call
0709 13:15:13.986461 (+ 14510us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:13.986927 (+   466us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:13.986968 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:13.987593 (+   625us) log.cc:844] Serialized 26 byte log entry
0709 13:15:14.359959 (+372366us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:14.836957 (+476998us) log.cc:844] Serialized 14 byte log entry
0709 13:15:15.045145 (+208188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:15.045226 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:15.170516 (+125290us) raft_consensus.cc:1685] finished
0709 13:15:15.170558 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:15.218758 (+ 48200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":173439,"prepare.queue_time_us":291774,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":72503,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":4295,"thread_start_us":720324,"threads_started":3,"wal-append.queue_time_us":915796}
I20260709 13:15:15.242660  6733 raft_consensus.cc:515] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:15.270624  6527 leader_election.cc:290] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:15.271431  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 54325.1us
I20260709 13:15:15.125274  6610 raft_consensus.cc:493] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.272727  3925 leader_election.cc:304] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:15.106145  6554 leader_election.cc:290] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:15.272251  6733 leader_election.cc:290] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:15.294461  6689 raft_consensus.cc:493] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:15.294896  6756 log.cc:927] Time spent T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:15:15.265147  6748 raft_consensus.cc:515] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:15.065301  6744 raft_consensus.cc:515] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:15.264060  6538 raft_consensus.cc:515] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:15.317190  6773 consensus_queue.cc:1048] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:15.318485  6538 leader_election.cc:290] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:15:15.326337  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 53686.7us
I20260709 13:15:15.327899  6745 raft_consensus.cc:2804] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:15.328510  6745 raft_consensus.cc:493] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:15.328994  6745 raft_consensus.cc:3060] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:15.123023  6447 consensus_queue.cc:1048] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.126s
I20260709 13:15:15.171128  6512 leader_election.cc:290] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:15:15.350926  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:15.353382  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:15.354359  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:15.437819  4025 raft_consensus.cc:2410] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:15:15.438808  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:15.387490  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:15.389029  3956 raft_consensus.cc:1275] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:15:15.440701  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:15.440937  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:15.442139  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:15:15.264599  6753 log.cc:927] Time spent T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
I20260709 13:15:15.442438  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:15.444535  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:15.272946  6676 raft_consensus.cc:2804] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:15.450796  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:15.468871  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:15.295099  6689 raft_consensus.cc:515] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:15.470965  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:15.471922  3952 raft_consensus.cc:2393] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 6: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:15.272925  6516 leader_election.cc:290] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:15.474098  3957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38612 (request call id 1130) took 1275 ms. Trace:
I20260709 13:15:15.483461  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:15.485693  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:15.492306  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:15.389395  6532 leader_election.cc:290] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:15.493362  3952 raft_consensus.cc:2410] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:15:15.494846  3924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:15.486579  3958 raft_consensus.cc:2468] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 5.
I20260709 13:15:15.388769  6624 consensus_queue.cc:1048] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.113s
I20260709 13:15:15.477190  6728 leader_election.cc:290] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:15.467319  6676 raft_consensus.cc:493] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:15.598555  6763 raft_consensus.cc:493] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:15.599313  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:15.622634  6676 raft_consensus.cc:3060] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:15.273185  6560 consensus_queue.cc:237] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:15.337947  6610 raft_consensus.cc:515] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:15.657505  6610 leader_election.cc:290] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:15.649179  6763 raft_consensus.cc:515] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:15.668769  6760 log.cc:927] Time spent T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.421s	user 0.000s	sys 0.001s
W20260709 13:15:15.651185  6677 consensus_meta.cc:287] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.715s	user 0.008s	sys 0.003s
I20260709 13:15:15.742826  6541 leader_election.cc:290] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:15.744047  6774 raft_consensus.cc:493] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:15.744887  6774 raft_consensus.cc:515] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:15.750710  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 256942us
I20260709 13:15:15.607430  6628 raft_consensus.cc:493] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:15.660635  6612 raft_consensus.cc:493] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.833624  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:15.834514  4029 raft_consensus.cc:2468] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
I20260709 13:15:15.835702  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:15.836650  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:15.836921  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:15.837987  4029 raft_consensus.cc:2393] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 6: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:15.838973  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:15:15.763067  6570 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.009s	sys 0.023s
I20260709 13:15:15.842747  3925 leader_election.cc:304] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:15.766182  6296 leader_election.cc:290] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:15.837981  4702 raft_consensus.cc:2410] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 13:15:15.850226  6570 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.009s	sys 0.024s
I20260709 13:15:15.750276  6677 raft_consensus.cc:515] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:15.891124  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:15.892244  6559 leader_election.cc:290] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:15.892836  6559 raft_consensus.cc:493] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:15.893339  6559 raft_consensus.cc:515] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:15.873622  6522 leader_election.cc:290] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:15.875054  6690 leader_election.cc:290] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 election: Requested vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:15:15.883129  6609 consensus_meta.cc:287] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.845s	user 0.006s	sys 0.001s
W20260709 13:15:15.883100  6745 consensus_meta.cc:287] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.554s	user 0.010s	sys 0.000s
I20260709 13:15:15.884238  6767 raft_consensus.cc:2804] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:15.821173  6612 raft_consensus.cc:515] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:15.819038  6628 raft_consensus.cc:515] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:15.888511  6773 raft_consensus.cc:493] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:15.895488  6559 leader_election.cc:290] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:15.898473  6772 raft_consensus.cc:493] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:15.900970  6758 raft_consensus.cc:493] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:15.849929  6688 raft_consensus.cc:493] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:15.904193  6650 leader_election.cc:290] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:15.911209  6767 raft_consensus.cc:493] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:15.922199  6689 leader_election.cc:290] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:15.909451  6745 raft_consensus.cc:515] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:15.918725  6763 leader_election.cc:290] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:15.969079  3922 connection.cc:256] RPC call timeout handler was delayed by -1.1073023260000809s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1626s for a response
I20260709 13:15:15.969836  6650 raft_consensus.cc:493] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:15.970186  4034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38290 (request call id 1771) took 1137 ms. Trace:
I20260709 13:15:15.970377  6650 raft_consensus.cc:515] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:15.970954  6521 consensus_meta.cc:287] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 1.026s	user 0.010s	sys 0.000s
I20260709 13:15:15.970821  4034 rpcz_store.cc:276] 0709 13:15:14.832823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.832974 (+   151us) service_pool.cc:224] Handling call
0709 13:15:15.969965 (+1136991us) spinlock_profiling.cc:243] Waited 22.7 ms on lock 0x7b540026d4d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:15.970111 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52109184}
I20260709 13:15:15.972606  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:15.972942  6768 raft_consensus.cc:493] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:15.976722  6768 raft_consensus.cc:515] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:15.973560  6522 raft_consensus.cc:493] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:15.936934  6758 raft_consensus.cc:515] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:15.978873  6522 raft_consensus.cc:515] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:15.974224  6532 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:15.975035  6296 raft_consensus.cc:493] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:15.909238  6609 raft_consensus.cc:515] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:15.480513  3957 rpcz_store.cc:276] 0709 13:15:14.198702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.288804 (+ 90102us) service_pool.cc:224] Handling call
0709 13:15:14.289160 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:14.289423 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:15:14.835035 (+545612us) log.cc:844] Serialized 14 byte log entry
0709 13:15:15.386689 (+551654us) log.cc:844] Serialized 14 byte log entry
0709 13:15:15.473637 (+ 86948us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:15.473704 (+    67us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:15.473780 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:15.473874 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:15.474027 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":309633,"prepare.queue_time_us":80635,"prepare.run_cpu_time_us":146,"prepare.run_wall_time_us":2227,"raft.queue_time_us":97882,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":77122,"thread_start_us":1017270,"threads_started":3,"wal-append.queue_time_us":282027}
I20260709 13:15:16.001446  3922 leader_election.cc:304] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:16.001624  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:16.002841  3957 raft_consensus.cc:2468] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 4.
I20260709 13:15:16.008697  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:16.009472  3957 raft_consensus.cc:3060] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:16.011633  6769 raft_consensus.cc:2749] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:15.971531  6521 raft_consensus.cc:515] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:16.012521  3922 leader_election.cc:304] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:15.926110  6773 raft_consensus.cc:515] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:15.938863  6767 raft_consensus.cc:3060] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:16.018844  6522 leader_election.cc:290] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:16.019626  6773 leader_election.cc:290] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:16.004839  6659 consensus_queue.cc:1048] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:15:16.006132  6296 raft_consensus.cc:515] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:16.029819  6296 leader_election.cc:290] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:15:16.034317  6771 log.cc:927] Time spent T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.776s	user 0.001s	sys 0.002s
I20260709 13:15:15.994340  6689 raft_consensus.cc:493] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.036454  6689 raft_consensus.cc:515] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:16.038435  6689 leader_election.cc:290] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:16.039937  6529 consensus_meta.cc:287] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 0.961s	user 0.012s	sys 0.000s
I20260709 13:15:16.040350  6529 raft_consensus.cc:515] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:16.040865  3957 raft_consensus.cc:2468] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 9.
I20260709 13:15:16.041986  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:16.042418  6529 leader_election.cc:290] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:16.042716  6748 leader_election.cc:290] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:16.043102  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:16.044325  6609 leader_election.cc:290] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:16.046744  4704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:16.050434  4032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38290 (request call id 1770) took 1309 ms. Trace:
I20260709 13:15:16.051715  6628 leader_election.cc:290] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:16.001645  6532 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:16.011219  6573 consensus_meta.cc:287] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.846s	user 0.012s	sys 0.000s
I20260709 13:15:16.050836  4032 rpcz_store.cc:276] 0709 13:15:14.741555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.816930 (+ 75375us) service_pool.cc:224] Handling call
0709 13:15:14.817278 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:14.891351 (+ 74073us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:14.891385 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:14.891437 (+    52us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:14.891483 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.050192 (+1158709us) spinlock_profiling.cc:243] Waited 73.8 ms on lock 0x7b54001e96d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:16.050243 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:16.050372 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":169796480}
I20260709 13:15:16.069293  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:16.071657  4026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38304 (request call id 1943) took 1071 ms. Trace:
I20260709 13:15:16.082783  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:15.984340  6688 raft_consensus.cc:515] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:16.072779  4026 rpcz_store.cc:276] 0709 13:15:15.000467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.003778 (+  3311us) service_pool.cc:224] Handling call
0709 13:15:15.004183 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:15.004664 (+   481us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:15.004700 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:15.023676 (+ 18976us) log.cc:844] Serialized 26 byte log entry
0709 13:15:15.108429 (+ 84753us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:15.108545 (+   116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:15.108753 (+   208us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:16.033514 (+924761us) spinlock_profiling.cc:243] Waited 45.5 ms on lock 0x7b4400022b4c. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f15224a7c85 00007f15224a86a2 00007f152521a1db 00007f1525215aaf 00007f152520986e 00007f1525208bb6 00007f15252087d8 00007f1525212221 00007f15252121d9 00007f1525212169
0709 13:15:16.054317 (+ 20803us) raft_consensus.cc:1685] finished
0709 13:15:16.054347 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:16.071582 (+ 17235us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":596,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":6995,"spinlock_wait_cycles":104662912,"thread_start_us":43848,"threads_started":1,"wal-append.queue_time_us":196389}
I20260709 13:15:16.092063  6677 leader_election.cc:290] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:16.092572  6521 leader_election.cc:290] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:16.093786  6676 raft_consensus.cc:515] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:16.100384  6778 log.cc:927] Time spent T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:15:16.101339  6688 leader_election.cc:290] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:16.093878  5757 consensus_queue.cc:260] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:16.103763  5757 raft_consensus.cc:3060] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:16.104497  6744 leader_election.cc:290] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:16.106215  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:16.109205  6628 raft_consensus.cc:493] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:16.109701  6628 raft_consensus.cc:515] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:16.111804  6529 raft_consensus.cc:493] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.112324  6529 raft_consensus.cc:515] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:16.112866  4028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38290 (request call id 1762) took 1384 ms. Trace:
I20260709 13:15:16.113250  4028 rpcz_store.cc:276] 0709 13:15:14.728781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.728929 (+   148us) service_pool.cc:224] Handling call
0709 13:15:14.729288 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:15.002837 (+273549us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:15.002884 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:15.002951 (+    67us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:15.003006 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.112620 (+1109614us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b5400286c54. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:16.112667 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:16.112805 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":628562304}
I20260709 13:15:16.114315  6529 leader_election.cc:290] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:16.114872  6529 raft_consensus.cc:493] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
W20260709 13:15:16.117209  6761 log.cc:927] Time spent T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.845s	user 0.003s	sys 0.011s
I20260709 13:15:16.118534  4105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45336 (request call id 1154) took 1581 ms. Trace:
I20260709 13:15:16.119064  6658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 649df91131174f00af0e0a0240f80adb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:16.118919  4105 rpcz_store.cc:276] 0709 13:15:14.537386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.682477 (+145091us) service_pool.cc:224] Handling call
0709 13:15:14.682919 (+   442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:14.762357 (+ 79438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:14.762404 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:14.802765 (+ 40361us) log.cc:844] Serialized 26 byte log entry
0709 13:15:15.045458 (+242693us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:15.045498 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:15.045566 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:16.116567 (+1071001us) spinlock_profiling.cc:243] Waited 6.15 ms on lock 0x7b4400022b4c. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f15224a7c85 00007f15224a86a2 00007f152521a1db 00007f1525215aaf 00007f152520986e 00007f1525208bb6 00007f15252087d8 00007f1525212221 00007f15252121d9 00007f1525212169
0709 13:15:16.118250 (+  1683us) raft_consensus.cc:1685] finished
0709 13:15:16.118272 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:16.118472 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78476,"raft.queue_time_us":130248,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":40053,"spinlock_wait_cycles":14151424,"thread_start_us":188561,"threads_started":1,"wal-append.queue_time_us":460961}
W20260709 13:15:16.121038  4707 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57680 (request call id 583) took 2492 ms (client timeout 1626 ms). Trace:
I20260709 13:15:16.062045  6613 raft_consensus.cc:493] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
W20260709 13:15:16.121685  4707 rpcz_store.cc:269] 0709 13:15:13.628185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:13.628420 (+   235us) service_pool.cc:224] Handling call
0709 13:15:16.120722 (+2492302us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54005979d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:16.120890 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2978776320}
I20260709 13:15:15.936651  6772 raft_consensus.cc:515] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:16.134507  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 46696.7us
I20260709 13:15:16.137553  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:16.099330  6676 leader_election.cc:290] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:16.141647  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:16.146064  4028 raft_consensus.cc:1240] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:16.148875  6688 raft_consensus.cc:493] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.115375  6529 raft_consensus.cc:515] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:16.167078  3957 raft_consensus.cc:1275] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:16.158926  6718 raft_consensus.cc:2749] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:16.138667  6613 raft_consensus.cc:515] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:16.160876  6628 leader_election.cc:290] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:16.194273  3957 raft_consensus.cc:1240] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 5. Current term is 7. Ops: []
I20260709 13:15:16.157310  6688 raft_consensus.cc:515] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:16.214457  4104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45336 (request call id 1146) took 1713 ms. Trace:
I20260709 13:15:16.215600  4100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45336 (request call id 1150) took 1701 ms. Trace:
I20260709 13:15:16.225628  4027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38290 (request call id 1773) took 1106 ms. Trace:
I20260709 13:15:16.171844  6612 leader_election.cc:290] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:16.216987  3955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38612 (request call id 1132) took 1977 ms. Trace:
I20260709 13:15:16.226023  4027 rpcz_store.cc:276] 0709 13:15:15.119350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.120122 (+   772us) service_pool.cc:224] Handling call
0709 13:15:15.120551 (+   429us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:15.685098 (+564547us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:15.685151 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:15.763062 (+ 77911us) log.cc:844] Serialized 26 byte log entry
0709 13:15:16.061448 (+298386us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:16.061490 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.223861 (+162371us) spinlock_profiling.cc:243] Waited 175 ms on lock 0x7b54003b0e54. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:16.223934 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:16.224011 (+    77us) raft_consensus.cc:1685] finished
0709 13:15:16.224033 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:16.225542 (+  1509us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":217814,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":3670,"spinlock_wait_cycles":402801408,"thread_start_us":598106,"threads_started":2,"wal-append.queue_time_us":346975}
I20260709 13:15:16.226405  3955 rpcz_store.cc:276] 0709 13:15:14.239957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.909476 (+669519us) service_pool.cc:224] Handling call
0709 13:15:14.909857 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:15.381757 (+471900us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:15.381807 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:15.382512 (+   705us) log.cc:844] Serialized 26 byte log entry
0709 13:15:15.981397 (+598885us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:15.981457 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.216578 (+235121us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b54003cd054. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:16.216641 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:16.216688 (+    47us) raft_consensus.cc:1685] finished
0709 13:15:16.216699 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:16.216921 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4558,"raft.queue_time_us":97715,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":10033,"spinlock_wait_cycles":250932992,"thread_start_us":771430,"threads_started":2,"wal-append.queue_time_us":575335}
W20260709 13:15:16.222050  6776 log.cc:927] Time spent T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.168s	user 0.003s	sys 0.000s
W20260709 13:15:16.222473  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 803575us
I20260709 13:15:16.223445  6727 raft_consensus.cc:2804] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:16.225802  4100 rpcz_store.cc:276] 0709 13:15:14.514684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.523807 (+  9123us) service_pool.cc:224] Handling call
0709 13:15:14.721074 (+197267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:14.781077 (+ 60003us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.215371 (+1434294us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b54001b9250. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566d8ad 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:16.215518 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":231147904}
I20260709 13:15:16.237139  6759 raft_consensus.cc:493] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.237890  6759 raft_consensus.cc:515] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:16.240720  4073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:16.240947  6613 leader_election.cc:290] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:16.241896  6556 raft_consensus.cc:493] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.242393  6556 raft_consensus.cc:515] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:16.243216  6772 leader_election.cc:290] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:16.243708  6729 raft_consensus.cc:493] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:16.244238  6729 raft_consensus.cc:515] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:16.246649  6729 leader_election.cc:290] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:16.247094  6729 raft_consensus.cc:493] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:16.247870  6532 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:16.249050  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:16.249869  4105 raft_consensus.cc:2468] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 4.
I20260709 13:15:16.225276  4104 rpcz_store.cc:276] 0709 13:15:14.501030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.519741 (+ 18711us) service_pool.cc:224] Handling call
0709 13:15:14.520023 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:14.520237 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:15:14.850766 (+330529us) log.cc:844] Serialized 14 byte log entry
0709 13:15:15.121203 (+270437us) log.cc:844] Serialized 14 byte log entry
0709 13:15:15.972381 (+851178us) spinlock_profiling.cc:243] Waited 45.7 ms on lock 0x7b1800116020. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f15225813f3 00007f15225837c1 00007f1522583779 00007f1522583709 00007f15225836d1 00007f15225829cd 000000000038f354 000000000038f199 00007f152256483a
0709 13:15:16.189202 (+216821us) spinlock_profiling.cc:243] Waited 8.28 ms on lock 0x7b1800116020. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f15225813f3 00007f15225837c1 00007f1522583779 00007f1522583709 00007f15225836d1 00007f15225829cd 000000000038f354 000000000038f199 00007f152256483a
0709 13:15:16.213888 (+ 24686us) spinlock_profiling.cc:243] Waited 4.53 ms on lock 0x7b1800116020. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f15224fbc0a 00007f152bc3b219 00007f1522583a40 00007f152257e4e4 00007f152257e455 00007f1525666060 00007f1525678716 00007f1525689287 00007f1525689208
0709 13:15:16.214054 (+   166us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:16.214142 (+    88us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:16.214196 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.214264 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:16.214392 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1094879,"prepare.queue_time_us":163600,"prepare.run_cpu_time_us":138,"prepare.run_wall_time_us":3482,"raft.queue_time_us":1099625,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":11152,"spinlock_wait_cycles":134537728,"thread_start_us":556520,"threads_started":2,"wal-append.queue_time_us":317597}
I20260709 13:15:16.248629  6556 leader_election.cc:290] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:15:16.264828  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 259608us
I20260709 13:15:16.254863  6554 raft_consensus.cc:493] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:16.274533  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 262070us
I20260709 13:15:16.251381  6745 leader_election.cc:290] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:16.276937  4104 raft_consensus.cc:1275] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:16.278795  3922 leader_election.cc:304] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
W20260709 13:15:16.266845  6560 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.012s	sys 0.013s
W20260709 13:15:16.284395  6560 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.012s	sys 0.013s
W20260709 13:15:16.287384  3999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 110116us
I20260709 13:15:16.247505  6729 raft_consensus.cc:515] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:16.288264  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 152521us
I20260709 13:15:16.296741  3922 leader_election.cc:304] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:16.294775  4104 raft_consensus.cc:1275] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:16.285269  6653 raft_consensus.cc:2749] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:16.309470  4673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:16.310513  3950 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38612 (request call id 1114) took 2458 ms (client timeout 3243 ms). Trace:
W20260709 13:15:16.325054  3950 rpcz_store.cc:269] 0709 13:15:13.852392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:13.875997 (+ 23605us) service_pool.cc:224] Handling call
0709 13:15:16.310314 (+2434317us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400168fd4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:16.310454 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2405230848}
I20260709 13:15:16.312758  6623 raft_consensus.cc:3060] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:16.329027  6758 leader_election.cc:290] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:16.332968  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:16.315217  3856 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44680 (request call id 119) took 16606 ms (client timeout 15000 ms). Trace:
I20260709 13:15:16.333894  3924 leader_election.cc:304] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
W20260709 13:15:16.315910  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:16.316550  6764 log.cc:927] Time spent T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 1.048s	user 0.009s	sys 0.013s
I20260709 13:15:16.317728  3954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38612 (request call id 1128) took 2121 ms. Trace:
I20260709 13:15:16.339447  3954 rpcz_store.cc:276] 0709 13:15:14.196213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.288265 (+ 92052us) service_pool.cc:224] Handling call
0709 13:15:14.288679 (+   414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:15.967590 (+1678911us) spinlock_profiling.cc:243] Waited 46.7 ms on lock 0x7b18000a3600. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f15252164bc 00007f152256448b 00007f152b3beab9 00007f152258069b 00007f152257e93f 00007f152257e455 00007f1525666060 00007f1525666bfb 00007f152567164b
0709 13:15:15.967781 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:15.967819 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:15.968482 (+   663us) log.cc:844] Serialized 26 byte log entry
0709 13:15:16.264148 (+295666us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:16.264197 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.264357 (+   160us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:16.317373 (+ 53016us) raft_consensus.cc:1685] finished
0709 13:15:16.317395 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:16.317662 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":227520,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":13413,"spinlock_wait_cycles":107378944,"thread_start_us":545283,"threads_started":2,"wal-append.queue_time_us":343905}
I20260709 13:15:16.318336  6727 raft_consensus.cc:493] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:16.343801  6727 raft_consensus.cc:3060] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:16.345181  6672 raft_consensus.cc:3060] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:16.318909  4033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38290 (request call id 1772) took 1200 ms. Trace:
I20260709 13:15:16.300177  6744 consensus_queue.cc:1048] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:15:16.348675  4107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45336 (request call id 1153) took 1811 ms. Trace:
I20260709 13:15:16.288301  6772 consensus_queue.cc:1048] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.021s
W20260709 13:15:16.350598  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:16.347913  4033 rpcz_store.cc:276] 0709 13:15:15.118944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.119980 (+  1036us) service_pool.cc:224] Handling call
0709 13:15:15.170300 (+ 50320us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:15.484325 (+314025us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:15:15.739345 (+255020us) log.cc:844] Serialized 14 byte log entry
0709 13:15:16.149999 (+410654us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:16.156438 (+  6439us) log.cc:844] Serialized 52 byte log entry
0709 13:15:16.156641 (+   203us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:16.156966 (+   325us) log.cc:844] Serialized 14 byte log entry
0709 13:15:16.157951 (+   985us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.158089 (+   138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:16.318701 (+160612us) raft_consensus.cc:1685] finished
0709 13:15:16.318722 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:16.318852 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4456,"prepare.queue_time_us":481705,"prepare.run_cpu_time_us":114,"prepare.run_wall_time_us":3356,"raft.queue_time_us":18783,"raft.run_cpu_time_us":397,"raft.run_wall_time_us":10441,"thread_start_us":866196,"threads_started":3,"wal-append.queue_time_us":526590}
I20260709 13:15:16.351830  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:16.320479  6532 raft_consensus.cc:2804] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:16.352988  6532 raft_consensus.cc:697] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 7 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:16.354112  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:16.354424  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:16.354784  4034 raft_consensus.cc:3060] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:16.354996  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:16.355826  4030 raft_consensus.cc:2393] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 8: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:16.355881  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:16.355032  4026 raft_consensus.cc:3060] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:16.359719  6745 raft_consensus.cc:2749] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:16.354077  6532 consensus_queue.cc:237] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:16.320168  6453 raft_consensus.cc:2955] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 7 LEADER]: Committing config change with OpId 5.6: config changed from index 2 to 6, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:15:16.361413  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:16.362548  3959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38612 (request call id 1131) took 2123 ms. Trace:
I20260709 13:15:16.292776  6541 raft_consensus.cc:2749] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:16.360703  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:16.365265  6688 leader_election.cc:290] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:16.278647  6554 raft_consensus.cc:515] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:16.362932  3959 rpcz_store.cc:276] 0709 13:15:14.239644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.855801 (+616157us) service_pool.cc:224] Handling call
0709 13:15:14.856218 (+   417us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:14.991911 (+135693us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:14.991958 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:14.992696 (+   738us) log.cc:844] Serialized 52 byte log entry
0709 13:15:16.358313 (+1365617us) spinlock_profiling.cc:243] Waited 9.57 ms on lock 0x7b180037e3a0. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f15252164bc 00007f152256448b 00007f152b3beab9 00007f152258069b 00007f152257e93f 00007f1522580c02 00007f152520820b 00007f152520dd23 00007f152520e0d1
0709 13:15:16.358471 (+   158us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:16.358764 (+   293us) log.cc:844] Serialized 14 byte log entry
0709 13:15:16.358947 (+   183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.362247 (+  3300us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b54001694d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:16.362295 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:16.362343 (+    48us) raft_consensus.cc:1685] finished
0709 13:15:16.362359 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:16.362490 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1885,"prepare.queue_time_us":2042,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":114753,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":10468,"spinlock_wait_cycles":332824064,"thread_start_us":124898,"threads_started":1,"wal-append.queue_time_us":540419}
I20260709 13:15:16.367894  6554 leader_election.cc:290] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:16.320995  6768 leader_election.cc:290] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:16.349062  4107 rpcz_store.cc:276] 0709 13:15:14.537022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.537563 (+   541us) service_pool.cc:224] Handling call
0709 13:15:14.537944 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:14.949938 (+411994us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:15:14.950246 (+   308us) log.cc:844] Serialized 14 byte log entry
0709 13:15:15.118487 (+168241us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:15.118573 (+    86us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:15.118625 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.315975 (+1197350us) spinlock_profiling.cc:243] Waited 9.14 ms on lock 0x7b4400022b4c. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f15224a7c85 00007f15224a86a2 00007f152521a1db 00007f1525215aaf 00007f152520986e 00007f1525208bb6 00007f15252087d8 00007f1525212221 00007f15252121d9 00007f1525212169
0709 13:15:16.348207 (+ 32232us) spinlock_profiling.cc:243] Waited 412 ms on lock 0x7b540042efd4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:16.348255 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:16.348601 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":978119,"prepare.queue_time_us":642,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":3005,"raft.queue_time_us":16467,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":90168,"spinlock_wait_cycles":967899648,"thread_start_us":154281,"threads_started":1,"wal-append.queue_time_us":317393}
I20260709 13:15:16.461853  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:16.371016  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:16.386128  4026 raft_consensus.cc:2468] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7.
W20260709 13:15:16.334455  3856 rpcz_store.cc:269] 0709 13:14:59.711648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:59.738008 (+ 26360us) service_pool.cc:224] Handling call
0709 13:15:16.315124 (+16577116us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:12.241744 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:12.266772 (+ 25028us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:12.266810 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:15:12.266828 (+    18us) tablet.cc:662] Decoding operations
0709 13:15:12.267698 (+   870us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:12.267778 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:12.267813 (+    35us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:15:12.268392 (+   579us) tablet.cc:701] Row locks acquired
0709 13:15:12.268412 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:15:12.268555 (+   143us) write_op.cc:270] Start()
0709 13:15:12.268689 (+   134us) write_op.cc:276] Timestamp: P: 1783602912268510 usec, L: 0
0709 13:15:12.268710 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:15:12.339184 (+ 70474us) log.cc:844] Serialized 2835 byte log entry
0709 13:15:13.246399 (+907215us) spinlock_profiling.cc:243] Waited 4.36 ms on lock 0x7b4400022b4c. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f15224a7c85 00007f15224a86a2 00007f152521a1db 00007f1525215aaf 00007f152520986e 00007f1525208bb6 00007f15252087d8 00007f1525212221 00007f15252121d9 00007f1525212169
0709 13:15:13.533146 (+286747us) op_driver.cc:464] REPLICATION: finished
0709 13:15:13.629748 (+ 96602us) write_op.cc:301] APPLY: starting
0709 13:15:13.629874 (+   126us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:13.630152 (+   278us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:13.630187 (+    35us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:13.631505 (+  1318us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:13.669769 (+ 38264us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:15:13.669844 (+    75us) write_op.cc:312] APPLY: finished
0709 13:15:13.670237 (+   393us) log.cc:844] Serialized 59 byte log entry
0709 13:15:13.670519 (+   282us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:13.670665 (+   146us) write_op.cc:454] Released schema lock
0709 13:15:13.670722 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:13.673657 (+  2935us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:13.673714 (+    57us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":171141,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":87260,"apply.run_cpu_time_us":28001,"apply.run_wall_time_us":43871,"num_ops":7,"prepare.queue_time_us":364274,"prepare.run_cpu_time_us":60377,"prepare.run_wall_time_us":373069,"raft.queue_time_us":84435,"raft.run_cpu_time_us":14292,"raft.run_wall_time_us":164899,"replication_time_us":1257663,"spinlock_wait_cycles":10021120,"thread_start_us":524313,"threads_started":4,"wal-append.queue_time_us":402466,"wal-append.run_cpu_time_us":31569,"wal-append.run_wall_time_us":1921890}]]}
I20260709 13:15:16.369781  3924 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:16.488662  4105 raft_consensus.cc:1275] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:16.492471  4704 raft_consensus.cc:2468] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
W20260709 13:15:16.586844  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 278602us
I20260709 13:15:16.497339  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:16.463065  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:15:16.305873  6540 consensus_meta.cc:287] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 1.389s	user 0.014s	sys 0.002s
I20260709 13:15:16.589164  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:16.589497  6540 raft_consensus.cc:515] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:16.590941  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:16.594340  3997 leader_election.cc:304] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:16.594521  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:15:16.379598  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 1.25638e+06us
I20260709 13:15:16.373534  4034 raft_consensus.cc:2468] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 8.
I20260709 13:15:16.596484  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:16.597122  3950 raft_consensus.cc:2468] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 5.
I20260709 13:15:16.598836  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:16.595093  3954 raft_consensus.cc:2468] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 4.
W20260709 13:15:16.601390  4103 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45332 (request call id 1666) took 2146 ms (client timeout 1986 ms). Trace:
W20260709 13:15:16.601855  4103 rpcz_store.cc:269] 0709 13:15:14.441187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.442254 (+  1067us) service_pool.cc:224] Handling call
0709 13:15:16.587576 (+2145322us) spinlock_profiling.cc:243] Waited 514 ms on lock 0x7b540005b9d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:16.587681 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1181877504}
I20260709 13:15:16.600687  6547 raft_consensus.cc:493] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.604391  6522 consensus_queue.cc:1048] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:15:16.604723  6547 raft_consensus.cc:515] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:16.606208  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:16.607175  6547 leader_election.cc:290] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:16.590728  6512 raft_consensus.cc:493] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.616231  6512 raft_consensus.cc:515] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:16.585904  6623 raft_consensus.cc:493] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:16.608390  6731 consensus_queue.cc:1048] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:16.520061  6614 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:16.500849  6759 leader_election.cc:290] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:16.613315  6729 leader_election.cc:290] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:16.613721  3952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:35344 (request call id 12) took 1111 ms. Trace:
I20260709 13:15:16.614751  6774 leader_election.cc:290] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:16.620217  3953 raft_consensus.cc:1240] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:16.630113  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:16.630793  4099 raft_consensus.cc:3060] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:16.626577  6718 raft_consensus.cc:2804] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:16.631214  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:16.631512  6718 raft_consensus.cc:493] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:16.632071  6718 raft_consensus.cc:3060] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:16.633574  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:16.633670  6623 raft_consensus.cc:515] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:16.632982  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:16.638034  3954 raft_consensus.cc:2468] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 8.
I20260709 13:15:16.644636  6512 leader_election.cc:290] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:16.301165  6613 consensus_queue.cc:1059] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.302s
I20260709 13:15:16.483477  6529 leader_election.cc:290] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:15:16.626614  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 291076us
I20260709 13:15:16.651906  6650 leader_election.cc:290] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:15:16.653674  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 54855.3us
I20260709 13:15:16.490458  6796 raft_consensus.cc:493] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:16.638120  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:16.647526  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:16.503031  6706 raft_consensus.cc:493] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:16.670270  4704 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57680 (request call id 588) took 1828 ms (client timeout 2391 ms). Trace:
I20260709 13:15:16.670455  6706 raft_consensus.cc:515] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:16.670740  4704 rpcz_store.cc:269] 0709 13:15:14.828042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.828679 (+   637us) service_pool.cc:224] Handling call
0709 13:15:16.046517 (+1217838us) spinlock_profiling.cc:243] Waited 9.98 ms on lock 0x7b5800003f98. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f1522549b71 00007f1522549a22 00007f152b462c09 00007f152a5bcee0 00007f152a6860ab 00007f152a686131 00007f152a6340a0 00007f152a633984 00007f1523bae6d4 00007f1523bae662
0709 13:15:16.655940 (+609423us) spinlock_profiling.cc:243] Waited 445 ms on lock 0x7b54004a9054. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:16.656038 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1046233728}
I20260709 13:15:16.671509  4029 raft_consensus.cc:2468] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 5.
I20260709 13:15:16.671774  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:16.673164  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:16.648518  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:16.674288  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:16.674465  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:16.676174  4033 raft_consensus.cc:1240] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:16.677042  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:16.649629  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:16.677680  4707 raft_consensus.cc:2468] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 4.
I20260709 13:15:16.676833  6706 leader_election.cc:290] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:16.650465  4099 raft_consensus.cc:2468] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 5.
I20260709 13:15:16.679034  4704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:16.664909  6623 leader_election.cc:290] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:16.679749  4704 raft_consensus.cc:3060] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:16.651911  3953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1818) took 1268 ms. Trace:
W20260709 13:15:16.684096  6786 log.cc:927] Time spent T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.516s	user 0.000s	sys 0.006s
I20260709 13:15:16.683709  3953 rpcz_store.cc:276] 0709 13:15:15.383477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.386666 (+  3189us) service_pool.cc:224] Handling call
0709 13:15:15.471333 (+ 84667us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:16.629625 (+1158292us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.651474 (+ 21849us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54001f7554. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:16.651794 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2641625344}
I20260709 13:15:16.685446  4031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38304 (request call id 1942) took 1685 ms. Trace:
I20260709 13:15:16.685813  4031 rpcz_store.cc:276] 0709 13:15:15.000126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.003593 (+  3467us) service_pool.cc:224] Handling call
0709 13:15:15.022847 (+ 19254us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:15.551849 (+529002us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:15.551909 (+    60us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:15.610873 (+ 58964us) log.cc:844] Serialized 26 byte log entry
0709 13:15:15.986814 (+375941us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:15.986873 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.364958 (+378085us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b54001e91d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:16.365010 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:16.588485 (+223475us) spinlock_profiling.cc:243] Waited 5 ms on lock 0x7b4400022b4c. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f15224a7c85 00007f15224a86a2 00007f152521a1db 00007f1525215aaf 00007f152520986e 00007f1525208bb6 00007f15252087d8 00007f1525212221 00007f15252121d9 00007f1525212169
0709 13:15:16.685201 (+ 96716us) raft_consensus.cc:1685] finished
0709 13:15:16.685228 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:16.685384 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4108,"raft.queue_time_us":19696,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":131,"spinlock_wait_cycles":508339840,"thread_start_us":516377,"threads_started":2,"wal-append.queue_time_us":382945}
I20260709 13:15:16.628278  3952 rpcz_store.cc:276] 0709 13:15:15.525014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:16.520406 (+995392us) service_pool.cc:224] Handling call
0709 13:15:16.613565 (+ 93159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:16.657219  4026 raft_consensus.cc:1240] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:16.657768  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:16.692911  4028 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7.
I20260709 13:15:16.660650  4106 raft_consensus.cc:2468] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 6.
I20260709 13:15:16.661475  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:16.662559  4708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:16.665309  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:16.666707  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:16.444090  6767 raft_consensus.cc:515] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:16.669348  5757 consensus_queue.cc:1048] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:16.673345  6768 raft_consensus.cc:493] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:16.649753  6758 raft_consensus.cc:2804] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:16.703874  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:16.704798  3952 raft_consensus.cc:2393] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 4: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
W20260709 13:15:16.697167  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 392701us
W20260709 13:15:16.705523  4673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:16.696123  3925 leader_election.cc:304] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:16.706923  4704 raft_consensus.cc:2468] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7.
I20260709 13:15:16.656910  4074 leader_election.cc:304] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
W20260709 13:15:16.710002  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 53172.8us
I20260709 13:15:16.711879  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:16.713905  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:16.715816  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:16.716442  3954 raft_consensus.cc:2468] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 5.
I20260709 13:15:16.717437  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:16.720165  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:16.726476  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:15:16.730316  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:16.733379  3925 leader_election.cc:304] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:16.734959  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:16.735970  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:16.737023  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:16.737839  3955 raft_consensus.cc:2410] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:15:16.727128  3954 raft_consensus.cc:2468] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 7.
I20260709 13:15:16.741875  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:16.735769  3957 raft_consensus.cc:2468] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 4.
I20260709 13:15:16.743494  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:16.744402  3958 raft_consensus.cc:2368] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 7. Current term is 8.
I20260709 13:15:16.744792  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:16.745867  3957 raft_consensus.cc:2410] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:15:16.746732  3924 leader_election.cc:304] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:16.746780  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:16.704224  6758 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:16.750592  4708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:16.705009  6794 raft_consensus.cc:493] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:16.712517  6745 raft_consensus.cc:493] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.742097  3925 leader_election.cc:304] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:16.758123  3956 raft_consensus.cc:1275] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:15:16.759820  3905 auto_rebalancer.cc:629] Failed to schedule move for tablet 20cb8f6ca1af4ec79acaa9f95e816ca6: Illegal state: Replica f1c75790cedf4f52a3463a255c7da059 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:16.763616  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:16.759186  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:16.764506  4026 raft_consensus.cc:2468] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 6.
I20260709 13:15:16.765643  3997 leader_election.cc:304] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:16.766037  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:16.766770  3924 leader_election.cc:304] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:16.711911  6650 raft_consensus.cc:493] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:16.780169  4025 raft_consensus.cc:1275] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:16.705076  6706 consensus_queue.cc:1048] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:15:16.793692  3959 raft_consensus.cc:1275] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:16.771317  6745 raft_consensus.cc:515] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:16.704010  6779 consensus_queue.cc:1048] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:15:16.774076  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:16.801015  4033 raft_consensus.cc:2368] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 7. Current term is 8.
I20260709 13:15:16.775099  6529 raft_consensus.cc:2804] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:16.775574  6688 raft_consensus.cc:493] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:16.777976  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:16.785903  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:16.760854  6758 raft_consensus.cc:3060] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:16.792253  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:16.693245  6796 raft_consensus.cc:515] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:16.796564  4708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:16.788254  3997 leader_election.cc:304] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:16.797444  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:16.802855  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:16.754665  6772 raft_consensus.cc:2804] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:16.837374  4707 raft_consensus.cc:2468] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 7.
I20260709 13:15:16.754388  6731 raft_consensus.cc:2804] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:16.838047  6731 raft_consensus.cc:493] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:16.838519  6731 raft_consensus.cc:3060] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:16.839236  4025 raft_consensus.cc:1275] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:15:16.749159  6582 raft_consensus.cc:2804] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:16.742064  6770 raft_consensus.cc:493] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:16.708731  6768 raft_consensus.cc:515] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:16.755560  6541 raft_consensus.cc:493] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.788013  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:16.811488  6516 raft_consensus.cc:493] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:16.843714  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 260267us
I20260709 13:15:16.812755  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:16.814249  4027 raft_consensus.cc:1275] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:16.815752  4030 raft_consensus.cc:1275] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:16.818048  6512 raft_consensus.cc:493] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:16.823639  4106 raft_consensus.cc:1240] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:15:16.823520  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:16.800414  6769 raft_consensus.cc:2804] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:16.826855  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:16.824225  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:16.824585  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:16.824877  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:16.853196  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:16.825737  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:16.824958  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:16.829257  6804 log.cc:927] Time spent T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:15:16.803767  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:16.858299  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:16.840385  4708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:16.782236  6791 raft_consensus.cc:2749] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:16.788323  6794 raft_consensus.cc:515] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:16.795015  6734 raft_consensus.cc:3060] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:16.845544  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:16.897171  4033 raft_consensus.cc:2468] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 6.
I20260709 13:15:16.844431  3954 raft_consensus.cc:2468] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 7.
I20260709 13:15:16.849321  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:16.823874  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:16.898514  4107 raft_consensus.cc:2468] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 4.
I20260709 13:15:16.899434  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:16.900243  4107 raft_consensus.cc:2468] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
I20260709 13:15:16.901396  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:16.857012  4106 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7.
I20260709 13:15:16.809068  6529 raft_consensus.cc:493] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:16.902971  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:16.903314  6529 raft_consensus.cc:3060] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:16.904452  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:16.905802  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:16.906384  4106 raft_consensus.cc:3060] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:16.860327  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:16.857712  4101 raft_consensus.cc:2468] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 4.
I20260709 13:15:16.910914  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:16.912225  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:16.912809  4101 raft_consensus.cc:2468] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
I20260709 13:15:16.912897  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:16.913489  4105 raft_consensus.cc:3060] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:15:16.913625  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:16.857151  4108 raft_consensus.cc:2468] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 4.
I20260709 13:15:16.915411  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:16.916177  4108 raft_consensus.cc:2468] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
I20260709 13:15:16.917143  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:16.918378  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:16.919070  4108 raft_consensus.cc:2468] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 6.
I20260709 13:15:16.861724  4708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:16.855877  4104 raft_consensus.cc:2468] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7.
I20260709 13:15:16.920702  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:16.921416  4104 raft_consensus.cc:2468] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
W20260709 13:15:16.841408  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 53262.7us
I20260709 13:15:16.863445  4071 leader_election.cc:304] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:16.923415  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 60090.1us
I20260709 13:15:16.864730  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:16.865528  3952 raft_consensus.cc:2468] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 5.
I20260709 13:15:16.851706  6582 raft_consensus.cc:697] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 7 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:16.876513  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:16.877877  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:15:16.879096  6672 consensus_meta.cc:287] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.533s	user 0.008s	sys 0.005s
I20260709 13:15:16.879632  6560 raft_consensus.cc:493] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.880102  6730 raft_consensus.cc:493] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.880991  6800 raft_consensus.cc:493] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.884397  3999 leader_election.cc:304] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:16.884954  6768 leader_election.cc:290] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:16.847779  6774 raft_consensus.cc:2804] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:16.982215  3951 raft_consensus.cc:1275] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:15:16.847654  6541 raft_consensus.cc:515] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:16.890673  6796 leader_election.cc:290] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:16.847472  6770 raft_consensus.cc:515] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:16.965443  6729 raft_consensus.cc:2749] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:16.838021  6772 raft_consensus.cc:697] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 8 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:16.891199  6540 leader_election.cc:290] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:16.891054  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:16.851795  6516 raft_consensus.cc:515] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:16.852494  6769 raft_consensus.cc:493] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:16.835402  6688 raft_consensus.cc:515] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:16.893630  4700 raft_consensus.cc:1240] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:16.798786  6650 raft_consensus.cc:515] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:16.894412  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:16.855136  6512 raft_consensus.cc:515] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:16.925709  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:16.927172  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:16.946709  4071 leader_election.cc:304] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:17.018719  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 72111.9us
I20260709 13:15:17.020313  4071 leader_election.cc:304] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:16.972886  4708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:17.021212  4708 raft_consensus.cc:2468] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 6.
I20260709 13:15:17.021265  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:16.947870  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 300531us
I20260709 13:15:17.022877  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:16.973193  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:16.981531  6718 raft_consensus.cc:515] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:17.023939  4104 raft_consensus.cc:2468] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 4.
I20260709 13:15:16.975096  6560 raft_consensus.cc:515] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:16.980973  3997 leader_election.cc:304] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:16.977016  6730 raft_consensus.cc:515] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:16.987883  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:17.031744  4108 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 7.
I20260709 13:15:17.034677  4707 raft_consensus.cc:2393] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 5: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
I20260709 13:15:16.894506  3853 catalog_manager.cc:5697] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 3 to 5, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 5 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:16.985122  6653 raft_consensus.cc:493] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.986964  6774 raft_consensus.cc:493] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:16.967824  6759 consensus_queue.cc:1048] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:15:17.044502  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:17.044899  4107 raft_consensus.cc:2468] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
I20260709 13:15:17.015295  4105 raft_consensus.cc:2468] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 8.
W20260709 13:15:17.017644  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 270863us
W20260709 13:15:17.020546  4073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:17.025712  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 44826.9us
W20260709 13:15:16.965061  6727 consensus_meta.cc:287] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.621s	user 0.012s	sys 0.000s
I20260709 13:15:17.014307  6447 raft_consensus.cc:2804] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:17.029606  4672 leader_election.cc:304] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:17.049643  4672 leader_election.cc:304] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:17.051429  4031 raft_consensus.cc:2410] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:15:17.051924  4672 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:17.027465  4071 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:17.054311  4101 raft_consensus.cc:3060] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:16.981382  4106 raft_consensus.cc:2468] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 7.
I20260709 13:15:17.052963  6582 consensus_queue.cc:237] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:17.058745  4701 raft_consensus.cc:1240] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 8. Current term is 9. Ops: []
W20260709 13:15:17.059304  6807 log.cc:927] Time spent T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:15:17.059406  6613 raft_consensus.cc:2804] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:17.059998  6613 raft_consensus.cc:697] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 5 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:17.060899  6613 consensus_queue.cc:237] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:17.033279  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:17.035511  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:16.982822  6800 raft_consensus.cc:515] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:17.069164  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:17.043387  6774 raft_consensus.cc:3060] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:17.040439  4074 leader_election.cc:304] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:17.070171  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:17.058678  6802 raft_consensus.cc:2804] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:17.058244  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:17.036348  5954 raft_consensus.cc:2749] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:17.071261  4108 raft_consensus.cc:1275] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:15:17.036935  6729 raft_consensus.cc:2749] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:17.080397  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:17.080799  6794 leader_election.cc:290] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:17.043226  6653 raft_consensus.cc:515] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:17.082401  6730 leader_election.cc:290] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:17.086598  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:17.069067  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:17.008718  6769 raft_consensus.cc:3060] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:17.031013  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 288967us
I20260709 13:15:17.040205  6796 consensus_queue.cc:1048] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:15:17.049875  6447 raft_consensus.cc:493] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:17.080279  5954 raft_consensus.cc:2804] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:17.088083  4108 raft_consensus.cc:1240] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:15:17.109258  5954 raft_consensus.cc:493] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:17.109689  5954 raft_consensus.cc:3060] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:17.056372  6797 raft_consensus.cc:2749] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:17.090728  4103 raft_consensus.cc:2468] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 7.
I20260709 13:15:17.094419  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:17.112102  6770 leader_election.cc:290] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:17.096216  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:15:17.100692  4673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:17.100170  4073 leader_election.cc:304] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:17.103363  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:17.075125  6802 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:17.071388  6554 raft_consensus.cc:2804] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:17.052670  6727 raft_consensus.cc:515] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:17.105053  4102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45336 (request call id 1174) took 1994 ms. Trace:
I20260709 13:15:17.108731  6447 raft_consensus.cc:3060] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:17.128914  4102 rpcz_store.cc:276] 0709 13:15:15.110947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.123570 (+ 12623us) service_pool.cc:224] Handling call
0709 13:15:15.123924 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:16.428902 (+1304978us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:16.428953 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:16.460545 (+ 31592us) log.cc:844] Serialized 26 byte log entry
0709 13:15:16.842020 (+381475us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:16.842078 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.846418 (+  4340us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:17.104797 (+258379us) raft_consensus.cc:1685] finished
0709 13:15:17.104825 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:17.104971 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1096436,"raft.queue_time_us":1097330,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":126,"thread_start_us":423988,"threads_started":2,"wal-append.queue_time_us":406026}
I20260709 13:15:17.082448  6512 leader_election.cc:290] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:17.090127  6628 raft_consensus.cc:3060] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:17.106326  3853 catalog_manager.cc:5697] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 3 to 4, leader changed from 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 4 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:17.049413  6810 consensus_queue.cc:1048] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.046s
W20260709 13:15:17.127490  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 360769us
I20260709 13:15:17.171164  3924 leader_election.cc:304] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
W20260709 13:15:17.149063  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 53082.3us
I20260709 13:15:17.089941  6799 consensus_queue.cc:1048] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
W20260709 13:15:17.153286  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 125930us
I20260709 13:15:17.127048  6802 raft_consensus.cc:3060] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:17.114687  4073 leader_election.cc:304] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:17.163836  4099 raft_consensus.cc:2393] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 7: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:17.052963  6772 consensus_queue.cc:237] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:17.167320  5954 raft_consensus.cc:515] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:17.167657  6512 raft_consensus.cc:2749] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:17.128429  6554 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:17.152838  3999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 268363us
I20260709 13:15:17.115653  6794 consensus_queue.cc:1059] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:15:17.105069  6758 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:17.189494  3999 leader_election.cc:304] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:17.175477  4071 leader_election.cc:304] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:17.131196  6770 consensus_queue.cc:1059] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:15:17.203893  5954 leader_election.cc:290] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:15:17.207489  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 159530us
W20260709 13:15:17.233417  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 60432.8us
I20260709 13:15:17.234706  3922 leader_election.cc:304] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
W20260709 13:15:17.237123  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 181922us
W20260709 13:15:17.245718  4073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 131105us
I20260709 13:15:17.190274  6554 raft_consensus.cc:3060] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:17.244647  3953 raft_consensus.cc:2468] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 6.
I20260709 13:15:17.253634  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:17.259055  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:17.205186  6522 raft_consensus.cc:2804] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:17.259939  6522 raft_consensus.cc:493] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:17.244602  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:17.260397  6522 raft_consensus.cc:3060] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:17.265050  6767 leader_election.cc:290] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:17.186619  6731 raft_consensus.cc:515] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:17.265723  6767 raft_consensus.cc:493] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.266193  6767 raft_consensus.cc:515] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:17.267665  6731 leader_election.cc:290] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:17.267920  6794 raft_consensus.cc:3055] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:17.268306  6794 raft_consensus.cc:740] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:17.268477  6731 consensus_queue.cc:1059] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:17.210005  6759 raft_consensus.cc:2749] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:17.254892  3958 raft_consensus.cc:1275] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:17.246702  6516 leader_election.cc:290] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:17.244650  5954 raft_consensus.cc:2749] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:17.270440  3922 leader_election.cc:304] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:17.205802  6734 raft_consensus.cc:2749] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:17.276543  4672 leader_election.cc:304] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:17.284605  5954 raft_consensus.cc:3055] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:17.285825  5954 raft_consensus.cc:740] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:17.286432  4672 leader_election.cc:304] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:17.287809  3922 leader_election.cc:304] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:17.291719  6672 raft_consensus.cc:2749] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:17.294683  4101 raft_consensus.cc:2468] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 8.
I20260709 13:15:17.295624  6614 raft_consensus.cc:2804] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:17.296106  6658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:57666 (request call id 474) took 4769 ms. Trace:
I20260709 13:15:17.296730  6324 raft_consensus.cc:3055] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:17.296566  6658 rpcz_store.cc:276] 0709 13:15:12.526540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:12.527876 (+  1336us) service_pool.cc:224] Handling call
0709 13:15:12.816215 (+288339us) ts_tablet_manager.cc:934] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938: Initiating tablet copy from peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
0709 13:15:16.117646 (+3301431us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:15:16.687726 (+570080us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:16.687871 (+   145us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:15:17.010449 (+322578us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:15:17.053325 (+ 42876us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:17.295925 (+242600us) ts_tablet_manager.cc:989] Replica registered.
0709 13:15:17.296002 (+    77us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":57761,"tablet-copy.queue_time_us":197176,"thread_start_us":221083,"threads_started":2}
I20260709 13:15:17.298424  6658 tablet_copy_client.cc:806] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:17.299041  6658 tablet_copy_client.cc:670] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:17.299890  3951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38612 (request call id 1127) took 3105 ms. Trace:
I20260709 13:15:17.300304  3951 rpcz_store.cc:276] 0709 13:15:14.194865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.237304 (+ 42439us) service_pool.cc:224] Handling call
0709 13:15:14.237578 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:16.982727 (+2745149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:17.299628 (+316901us) spinlock_profiling.cc:243] Waited 2.73 s on lock 0x7b540013a1d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:17.299820 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6279617792}
I20260709 13:15:17.303574  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:17.279047  6813 raft_consensus.cc:2749] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:17.279917  6794 consensus_queue.cc:260] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:17.310066  6794 raft_consensus.cc:3060] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:17.288543  4672 leader_election.cc:304] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:17.312724  3957 raft_consensus.cc:1240] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:17.313843  3922 leader_election.cc:304] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:17.295799  4703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:17.270614  6688 leader_election.cc:290] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:17.331635  3922 leader_election.cc:304] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: d709ee666b774ec29aa732e508219938
W20260709 13:15:17.323436  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 250330us
I20260709 13:15:17.333771  4074 leader_election.cc:400] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Vote denied by peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115) with higher term. Message: Invalid argument: T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 7. Current term is 8.
I20260709 13:15:17.334424  4074 leader_election.cc:403] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:17.335585  4074 leader_election.cc:304] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:17.344453  3922 leader_election.cc:304] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:17.331125  5954 consensus_queue.cc:260] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:17.352800  5954 raft_consensus.cc:3060] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:17.255831  6744 consensus_queue.cc:1059] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 13:15:17.284041  6650 leader_election.cc:290] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:17.356746  3922 leader_election.cc:304] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
W20260709 13:15:17.331137  6807 log.cc:927] Time spent T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:15:17.283651  6560 leader_election.cc:290] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:17.297441  6324 raft_consensus.cc:740] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:17.324129  6796 raft_consensus.cc:2749] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:17.296115  6614 raft_consensus.cc:493] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:17.332753  6582 raft_consensus.cc:2804] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:17.385416  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:17.342383  6731 raft_consensus.cc:2749] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115) with higher term. Message: Invalid argument: T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 7. Current term is 8.
I20260709 13:15:17.355417  6734 raft_consensus.cc:2804] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:17.345643  6822 raft_consensus.cc:2749] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:17.366978  6672 raft_consensus.cc:2749] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:15:17.401199  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 199922us
I20260709 13:15:17.361486  6759 raft_consensus.cc:2749] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:17.362011  6813 raft_consensus.cc:2804] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:17.330272  6613 consensus_queue.cc:1048] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
W20260709 13:15:17.411456  3999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 222012us
I20260709 13:15:17.387637  6744 raft_consensus.cc:2749] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:17.404618  6614 raft_consensus.cc:3060] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:17.434283  4071 leader_election.cc:304] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:15:17.368098  6516 consensus_queue.cc:1048] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:15:17.440933  4071 leader_election.cc:304] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:17.404829  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:17.405197  6582 raft_consensus.cc:493] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:17.457418  6582 raft_consensus.cc:3060] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:17.458336  6836 consensus_queue.cc:1059] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:15:17.449409  4071 leader_election.cc:304] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:17.379803  6512 consensus_queue.cc:1048] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:15:17.461645  6554 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:17.464459  6823 consensus_queue.cc:1059] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:15:17.471834  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 115184us
I20260709 13:15:17.415442  6734 raft_consensus.cc:493] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:17.472739  3922 leader_election.cc:304] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:17.474105  3922 leader_election.cc:304] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:17.475857  3922 leader_election.cc:304] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:17.480827  6770 raft_consensus.cc:2804] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:17.481356  6770 raft_consensus.cc:493] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:17.481741  6770 raft_consensus.cc:3060] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:17.453763  6731 raft_consensus.cc:2804] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:17.484054  6731 raft_consensus.cc:493] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:17.484550  6731 raft_consensus.cc:3060] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:17.430601  6813 raft_consensus.cc:493] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:17.485469  6813 raft_consensus.cc:3060] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:17.489596  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:17.491665  6658 tablet_copy_client.cc:538] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:17.449395  6727 leader_election.cc:290] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:17.494534  6653 leader_election.cc:290] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:17.496397  6744 raft_consensus.cc:2749] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:17.497577  6791 raft_consensus.cc:3055] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:17.497941  6791 raft_consensus.cc:740] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:17.498764  6791 consensus_queue.cc:260] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:17.499848  6745 leader_election.cc:290] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:17.500408  6745 raft_consensus.cc:493] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:17.500661  6554 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:17.500869  6745 raft_consensus.cc:515] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:17.502704  6447 raft_consensus.cc:515] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:17.503111  6745 leader_election.cc:290] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:17.506343  6832 log.cc:927] Time spent T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.199s	user 0.000s	sys 0.000s
I20260709 13:15:17.431176  6774 raft_consensus.cc:515] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:17.432729  6767 leader_election.cc:290] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:17.403385  6826 consensus_queue.cc:1048] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
W20260709 13:15:17.475302  6529 consensus_meta.cc:287] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 0.568s	user 0.013s	sys 0.000s
W20260709 13:15:17.524508  4074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:17.515232  6836 consensus_queue.cc:1243] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer f1c75790cedf4f52a3463a255c7da059 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:15:17.525736  5962 raft_consensus.cc:3055] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:17.525875  6758 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 election: Requested vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:17.526218  5962 raft_consensus.cc:740] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
W20260709 13:15:17.510510  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 61198.6us
I20260709 13:15:17.528148  4071 leader_election.cc:304] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:17.530254  4071 leader_election.cc:400] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Vote denied by peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339) with higher term. Message: Invalid argument: T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 7. Current term is 8.
I20260709 13:15:17.530649  3955 raft_consensus.cc:1240] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:15:17.531806  6727 raft_consensus.cc:2749] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:17.532058  6791 raft_consensus.cc:3060] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:17.534304  6727 consensus_queue.cc:1048] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:17.514236  6541 leader_election.cc:290] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:17.473011  6324 consensus_queue.cc:260] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:17.537189  6324 raft_consensus.cc:3060] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:17.540400  6830 consensus_queue.cc:1048] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:17.542531  4105 raft_consensus.cc:1240] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:15:17.447801  3853 catalog_manager.cc:5697] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 5 to 6, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193), now has a pending config: VOTER f1c75790cedf4f52a3463a255c7da059 (127.2.198.193), VOTER 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194), VOTER 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195), VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196). New cstate: current_term: 6 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:15:17.545406  6802 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:17.514163  3922 leader_election.cc:304] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:15:17.524112  6529 raft_consensus.cc:515] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:17.527364  6827 log.cc:927] Time spent T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:15:17.566395  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
W20260709 13:15:17.568370  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 54319.8us
I20260709 13:15:17.569391  3922 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:15:17.570845  3922 leader_election.cc:304] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:17.474419  6823 raft_consensus.cc:3055] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:17.551429  4071 leader_election.cc:304] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:17.556670  4073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:17.454612  6759 raft_consensus.cc:2749] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:15:17.563313  4673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:17.576057  3922 leader_election.cc:304] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:17.577224  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:17.522109  6769 raft_consensus.cc:515] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:17.584721  4073 leader_election.cc:304] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:17.509298  6734 raft_consensus.cc:3060] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:17.594365  4100 raft_consensus.cc:2468] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
I20260709 13:15:17.596556  4709 raft_consensus.cc:2368] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 6. Current term is 7.
I20260709 13:15:17.590546  6767 raft_consensus.cc:2804] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:17.602092  6767 raft_consensus.cc:493] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:17.515370  6512 raft_consensus.cc:2749] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:17.608438  3922 leader_election.cc:304] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:17.602954  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:17.546705  6745 raft_consensus.cc:2749] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:17.606992  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 55656.4us
I20260709 13:15:17.602514  6767 raft_consensus.cc:3060] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:17.611907  5954 raft_consensus.cc:2749] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:17.612473  4073 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:17.609368  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:17.614923  4108 raft_consensus.cc:3060] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:17.598057  6832 log.cc:927] Time spent T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.091s	user 0.004s	sys 0.000s
W20260709 13:15:17.627751  3925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:17.646961  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 437988us
I20260709 13:15:17.640218  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:17.583447  6823 raft_consensus.cc:740] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:17.598693  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:17.591019  6623 raft_consensus.cc:493] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:17.527244  5962 consensus_queue.cc:260] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:17.658918  3956 raft_consensus.cc:1240] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 5. Current term is 6. Ops: []
W20260709 13:15:17.656805  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 46640us
I20260709 13:15:17.602777  6814 raft_consensus.cc:2804] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:17.617769  6727 raft_consensus.cc:2749] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:17.648720  6759 raft_consensus.cc:2749] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:17.620729  5954 consensus_queue.cc:1048] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:15:17.590274  6779 raft_consensus.cc:493] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:17.662391  3997 leader_election.cc:304] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:17.622049  4071 leader_election.cc:304] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:17.599654  6758 raft_consensus.cc:2804] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:17.667896  6541 raft_consensus.cc:2804] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:15:17.772943  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 110694us
I20260709 13:15:17.674705  6774 leader_election.cc:290] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: Requested vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:17.774906  4107 raft_consensus.cc:1240] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:17.793567  3997 leader_election.cc:304] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:17.796167  3997 leader_election.cc:304] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:17.789330  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:17.665256  6847 raft_consensus.cc:2804] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:17.671571  6768 consensus_queue.cc:1048] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.088s
W20260709 13:15:17.805855  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 183896us
I20260709 13:15:17.807216  5954 consensus_queue.cc:1059] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:17.760597  6541 raft_consensus.cc:493] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:17.811944  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:17.812613  3959 raft_consensus.cc:2468] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 6.
I20260709 13:15:17.681414  6623 raft_consensus.cc:515] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:17.800966  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:17.800624  3957 raft_consensus.cc:2468] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 6.
I20260709 13:15:17.790132  4108 raft_consensus.cc:2468] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7.
I20260709 13:15:17.849033  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:17.807988  5954 consensus_queue.cc:1243] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer f1c75790cedf4f52a3463a255c7da059 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:15:17.775938  6758 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
W20260709 13:15:17.811390  6522 consensus_meta.cc:287] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.550s	user 0.012s	sys 0.007s
W20260709 13:15:17.772614  4674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:17.858376  6623 leader_election.cc:290] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:17.847108  6541 raft_consensus.cc:3060] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:17.860127  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:17.801471  6688 raft_consensus.cc:2804] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:17.863833  6688 raft_consensus.cc:493] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:17.864246  6688 raft_consensus.cc:3060] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:17.851269  4108 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "f1c75790cedf4f52a3463a255c7da059"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:15:17.867861  4108 raft_consensus.cc:606] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Received request to transfer leadership to TS f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:17.868330  4108 raft_consensus.cc:614] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:17.816032  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:17.871873  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:17.797417  3997 leader_election.cc:304] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:17.826244  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:17.825672  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:17.857693  6522 raft_consensus.cc:515] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:17.790902  6853 raft_consensus.cc:2804] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:15:17.875519  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 78233.6us
I20260709 13:15:17.874439  3954 raft_consensus.cc:2393] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 6: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:17.803402  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:17.801527  6706 raft_consensus.cc:2804] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:17.881457  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:15:17.873239  6628 consensus_meta.cc:287] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 0.727s	user 0.006s	sys 0.005s
I20260709 13:15:17.892994  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:17.922848  6628 raft_consensus.cc:2749] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:17.923251  3951 raft_consensus.cc:2410] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:15:17.878121  6822 raft_consensus.cc:2749] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:17.924278  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:17.915305  6522 leader_election.cc:290] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:17.924942  3951 raft_consensus.cc:3060] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:17.804077  6814 raft_consensus.cc:493] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:17.804528  6847 raft_consensus.cc:493] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:17.814430  6512 raft_consensus.cc:2804] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:17.900185  6802 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:17.901783  6447 leader_election.cc:290] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: Requested vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:17.855456  6824 raft_consensus.cc:493] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:17.906740  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:17.907449  6791 raft_consensus.cc:493] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.898967  6582 raft_consensus.cc:515] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:17.874503  6797 raft_consensus.cc:2749] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:17.912328  6834 log.cc:927] Time spent T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:15:17.774263  3853 catalog_manager.cc:5697] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:17.913410  6831 log.cc:927] Time spent T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 13:15:17.853125  6758 raft_consensus.cc:3060] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:17.915915  6658 tablet_bootstrap.cc:492] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938: Bootstrap starting.
I20260709 13:15:17.916643  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:17.919941  6529 leader_election.cc:290] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:17.921866  6842 raft_consensus.cc:3055] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:17.922271  6706 raft_consensus.cc:493] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:17.924124  6541 raft_consensus.cc:515] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:17.926339  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:17.893577  3997 leader_election.cc:304] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:15:17.894354  4071 leader_election.cc:304] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:17.979277  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 85017.4us
I20260709 13:15:17.980144  6800 leader_election.cc:290] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:17.980813  6800 raft_consensus.cc:2749] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:17.785202  6779 raft_consensus.cc:515] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:17.789528  6823 consensus_queue.cc:260] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:17.981808  6823 raft_consensus.cc:3060] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:17.982667  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:17.983932  6769 leader_election.cc:290] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:17.882189  6623 raft_consensus.cc:493] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.985209  6779 leader_election.cc:290] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:17.985039  6623 raft_consensus.cc:515] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:17.987215  6623 leader_election.cc:290] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:18.000715  4104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45336 (request call id 1178) took 1168 ms. Trace:
I20260709 13:15:18.001605  3924 leader_election.cc:400] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 election: Vote denied by peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117) with higher term. Message: Invalid argument: T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 6. Current term is 7.
I20260709 13:15:18.001935  3924 leader_election.cc:403] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:15:18.002652  6769 raft_consensus.cc:3060] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:18.001132  4104 rpcz_store.cc:276] 0709 13:15:16.832702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.136495 (+303793us) service_pool.cc:224] Handling call
0709 13:15:17.165403 (+ 28908us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:17.173016 (+  7613us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:17.173050 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:17.173695 (+   645us) log.cc:844] Serialized 52 byte log entry
0709 13:15:17.372056 (+198361us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:17.372117 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:17.372206 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:17.998999 (+626793us) spinlock_profiling.cc:243] Waited 39.6 ms on lock 0x7b4400022b4c. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f15224a7c85 00007f15224a86a2 00007f152521a1db 00007f1525215aaf 00007f152520986e 00007f1525208bb6 00007f15252087d8 00007f1525212221 00007f15252121d9 00007f1525212169
0709 13:15:18.000362 (+  1363us) raft_consensus.cc:1685] finished
0709 13:15:18.000383 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:18.000653 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":33955,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":28032,"spinlock_wait_cycles":90978688,"thread_start_us":165712,"threads_started":1,"wal-append.queue_time_us":704828}
W20260709 13:15:18.005304  6838 log.cc:927] Time spent T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 13:15:18.005534  4104 raft_consensus.cc:1240] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:18.005836  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:18.005849  4106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45332 (request call id 1694) took 1174 ms. Trace:
I20260709 13:15:18.006479  4106 rpcz_store.cc:276] 0709 13:15:16.831156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.078130 (+246974us) service_pool.cc:224] Handling call
0709 13:15:17.078551 (+   421us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:17.078963 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:17.079000 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:17.090955 (+ 11955us) log.cc:844] Serialized 52 byte log entry
0709 13:15:17.339442 (+248487us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:17.430077 (+ 90635us) log.cc:844] Serialized 14 byte log entry
0709 13:15:17.442893 (+ 12816us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:17.443075 (+   182us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:18.005616 (+562541us) raft_consensus.cc:1685] finished
0709 13:15:18.005639 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:18.005786 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11900,"prepare.queue_time_us":266998,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":20178,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":314,"thread_start_us":247945,"threads_started":2,"wal-append.queue_time_us":556948}
I20260709 13:15:18.006482  4102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45336 (request call id 1177) took 1174 ms. Trace:
I20260709 13:15:18.008561  4106 raft_consensus.cc:1240] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:18.008078  4102 rpcz_store.cc:276] 0709 13:15:16.832465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.131894 (+299429us) service_pool.cc:224] Handling call
0709 13:15:17.132357 (+   463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:17.139692 (+  7335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:17.139739 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:17.145528 (+  5789us) log.cc:844] Serialized 26 byte log entry
0709 13:15:17.360333 (+214805us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:17.360389 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:17.360462 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:18.004755 (+644293us) spinlock_profiling.cc:243] Waited 3.74 ms on lock 0x7b4400022b4c. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f15224a7c85 00007f15224a86a2 00007f152521a1db 00007f1525215aaf 00007f152520986e 00007f1525208bb6 00007f15252087d8 00007f1525212221 00007f15252121d9 00007f1525212169
0709 13:15:18.006184 (+  1429us) raft_consensus.cc:1685] finished
0709 13:15:18.006213 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:18.006417 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":31082,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":2658,"spinlock_wait_cycles":8596864,"thread_start_us":156909,"threads_started":1,"wal-append.queue_time_us":495736}
I20260709 13:15:18.010147  4026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38290 (request call id 1788) took 1201 ms. Trace:
I20260709 13:15:18.010561  4026 rpcz_store.cc:276] 0709 13:15:16.808607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:16.808743 (+   136us) service_pool.cc:224] Handling call
0709 13:15:16.809078 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:16.809495 (+   417us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:15:17.298735 (+489240us) spinlock_profiling.cc:243] Waited 8.38 ms on lock 0x7b1800352d20. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f1522563e07 00007f152b3beab9 00007f152258069b 00007f152257e93f 00007f152257e455 00007f15290663c7 00007f15256789a7 00007f15256880bf 00007f1525688038
0709 13:15:17.391620 (+ 92885us) log.cc:844] Serialized 14 byte log entry
0709 13:15:17.675688 (+284068us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:17.676382 (+   694us) log.cc:844] Serialized 26 byte log entry
0709 13:15:17.676584 (+   202us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:17.676621 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:17.676715 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:18.009855 (+333140us) raft_consensus.cc:1685] finished
0709 13:15:18.009960 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:18.010089 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19470,"prepare.queue_time_us":24131,"prepare.run_cpu_time_us":140,"prepare.run_wall_time_us":140,"raft.queue_time_us":20701,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":2651,"spinlock_wait_cycles":19283712,"thread_start_us":314560,"threads_started":2,"wal-append.queue_time_us":592992}
I20260709 13:15:17.895287  6853 raft_consensus.cc:493] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
W20260709 13:15:18.015643  3922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:18.015776  6853 raft_consensus.cc:3060] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:17.936431  6512 raft_consensus.cc:493] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:18.019778  6512 raft_consensus.cc:3060] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:18.020664  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:17.899338  6614 raft_consensus.cc:515] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:17.960518  6541 leader_election.cc:290] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:17.961076  6706 raft_consensus.cc:3060] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:17.961167  3958 raft_consensus.cc:2393] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 7: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:17.954231  6842 raft_consensus.cc:740] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:17.962493  6529 raft_consensus.cc:493] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:18.031677  4673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:17.963825  6582 leader_election.cc:290] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:17.970827  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:17.935418  6847 raft_consensus.cc:3060] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:18.077976  6842 consensus_queue.cc:260] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:18.079259  6842 raft_consensus.cc:3060] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:18.080657  6731 consensus_meta.cc:287] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.596s	user 0.011s	sys 0.001s
I20260709 13:15:18.081130  6731 raft_consensus.cc:515] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:18.082312  4107 raft_consensus.cc:1240] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:15:18.083379  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:18.083714  6836 consensus_queue.cc:1059] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:18.084233  4026 raft_consensus.cc:3060] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:18.084683  6836 raft_consensus.cc:3055] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:18.085036  6836 raft_consensus.cc:740] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:18.085091  6688 raft_consensus.cc:515] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:18.086201  6847 raft_consensus.cc:515] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:17.948101  6824 raft_consensus.cc:515] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:17.943337  3951 raft_consensus.cc:2468] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 7.
I20260709 13:15:17.950335  6791 raft_consensus.cc:515] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:17.998315  6767 raft_consensus.cc:515] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:17.999470  6718 leader_election.cc:290] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:18.023779  4104 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:15:18.118568  4104 raft_consensus.cc:606] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Received request to transfer leadership to TS 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:18.119035  4104 raft_consensus.cc:614] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:17.937526  6814 raft_consensus.cc:3060] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:18.059118  6529 raft_consensus.cc:515] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:18.072171  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 178656us
I20260709 13:15:18.128854  3997 leader_election.cc:304] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:18.072539  6547 raft_consensus.cc:2804] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:18.073840  6623 raft_consensus.cc:493] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:18.072191  6614 leader_election.cc:290] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:18.088255  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:18.089227  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:18.090360  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:18.140487  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:18.141953  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:18.091356  6768 raft_consensus.cc:493] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:18.095468  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:18.096774  4071 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:18.149595  4028 raft_consensus.cc:3060] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:18.150100  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 53477us
I20260709 13:15:18.138118  6779 raft_consensus.cc:2804] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:18.107983  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:18.106714  4026 raft_consensus.cc:2410] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:15:18.157630  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:18.132776  3997 leader_election.cc:304] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:15:18.132786  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:18.159013  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:18.159657  4026 raft_consensus.cc:3060] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:18.159591  4033 raft_consensus.cc:2468] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 5.
I20260709 13:15:18.122925  4104 raft_consensus.cc:1275] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:18.135110  3955 raft_consensus.cc:1240] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:15:18.070713  6734 raft_consensus.cc:515] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:18.094185  4029 raft_consensus.cc:1275] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:15:18.165419  4029 pending_rounds.cc:85] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2: Aborting all ops after (but not including) 3
I20260709 13:15:18.165710  4029 pending_rounds.cc:107] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:15:18.165958  4029 raft_consensus.cc:2889] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:18.168282  3997 leader_election.cc:304] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:18.169417  4028 raft_consensus.cc:2468] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7.
I20260709 13:15:18.169598  3997 leader_election.cc:304] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:18.143210  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:18.151264  4071 leader_election.cc:304] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:18.125043  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:18.172729  4027 raft_consensus.cc:2468] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
I20260709 13:15:18.157768  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
W20260709 13:15:18.093556  6770 consensus_meta.cc:287] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.611s	user 0.013s	sys 0.000s
I20260709 13:15:18.132292  6547 raft_consensus.cc:493] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:18.178148  6822 raft_consensus.cc:2804] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:18.180428  4672 leader_election.cc:304] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:18.199055  4025 raft_consensus.cc:1275] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:15:18.183688  4071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:18.210743  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:18.211664  4033 raft_consensus.cc:3060] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:15:18.217046  4025 raft_consensus.cc:1240] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:18.220860  4029 raft_consensus.cc:1240] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:18.156104  6779 raft_consensus.cc:493] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:18.156085  6730 raft_consensus.cc:2749] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:18.227262  3959 raft_consensus.cc:2393] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 7: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:18.085989  6836 consensus_queue.cc:260] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:18.138803  6823 consensus_queue.cc:1048] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:15:18.235695  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:18.237071  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:18.240106  6843 raft_consensus.cc:493] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.240518  4709 raft_consensus.cc:1240] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:18.241641  3997 leader_election.cc:304] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:18.276953  4101 raft_consensus.cc:2393] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 6: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:18.207742  4026 raft_consensus.cc:2468] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
I20260709 13:15:18.279029  4033 raft_consensus.cc:2468] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 5.
W20260709 13:15:18.249941  6813 consensus_meta.cc:287] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.764s	user 0.007s	sys 0.007s
I20260709 13:15:18.204010  6826 raft_consensus.cc:2804] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:18.207804  6547 raft_consensus.cc:3060] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:18.197391  6447 raft_consensus.cc:2804] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:18.144340  6623 raft_consensus.cc:515] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:18.215152  6822 raft_consensus.cc:493] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:18.197551  6718 raft_consensus.cc:2804] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:15:18.261725  3905 auto_rebalancer.cc:629] Failed to schedule move for tablet 649df91131174f00af0e0a0240f80adb: Illegal state: Replica 8952c48a6f3a43968f7d77f7bfc4d1bc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:18.261920  4029 raft_consensus.cc:1240] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:18.266453  6512 raft_consensus.cc:515] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:18.268178  6731 leader_election.cc:290] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:18.269795  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:18.270643  4100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45336 (request call id 1179) took 1437 ms. Trace:
I20260709 13:15:18.271327  6824 leader_election.cc:290] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:18.273824  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:18.157279  6768 raft_consensus.cc:515] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:18.306052  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:18.337189  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:18.227586  6839 raft_consensus.cc:2749] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:18.339118  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:18.342555  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:18.350867  4672 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.198.193:35339 timed out after 1.538s (SENT) [suppressed 16 similar messages]
I20260709 13:15:18.222316  6628 raft_consensus.cc:493] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:18.249691  6779 raft_consensus.cc:3060] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:18.260895  6324 consensus_meta.cc:287] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938: Time spent flushing consensus metadata: real 0.719s	user 0.006s	sys 0.007s
I20260709 13:15:18.244652  4074 leader_election.cc:304] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:18.195236  6770 raft_consensus.cc:515] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:18.363473  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:18.366127  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:18.341051  6847 leader_election.cc:290] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:18.508899  6734 leader_election.cc:290] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:18.509684  6734 raft_consensus.cc:493] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:18.510505  6734 raft_consensus.cc:515] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:18.339856  6540 raft_consensus.cc:493] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:18.445226  4100 rpcz_store.cc:276] 0709 13:15:16.832952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.668676 (+835724us) service_pool.cc:224] Handling call
0709 13:15:17.677229 (+  8553us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:17.683630 (+  6401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:17.683663 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:17.783531 (+ 99868us) log.cc:844] Serialized 52 byte log entry
0709 13:15:18.132408 (+348877us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:18.132451 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:18.132523 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:18.270382 (+137859us) raft_consensus.cc:1685] finished
0709 13:15:18.270404 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:18.270573 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7194,"raft.queue_time_us":6897,"raft.run_cpu_time_us":10812,"raft.run_wall_time_us":49282,"thread_start_us":264585,"threads_started":1,"wal-append.queue_time_us":461868}
I20260709 13:15:18.512085  6529 leader_election.cc:290] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:18.445580  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:18.513253  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:15:18.513535  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 268985us
I20260709 13:15:18.514423  4074 leader_election.cc:304] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:15:18.449437  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:18.360800  6800 raft_consensus.cc:493] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:18.487928  4032 raft_consensus.cc:2393] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 8: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:18.489707  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:18.365978  6447 raft_consensus.cc:493] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:18.493924  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:18.371232  6836 raft_consensus.cc:3060] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:18.498732  4026 raft_consensus.cc:3060] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:18.353060  6843 raft_consensus.cc:515] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:18.339241  6853 raft_consensus.cc:515] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:18.403884  6769 raft_consensus.cc:2749] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117) with higher term. Message: Invalid argument: T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 6. Current term is 7.
I20260709 13:15:18.508634  4106 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "f1c75790cedf4f52a3463a255c7da059"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:15:18.561534  4106 raft_consensus.cc:606] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 LEADER]: Received request to transfer leadership to TS f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:18.509745  6744 raft_consensus.cc:493] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.445376  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:18.520349  4027 raft_consensus.cc:2393] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 6: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:18.522284  6731 raft_consensus.cc:2749] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:18.374605  6822 raft_consensus.cc:3060] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:18.374593  6718 raft_consensus.cc:493] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:18.524060  4074 leader_election.cc:304] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:18.537128  6758 consensus_meta.cc:287] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.567s	user 0.012s	sys 0.000s
I20260709 13:15:18.535384  6447 raft_consensus.cc:3060] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:18.403505  6826 raft_consensus.cc:697] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:18.403698  6706 raft_consensus.cc:515] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:18.543253  4107 raft_consensus.cc:2393] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 6: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:18.499722  6688 leader_election.cc:290] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:18.581703  4673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:18.511870  6540 raft_consensus.cc:515] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:18.613215  4102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34656 (request call id 331) took 1274 ms. Trace:
I20260709 13:15:18.534482  6791 leader_election.cc:290] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:18.534825  6529 raft_consensus.cc:2804] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:18.364564  6813 raft_consensus.cc:515] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:18.533156  6830 raft_consensus.cc:2804] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:18.495519  6628 raft_consensus.cc:515] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:18.599141  6324 raft_consensus.cc:493] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:18.529539  6800 raft_consensus.cc:515] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:18.641731  6718 raft_consensus.cc:3060] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:18.644718  6566 raft_consensus.cc:2749] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:18.645519  6767 leader_election.cc:290] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Requested vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:18.612366  6744 raft_consensus.cc:515] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:18.645372  6758 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:18.657284  6529 raft_consensus.cc:493] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:18.680717  6734 leader_election.cc:290] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:18.680835  6770 leader_election.cc:290] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:18.661998  6830 raft_consensus.cc:493] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:18.687722  6830 raft_consensus.cc:3060] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:18.701658  6800 leader_election.cc:290] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:15:18.702762  6857 log.cc:927] Time spent T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:15:18.705516  6813 leader_election.cc:290] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:18.691375  6826 consensus_queue.cc:237] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:18.707665  6822 raft_consensus.cc:515] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:18.743366  3951 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.021s	sys 0.050s
W20260709 13:15:18.743993  3922 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.005s	sys 0.013s
W20260709 13:15:18.744495  3951 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.021s	sys 0.051s
W20260709 13:15:18.744632  3922 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.005s	sys 0.013s
W20260709 13:15:18.745443  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 523665us
W20260709 13:15:18.747864  3923 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.008s	sys 0.026s
I20260709 13:15:18.748420  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:18.750196  3951 raft_consensus.cc:2468] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 6.
I20260709 13:15:18.752534  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:18.754585  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:15:18.748450  3923 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.008s	sys 0.026s
I20260709 13:15:18.600754  4027 raft_consensus.cc:1240] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:15:18.756625  3952 raft_consensus.cc:2393] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 8: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
W20260709 13:15:18.758055  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:18.758464  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:18.759863  4027 raft_consensus.cc:1240] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 5. Current term is 6. Ops: []
W20260709 13:15:18.760349  3999 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.031s	sys 0.064s
W20260709 13:15:18.760872  3999 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.031s	sys 0.064s
W20260709 13:15:18.761389  3999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 521500us
W20260709 13:15:18.762241  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 520510us
I20260709 13:15:18.763267  4029 raft_consensus.cc:1240] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:15:18.568907  4026 raft_consensus.cc:2468] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 7.
W20260709 13:15:18.759897  3955 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.008s	sys 0.011s
W20260709 13:15:18.764357  3955 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.008s	sys 0.011s
W20260709 13:15:18.759212  3954 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.012s	sys 0.024s
W20260709 13:15:18.766880  3954 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.012s	sys 0.025s
I20260709 13:15:18.526083  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:18.768805  4033 raft_consensus.cc:2410] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 10 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:15:18.769093  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:18.769975  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:18.770982  4033 raft_consensus.cc:2468] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 7.
I20260709 13:15:18.601087  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:18.520874  3957 raft_consensus.cc:2393] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 in current term 5: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:18.771450  3954 raft_consensus.cc:1217] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[3.2-6.3]   Dedup: 3.2->[6.3-6.3]
I20260709 13:15:18.782944  3954 raft_consensus.cc:1240] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 6. Current term is 7. Ops: [3.2-6.3]
I20260709 13:15:18.652845  4102 rpcz_store.cc:276] 0709 13:15:17.338559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.010617 (+672058us) service_pool.cc:224] Handling call
0709 13:15:18.010925 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:18.011292 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:18.011322 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:18.011855 (+   533us) log.cc:844] Serialized 26 byte log entry
0709 13:15:18.167688 (+155833us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:18.229903 (+ 62215us) log.cc:844] Serialized 14 byte log entry
0709 13:15:18.249519 (+ 19616us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:18.249648 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:18.612940 (+363292us) raft_consensus.cc:1685] finished
0709 13:15:18.612967 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:18.613144 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72445,"prepare.queue_time_us":81641,"raft.queue_time_us":21304,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":18064,"spinlock_wait_cycles":9464064,"thread_start_us":155434,"threads_started":1,"wal-append.queue_time_us":439832}
I20260709 13:15:18.526597  4101 raft_consensus.cc:2468] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 8.
W20260709 13:15:18.615123  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 91149.5us
I20260709 13:15:18.786165  3954 raft_consensus.cc:1240] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:18.783475  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:18.787003  4033 raft_consensus.cc:2468] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 5.
I20260709 13:15:18.747238  3922 leader_election.cc:304] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:18.749871  3853 catalog_manager.cc:5697] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 4 to 6, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 6 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:18.788762  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:18.789870  3922 leader_election.cc:304] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:18.798374  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:18.775079  3924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:18.799515  4102 raft_consensus.cc:2468] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 5.
I20260709 13:15:18.801187  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:18.802039  4071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:18.789536  3853 catalog_manager.cc:5697] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:18.762288  4027 raft_consensus.cc:1240] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:18.776264  3997 leader_election.cc:304] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:18.796296  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:18.808880  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:18.809842  4099 raft_consensus.cc:2468] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
I20260709 13:15:18.809846  3997 leader_election.cc:304] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:18.811407  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:18.643850  4105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45332 (request call id 1687) took 1816 ms. Trace:
I20260709 13:15:18.816144  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:18.806500  4027 raft_consensus.cc:2955] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 2 to 6, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:15:18.817181  4106 raft_consensus.cc:2368] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 6. Current term is 7.
I20260709 13:15:18.818286  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:18.818965  4106 raft_consensus.cc:3060] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:18.820122  4107 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a08c9f959924154b694899e3a318181"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:15:18.821323  4107 raft_consensus.cc:606] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Received request to transfer leadership to TS 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:18.815773  4105 rpcz_store.cc:276] 0709 13:15:16.827218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.073187 (+245969us) service_pool.cc:224] Handling call
0709 13:15:17.542247 (+469060us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:17.542969 (+   722us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:18.643467 (+1100498us) spinlock_profiling.cc:243] Waited 469 ms on lock 0x7b54001b9750. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566d8ad 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:18.643756 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1077965696}
I20260709 13:15:18.826370  4105 raft_consensus.cc:1275] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:15:18.828382  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 477382us
I20260709 13:15:18.829487  4107 raft_consensus.cc:1240] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:15:18.834744  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:18.836397  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:18.835146  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:18.838546  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:18.839468  4709 raft_consensus.cc:2468] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9.
I20260709 13:15:18.814905  3956 raft_consensus.cc:2468] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 6.
I20260709 13:15:18.847955  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:18.837299  4701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:18.672843  6324 raft_consensus.cc:515] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:18.828935  3853 catalog_manager.cc:5697] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:18.851922  6529 raft_consensus.cc:3060] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:18.852777  6512 leader_election.cc:290] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:18.853863  6512 raft_consensus.cc:493] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.854921  3924 leader_election.cc:304] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:18.854646  6512 raft_consensus.cc:515] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:18.851994  6324 leader_election.cc:290] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:18.857669  6512 leader_election.cc:290] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:18.858273  6324 raft_consensus.cc:493] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.861676  6540 leader_election.cc:290] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:18.857596  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:18.864142  3956 raft_consensus.cc:3060] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:18.865552  6512 raft_consensus.cc:993] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc: : Instructing follower f1c75790cedf4f52a3463a255c7da059 to start an election
I20260709 13:15:18.830345  3997 leader_election.cc:304] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:18.867467  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 52531.8us
I20260709 13:15:18.862987  3853 catalog_manager.cc:5697] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:18.868831  3997 leader_election.cc:304] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:18.877921  3951 raft_consensus.cc:2393] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 5: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:18.883651  4106 raft_consensus.cc:2468] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 5.
I20260709 13:15:18.886812  3954 raft_consensus.cc:1240] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:15:18.859231  6324 raft_consensus.cc:515] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:18.888001  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:18.892445  6869 raft_consensus.cc:2764] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:15:18.893054  3922 leader_election.cc:304] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:18.893543  6869 raft_consensus.cc:2804] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:18.893640  6744 leader_election.cc:290] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:18.894397  6869 raft_consensus.cc:697] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:18.895072  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:18.896073  6871 raft_consensus.cc:2749] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:18.896463  6628 leader_election.cc:290] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:18.896917  4107 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "f1c75790cedf4f52a3463a255c7da059"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:15:18.897658  4107 raft_consensus.cc:606] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Received request to transfer leadership to TS f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:18.898026  4107 raft_consensus.cc:614] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:18.896373  3951 raft_consensus.cc:2410] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:15:18.901121  6566 raft_consensus.cc:1081] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 LEADER]: Signalling peer f1c75790cedf4f52a3463a255c7da059 to start an election
I20260709 13:15:18.903615  6734 raft_consensus.cc:2804] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:18.904038  6623 leader_election.cc:290] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:18.904363  6734 raft_consensus.cc:493] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:18.904966  6734 raft_consensus.cc:3060] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:18.906162  6823 consensus_queue.cc:1059] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:18.908737  6840 raft_consensus.cc:2749] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:18.885432  6540 raft_consensus.cc:2749] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:18.912390  6840 raft_consensus.cc:3055] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:18.912854  6840 raft_consensus.cc:740] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:18.695814  6768 leader_election.cc:290] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:18.914230  6840 consensus_queue.cc:260] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:18.921545  6614 raft_consensus.cc:493] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.928138  6770 raft_consensus.cc:2804] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:15:18.928766  3953 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35354 (request call id 285) took 1835 ms (client timeout 1538 ms). Trace:
W20260709 13:15:18.929456  3953 rpcz_store.cc:269] 0709 13:15:17.093073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.094021 (+   948us) service_pool.cc:224] Handling call
0709 13:15:18.928185 (+1834164us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b54001888d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:18.928433 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":300180864}
I20260709 13:15:18.933466  3958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38606 (request call id 1851) took 1107 ms. Trace:
I20260709 13:15:18.934116  3958 rpcz_store.cc:276] 0709 13:15:17.825356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.825936 (+   580us) service_pool.cc:224] Handling call
0709 13:15:18.932870 (+1106934us) spinlock_profiling.cc:243] Waited 86.7 ms on lock 0x7b54000f28d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:18.933191 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":199463680}
I20260709 13:15:18.928128  6614 raft_consensus.cc:515] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:18.937525  6768 raft_consensus.cc:2804] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:18.938035  6758 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Requested vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:18.938298  6768 raft_consensus.cc:697] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 7 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
W20260709 13:15:18.936579  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 49405.2us
W20260709 13:15:18.942124  6547 consensus_meta.cc:287] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 0.570s	user 0.015s	sys 0.000s
I20260709 13:15:18.942811  3922 leader_election.cc:304] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:18.945068  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:18.945760  3905 auto_rebalancer.cc:629] Failed to schedule move for tablet b1073c870d784f068fdb3f222623f5a3: Illegal state: Replica 8952c48a6f3a43968f7d77f7bfc4d1bc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:18.946094  4101 raft_consensus.cc:2376] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 8. Re-sending same reply.
W20260709 13:15:18.948451  6877 log.cc:927] Time spent T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:15:18.950255  4033 raft_consensus.cc:1240] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:18.939402  6614 leader_election.cc:290] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:18.952342  6614 consensus_queue.cc:1059] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:18.954835  6614 raft_consensus.cc:3055] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:18.954607  6768 consensus_queue.cc:237] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:18.957602  6869 consensus_queue.cc:237] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:18.955317  6614 raft_consensus.cc:740] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:18.928853  6770 raft_consensus.cc:493] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:18.982265  3956 raft_consensus.cc:2468] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 8.
I20260709 13:15:18.873888  3853 catalog_manager.cc:5697] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 3 to 4, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 4 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:18.992159  2843 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:15:18.997705  6324 leader_election.cc:290] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:18.942703  6547 raft_consensus.cc:515] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:19.002959  5962 raft_consensus.cc:3060] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:18.984972  6770 raft_consensus.cc:3060] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:19.007349  6759 raft_consensus.cc:3055] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:19.007965  6759 raft_consensus.cc:740] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:19.011060  6759 consensus_queue.cc:260] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:19.016615  6759 raft_consensus.cc:3060] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:19.026149  4099 raft_consensus.cc:2410] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:15:19.011878  6547 leader_election.cc:290] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:19.026935  3853 catalog_manager.cc:5697] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:19.029615  3853 catalog_manager.cc:5697] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 1 to 4, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 4 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:19.013482  4103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34656 (request call id 326) took 1678 ms. Trace:
I20260709 13:15:19.013057  4030 raft_consensus.cc:2393] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 6: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:19.031288  6840 raft_consensus.cc:3060] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:19.031649  2843 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:19.038106  3955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1864) took 1169 ms. Trace:
I20260709 13:15:19.015244  4701 raft_consensus.cc:1275] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:19.046433  4028 raft_consensus.cc:1240] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:19.010377  6758 raft_consensus.cc:2804] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:15:19.054709  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 62312.2us
W20260709 13:15:19.068298  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 58695.8us
I20260709 13:15:19.067013  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:19.048604  3955 rpcz_store.cc:276] 0709 13:15:17.869142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.181866 (+312724us) service_pool.cc:224] Handling call
0709 13:15:18.182235 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:18.765030 (+582795us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:18.765074 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:18.766104 (+  1030us) log.cc:844] Serialized 26 byte log entry
0709 13:15:18.888281 (+122177us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:18.888352 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:18.899555 (+ 11203us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:19.037729 (+138174us) raft_consensus.cc:1685] finished
0709 13:15:19.037757 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:19.038013 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32315,"raft.queue_time_us":77400,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":65487,"thread_start_us":657838,"threads_started":2,"wal-append.queue_time_us":215258}
W20260709 13:15:19.076725  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:19.074460  6324 consensus_queue.cc:1059] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
W20260709 13:15:19.081519  6779 consensus_meta.cc:287] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 0.568s	user 0.017s	sys 0.000s
I20260709 13:15:19.081808  6324 raft_consensus.cc:3055] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:19.082288  6324 raft_consensus.cc:740] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:19.082116  6779 raft_consensus.cc:515] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:19.098006  4025 raft_consensus.cc:1240] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:19.063331  6758 raft_consensus.cc:493] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:19.039747  4103 rpcz_store.cc:276] 0709 13:15:17.334764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.992102 (+657338us) service_pool.cc:224] Handling call
0709 13:15:17.992495 (+   393us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:17.992913 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:17.992944 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:17.993582 (+   638us) log.cc:844] Serialized 52 byte log entry
0709 13:15:18.164155 (+170573us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:18.221042 (+ 56887us) log.cc:844] Serialized 14 byte log entry
0709 13:15:18.954667 (+733625us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b18004553e0. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f15224fbc0a 00007f152bc3b219 00007f1522583a40 00007f152257e4e4 00007f152257e455 00007f15290663c7 00007f15256789a7 00007f15256880bf 00007f1525688038
0709 13:15:18.976727 (+ 22060us) log.cc:844] Serialized 14 byte log entry
0709 13:15:19.003826 (+ 27099us) spinlock_profiling.cc:243] Waited 4.31 ms on lock 0x7b18004553e0. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f15225813f3 00007f15225837c1 00007f1522583779 00007f1522583709 00007f15225836d1 00007f15225829cd 000000000038f354 000000000038f199 00007f152256483a
0709 13:15:19.012778 (+  8952us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:19.012914 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:19.012989 (+    75us) raft_consensus.cc:1685] finished
0709 13:15:19.013000 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:19.013252 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":758373,"prepare.queue_time_us":810850,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":70,"raft.queue_time_us":50472,"raft.run_cpu_time_us":395,"raft.run_wall_time_us":8599,"spinlock_wait_cycles":14373504,"thread_start_us":170061,"threads_started":1,"wal-append.queue_time_us":520878}
W20260709 13:15:19.109934  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:19.083134  6734 raft_consensus.cc:515] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:19.119102  3951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1866) took 1095 ms. Trace:
I20260709 13:15:19.111663  6758 raft_consensus.cc:3060] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:19.122020  4071 leader_election.cc:304] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:19.124976  3956 raft_consensus.cc:1240] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:19.121075  3951 rpcz_store.cc:276] 0709 13:15:18.024110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.916154 (+892044us) service_pool.cc:224] Handling call
0709 13:15:18.985379 (+ 69225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:19.038389 (+ 53010us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:15:19.038752 (+   363us) log.cc:844] Serialized 14 byte log entry
0709 13:15:19.118627 (+ 79875us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:19.118699 (+    72us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:19.118776 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:19.118866 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:19.119029 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81,"prepare.queue_time_us":3431,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":65,"raft.queue_time_us":7689,"thread_start_us":65004,"threads_started":1}
W20260709 13:15:19.126688  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 258136us
I20260709 13:15:19.083456  6324 consensus_queue.cc:260] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:19.113497  6830 raft_consensus.cc:515] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:19.160472  3922 leader_election.cc:304] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:15:19.160981  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:19.164426  3953 raft_consensus.cc:1240] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:15:19.160136  6826 raft_consensus.cc:2804] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:15:19.171926  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 185938us
I20260709 13:15:19.172767  6734 leader_election.cc:290] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:19.175465  6541 raft_consensus.cc:493] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.176182  6541 raft_consensus.cc:515] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:19.176733  6876 log.cc:927] Time spent T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 13:15:19.176882  6532 raft_consensus.cc:493] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.177721  6836 raft_consensus.cc:493] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:19.177605  6532 raft_consensus.cc:515] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:19.182437  4028 raft_consensus.cc:1275] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 13:15:19.182560  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:19.182890  4028 pending_rounds.cc:85] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2: Aborting all ops after (but not including) 6
I20260709 13:15:19.183681  4028 pending_rounds.cc:107] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:15:19.183749  4033 raft_consensus.cc:1240] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:19.184165  4028 raft_consensus.cc:2889] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:19.185264  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:19.186084  4033 raft_consensus.cc:2468] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 7.
I20260709 13:15:19.170831  3853 catalog_manager.cc:5697] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 3 to 4, leader changed from 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 4 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:19.187786  6839 consensus_queue.cc:1048] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:19.189179  6797 consensus_queue.cc:1059] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:19.190554  6614 consensus_queue.cc:260] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:19.195068  6843 leader_election.cc:290] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:19.195310  6614 raft_consensus.cc:3060] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:19.197324  4701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:19.186081  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:19.189400  6779 leader_election.cc:290] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:19.178969  6744 raft_consensus.cc:2804] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:19.203693  6744 raft_consensus.cc:493] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:19.203873  6727 raft_consensus.cc:493] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:19.204164  6744 raft_consensus.cc:3060] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:19.204546  6727 raft_consensus.cc:515] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:19.200171  4028 raft_consensus.cc:2468] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 8.
I20260709 13:15:19.178326  6836 raft_consensus.cc:515] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:19.200320  6826 raft_consensus.cc:697] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:19.227854  3922 leader_election.cc:400] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 election: Vote denied by peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843) with higher term. Message: Invalid argument: T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 6. Current term is 7.
W20260709 13:15:19.235668  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 61340.2us
I20260709 13:15:19.236397  6826 consensus_queue.cc:237] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:19.238113  6512 raft_consensus.cc:493] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.238837  6512 raft_consensus.cc:515] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:19.239066  3925 leader_election.cc:304] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:19.240671  3925 leader_election.cc:304] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
W20260709 13:15:19.241180  6814 consensus_meta.cc:287] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 1.103s	user 0.011s	sys 0.005s
I20260709 13:15:19.241645  6582 raft_consensus.cc:2749] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:19.241703  6814 raft_consensus.cc:515] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:19.241227  6512 leader_election.cc:290] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:15:19.245481  6447 consensus_meta.cc:287] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 0.590s	user 0.013s	sys 0.002s
I20260709 13:15:19.246006  6447 raft_consensus.cc:515] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:19.246824  6522 consensus_queue.cc:1048] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:19.247764  3925 leader_election.cc:304] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:19.248684  3954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35354 (request call id 289) took 1231 ms. Trace:
I20260709 13:15:19.248853  6767 raft_consensus.cc:2749] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:19.249380  3925 leader_election.cc:304] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:15:19.249565  3922 leader_election.cc:304] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:15:19.250648  3959 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38606 (request call id 1858) took 1423 ms (client timeout 1540 ms). Trace:
I20260709 13:15:19.252111  6324 raft_consensus.cc:3060] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:19.258953  4073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:19.260507  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 95961.1us
I20260709 13:15:19.259377  6727 leader_election.cc:290] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:19.262972  3956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38612 (request call id 1160) took 1079 ms. Trace:
I20260709 13:15:19.263460  3956 rpcz_store.cc:276] 0709 13:15:18.183391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.991480 (+808089us) service_pool.cc:224] Handling call
0709 13:15:19.110956 (+119476us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:19.125432 (+ 14476us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:19.262656 (+137224us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b5400218ed4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:19.262888 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31781760}
I20260709 13:15:19.265146  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:19.277587  3950 raft_consensus.cc:2410] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:15:19.278592  4034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38290 (request call id 1793) took 1104 ms. Trace:
I20260709 13:15:19.278934  3950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38606 (request call id 1850) took 1454 ms. Trace:
I20260709 13:15:19.279506  3950 rpcz_store.cc:276] 0709 13:15:17.825031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.825231 (+   200us) service_pool.cc:224] Handling call
0709 13:15:19.278673 (+1453442us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54002170d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:19.278873 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3218547072}
I20260709 13:15:19.230952  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:19.278321  5962 consensus_queue.cc:1048] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:19.279402  4032 raft_consensus.cc:1240] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:15:19.238155  4074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:19.293161  4029 raft_consensus.cc:1240] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:19.294365  4026 raft_consensus.cc:2468] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 5.
I20260709 13:15:19.249151  3954 rpcz_store.cc:276] 0709 13:15:18.017022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.787081 (+770059us) service_pool.cc:224] Handling call
0709 13:15:18.882811 (+ 95730us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:18.888359 (+  5548us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:19.248427 (+360068us) spinlock_profiling.cc:243] Waited 95.3 ms on lock 0x7b54003aedd0. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566d8ad 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:19.248589 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":219138944}
W20260709 13:15:19.296957  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 108322us
W20260709 13:15:19.293305  3952 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38612 (request call id 1156) took 1493 ms (client timeout 1641 ms). Trace:
W20260709 13:15:19.251093  3959 rpcz_store.cc:269] 0709 13:15:17.827025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.859471 (+ 32446us) service_pool.cc:224] Handling call
0709 13:15:19.250100 (+1390629us) spinlock_profiling.cc:243] Waited 354 ms on lock 0x7b54000be5d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:19.250427 (+   327us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":815028608}
I20260709 13:15:19.297276  3922 leader_election.cc:304] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:19.279757  3997 leader_election.cc:304] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
W20260709 13:15:19.299515  4672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:19.298609  3952 rpcz_store.cc:269] 0709 13:15:17.799827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.800062 (+   235us) service_pool.cc:224] Handling call
0709 13:15:19.259955 (+1459893us) spinlock_profiling.cc:243] Waited 904 ms on lock 0x7b54003ff554. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:19.293237 (+ 33282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2079414016}
I20260709 13:15:19.278961  3925 leader_election.cc:304] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:19.301966  4030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38304 (request call id 1983) took 1213 ms. Trace:
I20260709 13:15:19.279027  4034 rpcz_store.cc:276] 0709 13:15:18.189140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.189320 (+   180us) service_pool.cc:224] Handling call
0709 13:15:18.189750 (+   430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:18.472865 (+283115us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:15:18.772124 (+299259us) log.cc:844] Serialized 14 byte log entry
0709 13:15:18.910164 (+138040us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:18.910264 (+   100us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:18.910379 (+   115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:19.273564 (+363185us) spinlock_profiling.cc:243] Waited 8.56 ms on lock 0x7b48000cda58. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152a597aa1 00007f152a58eb37 00007f152a58e9ca 00007f152a68626f 00007f152a685f37 00007f152a69a55c 00007f152a69a508 00007f152a69a488 00007f152a69a443 00007f152a6996ec 00007f15295c3a96
0709 13:15:19.278131 (+  4567us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b54000a3cd4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:19.278189 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:19.278369 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13618,"prepare.queue_time_us":230821,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":56,"raft.queue_time_us":26746,"raft.run_cpu_time_us":3386,"raft.run_wall_time_us":362906,"spinlock_wait_cycles":670082176,"thread_start_us":410023,"threads_started":2,"wal-append.queue_time_us":111802}
I20260709 13:15:19.304040  6758 raft_consensus.cc:515] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:19.304625  6822 leader_election.cc:290] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:19.306510  6758 leader_election.cc:290] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:19.306675  6706 leader_election.cc:290] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:19.307299  6799 raft_consensus.cc:493] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.307976  6799 raft_consensus.cc:515] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:19.308526  6830 leader_election.cc:290] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:19.309829  6541 leader_election.cc:290] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:19.310240  6799 leader_election.cc:290] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:19.310810  3957 raft_consensus.cc:1240] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:19.281718  6868 consensus_queue.cc:1048] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:15:19.312209  6794 raft_consensus.cc:2804] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:19.312654  6794 raft_consensus.cc:493] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:19.313032  6794 raft_consensus.cc:3060] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:19.281885  6853 leader_election.cc:290] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:19.315872  3958 raft_consensus.cc:1240] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 6. Current term is 7. Ops: []
W20260709 13:15:19.317135  6887 log.cc:927] Time spent T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:15:19.317057  3958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38612 (request call id 1158) took 1134 ms. Trace:
I20260709 13:15:19.317492  3954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35354 (request call id 294) took 1112 ms. Trace:
I20260709 13:15:19.317724  3958 rpcz_store.cc:276] 0709 13:15:18.182836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.935276 (+752440us) service_pool.cc:224] Handling call
0709 13:15:19.268501 (+333225us) spinlock_profiling.cc:243] Waited 28.1 ms on lock 0x7b5800002d98. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f1522549b71 00007f1522549a22 00007f152b462c09 00007f152a5bcee0 00007f152a6860ab 00007f152a686131 00007f152a647fc0 00007f152a632929 00007f152a6323d2 00007f1523ba9bd4
0709 13:15:19.299902 (+ 31401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:19.316677 (+ 16775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:19.316981 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64516992}
I20260709 13:15:19.319085  3957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35354 (request call id 287) took 1302 ms. Trace:
I20260709 13:15:19.320815  3957 rpcz_store.cc:276] 0709 13:15:18.016533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.782618 (+766085us) service_pool.cc:224] Handling call
0709 13:15:19.293418 (+510800us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:19.311226 (+ 17808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:19.318914 (+  7688us) spinlock_profiling.cc:243] Waited 501 ms on lock 0x7b54003ff550. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566d8ad 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:19.319031 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1152259840}
I20260709 13:15:19.322593  6836 leader_election.cc:290] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:19.283989  4701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
W20260709 13:15:19.323400  6881 log.cc:927] Time spent T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.166s	user 0.000s	sys 0.003s
I20260709 13:15:19.323154  3853 catalog_manager.cc:5697] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:19.324748  3951 raft_consensus.cc:1240] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:19.317903  3954 rpcz_store.cc:276] 0709 13:15:18.204729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:19.296159 (+1091430us) service_pool.cc:224] Handling call
0709 13:15:19.316918 (+ 20759us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:19.317164 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:19.317198 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:19.317257 (+    59us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:19.317285 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:19.317333 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:19.317440 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:19.326032  3951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38612 (request call id 1164) took 1141 ms. Trace:
I20260709 13:15:19.325402  3853 catalog_manager.cc:5697] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 4 to 5, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 5 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:19.326407  3951 rpcz_store.cc:276] 0709 13:15:18.184452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:19.137501 (+953049us) service_pool.cc:224] Handling call
0709 13:15:19.284300 (+146799us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:19.325172 (+ 40872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:19.325846 (+   674us) spinlock_profiling.cc:243] Waited 81.7 ms on lock 0x7b54000be5d0. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566d8ad 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:19.325972 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":187958528}
I20260709 13:15:19.326948  3954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1869) took 1113 ms. Trace:
I20260709 13:15:19.302352  4030 rpcz_store.cc:276] 0709 13:15:18.082490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.088920 (+  6430us) service_pool.cc:224] Handling call
0709 13:15:19.274118 (+1185198us) spinlock_profiling.cc:243] Waited 870 ms on lock 0x7b54000a0854. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:19.295669 (+ 21551us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2001483008}
I20260709 13:15:19.323352  3957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1868) took 1110 ms. Trace:
I20260709 13:15:19.329919  3957 rpcz_store.cc:276] 0709 13:15:18.212675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:19.322069 (+1109394us) service_pool.cc:224] Handling call
0709 13:15:19.322609 (+   540us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:19.322932 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:19.322955 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:19.323025 (+    70us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:19.323059 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:19.323138 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:19.323281 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:19.327533  3954 rpcz_store.cc:276] 0709 13:15:18.213055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:19.325816 (+1112761us) service_pool.cc:224] Handling call
0709 13:15:19.326259 (+   443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:19.326508 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:19.326543 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:19.326644 (+   101us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:19.326687 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:19.326755 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:19.326882 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:19.315937  6540 raft_consensus.cc:2804] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:19.334256  3953 raft_consensus.cc:1240] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 5. Current term is 6. Ops: []
W20260709 13:15:19.336010  4673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:19.280927  6532 leader_election.cc:290] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:19.350986  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:19.357462  3953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38612 (request call id 1167) took 1172 ms. Trace:
I20260709 13:15:19.358034  3953 rpcz_store.cc:276] 0709 13:15:18.185169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:19.215855 (+1030686us) service_pool.cc:224] Handling call
0709 13:15:19.229806 (+ 13951us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:19.337845 (+108039us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:19.357128 (+ 19283us) spinlock_profiling.cc:243] Waited 99.2 ms on lock 0x7b54003cd554. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:19.357372 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":228154112}
W20260709 13:15:19.358678  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 73524.1us
I20260709 13:15:19.339406  6767 raft_consensus.cc:2749] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:19.363595  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:19.363487  6540 raft_consensus.cc:697] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 5 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:19.367003  6839 raft_consensus.cc:3055] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:19.367290  6842 raft_consensus.cc:993] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc: : Instructing follower 6f5b5e4ed72944ecbda200012d141dc2 to start an election
I20260709 13:15:19.367484  6839 raft_consensus.cc:740] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:19.367888  6842 raft_consensus.cc:1081] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Signalling peer 6f5b5e4ed72944ecbda200012d141dc2 to start an election
I20260709 13:15:19.368077  6540 consensus_queue.cc:237] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:19.371479  4099 raft_consensus.cc:2393] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 in current term 7: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
W20260709 13:15:19.371922  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 92298.1us
I20260709 13:15:19.373345  3956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35354 (request call id 291) took 1184 ms. Trace:
I20260709 13:15:19.373805  3956 rpcz_store.cc:276] 0709 13:15:18.185433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:19.266435 (+1081002us) service_pool.cc:224] Handling call
0709 13:15:19.337169 (+ 70734us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:19.370107 (+ 32938us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:19.370127 (+    20us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:19.370156 (+    29us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:19.370177 (+    21us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:19.370219 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:19.370297 (+    78us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:19.374454  3951 raft_consensus.cc:1240] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:15:19.373517  3950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35354 (request call id 293) took 1184 ms. Trace:
I20260709 13:15:19.375824  3950 rpcz_store.cc:276] 0709 13:15:18.199767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:19.283219 (+1083452us) service_pool.cc:224] Handling call
0709 13:15:19.349321 (+ 66102us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:19.370373 (+ 21052us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:19.370392 (+    19us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:19.370425 (+    33us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:19.370445 (+    20us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:19.370485 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:19.370558 (+    73us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:19.356235  6853 raft_consensus.cc:2749] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:19.343042  6830 raft_consensus.cc:493] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:19.376587  3951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1870) took 1090 ms. Trace:
I20260709 13:15:19.301395  6529 raft_consensus.cc:515] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:19.356603  6541 raft_consensus.cc:2749] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:19.355604  6582 raft_consensus.cc:2749] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:19.381910  4104 raft_consensus.cc:1240] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 5. Current term is 6. Ops: []
W20260709 13:15:19.372761  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 93936.9us
I20260709 13:15:19.380262  3951 rpcz_store.cc:276] 0709 13:15:18.286155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:19.327485 (+1041330us) service_pool.cc:224] Handling call
0709 13:15:19.363504 (+ 36019us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:19.376361 (+ 12857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:19.376515 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:19.379652  3957 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0"
dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
 from {username='slave'} at 127.0.0.1:38606
I20260709 13:15:19.386430  3957 raft_consensus.cc:493] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:19.386835  3957 raft_consensus.cc:3060] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:19.388298  6830 raft_consensus.cc:515] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:19.391757  3955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38612 (request call id 1162) took 1207 ms. Trace:
I20260709 13:15:19.392325  3955 rpcz_store.cc:276] 0709 13:15:18.183953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:19.110022 (+926069us) service_pool.cc:224] Handling call
0709 13:15:19.110497 (+   475us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:19.146001 (+ 35504us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:15:19.146055 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:19.170373 (+ 24318us) log.cc:844] Serialized 26 byte log entry
0709 13:15:19.351696 (+181323us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:19.351737 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:19.351811 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:19.391484 (+ 39673us) raft_consensus.cc:1685] finished
0709 13:15:19.391517 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:19.391683 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13128,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":5092,"thread_start_us":169880,"threads_started":1,"wal-append.queue_time_us":200063}
I20260709 13:15:19.377971  4701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:19.396977  6447 leader_election.cc:290] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:19.400691  6744 raft_consensus.cc:515] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:19.401566  3998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:19.403023  6744 leader_election.cc:290] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:19.403251  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:19.403999  4030 raft_consensus.cc:3060] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:19.404139  4032 raft_consensus.cc:1275] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:15:19.406838  4073 leader_election.cc:304] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:19.368714  6839 consensus_queue.cc:260] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:19.384652  6814 leader_election.cc:290] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:19.408454  6839 raft_consensus.cc:3060] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:19.409184  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:19.410812  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:19.412223  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:19.412967  4702 raft_consensus.cc:2468] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 9.
I20260709 13:15:19.413442  6529 leader_election.cc:290] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:19.416298  3950 raft_consensus.cc:1275] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:15:19.418399  4032 raft_consensus.cc:1240] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:19.423840  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
W20260709 13:15:19.383203  4071 leader_election.cc:336] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Timed out: RequestConsensusVote RPC to 127.2.198.193:35339 timed out after 1.540s (SENT)
I20260709 13:15:19.425568  4071 leader_election.cc:304] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:19.427978  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:19.430755  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:19.432564  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:19.433235  3925 leader_election.cc:304] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:19.327445  3853 catalog_manager.cc:5697] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 2 to 4, leader changed from 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 4 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:19.439728  6836 raft_consensus.cc:2749] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:19.430430  6718 consensus_meta.cc:287] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 0.735s	user 0.012s	sys 0.003s
I20260709 13:15:19.453059  6730 raft_consensus.cc:493] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:19.458472  6718 raft_consensus.cc:515] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:19.458817  6730 raft_consensus.cc:515] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:19.459978  4031 raft_consensus.cc:1240] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:19.461194  6718 leader_election.cc:290] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:19.445606  3997 leader_election.cc:304] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:19.439303  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 60480.5us
I20260709 13:15:19.462565  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:19.432416  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:19.435925  6541 consensus_queue.cc:1048] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:15:19.458964  3853 catalog_manager.cc:5697] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 3 to 6, leader changed from 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 6 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:19.437268  6512 raft_consensus.cc:2749] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:19.445547  4073 leader_election.cc:304] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:19.468569  6836 raft_consensus.cc:2804] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:19.468559  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:19.436508  6814 consensus_queue.cc:1059] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:15:19.469120  6836 raft_consensus.cc:493] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:19.471428  4071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:19.434725  6744 raft_consensus.cc:2749] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:19.437001  3925 leader_election.cc:304] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:19.478276  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:19.474985  4030 raft_consensus.cc:2468] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7.
I20260709 13:15:19.485868  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:19.481520  6794 raft_consensus.cc:515] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:19.488624  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:19.461802  6730 leader_election.cc:290] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:19.488145  4032 raft_consensus.cc:2393] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 6: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:19.478192  6688 raft_consensus.cc:2749] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:19.492947  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 56263.7us
I20260709 13:15:19.493260  6797 raft_consensus.cc:493] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:19.476836  6836 raft_consensus.cc:3060] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:19.497684  6814 raft_consensus.cc:2804] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:15:19.500418  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 54988.2us
I20260709 13:15:19.452159  6770 raft_consensus.cc:515] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:19.502910  3952 raft_consensus.cc:1240] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:19.498971  3957 raft_consensus.cc:515] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:19.503319  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:19.504065  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:19.507973  3951 raft_consensus.cc:2393] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 5: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:19.509217  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:19.496456  6512 raft_consensus.cc:493] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:19.523957  3997 leader_election.cc:304] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:19.525821  6512 raft_consensus.cc:515] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:19.526865  6727 raft_consensus.cc:493] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.527598  6688 raft_consensus.cc:2804] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:19.511519  3953 raft_consensus.cc:1240] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:19.528280  6688 raft_consensus.cc:493] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:19.528738  6688 raft_consensus.cc:3060] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:19.530439  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:19.519044  6770 leader_election.cc:290] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 election: Requested vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:19.520973  6794 leader_election.cc:290] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:19.532208  4074 leader_election.cc:304] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:19.507895  6814 raft_consensus.cc:697] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 6 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:19.532672  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:19.527693  6730 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:19.527503  6727 raft_consensus.cc:515] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:19.508826  6797 raft_consensus.cc:515] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:19.521708  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 70257.4us
I20260709 13:15:19.523936  3956 raft_consensus.cc:2393] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 10: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:19.526777  3997 leader_election.cc:304] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:19.538688  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:19.538857  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:19.540513  4707 raft_consensus.cc:3060] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:19.541477  3952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35354 (request call id 295) took 1330 ms. Trace:
I20260709 13:15:19.542052  3952 rpcz_store.cc:276] 0709 13:15:18.210724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:19.301507 (+1090783us) service_pool.cc:224] Handling call
0709 13:15:19.304293 (+  2786us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:19.504826 (+200533us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:19.541145 (+ 36319us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b5400320ad4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:19.541390 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":453710592}
I20260709 13:15:19.548794  3957 leader_election.cc:290] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Requested vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:19.550197  6730 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:19.551849  6797 leader_election.cc:290] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:19.552520  6529 raft_consensus.cc:2804] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:19.553167  6529 raft_consensus.cc:697] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:19.553941  6727 leader_election.cc:290] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:19.554308  6529 consensus_queue.cc:237] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:19.554775  6516 consensus_queue.cc:1059] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:15:19.556708  6516 raft_consensus.cc:493] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.557091  6842 raft_consensus.cc:3055] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:19.557564  6842 raft_consensus.cc:740] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:19.557212  6516 raft_consensus.cc:515] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:19.558588  6842 consensus_queue.cc:260] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:19.559255  4701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:19.560045  4701 raft_consensus.cc:3060] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:19.560457  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:19.561873  6868 raft_consensus.cc:3055] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:19.562270  6868 raft_consensus.cc:740] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
W20260709 13:15:19.565176  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:19.567934  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:19.568094  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:19.569135  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:19.565516  4074 leader_election.cc:304] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:19.565410  4026 consensus_queue.cc:237] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:15:19.535627  6512 leader_election.cc:290] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:15:19.573666  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 61585.9us
I20260709 13:15:19.567209  6826 raft_consensus.cc:3060] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:19.580365  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:19.552551  6730 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:19.589370  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:19.590291  4031 raft_consensus.cc:2468] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 5.
I20260709 13:15:19.563163  6868 consensus_queue.cc:260] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:19.573184  6516 leader_election.cc:290] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:19.596513  6516 consensus_queue.cc:1059] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:19.597090  3953 raft_consensus.cc:1240] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:19.598277  6727 raft_consensus.cc:3055] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:19.598695  6727 raft_consensus.cc:740] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:19.599766  6727 consensus_queue.cc:260] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:19.601192  3997 leader_election.cc:304] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:19.602046  6842 raft_consensus.cc:3060] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:19.602852  3997 leader_election.cc:304] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:19.602089  6853 raft_consensus.cc:2749] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:19.603667  6869 raft_consensus.cc:2749] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:19.605022  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:19.605230  3997 leader_election.cc:304] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:19.605935  4074 leader_election.cc:304] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:19.606360  4707 raft_consensus.cc:2468] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 10.
I20260709 13:15:19.606877  6623 raft_consensus.cc:2749] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:19.607628  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:19.606873  6730 raft_consensus.cc:2749] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:15:19.610051  6899 log.cc:927] Time spent T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.053s	user 0.002s	sys 0.002s
I20260709 13:15:19.610819  6830 leader_election.cc:290] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:19.616600  6688 raft_consensus.cc:515] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:19.619005  6688 leader_election.cc:290] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:19.622045  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:19.625497  6896 log.cc:927] Time spent T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:15:19.614284  6868 raft_consensus.cc:3060] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:19.607666  3924 leader_election.cc:304] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:19.615130  6814 consensus_queue.cc:237] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:19.633884  3957 raft_consensus.cc:1240] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:19.634793  3997 leader_election.cc:304] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:19.591310  6512 raft_consensus.cc:2749] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:19.650242  4074 leader_election.cc:304] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:19.652014  4674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:19.652590  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 45930.3us
I20260709 13:15:19.654353  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:19.653438  3997 leader_election.cc:304] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:19.657541  4672 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:19.641327  6541 raft_consensus.cc:2804] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:15:19.665637  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:19.666157  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:19.672904  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:19.673887  3956 raft_consensus.cc:2393] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 8: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
W20260709 13:15:19.675608  3925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:19.674109  6447 raft_consensus.cc:2804] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:19.679361  6447 raft_consensus.cc:493] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:19.679809  6447 raft_consensus.cc:3060] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:19.679728  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:19.682080  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:19.663508  6839 raft_consensus.cc:2749] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:19.683707  4031 raft_consensus.cc:3055] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:19.670113  6730 consensus_queue.cc:1059] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:15:19.686205  6727 raft_consensus.cc:3060] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:19.667946  6759 raft_consensus.cc:2804] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:19.687780  6894 consensus_queue.cc:1059] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:19.649935  6830 consensus_queue.cc:1048] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
W20260709 13:15:19.701289  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 78532us
I20260709 13:15:19.692828  4031 raft_consensus.cc:740] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:19.669530  6529 raft_consensus.cc:2749] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:19.693149  4032 raft_consensus.cc:2393] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 7: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:19.702085  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:19.702452  3951 raft_consensus.cc:1240] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:19.703416  4030 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a08c9f959924154b694899e3a318181"
dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:38290
I20260709 13:15:19.705962  4071 leader_election.cc:304] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:19.681551  6541 raft_consensus.cc:697] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 10 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:19.700585  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:19.680720  6516 raft_consensus.cc:493] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:19.710898  6830 raft_consensus.cc:3060] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:19.711563  4034 raft_consensus.cc:1240] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:19.705873  4031 consensus_queue.cc:260] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:15:19.712899  3959 raft_consensus.cc:2410] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:15:19.715786  4031 raft_consensus.cc:3060] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:19.698823  6759 raft_consensus.cc:493] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:19.717883  4030 raft_consensus.cc:493] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:19.718506  4030 raft_consensus.cc:3060] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:19.710112  3956 raft_consensus.cc:2393] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 7: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
W20260709 13:15:19.723492  4672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:19.730429  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:19.731384  4026 raft_consensus.cc:2393] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 6: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:19.741226  6541 consensus_queue.cc:237] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:19.745831  6729 raft_consensus.cc:3055] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:19.746286  6729 raft_consensus.cc:740] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:19.734028  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:19.721810  6759 raft_consensus.cc:3060] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:19.750304  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:19.728834  6516 raft_consensus.cc:515] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:19.752470  6797 consensus_queue.cc:1059] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:19.753651  6797 raft_consensus.cc:3055] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:19.754012  6797 raft_consensus.cc:740] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:19.754196  6516 leader_election.cc:290] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:19.754959  6797 consensus_queue.cc:260] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:19.757293  6797 raft_consensus.cc:3060] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:19.751149  4032 raft_consensus.cc:2376] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 7. Re-sending same reply.
I20260709 13:15:19.770205  4071 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:19.769963  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:19.774127  3956 raft_consensus.cc:2393] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 8: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:19.772580  4030 raft_consensus.cc:515] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:19.784694  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:19.785763  4032 raft_consensus.cc:2393] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 7: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:19.789077  6836 raft_consensus.cc:515] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:19.780818  6516 raft_consensus.cc:3060] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:19.794687  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:19.791407  6836 leader_election.cc:290] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:19.805493  6540 raft_consensus.cc:493] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.747247  6729 consensus_queue.cc:260] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:19.828236  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:19.828812  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:19.829339  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:19.830293  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:19.836185  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:19.837010  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:19.837777  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:19.782920  6512 consensus_queue.cc:1059] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:15:19.858450  3950 raft_consensus.cc:2468] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 7.
W20260709 13:15:19.867597  6906 log.cc:927] Time spent T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:15:19.824460  6522 raft_consensus.cc:493] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.880234  3956 raft_consensus.cc:2468] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 7.
I20260709 13:15:19.882067  4030 leader_election.cc:290] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:19.885469  6729 raft_consensus.cc:3060] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:19.886963  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:19.887854  3950 raft_consensus.cc:2393] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 8: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:19.888109  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:19.887866  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:19.846649  6836 consensus_queue.cc:1059] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:15:19.893908  3955 raft_consensus.cc:2468] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 7.
I20260709 13:15:19.873853  6799 raft_consensus.cc:493] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.898159  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:19.904238  6658 tablet_bootstrap.cc:492] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:15:19.906653  6447 raft_consensus.cc:515] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:19.908552  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 93219.6us
W20260709 13:15:19.909000  6905 log.cc:927] Time spent T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:15:19.909791  4701 raft_consensus.cc:2468] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7.
I20260709 13:15:19.864123  6540 raft_consensus.cc:515] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:19.911657  6522 raft_consensus.cc:515] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:19.924621  4031 raft_consensus.cc:1275] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:15:19.916436  6878 raft_consensus.cc:3055] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:19.916324  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:15:19.923923  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 115896us
I20260709 13:15:19.912503  6830 raft_consensus.cc:2749] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:19.927919  4031 pending_rounds.cc:85] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2: Aborting all ops after (but not including) 4
I20260709 13:15:19.930320  4031 pending_rounds.cc:107] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 6.5
I20260709 13:15:19.930781  4031 raft_consensus.cc:2917] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Aborting config change with OpId 6.5: Aborted: Op aborted by new leader
I20260709 13:15:19.931370  4031 raft_consensus.cc:2889] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:15:19.933171  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 63362.7us
W20260709 13:15:19.937193  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 78973us
W20260709 13:15:19.926863  3997 connection.cc:256] RPC call timeout handler was delayed by -1.5361746440000843s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16410000000000002s for a response
I20260709 13:15:19.949169  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:15:19.949718  3998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:19.949987  3954 raft_consensus.cc:2393] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 6: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:19.953305  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:19.954728  4707 raft_consensus.cc:2393] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 10: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:19.927138  6730 raft_consensus.cc:3055] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:19.955694  3957 raft_consensus.cc:2468] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 8.
I20260709 13:15:19.956365  3924 leader_election.cc:304] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:19.959255  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:19.959873  4027 raft_consensus.cc:2376] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d709ee666b774ec29aa732e508219938 in term 5. Re-sending same reply.
I20260709 13:15:19.932183  6878 raft_consensus.cc:740] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:19.933283  6826 raft_consensus.cc:2749] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:19.966205  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:19.974545  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:19.967662  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:19.980048  4027 raft_consensus.cc:2393] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 6: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:19.975301  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:19.923705  6799 raft_consensus.cc:515] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:19.976147  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:19.970443  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:19.948300  6706 raft_consensus.cc:493] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:19.968986  3997 leader_election.cc:304] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:19.984475  4034 raft_consensus.cc:2393] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 in current term 8: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:19.987509  3925 leader_election.cc:304] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:19.988943  3925 leader_election.cc:304] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:19.989732  6770 consensus_queue.cc:1048] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:19.991276  6770 consensus_queue.cc:1059] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:19.992066  6770 raft_consensus.cc:2749] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:19.992689  6770 raft_consensus.cc:2749] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:19.992900  6658 tablet_bootstrap.cc:492] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938: Bootstrap complete.
I20260709 13:15:19.993381  6770 raft_consensus.cc:3055] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:19.993767  6770 raft_consensus.cc:740] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:19.994669  6770 consensus_queue.cc:260] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:19.993851  6658 ts_tablet_manager.cc:1403] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938: Time spent bootstrapping tablet: real 2.078s	user 0.043s	sys 0.016s
I20260709 13:15:19.982692  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:19.979924  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:20.004552  4029 raft_consensus.cc:2410] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:15:20.000694  4028 raft_consensus.cc:2376] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7. Re-sending same reply.
W20260709 13:15:20.006946  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 43520.4us
I20260709 13:15:19.961879  6730 raft_consensus.cc:740] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:20.004998  4675 leader_election.cc:304] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:19.938503  6324 consensus_queue.cc:1059] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:15:19.960863  6839 raft_consensus.cc:493] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:20.027201  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:20.010789  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:20.012059  6853 raft_consensus.cc:2804] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:20.012670  3997 leader_election.cc:304] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:20.008289  6706 raft_consensus.cc:515] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:20.031992  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:19.964736  6512 consensus_queue.cc:1059] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:15:20.016793  6770 raft_consensus.cc:3060] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:20.017391  6658 raft_consensus.cc:359] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938 [term 6 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:20.021253  6540 leader_election.cc:290] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:20.021600  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:20.021478  6759 raft_consensus.cc:515] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:20.024024  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:15:20.024842  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:19.976639  6768 raft_consensus.cc:2804] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:20.067947  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:20.030769  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:20.016399  6516 raft_consensus.cc:2749] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:20.032980  4025 raft_consensus.cc:3060] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:20.069482  4074 leader_election.cc:304] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:20.035336  4033 raft_consensus.cc:1240] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:15:20.036816  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
W20260709 13:15:20.070418  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 57865.9us
I20260709 13:15:20.072769  4034 raft_consensus.cc:2393] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 6: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:20.032099  6853 raft_consensus.cc:493] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:20.076463  4672 leader_election.cc:304] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:20.075107  4030 raft_consensus.cc:2468] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 3.
I20260709 13:15:20.077440  4032 raft_consensus.cc:1275] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:15:20.080181  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:15:20.079591  3905 auto_rebalancer.cc:629] Failed to schedule move for tablet 7ebbb84155f1455d87aab7fd5d78e3d8: Aborted: Op aborted by new leader
I20260709 13:15:20.069837  4027 raft_consensus.cc:2468] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
I20260709 13:15:20.082850  3953 raft_consensus.cc:1240] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 6. Current term is 7. Ops: []
W20260709 13:15:20.083014  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 78124.3us
I20260709 13:15:20.085237  3997 leader_election.cc:304] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:20.087044  3958 raft_consensus.cc:1240] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:20.032357  6839 raft_consensus.cc:515] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:20.068813  6512 consensus_queue.cc:1243] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer 6f5b5e4ed72944ecbda200012d141dc2 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:15:20.070533  6688 raft_consensus.cc:2749] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:20.077917  6768 raft_consensus.cc:697] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 7 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:20.079389  6853 raft_consensus.cc:3060] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:20.089380  6516 raft_consensus.cc:2749] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:20.079591  6797 consensus_queue.cc:1048] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:15:20.075861  6918 consensus_queue.cc:1059] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:15:20.112119  4074 leader_election.cc:304] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:20.113456  4074 leader_election.cc:304] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:15:20.115127  6512 raft_consensus.cc:2749] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:20.115906  6799 leader_election.cc:290] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:20.119218  6522 leader_election.cc:290] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:20.120275  6917 raft_consensus.cc:3055] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:20.120676  6917 raft_consensus.cc:740] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:20.120970  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:20.121671  4702 raft_consensus.cc:2468] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 8.
I20260709 13:15:20.121598  6917 consensus_queue.cc:260] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:20.122845  4025 raft_consensus.cc:2468] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7.
I20260709 13:15:20.123135  3924 leader_election.cc:304] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:20.106560  6730 consensus_queue.cc:260] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:20.124975  3997 leader_election.cc:304] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:20.125326  6730 raft_consensus.cc:3060] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:20.126533  6582 raft_consensus.cc:2804] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:20.126971  6582 raft_consensus.cc:493] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:20.134609  6903 log.cc:927] Time spent T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.265s	user 0.000s	sys 0.003s
W20260709 13:15:20.105847  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 116973us
I20260709 13:15:20.138985  3925 leader_election.cc:304] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:20.127326  6582 raft_consensus.cc:3060] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:20.149755  6706 leader_election.cc:290] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:20.149955  6895 raft_consensus.cc:3055] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:20.150730  6541 raft_consensus.cc:2749] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:20.150535  6768 consensus_queue.cc:237] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:20.151914  6529 consensus_queue.cc:1059] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:20.151944  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:20.180027  3950 raft_consensus.cc:2468] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 7.
I20260709 13:15:20.152822  6839 leader_election.cc:290] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:20.152654  6822 consensus_queue.cc:1059] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:20.153406  6869 raft_consensus.cc:3060] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:20.154664  6759 leader_election.cc:290] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:20.155795  6658 raft_consensus.cc:740] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938 [term 6 LEARNER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Initialized, Role: LEARNER
I20260709 13:15:20.157151  3925 leader_election.cc:304] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:20.160400  6718 consensus_queue.cc:1059] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:20.107506  6447 leader_election.cc:290] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:20.161237  6623 raft_consensus.cc:2764] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
W20260709 13:15:20.164880  3905 auto_rebalancer.cc:629] Failed to schedule move for tablet f492997a6e0f48c5b9e231e43f19e3f3: Illegal state: Replica 8952c48a6f3a43968f7d77f7bfc4d1bc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:20.148612  4675 leader_election.cc:304] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:20.173429  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:15:20.205387  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 92007.2us
I20260709 13:15:20.078547  6878 consensus_queue.cc:260] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:20.174396  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 45634.3us
I20260709 13:15:20.211792  4071 leader_election.cc:304] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:20.170326  6895 raft_consensus.cc:740] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:20.150625  6727 raft_consensus.cc:3055] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:20.123157  6917 raft_consensus.cc:3060] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:20.208381  4074 leader_election.cc:304] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:20.170310  6920 raft_consensus.cc:2804] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:15:20.226886  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 69831.9us
I20260709 13:15:20.227934  3925 leader_election.cc:304] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:20.229063  6920 raft_consensus.cc:493] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:20.229424  6541 raft_consensus.cc:3060] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:20.184396  6324 raft_consensus.cc:2749] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:20.244163  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:15:20.245015  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:20.246402  3952 raft_consensus.cc:2468] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 7.
I20260709 13:15:20.215390  6516 raft_consensus.cc:2804] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:15:20.252388  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 44139.7us
I20260709 13:15:20.229686  6920 raft_consensus.cc:3060] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:20.256928  4074 leader_election.cc:304] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
W20260709 13:15:20.254444  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 141454us
I20260709 13:15:20.216141  6529 raft_consensus.cc:3055] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:20.223292  6540 raft_consensus.cc:2749] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:20.214495  6727 raft_consensus.cc:740] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:20.278132  6727 consensus_queue.cc:260] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:20.279407  6727 raft_consensus.cc:3060] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:20.261332  6799 raft_consensus.cc:2749] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:20.261904  4074 leader_election.cc:304] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:20.259426  6529 raft_consensus.cc:740] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:20.264101  6836 raft_consensus.cc:493] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.274737  4675 leader_election.cc:304] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:20.259071  6878 raft_consensus.cc:3060] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:20.256502  6516 raft_consensus.cc:493] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:20.256902  6759 raft_consensus.cc:2804] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:20.259786  6842 raft_consensus.cc:2749] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:20.276741  6797 consensus_queue.cc:1059] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:20.248759  6447 consensus_queue.cc:1059] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.066s
W20260709 13:15:20.308845  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 47056.4us
I20260709 13:15:20.317390  6799 raft_consensus.cc:3060] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:20.321583  4104 raft_consensus.cc:1240] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:20.263883  6614 raft_consensus.cc:2804] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:20.290446  6895 consensus_queue.cc:260] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:20.329440  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 150245us
I20260709 13:15:20.322463  6759 raft_consensus.cc:493] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:20.331307  4073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:20.333676  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 59025.1us
I20260709 13:15:20.301889  6918 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.335328  4074 leader_election.cc:304] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:20.322201  6516 raft_consensus.cc:3060] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:20.341863  3925 leader_election.cc:304] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:20.351529  3925 leader_election.cc:304] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:20.299010  6853 raft_consensus.cc:515] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:20.347790  6918 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:20.353549  6770 consensus_queue.cc:1059] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:15:20.354290  6914 log.cc:927] Time spent T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.450s	user 0.000s	sys 0.004s
I20260709 13:15:20.336692  6614 raft_consensus.cc:493] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:20.355017  4074 leader_election.cc:304] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:20.362072  3925 leader_election.cc:304] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:20.255179  6658 consensus_queue.cc:260] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:15:20.363220  6916 raft_consensus.cc:2749] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:20.363335  6929 raft_consensus.cc:3055] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:20.326362  6836 raft_consensus.cc:515] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:20.347285  6759 raft_consensus.cc:3060] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:20.363795  6868 consensus_queue.cc:1048] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:15:20.377265  4074 leader_election.cc:304] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:15:20.338716  6512 consensus_queue.cc:1059] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:15:20.355522  6768 raft_consensus.cc:2749] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:20.376044  6814 raft_consensus.cc:3055] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:20.346506  6729 raft_consensus.cc:493] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.353597  6923 raft_consensus.cc:2804] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:15:20.386222  6909 log.cc:927] Time spent T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.474s	user 0.004s	sys 0.000s
I20260709 13:15:20.366518  6921 raft_consensus.cc:2804] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:20.339558  6839 consensus_queue.cc:1059] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:15:20.375499  6614 raft_consensus.cc:3060] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:20.382113  3925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:20.380270  6929 raft_consensus.cc:740] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:20.417006  4074 leader_election.cc:304] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:20.355656  6529 consensus_queue.cc:260] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:20.395717  6813 raft_consensus.cc:2804] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:20.396070  6814 raft_consensus.cc:740] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:20.385777  6894 consensus_queue.cc:1059] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:15:20.402334  6921 raft_consensus.cc:493] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:20.441220  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 95219.6us
W20260709 13:15:20.444751  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:20.423600  6916 raft_consensus.cc:3060] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:20.422374  6541 raft_consensus.cc:2749] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:20.429901  6813 raft_consensus.cc:697] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 7 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:20.456423  6813 consensus_queue.cc:237] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:20.458634  6830 raft_consensus.cc:3055] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:20.459076  6830 raft_consensus.cc:740] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:20.460032  6830 consensus_queue.cc:260] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:20.461006  6830 raft_consensus.cc:3060] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:20.462005  4030 raft_consensus.cc:1240] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:15:20.462270  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:20.463066  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:20.424034  6447 consensus_queue.cc:1059] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:15:20.464274  6447 raft_consensus.cc:3055] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:20.464705  6447 raft_consensus.cc:740] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
W20260709 13:15:20.464890  6927 log.cc:927] Time spent T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.235s	user 0.002s	sys 0.000s
I20260709 13:15:20.465574  6447 consensus_queue.cc:260] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:20.466320  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:20.466887  4032 raft_consensus.cc:2376] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7. Re-sending same reply.
I20260709 13:15:20.468243  4025 raft_consensus.cc:1275] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:15:20.470558  6928 log.cc:927] Time spent T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:15:20.474934  6922 log.cc:927] Time spent T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.246s	user 0.001s	sys 0.000s
W20260709 13:15:20.475697  6931 log.cc:927] Time spent T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:15:20.429798  6921 raft_consensus.cc:3060] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:20.478969  6324 raft_consensus.cc:3055] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:20.483736  4027 raft_consensus.cc:2468] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 8.
I20260709 13:15:20.425168  6729 raft_consensus.cc:515] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:20.479911  6529 raft_consensus.cc:3060] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:20.481604  6658 ts_tablet_manager.cc:1434] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938: Time spent starting tablet: real 0.485s	user 0.007s	sys 0.003s
I20260709 13:15:20.481680  6718 raft_consensus.cc:3055] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:20.482779  6918 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:20.482914  6727 raft_consensus.cc:3060] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:20.489531  6540 consensus_queue.cc:1059] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:20.489964  3925 leader_election.cc:304] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:20.466789  6447 raft_consensus.cc:3060] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:20.500859  3922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:20.451298  6941 raft_consensus.cc:2804] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:20.486043  6324 raft_consensus.cc:740] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:20.486449  6688 raft_consensus.cc:493] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:20.539921  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 50064.5us
I20260709 13:15:20.493780  6718 raft_consensus.cc:740] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:20.546263  3954 raft_consensus.cc:1240] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:20.547353  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:15:20.557102  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 132197us
I20260709 13:15:20.545388  6937 raft_consensus.cc:493] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.510959  6918 consensus_queue.cc:1048] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:15:20.542958  6941 raft_consensus.cc:697] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:20.551621  6512 raft_consensus.cc:493] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:20.565611  4675 leader_election.cc:304] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
W20260709 13:15:20.569648  3998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:20.556604  6522 raft_consensus.cc:3055] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:20.563407  6541 raft_consensus.cc:2804] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:20.533277  6814 consensus_queue.cc:260] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:20.558830  6688 raft_consensus.cc:515] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:20.575590  6522 raft_consensus.cc:740] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:20.576906  6939 raft_consensus.cc:493] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.589190  3997 leader_election.cc:304] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:15:20.612695  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:20.589489  4702 raft_consensus.cc:1275] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:15:20.585038  6923 raft_consensus.cc:697] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 5 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:20.620627  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:20.621348  3950 raft_consensus.cc:2468] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 7.
I20260709 13:15:20.626411  4031 raft_consensus.cc:1275] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:20.628711  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:20.631251  6944 raft_consensus.cc:2749] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:20.630951  6522 consensus_queue.cc:260] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:20.632397  6522 raft_consensus.cc:3060] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:20.632436  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 72766.1us
I20260709 13:15:20.633409  4675 leader_election.cc:304] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:20.585845  6512 raft_consensus.cc:515] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:20.587393  6706 consensus_queue.cc:1059] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:15:20.646870  3997 leader_election.cc:304] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:20.649370  4675 leader_election.cc:304] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:20.617646  6541 raft_consensus.cc:697] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 7 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
W20260709 13:15:20.651978  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 67773.6us
I20260709 13:15:20.571086  6324 consensus_queue.cc:260] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:20.655253  3997 leader_election.cc:304] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:20.569109  6937 raft_consensus.cc:515] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:20.658056  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 238950us
I20260709 13:15:20.641256  6942 raft_consensus.cc:2804] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:20.613858  6770 consensus_queue.cc:1048] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:15:20.679533  6935 raft_consensus.cc:2804] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:20.679656  6623 raft_consensus.cc:2804] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:20.680162  6935 raft_consensus.cc:493] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:20.680285  6623 raft_consensus.cc:493] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:20.680703  6935 raft_consensus.cc:3060] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:20.680774  6623 raft_consensus.cc:3060] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:20.684144  4672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:20.690553  6920 raft_consensus.cc:515] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:20.614077  6718 consensus_queue.cc:260] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:20.692368  3952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38612 (request call id 1170) took 1100 ms. Trace:
I20260709 13:15:20.692848  3952 rpcz_store.cc:276] 0709 13:15:19.591827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:19.592169 (+   342us) service_pool.cc:224] Handling call
0709 13:15:20.692173 (+1100004us) spinlock_profiling.cc:243] Waited 412 ms on lock 0x7b540042a754. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:20.692290 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":947494656}
W20260709 13:15:20.693653  6945 consensus_queue.cc:1175] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f1c75790cedf4f52a3463a255c7da059" responder_term: 6 status { last_received { term: 5 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 5. Current term is 6. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:15:20.692425  6706 raft_consensus.cc:2749] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:20.696928  6799 raft_consensus.cc:2749] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:20.697302  6853 leader_election.cc:290] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:20.636797  6582 raft_consensus.cc:515] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:20.661657  3997 leader_election.cc:304] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:20.699421  6759 raft_consensus.cc:515] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:20.700891  3997 leader_election.cc:304] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:20.664882  6951 consensus_queue.cc:1048] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:20.639930  6941 consensus_queue.cc:237] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:20.622013  6939 raft_consensus.cc:515] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:20.670223  6916 raft_consensus.cc:2749] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:20.677639  6516 raft_consensus.cc:515] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:20.648756  6944 raft_consensus.cc:3060] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:20.702618  3924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:20.727034  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 82450.4us
W20260709 13:15:20.716830  4073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:20.768887  4073 leader_election.cc:304] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:20.789217  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:20.695075  6938 raft_consensus.cc:3055] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:20.790047  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:20.702064  6529 raft_consensus.cc:2749] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:20.663153  6729 leader_election.cc:290] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:20.822666  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:20.822440  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:20.827112  4030 raft_consensus.cc:2468] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 6.
I20260709 13:15:20.735066  6937 leader_election.cc:290] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:20.821866  4099 raft_consensus.cc:2468] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 6.
I20260709 13:15:20.701900  6759 leader_election.cc:290] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:20.852459  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:20.760128  6324 raft_consensus.cc:3060] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:20.854465  4709 raft_consensus.cc:2468] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 7.
W20260709 13:15:20.793475  4073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:20.663370  6942 raft_consensus.cc:493] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:20.828744  4104 raft_consensus.cc:1240] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 5. Current term is 6. Ops: []
W20260709 13:15:20.840737  3925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:20.792449  6936 raft_consensus.cc:493] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.761176  6930 raft_consensus.cc:2804] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:20.873680  4672 leader_election.cc:304] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:20.791994  6945 raft_consensus.cc:493] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.675441  6614 raft_consensus.cc:515] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:20.759796  4117 tablet_copy_service.cc:342] P 8952c48a6f3a43968f7d77f7bfc4d1bc: Request end of tablet copy session d709ee666b774ec29aa732e508219938-649df91131174f00af0e0a0240f80adb received from {username='slave'} at 127.0.0.1:34656
W20260709 13:15:20.852455  6869 consensus_meta.cc:287] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 0.648s	user 0.010s	sys 0.003s
I20260709 13:15:20.702322  6706 consensus_queue.cc:1059] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.129s
I20260709 13:15:20.822122  6916 raft_consensus.cc:2749] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:20.797430  6938 raft_consensus.cc:740] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:20.879691  6942 raft_consensus.cc:3060] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:20.900602  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 76482.1us
I20260709 13:15:20.849452  4701 raft_consensus.cc:1240] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:20.853361  6951 raft_consensus.cc:493] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
W20260709 13:15:20.900575  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 199755us
I20260709 13:15:20.713822  6541 consensus_queue.cc:237] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:20.876526  6759 raft_consensus.cc:493] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.703400  6923 consensus_queue.cc:237] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:20.902942  4073 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:20.905436  4117 tablet_copy_service.cc:434] P 8952c48a6f3a43968f7d77f7bfc4d1bc: ending tablet copy session d709ee666b774ec29aa732e508219938-649df91131174f00af0e0a0240f80adb on tablet 649df91131174f00af0e0a0240f80adb with peer d709ee666b774ec29aa732e508219938
I20260709 13:15:20.906328  6951 raft_consensus.cc:515] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:20.919829  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:20.888382  6770 raft_consensus.cc:493] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:20.880788  6688 leader_election.cc:290] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:20.908658  6582 leader_election.cc:290] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:20.909336  6706 raft_consensus.cc:3055] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:15:20.902408  6878 consensus_meta.cc:287] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938: Time spent flushing consensus metadata: real 0.579s	user 0.012s	sys 0.000s
I20260709 13:15:20.917295  4675 leader_election.cc:304] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:20.894759  6930 raft_consensus.cc:697] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:20.900861  6869 raft_consensus.cc:2749] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:20.925007  4709 raft_consensus.cc:2393] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 9: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
I20260709 13:15:20.895562  6945 raft_consensus.cc:515] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:20.918543  6937 raft_consensus.cc:2804] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:15:20.935281  6947 log.cc:927] Time spent T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:15:20.920065  6799 raft_consensus.cc:2804] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:20.941414  4706 raft_consensus.cc:1275] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:15:20.941568  3997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:20.892712  6936 raft_consensus.cc:515] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:20.936431  6939 leader_election.cc:290] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:20.927131  6706 raft_consensus.cc:740] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:20.904673  6921 raft_consensus.cc:515] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:20.936542  6727 raft_consensus.cc:2749] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:20.929886  6512 leader_election.cc:290] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:20.937314  6937 raft_consensus.cc:493] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:20.915429  6759 raft_consensus.cc:515] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:20.965600  6759 leader_election.cc:290] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:15:20.951122  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:20.949653  3997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:20.940027  6799 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:20.957643  6516 leader_election.cc:290] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:20.961104  6930 consensus_queue.cc:237] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:20.930864  6770 raft_consensus.cc:515] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:20.945704  6917 raft_consensus.cc:493] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
W20260709 13:15:21.021206  4073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.040654  6869 raft_consensus.cc:493] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.042986  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:20.977531  6799 raft_consensus.cc:3060] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:20.968184  6937 raft_consensus.cc:3060] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:20.967890  6921 leader_election.cc:290] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:21.047071  6920 leader_election.cc:290] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 8 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:15:21.108852  6830 consensus_meta.cc:287] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.621s	user 0.011s	sys 0.002s
I20260709 13:15:21.109218  6895 raft_consensus.cc:3060] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:21.109634  6952 consensus_queue.cc:1048] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.156s
I20260709 13:15:21.110378  6945 leader_election.cc:290] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:21.126020  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.133340  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:21.134155  4099 raft_consensus.cc:2468] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 5.
I20260709 13:15:21.050734  6917 raft_consensus.cc:515] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:21.142335  6759 raft_consensus.cc:493] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:21.056397  6869 raft_consensus.cc:515] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:21.149359  6759 raft_consensus.cc:515] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:21.152093  6512 raft_consensus.cc:493] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:21.152920  6951 leader_election.cc:290] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:21.152717  6512 raft_consensus.cc:515] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:21.131242  6929 consensus_queue.cc:260] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:21.154316  6929 raft_consensus.cc:3060] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:21.154948  6512 leader_election.cc:290] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:21.162281  6936 leader_election.cc:290] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:21.162417  6944 raft_consensus.cc:2749] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:21.167181  4707 raft_consensus.cc:1240] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:21.169559  6917 leader_election.cc:290] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:20.948006  6938 consensus_queue.cc:260] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:21.171754  6938 raft_consensus.cc:3060] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:21.178639  6623 raft_consensus.cc:515] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:21.181176  6826 raft_consensus.cc:493] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:21.200799  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:21.140517  6924 raft_consensus.cc:2749] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:15:21.202939  4672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.206022  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:21.206848  3950 raft_consensus.cc:3060] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:21.211795  6727 raft_consensus.cc:493] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:21.212383  6770 leader_election.cc:290] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:21.212594  6917 raft_consensus.cc:493] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.213402  6917 raft_consensus.cc:515] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:21.124941  6706 consensus_queue.cc:260] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:21.216952  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:21.217731  4103 raft_consensus.cc:2393] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 7: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
W20260709 13:15:21.218952  6961 log.cc:927] Time spent T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:15:21.221570  6963 log.cc:927] Time spent T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 13:15:21.227589  3922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.191990  6759 leader_election.cc:290] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:21.230026  6869 leader_election.cc:290] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:21.230840  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:21.231500  3957 raft_consensus.cc:2468] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 5.
I20260709 13:15:21.212395  6727 raft_consensus.cc:515] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:21.232636  6718 raft_consensus.cc:3060] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:21.232757  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:21.234510  6727 leader_election.cc:290] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:21.214928  6826 raft_consensus.cc:515] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:21.235598  3998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.235932  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:21.236665  3952 raft_consensus.cc:2393] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 7: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:21.237500  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:21.237550  6826 leader_election.cc:290] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:21.238051  6842 raft_consensus.cc:3055] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:21.231313  4105 raft_consensus.cc:1240] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 LEADER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:21.238440  3957 raft_consensus.cc:2393] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 6: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:21.239509  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:21.240209  3954 raft_consensus.cc:2468] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 6.
I20260709 13:15:21.240883  6836 leader_election.cc:290] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:21.204137  6541 raft_consensus.cc:493] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:21.244377  3959 raft_consensus.cc:1275] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:15:21.244172  6541 raft_consensus.cc:515] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:21.246464  6541 leader_election.cc:290] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:21.246969  6541 raft_consensus.cc:493] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.251188  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:21.252101  4032 raft_consensus.cc:2468] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 6.
W20260709 13:15:21.252475  4073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:21.252874  3924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.254412  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:21.238480  6842 raft_consensus.cc:740] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:21.257388  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:21.263231  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: true dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:21.268164  3953 raft_consensus.cc:3060] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:15:21.267237  4031 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 8.
I20260709 13:15:21.271664  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:21.272678  4031 raft_consensus.cc:2393] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 8: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:21.273473  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:21.274816  4101 raft_consensus.cc:1240] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:21.267504  4071 leader_election.cc:304] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:21.265957  4672 leader_election.cc:304] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:21.277282  4071 leader_election.cc:304] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:21.279109  6830 raft_consensus.cc:2804] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:21.279678  6830 raft_consensus.cc:493] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:21.280157  6830 raft_consensus.cc:3060] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:21.280654  6759 raft_consensus.cc:2804] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:21.281085  6759 raft_consensus.cc:493] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:21.281539  6759 raft_consensus.cc:3060] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:21.284489  6916 consensus_queue.cc:1048] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:15:21.284929  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.208992  6932 raft_consensus.cc:3055] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:21.288826  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:15:21.216398  6935 consensus_meta.cc:287] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938: Time spent flushing consensus metadata: real 0.525s	user 0.009s	sys 0.003s
I20260709 13:15:21.291235  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:21.301610  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:21.301623  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:21.303129  4034 raft_consensus.cc:1240] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:15:21.291805  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:21.304423  3951 raft_consensus.cc:2410] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:15:21.296657  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:21.292608  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:21.292131  4025 raft_consensus.cc:1240] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:15:21.294282  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:21.294829  4026 raft_consensus.cc:1275] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:15:21.293426  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:21.298229  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:21.311389  3952 raft_consensus.cc:2468] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 5.
W20260709 13:15:21.308596  3925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.315984  3954 raft_consensus.cc:2393] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 7: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:21.316411  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:21.318707  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:21.321029  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:21.309198  4107 raft_consensus.cc:2468] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 8.
I20260709 13:15:21.305081  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:21.305696  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:21.324240  4103 raft_consensus.cc:2393] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 7: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:21.325093  4028 raft_consensus.cc:2393] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 8: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:21.326711  3957 raft_consensus.cc:2393] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 in current term 9: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:21.328545  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:21.329030  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:21.329406  4102 raft_consensus.cc:2410] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:15:21.329762  4106 raft_consensus.cc:2393] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 8: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:21.331091  3957 raft_consensus.cc:1240] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 6. Current term is 7. Ops: []
W20260709 13:15:21.332644  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.333283  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:21.334352  4031 raft_consensus.cc:2393] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 8: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:21.269536  6869 raft_consensus.cc:493] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.344463  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:21.266726  6614 leader_election.cc:290] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:21.348881  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:21.350340  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:21.350782  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:21.351235  4102 raft_consensus.cc:2410] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:15:21.356146  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:21.357206  4031 raft_consensus.cc:2468] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 6.
I20260709 13:15:21.360951  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:21.308233  6924 raft_consensus.cc:2804] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:21.299177  6932 raft_consensus.cc:740] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:21.363930  6941 raft_consensus.cc:493] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.364238  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:21.378350  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:21.368566  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:21.343695  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:21.301239  6730 raft_consensus.cc:493] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:21.373449  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 109510us
I20260709 13:15:21.374451  4027 raft_consensus.cc:2468] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 7.
I20260709 13:15:21.328323  6935 raft_consensus.cc:515] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:21.376188  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
W20260709 13:15:21.376573  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.374349  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:21.391861  3951 raft_consensus.cc:1275] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:15:21.395984  4034 raft_consensus.cc:2393] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 7: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:21.381575  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:21.373764  4031 raft_consensus.cc:2468] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 7.
I20260709 13:15:21.288415  6952 consensus_queue.cc:1048] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.082s
I20260709 13:15:21.396971  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:21.392642  4030 raft_consensus.cc:1240] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 8. Current term is 10. Ops: []
I20260709 13:15:21.397359  3956 raft_consensus.cc:1240] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:21.247416  6541 raft_consensus.cc:515] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:21.392416  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:21.398065  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:21.392565  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:21.404984  4028 raft_consensus.cc:3060] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:21.377851  6936 raft_consensus.cc:493] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.405936  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:21.406731  4025 raft_consensus.cc:2393] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 5: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:21.406351  6936 raft_consensus.cc:515] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:21.409358  6936 leader_election.cc:290] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:21.410678  4025 raft_consensus.cc:1275] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:15:21.411243  6541 leader_election.cc:290] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:21.392695  6826 raft_consensus.cc:493] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.402006  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:21.413547  4105 raft_consensus.cc:3060] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:21.414018  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.307979  6770 consensus_queue.cc:1059] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 13:15:21.374313  6924 raft_consensus.cc:493] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:21.428088  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:21.429765  4709 raft_consensus.cc:1240] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:21.444645  4030 raft_consensus.cc:2393] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 8: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:21.446805  3951 raft_consensus.cc:1240] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:21.371745  6944 consensus_queue.cc:1059] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:15:21.370645  6869 raft_consensus.cc:515] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:21.481086  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:21.471741  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:15:21.483268  3922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.443487  6623 leader_election.cc:290] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:21.473078  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:21.487709  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:21.474112  3956 raft_consensus.cc:1275] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:15:21.478313  6932 consensus_queue.cc:260] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:21.443421  6842 consensus_queue.cc:260] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:21.480891  6324 consensus_meta.cc:287] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938: Time spent flushing consensus metadata: real 0.604s	user 0.010s	sys 0.001s
I20260709 13:15:21.444084  6924 raft_consensus.cc:3060] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:21.402714  6730 raft_consensus.cc:515] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:21.398061  6799 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:21.411993  6826 raft_consensus.cc:515] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:21.486222  3951 raft_consensus.cc:2468] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 5.
I20260709 13:15:21.402467  6942 raft_consensus.cc:515] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:21.524271  4029 raft_consensus.cc:2410] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:15:21.484092  6869 leader_election.cc:290] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:21.399791  6941 raft_consensus.cc:515] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:21.524238  6842 raft_consensus.cc:3060] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:21.526006  4106 raft_consensus.cc:2410] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:15:21.495893  4101 raft_consensus.cc:2468] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 7.
W20260709 13:15:21.534154  6970 log.cc:927] Time spent T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 13:15:21.543853  6868 raft_consensus.cc:3055] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:21.572346  6935 leader_election.cc:290] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:21.525959  6932 raft_consensus.cc:3060] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:21.538213  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:21.544410  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.502635  6836 raft_consensus.cc:493] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.572721  6868 raft_consensus.cc:740] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:21.537464  6799 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:21.578347  4028 raft_consensus.cc:2468] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9.
I20260709 13:15:21.571235  6941 leader_election.cc:290] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:21.579651  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:21.524874  6730 leader_election.cc:290] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:15:21.582652  4073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.590797  4101 raft_consensus.cc:2393] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 5: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:21.601151  6921 raft_consensus.cc:493] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:21.592167  4100 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 8.
I20260709 13:15:21.591354  3950 raft_consensus.cc:2468] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 8.
I20260709 13:15:21.589779  6942 leader_election.cc:290] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:21.620612  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
W20260709 13:15:21.623844  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:21.644693  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:21.665117  4073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.633215  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:21.697250  4104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34656 (request call id 349) took 1135 ms. Trace:
I20260709 13:15:21.698264  4032 raft_consensus.cc:2468] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 8.
I20260709 13:15:21.586174  6836 raft_consensus.cc:515] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:21.697808  4104 rpcz_store.cc:276] 0709 13:15:20.476452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:20.476643 (+   191us) service_pool.cc:224] Handling call
0709 13:15:20.476924 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:20.879887 (+402963us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:21.611694 (+731807us) spinlock_profiling.cc:243] Waited 352 ms on lock 0x7b54000406d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:21.611944 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":808461056}
I20260709 13:15:21.720595  3953 raft_consensus.cc:2468] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 10.
I20260709 13:15:21.719189  4099 raft_consensus.cc:2468] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 5.
I20260709 13:15:21.722852  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:21.723944  4099 raft_consensus.cc:2393] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 8: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:21.723850  6868 consensus_queue.cc:260] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:21.725395  6868 raft_consensus.cc:3060] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:21.726521  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:21.728518  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.602787  6917 leader_election.cc:290] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:21.733052  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: true dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:21.735811  4101 raft_consensus.cc:2468] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7.
I20260709 13:15:21.739439  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:21.740056  4101 raft_consensus.cc:3060] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:21.742277  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 254985us
I20260709 13:15:21.727964  6962 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.748368  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:21.750659  4104 raft_consensus.cc:2410] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:15:21.751188  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:21.751564  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:21.752183  3953 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 8.
I20260709 13:15:21.752179  4104 raft_consensus.cc:3060] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:21.751199  4100 raft_consensus.cc:2468] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 5.
I20260709 13:15:21.755532  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:21.757236  4100 raft_consensus.cc:2393] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 10: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:21.599144  6830 raft_consensus.cc:515] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:21.766530  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:15:21.774041  3998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.778206  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:21.778908  4099 raft_consensus.cc:2468] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7.
I20260709 13:15:21.780687  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:21.780418  4101 raft_consensus.cc:2468] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7.
I20260709 13:15:21.781276  4102 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 8.
I20260709 13:15:21.738837  6839 consensus_queue.cc:1059] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.043s
W20260709 13:15:21.783427  3922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.787487  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:21.692487  6921 raft_consensus.cc:515] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:21.791805  4103 raft_consensus.cc:2368] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 6. Current term is 7.
I20260709 13:15:21.798060  4100 raft_consensus.cc:1240] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:21.765121  6962 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:21.804904  4101 raft_consensus.cc:1275] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:15:21.811403  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.812197  4707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57666 (request call id 510) took 1020 ms. Trace:
I20260709 13:15:21.779131  6759 raft_consensus.cc:515] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:21.816749  4105 raft_consensus.cc:2468] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7.
I20260709 13:15:21.812780  4707 rpcz_store.cc:276] 0709 13:15:20.792231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:20.792346 (+   115us) service_pool.cc:224] Handling call
0709 13:15:20.792670 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:21.167634 (+374964us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:21.811846 (+644212us) spinlock_profiling.cc:243] Waited 374 ms on lock 0x7b5400640354. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:21.812107 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":860776832}
I20260709 13:15:21.818249  4105 raft_consensus.cc:1240] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:21.820382  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:21.822533  4100 raft_consensus.cc:2410] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:15:21.807921  6826 leader_election.cc:290] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:21.829079  4105 raft_consensus.cc:1240] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:21.828284  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:21.831876  4100 raft_consensus.cc:1240] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:21.833458  4100 raft_consensus.cc:1275] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:15:21.835891  4100 raft_consensus.cc:1240] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:21.837174  4100 raft_consensus.cc:1240] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:21.839618  6940 raft_consensus.cc:3055] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:21.840183  6940 raft_consensus.cc:740] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:21.841375  6940 consensus_queue.cc:260] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:21.843051  6940 raft_consensus.cc:3060] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:21.872664  6830 leader_election.cc:290] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:15:21.879175  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.883708  4105 raft_consensus.cc:1240] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:21.888676  6759 leader_election.cc:290] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:21.889629  6836 leader_election.cc:290] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:21.891948  6938 raft_consensus.cc:493] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:21.892736  6938 raft_consensus.cc:515] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:21.895210  6938 leader_election.cc:290] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:21.973883  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:21.989256  4701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:22.051831  4707 raft_consensus.cc:3060] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:21.933178  6924 raft_consensus.cc:515] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:22.052390  4701 raft_consensus.cc:2468] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 8.
I20260709 13:15:22.054100  6924 leader_election.cc:290] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:21.919577  6718 consensus_meta.cc:287] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 0.686s	user 0.013s	sys 0.000s
I20260709 13:15:22.055140  4026 raft_consensus.cc:2468] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 7.
I20260709 13:15:22.056236  6942 raft_consensus.cc:493] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.882364  6935 raft_consensus.cc:493] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.056715  6942 raft_consensus.cc:515] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:22.057341  6935 raft_consensus.cc:515] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:21.908741  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:22.058580  4103 raft_consensus.cc:2468] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 8.
I20260709 13:15:22.059702  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:21.899860  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:22.060029  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:22.060376  4103 raft_consensus.cc:2376] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7. Re-sending same reply.
I20260709 13:15:22.060911  4029 raft_consensus.cc:2410] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:15:22.061751  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:22.060529  3954 raft_consensus.cc:2468] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 7.
I20260709 13:15:21.971107  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:22.017587  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:22.064539  4105 raft_consensus.cc:3060] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:21.899586  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:22.067287  4028 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 8.
I20260709 13:15:21.899942  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:22.068678  4030 raft_consensus.cc:3060] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:21.976231  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:21.922684  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:22.063258  4103 raft_consensus.cc:2376] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7. Re-sending same reply.
I20260709 13:15:22.071355  4106 raft_consensus.cc:2468] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7.
I20260709 13:15:22.072732  4707 raft_consensus.cc:2468] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 8.
W20260709 13:15:22.073544  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:21.930604  3997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:22.079981  3997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:22.080691  3997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:22.081004  3997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.939453  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:22.075650  4073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 171733us
W20260709 13:15:22.022595  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:22.082415  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.981698  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:22.086151  4104 raft_consensus.cc:2468] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 9.
I20260709 13:15:22.074103  4672 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:15:22.088791  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.897804  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:21.880388  6541 raft_consensus.cc:493] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:22.089241  4675 leader_election.cc:304] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:22.159798  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:22.091846  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:22.160599  3954 raft_consensus.cc:3060] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:22.160827  4028 raft_consensus.cc:2393] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 7: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:22.161085  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:22.093827  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:22.161736  4104 raft_consensus.cc:2376] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 8. Re-sending same reply.
I20260709 13:15:22.077414  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:22.162456  4031 raft_consensus.cc:2468] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 6.
W20260709 13:15:21.885011  6937 consensus_meta.cc:287] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938: Time spent flushing consensus metadata: real 0.818s	user 0.005s	sys 0.009s
I20260709 13:15:22.169461  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:22.170305  4031 raft_consensus.cc:2468] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 7.
I20260709 13:15:22.124959  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:15:22.160286  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 71132.8us
I20260709 13:15:22.138897  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:22.099911  4071 leader_election.cc:304] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:22.161873  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:22.163978  4100 raft_consensus.cc:1240] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:22.165865  4027 raft_consensus.cc:1240] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:22.165699  4074 leader_election.cc:304] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:22.171857  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:22.048303  4107 raft_consensus.cc:2468] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 9.
I20260709 13:15:22.175971  4028 raft_consensus.cc:2468] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 8.
I20260709 13:15:21.895253  6921 leader_election.cc:290] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:22.176292  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 76476.5us
I20260709 13:15:21.946596  6814 raft_consensus.cc:3060] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:21.951573  6324 raft_consensus.cc:3055] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:22.170204  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:22.106374  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:22.168210  4105 raft_consensus.cc:2468] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7.
I20260709 13:15:22.192190  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:22.192793  4104 raft_consensus.cc:3060] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:22.192893  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:22.193698  4105 raft_consensus.cc:2368] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 6. Current term is 7.
I20260709 13:15:22.194502  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:22.168241  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 94230.9us
I20260709 13:15:22.163800  4033 raft_consensus.cc:2393] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 in current term 9: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:21.928514  6706 raft_consensus.cc:3060] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:22.142853  3925 leader_election.cc:304] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:15:22.195251  4105 raft_consensus.cc:2393] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 5: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:22.039898  6932 raft_consensus.cc:493] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.897277  6962 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:22.141026  6842 raft_consensus.cc:493] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:22.183947  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
W20260709 13:15:22.205480  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 62743.5us
I20260709 13:15:22.188083  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:22.206408  4032 raft_consensus.cc:3060] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:22.188807  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:22.207492  4028 raft_consensus.cc:2393] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 9: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:22.188030  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:22.066092  6935 leader_election.cc:290] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:22.197850  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:22.185526  4074 leader_election.cc:304] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:22.184770  4675 leader_election.cc:304] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:22.209235  6540 raft_consensus.cc:2804] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:22.209852  6540 raft_consensus.cc:697] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:22.195744  4672 leader_election.cc:304] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:22.210879  4105 raft_consensus.cc:2376] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 5. Re-sending same reply.
I20260709 13:15:22.200021  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
W20260709 13:15:22.200167  3924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:22.076423  6868 raft_consensus.cc:493] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.199986  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:22.190522  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:15:22.202267  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 63414.6us
I20260709 13:15:22.202610  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:22.139204  6941 raft_consensus.cc:493] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.204255  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:21.975755  4703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:22.191284  6324 raft_consensus.cc:740] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:22.171615  6916 raft_consensus.cc:493] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.189895  4030 raft_consensus.cc:2468] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 4.
I20260709 13:15:22.225045  4074 leader_election.cc:304] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:22.212324  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:22.213351  3924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:22.226800  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:22.183930  6940 raft_consensus.cc:2804] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:22.214056  4073 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:22.215154  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:22.229545  4106 raft_consensus.cc:2468] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 8.
I20260709 13:15:22.216298  3922 leader_election.cc:304] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:22.202251  6984 raft_consensus.cc:493] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.172632  6541 raft_consensus.cc:515] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:22.189715  6759 raft_consensus.cc:2804] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:22.218603  4104 raft_consensus.cc:2468] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 6.
I20260709 13:15:22.277895  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:22.278676  4104 raft_consensus.cc:3060] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:22.215823  4029 raft_consensus.cc:2468] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 7.
I20260709 13:15:22.184582  6923 raft_consensus.cc:2804] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:22.200498  6918 raft_consensus.cc:2804] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:22.286427  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:22.287086  4103 raft_consensus.cc:2468] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 7.
I20260709 13:15:22.213852  3999 leader_election.cc:304] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:22.288067  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
W20260709 13:15:22.288285  3999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 74479.9us
I20260709 13:15:22.288640  4106 raft_consensus.cc:2376] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7. Re-sending same reply.
W20260709 13:15:22.289047  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:22.196267  6951 raft_consensus.cc:493] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.197149  6938 raft_consensus.cc:493] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.227880  4105 raft_consensus.cc:2468] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7.
I20260709 13:15:22.231448  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:22.216218  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:22.291730  4028 raft_consensus.cc:2468] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 6.
I20260709 13:15:22.207772  6582 consensus_queue.cc:1048] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:15:22.234242  4675 leader_election.cc:304] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:22.233355  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:22.234191  4033 raft_consensus.cc:1275] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:22.235409  4074 leader_election.cc:304] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:22.214747  6842 raft_consensus.cc:515] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:22.282788  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 66579.2us
I20260709 13:15:22.228776  6940 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:22.285588  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:22.281574  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 54061.5us
W20260709 13:15:22.306902  3853 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52092 (request call id 206) took 17662 ms (client timeout 15000 ms). Trace:
I20260709 13:15:22.186143  6937 raft_consensus.cc:515] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:22.240469  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:22.290935  4108 raft_consensus.cc:2468] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7.
I20260709 13:15:22.225071  6614 raft_consensus.cc:2804] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:15:22.296587  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 61259.2us
I20260709 13:15:22.297654  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:22.213411  6826 raft_consensus.cc:493] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:22.298749  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 64623.6us
I20260709 13:15:22.339321  4074 leader_election.cc:304] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:22.244872  4030 raft_consensus.cc:1240] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:22.232945  6836 raft_consensus.cc:2749] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:22.232720  6917 raft_consensus.cc:493] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.225138  6941 raft_consensus.cc:515] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:22.310245  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:22.328326  4073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 114320us
I20260709 13:15:22.274214  6797 raft_consensus.cc:493] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.281601  6923 raft_consensus.cc:493] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:22.359023  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:22.359699  3958 raft_consensus.cc:3060] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:15:22.286533  6918 raft_consensus.cc:493] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:22.292590  6799 raft_consensus.cc:2804] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:22.334123  4706 raft_consensus.cc:2468] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 7.
I20260709 13:15:22.342665  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:22.344362  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:22.292249  6830 raft_consensus.cc:2749] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:22.295428  6718 raft_consensus.cc:2804] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:22.346585  4100 raft_consensus.cc:1275] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:15:22.309383  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:22.376358  4106 raft_consensus.cc:2393] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 10: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:22.346477  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:15:22.349850  3922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:22.352824  4101 raft_consensus.cc:2468] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7.
I20260709 13:15:22.377532  4107 raft_consensus.cc:1240] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:15:22.297245  6921 raft_consensus.cc:2749] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:22.356144  4103 raft_consensus.cc:2468] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 8.
I20260709 13:15:22.219678  6935 raft_consensus.cc:2749] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:22.360823  4104 raft_consensus.cc:2468] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 8.
I20260709 13:15:22.294454  6951 raft_consensus.cc:515] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:22.389662  4101 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "f1c75790cedf4f52a3463a255c7da059"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:15:22.294342  6759 raft_consensus.cc:697] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:22.274955  6916 raft_consensus.cc:515] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:22.363912  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:22.400539  3955 raft_consensus.cc:3060] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:22.364737  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:22.371220  6918 raft_consensus.cc:3060] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:22.366430  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:22.330056  6940 raft_consensus.cc:3060] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:22.329043  6839 raft_consensus.cc:2749] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:15:22.371028  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 289622us
I20260709 13:15:22.328734  6744 raft_consensus.cc:493] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.371230  3950 raft_consensus.cc:2468] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 7.
I20260709 13:15:22.412523  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:22.366022  6923 raft_consensus.cc:3060] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:22.334408  6770 raft_consensus.cc:493] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.374047  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:22.374349  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:22.339788  6614 raft_consensus.cc:493] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:22.217659  6540 consensus_queue.cc:237] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:22.221869  6868 raft_consensus.cc:515] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:22.290174  6984 raft_consensus.cc:515] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:22.294564  6938 raft_consensus.cc:515] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:22.357549  4672 leader_election.cc:304] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
W20260709 13:15:22.434298  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 76873.4us
I20260709 13:15:22.391281  4101 raft_consensus.cc:606] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Received request to transfer leadership to TS f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:22.391891  4104 raft_consensus.cc:1275] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:22.436717  4101 raft_consensus.cc:614] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:22.398864  3999 leader_election.cc:304] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:22.206054  6932 raft_consensus.cc:515] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:22.443217  6951 leader_election.cc:290] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:22.444679  3957 raft_consensus.cc:2468] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 6.
I20260709 13:15:22.445667  4027 raft_consensus.cc:2468] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 7.
I20260709 13:15:22.408805  4105 raft_consensus.cc:1275] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:15:22.409538  3951 raft_consensus.cc:2468] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 8.
I20260709 13:15:22.379062  6718 raft_consensus.cc:493] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:22.380609  6727 raft_consensus.cc:2749] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:22.354944  6826 raft_consensus.cc:515] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:22.427052  4106 raft_consensus.cc:1275] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:15:22.428000  4103 raft_consensus.cc:1240] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 5. Current term is 6. Ops: []
W20260709 13:15:22.454733  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 90510.6us
I20260709 13:15:22.399720  6836 consensus_queue.cc:1048] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:15:22.371470  6522 consensus_queue.cc:1059] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:15:22.362227  6917 raft_consensus.cc:515] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:22.370738  6797 raft_consensus.cc:515] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:22.429756  6614 raft_consensus.cc:3060] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:22.432542  3997 connection.cc:256] RPC call timeout handler was delayed by -1.013656028000014s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18560000000000001s for a response
I20260709 13:15:22.440052  6984 leader_election.cc:290] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:22.440582  6868 leader_election.cc:290] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:15:22.441129  6994 log.cc:927] Time spent T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:15:22.346029  6324 consensus_queue.cc:260] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:22.307463  3853 rpcz_store.cc:269] 0709 13:15:04.625378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:04.629685 (+  4307us) service_pool.cc:224] Handling call
0709 13:15:22.287276 (+17657591us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:20.105334 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:20.129425 (+ 24091us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:20.129492 (+    67us) write_op.cc:435] Acquired schema lock
0709 13:15:20.129530 (+    38us) tablet.cc:662] Decoding operations
0709 13:15:20.131099 (+  1569us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:20.131177 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:20.131203 (+    26us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:15:20.294934 (+163731us) tablet.cc:701] Row locks acquired
0709 13:15:20.294991 (+    57us) write_op.cc:260] PREPARE: finished
0709 13:15:20.295215 (+   224us) write_op.cc:270] Start()
0709 13:15:20.295383 (+   168us) write_op.cc:276] Timestamp: P: 1783602920295150 usec, L: 0
0709 13:15:20.295413 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:15:20.296261 (+   848us) log.cc:844] Serialized 6661 byte log entry
0709 13:15:20.664119 (+367858us) op_driver.cc:464] REPLICATION: finished
0709 13:15:20.909380 (+245261us) write_op.cc:301] APPLY: starting
0709 13:15:20.909520 (+   140us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:20.909894 (+   374us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:20.915344 (+  5450us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:20.958958 (+ 43614us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:20.959356 (+   398us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 13:15:20.959410 (+    54us) write_op.cc:312] APPLY: finished
0709 13:15:20.959903 (+   493us) log.cc:844] Serialized 113 byte log entry
0709 13:15:21.002956 (+ 43053us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:21.054971 (+ 52015us) write_op.cc:454] Released schema lock
0709 13:15:21.068849 (+ 13878us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:21.160792 (+ 91943us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:21.160826 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3255056,"reported_tablets":43,"child_traces":[["op",{"apply.queue_time_us":244849,"apply.run_cpu_time_us":6916,"apply.run_wall_time_us":251420,"num_ops":16,"prepare.queue_time_us":177754,"prepare.run_cpu_time_us":38372,"prepare.run_wall_time_us":285329,"raft.queue_time_us":134142,"raft.run_cpu_time_us":41637,"raft.run_wall_time_us":220500,"replication_time_us":358852,"thread_start_us":387801,"threads_started":4,"wal-append.queue_time_us":111297,"wal-append.run_cpu_time_us":19153,"wal-append.run_wall_time_us":1550394}]]}
I20260709 13:15:22.457743  6932 leader_election.cc:290] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:22.458079  6842 leader_election.cc:290] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:22.435297  6582 raft_consensus.cc:493] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.514283  6582 raft_consensus.cc:515] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:22.516810  6582 leader_election.cc:290] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:22.520546  6941 leader_election.cc:290] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:22.521209  4100 raft_consensus.cc:1275] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:15:22.452901  6924 raft_consensus.cc:2804] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:22.512853  4672 leader_election.cc:304] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:15:22.524408  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 160875us
I20260709 13:15:22.525965  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:22.425168  3959 raft_consensus.cc:2468] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 6.
I20260709 13:15:22.454939  4106 pending_rounds.cc:85] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Aborting all ops after (but not including) 7
W20260709 13:15:22.480298  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:22.527241  4106 pending_rounds.cc:107] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:15:22.452670  6718 raft_consensus.cc:3060] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:22.426294  6744 raft_consensus.cc:515] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:22.465768  6826 leader_election.cc:290] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:22.459532  6937 leader_election.cc:290] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:22.465737  6938 leader_election.cc:290] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:22.472163  6942 leader_election.cc:290] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:22.429971  6770 raft_consensus.cc:515] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:22.527567  4106 raft_consensus.cc:2889] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:22.547894  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:22.558126  3955 raft_consensus.cc:2468] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 8.
I20260709 13:15:22.558300  3952 raft_consensus.cc:2468] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 7.
I20260709 13:15:22.549712  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:22.548949  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:22.559508  4707 raft_consensus.cc:2468] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
I20260709 13:15:22.534825  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:22.508613  6799 raft_consensus.cc:697] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:22.554050  4071 leader_election.cc:304] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:22.533845  3957 raft_consensus.cc:2368] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 7. Current term is 8.
I20260709 13:15:22.563302  3953 raft_consensus.cc:2410] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:15:22.561618  3924 leader_election.cc:304] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:22.547813  6839 raft_consensus.cc:2804] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:22.525214  6324 raft_consensus.cc:3060] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:22.552516  4102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45336 (request call id 1225) took 1194 ms. Trace:
I20260709 13:15:22.573094  3958 raft_consensus.cc:2468] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 7.
I20260709 13:15:22.555763  6924 raft_consensus.cc:697] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 6 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:22.553618  4099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45336 (request call id 1224) took 1201 ms. Trace:
I20260709 13:15:22.540856  4073 leader_election.cc:304] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:22.472074  6759 consensus_queue.cc:237] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:22.523855  6830 raft_consensus.cc:493] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.547591  6797 leader_election.cc:290] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:22.569428  4032 raft_consensus.cc:2468] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 7.
I20260709 13:15:22.569795  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:15:22.555807  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 186063us
I20260709 13:15:22.548358  6916 leader_election.cc:290] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:22.641171  4074 leader_election.cc:304] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:22.573585  4102 rpcz_store.cc:276] 0709 13:15:21.358040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:21.795940 (+437900us) service_pool.cc:224] Handling call
0709 13:15:21.802421 (+  6481us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:21.802669 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:15:21.820835 (+ 18166us) log.cc:844] Serialized 14 byte log entry
0709 13:15:22.515658 (+694823us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b1800324280. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f15224fbc0a 00007f152bc3b219 00007f1522583a40 00007f152257e4e4 00007f152257e455 00007f15290663c7 00007f15256789a7 00007f15256880bf 00007f1525688038
0709 13:15:22.515904 (+   246us) log.cc:844] Serialized 14 byte log entry
0709 13:15:22.552127 (+ 36223us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:22.552192 (+    65us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:22.552253 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:22.552325 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:22.552454 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":97122,"prepare.queue_time_us":372085,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":78,"raft.queue_time_us":72782,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":19829,"spinlock_wait_cycles":29904640,"thread_start_us":299124,"threads_started":1,"wal-append.queue_time_us":367890}
I20260709 13:15:22.580132  3954 raft_consensus.cc:2468] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 6.
I20260709 13:15:22.631364  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:22.555029  7001 raft_consensus.cc:2749] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:22.631528  4071 leader_election.cc:304] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:22.630142  6999 log.cc:927] Time spent T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:15:22.633831  6830 raft_consensus.cc:515] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:22.568105  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:22.574007  6540 raft_consensus.cc:2804] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:22.635629  6924 consensus_queue.cc:237] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:22.640218  3955 raft_consensus.cc:2468] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 6.
I20260709 13:15:22.560626  4107 raft_consensus.cc:3060] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:22.569000  6839 raft_consensus.cc:493] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:22.645438  4071 leader_election.cc:304] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:22.573097  6541 leader_election.cc:290] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:22.648887  4707 raft_consensus.cc:1240] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 3. Current term is 4. Ops: []
W20260709 13:15:22.654963  3905 auto_rebalancer.cc:629] Failed to schedule move for tablet 5e21bc17c8f64c43938a80f74620d90a: Illegal state: Replica 8952c48a6f3a43968f7d77f7bfc4d1bc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
W20260709 13:15:22.592386  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:22.655860  4071 leader_election.cc:304] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:22.642177  6935 raft_consensus.cc:493] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:22.658151  3955 raft_consensus.cc:1240] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:22.640719  6826 raft_consensus.cc:2804] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:22.653867  3959 raft_consensus.cc:2468] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 6.
I20260709 13:15:22.645658  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:22.686512  3954 raft_consensus.cc:2468] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 7.
W20260709 13:15:22.659700  4073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 118983us
I20260709 13:15:22.653338  6839 raft_consensus.cc:3060] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:22.666616  4071 leader_election.cc:304] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:22.668396  4107 raft_consensus.cc:2468] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 7.
I20260709 13:15:22.646258  6916 raft_consensus.cc:2749] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:22.692575  4672 leader_election.cc:304] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:22.693756  6944 raft_consensus.cc:2804] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:22.694411  6944 raft_consensus.cc:697] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 7 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:22.695353  6944 consensus_queue.cc:237] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:22.685806  6826 raft_consensus.cc:493] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:22.696630  6826 raft_consensus.cc:3060] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:22.664079  6582 consensus_queue.cc:1059] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:15:22.664001  6836 raft_consensus.cc:2804] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:22.698763  6836 raft_consensus.cc:493] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:22.699193  6836 raft_consensus.cc:3060] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:22.677999  6830 leader_election.cc:290] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:22.704841  3958 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0"
dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
mode: GRACEFUL
new_leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
 from {username='slave'} at 127.0.0.1:35222
I20260709 13:15:22.678133  3950 raft_consensus.cc:1275] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:15:22.705713  6923 raft_consensus.cc:515] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:22.707036  4701 raft_consensus.cc:1240] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:22.708292  6770 leader_election.cc:290] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:22.710825  6940 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:22.646126  6842 raft_consensus.cc:2749] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:22.647871  4074 leader_election.cc:304] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:22.726729  6925 raft_consensus.cc:493] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:22.667040  7005 raft_consensus.cc:2749] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:22.729661  6925 raft_consensus.cc:515] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:22.731220  6952 consensus_queue.cc:1059] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:22.732177  6925 leader_election.cc:290] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:22.691458  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:22.669963  6799 consensus_queue.cc:237] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:22.715821  6918 raft_consensus.cc:515] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:22.736021  3955 raft_consensus.cc:2468] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 7.
W20260709 13:15:22.676448  6990 log.cc:927] Time spent T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.484s	user 0.003s	sys 0.001s
I20260709 13:15:22.705535  3958 raft_consensus.cc:606] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 7 LEADER]: Received request to transfer leadership to TS 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:22.738066  6918 leader_election.cc:290] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:22.687409  6540 raft_consensus.cc:493] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:22.738586  6951 raft_consensus.cc:3055] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:22.712054  6917 leader_election.cc:290] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:22.712724  4703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:22.713770  6744 leader_election.cc:290] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:22.667695  7007 raft_consensus.cc:2804] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:22.715179  7009 raft_consensus.cc:2804] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:15:22.715811  3905 auto_rebalancer.cc:629] Failed to schedule move for tablet 4a08c9f959924154b694899e3a318181: Illegal state: Replica 8952c48a6f3a43968f7d77f7bfc4d1bc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:22.738987  6540 raft_consensus.cc:3060] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:22.716547  3999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 317791us
W20260709 13:15:22.759855  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:22.717160  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:22.718043  6938 raft_consensus.cc:493] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:22.718587  6942 raft_consensus.cc:493] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.718032  6932 raft_consensus.cc:2804] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:22.719677  6957 raft_consensus.cc:493] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.720111  6959 raft_consensus.cc:493] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.793915  6957 raft_consensus.cc:515] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:22.722014  3998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:22.796559  6957 leader_election.cc:290] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:22.723469  4675 leader_election.cc:304] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:22.710743  6814 consensus_meta.cc:287] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.513s	user 0.008s	sys 0.002s
I20260709 13:15:22.644507  4099 rpcz_store.cc:276] 0709 13:15:21.352240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:21.794339 (+442099us) service_pool.cc:224] Handling call
0709 13:15:21.802291 (+  7952us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:21.823648 (+ 21357us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:15:22.135054 (+311406us) log.cc:844] Serialized 14 byte log entry
0709 13:15:22.523479 (+388425us) log.cc:844] Serialized 14 byte log entry
0709 13:15:22.553207 (+ 29728us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:22.553264 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:22.553323 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:22.553407 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:22.553554 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79939,"prepare.queue_time_us":55904,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":84,"raft.queue_time_us":114421,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":17876,"spinlock_wait_cycles":36444032,"thread_start_us":574787,"threads_started":3,"wal-append.queue_time_us":247270}
I20260709 13:15:22.668479  6935 raft_consensus.cc:515] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:22.742408  4108 raft_consensus.cc:1240] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 6. Current term is 7. Ops: []
W20260709 13:15:22.748677  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 100918us
W20260709 13:15:22.753060  3924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:22.752907  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:22.799448  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:22.799799  4102 raft_consensus.cc:3060] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:22.799928  4074 leader_election.cc:304] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:22.800240  4032 raft_consensus.cc:2468] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7.
I20260709 13:15:22.801285  4074 leader_election.cc:304] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:22.801473  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:22.802124  4031 raft_consensus.cc:2468] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7.
I20260709 13:15:22.803113  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:15:22.803485  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:22.804123  4030 raft_consensus.cc:2393] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 7: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
W20260709 13:15:22.804302  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:22.743875  6951 raft_consensus.cc:740] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:22.774159  4672 leader_election.cc:304] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:15:22.778724  4674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:22.752290  7005 raft_consensus.cc:2749] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:22.774722  7007 raft_consensus.cc:697] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:22.785053  6923 leader_election.cc:290] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 8 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:22.785629  6839 raft_consensus.cc:515] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:22.792030  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:22.814939  3952 raft_consensus.cc:3060] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:22.792771  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:22.756363  4703 raft_consensus.cc:2468] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 8.
I20260709 13:15:22.793998  6959 raft_consensus.cc:515] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:22.721881  4071 leader_election.cc:304] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:22.797307  6942 raft_consensus.cc:515] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:22.798564  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 75221.7us
W20260709 13:15:22.834465  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 112691us
W20260709 13:15:22.752070  7015 log.cc:927] Time spent T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:15:22.805331  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:22.806991  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:22.742518  6940 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 8 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:22.809469  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:22.756151  7009 raft_consensus.cc:493] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:22.812996  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:22.813520  4074 leader_election.cc:304] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:22.820652  3997 leader_election.cc:304] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:22.825941  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:22.849479  4027 raft_consensus.cc:2468] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
I20260709 13:15:22.826884  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:22.814841  3925 leader_election.cc:304] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:22.835206  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:22.802325  6932 raft_consensus.cc:493] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:22.828334  6967 raft_consensus.cc:2804] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:22.856011  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:22.856715  4031 raft_consensus.cc:1275] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:15:22.809325  6768 raft_consensus.cc:493] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.856652  4706 raft_consensus.cc:2468] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 7.
I20260709 13:15:22.844750  4028 raft_consensus.cc:2468] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
I20260709 13:15:22.845014  4030 raft_consensus.cc:3060] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:22.855952  7001 raft_consensus.cc:2804] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:22.860225  7001 raft_consensus.cc:493] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:22.860622  7001 raft_consensus.cc:3060] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:22.847800  4071 leader_election.cc:304] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:22.814236  6797 raft_consensus.cc:2804] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:22.852329  4074 leader_election.cc:304] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:22.870117  4071 leader_election.cc:304] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:22.810773  6957 raft_consensus.cc:493] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:22.816212  6917 raft_consensus.cc:2749] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:22.877107  7005 raft_consensus.cc:2804] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:22.884374  7005 raft_consensus.cc:493] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:22.884776  7005 raft_consensus.cc:3060] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:22.844187  4029 raft_consensus.cc:2468] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9.
I20260709 13:15:22.852985  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:22.855108  6921 raft_consensus.cc:2804] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:22.783845  6938 raft_consensus.cc:515] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:22.865152  4073 leader_election.cc:304] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:22.848194  6727 raft_consensus.cc:2804] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:22.872608  4074 leader_election.cc:304] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
W20260709 13:15:22.873389  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 52852us
I20260709 13:15:22.875671  3952 raft_consensus.cc:2468] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 8.
I20260709 13:15:22.851490  7009 raft_consensus.cc:3060] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:22.876829  4030 raft_consensus.cc:2468] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 7.
I20260709 13:15:22.877446  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:22.881278  6797 raft_consensus.cc:697] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 4 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:22.881695  7003 raft_consensus.cc:2804] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:22.882112  6941 raft_consensus.cc:2804] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:22.851195  6759 consensus_queue.cc:1059] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:15:22.832737  6918 raft_consensus.cc:2804] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:22.914805  7016 raft_consensus.cc:493] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:22.915095  6918 raft_consensus.cc:493] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:22.915648  6918 raft_consensus.cc:3060] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:22.915443  7016 raft_consensus.cc:515] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:22.917891  3855 catalog_manager.cc:5697] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:22.856212  6932 raft_consensus.cc:3060] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:22.919209  4701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:22.902604  6727 raft_consensus.cc:493] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:22.921169  6727 raft_consensus.cc:3060] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:22.826918  6836 raft_consensus.cc:515] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:22.923862  4703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:22.924506  4703 raft_consensus.cc:2468] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 6.
I20260709 13:15:22.924729  6959 leader_election.cc:290] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:22.925364  6836 leader_election.cc:290] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:22.856482  6967 raft_consensus.cc:493] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:22.892652  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:22.926168  6967 raft_consensus.cc:3060] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:22.926352  4029 raft_consensus.cc:3060] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:22.858713  6706 raft_consensus.cc:2804] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:22.927829  6706 raft_consensus.cc:493] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
W20260709 13:15:22.928328  7017 log.cc:927] Time spent T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:15:22.929215  3925 leader_election.cc:304] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:15:22.930227  7014 log.cc:927] Time spent T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:15:22.931788  6830 consensus_queue.cc:1059] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:22.934136  6744 raft_consensus.cc:2804] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:22.934571  6744 raft_consensus.cc:493] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:22.934952  7023 log.cc:927] Time spent T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:15:22.935567  3925 leader_election.cc:304] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:22.936673  4675 leader_election.cc:304] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:22.937708  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:22.938388  3955 raft_consensus.cc:3060] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:15:22.939718  7016 leader_election.cc:290] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:22.935096  6718 raft_consensus.cc:515] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:22.896806  3997 leader_election.cc:304] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:22.940243  6951 consensus_queue.cc:260] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:22.870615  6768 raft_consensus.cc:515] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:22.942005  6951 raft_consensus.cc:3060] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:22.900591  6938 leader_election.cc:290] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:15:22.902688  3905 auto_rebalancer.cc:629] Failed to schedule move for tablet 65333bcc8c2a4b1a9f6f35670cefe7d0: Illegal state: Replica f1c75790cedf4f52a3463a255c7da059 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:22.891916  6921 raft_consensus.cc:493] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:22.894170  4702 raft_consensus.cc:2393] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 7: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
I20260709 13:15:22.909943  4032 raft_consensus.cc:1275] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:22.912679  4074 leader_election.cc:304] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:22.908486  6842 raft_consensus.cc:2749] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:22.925819  4108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45332 (request call id 1742) took 1083 ms. Trace:
I20260709 13:15:22.888514  6957 raft_consensus.cc:515] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:23.014861  4108 rpcz_store.cc:276] 0709 13:15:21.852247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:22.357382 (+505135us) service_pool.cc:224] Handling call
0709 13:15:22.357881 (+   499us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:22.798830 (+440949us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:22.925588 (+126758us) spinlock_profiling.cc:243] Waited 381 ms on lock 0x7b5400198054. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:22.925754 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":876714368}
W20260709 13:15:22.943260  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 46566.2us
I20260709 13:15:22.894475  4099 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:34352
W20260709 13:15:22.944525  3922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:22.947518  3925 leader_election.cc:304] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:22.948405  3855 catalog_manager.cc:5697] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:23.018198  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:15:23.018261  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 70866us
I20260709 13:15:22.928320  6706 raft_consensus.cc:3060] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:23.016842  6614 consensus_meta.cc:287] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938: Time spent flushing consensus metadata: real 0.511s	user 0.020s	sys 0.006s
I20260709 13:15:23.020426  6614 raft_consensus.cc:515] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:23.023764  6614 leader_election.cc:290] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:23.026513  6797 consensus_queue.cc:237] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:23.029376  6768 leader_election.cc:290] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:23.029922  3997 leader_election.cc:304] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:23.031726  3997 leader_election.cc:304] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:23.032680  6718 leader_election.cc:290] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 election: Requested vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:23.033237  3997 leader_election.cc:304] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:23.034152  6959 raft_consensus.cc:2749] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:23.034533  3997 leader_election.cc:304] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:23.035223  6959 raft_consensus.cc:2804] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:23.035764  6952 raft_consensus.cc:2804] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:23.036208  6952 raft_consensus.cc:493] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:23.036721  6952 raft_consensus.cc:3060] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:23.036857  7019 raft_consensus.cc:2749] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:23.041025  6830 raft_consensus.cc:3055] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:23.041436  6830 raft_consensus.cc:740] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
W20260709 13:15:23.041741  3905 auto_rebalancer.cc:629] Failed to schedule move for tablet f492997a6e0f48c5b9e231e43f19e3f3: Illegal state: Replica 8952c48a6f3a43968f7d77f7bfc4d1bc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:23.033596  6718 raft_consensus.cc:2749] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:23.042398  6830 consensus_queue.cc:260] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:23.044149  6768 raft_consensus.cc:493] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:23.044695  6768 raft_consensus.cc:515] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:22.905360  7007 consensus_queue.cc:237] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:23.041749  3855 catalog_manager.cc:5697] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 5 to 6, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 6 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:23.051828  6582 consensus_queue.cc:1048] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:23.053292  6917 raft_consensus.cc:3055] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:23.053681  6917 raft_consensus.cc:740] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:23.050460  3855 catalog_manager.cc:5697] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 4 to 6, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to d709ee666b774ec29aa732e508219938 (127.2.198.196). New cstate: current_term: 6 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:15:23.054517  6917 consensus_queue.cc:260] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:23.058892  6942 leader_election.cc:290] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:23.059770  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:23.060791  4032 raft_consensus.cc:2468] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 8.
I20260709 13:15:23.063724  3925 leader_election.cc:304] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:23.064456  6541 raft_consensus.cc:493] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:23.065009  6541 raft_consensus.cc:515] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:23.065639  4034 raft_consensus.cc:1275] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:15:23.066790  6799 raft_consensus.cc:2749] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:23.067150  6541 leader_election.cc:290] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:22.905462  6916 raft_consensus.cc:2804] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:22.910353  7003 raft_consensus.cc:493] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:23.008463  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 62914us
I20260709 13:15:22.925984  6839 leader_election.cc:290] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:22.913944  6941 raft_consensus.cc:493] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:22.934947  6744 raft_consensus.cc:3060] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:22.943013  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:23.141490  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:23.036008  6959 raft_consensus.cc:697] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:23.143074  6959 consensus_queue.cc:237] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:23.011051  6937 raft_consensus.cc:2749] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:23.054931  3855 catalog_manager.cc:5697] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:23.068763  7008 raft_consensus.cc:2804] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:22.952255  3955 raft_consensus.cc:2468] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 8.
I20260709 13:15:22.951164  4029 raft_consensus.cc:2468] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 8.
W20260709 13:15:23.015867  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 79261.4us
W20260709 13:15:23.074715  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 162120us
I20260709 13:15:23.147629  4074 leader_election.cc:304] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:23.076145  4071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:23.079012  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:23.080189  4672 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:15:23.150106  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 70043.9us
I20260709 13:15:23.151944  6937 raft_consensus.cc:2804] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:23.007702  7016 raft_consensus.cc:2749] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:23.139578  6941 raft_consensus.cc:3060] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:23.092257  6582 raft_consensus.cc:493] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:23.156426  6582 raft_consensus.cc:515] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:23.157871  6918 raft_consensus.cc:515] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:23.158782  6582 leader_election.cc:290] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:23.081370  6770 consensus_queue.cc:1048] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 13:15:23.065027  6957 leader_election.cc:290] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:23.078382  4102 raft_consensus.cc:2468] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 8.
I20260709 13:15:23.161375  6826 raft_consensus.cc:515] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:23.161103  3855 catalog_manager.cc:5697] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 4 to 6, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 6 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:23.162449  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:23.163144  4108 raft_consensus.cc:3060] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:23.164714  6768 leader_election.cc:290] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:23.164644  6962 consensus_queue.cc:1048] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:15:23.088027  7023 log.cc:927] Time spent T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 13:15:23.167042  6830 raft_consensus.cc:3060] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:23.168411  7001 raft_consensus.cc:515] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:23.013795  6921 raft_consensus.cc:3060] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:23.076768  6916 raft_consensus.cc:493] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:23.149950  4071 leader_election.cc:304] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:23.148871  4675 leader_election.cc:304] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:23.162942  3855 catalog_manager.cc:5697] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:23.184759  4108 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 9.
I20260709 13:15:23.172828  4074 leader_election.cc:304] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:23.172917  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:23.174777  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:23.187522  3855 catalog_manager.cc:5697] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
W20260709 13:15:23.189291  4674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:23.012255  6814 raft_consensus.cc:2804] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:23.181188  3997 leader_election.cc:400] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: Vote denied by peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843) with higher term. Message: Invalid argument: T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 6. Current term is 7.
I20260709 13:15:23.123052  6917 raft_consensus.cc:3060] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:23.182706  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:23.192943  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:23.194538  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:23.234529  3952 raft_consensus.cc:3060] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:15:23.234752  3958 raft_consensus.cc:2393] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 8: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:23.195756  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:23.235466  3955 raft_consensus.cc:2393] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 7: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:23.188867  4706 raft_consensus.cc:2468] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 8.
W20260709 13:15:23.171379  7012 log.cc:927] Time spent T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.133s	user 0.000s	sys 0.002s
I20260709 13:15:23.197927  3997 leader_election.cc:403] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 13:15:23.198233  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 49448.8us
W20260709 13:15:23.200237  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 108778us
I20260709 13:15:23.146341  7008 raft_consensus.cc:493] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:23.146836  6938 consensus_queue.cc:1048] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 13:15:23.185696  6916 raft_consensus.cc:3060] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:23.182264  6759 raft_consensus.cc:2749] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:23.219663  6799 raft_consensus.cc:2804] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:23.170759  6937 raft_consensus.cc:697] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 8 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:23.183431  6836 raft_consensus.cc:493] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.223836  6727 raft_consensus.cc:515] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:23.146773  6718 consensus_queue.cc:1059] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.080s
I20260709 13:15:23.226601  7011 raft_consensus.cc:2764] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:15:23.227785  6935 leader_election.cc:290] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:23.140806  7003 raft_consensus.cc:3060] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:23.229949  6941 raft_consensus.cc:515] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:23.230657  4702 raft_consensus.cc:1275] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:15:23.139681  6942 consensus_queue.cc:1048] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.092s
I20260709 13:15:23.227257  7009 raft_consensus.cc:515] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:23.226642  6826 leader_election.cc:290] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:23.231351  3855 catalog_manager.cc:5697] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 4 to 5, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 5 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:23.236999  3924 leader_election.cc:304] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:23.241271  3952 raft_consensus.cc:2468] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 9.
I20260709 13:15:23.141500  6949 raft_consensus.cc:493] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:23.340857  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:23.166198  6967 raft_consensus.cc:515] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:23.341777  4706 raft_consensus.cc:3060] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:23.288033  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:23.288350  4073 leader_election.cc:304] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:23.290925  3999 leader_election.cc:304] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:23.342525  3951 raft_consensus.cc:3060] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:23.298043  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:23.343154  4033 raft_consensus.cc:3060] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:23.298342  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:23.343885  4034 raft_consensus.cc:3060] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:23.233330  6814 raft_consensus.cc:493] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:23.315429  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:23.252346  6797 raft_consensus.cc:2804] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:15:23.252875  7025 log.cc:927] Time spent T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.097s	user 0.000s	sys 0.002s
I20260709 13:15:23.284461  7008 raft_consensus.cc:3060] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:23.320046  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 120720us
I20260709 13:15:23.285247  6706 raft_consensus.cc:515] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:23.328975  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 147968us
I20260709 13:15:23.361310  3922 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:15:23.361949  3997 leader_election.cc:304] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:23.329303  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:23.340716  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 103815us
I20260709 13:15:23.226909  6540 raft_consensus.cc:515] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:23.184209  6918 leader_election.cc:290] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:23.350507  6814 raft_consensus.cc:3060] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:23.366457  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:23.367856  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:23.368595  4107 raft_consensus.cc:2393] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 8: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:23.369383  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:23.369912  4107 raft_consensus.cc:2468] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 8.
I20260709 13:15:23.370397  6797 raft_consensus.cc:697] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 8 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:23.370724  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:23.371466  6797 consensus_queue.cc:237] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:23.371929  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:23.372715  4105 raft_consensus.cc:2393] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 8: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:23.372784  7016 raft_consensus.cc:2749] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843) with higher term. Message: Invalid argument: T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 6. Current term is 7.
I20260709 13:15:23.373538  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:23.374339  4105 raft_consensus.cc:2393] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 7: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:23.375100  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:23.317193  6836 raft_consensus.cc:515] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:23.346589  3855 catalog_manager.cc:5697] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 3 to 5, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 5 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:23.376974  4103 raft_consensus.cc:1275] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:15:23.377388  6727 leader_election.cc:290] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:23.350688  6949 raft_consensus.cc:515] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:23.378135  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:23.378721  4102 raft_consensus.cc:2376] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 8. Re-sending same reply.
I20260709 13:15:23.356853  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:23.379580  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:23.379853  4108 raft_consensus.cc:2376] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7. Re-sending same reply.
I20260709 13:15:23.380411  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:23.380654  3999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 89822.7us
I20260709 13:15:23.380826  4071 leader_election.cc:304] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:23.381014  4101 raft_consensus.cc:2468] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9.
I20260709 13:15:23.351464  6813 raft_consensus.cc:2804] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:23.381752  6813 raft_consensus.cc:493] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:23.382305  6813 raft_consensus.cc:3060] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:23.360319  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:23.383101  4100 raft_consensus.cc:2368] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 7. Current term is 8.
I20260709 13:15:23.384265  6938 raft_consensus.cc:2749] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:15:23.272727  7034 log.cc:927] Time spent T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:15:23.385039  6706 leader_election.cc:290] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:23.326548  7001 leader_election.cc:290] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:15:23.381402  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:23.322494  6932 raft_consensus.cc:515] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:23.381783  6957 raft_consensus.cc:2804] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:23.359612  4099 raft_consensus.cc:606] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Received request to transfer leadership to TS 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:23.375938  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:23.390028  4028 raft_consensus.cc:1275] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:15:23.386740  4105 raft_consensus.cc:2468] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
I20260709 13:15:23.379371  7009 leader_election.cc:290] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:23.377501  3855 catalog_manager.cc:5697] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 3 to 5, leader changed from d709ee666b774ec29aa732e508219938 (127.2.198.196) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 5 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:23.396938  3997 leader_election.cc:304] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:23.399899  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:23.437959  4032 raft_consensus.cc:2468] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 7.
W20260709 13:15:23.400745  4073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 112494us
I20260709 13:15:23.440671  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:23.416250  4099 raft_consensus.cc:614] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:23.392349  4107 raft_consensus.cc:2393] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 5: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:23.405973  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:23.417981  6941 leader_election.cc:290] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:23.418339  3952 raft_consensus.cc:1275] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:23.442301  4027 raft_consensus.cc:2468] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 7.
I20260709 13:15:23.423074  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:23.443099  3954 raft_consensus.cc:2393] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 in current term 7: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:23.443207  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:23.423746  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:23.444293  4030 raft_consensus.cc:2393] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 9: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:23.425516  6744 raft_consensus.cc:515] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:23.416863  4106 raft_consensus.cc:2468] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7.
I20260709 13:15:23.413003  7011 raft_consensus.cc:2804] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:23.432296  6706 raft_consensus.cc:493] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.444684  4706 raft_consensus.cc:2468] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 9.
I20260709 13:15:23.454278  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:23.441488  4105 raft_consensus.cc:2468] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 7.
I20260709 13:15:23.458070  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:23.458369  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:23.458680  4030 raft_consensus.cc:2468] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 7.
I20260709 13:15:23.459319  3922 leader_election.cc:400] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843) with higher term. Message: Invalid argument: T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 6. Current term is 7.
I20260709 13:15:23.459685  3922 leader_election.cc:403] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:23.461416  4074 leader_election.cc:304] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:23.446714  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 49994.1us
I20260709 13:15:23.450150  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:23.332751  7005 raft_consensus.cc:515] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:23.460961  4672 leader_election.cc:304] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:23.468098  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:23.454999  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:23.469549  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:23.456171  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:23.470106  4026 raft_consensus.cc:3060] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:23.470476  4102 raft_consensus.cc:2368] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 7. Current term is 8.
I20260709 13:15:23.471674  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:23.472592  4102 raft_consensus.cc:2393] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 10: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:23.455232  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:23.476029  4108 raft_consensus.cc:2376] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 7. Re-sending same reply.
I20260709 13:15:23.469646  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:23.411728  6541 raft_consensus.cc:2764] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:15:23.401590  6799 raft_consensus.cc:697] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:23.484680  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:23.444515  6826 raft_consensus.cc:2804] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:23.484959  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
W20260709 13:15:23.488564  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 86140us
I20260709 13:15:23.416354  6957 raft_consensus.cc:493] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:23.464401  3997 leader_election.cc:304] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:23.489917  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:23.453765  6942 raft_consensus.cc:2749] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:23.494767  4027 raft_consensus.cc:3060] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:23.449908  3855 catalog_manager.cc:5697] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: config changed from index 2 to 6, term changed from 6 to 7, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to <none>, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER f1c75790cedf4f52a3463a255c7da059 (127.2.198.193), VOTER 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194), VOTER 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195), VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196). New cstate: current_term: 7 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:15:23.510082  3855 catalog_manager.cc:5697] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 5 to 7, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 7 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:23.485296  7011 raft_consensus.cc:697] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:23.488689  6826 raft_consensus.cc:493] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:23.546003  3924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:23.514860  3997 leader_election.cc:304] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:23.556828  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:23.557444  3952 raft_consensus.cc:3060] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:15:23.557621  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:23.558394  3958 raft_consensus.cc:2393] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 6: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:23.381798  6937 consensus_queue.cc:237] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:23.514909  4032 raft_consensus.cc:2468] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 7.
I20260709 13:15:23.551105  6839 consensus_queue.cc:1048] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:15:23.481900  6706 raft_consensus.cc:515] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:23.493018  6923 raft_consensus.cc:2804] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:23.495476  7041 raft_consensus.cc:2749] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:23.608707  4026 raft_consensus.cc:2468] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 8.
I20260709 13:15:23.538722  4074 leader_election.cc:304] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:23.597693  4027 raft_consensus.cc:2468] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 9.
I20260709 13:15:23.610360  4033 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 9.
W20260709 13:15:23.569303  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:23.635095  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:23.635776  4675 leader_election.cc:304] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:23.615309  3952 raft_consensus.cc:2468] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 8.
I20260709 13:15:23.566109  3956 raft_consensus.cc:1275] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:15:23.641368  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:23.641253  3855 catalog_manager.cc:5697] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:15:23.641976  4027 raft_consensus.cc:3060] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:23.564429  7046 raft_consensus.cc:493] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.643607  4033 raft_consensus.cc:1275] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:15:23.566929  6826 raft_consensus.cc:3060] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:23.649449  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 91901.9us
I20260709 13:15:23.627856  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:23.649812  4027 raft_consensus.cc:2468] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 8.
I20260709 13:15:23.647027  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:23.626904  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:23.647961  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:23.650944  4032 raft_consensus.cc:3060] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:23.651932  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 113299us
I20260709 13:15:23.503882  6718 raft_consensus.cc:2749] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:23.497985  6957 raft_consensus.cc:3060] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:23.658255  4026 raft_consensus.cc:2468] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 6.
W20260709 13:15:23.662465  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 147690us
I20260709 13:15:23.510800  6952 raft_consensus.cc:515] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:23.667433  4032 raft_consensus.cc:2468] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 8.
I20260709 13:15:23.523139  7019 consensus_queue.cc:1048] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.137s
I20260709 13:15:23.632087  6949 leader_election.cc:290] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:23.647228  6940 raft_consensus.cc:2804] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:23.653977  4074 leader_election.cc:304] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:23.625912  6923 raft_consensus.cc:493] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:23.649896  6938 raft_consensus.cc:2749] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:23.649300  6836 leader_election.cc:290] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:23.671478  4030 raft_consensus.cc:2468] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 8.
I20260709 13:15:23.660854  7009 raft_consensus.cc:2749] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:23.677357  6940 raft_consensus.cc:697] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 9 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:23.678200  6744 leader_election.cc:290] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:23.682197  7035 log.cc:927] Time spent T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
W20260709 13:15:23.682929  7042 log.cc:927] Time spent T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
W20260709 13:15:23.688174  7038 log.cc:927] Time spent T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:15:23.726344  7048 consensus_queue.cc:1048] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:15:23.727677  6921 consensus_meta.cc:287] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.530s	user 0.003s	sys 0.010s
I20260709 13:15:23.728276  6921 raft_consensus.cc:515] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:23.731034  6921 leader_election.cc:290] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:23.701388  6718 consensus_queue.cc:1048] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:15:23.697299  6842 raft_consensus.cc:2804] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:23.733171  6842 raft_consensus.cc:697] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:23.734503  6842 consensus_queue.cc:237] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:23.695719  4074 leader_election.cc:304] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
W20260709 13:15:23.741737  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 46122.6us
I20260709 13:15:23.669337  6582 raft_consensus.cc:2749] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843) with higher term. Message: Invalid argument: T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 6. Current term is 7.
I20260709 13:15:23.740764  3954 raft_consensus.cc:2393] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 8: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:23.742645  4074 leader_election.cc:304] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:23.746978  4074 leader_election.cc:304] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:23.738610  6540 leader_election.cc:290] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:23.692517  6923 raft_consensus.cc:3060] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:23.695834  4034 raft_consensus.cc:2468] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 7.
I20260709 13:15:23.661288  7046 raft_consensus.cc:515] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:23.768574  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 118039us
I20260709 13:15:23.768741  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:23.645869  6799 consensus_queue.cc:237] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:23.787911  3951 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 9.
W20260709 13:15:23.759151  7040 log.cc:927] Time spent T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:15:23.705366  7001 consensus_queue.cc:1048] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 13:15:23.806967  4706 raft_consensus.cc:2468] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 7.
W20260709 13:15:23.809891  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 136217us
I20260709 13:15:23.759452  7041 raft_consensus.cc:2804] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:23.761863  6836 raft_consensus.cc:2804] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:23.747818  7009 raft_consensus.cc:2804] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:23.767634  6932 leader_election.cc:290] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 election: Requested vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:15:23.847079  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 388002us
I20260709 13:15:23.879133  3922 leader_election.cc:304] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:23.855865  6952 leader_election.cc:290] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:23.858824  4101 raft_consensus.cc:1275] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:15:23.881868  6706 leader_election.cc:290] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:23.817211  7005 leader_election.cc:290] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:23.878840  7041 raft_consensus.cc:697] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:23.883059  3922 leader_election.cc:304] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:23.883666  6976 raft_consensus.cc:2804] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:23.884338  6976 raft_consensus.cc:697] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 5 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:23.884048  7041 consensus_queue.cc:237] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:23.884917  3922 leader_election.cc:304] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:23.885242  6976 consensus_queue.cc:237] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:23.886760  6921 raft_consensus.cc:2749] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:23.888257  7050 raft_consensus.cc:493] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:23.886057  6540 raft_consensus.cc:2749] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:23.888984  7050 raft_consensus.cc:515] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:23.880100  6814 consensus_meta.cc:287] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.514s	user 0.007s	sys 0.004s
I20260709 13:15:23.862449  3997 leader_election.cc:304] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:15:23.893303  4675 leader_election.cc:304] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:23.893847  4099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:34352 (request call id 28) took 1014 ms. Trace:
I20260709 13:15:23.894244  4099 rpcz_store.cc:276] 0709 13:15:22.877824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:22.878032 (+   208us) service_pool.cc:224] Handling call
0709 13:15:23.891692 (+1013660us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x7b540017ff54. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f1525668853 00007f152a63660a 00007f1523bbc7d4 00007f1523bbc762 00007f1523bbc691 00007f1523bbc60c 00007f1523bbb8c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:23.891815 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":788044032}
I20260709 13:15:23.895967  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:23.702957  7011 consensus_queue.cc:237] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:23.886747  3922 leader_election.cc:304] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:23.901546  4706 raft_consensus.cc:1275] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:15:23.901999  3997 leader_election.cc:304] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:23.902653  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:23.903285  4032 raft_consensus.cc:3060] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:23.902269  3922 leader_election.cc:304] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:23.909236  3922 leader_election.cc:304] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:23.894321  6836 raft_consensus.cc:697] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:23.911055  7055 raft_consensus.cc:2749] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:23.911960  6706 raft_consensus.cc:2804] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:23.911789  6836 consensus_queue.cc:237] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:23.913137  6706 raft_consensus.cc:697] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:23.914093  6706 consensus_queue.cc:237] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:23.915839  4032 raft_consensus.cc:2468] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 8.
I20260709 13:15:23.917244  3997 leader_election.cc:304] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:23.923523  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:23.924021  3997 leader_election.cc:400] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 election: Vote denied by peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339) with higher term. Message: Invalid argument: T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 7. Current term is 8.
I20260709 13:15:23.924685  3997 leader_election.cc:403] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:15:23.923718  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:23.925513  4032 raft_consensus.cc:3060] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:23.926133  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:24.130764  4027 raft_consensus.cc:3060] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:15:24.132611  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 206607us
I20260709 13:15:23.896423  7009 raft_consensus.cc:697] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:23.891366  6814 raft_consensus.cc:515] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:24.132628  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 205270us
I20260709 13:15:23.927177  4026 raft_consensus.cc:2393] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 8: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
W20260709 13:15:24.145172  3924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:23.908546  6932 raft_consensus.cc:2804] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:23.921053  6540 raft_consensus.cc:2804] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:24.150379  3925 leader_election.cc:304] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:24.127713  6942 raft_consensus.cc:2804] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:15:24.168576  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 259409us
I20260709 13:15:24.175194  3922 leader_election.cc:304] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:24.128063  7053 raft_consensus.cc:3060] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:24.132718  7005 raft_consensus.cc:493] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.177935  3957 raft_consensus.cc:2393] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 in current term 7: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:24.151435  7050 leader_election.cc:290] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:24.184798  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:24.185721  4033 raft_consensus.cc:2468] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7.
I20260709 13:15:24.156256  6932 raft_consensus.cc:493] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
W20260709 13:15:24.195729  7044 log.cc:927] Time spent T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.481s	user 0.000s	sys 0.001s
I20260709 13:15:24.196143  7009 consensus_queue.cc:237] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:24.174629  6942 raft_consensus.cc:493] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:24.197434  6942 raft_consensus.cc:3060] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:24.198526  3922 leader_election.cc:304] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:24.199738  6744 raft_consensus.cc:2804] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:24.200127  7001 raft_consensus.cc:493] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.200438  6582 raft_consensus.cc:2764] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:15:24.200829  7001 raft_consensus.cc:515] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:24.156002  7056 raft_consensus.cc:2804] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:24.203996  7056 raft_consensus.cc:697] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 7 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:24.205186  7056 consensus_queue.cc:237] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:24.168529  6952 raft_consensus.cc:493] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:24.208159  7047 log.cc:927] Time spent T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.329s	user 0.000s	sys 0.000s
I20260709 13:15:24.200148  6744 raft_consensus.cc:493] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:24.209543  6744 raft_consensus.cc:3060] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:24.209913  7052 log.cc:927] Time spent T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.288s	user 0.000s	sys 0.000s
I20260709 13:15:24.210505  7059 raft_consensus.cc:2804] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:24.207809  6952 raft_consensus.cc:515] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:23.897213  6940 consensus_queue.cc:237] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:24.167735  6540 raft_consensus.cc:493] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:24.218290  4027 raft_consensus.cc:2468] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 10.
W20260709 13:15:24.243902  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 344095us
W20260709 13:15:24.236052  6957 consensus_meta.cc:287] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 0.566s	user 0.009s	sys 0.002s
I20260709 13:15:24.212031  6932 raft_consensus.cc:3060] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:24.251724  6937 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.087s	sys 0.158s
I20260709 13:15:24.186347  6614 consensus_queue.cc:1048] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.120s
I20260709 13:15:24.214639  6582 raft_consensus.cc:493] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
W20260709 13:15:24.303148  6916 consensus_meta.cc:287] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 1.007s	user 0.007s	sys 0.005s
I20260709 13:15:24.187724  7005 raft_consensus.cc:515] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:24.176921  7057 consensus_queue.cc:1048] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.138s
I20260709 13:15:24.304335  7041 raft_consensus.cc:493] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:24.316288  6937 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.088s	sys 0.159s
I20260709 13:15:24.244362  6540 raft_consensus.cc:3060] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:24.325277  7046 leader_election.cc:290] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:24.342100  6582 raft_consensus.cc:515] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:24.357270  7049 raft_consensus.cc:2804] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:24.388849  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:24.316314  6957 raft_consensus.cc:515] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:24.418869  3999 leader_election.cc:304] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
W20260709 13:15:24.399804  6826 consensus_meta.cc:287] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.738s	user 0.009s	sys 0.004s
I20260709 13:15:24.416915  6744 raft_consensus.cc:515] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:24.419386  4025 raft_consensus.cc:2393] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 7: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
I20260709 13:15:24.419914  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
W20260709 13:15:24.423878  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 225447us
I20260709 13:15:24.424654  3922 leader_election.cc:304] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:24.429373  4032 raft_consensus.cc:2468] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7.
I20260709 13:15:24.432735  3999 leader_election.cc:304] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:24.340581  6916 raft_consensus.cc:515] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:24.411870  7003 consensus_meta.cc:287] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 1.063s	user 0.013s	sys 0.003s
I20260709 13:15:24.425136  7059 raft_consensus.cc:697] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 7 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:24.463181  4026 raft_consensus.cc:1275] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:15:24.423367  6949 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.061s	sys 0.083s
W20260709 13:15:24.428748  7062 log.cc:927] Time spent T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:15:24.478014  7050 raft_consensus.cc:2804] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:24.481895  7050 raft_consensus.cc:697] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:24.482956  7050 consensus_queue.cc:237] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:24.478279  7067 raft_consensus.cc:493] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.487485  7067 raft_consensus.cc:515] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:24.489985  7067 leader_election.cc:290] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:24.428642  7001 leader_election.cc:290] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:24.472196  6937 raft_consensus.cc:493] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.492723  6937 raft_consensus.cc:515] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:24.494918  6937 leader_election.cc:290] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:24.496156  6814 leader_election.cc:290] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:24.475773  7003 raft_consensus.cc:515] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:24.497476  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:24.498523  4026 raft_consensus.cc:2468] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 6.
I20260709 13:15:24.499666  7003 leader_election.cc:290] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:24.500200  6582 leader_election.cc:290] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:24.499956  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:15:24.500746  7066 log.cc:927] Time spent T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:15:24.501040  4025 raft_consensus.cc:2468] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 7.
I20260709 13:15:24.418766  6967 leader_election.cc:290] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:24.505309  6916 leader_election.cc:290] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:24.428376  7049 raft_consensus.cc:697] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 8 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:24.506611  7049 consensus_queue.cc:237] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:24.508682  6813 consensus_meta.cc:287] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 1.126s	user 0.011s	sys 0.003s
I20260709 13:15:24.509142  6813 raft_consensus.cc:515] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:24.512310  6916 raft_consensus.cc:493] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.512869  6916 raft_consensus.cc:515] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:24.513480  4104 raft_consensus.cc:2393] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 8: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:24.514189  4107 raft_consensus.cc:2393] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 9: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:24.429450  7046 raft_consensus.cc:2749] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:24.514973  6916 leader_election.cc:290] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:24.517347  6744 leader_election.cc:290] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:24.518971  6952 leader_election.cc:290] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:24.521303  4099 raft_consensus.cc:1275] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:15:24.442548  6826 raft_consensus.cc:515] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:24.524515  3957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35354 (request call id 327) took 1506 ms. Trace:
I20260709 13:15:24.525439  4105 raft_consensus.cc:2368] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 7. Current term is 8.
I20260709 13:15:24.525875  6957 leader_election.cc:290] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: Requested vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:24.525128  3957 rpcz_store.cc:276] 0709 13:15:23.017676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.017924 (+   248us) service_pool.cc:224] Handling call
0709 13:15:24.524203 (+1506279us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b5400320ad4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:24.524413 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2664901888}
I20260709 13:15:24.526376  6826 leader_election.cc:290] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:24.476188  3922 leader_election.cc:304] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
W20260709 13:15:24.528470  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 52404.8us
I20260709 13:15:24.529307  3922 leader_election.cc:304] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:24.530866  7046 raft_consensus.cc:2764] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:15:24.347879  7041 raft_consensus.cc:515] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:24.479810  6949 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.061s	sys 0.084s
I20260709 13:15:24.503317  6942 raft_consensus.cc:515] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:24.470507  6706 raft_consensus.cc:2804] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:24.525898  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:24.539294  4102 raft_consensus.cc:2468] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 6.
I20260709 13:15:24.537508  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:24.545816  3951 raft_consensus.cc:1275] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:15:24.549350  4672 leader_election.cc:304] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:24.551190  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:24.551523  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:24.552027  3957 raft_consensus.cc:3060] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:24.552424  3952 raft_consensus.cc:2468] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 6.
I20260709 13:15:24.555873  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
W20260709 13:15:24.532539  7008 consensus_meta.cc:287] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 1.134s	user 0.008s	sys 0.003s
I20260709 13:15:24.557853  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:24.558282  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:24.558346  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:24.562417  3952 raft_consensus.cc:3060] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:24.562590  3958 raft_consensus.cc:1275] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:15:24.561383  3951 raft_consensus.cc:2468] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 4.
I20260709 13:15:24.531508  7046 raft_consensus.cc:2804] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:24.581971  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:24.524574  7005 leader_election.cc:290] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:24.532932  7041 leader_election.cc:290] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:24.534611  7053 raft_consensus.cc:2749] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339) with higher term. Message: Invalid argument: T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 7. Current term is 8.
I20260709 13:15:24.536767  6706 raft_consensus.cc:697] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:24.594988  3922 leader_election.cc:304] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:24.511466  6813 leader_election.cc:290] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:24.522241  7059 consensus_queue.cc:237] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:24.611583  7011 raft_consensus.cc:493] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.612473  7011 raft_consensus.cc:515] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:24.559638  6614 raft_consensus.cc:2804] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:24.590030  7001 raft_consensus.cc:493] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.533612  6949 consensus_queue.cc:1048] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:15:24.533205  7006 consensus_queue.cc:1048] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
W20260709 13:15:24.605924  7061 log.cc:927] Time spent T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:15:24.578877  6967 raft_consensus.cc:493] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:24.578881  6744 raft_consensus.cc:493] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:24.555159  6582 consensus_queue.cc:1048] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 13:15:24.600301  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:24.635475  3952 raft_consensus.cc:2468] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 8.
I20260709 13:15:24.559855  6826 consensus_queue.cc:1048] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:15:24.637989  3957 raft_consensus.cc:2468] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 9.
I20260709 13:15:24.587204  7008 raft_consensus.cc:515] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:24.598305  6942 leader_election.cc:290] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:24.647271  4703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:24.623140  6614 raft_consensus.cc:493] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:24.580793  7069 consensus_queue.cc:1048] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 13:15:24.601375  6951 consensus_queue.cc:1059] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:15:24.667826  6951 consensus_queue.cc:1243] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer 8952c48a6f3a43968f7d77f7bfc4d1bc log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:15:24.668416  6951 raft_consensus.cc:3055] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:24.668875  6951 raft_consensus.cc:740] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:24.669301  7008 leader_election.cc:290] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:24.669989  6951 consensus_queue.cc:260] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:24.672012  4702 raft_consensus.cc:2393] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 9: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:24.672515  6932 raft_consensus.cc:515] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:24.653741  6814 raft_consensus.cc:2749] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:15:24.677832  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:24.658834  7051 consensus_queue.cc:1048] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:15:24.659648  7065 consensus_queue.cc:1048] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 13:15:24.622188  7003 consensus_queue.cc:1048] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:15:24.661504  6706 consensus_queue.cc:237] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:24.661886  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:24.645922  6744 raft_consensus.cc:515] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:24.648649  6967 raft_consensus.cc:515] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:24.666656  6540 raft_consensus.cc:515] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:24.680917  6959 raft_consensus.cc:3055] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:24.657102  6614 raft_consensus.cc:3060] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:24.650324  7011 leader_election.cc:290] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:24.683218  6951 raft_consensus.cc:3060] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:24.675359  6932 leader_election.cc:290] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:24.629822  7001 raft_consensus.cc:515] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:24.692343  4700 raft_consensus.cc:3060] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:24.687572  7003 consensus_queue.cc:1243] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer f1c75790cedf4f52a3463a255c7da059 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 13:15:24.686120  6923 consensus_meta.cc:287] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938: Time spent flushing consensus metadata: real 0.887s	user 0.004s	sys 0.008s
I20260709 13:15:24.681819  6842 consensus_queue.cc:1048] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:15:24.695621  6959 raft_consensus.cc:740] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:24.699139  7005 raft_consensus.cc:493] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.739794  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:24.730410  6959 consensus_queue.cc:260] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:24.733203  7001 leader_election.cc:290] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:24.733946  6967 leader_election.cc:290] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:24.701064  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:24.740795  4101 raft_consensus.cc:2468] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 10.
W20260709 13:15:24.755403  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 160505us
I20260709 13:15:24.756361  3922 leader_election.cc:304] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:24.728559  6923 raft_consensus.cc:515] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:24.761547  3922 leader_election.cc:400] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843) with higher term. Message: Invalid argument: T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 7. Current term is 8.
I20260709 13:15:24.784329  3922 leader_election.cc:403] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:15:24.761916  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 143549us
I20260709 13:15:24.755923  4672 leader_election.cc:304] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:24.787482  3922 leader_election.cc:304] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:24.787935  4101 raft_consensus.cc:1275] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:15:24.770376  4673 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.040s	sys 0.105s
I20260709 13:15:24.773139  6540 leader_election.cc:290] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:24.776274  3954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38606 (request call id 1944) took 1220 ms. Trace:
I20260709 13:15:24.776491  4030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38290 (request call id 1871) took 1316 ms. Trace:
W20260709 13:15:24.788707  4673 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.042s	sys 0.106s
I20260709 13:15:24.810290  3922 leader_election.cc:304] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:24.783867  6959 raft_consensus.cc:3060] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:24.812204  4030 rpcz_store.cc:276] 0709 13:15:23.459623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.459808 (+   185us) service_pool.cc:224] Handling call
0709 13:15:24.776317 (+1316509us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b54000a1754. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:24.776427 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":412162816}
I20260709 13:15:24.783288  7051 raft_consensus.cc:3060] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:24.808182  7026 raft_consensus.cc:2804] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:24.785248  7046 raft_consensus.cc:697] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 8 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:24.810621  7049 raft_consensus.cc:2804] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:24.813915  4703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
W20260709 13:15:24.844064  4105 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45336 (request call id 1244) took 1382 ms (client timeout 1658 ms). Trace:
I20260709 13:15:24.844779  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:24.814942  6967 raft_consensus.cc:493] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:24.750744  7005 raft_consensus.cc:515] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:24.807691  3954 rpcz_store.cc:276] 0709 13:15:23.555947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.556128 (+   181us) service_pool.cc:224] Handling call
0709 13:15:24.776053 (+1219925us) spinlock_profiling.cc:243] Waited 90.2 ms on lock 0x7b54000f28d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:24.776208 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":207538048}
I20260709 13:15:24.814886  4071 leader_election.cc:304] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:24.846614  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:24.930536  4108 raft_consensus.cc:3060] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:24.931070  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:24.931928  4099 raft_consensus.cc:2468] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7.
I20260709 13:15:24.841079  6540 raft_consensus.cc:3060] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:24.844518  4105 rpcz_store.cc:269] 0709 13:15:23.457502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.458148 (+   646us) service_pool.cc:224] Handling call
0709 13:15:24.839796 (+1381648us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54002594d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:24.840012 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2452251008}
I20260709 13:15:24.783150  7065 consensus_queue.cc:1048] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:15:24.811439  7084 raft_consensus.cc:493] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:24.923077  7076 log.cc:927] Time spent T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:15:24.817307  6744 leader_election.cc:290] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:24.812448  6937 consensus_queue.cc:1048] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.108s
I20260709 13:15:24.848354  4703 raft_consensus.cc:2393] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 7: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
I20260709 13:15:24.840845  7026 raft_consensus.cc:493] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:24.933044  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:15:24.933418  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 125907us
I20260709 13:15:24.954874  4709 raft_consensus.cc:2468] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 8.
I20260709 13:15:24.842079  7049 raft_consensus.cc:493] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:24.808866  6522 raft_consensus.cc:2749] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843) with higher term. Message: Invalid argument: T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 7. Current term is 8.
I20260709 13:15:24.938143  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:24.970875  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:24.944290  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:24.955163  4071 leader_election.cc:304] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:15:24.976218  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:24.937244  7003 raft_consensus.cc:2749] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:24.950986  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:15:24.971660  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 132733us
I20260709 13:15:24.971609  4101 raft_consensus.cc:3060] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:24.946091  4108 raft_consensus.cc:2468] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 8.
I20260709 13:15:24.981495  4071 leader_election.cc:304] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:24.950217  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:24.944933  7006 raft_consensus.cc:493] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.986027  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:24.996866  3952 raft_consensus.cc:2468] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 8.
I20260709 13:15:24.985532  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:25.067768  7006 raft_consensus.cc:515] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:25.068746  4030 raft_consensus.cc:2410] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 9 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:15:25.069217  3957 raft_consensus.cc:1275] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:15:25.069696  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:25.070317  4030 raft_consensus.cc:3060] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:24.980168  4105 raft_consensus.cc:2468] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7.
I20260709 13:15:25.063364  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:25.071655  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:25.072206  4105 raft_consensus.cc:3060] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:24.982482  7016 raft_consensus.cc:493] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:24.998337  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:24.944051  7065 consensus_queue.cc:1243] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer 8952c48a6f3a43968f7d77f7bfc4d1bc log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:15:24.937582  6976 raft_consensus.cc:493] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:25.023280  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:25.076853  4106 raft_consensus.cc:3060] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:25.024158  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:24.998529  7007 consensus_queue.cc:1048] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:15:24.973567  7049 raft_consensus.cc:3060] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:25.095683  6976 raft_consensus.cc:515] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:25.098213  6976 leader_election.cc:290] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:25.077068  7009 raft_consensus.cc:2804] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:15:25.025671  7075 log.cc:927] Time spent T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:15:25.100375  7009 raft_consensus.cc:493] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.100804  7009 raft_consensus.cc:3060] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:25.026563  6923 leader_election.cc:290] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 8 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:25.102293  6923 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.102941  6923 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:25.105176  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:25.106220  6923 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:24.955937  7026 raft_consensus.cc:3060] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:25.088281  7016 raft_consensus.cc:515] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:25.027474  3922 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.933s (SENT) [suppressed 35 similar messages]
W20260709 13:15:25.028357  7085 log.cc:927] Time spent T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:15:24.971730  7067 consensus_queue.cc:1048] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:15:25.020406  7046 consensus_queue.cc:237] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:25.117051  7016 leader_election.cc:290] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:25.022389  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:25.040380  4071 leader_election.cc:304] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:24.952920  7083 raft_consensus.cc:493] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:25.041910  4100 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45336 (request call id 1239) took 1587 ms (client timeout 1537 ms). Trace:
I20260709 13:15:25.049675  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:25.125773  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:25.047385  4703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:24.944486  6967 raft_consensus.cc:515] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:25.021633  7043 raft_consensus.cc:2804] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:15:25.055936  7074 log.cc:927] Time spent T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
W20260709 13:15:25.060329  7086 log.cc:927] Time spent T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:15:25.061410  4705 raft_consensus.cc:1240] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:25.067147  4101 raft_consensus.cc:2468] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9.
I20260709 13:15:25.073468  4028 raft_consensus.cc:2393] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 7: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
W20260709 13:15:25.082756  3997 connection.cc:256] RPC call timeout handler was delayed by -1.2409370139998828s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2209s for a response
I20260709 13:15:25.089514  7005 leader_election.cc:290] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:24.960879  7084 raft_consensus.cc:515] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:25.095894  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:25.106386  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:25.120149  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:25.151155  4108 raft_consensus.cc:2368] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 7. Current term is 8.
I20260709 13:15:25.151337  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:24.972493  6706 raft_consensus.cc:493] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:25.122382  4105 raft_consensus.cc:2468] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9.
I20260709 13:15:25.122673  4106 raft_consensus.cc:2468] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 10.
W20260709 13:15:25.124207  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 83916.8us
I20260709 13:15:25.125849  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:25.153957  4071 leader_election.cc:304] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:25.154186  4033 raft_consensus.cc:2468] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 7.
I20260709 13:15:25.055315  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:25.155299  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:25.155956  4031 raft_consensus.cc:3060] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:25.156030  4033 raft_consensus.cc:2468] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 8.
I20260709 13:15:25.157325  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
W20260709 13:15:25.162384  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:25.124840  4100 rpcz_store.cc:269] 0709 13:15:23.454244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.467831 (+ 13587us) service_pool.cc:224] Handling call
0709 13:15:25.041687 (+1573856us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540042d6d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:25.041830 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2318263168}
I20260709 13:15:25.131160  7043 raft_consensus.cc:493] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.130941  3997 leader_election.cc:304] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:25.131067  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:25.127143  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:25.221750  4029 raft_consensus.cc:2410] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:15:25.141865  4030 raft_consensus.cc:2468] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 9.
I20260709 13:15:25.146448  6842 raft_consensus.cc:493] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:25.167912  7016 raft_consensus.cc:493] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.213086  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:25.213487  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:25.213059  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:25.264762  4105 raft_consensus.cc:2376] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 9. Re-sending same reply.
I20260709 13:15:25.132313  7083 raft_consensus.cc:515] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:25.169492  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:25.214100  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:25.147578  6826 raft_consensus.cc:2804] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:25.147258  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:25.280917  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:25.281363  4702 raft_consensus.cc:3060] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:25.281584  7006 leader_election.cc:290] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:25.282332  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:25.283006  4106 raft_consensus.cc:2468] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 8.
I20260709 13:15:25.215147  4026 raft_consensus.cc:1275] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:15:25.232388  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:25.284006  4102 raft_consensus.cc:2393] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 6: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
W20260709 13:15:25.240832  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:25.232519  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 101668us
I20260709 13:15:25.243122  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:15:25.231643  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 210785us
I20260709 13:15:25.260958  4031 raft_consensus.cc:2468] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9.
I20260709 13:15:25.223861  7005 raft_consensus.cc:2804] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:25.231060  6540 raft_consensus.cc:2749] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:25.163898  7043 raft_consensus.cc:3060] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:25.234933  6718 raft_consensus.cc:2764] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:15:25.268648  4100 raft_consensus.cc:2368] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 7. Current term is 8.
I20260709 13:15:25.233244  6917 raft_consensus.cc:493] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:25.293077  4030 raft_consensus.cc:1240] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 7. Current term is 8. Ops: []
W20260709 13:15:25.265414  4700 consensus_meta.cc:287] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938: Time spent flushing consensus metadata: real 0.527s	user 0.009s	sys 0.004s
I20260709 13:15:25.223289  6706 raft_consensus.cc:515] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:25.283456  6614 consensus_meta.cc:287] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938: Time spent flushing consensus metadata: real 0.566s	user 0.008s	sys 0.004s
I20260709 13:15:25.334611  6917 raft_consensus.cc:515] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:25.373134  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:25.373883  4099 raft_consensus.cc:3060] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:25.397413  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 369962us
I20260709 13:15:25.347474  7067 raft_consensus.cc:493] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.264547  6842 raft_consensus.cc:515] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:25.269240  7016 raft_consensus.cc:515] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:25.332337  4700 raft_consensus.cc:2468] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 8.
W20260709 13:15:25.454497  7051 consensus_meta.cc:287] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.616s	user 0.009s	sys 0.007s
I20260709 13:15:25.392799  6938 raft_consensus.cc:493] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.455020  7051 raft_consensus.cc:2749] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:25.455379  6938 raft_consensus.cc:515] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:25.426764  4104 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45332 (request call id 1771) took 2068 ms (client timeout 1933 ms). Trace:
I20260709 13:15:25.377072  6614 raft_consensus.cc:515] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:25.450008  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:25.457305  4104 rpcz_store.cc:269] 0709 13:15:23.358128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.360757 (+  2629us) service_pool.cc:224] Handling call
0709 13:15:25.426419 (+2065662us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b5400197154. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:25.426636 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2605962112}
I20260709 13:15:25.486291  7026 raft_consensus.cc:515] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:25.490199  6959 consensus_meta.cc:287] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 0.660s	user 0.013s	sys 0.000s
W20260709 13:15:25.492731  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 207003us
I20260709 13:15:25.493469  6967 leader_election.cc:290] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:25.494626  6614 leader_election.cc:290] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 election: Requested vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:25.495071  7083 leader_election.cc:290] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:25.495486  4706 raft_consensus.cc:2368] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 6. Current term is 7.
I20260709 13:15:25.496253  3997 leader_election.cc:400] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 election: Vote denied by peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843) with higher term. Message: Invalid argument: T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 7. Current term is 8.
I20260709 13:15:25.497139  3997 leader_election.cc:304] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:25.505363  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:25.507723  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 200530us
I20260709 13:15:25.516805  3925 leader_election.cc:304] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:25.508473  4100 raft_consensus.cc:2468] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 7.
I20260709 13:15:25.518165  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:25.521517  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:25.522996  4100 raft_consensus.cc:2468] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 7.
I20260709 13:15:25.523187  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:25.524320  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:25.527577  4701 raft_consensus.cc:1240] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:25.528434  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:25.529834  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:25.530875  4026 raft_consensus.cc:2410] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:15:25.534548  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:25.535470  3957 raft_consensus.cc:2468] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 8.
I20260709 13:15:25.541674  3951 raft_consensus.cc:1275] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:15:25.550607  4099 raft_consensus.cc:2468] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 8.
I20260709 13:15:25.554744  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:25.555959  3997 leader_election.cc:304] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:25.570674  3997 leader_election.cc:400] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843) with higher term. Message: Invalid argument: T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 7. Current term is 8.
I20260709 13:15:25.571938  3997 leader_election.cc:400] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 election: Vote denied by peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843) with higher term. Message: Invalid argument: T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 7. Current term is 8.
I20260709 13:15:25.573666  3997 leader_election.cc:304] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:25.525467  4100 raft_consensus.cc:2393] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 6: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:25.575449  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:25.578295  4100 raft_consensus.cc:3060] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:25.579954  4099 raft_consensus.cc:2468] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 5.
I20260709 13:15:25.565248  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:25.565824  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:25.581717  4031 raft_consensus.cc:2468] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 4.
W20260709 13:15:25.566586  3998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:25.653425  4031 raft_consensus.cc:1275] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:15:25.658468  4031 raft_consensus.cc:1275] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:15:25.675414  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:25.682550  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:25.683420  4029 raft_consensus.cc:3060] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:25.721410  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:25.723650  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:25.724598  4106 raft_consensus.cc:2468] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 7.
W20260709 13:15:25.717866  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 165429us
I20260709 13:15:25.725667  4107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45336 (request call id 1238) took 2101 ms. Trace:
I20260709 13:15:25.726383  4675 leader_election.cc:304] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:25.726610  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 153036us
W20260709 13:15:25.730093  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 173161us
I20260709 13:15:25.730953  3925 leader_election.cc:304] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:25.732204  3925 leader_election.cc:304] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:25.735661  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:25.736785  3951 raft_consensus.cc:2393] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 in current term 7: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:25.508880  6941 raft_consensus.cc:493] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:25.728731  4675 leader_election.cc:304] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:25.726203  4107 rpcz_store.cc:276] 0709 13:15:23.453862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.454012 (+   150us) service_pool.cc:224] Handling call
0709 13:15:25.555457 (+2101445us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54000e7c54. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:25.555623 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2428977408}
I20260709 13:15:25.744184  4099 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "604474f002cb41eb9125fc14353547d2"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:15:25.745497  3999 leader_election.cc:400] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: Vote denied by peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117) with higher term. Message: Invalid argument: T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 6. Current term is 7.
I20260709 13:15:25.745851  3999 leader_election.cc:403] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:15:25.738490  4030 raft_consensus.cc:1275] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:15:25.750548  4029 raft_consensus.cc:2468] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 7.
I20260709 13:15:25.753350  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:15:25.716984  6836 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.012s	sys 0.054s
I20260709 13:15:25.429869  7067 raft_consensus.cc:515] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:25.538822  6718 raft_consensus.cc:2764] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:15:25.538932  6959 raft_consensus.cc:493] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.810075  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:25.557166  6540 raft_consensus.cc:493] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:25.817600  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 73727us
I20260709 13:15:25.539062  6706 leader_election.cc:290] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:25.820205  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:25.822928  3925 leader_election.cc:304] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:25.823240  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:25.849327  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:25.865847  4100 raft_consensus.cc:2468] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 8.
I20260709 13:15:25.867112  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:25.730285  6826 raft_consensus.cc:697] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:25.874650  4099 raft_consensus.cc:606] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Received request to transfer leadership to TS 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:25.725872  7055 raft_consensus.cc:2804] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:25.868774  4107 raft_consensus.cc:1240] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:15:25.881320  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:25.885423  4073 leader_election.cc:304] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:25.747237  7006 raft_consensus.cc:2804] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:25.748448  7056 raft_consensus.cc:2804] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:25.747433  6944 raft_consensus.cc:2749] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:25.739683  7050 raft_consensus.cc:2749] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:25.884660  4672 leader_election.cc:304] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
W20260709 13:15:25.775771  7049 consensus_meta.cc:287] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.679s	user 0.011s	sys 0.002s
I20260709 13:15:25.880388  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:25.760947  6917 leader_election.cc:290] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:25.816237  7005 raft_consensus.cc:697] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:25.870177  7093 raft_consensus.cc:2804] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:25.928404  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:25.936376  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:26.008780  4105 raft_consensus.cc:3060] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:25.804189  7084 leader_election.cc:290] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:15:25.946820  4073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 61513.9us
W20260709 13:15:25.953006  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 68464.1us
I20260709 13:15:25.882944  6718 raft_consensus.cc:493] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.760126  6941 raft_consensus.cc:515] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:25.760851  6797 consensus_queue.cc:1048] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.169s
I20260709 13:15:25.901305  6541 raft_consensus.cc:493] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.040432  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:25.922996  7103 raft_consensus.cc:493] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:25.950193  7083 raft_consensus.cc:2804] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:26.082872  3951 raft_consensus.cc:2468] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 6.
I20260709 13:15:25.872923  6959 raft_consensus.cc:515] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:26.120250  6959 leader_election.cc:290] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:25.961699  6836 raft_consensus.cc:493] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.896775  7055 raft_consensus.cc:493] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.121356  7055 raft_consensus.cc:3060] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:26.121323  6836 raft_consensus.cc:515] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:26.124609  6836 leader_election.cc:290] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:26.125342  6836 raft_consensus.cc:493] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.125952  6836 raft_consensus.cc:515] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:26.129875  6836 leader_election.cc:290] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:26.131022  6836 raft_consensus.cc:2804] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:26.132742  6836 raft_consensus.cc:697] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:26.135629  6836 consensus_queue.cc:237] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:26.041465  6718 raft_consensus.cc:515] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:26.114001  6541 raft_consensus.cc:515] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:26.146629  6718 leader_election.cc:290] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:26.155958  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:26.161432  3955 raft_consensus.cc:2468] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 7.
I20260709 13:15:26.162552  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:26.157604  3950 raft_consensus.cc:1240] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:15:26.164718  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:26.165359  3950 raft_consensus.cc:3060] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:26.166241  4025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38304 (request call id 2086) took 1187 ms. Trace:
I20260709 13:15:26.149294  3959 raft_consensus.cc:1240] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:26.167905  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:26.169272  3959 raft_consensus.cc:1240] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:26.169550  3955 raft_consensus.cc:1240] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:15:26.171649  7103 raft_consensus.cc:515] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:26.172773  7095 log.cc:927] Time spent T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.933s	user 0.006s	sys 0.011s
I20260709 13:15:26.174002  7103 leader_election.cc:290] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:25.873781  6540 raft_consensus.cc:515] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:26.032822  7003 raft_consensus.cc:493] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.148516  6941 leader_election.cc:290] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:15:26.148555  7081 log.cc:927] Time spent T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 1.213s	user 0.012s	sys 0.014s
I20260709 13:15:26.148680  3958 raft_consensus.cc:1240] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:15:26.007656  7093 raft_consensus.cc:493] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.151775  3954 raft_consensus.cc:1275] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:26.166754  4025 rpcz_store.cc:276] 0709 13:15:24.979087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.979212 (+   125us) service_pool.cc:224] Handling call
0709 13:15:24.979618 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:25.393413 (+413795us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:25.393450 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:25.393512 (+    62us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:25.393548 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:26.165954 (+772406us) spinlock_profiling.cc:243] Waited 414 ms on lock 0x7b540026e8d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:26.166017 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:26.166172 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":951053696}
I20260709 13:15:26.033434  7056 raft_consensus.cc:697] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 10 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:26.214984  3922 leader_election.cc:304] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:26.231089  3950 raft_consensus.cc:2468] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 8.
I20260709 13:15:26.020130  7049 raft_consensus.cc:515] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:26.153069  3953 raft_consensus.cc:1275] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:15:26.153860  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:26.225026  6706 raft_consensus.cc:2749] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117) with higher term. Message: Invalid argument: T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 6. Current term is 7.
I20260709 13:15:26.152158  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:26.262874  3952 raft_consensus.cc:2468] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 8.
I20260709 13:15:26.151400  6541 leader_election.cc:290] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:26.261655  3999 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.023s	sys 0.083s
I20260709 13:15:26.224372  7045 raft_consensus.cc:493] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.269462  3951 raft_consensus.cc:2368] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 8. Current term is 9.
I20260709 13:15:26.304009  3956 raft_consensus.cc:2376] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d709ee666b774ec29aa732e508219938 in term 9. Re-sending same reply.
W20260709 13:15:26.273448  3999 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.023s	sys 0.083s
W20260709 13:15:26.311865  3999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 594117us
W20260709 13:15:26.312031  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 63395.8us
I20260709 13:15:26.312763  4074 leader_election.cc:304] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:26.313117  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:26.314641  4074 leader_election.cc:304] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:26.273224  4105 raft_consensus.cc:2468] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 7.
W20260709 13:15:26.274927  3997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.002s	sys 0.013s
W20260709 13:15:26.320791  3997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.002s	sys 0.014s
I20260709 13:15:26.225414  6944 raft_consensus.cc:2804] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:26.115332  7105 raft_consensus.cc:493] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:26.255164  7093 raft_consensus.cc:3060] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:26.385440  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 70879.9us
I20260709 13:15:26.254356  6938 leader_election.cc:290] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:26.264858  7080 log.cc:927] Time spent T 00000000000000000000000000000000 P af4ff34c238b4043994545a7eb56815f: Append to log took a long time: real 1.225s	user 0.008s	sys 0.011s
I20260709 13:15:26.229547  7083 raft_consensus.cc:697] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
W20260709 13:15:26.385095  3925 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.025s	sys 0.032s
W20260709 13:15:26.406459  3925 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.025s	sys 0.032s
I20260709 13:15:26.235687  7003 raft_consensus.cc:515] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:26.387112  4074 leader_election.cc:304] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938
W20260709 13:15:26.374536  4072 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.035s	sys 0.103s
I20260709 13:15:26.368048  7084 raft_consensus.cc:493] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
W20260709 13:15:26.268046  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 53204.3us
I20260709 13:15:26.272775  6768 raft_consensus.cc:2749] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:26.262408  6941 raft_consensus.cc:493] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:26.404623  3998 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.067s	sys 0.082s
W20260709 13:15:26.406867  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 588165us
W20260709 13:15:26.433130  3998 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.067s	sys 0.082s
I20260709 13:15:26.433370  4074 leader_election.cc:304] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
W20260709 13:15:26.408013  3924 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.033s	sys 0.031s
W20260709 13:15:26.434041  3924 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.033s	sys 0.031s
W20260709 13:15:26.414050  4072 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.035s	sys 0.104s
I20260709 13:15:26.393918  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:26.394760  6944 raft_consensus.cc:697] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 8 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:26.436682  4105 raft_consensus.cc:2468] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 9.
W20260709 13:15:26.416857  7009 consensus_meta.cc:287] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 1.316s	user 0.011s	sys 0.004s
I20260709 13:15:26.391237  7105 raft_consensus.cc:515] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:26.385867  6706 raft_consensus.cc:493] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.377390  7026 leader_election.cc:290] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 11 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:26.374861  7050 raft_consensus.cc:493] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.452291  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:26.423934  7049 leader_election.cc:290] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:26.421663  3922 leader_election.cc:304] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:26.379985  7016 leader_election.cc:290] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:26.248797  6718 raft_consensus.cc:493] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:26.436017  3925 leader_election.cc:304] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:26.253598  6826 consensus_queue.cc:237] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:26.447570  7111 raft_consensus.cc:2804] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:15:26.473443  7096 log.cc:927] Time spent T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 1.234s	user 0.006s	sys 0.018s
I20260709 13:15:26.443890  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:26.474836  4707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57680 (request call id 648) took 1635 ms. Trace:
I20260709 13:15:26.475019  7115 raft_consensus.cc:2749] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:26.376317  7045 raft_consensus.cc:515] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:26.475225  4707 rpcz_store.cc:276] 0709 13:15:24.838993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.839188 (+   195us) service_pool.cc:224] Handling call
0709 13:15:24.839791 (+   603us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:24.921683 (+ 81892us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:24.921723 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:24.926815 (+  5092us) log.cc:844] Serialized 26 byte log entry
0709 13:15:25.130244 (+203429us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:25.130292 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:25.130369 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:26.472780 (+1342411us) spinlock_profiling.cc:243] Waited 2.53 ms on lock 0x7b4400022b4c. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f15224a7c85 00007f15224a86a2 00007f152521a1db 00007f1525215aaf 00007f152520986e 00007f1525208bb6 00007f15252087d8 00007f1525212221 00007f15252121d9 00007f1525212169
0709 13:15:26.474447 (+  1667us) raft_consensus.cc:1685] finished
0709 13:15:26.474470 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:26.474744 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":178922,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":3637,"spinlock_wait_cycles":5808512,"thread_start_us":254702,"threads_started":2,"wal-append.queue_time_us":303327}
I20260709 13:15:26.475071  3952 raft_consensus.cc:2393] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 10: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
W20260709 13:15:26.446228  3957 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.034s	sys 0.060s
I20260709 13:15:26.408263  6842 leader_election.cc:290] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:26.447871  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:26.484177  3952 raft_consensus.cc:1240] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 7. Current term is 8. Ops: []
W20260709 13:15:26.521857  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 85909.2us
I20260709 13:15:26.454782  7103 raft_consensus.cc:2804] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:26.432627  7084 raft_consensus.cc:515] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:26.367201  6959 raft_consensus.cc:493] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:26.453503  3953 raft_consensus.cc:1217] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[3.2-8.4]   Dedup: 3.2->[6.3-8.4]
I20260709 13:15:26.314185  7005 consensus_queue.cc:237] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:26.437726  7104 raft_consensus.cc:493] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
W20260709 13:15:26.478902  3957 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.034s	sys 0.060s
I20260709 13:15:26.443451  6768 raft_consensus.cc:493] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:26.479501  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 57990.5us
W20260709 13:15:26.463696  7043 consensus_meta.cc:287] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 1.115s	user 0.010s	sys 0.003s
W20260709 13:15:26.373845  4675 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.014s	sys 0.016s
I20260709 13:15:26.440613  6941 raft_consensus.cc:515] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:26.450666  7007 raft_consensus.cc:2749] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:26.534068  3953 pending_rounds.cc:85] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059: Aborting all ops after (but not including) 2
I20260709 13:15:26.752310  3953 pending_rounds.cc:107] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:15:26.752738  3953 raft_consensus.cc:2889] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:15:26.535954  4674 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.018s	sys 0.077s
I20260709 13:15:26.481499  6718 raft_consensus.cc:515] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:26.444535  7009 raft_consensus.cc:515] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:26.618180  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:26.524096  6976 raft_consensus.cc:2804] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:26.521945  7051 raft_consensus.cc:2804] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:26.470376  7067 leader_election.cc:290] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:26.452474  7050 raft_consensus.cc:515] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:26.525080  7103 raft_consensus.cc:493] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.484671  7111 raft_consensus.cc:697] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:26.477461  7045 leader_election.cc:290] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:26.647182  4701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57680 (request call id 647) took 1830 ms. Trace:
I20260709 13:15:26.749199  7114 raft_consensus.cc:493] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.533279  6938 raft_consensus.cc:493] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.523932  7113 raft_consensus.cc:493] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:26.481212  7016 raft_consensus.cc:493] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:26.452193  7056 consensus_queue.cc:237] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:26.615309  6921 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.003s	sys 0.024s
I20260709 13:15:26.709740  3922 leader_election.cc:304] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
W20260709 13:15:26.719256  4675 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.950s	user 0.014s	sys 0.017s
I20260709 13:15:26.719236  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:15:26.753724  4674 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.839s	user 0.019s	sys 0.077s
W20260709 13:15:26.708974  7006 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.014s	sys 0.029s
I20260709 13:15:26.477434  6706 raft_consensus.cc:515] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:26.537837  6541 consensus_queue.cc:1048] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.205s
W20260709 13:15:26.782217  3998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:26.783006  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 334121us
I20260709 13:15:26.548480  6959 raft_consensus.cc:515] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:26.647976  4033 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.248s	user 0.023s	sys 0.047s
I20260709 13:15:26.625566  7055 raft_consensus.cc:515] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:26.486578  7083 consensus_queue.cc:237] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:26.784467  4701 rpcz_store.cc:276] 0709 13:15:24.817041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.817187 (+   146us) service_pool.cc:224] Handling call
0709 13:15:24.844474 (+ 27287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:25.528005 (+683531us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:26.646877 (+1118872us) spinlock_profiling.cc:243] Waited 683 ms on lock 0x7b5400680e54. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:26.647110 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1570500352}
I20260709 13:15:26.789742  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:26.625593  7104 raft_consensus.cc:515] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:26.776124  7106 raft_consensus.cc:493] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.780927  6976 raft_consensus.cc:493] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.805948  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:26.813669  4103 raft_consensus.cc:1240] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 7. Current term is 8. Ops: []
W20260709 13:15:26.810810  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 1.04184e+06us
I20260709 13:15:26.793665  7114 raft_consensus.cc:515] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:26.736790  6768 raft_consensus.cc:515] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:26.784137  7103 raft_consensus.cc:3060] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:26.820757  4074 leader_election.cc:304] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:26.822176  4033 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.422s	user 0.024s	sys 0.047s
I20260709 13:15:26.820014  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:26.841535  3951 raft_consensus.cc:2393] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 7: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
W20260709 13:15:26.827055  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 117431us
I20260709 13:15:26.843236  3922 leader_election.cc:304] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:26.749868  7043 raft_consensus.cc:515] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:26.812603  6921 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.930s	user 0.003s	sys 0.024s
W20260709 13:15:26.815699  6836 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.011s	sys 0.036s
W20260709 13:15:26.813585  7006 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.015s	sys 0.030s
I20260709 13:15:26.640792  6944 consensus_queue.cc:237] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:26.830675  3955 raft_consensus.cc:2410] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:15:26.796782  7112 raft_consensus.cc:493] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.780543  7051 raft_consensus.cc:493] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:26.846035  3951 raft_consensus.cc:1275] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:26.850713  3922 leader_election.cc:304] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:26.884934  3950 raft_consensus.cc:1275] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:15:26.872097  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 51418.5us
I20260709 13:15:26.796013  6938 raft_consensus.cc:515] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:26.829448  7045 raft_consensus.cc:2749] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:26.807686  7016 raft_consensus.cc:515] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:26.819952  7117 raft_consensus.cc:493] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
W20260709 13:15:26.877029  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:26.884121  4675 leader_election.cc:304] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
W20260709 13:15:27.063617  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 179964us
I20260709 13:15:27.065986  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:26.837644  6976 raft_consensus.cc:3060] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:26.847224  6836 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.011s	sys 0.036s
I20260709 13:15:26.809444  7113 raft_consensus.cc:515] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:26.901278  3922 leader_election.cc:304] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:27.067576  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:27.067804  7118 raft_consensus.cc:2804] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:15:27.068130  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 166928us
I20260709 13:15:27.068445  7118 raft_consensus.cc:697] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 7 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:27.069221  7113 leader_election.cc:290] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:27.069804  7113 raft_consensus.cc:493] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.069445  7118 consensus_queue.cc:237] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:27.070502  7137 raft_consensus.cc:2804] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:27.070369  7113 raft_consensus.cc:515] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:27.071202  7137 raft_consensus.cc:697] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:27.073001  7113 leader_election.cc:290] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:27.072448  7137 consensus_queue.cc:237] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:27.073429  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:15:26.938381  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 51786us
I20260709 13:15:27.076330  6759 consensus_queue.cc:1048] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:27.076802  6836 consensus_queue.cc:1059] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:27.077926  6836 raft_consensus.cc:3055] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:27.078352  6836 raft_consensus.cc:740] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:27.034330  6706 leader_election.cc:290] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:26.887230  7121 raft_consensus.cc:2804] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:27.079452  6836 consensus_queue.cc:260] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:27.080318  7121 raft_consensus.cc:493] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:27.080941  7121 raft_consensus.cc:3060] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:27.081068  6836 raft_consensus.cc:3060] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:27.003011  7009 leader_election.cc:290] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:26.888173  6614 consensus_queue.cc:1048] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 13:15:27.000849  7043 leader_election.cc:290] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:27.002396  7016 leader_election.cc:290] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:27.005810  6941 leader_election.cc:290] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:26.960036  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:26.999476  6938 leader_election.cc:290] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:27.035178  6768 leader_election.cc:290] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:26.973366  7125 raft_consensus.cc:493] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.085844  7125 raft_consensus.cc:515] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:26.936121  7112 raft_consensus.cc:515] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:27.090261  7112 leader_election.cc:290] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:26.980859  3924 leader_election.cc:304] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:27.091373  6768 raft_consensus.cc:2749] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:15:27.091590  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 110839us
I20260709 13:15:27.092536  3924 leader_election.cc:304] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:27.093454  6768 raft_consensus.cc:2749] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:27.094182  6768 consensus_queue.cc:1059] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:27.003960  7129 raft_consensus.cc:493] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:26.998168  7055 leader_election.cc:290] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:27.095067  7129 raft_consensus.cc:515] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:27.098264  7129 leader_election.cc:290] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:27.100080  6921 raft_consensus.cc:3055] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:27.100600  6921 raft_consensus.cc:740] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:27.101634  6921 consensus_queue.cc:260] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:27.104142  4703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:15:27.104969  3905 auto_rebalancer.cc:629] Failed to schedule move for tablet f59fe7d824ba4030a574c8f7172dab57: Illegal state: Replica f1c75790cedf4f52a3463a255c7da059 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:26.981730  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:26.871766  7124 consensus_queue.cc:1048] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.127s
I20260709 13:15:27.109191  4707 raft_consensus.cc:1240] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:26.973860  7084 leader_election.cc:290] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:27.040524  7050 leader_election.cc:290] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:27.031384  7126 log.cc:927] Time spent T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:15:27.033432  7104 leader_election.cc:290] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:27.007164  6718 leader_election.cc:290] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:26.967031  6540 leader_election.cc:290] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:26.828585  7111 consensus_queue.cc:237] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:27.111500  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:27.107420  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:27.112566  7125 leader_election.cc:290] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:27.103317  6921 raft_consensus.cc:3060] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:27.112897  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:27.113859  7104 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
W20260709 13:15:26.995527  7122 log.cc:927] Time spent T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:15:27.114450  7104 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:26.841275  7106 raft_consensus.cc:515] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:26.852262  7006 raft_consensus.cc:697] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 7 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:27.116083  4709 raft_consensus.cc:1275] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:15:27.116474  7006 consensus_queue.cc:237] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:27.117038  7104 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:27.117338  7106 leader_election.cc:290] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:27.117512  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:27.118124  3957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35354 (request call id 343) took 1581 ms. Trace:
I20260709 13:15:26.888028  7051 raft_consensus.cc:3060] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:27.118957  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:27.120458  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:27.118481  3957 rpcz_store.cc:276] 0709 13:15:25.536761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.555699 (+ 18938us) service_pool.cc:224] Handling call
0709 13:15:25.556076 (+   377us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:25.556467 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:25.556499 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:25.744582 (+188083us) log.cc:844] Serialized 52 byte log entry
0709 13:15:26.666195 (+921613us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:26.666282 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:26.666398 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:27.117869 (+451471us) raft_consensus.cc:1685] finished
0709 13:15:27.117894 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:27.118030 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60566,"raft.queue_time_us":186,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":22493,"thread_start_us":780037,"threads_started":1,"wal-append.queue_time_us":1003550}
I20260709 13:15:26.962143  7117 raft_consensus.cc:515] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:27.121867  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:27.123755  7117 leader_election.cc:290] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:27.069658  3922 leader_election.cc:304] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
W20260709 13:15:26.997970  4702 consensus_meta.cc:287] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938: Time spent flushing consensus metadata: real 1.716s	user 0.011s	sys 0.004s
I20260709 13:15:27.124176  6540 raft_consensus.cc:493] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.124508  4702 raft_consensus.cc:2468] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9.
I20260709 13:15:27.107939  4703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:15:27.124842  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 55287.7us
I20260709 13:15:27.124855  6540 raft_consensus.cc:515] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:27.125964  4707 raft_consensus.cc:1240] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 8. Current term is 9. Ops: []
W20260709 13:15:27.125130  4702 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57680 (request call id 652) took 2125 ms (client timeout 2144 ms). Trace:
W20260709 13:15:27.126889  4702 rpcz_store.cc:269] 0709 13:15:24.999863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.075127 (+ 75264us) service_pool.cc:224] Handling call
0709 13:15:27.125043 (+2049916us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.127786  6540 leader_election.cc:290] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:27.127838  7125 raft_consensus.cc:2804] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:27.129235  7125 raft_consensus.cc:697] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 8 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:27.130499  7125 consensus_queue.cc:237] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:27.131891  7117 consensus_queue.cc:1059] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:27.132949  6718 raft_consensus.cc:3055] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:27.133301  6718 raft_consensus.cc:740] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:27.134119  6718 consensus_queue.cc:260] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:27.134702  6540 raft_consensus.cc:493] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:27.135154  6718 raft_consensus.cc:3060] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:27.135315  6540 raft_consensus.cc:515] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:27.137562  6540 leader_election.cc:290] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:15:27.140890  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 354968us
I20260709 13:15:27.143478  4100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45332 (request call id 1789) took 2296 ms. Trace:
I20260709 13:15:27.144004  4100 rpcz_store.cc:276] 0709 13:15:24.847612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.886805 (+1039193us) service_pool.cc:224] Handling call
0709 13:15:25.887296 (+   491us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:25.928844 (+ 41548us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:25.928894 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:25.946545 (+ 17651us) log.cc:844] Serialized 26 byte log entry
0709 13:15:26.672270 (+725725us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:27.056847 (+384577us) log.cc:844] Serialized 14 byte log entry
0709 13:15:27.142913 (+ 86066us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:27.143162 (+   249us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:27.143217 (+    55us) raft_consensus.cc:1685] finished
0709 13:15:27.143235 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:27.143402 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40927,"raft.queue_time_us":242925,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":119,"thread_start_us":794002,"threads_started":2,"wal-append.queue_time_us":918989}
I20260709 13:15:27.146723  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:27.153968  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:27.157181  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:27.164525  4100 raft_consensus.cc:1240] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 7. Current term is 8. Ops: [6.5-7.6]
I20260709 13:15:27.169677  4100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45336 (request call id 1256) took 2076 ms. Trace:
I20260709 13:15:27.171284  4100 rpcz_store.cc:276] 0709 13:15:25.093536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.160123 (+2066587us) service_pool.cc:224] Handling call
0709 13:15:27.162499 (+  2376us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:27.168100 (+  5601us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:27.169415 (+  1315us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.177870  4100 raft_consensus.cc:1240] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 8. Current term is 9. Ops: [5.4-8.6]
I20260709 13:15:27.180620  4100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45336 (request call id 1257) took 2086 ms. Trace:
I20260709 13:15:27.182245  4100 rpcz_store.cc:276] 0709 13:15:25.093810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.174836 (+2081026us) service_pool.cc:224] Handling call
0709 13:15:27.176662 (+  1826us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:15:27.179432 (+  2770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:27.180371 (+   939us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.193550  4100 raft_consensus.cc:1240] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:27.195361  4100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45336 (request call id 1260) took 2100 ms. Trace:
I20260709 13:15:27.196882  4100 rpcz_store.cc:276] 0709 13:15:25.094582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.185424 (+2090842us) service_pool.cc:224] Handling call
0709 13:15:27.193246 (+  7822us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:27.194951 (+  1705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:27.195282 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.054188  7120 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:27.208943  4025 raft_consensus.cc:1275] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:27.211668  4025 raft_consensus.cc:1275] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:15:27.213444  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:27.214293  4025 raft_consensus.cc:2468] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 6.
I20260709 13:15:27.216391  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:27.217192  4025 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 9.
I20260709 13:15:27.218698  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:27.219486  4025 raft_consensus.cc:2468] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 4.
I20260709 13:15:27.221112  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:27.221894  4025 raft_consensus.cc:2410] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:15:27.222785  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:27.223693  4029 raft_consensus.cc:2468] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 3.
I20260709 13:15:27.225268  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:27.234475  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:27.203267  4100 raft_consensus.cc:1240] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 5. Current term is 6. Ops: []
W20260709 13:15:27.203691  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 58299.7us
I20260709 13:15:27.200932  6916 raft_consensus.cc:2749] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:27.241513  4027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38304 (request call id 2083) took 2924 ms. Trace:
I20260709 13:15:27.242048  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:15:27.239367  3997 leader_election.cc:336] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.636s (SENT)
I20260709 13:15:27.205570  6932 raft_consensus.cc:2749] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:27.232173  6959 leader_election.cc:290] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:27.243485  4031 raft_consensus.cc:2468] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 7.
I20260709 13:15:27.231464  7104 raft_consensus.cc:493] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.243557  3997 leader_election.cc:304] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:27.240208  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
W20260709 13:15:27.234602  7127 log.cc:927] Time spent T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:15:27.246773  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:27.243073  4027 rpcz_store.cc:276] 0709 13:15:24.317487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.343951 (+ 26464us) service_pool.cc:224] Handling call
0709 13:15:24.419056 (+ 75105us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:24.419276 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:15:24.419651 (+   375us) log.cc:844] Serialized 14 byte log entry
0709 13:15:26.760602 (+2340951us) spinlock_profiling.cc:243] Waited 6.09 ms on lock 0x7b18003ec140. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f1522563e07 00007f152b3beab9 00007f152258069b 00007f152257e93f 00007f1522580c02 00007f152520820b 00007f152520dd23 00007f152520e23a 00007f1525678a2a
0709 13:15:27.241129 (+480527us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:27.241187 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:27.241233 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:27.241303 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:27.241410 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":118,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":29428,"raft.queue_time_us":15633,"raft.run_cpu_time_us":57,"raft.run_wall_time_us":57,"spinlock_wait_cycles":14017920,"thread_start_us":480185,"threads_started":2,"wal-append.queue_time_us":2814782}
I20260709 13:15:27.252465  4031 raft_consensus.cc:3055] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:27.254027  4032 raft_consensus.cc:2468] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 7.
I20260709 13:15:27.254271  4031 raft_consensus.cc:740] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:27.134687  6976 raft_consensus.cc:515] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:27.253675  4030 raft_consensus.cc:3060] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:27.255645  3997 leader_election.cc:336] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.686s (SENT)
I20260709 13:15:27.265379  3997 leader_election.cc:304] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:27.241349  4100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45336 (request call id 1261) took 2146 ms. Trace:
I20260709 13:15:27.255105  4031 consensus_queue.cc:260] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:27.204525  7050 consensus_queue.cc:1048] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:15:27.272050  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:27.272921  4034 raft_consensus.cc:2468] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 10.
I20260709 13:15:27.238582  7137 raft_consensus.cc:493] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.269673  4031 raft_consensus.cc:3060] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:27.268719  4100 rpcz_store.cc:276] 0709 13:15:25.094878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.202635 (+2107757us) service_pool.cc:224] Handling call
0709 13:15:27.203072 (+   437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:27.240708 (+ 37636us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:27.241222 (+   514us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.286666  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:27.287038  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:27.256712  4074 leader_election.cc:304] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:27.289331  3952 raft_consensus.cc:1240] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:27.286230  4030 raft_consensus.cc:2468] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 8.
I20260709 13:15:27.290514  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:27.290609  4074 leader_election.cc:304] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:15:27.295146  4027 raft_consensus.cc:1275] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:15:27.286693  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:27.296365  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:27.280323  3997 leader_election.cc:304] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:27.288137  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:27.296860  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:27.297866  3951 raft_consensus.cc:2468] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 8.
I20260709 13:15:27.298285  4100 raft_consensus.cc:2468] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9.
I20260709 13:15:27.228735  7120 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:27.258376  7117 raft_consensus.cc:2749] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 LEADER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:27.301390  3955 raft_consensus.cc:2393] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 5: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:27.252269  7056 raft_consensus.cc:493] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:27.295899  7083 raft_consensus.cc:493] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.252022  7131 raft_consensus.cc:493] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:27.308149  3997 leader_election.cc:304] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:27.298731  7043 raft_consensus.cc:2804] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:27.315459  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:27.316577  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:27.332518  4028 raft_consensus.cc:2393] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 8: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:27.290665  6938 raft_consensus.cc:2804] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:27.302227  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:27.321525  4074 leader_election.cc:304] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:15:27.338277  3954 raft_consensus.cc:2468] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 7.
I20260709 13:15:27.259279  7106 consensus_queue.cc:1048] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:15:27.298733  4031 raft_consensus.cc:1275] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:15:27.340090  4031 pending_rounds.cc:85] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2: Aborting all ops after (but not including) 4
I20260709 13:15:27.269194  7104 raft_consensus.cc:515] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:27.340358  4031 pending_rounds.cc:107] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:15:27.340662  4031 raft_consensus.cc:2889] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:27.328908  3997 leader_election.cc:304] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:27.287657  7084 consensus_queue.cc:1048] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:15:27.339444  4074 leader_election.cc:304] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:27.344220  3997 leader_election.cc:304] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:27.258291  7051 raft_consensus.cc:515] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:27.318609  6522 raft_consensus.cc:2749] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:27.326095  6836 raft_consensus.cc:2804] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:27.317930  7145 raft_consensus.cc:493] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:27.350822  7111 raft_consensus.cc:2804] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:27.321990  6959 raft_consensus.cc:2804] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:27.358323  3997 leader_election.cc:304] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:27.358569  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:27.358465  7084 consensus_queue.cc:1243] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer 6f5b5e4ed72944ecbda200012d141dc2 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:15:27.397420  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 77936.2us
I20260709 13:15:27.337885  6938 raft_consensus.cc:493] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:27.363907  7064 consensus_queue.cc:1048] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:27.364357  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:27.368429  7130 raft_consensus.cc:2804] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:27.379645  6706 raft_consensus.cc:2804] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:27.348452  7117 raft_consensus.cc:2804] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:27.365670  3922 leader_election.cc:304] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:27.296072  7137 raft_consensus.cc:515] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:27.379465  4033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38290 (request call id 1881) took 2318 ms. Trace:
I20260709 13:15:27.541923  7104 leader_election.cc:290] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:27.540680  4033 rpcz_store.cc:276] 0709 13:15:25.060651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.213874 (+153223us) service_pool.cc:224] Handling call
0709 13:15:25.214301 (+   427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:25.214752 (+   451us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:15:25.351147 (+136395us) log.cc:844] Serialized 14 byte log entry
0709 13:15:27.187672 (+1836525us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:27.203013 (+ 15341us) log.cc:844] Serialized 26 byte log entry
0709 13:15:27.203306 (+   293us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:27.203397 (+    91us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:27.203494 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:27.379161 (+175667us) raft_consensus.cc:1685] finished
0709 13:15:27.379194 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:27.379386 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":276855,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":231968,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":13807,"spinlock_wait_cycles":1656576,"thread_start_us":1904241,"threads_started":3,"wal-append.queue_time_us":1447232}
W20260709 13:15:27.363365  7093 consensus_meta.cc:287] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938: Time spent flushing consensus metadata: real 0.958s	user 0.011s	sys 0.001s
I20260709 13:15:27.543924  7093 raft_consensus.cc:515] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:27.545567  4709 raft_consensus.cc:2368] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 8. Current term is 9.
I20260709 13:15:27.546857  7093 leader_election.cc:290] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:27.331020  7043 raft_consensus.cc:493] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:27.548292  7043 raft_consensus.cc:3060] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:27.549057  6718 consensus_queue.cc:1059] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:15:27.395779  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:27.359364  4031 raft_consensus.cc:1275] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:15:27.552697  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:27.552827  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:27.554081  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:27.554785  4031 raft_consensus.cc:3060] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:15:27.398218  3957 raft_consensus.cc:1240] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:27.361212  4099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:34352 (request call id 29) took 2125 ms. Trace:
I20260709 13:15:27.367102  4074 leader_election.cc:304] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:15:27.556152  4099 rpcz_store.cc:276] 0709 13:15:25.236064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.580931 (+344867us) service_pool.cc:224] Handling call
0709 13:15:27.361039 (+1780108us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b5400200154. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f1525668853 00007f152a63660a 00007f1523bbc7d4 00007f1523bbc762 00007f1523bbc691 00007f1523bbc60c 00007f1523bbb8c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:27.361129 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":298303744}
W20260709 13:15:27.557014  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 189981us
I20260709 13:15:27.558039  4074 leader_election.cc:304] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:27.383241  6836 raft_consensus.cc:493] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
W20260709 13:15:27.437016  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:27.398157  7145 raft_consensus.cc:515] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:27.407517  7130 raft_consensus.cc:493] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:27.392575  7114 leader_election.cc:290] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:27.442302  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:27.444697  7144 consensus_queue.cc:1059] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.077s
W20260709 13:15:27.497556  7138 log.cc:927] Time spent T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.250s	user 0.000s	sys 0.001s
I20260709 13:15:27.539366  7137 leader_election.cc:290] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:27.405570  7129 consensus_queue.cc:1059] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:15:27.441471  7121 raft_consensus.cc:515] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:27.577724  6836 raft_consensus.cc:3060] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:27.410049  6706 raft_consensus.cc:493] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:27.409945  7117 raft_consensus.cc:493] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
W20260709 13:15:27.531555  7156 log.cc:927] Time spent T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.082s	user 0.002s	sys 0.000s
I20260709 13:15:27.344733  7131 raft_consensus.cc:515] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:27.405772  6938 raft_consensus.cc:3060] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:27.485736  4103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45336 (request call id 1243) took 4030 ms. Trace:
I20260709 13:15:27.691848  4103 rpcz_store.cc:276] 0709 13:15:23.455477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.455642 (+   165us) service_pool.cc:224] Handling call
0709 13:15:25.427875 (+1972233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:26.837381 (+1409506us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:27.484758 (+647377us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b5400197154. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:27.485416 (+   658us) spinlock_profiling.cc:243] Waited 1.94 s on lock 0x7b5400197150. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566d8ad 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:27.485619 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7655472896}
I20260709 13:15:27.394474  6959 raft_consensus.cc:493] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:27.330746  7056 raft_consensus.cc:515] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:27.400327  7050 raft_consensus.cc:2804] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:27.529413  6976 leader_election.cc:290] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:27.392150  7111 raft_consensus.cc:493] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:27.398002  7123 log.cc:927] Time spent T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.394s	user 0.001s	sys 0.001s
I20260709 13:15:27.443425  7051 leader_election.cc:290] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:27.339497  7083 raft_consensus.cc:515] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:27.551352  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:27.559190  4074 leader_election.cc:304] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
W20260709 13:15:27.718689  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 159588us
I20260709 13:15:27.560395  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:27.579851  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:27.579727  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:27.580667  4703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:27.722692  4703 raft_consensus.cc:2393] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 9: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
W20260709 13:15:27.564760  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 199182us
I20260709 13:15:27.590553  3999 leader_election.cc:400] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Vote denied by peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117) with higher term. Message: Invalid argument: T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 8. Current term is 9.
W20260709 13:15:27.591158  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 58221.5us
I20260709 13:15:27.590747  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:27.723572  3999 leader_election.cc:403] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:27.404387  7113 consensus_queue.cc:1059] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:15:27.590708  4701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:27.725119  4701 raft_consensus.cc:2468] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 7.
W20260709 13:15:27.610320  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:27.623862  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:27.726747  4104 raft_consensus.cc:3060] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:27.727945  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:27.727977  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:27.728929  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:27.729537  3951 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 9.
I20260709 13:15:27.730105  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:27.598991  4031 raft_consensus.cc:2468] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9.
I20260709 13:15:27.730561  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:27.730695  4032 raft_consensus.cc:2468] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7.
I20260709 13:15:27.720717  4033 raft_consensus.cc:2468] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
I20260709 13:15:27.627417  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:27.581881  7068 raft_consensus.cc:2804] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:15:27.530592  3924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:27.733829  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:27.734587  3954 raft_consensus.cc:2368] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 8. Current term is 9.
I20260709 13:15:27.577466  7006 raft_consensus.cc:2749] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:27.589748  7106 raft_consensus.cc:2804] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:15:27.596220  7146 log.cc:927] Time spent T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:15:27.669696  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:27.670889  3956 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35354 (request call id 345) took 1950 ms (client timeout 1767 ms). Trace:
I20260709 13:15:27.588474  7130 raft_consensus.cc:3060] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:27.624300  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:27.693621  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:27.591311  6921 consensus_queue.cc:1048] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.095s
I20260709 13:15:27.630404  7144 raft_consensus.cc:493] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.668115  6706 raft_consensus.cc:3060] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:27.665103  6923 raft_consensus.cc:493] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:27.686686  7117 raft_consensus.cc:3060] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:27.714146  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:27.715058  3958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1963) took 1273 ms. Trace:
W20260709 13:15:27.715356  3998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:27.699397  6959 raft_consensus.cc:3060] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:27.695271  7129 raft_consensus.cc:3055] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:27.732684  3922 leader_election.cc:304] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:27.732823  4101 raft_consensus.cc:2468] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
I20260709 13:15:27.700603  7050 raft_consensus.cc:493] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:27.731127  3951 raft_consensus.cc:2468] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 6.
I20260709 13:15:27.731684  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:27.735939  4703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:28.050628  4703 raft_consensus.cc:2376] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9. Re-sending same reply.
W20260709 13:15:28.053198  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 320596us
I20260709 13:15:28.053306  7049 raft_consensus.cc:2804] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:28.053881  7049 raft_consensus.cc:493] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:28.054265  7049 raft_consensus.cc:3060] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:28.055812  4029 raft_consensus.cc:2468] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 8.
W20260709 13:15:28.056797  3956 rpcz_store.cc:269] 0709 13:15:25.720797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.720983 (+   186us) service_pool.cc:224] Handling call
0709 13:15:27.670607 (+1949624us) spinlock_profiling.cc:243] Waited 582 ms on lock 0x7b54003ff554. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:27.670787 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1337463040}
I20260709 13:15:28.047556  4672 leader_election.cc:304] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:27.758049  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:15:28.042531  4108 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45336 (request call id 1258) took 2948 ms (client timeout 1611 ms). Trace:
I20260709 13:15:27.976402  3950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1961) took 1535 ms. Trace:
I20260709 13:15:28.076848  3924 leader_election.cc:304] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:28.077181  3950 rpcz_store.cc:276] 0709 13:15:26.441329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.444475 (+  3146us) service_pool.cc:224] Handling call
0709 13:15:26.444809 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:26.885444 (+440635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:27.976067 (+1090623us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b54000befd4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:27.976323 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1011333376}
I20260709 13:15:27.736361  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:15:28.076705  4108 rpcz_store.cc:269] 0709 13:15:25.094061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.187232 (+ 93171us) service_pool.cc:224] Handling call
0709 13:15:28.042214 (+2854982us) spinlock_profiling.cc:243] Waited 2.31 s on lock 0x7b540025a3d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:28.042432 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5321323904}
I20260709 13:15:27.753584  4104 raft_consensus.cc:2468] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7.
I20260709 13:15:28.080534  4103 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9.
I20260709 13:15:28.079484  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:28.068298  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:15:27.806507  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 86204.1us
I20260709 13:15:27.705492  7111 raft_consensus.cc:3060] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:28.082479  3950 raft_consensus.cc:2368] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 8. Current term is 9.
W20260709 13:15:27.810829  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:28.077099  3958 rpcz_store.cc:276] 0709 13:15:26.441940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.442089 (+   149us) service_pool.cc:224] Handling call
0709 13:15:26.442445 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:26.456627 (+ 14182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:26.456674 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:26.469421 (+ 12747us) log.cc:844] Serialized 26 byte log entry
0709 13:15:26.888693 (+419272us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:26.888735 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:26.888814 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:27.705954 (+817140us) raft_consensus.cc:1685] finished
0709 13:15:27.705974 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:27.714970 (+  8996us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57812,"raft.queue_time_us":22332,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":4976,"thread_start_us":351946,"threads_started":1,"wal-append.queue_time_us":619049}
I20260709 13:15:28.120653  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:28.121361  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:28.121721  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:28.122424  3950 raft_consensus.cc:2468] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 7.
I20260709 13:15:28.122573  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:28.123108  4703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:28.123495  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:28.124013  4033 raft_consensus.cc:1275] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:15:28.124673  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:28.124571  3950 raft_consensus.cc:2410] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:15:28.059080  7129 raft_consensus.cc:740] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:28.126307  4705 raft_consensus.cc:1275] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:28.126552  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:28.126482  7129 consensus_queue.cc:260] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:28.127669  7121 leader_election.cc:290] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:28.127846  7129 raft_consensus.cc:3060] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:28.120211  7137 consensus_queue.cc:1059] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:15:28.132534  6836 raft_consensus.cc:515] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:28.133391  7049 raft_consensus.cc:515] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:28.135000  6836 leader_election.cc:290] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:28.136842  4102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45332 (request call id 1790) took 3288 ms. Trace:
W20260709 13:15:27.900575  3999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 321033us
I20260709 13:15:28.121659  4100 raft_consensus.cc:2410] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 13:15:28.093326  4672 connection.cc:256] RPC call timeout handler was delayed by -1.4282536879998133s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23820000000000002s for a response
W20260709 13:15:28.140170  4672 connection.cc:256] RPC call timeout handler was delayed by -1.3909807509999155s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2157s for a response
I20260709 13:15:28.140682  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:28.125232  4033 raft_consensus.cc:1240] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:28.143285  4100 raft_consensus.cc:2468] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 9.
W20260709 13:15:28.125165  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 48416.3us
I20260709 13:15:28.145144  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
W20260709 13:15:28.141041  4672 connection.cc:256] RPC call timeout handler was delayed by -1.0970851249999214s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1867s for a response
W20260709 13:15:28.146155  4672 connection.cc:256] RPC call timeout handler was delayed by -1.021162147999803s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1767s for a response
W20260709 13:15:27.950971  7103 consensus_meta.cc:287] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 1.066s	user 0.013s	sys 0.001s
W20260709 13:15:27.974974  7140 log.cc:927] Time spent T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.703s	user 0.000s	sys 0.003s
W20260709 13:15:28.042208  7141 log.cc:927] Time spent T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.446s	user 0.001s	sys 0.006s
I20260709 13:15:28.162474  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:27.960623  7167 log.cc:927] Time spent T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:15:28.082798  3954 raft_consensus.cc:2468] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 7.
W20260709 13:15:27.802155  7159 log.cc:927] Time spent T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 13:15:27.973992  7162 log.cc:927] Time spent T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
W20260709 13:15:27.978283  7168 log.cc:927] Time spent T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 13:15:27.807525  7163 log.cc:927] Time spent T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:15:27.774629  7152 raft_consensus.cc:2804] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:28.055037  7045 raft_consensus.cc:493] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.175019  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:28.178869  7045 raft_consensus.cc:515] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:28.181079  3953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1960) took 1740 ms. Trace:
I20260709 13:15:28.166450  7121 raft_consensus.cc:3055] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:27.944940  7001 raft_consensus.cc:493] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.115815  7050 raft_consensus.cc:3060] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:27.734193  7104 raft_consensus.cc:2804] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:28.137292  4102 rpcz_store.cc:276] 0709 13:15:24.857246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.083174 (+1225928us) service_pool.cc:224] Handling call
0709 13:15:26.083757 (+   583us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:26.728060 (+644303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:26.728112 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:26.759475 (+ 31363us) log.cc:844] Serialized 52 byte log entry
0709 13:15:27.230950 (+471475us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:27.294135 (+ 63185us) log.cc:844] Serialized 14 byte log entry
0709 13:15:27.294658 (+   523us) log.cc:844] Serialized 14 byte log entry
0709 13:15:27.312581 (+ 17923us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.048386 (+735805us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b54002b7354. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:28.048459 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:28.136590 (+ 88131us) raft_consensus.cc:1685] finished
0709 13:15:28.136617 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:28.136775 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28746,"prepare.queue_time_us":154637,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":78,"raft.queue_time_us":84904,"raft.run_cpu_time_us":414,"raft.run_wall_time_us":10905,"spinlock_wait_cycles":764731264,"thread_start_us":792056,"threads_started":3,"wal-append.queue_time_us":748304}
I20260709 13:15:28.084517  7112 raft_consensus.cc:2749] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117) with higher term. Message: Invalid argument: T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 8. Current term is 9.
I20260709 13:15:28.070411  7125 raft_consensus.cc:493] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:27.899740  7172 raft_consensus.cc:3055] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:28.196419  7104 raft_consensus.cc:697] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:28.186493  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:28.197609  7104 consensus_queue.cc:237] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:28.200909  7173 raft_consensus.cc:493] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.201426  7173 raft_consensus.cc:515] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:28.204399  7125 raft_consensus.cc:515] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:28.204905  4026 raft_consensus.cc:3055] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:28.205278  4026 raft_consensus.cc:740] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:28.206017  4026 consensus_queue.cc:260] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:28.206700  7125 leader_election.cc:290] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:28.207273  7172 raft_consensus.cc:740] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:28.207207  4026 raft_consensus.cc:3060] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:28.195286  7001 raft_consensus.cc:515] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:28.208348  7172 consensus_queue.cc:260] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:28.209376  7172 raft_consensus.cc:3060] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:28.166540  7103 raft_consensus.cc:515] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:28.213987  7103 leader_election.cc:290] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:28.215641  7083 leader_election.cc:290] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:27.738235  7068 raft_consensus.cc:493] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:28.165982  7055 consensus_queue.cc:1048] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:15:28.033991  6925 raft_consensus.cc:493] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:28.084343  6967 raft_consensus.cc:2749] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:28.046830  7145 leader_election.cc:290] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:28.170046  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:28.041162  7131 leader_election.cc:290] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:27.974850  7056 leader_election.cc:290] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:28.135428  7049 leader_election.cc:290] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:28.194828  7175 raft_consensus.cc:493] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.232832  4028 raft_consensus.cc:1275] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:15:28.174193  3924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:28.234182  4026 raft_consensus.cc:1275] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:15:28.234648  4026 pending_rounds.cc:85] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2: Aborting all ops after (but not including) 5
I20260709 13:15:28.234913  4026 pending_rounds.cc:107] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:15:28.079159  7106 raft_consensus.cc:493] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:28.152172  6976 raft_consensus.cc:2804] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:27.738340  7084 consensus_queue.cc:1048] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.441s
I20260709 13:15:28.256187  7175 raft_consensus.cc:515] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:28.231279  6925 raft_consensus.cc:515] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:28.261601  7134 log.cc:927] Time spent T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.966s	user 0.000s	sys 0.003s
I20260709 13:15:28.262295  6925 leader_election.cc:290] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:28.263253  3959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 1965) took 1820 ms. Trace:
I20260709 13:15:28.181190  7045 leader_election.cc:290] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:27.733918  7003 leader_election.cc:290] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:28.181628  3953 rpcz_store.cc:276] 0709 13:15:26.441032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.452794 (+ 11762us) service_pool.cc:224] Handling call
0709 13:15:26.453243 (+   449us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:15:26.782764 (+329521us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:15:27.140130 (+357366us) log.cc:844] Serialized 14 byte log entry
0709 13:15:27.308139 (+168009us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:27.309206 (+  1067us) log.cc:844] Serialized 52 byte log entry
0709 13:15:27.309389 (+   183us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:27.309629 (+   240us) log.cc:844] Serialized 14 byte log entry
0709 13:15:27.311781 (+  2152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:27.311907 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:27.481553 (+169646us) spinlock_profiling.cc:243] Waited 3.79 ms on lock 0x7b48002dc6d8. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152a597aa1 00007f152a58eb37 00007f152a58e9ca 00007f152a68626f 00007f152a685f37 00007f152a69a55c 00007f152a69a508 00007f152a69a488 00007f152a69a443 00007f152a6996ec 00007f15295c3a96
0709 13:15:28.033997 (+552444us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b1800282e80. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f1522581522 00007f15225837c1 00007f1522583779 00007f1522583709 00007f15225836d1 00007f15225829cd 000000000038f354 000000000038f199 00007f152256483a
0709 13:15:28.180862 (+146865us) raft_consensus.cc:1685] finished
0709 13:15:28.180887 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:28.181015 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79683,"prepare.queue_time_us":628525,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":38294,"raft.run_cpu_time_us":1243,"raft.run_wall_time_us":191449,"spinlock_wait_cycles":39653376,"thread_start_us":401673,"threads_started":2,"wal-append.queue_time_us":392465}
I20260709 13:15:28.166021  4100 raft_consensus.cc:2393] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 6: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:28.120131  7144 raft_consensus.cc:515] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:28.139181  6923 raft_consensus.cc:515] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:28.211200  7001 leader_election.cc:290] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:27.729436  7120 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:28.185823  7121 raft_consensus.cc:740] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:28.263058  6925 consensus_queue.cc:1048] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:15:28.235205  4026 raft_consensus.cc:2889] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:28.224896  7068 raft_consensus.cc:3060] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:28.244972  4704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:28.241459  6967 raft_consensus.cc:493] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.264376  4027 raft_consensus.cc:1275] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:15:28.265074  4105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45332 (request call id 1791) took 3318 ms. Trace:
I20260709 13:15:28.320873  4105 rpcz_store.cc:276] 0709 13:15:24.946881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.536715 (+1589834us) service_pool.cc:224] Handling call
0709 13:15:26.642445 (+105730us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:26.642831 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:26.642889 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:26.645071 (+  2182us) log.cc:844] Serialized 26 byte log entry
0709 13:15:26.989336 (+344265us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:27.215274 (+225938us) log.cc:844] Serialized 14 byte log entry
0709 13:15:27.216562 (+  1288us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:27.217022 (+   460us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:27.479523 (+262501us) spinlock_profiling.cc:243] Waited 9.27 ms on lock 0x7b1800415d20. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f152254f2a6 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f15224a7c85 00007f15224a86a2 00007f152521a1db
0709 13:15:27.565723 (+ 86200us) spinlock_profiling.cc:243] Waited 4.77 ms on lock 0x7b4400022b4c. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f15224a7c85 00007f15224a86a2 00007f152521a1db 00007f1525215aaf 00007f152520986e 00007f1525208bb6 00007f15252087d8 00007f1525212221 00007f15252121d9 00007f1525212169
0709 13:15:28.264776 (+699053us) raft_consensus.cc:1685] finished
0709 13:15:28.264806 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:28.264993 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8775,"prepare.queue_time_us":336278,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":66893,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":31814,"spinlock_wait_cycles":32295936,"thread_start_us":364414,"threads_started":2,"wal-append.queue_time_us":467710}
W20260709 13:15:28.265619  7043 consensus_meta.cc:287] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.717s	user 0.013s	sys 0.000s
I20260709 13:15:28.259316  7175 leader_election.cc:290] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:28.263680  3959 rpcz_store.cc:276] 0709 13:15:26.442492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.445131 (+  2639us) service_pool.cc:224] Handling call
0709 13:15:26.445481 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:26.448811 (+  3330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:26.448859 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:26.457418 (+  8559us) log.cc:844] Serialized 26 byte log entry
0709 13:15:26.973086 (+515668us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:26.973148 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:26.973249 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:28.260814 (+1287565us) spinlock_profiling.cc:243] Waited 3.57 ms on lock 0x7b4400022b4c. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f15224a7c85 00007f15224a86a2 00007f152521a1db 00007f1525215aaf 00007f152520986e 00007f1525208bb6 00007f15252087d8 00007f1525212221 00007f15252121d9 00007f1525212169
0709 13:15:28.262886 (+  2072us) raft_consensus.cc:1685] finished
0709 13:15:28.262910 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:28.263178 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12204,"raft.queue_time_us":653,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":10831,"spinlock_wait_cycles":8220544,"thread_start_us":491046,"threads_started":1,"wal-append.queue_time_us":785153}
W20260709 13:15:28.283350  4071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:28.285166  4107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45332 (request call id 1787) took 3440 ms. Trace:
I20260709 13:15:28.343477  4105 raft_consensus.cc:1275] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:15:28.345070  4107 rpcz_store.cc:276] 0709 13:15:24.844376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.744809 (+900433us) service_pool.cc:224] Handling call
0709 13:15:25.868376 (+123567us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:25.896152 (+ 27776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.282923 (+2386771us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b54000fe950. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566d8ad 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:28.285076 (+  2153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":283400960}
I20260709 13:15:28.345996  4105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34656 (request call id 384) took 2626 ms. Trace:
I20260709 13:15:28.346465  4105 rpcz_store.cc:276] 0709 13:15:25.720132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.323502 (+2603370us) service_pool.cc:224] Handling call
0709 13:15:28.343070 (+ 19568us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:28.345716 (+  2646us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.345929 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:28.243433  7106 raft_consensus.cc:3060] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:15:28.287665  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:28.331357  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:28.289634  4100 raft_consensus.cc:1240] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:28.352530  4028 raft_consensus.cc:2468] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7.
I20260709 13:15:28.353025  4100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34656 (request call id 383) took 2655 ms. Trace:
I20260709 13:15:28.266798  7173 leader_election.cc:290] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:28.231923  7117 raft_consensus.cc:515] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:28.270406  6976 raft_consensus.cc:697] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:28.349786  4107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34656 (request call id 385) took 2610 ms. Trace:
I20260709 13:15:28.350792  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:28.286136  7003 raft_consensus.cc:493] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:28.353466  4100 rpcz_store.cc:276] 0709 13:15:25.697343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.288938 (+2591595us) service_pool.cc:224] Handling call
0709 13:15:28.289395 (+   457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:28.352745 (+ 63350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.352943 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:28.353717  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:15:28.231884  3997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.023s	sys 0.012s
I20260709 13:15:28.357693  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:28.362079  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:28.386719  3959 raft_consensus.cc:2468] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 6.
I20260709 13:15:28.387277  3955 raft_consensus.cc:2468] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 7.
I20260709 13:15:28.388666  4105 raft_consensus.cc:1240] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:28.389465  4105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34656 (request call id 386) took 2643 ms. Trace:
I20260709 13:15:28.389948  4105 rpcz_store.cc:276] 0709 13:15:25.746485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.361095 (+2614610us) service_pool.cc:224] Handling call
0709 13:15:28.388448 (+ 27353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:28.389129 (+   681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.389387 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:28.390239  4028 raft_consensus.cc:2468] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
I20260709 13:15:28.368144  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:28.391819  3953 raft_consensus.cc:3060] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:28.386396  3997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.025s	sys 0.017s
I20260709 13:15:28.386250  4107 rpcz_store.cc:276] 0709 13:15:25.739013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.346620 (+2607607us) service_pool.cc:224] Handling call
0709 13:15:28.347020 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:28.347259 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:28.347295 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:28.347353 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:28.347398 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.347467 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:28.349707 (+  2240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:28.393211  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:28.407675  4107 raft_consensus.cc:1240] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:28.409582  4107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45336 (request call id 1266) took 2162 ms. Trace:
I20260709 13:15:28.410025  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:28.410288  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:28.368624  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:28.410959  3955 raft_consensus.cc:2468] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 8.
I20260709 13:15:28.411098  3954 raft_consensus.cc:3060] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:28.394219  4030 raft_consensus.cc:1240] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:28.412919  3955 raft_consensus.cc:1275] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:15:28.413213  4028 raft_consensus.cc:3060] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:28.413230  3950 raft_consensus.cc:1275] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:15:28.343335  7120 raft_consensus.cc:493] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
W20260709 13:15:28.379118  7101 log.cc:927] Time spent T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 2.324s	user 0.007s	sys 0.015s
I20260709 13:15:28.401259  3959 raft_consensus.cc:1275] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:15:28.420167  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:28.421898  3958 raft_consensus.cc:1275] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:15:28.415907  4026 raft_consensus.cc:2368] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 7. Current term is 8.
I20260709 13:15:28.426014  3925 leader_election.cc:304] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:28.426744  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:28.429708  3997 leader_election.cc:304] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:28.410109  4107 rpcz_store.cc:276] 0709 13:15:26.247368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.407092 (+2159724us) service_pool.cc:224] Handling call
0709 13:15:28.407450 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:28.408300 (+   850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.409520 (+  1220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:28.436651  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:28.437610  3959 raft_consensus.cc:2410] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:15:28.437737  3997 leader_election.cc:304] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
W20260709 13:15:28.357110  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 207965us
I20260709 13:15:28.441780  3997 leader_election.cc:304] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: d709ee666b774ec29aa732e508219938
W20260709 13:15:28.441963  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 81145.4us
I20260709 13:15:28.446802  3925 leader_election.cc:304] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: d709ee666b774ec29aa732e508219938
W20260709 13:15:28.447398  4071 connection.cc:256] RPC call timeout handler was delayed by -1.2304890610000712s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2162s for a response
I20260709 13:15:28.363962  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:28.378749  7144 leader_election.cc:290] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:28.454133  3925 leader_election.cc:304] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:28.451999  4034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41312 (request call id 392) took 1163 ms. Trace:
I20260709 13:15:28.527850  4034 rpcz_store.cc:276] 0709 13:15:27.288476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.289446 (+   970us) service_pool.cc:224] Handling call
0709 13:15:27.302613 (+ 13167us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:27.307092 (+  4479us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:27.307163 (+    71us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:28.054079 (+746916us) spinlock_profiling.cc:243] Waited 1.04 ms on lock 0x7b2c00034798. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1523f67a11 00007f1523f77372 00007f15256a9a01 00007f152566e43a 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2
0709 13:15:28.054608 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 13:15:28.284820 (+230212us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:28.284876 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.284986 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:28.451670 (+166684us) raft_consensus.cc:1685] finished
0709 13:15:28.451693 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:28.451934 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4053,"raft.queue_time_us":15240,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":19084,"spinlock_wait_cycles":2397440,"thread_start_us":229733,"threads_started":1,"wal-append.queue_time_us":363489}
I20260709 13:15:28.351826  7043 raft_consensus.cc:515] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:28.460134  3954 raft_consensus.cc:2468] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 6.
W20260709 13:15:28.460763  4071 connection.cc:256] RPC call timeout handler was delayed by -1.0474073929999577s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1978s for a response
I20260709 13:15:28.456283  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:28.344431  6967 raft_consensus.cc:515] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:28.418362  7175 consensus_queue.cc:1059] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
W20260709 13:15:28.539727  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 397269us
I20260709 13:15:28.461917  3953 raft_consensus.cc:2468] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 8.
I20260709 13:15:28.462114  7110 raft_consensus.cc:493] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.442116  6959 raft_consensus.cc:515] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:28.440840  7177 raft_consensus.cc:2749] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:28.464082  4105 raft_consensus.cc:3060] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:28.464236  7005 raft_consensus.cc:493] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.432473  7120 raft_consensus.cc:515] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:28.460681  7103 raft_consensus.cc:493] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.406211  7003 raft_consensus.cc:515] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:28.471280  7145 raft_consensus.cc:493] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.387017  7121 consensus_queue.cc:260] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:28.474648  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:28.577898  4105 raft_consensus.cc:1275] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:15:28.578226  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:28.578589  4105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45336 (request call id 1270) took 1464 ms. Trace:
I20260709 13:15:28.462033  7187 consensus_queue.cc:1048] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:15:28.430253  7046 raft_consensus.cc:2749] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:28.458798  7131 raft_consensus.cc:2804] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:28.453509  7049 raft_consensus.cc:2804] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:28.589053  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:28.516311  7174 log.cc:927] Time spent T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.236s	user 0.002s	sys 0.000s
I20260709 13:15:28.590183  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:28.590842  4104 raft_consensus.cc:2393] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 7: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:28.457816  7176 consensus_queue.cc:1059] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 13:15:28.523500  6976 consensus_queue.cc:237] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:28.572223  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:15:28.536319  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 82273.9us
W20260709 13:15:28.536936  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 78726.4us
I20260709 13:15:28.534340  4071 leader_election.cc:304] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:28.445744  7173 consensus_queue.cc:1048] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:15:28.520980  6923 leader_election.cc:290] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:28.544795  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:28.551368  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:28.596100  4672 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:28.597437  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:28.552917  7110 raft_consensus.cc:515] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:28.598325  4034 raft_consensus.cc:2410] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 10 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:15:28.540441  7056 raft_consensus.cc:2804] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:28.572127  4029 raft_consensus.cc:1240] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:28.572777  4704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:28.476085  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:28.586404  7131 raft_consensus.cc:493] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:28.555341  4028 raft_consensus.cc:2468] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 5.
I20260709 13:15:28.583665  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:28.589176  7117 leader_election.cc:290] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:28.593168  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:28.606032  4104 raft_consensus.cc:2368] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 6. Current term is 7.
I20260709 13:15:28.592006  7183 raft_consensus.cc:2804] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:28.449095  4107 raft_consensus.cc:1275] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:15:28.595602  3925 leader_election.cc:304] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:28.579476  7103 raft_consensus.cc:515] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:28.600800  4103 raft_consensus.cc:3060] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:28.623557  3957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38612 (request call id 1235) took 1336 ms. Trace:
I20260709 13:15:28.580471  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:28.603799  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:28.623989  3957 rpcz_store.cc:276] 0709 13:15:27.287422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.292955 (+  5533us) service_pool.cc:224] Handling call
0709 13:15:27.293264 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:27.555759 (+262495us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.623276 (+1067517us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b540013a1d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:28.623467 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":240905600}
I20260709 13:15:28.624877  4101 raft_consensus.cc:2393] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 7: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:28.579099  4105 rpcz_store.cc:276] 0709 13:15:27.114258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.456265 (+1342007us) service_pool.cc:224] Handling call
0709 13:15:28.463938 (+  7673us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:28.578347 (+114409us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.578533 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:28.626061  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:28.626467  4107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45336 (request call id 1268) took 2378 ms. Trace:
I20260709 13:15:28.626920  4105 raft_consensus.cc:2468] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 7.
I20260709 13:15:28.596643  7049 raft_consensus.cc:697] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:28.606559  4028 raft_consensus.cc:1275] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:15:28.606901  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:28.593364  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:28.608656  7050 raft_consensus.cc:515] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:28.610313  6967 leader_election.cc:290] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:28.611896  6959 leader_election.cc:290] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:28.602322  6935 raft_consensus.cc:2804] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:15:28.613533  6938 consensus_meta.cc:287] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 0.925s	user 0.007s	sys 0.007s
I20260709 13:15:28.615159  7105 leader_election.cc:290] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:28.615942  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:28.616886  7111 raft_consensus.cc:515] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:28.622390  3925 leader_election.cc:304] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:15:28.706621  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 84289.1us
I20260709 13:15:28.708719  3925 leader_election.cc:304] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:28.552562  6839 consensus_queue.cc:1059] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:15:28.581379  7145 raft_consensus.cc:515] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:28.623694  4672 leader_election.cc:336] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Timed out: RequestConsensusVote RPC to 127.2.198.193:35339 timed out after 1.767s (SENT)
I20260709 13:15:28.558645  7005 raft_consensus.cc:515] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:28.626736  4107 rpcz_store.cc:276] 0709 13:15:26.248034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.433807 (+2185773us) service_pool.cc:224] Handling call
0709 13:15:28.443507 (+  9700us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:28.626256 (+182749us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.626420 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:28.635054  4704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:28.635030  4707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57692 (request call id 362) took 1081 ms. Trace:
I20260709 13:15:28.671801  4104 raft_consensus.cc:2393] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 5: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:28.665462  4033 raft_consensus.cc:1275] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:28.600454  7056 raft_consensus.cc:493] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:28.604760  7131 raft_consensus.cc:3060] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:28.690382  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:28.628623  7130 consensus_meta.cc:287] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.577s	user 0.007s	sys 0.013s
I20260709 13:15:28.627377  7046 raft_consensus.cc:2804] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:28.706670  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:28.727309  4034 raft_consensus.cc:1275] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 13:15:28.728389  4032 raft_consensus.cc:1240] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:28.736296  7048 raft_consensus.cc:2804] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:28.604041  7182 consensus_queue.cc:1048] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.151s
I20260709 13:15:28.630502  4705 raft_consensus.cc:1275] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:15:29.084824  7106 consensus_meta.cc:287] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.723s	user 0.013s	sys 0.000s
I20260709 13:15:29.091686  4034 pending_rounds.cc:85] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2: Aborting all ops after (but not including) 5
I20260709 13:15:29.091369  7106 raft_consensus.cc:515] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:29.092125  4034 pending_rounds.cc:107] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:15:29.092581  4034 raft_consensus.cc:2889] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:29.092841  6959 raft_consensus.cc:493] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:28.793411  7152 raft_consensus.cc:493] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:29.093477  6959 raft_consensus.cc:515] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:29.094434  7152 raft_consensus.cc:3060] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:29.087998  4029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38304 (request call id 2110) took 1737 ms. Trace:
I20260709 13:15:29.096948  6959 leader_election.cc:290] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:15:28.894580  7194 log.cc:927] Time spent T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.273s	user 0.000s	sys 0.001s
I20260709 13:15:28.873068  7043 leader_election.cc:290] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:29.090438  4707 rpcz_store.cc:276] 0709 13:15:27.553102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.553219 (+   117us) service_pool.cc:224] Handling call
0709 13:15:27.553530 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:27.576262 (+ 22732us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:27.576310 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:27.623453 (+ 47143us) log.cc:844] Serialized 26 byte log entry
0709 13:15:28.095608 (+472155us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:28.095661 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.095753 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:28.515488 (+419735us) spinlock_profiling.cc:243] Waited 40.3 ms on lock 0x7b4400022b4c. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f15224a7c85 00007f15224a86a2 00007f152521a1db 00007f1525215aaf 00007f152520986e 00007f1525208bb6 00007f15252087d8 00007f1525212221 00007f15252121d9 00007f1525212169
0709 13:15:28.634658 (+119170us) raft_consensus.cc:1685] finished
0709 13:15:28.634686 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:28.634934 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4063,"raft.queue_time_us":7101,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":18153,"spinlock_wait_cycles":92675840,"thread_start_us":393657,"threads_started":1,"wal-append.queue_time_us":587206}
I20260709 13:15:29.031064  7049 consensus_queue.cc:237] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:29.096621  4029 rpcz_store.cc:276] 0709 13:15:27.350404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.083862 (+733458us) service_pool.cc:224] Handling call
0709 13:15:28.084364 (+   502us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:28.600584 (+516220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:29.087712 (+487128us) spinlock_profiling.cc:243] Waited 487 ms on lock 0x7b5400396054. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:29.087922 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1121227648}
I20260709 13:15:28.891481  7120 leader_election.cc:290] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:29.104596  4099 raft_consensus.cc:2468] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 5.
I20260709 13:15:28.888708  7003 leader_election.cc:290] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:28.893662  7125 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:29.107436  4029 raft_consensus.cc:1275] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:29.108016  7056 raft_consensus.cc:3060] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:29.103870  7046 raft_consensus.cc:493] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:29.108748  7046 raft_consensus.cc:3060] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:29.110682  7114 raft_consensus.cc:3055] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:29.105973  7130 raft_consensus.cc:515] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:29.111193  7114 raft_consensus.cc:740] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:29.112001  4102 raft_consensus.cc:1240] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:29.112150  7114 consensus_queue.cc:260] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:29.113276  7103 leader_election.cc:290] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:28.798441  7110 leader_election.cc:290] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:15:28.803110  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:29.115660  7130 leader_election.cc:290] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:29.132634  7183 raft_consensus.cc:493] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:29.133320  7183 raft_consensus.cc:3060] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:28.874022  7197 log.cc:927] Time spent T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:15:28.890547  7111 leader_election.cc:290] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:29.115837  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:29.107411  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:29.135500  4031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41312 (request call id 398) took 1585 ms. Trace:
I20260709 13:15:28.893086  7050 leader_election.cc:290] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:29.117290  7048 raft_consensus.cc:493] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:29.137786  7048 raft_consensus.cc:3060] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:29.135903  4031 rpcz_store.cc:276] 0709 13:15:27.549984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.123636 (+573652us) service_pool.cc:224] Handling call
0709 13:15:28.123922 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:28.124290 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:28.428718 (+304428us) log.cc:844] Serialized 14 byte log entry
0709 13:15:28.580733 (+152015us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:28.586985 (+  6252us) log.cc:844] Serialized 26 byte log entry
0709 13:15:28.587185 (+   200us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:28.587235 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.587335 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:29.135235 (+547900us) raft_consensus.cc:1685] finished
0709 13:15:29.135259 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:29.135419 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10046,"prepare.queue_time_us":305265,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":76416,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":121,"spinlock_wait_cycles":3149568,"thread_start_us":314525,"threads_started":2,"wal-append.queue_time_us":149383}
I20260709 13:15:29.117566  4027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38304 (request call id 2121) took 1035 ms. Trace:
I20260709 13:15:29.117825  4032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38304 (request call id 2119) took 1578 ms. Trace:
I20260709 13:15:29.139864  4027 rpcz_store.cc:276] 0709 13:15:28.082381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.201276 (+118895us) service_pool.cc:224] Handling call
0709 13:15:28.201595 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:28.320557 (+118962us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:29.117336 (+796779us) spinlock_profiling.cc:243] Waited 62.4 ms on lock 0x7b5400394c54. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:29.117507 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":143524096}
I20260709 13:15:28.902163  7145 leader_election.cc:290] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:29.142300  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 408661us
I20260709 13:15:29.143862  4031 raft_consensus.cc:1275] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:15:29.144083  3925 leader_election.cc:304] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:15:29.145588  7055 consensus_queue.cc:1048] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:15:28.872496  7193 log.cc:927] Time spent T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.231s	user 0.000s	sys 0.000s
I20260709 13:15:28.783493  7051 raft_consensus.cc:2749] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:15:28.870919  7198 log.cc:927] Time spent T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
W20260709 13:15:29.089833  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 466169us
W20260709 13:15:29.120198  7196 log.cc:927] Time spent T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.380s	user 0.007s	sys 0.010s
I20260709 13:15:29.121896  4102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34656 (request call id 382) took 3597 ms. Trace:
I20260709 13:15:29.093881  7106 leader_election.cc:290] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:15:29.180122  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 645842us
I20260709 13:15:29.181258  4071 leader_election.cc:304] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:29.181696  7041 raft_consensus.cc:2749] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:29.182134  7007 raft_consensus.cc:2749] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:29.089418  4026 pending_rounds.cc:85] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2: Aborting all ops after (but not including) 3
I20260709 13:15:29.125375  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:29.182878  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:29.183118  4104 raft_consensus.cc:2468] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 8.
I20260709 13:15:29.179889  4102 rpcz_store.cc:276] 0709 13:15:25.524607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.193771 (+2669164us) service_pool.cc:224] Handling call
0709 13:15:28.194209 (+   438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:29.112512 (+918303us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:29.121583 (+  9071us) spinlock_profiling.cc:243] Waited 917 ms on lock 0x7b54002c24d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:29.121816 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2110167296}
I20260709 13:15:29.183784  4099 raft_consensus.cc:2468] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 9.
I20260709 13:15:29.184185  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:29.139925  4032 rpcz_store.cc:276] 0709 13:15:27.539221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.122021 (+582800us) service_pool.cc:224] Handling call
0709 13:15:28.122326 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:29.091653 (+969327us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:29.117596 (+ 25943us) spinlock_profiling.cc:243] Waited 606 ms on lock 0x7b540026e8d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:29.117768 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1393172736}
I20260709 13:15:29.149268  3999 leader_election.cc:304] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:29.184989  4104 raft_consensus.cc:2468] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 6.
I20260709 13:15:29.185348  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:29.119078  7005 leader_election.cc:290] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:29.149099  4672 leader_election.cc:304] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:29.147962  6768 raft_consensus.cc:2804] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:29.136078  4107 raft_consensus.cc:2468] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 7.
I20260709 13:15:29.155964  4709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57680 (request call id 661) took 1091 ms. Trace:
I20260709 13:15:29.120381  6967 raft_consensus.cc:3055] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:15:29.158663  6718 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:15:29.160069  7129 raft_consensus.cc:3055] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:15:29.161042  7171 log.cc:927] Time spent T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 1.095s	user 0.013s	sys 0.010s
I20260709 13:15:29.170460  7116 raft_consensus.cc:493] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:29.171293  4106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45332 (request call id 1786) took 4327 ms. Trace:
I20260709 13:15:29.172544  4100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34656 (request call id 390) took 3289 ms. Trace:
I20260709 13:15:29.174099  6941 raft_consensus.cc:493] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:29.174690  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 621166us
I20260709 13:15:29.110608  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:29.184302  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:28.696570  6935 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:29.128113  7121 raft_consensus.cc:3060] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:29.090250  4030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38304 (request call id 2113) took 1739 ms. Trace:
I20260709 13:15:29.187271  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:15:29.214382  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:29.214962  4032 raft_consensus.cc:2410] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:15:29.217823  4032 raft_consensus.cc:1240] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:29.219913  4030 rpcz_store.cc:276] 0709 13:15:27.351220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.118973 (+767753us) service_pool.cc:224] Handling call
0709 13:15:28.119495 (+   522us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:28.412651 (+293156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.783103 (+370452us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b5400378054. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:29.090166 (+307063us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":631287552}
I20260709 13:15:29.223670  4074 leader_election.cc:304] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:29.224846  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:29.225438  4074 leader_election.cc:304] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:15:29.226023  3956 raft_consensus.cc:2410] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:15:28.976720  4103 raft_consensus.cc:2468] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 8.
I20260709 13:15:29.193362  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:29.228092  4104 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 9.
I20260709 13:15:29.229827  4104 raft_consensus.cc:1275] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:29.230525  4104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45332 (request call id 1793) took 2048 ms. Trace:
I20260709 13:15:29.193563  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:29.233319  4107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45332 (request call id 1794) took 2050 ms. Trace:
I20260709 13:15:29.233857  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:29.233814  4107 rpcz_store.cc:276] 0709 13:15:27.183196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.232246 (+2049050us) service_pool.cc:224] Handling call
0709 13:15:29.232621 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:29.232854 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:29.232894 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:29.232959 (+    65us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:29.233019 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:29.233090 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:29.233247 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:29.234790  3953 raft_consensus.cc:3060] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:29.230923  4104 rpcz_store.cc:276] 0709 13:15:27.182543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.229008 (+2046465us) service_pool.cc:224] Handling call
0709 13:15:29.229386 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:29.230229 (+   843us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:29.230456 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:29.237673  4107 pending_rounds.cc:85] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Aborting all ops after (but not including) 2
I20260709 13:15:29.238169  4107 pending_rounds.cc:107] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:15:29.238570  4107 raft_consensus.cc:2889] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:15:29.198331  3999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 49150.6us
W20260709 13:15:28.726944  6706 consensus_meta.cc:287] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 0.567s	user 0.012s	sys 0.001s
I20260709 13:15:29.203047  4100 rpcz_store.cc:276] 0709 13:15:25.883512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.388721 (+2505209us) service_pool.cc:224] Handling call
0709 13:15:28.389209 (+   488us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:28.389506 (+   297us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:15:28.440653 (+ 51147us) log.cc:844] Serialized 14 byte log entry
0709 13:15:29.172071 (+731418us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:29.172149 (+    78us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:29.172212 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:29.172306 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:29.172466 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":635728,"prepare.queue_time_us":83825,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":639043,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"thread_start_us":120278,"threads_started":2,"wal-append.queue_time_us":150909}
I20260709 13:15:29.205821  4071 leader_election.cc:304] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:29.209144  4105 raft_consensus.cc:2393] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 8: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:29.189821  4709 rpcz_store.cc:276] 0709 13:15:28.064144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.064528 (+   384us) service_pool.cc:224] Handling call
0709 13:15:28.064788 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:28.316151 (+251363us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:15:28.443261 (+127110us) log.cc:844] Serialized 14 byte log entry
0709 13:15:28.587677 (+144416us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:28.587751 (+    74us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:28.587811 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:29.119405 (+531594us) spinlock_profiling.cc:243] Waited 39.5 ms on lock 0x7b4400022b4c. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f15224a7c85 00007f15224a86a2 00007f152521a1db 00007f1525215aaf 00007f152520986e 00007f1525208bb6 00007f15252087d8 00007f1525212221 00007f15252121d9 00007f1525212169
0709 13:15:29.154391 (+ 34986us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b180022f7e0. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f152254f2a6 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419
0709 13:15:29.155660 (+  1269us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b5400655754. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:29.155728 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:29.155884 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":778,"prepare.queue_time_us":133363,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":948,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":7346,"spinlock_wait_cycles":670800896,"thread_start_us":234256,"threads_started":2,"wal-append.queue_time_us":184857}
I20260709 13:15:29.206380  4106 rpcz_store.cc:276] 0709 13:15:24.844104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.735972 (+891868us) service_pool.cc:224] Handling call
0709 13:15:25.736472 (+   500us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:26.223622 (+487150us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:26.223724 (+   102us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:27.719953 (+1496229us) spinlock_profiling.cc:243] Waited 3.55 ms on lock 0x7b2c0005a6a8. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1523f67a11 00007f1523f77372 00007f15256a9a01 00007f152566e43a 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2
0709 13:15:27.720571 (+   618us) log.cc:844] Serialized 52 byte log entry
0709 13:15:28.268435 (+547864us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:28.512392 (+243957us) log.cc:844] Serialized 14 byte log entry
0709 13:15:28.519265 (+  6873us) log.cc:844] Serialized 14 byte log entry
0709 13:15:29.170049 (+650784us) spinlock_profiling.cc:243] Waited 4.5 ms on lock 0x7b1800442660. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f15224fbc0a 00007f152bc3b219 00007f1522583a40 00007f152257e4e4 00007f152257e455 00007f1525666060 00007f1525678716 00007f1525689287 00007f1525689208
0709 13:15:29.170298 (+   249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:29.170963 (+   665us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:29.171020 (+    57us) raft_consensus.cc:1685] finished
0709 13:15:29.171035 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:29.171225 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27714,"prepare.queue_time_us":211159,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":86,"raft.queue_time_us":1033232,"raft.run_cpu_time_us":412,"raft.run_wall_time_us":56065,"spinlock_wait_cycles":18520832,"thread_start_us":1133959,"threads_started":3,"wal-append.queue_time_us":635128}
I20260709 13:15:29.245668  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:29.209956  4701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:29.210032  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:29.251612  4099 raft_consensus.cc:2393] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 9: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:29.186120  4026 pending_rounds.cc:107] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:15:29.252326  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:29.252525  4026 raft_consensus.cc:2889] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:29.211957  4672 leader_election.cc:304] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:29.247872  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:15:29.254050  3924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:29.248867  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:29.240666  4103 raft_consensus.cc:1240] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:29.250119  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:29.256647  3957 raft_consensus.cc:2468] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 7.
I20260709 13:15:29.147081  7055 consensus_queue.cc:1048] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:15:29.257330  4101 raft_consensus.cc:2393] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 8: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:29.246332  3999 leader_election.cc:304] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:29.196384  6967 raft_consensus.cc:740] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:29.192900  6768 raft_consensus.cc:493] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:29.193054  7129 raft_consensus.cc:740] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:29.107617  7125 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:29.340721  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:29.341023  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:29.341297  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:15:29.315127  3924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:29.211288  7093 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.042s	sys 0.085s
I20260709 13:15:29.352993  4105 raft_consensus.cc:1275] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:29.334195  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:29.368660  4105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45332 (request call id 1801) took 2132 ms. Trace:
I20260709 13:15:29.369225  4105 rpcz_store.cc:276] 0709 13:15:27.239212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.250129 (+2010917us) service_pool.cc:224] Handling call
0709 13:15:29.352506 (+102377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:29.368342 (+ 15836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:29.368588 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:29.370486  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 164727us
I20260709 13:15:29.258183  4103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45332 (request call id 1798) took 2023 ms. Trace:
I20260709 13:15:29.371651  4071 leader_election.cc:304] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:29.372004  4103 rpcz_store.cc:276] 0709 13:15:27.235375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.240011 (+2004636us) service_pool.cc:224] Handling call
0709 13:15:29.240420 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:29.257855 (+ 17435us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:29.258118 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:29.373270  4071 leader_election.cc:304] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:29.374046  4103 raft_consensus.cc:1275] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:15:29.374779  4071 leader_election.cc:304] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:29.198232  7120 raft_consensus.cc:493] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:29.377614  4105 raft_consensus.cc:1275] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:15:29.384898  4105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34656 (request call id 396) took 1254 ms. Trace:
I20260709 13:15:29.385406  4105 rpcz_store.cc:276] 0709 13:15:28.130867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.370596 (+1239729us) service_pool.cc:224] Handling call
0709 13:15:29.371009 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:29.384555 (+ 13546us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:29.384826 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:29.387061  4105 raft_consensus.cc:1240] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:29.314873  4099 raft_consensus.cc:1275] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:29.377856  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:29.379182  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:29.388170  4099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34656 (request call id 395) took 1257 ms. Trace:
I20260709 13:15:29.388664  4099 rpcz_store.cc:276] 0709 13:15:28.130585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.313928 (+1183343us) service_pool.cc:224] Handling call
0709 13:15:29.314420 (+   492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:29.387813 (+ 73393us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:29.388099 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:29.389532  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:28.727785  6938 raft_consensus.cc:515] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:29.380587  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:29.381317  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:29.381807  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:29.367667  3953 raft_consensus.cc:2468] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 6.
I20260709 13:15:29.388159  3954 raft_consensus.cc:2468] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 6.
I20260709 13:15:29.254024  3951 raft_consensus.cc:2376] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 8. Re-sending same reply.
I20260709 13:15:29.255373  3956 raft_consensus.cc:2468] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 8.
I20260709 13:15:29.202764  7059 consensus_queue.cc:1048] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.179s
I20260709 13:15:29.210580  7187 consensus_queue.cc:1059] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.186s
I20260709 13:15:29.403074  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:29.250542  6706 raft_consensus.cc:515] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:29.405387  4025 raft_consensus.cc:1240] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:15:29.405848  4099 raft_consensus.cc:1240] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:29.407598  4099 raft_consensus.cc:1240] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 7. Current term is 8. Ops: [6.5-7.6]
W20260709 13:15:29.409643  3999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 163413us
I20260709 13:15:29.245242  6976 raft_consensus.cc:493] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.213297  7116 raft_consensus.cc:515] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:29.209144  6932 raft_consensus.cc:2804] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:15:29.381573  7093 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.050s	sys 0.090s
I20260709 13:15:29.325377  6718 raft_consensus.cc:476] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 LEADER]: Not starting pre-election -- already a leader
I20260709 13:15:29.202587  7064 raft_consensus.cc:2804] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:29.312242  7105 raft_consensus.cc:2749] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:29.323438  7169 raft_consensus.cc:493] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:29.277072  4104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45332 (request call id 1796) took 2047 ms. Trace:
I20260709 13:15:29.485809  4104 rpcz_store.cc:276] 0709 13:15:27.229977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.275757 (+2045780us) service_pool.cc:224] Handling call
0709 13:15:29.276275 (+   518us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:29.276544 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:29.276582 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:29.276642 (+    60us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:29.276686 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:29.276756 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:29.276914 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:29.458520  3956 raft_consensus.cc:1240] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:15:29.244971  6941 raft_consensus.cc:515] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:29.498765  4100 raft_consensus.cc:1275] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:15:29.415678  7144 raft_consensus.cc:2749] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:29.468144  4033 raft_consensus.cc:1240] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:29.381378  7103 raft_consensus.cc:2804] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:29.369380  6768 raft_consensus.cc:3060] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:29.246397  6935 raft_consensus.cc:3060] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:29.477128  4025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38304 (request call id 2111) took 2126 ms. Trace:
I20260709 13:15:29.383033  7111 raft_consensus.cc:2749] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:29.202903  7185 consensus_queue.cc:1059] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.218s
I20260709 13:15:29.476274  7064 raft_consensus.cc:493] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:29.479980  4105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:34646 (request call id 18) took 1308 ms. Trace:
W20260709 13:15:29.278635  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 51180.4us
W20260709 13:15:29.455462  7068 consensus_meta.cc:287] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 1.100s	user 0.013s	sys 0.000s
I20260709 13:15:29.246173  6925 consensus_queue.cc:1059] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.211s
I20260709 13:15:29.213459  6836 consensus_queue.cc:1048] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.239s
I20260709 13:15:29.417551  7115 raft_consensus.cc:2749] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:29.405280  7120 raft_consensus.cc:515] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:29.418409  7106 raft_consensus.cc:2749] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:29.457517  6976 raft_consensus.cc:515] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:29.457139  6932 raft_consensus.cc:493] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:29.520319  4025 rpcz_store.cc:276] 0709 13:15:27.350696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.083629 (+732933us) service_pool.cc:224] Handling call
0709 13:15:28.084005 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:29.414277 (+1330272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:29.476874 (+ 62597us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b5400396a54. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:29.477069 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3038309760}
I20260709 13:15:29.525851  4105 rpcz_store.cc:276] 0709 13:15:28.171988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.410062 (+1238074us) service_pool.cc:224] Handling call
0709 13:15:29.479882 (+ 69820us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:29.488927  7182 raft_consensus.cc:2804] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:29.491886  7114 raft_consensus.cc:3060] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:29.495265  6718 raft_consensus.cc:493] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.525480  6941 leader_election.cc:290] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:29.492654  7007 consensus_queue.cc:1048] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:15:29.525615  7064 raft_consensus.cc:3060] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:15:29.571224  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 44670.9us
I20260709 13:15:29.527407  6959 raft_consensus.cc:493] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.570297  6932 raft_consensus.cc:3060] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:29.573100  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:29.479270  7129 consensus_queue.cc:260] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:29.494899  7169 raft_consensus.cc:515] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:29.495142  6967 consensus_queue.cc:260] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:29.568087  7182 raft_consensus.cc:493] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:29.570863  7103 raft_consensus.cc:697] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:29.555861  7068 raft_consensus.cc:515] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:29.604101  6938 leader_election.cc:290] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:29.604444  7068 leader_election.cc:290] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:29.605259  7129 raft_consensus.cc:3060] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:29.606209  4033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38290 (request call id 1918) took 1260 ms. Trace:
I20260709 13:15:29.606631  4033 rpcz_store.cc:276] 0709 13:15:28.345768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.098969 (+753201us) service_pool.cc:224] Handling call
0709 13:15:29.099279 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:29.523704 (+424425us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:29.605930 (+ 82226us) spinlock_profiling.cc:243] Waited 369 ms on lock 0x7b54000a1754. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:29.606139 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":847591168}
I20260709 13:15:29.608219  4108 raft_consensus.cc:2393] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 8: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:29.601667  7003 consensus_queue.cc:1048] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:29.586005  7185 raft_consensus.cc:3055] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:29.577739  7131 raft_consensus.cc:515] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:29.600523  7182 raft_consensus.cc:3060] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:29.585177  7043 consensus_queue.cc:1048] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 13:15:29.579362  6718 raft_consensus.cc:515] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:29.599121  6706 leader_election.cc:290] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:29.666175  4029 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.037s	sys 0.049s
W20260709 13:15:29.669981  4028 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.026s	sys 0.050s
I20260709 13:15:29.587909  6959 raft_consensus.cc:515] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:29.663589  7049 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.004s	sys 0.027s
I20260709 13:15:29.656483  6967 raft_consensus.cc:3060] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:29.674278  4029 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.037s	sys 0.049s
W20260709 13:15:29.800364  4030 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.003s	sys 0.011s
W20260709 13:15:29.800834  4672 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.014s	sys 0.010s
W20260709 13:15:29.801090  4030 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.003s	sys 0.012s
W20260709 13:15:29.801307  4672 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.014s	sys 0.010s
I20260709 13:15:29.801704  4102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34656 (request call id 392) took 1733 ms. Trace:
W20260709 13:15:29.802086  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 590185us
I20260709 13:15:29.804456  4031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38290 (request call id 1926) took 1358 ms. Trace:
I20260709 13:15:29.802460  4102 rpcz_store.cc:276] 0709 13:15:28.068373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.252299 (+1183926us) service_pool.cc:224] Handling call
0709 13:15:29.252648 (+   349us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:29.382280 (+129632us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:29.382321 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:29.407510 (+ 25189us) log.cc:844] Serialized 52 byte log entry
0709 13:15:29.800498 (+392988us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:29.800656 (+   158us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:29.800828 (+   172us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:29.800925 (+    97us) raft_consensus.cc:1685] finished
0709 13:15:29.800957 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:29.801314 (+   357us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":144640,"raft.queue_time_us":131503,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":19810,"thread_start_us":307683,"threads_started":1,"wal-append.queue_time_us":281471}
I20260709 13:15:29.805161  4031 rpcz_store.cc:276] 0709 13:15:28.445879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.144747 (+698868us) service_pool.cc:224] Handling call
0709 13:15:29.145086 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:29.145480 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:15:29.145515 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:29.146026 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 13:15:29.559161 (+413135us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:29.559229 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:29.559339 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:29.803788 (+244449us) raft_consensus.cc:1685] finished
0709 13:15:29.803841 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:29.804227 (+   386us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2603,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":69,"thread_start_us":412781,"threads_started":1,"wal-append.queue_time_us":550232}
I20260709 13:15:29.481215  3922 leader_election.cc:304] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
W20260709 13:15:29.812139  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 412095us
I20260709 13:15:29.811981  4701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:29.813171  6718 leader_election.cc:290] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:29.814733  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:29.819348  6799 raft_consensus.cc:493] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
W20260709 13:15:29.822340  4675 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.005s	sys 0.019s
I20260709 13:15:29.822220  6799 raft_consensus.cc:515] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:29.828600  6799 leader_election.cc:290] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:15:29.830569  3924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:29.814617  4071 leader_election.cc:304] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:29.834630  4071 leader_election.cc:304] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:29.790047  3925 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.009s	sys 0.015s
I20260709 13:15:29.465600  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:15:29.791229  3905 auto_rebalancer.cc:629] Failed to schedule move for tablet 79e5ee76c81a42c8a9510d0d5d7b55b2: Illegal state: Replica 8952c48a6f3a43968f7d77f7bfc4d1bc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
W20260709 13:15:29.837329  3925 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.010s	sys 0.015s
W20260709 13:15:29.823006  4675 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.005s	sys 0.019s
I20260709 13:15:29.474615  3951 raft_consensus.cc:1240] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 6. Current term is 7. Ops: []
W20260709 13:15:29.839638  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 593718us
W20260709 13:15:29.839735  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 695702us
I20260709 13:15:29.466002  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:29.841362  3925 leader_election.cc:304] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:29.481216  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:15:29.793740  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:29.673650  6938 raft_consensus.cc:493] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:29.797960  4027 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.000s	sys 0.024s
W20260709 13:15:29.674583  4028 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.026s	sys 0.051s
I20260709 13:15:29.676739  4034 raft_consensus.cc:1240] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:29.808076  4672 leader_election.cc:304] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
W20260709 13:15:29.671733  3997 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.003s	sys 0.007s
I20260709 13:15:29.904152  6959 leader_election.cc:290] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:29.904459  3997 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.004s	sys 0.007s
W20260709 13:15:29.905071  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 815478us
W20260709 13:15:29.703934  7048 consensus_meta.cc:287] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.566s	user 0.009s	sys 0.002s
I20260709 13:15:29.908461  7048 raft_consensus.cc:515] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:29.701381  7046 consensus_meta.cc:287] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.592s	user 0.012s	sys 0.000s
I20260709 13:15:29.894068  6925 raft_consensus.cc:493] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.912509  7046 raft_consensus.cc:515] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:29.912801  6925 raft_consensus.cc:515] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:29.684080  7049 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.005s	sys 0.027s
W20260709 13:15:29.702913  7051 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.016s	sys 0.043s
W20260709 13:15:29.916837  7051 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.016s	sys 0.043s
I20260709 13:15:29.916976  4026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38290 (request call id 1916) took 1573 ms. Trace:
I20260709 13:15:29.728864  7120 leader_election.cc:290] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:29.677162  7125 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:29.748260  7131 leader_election.cc:290] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:29.599709  7152 raft_consensus.cc:515] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:29.921103  6836 raft_consensus.cc:493] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.922220  7152 leader_election.cc:290] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:29.922098  6836 raft_consensus.cc:515] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:29.751684  7169 leader_election.cc:290] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:29.655129  7185 raft_consensus.cc:740] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
W20260709 13:15:29.683784  7183 consensus_meta.cc:287] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 0.550s	user 0.006s	sys 0.006s
I20260709 13:15:29.924259  6925 leader_election.cc:290] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:29.924919  3925 leader_election.cc:400] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Vote denied by peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115) with higher term. Message: Invalid argument: T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 7. Current term is 8.
I20260709 13:15:29.925390  3925 leader_election.cc:403] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:15:29.925248  7183 raft_consensus.cc:515] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:29.707149  7199 log.cc:927] Time spent T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
W20260709 13:15:29.691321  7201 log.cc:927] Time spent T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
W20260709 13:15:29.743144  7212 log.cc:927] Time spent T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:15:29.887917  7214 consensus_queue.cc:1059] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:29.932179  4033 raft_consensus.cc:1240] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:29.932507  7055 raft_consensus.cc:2749] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:29.836289  6799 raft_consensus.cc:2749] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:29.933670  7055 raft_consensus.cc:2749] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115) with higher term. Message: Invalid argument: T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 7. Current term is 8.
I20260709 13:15:29.935207  6938 raft_consensus.cc:515] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:29.937862  6938 leader_election.cc:290] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:29.938587  7226 raft_consensus.cc:2804] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:29.939199  7226 raft_consensus.cc:493] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:29.724776  6976 leader_election.cc:290] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:29.939684  7226 raft_consensus.cc:3060] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:29.944105  3905 auto_rebalancer.cc:629] Failed to schedule move for tablet 604474f002cb41eb9125fc14353547d2: Remote error: Service unavailable: leader transfer in progress
I20260709 13:15:29.945290  4028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38290 (request call id 1914) took 1610 ms. Trace:
I20260709 13:15:29.945750  6836 leader_election.cc:290] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:29.945652  4028 rpcz_store.cc:276] 0709 13:15:28.334447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.673939 (+339492us) service_pool.cc:224] Handling call
0709 13:15:29.087519 (+413580us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:29.132441 (+ 44922us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:29.132475 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:29.133184 (+   709us) log.cc:844] Serialized 52 byte log entry
0709 13:15:29.943931 (+810747us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:29.944421 (+   490us) log.cc:844] Serialized 14 byte log entry
0709 13:15:29.944721 (+   300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:29.944824 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:29.944885 (+    61us) raft_consensus.cc:1685] finished
0709 13:15:29.944902 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:29.945096 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44374,"raft.queue_time_us":49474,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"spinlock_wait_cycles":21632,"thread_start_us":765698,"threads_started":1,"wal-append.queue_time_us":615869}
W20260709 13:15:29.863878  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 330343us
I20260709 13:15:29.948247  7183 leader_election.cc:290] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:15:29.892416  4027 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.000s	sys 0.025s
I20260709 13:15:29.690315  7103 consensus_queue.cc:237] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:29.710393  7187 consensus_queue.cc:1243] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [LEADER]: Peer 8952c48a6f3a43968f7d77f7bfc4d1bc log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:15:29.900336  7220 raft_consensus.cc:2749] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:29.900988  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 66775.8us
I20260709 13:15:29.955739  6932 raft_consensus.cc:515] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:29.957935  4071 leader_election.cc:304] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: d709ee666b774ec29aa732e508219938
W20260709 13:15:29.901978  3924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:29.902801  7130 raft_consensus.cc:2749] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:29.917640  4026 rpcz_store.cc:276] 0709 13:15:28.345206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.088662 (+743456us) service_pool.cc:224] Handling call
0709 13:15:29.089137 (+   475us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:29.312729 (+223592us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:29.312777 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:29.313536 (+   759us) log.cc:844] Serialized 52 byte log entry
0709 13:15:29.657922 (+344386us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:29.672200 (+ 14278us) spinlock_profiling.cc:243] Waited 29.9 ms on lock 0x7b48000cda58. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152a597aa1 00007f152a58eb37 00007f152a58e9ca 00007f152a68626f 00007f152a685f37 00007f152a69a55c 00007f152a69a508 00007f152a69a488 00007f152a69a443 00007f152a6996ec 00007f15295c3a96
0709 13:15:29.851712 (+179512us) log.cc:844] Serialized 14 byte log entry
0709 13:15:29.915908 (+ 64196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:29.916081 (+   173us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:29.916196 (+   115us) raft_consensus.cc:1685] finished
0709 13:15:29.916372 (+   176us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:29.916724 (+   352us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":86540,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":8067,"raft.run_cpu_time_us":3233,"raft.run_wall_time_us":353430,"spinlock_wait_cycles":68836096,"thread_start_us":368825,"threads_started":2,"wal-append.queue_time_us":350575}
I20260709 13:15:29.968802  7046 leader_election.cc:290] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:29.970575  7048 leader_election.cc:290] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:29.972770  3922 leader_election.cc:304] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:29.979821  6799 consensus_queue.cc:1048] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:29.980572  7046 raft_consensus.cc:2749] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:30.003073  6932 leader_election.cc:290] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:15:30.008982  3905 auto_rebalancer.cc:629] Failed to schedule move for tablet b1073c870d784f068fdb3f222623f5a3: Illegal state: Replica 8952c48a6f3a43968f7d77f7bfc4d1bc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
W20260709 13:15:30.016831  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 209319us
I20260709 13:15:30.024835  6706 raft_consensus.cc:493] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:30.050992  6706 raft_consensus.cc:515] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:30.051337  7064 raft_consensus.cc:515] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:30.053758  4674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:30.025370  4100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45332 (request call id 1800) took 2789 ms. Trace:
I20260709 13:15:30.061834  7218 raft_consensus.cc:2749] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:30.062906  6935 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:30.063745  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 89118.9us
I20260709 13:15:30.064929  3922 leader_election.cc:304] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:30.065248  7220 raft_consensus.cc:2804] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:30.065871  7220 raft_consensus.cc:493] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
W20260709 13:15:30.066057  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 108426us
I20260709 13:15:30.066196  6935 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:30.067152  4071 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:15:30.067425  4705 raft_consensus.cc:1240] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 8. Current term is 9. Ops: []
W20260709 13:15:30.070942  3997 leader_election.cc:336] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.611s (SENT)
I20260709 13:15:30.056700  4100 rpcz_store.cc:276] 0709 13:15:27.235981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.248563 (+2012582us) service_pool.cc:224] Handling call
0709 13:15:29.248893 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:29.499311 (+250418us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:30.024658 (+525347us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b540042ead4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:30.025175 (+   517us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":573459328}
I20260709 13:15:30.072166  4029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38290 (request call id 1921) took 1706 ms. Trace:
W20260709 13:15:30.074012  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 74201.3us
I20260709 13:15:30.066411  7220 raft_consensus.cc:3060] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:30.092051  7064 leader_election.cc:290] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:30.093075  7064 consensus_queue.cc:1048] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:30.093451  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:30.094890  7064 consensus_queue.cc:1048] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:30.089502  6706 leader_election.cc:290] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:30.090191  7051 consensus_queue.cc:1048] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:30.096127  4700 raft_consensus.cc:1240] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 8. Current term is 9. Ops: []
W20260709 13:15:30.097383  7121 consensus_meta.cc:287] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.846s	user 0.021s	sys 0.000s
I20260709 13:15:30.088374  6836 raft_consensus.cc:2804] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:15:30.099663  3997 leader_election.cc:336] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Timed out: RequestConsensusVote RPC to 127.2.198.193:35339 timed out after 1.611s (SENT)
I20260709 13:15:30.074298  4029 rpcz_store.cc:276] 0709 13:15:28.365382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.109158 (+743776us) service_pool.cc:224] Handling call
0709 13:15:29.109442 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:29.109674 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:15:29.799283 (+689609us) log.cc:844] Serialized 14 byte log entry
0709 13:15:29.999471 (+200188us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:30.004894 (+  5423us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:30.071640 (+ 66746us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:30.071798 (+   158us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:30.071964 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38336,"prepare.queue_time_us":630355,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":70,"raft.queue_time_us":73185,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":144,"thread_start_us":787364,"threads_started":2,"wal-append.queue_time_us":226823}
I20260709 13:15:30.107045  3997 leader_election.cc:304] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:30.115152  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:30.115487  4027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38304 (request call id 2133) took 1678 ms. Trace:
I20260709 13:15:30.115679  6522 raft_consensus.cc:493] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.117550  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:30.120033  4709 raft_consensus.cc:2393] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 10: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
I20260709 13:15:30.120887  7169 consensus_queue.cc:1048] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:15:30.109530  6836 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:30.116334  6522 raft_consensus.cc:515] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:30.138799  4108 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45336 (request call id 1273) took 1672 ms (client timeout 1966 ms). Trace:
I20260709 13:15:30.129179  4702 raft_consensus.cc:1240] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:30.113641  4704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:30.141031  4704 raft_consensus.cc:2393] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 11: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
I20260709 13:15:30.115937  4027 rpcz_store.cc:276] 0709 13:15:28.437097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.142383 (+705286us) service_pool.cc:224] Handling call
0709 13:15:29.142724 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:29.143107 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:15:29.949780 (+806673us) log.cc:844] Serialized 14 byte log entry
0709 13:15:30.063142 (+113362us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:30.064135 (+   993us) log.cc:844] Serialized 26 byte log entry
0709 13:15:30.064301 (+   166us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:30.064338 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:30.064476 (+   138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:30.115211 (+ 50735us) raft_consensus.cc:1685] finished
0709 13:15:30.115229 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:30.115420 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54918,"prepare.queue_time_us":600573,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":67914,"raft.run_cpu_time_us":374,"raft.run_wall_time_us":375,"thread_start_us":853501,"threads_started":2,"wal-append.queue_time_us":127536}
I20260709 13:15:30.141651  6916 consensus_queue.cc:1048] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:15:30.144273  7056 consensus_meta.cc:287] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 1.035s	user 0.019s	sys 0.001s
I20260709 13:15:30.145000  4106 raft_consensus.cc:1240] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:30.144853  7056 raft_consensus.cc:515] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:30.129887  7043 consensus_queue.cc:1048] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:15:30.130443  6839 raft_consensus.cc:3055] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:15:30.132026  6768 consensus_meta.cc:287] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.573s	user 0.003s	sys 0.014s
I20260709 13:15:30.132247  7103 consensus_queue.cc:1048] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:30.133396  4703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:30.136399  6836 raft_consensus.cc:3060] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:30.138463  4071 leader_election.cc:304] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:30.148211  6916 consensus_queue.cc:1048] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:30.158010  6706 raft_consensus.cc:2749] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:30.159356  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:30.159515  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:30.160346  4034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38290 (request call id 1922) took 1778 ms. Trace:
I20260709 13:15:30.151294  6839 raft_consensus.cc:740] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:30.160754  4034 rpcz_store.cc:276] 0709 13:15:28.381517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.128622 (+747105us) service_pool.cc:224] Handling call
0709 13:15:29.129114 (+   492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:29.903655 (+774541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:30.159954 (+256299us) spinlock_profiling.cc:243] Waited 546 ms on lock 0x7b54001d9f54. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:30.160167 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1256401280}
W20260709 13:15:30.139348  4108 rpcz_store.cc:269] 0709 13:15:28.466594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.615680 (+149086us) service_pool.cc:224] Handling call
0709 13:15:30.138240 (+1522560us) spinlock_profiling.cc:243] Waited 902 ms on lock 0x7b54002274d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:30.138537 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2074365696}
I20260709 13:15:30.113751  7182 raft_consensus.cc:515] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:30.154105  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 89415.8us
W20260709 13:15:30.170115  4672 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.198.193:35339 timed out after 1.857s (SENT) [suppressed 22 similar messages]
I20260709 13:15:30.177728  7103 raft_consensus.cc:2749] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:30.181182  4106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34656 (request call id 391) took 2113 ms. Trace:
I20260709 13:15:30.181670  4106 rpcz_store.cc:276] 0709 13:15:28.067757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.251149 (+1183392us) service_pool.cc:224] Handling call
0709 13:15:30.144515 (+893366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:30.145464 (+   949us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:30.180944 (+ 35480us) spinlock_profiling.cc:243] Waited 821 ms on lock 0x7b54002274d0. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566d8ad 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:30.181103 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1888629632}
I20260709 13:15:30.182358  7056 leader_election.cc:290] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:30.153191  7231 raft_consensus.cc:2804] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:15:30.188138  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 105283us
W20260709 13:15:30.188645  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 50350.4us
I20260709 13:15:30.189527  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:30.189702  4071 leader_election.cc:304] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:30.189527  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:30.153159  6768 raft_consensus.cc:515] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:30.192945  7103 raft_consensus.cc:2749] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:30.193524  7182 leader_election.cc:290] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:30.194996  6768 leader_election.cc:290] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:30.188982  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:30.191404  7049 consensus_queue.cc:1048] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:30.196171  7120 consensus_queue.cc:1059] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:15:30.196200  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:30.197283  7120 raft_consensus.cc:3055] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:30.197438  7220 raft_consensus.cc:515] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:30.197762  7120 raft_consensus.cc:740] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:30.196547  4106 raft_consensus.cc:3060] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:15:30.189016  3997 leader_election.cc:336] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.618s (SENT)
W20260709 13:15:30.199082  3997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:30.194865  4071 leader_election.cc:304] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:30.197988  7116 leader_election.cc:290] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:30.196110  3957 raft_consensus.cc:2393] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 8: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:30.161803  6839 consensus_queue.cc:260] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:30.208249  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:30.203872  7231 raft_consensus.cc:697] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 7 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:30.208861  7220 leader_election.cc:290] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:30.214447  4105 raft_consensus.cc:1240] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 LEADER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:30.212673  3922 leader_election.cc:304] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:15:30.226116  7116 raft_consensus.cc:2804] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:30.226977  7116 raft_consensus.cc:697] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:30.233991  7169 consensus_queue.cc:1048] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:15:30.240482  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 70394.7us
I20260709 13:15:30.199301  7120 consensus_queue.cc:260] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:30.237565  4100 raft_consensus.cc:1240] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:30.243515  6839 raft_consensus.cc:3060] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:30.243837  4704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:30.250173  7093 raft_consensus.cc:3055] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:30.250741  7093 raft_consensus.cc:740] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
W20260709 13:15:30.251006  7114 consensus_meta.cc:287] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 0.676s	user 0.009s	sys 0.009s
I20260709 13:15:30.251737  4034 raft_consensus.cc:2468] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 9.
I20260709 13:15:30.223625  7145 consensus_queue.cc:1059] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:15:30.251993  7093 consensus_queue.cc:260] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:30.253132  7145 raft_consensus.cc:3055] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:30.253592  7145 raft_consensus.cc:740] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:30.247116  7231 consensus_queue.cc:237] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:30.259938  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 47394us
I20260709 13:15:30.261267  3922 leader_election.cc:304] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:30.261441  4704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:30.262182  4704 raft_consensus.cc:2468] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 11.
I20260709 13:15:30.262588  7120 raft_consensus.cc:3060] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:30.263821  3924 leader_election.cc:304] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:30.265098  6522 leader_election.cc:290] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:30.269562  7121 consensus_queue.cc:1059] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:30.277105  7121 raft_consensus.cc:3055] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:30.277527  7121 raft_consensus.cc:740] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:30.277568  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:30.278647  7121 consensus_queue.cc:260] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:30.271731  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:30.271978  7049 consensus_queue.cc:1059] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:15:30.280552  3997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:30.280831  7049 raft_consensus.cc:3055] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:30.281301  7049 raft_consensus.cc:740] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:30.272298  4027 raft_consensus.cc:1240] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:30.271775  7051 consensus_queue.cc:1059] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:30.282379  7049 consensus_queue.cc:260] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:30.283329  4030 raft_consensus.cc:1240] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:15:30.283753  7051 raft_consensus.cc:3055] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:30.284224  7051 raft_consensus.cc:740] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:30.284493  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:30.285296  4029 raft_consensus.cc:3060] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:30.285435  7051 consensus_queue.cc:260] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:30.287031  7051 raft_consensus.cc:3060] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:30.288029  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:30.288730  4032 raft_consensus.cc:3060] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:30.290792  7226 raft_consensus.cc:515] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:30.288069  6706 raft_consensus.cc:493] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.292171  6706 raft_consensus.cc:515] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:30.292773  7048 raft_consensus.cc:2804] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:30.293207  7048 raft_consensus.cc:493] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:30.293561  7048 raft_consensus.cc:3060] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:30.293785  7226 leader_election.cc:290] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:30.295060  6706 leader_election.cc:290] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:30.279946  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:30.296721  4704 raft_consensus.cc:1240] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 6. Current term is 7. Ops: []
W20260709 13:15:30.302474  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 53967.5us
I20260709 13:15:30.308359  4106 raft_consensus.cc:2468] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 10.
I20260709 13:15:30.309729  4029 raft_consensus.cc:2468] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7.
I20260709 13:15:30.254127  7093 raft_consensus.cc:3060] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:30.315471  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 120752us
I20260709 13:15:30.230410  7116 consensus_queue.cc:237] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:30.321024  4073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 69153.7us
I20260709 13:15:30.323094  4704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:30.313599  7056 raft_consensus.cc:2804] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:30.325814  6768 consensus_queue.cc:1059] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:15:30.328179  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:30.328557  7094 consensus_queue.cc:1059] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:30.255000  7145 consensus_queue.cc:260] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:30.336941  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:30.338984  6768 raft_consensus.cc:3055] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:30.339529  6768 raft_consensus.cc:740] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:30.339839  4030 raft_consensus.cc:1275] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:15:30.340579  6768 consensus_queue.cc:260] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:30.341965  6768 raft_consensus.cc:3060] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:30.332012  7049 raft_consensus.cc:3060] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:30.334600  7220 consensus_queue.cc:1059] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:15:30.348467  6522 raft_consensus.cc:493] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.348745  7220 raft_consensus.cc:3055] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:30.352128  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:30.349175  6522 raft_consensus.cc:515] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:30.347311  7185 consensus_queue.cc:260] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:30.358892  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 69710.9us
W20260709 13:15:30.359231  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 98184.9us
I20260709 13:15:30.330505  7056 raft_consensus.cc:493] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:30.349229  7220 raft_consensus.cc:740] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:30.331568  7169 raft_consensus.cc:2749] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:30.367612  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:30.371328  7129 raft_consensus.cc:493] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:30.372043  7129 raft_consensus.cc:515] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:30.372627  6967 consensus_queue.cc:1059] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:15:30.373570  6967 consensus_queue.cc:1243] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Peer 8952c48a6f3a43968f7d77f7bfc4d1bc log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:15:30.376680  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:30.376878  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:30.377993  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:30.378135  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:30.379179  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:30.364334  7056 raft_consensus.cc:3060] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:30.384436  4672 leader_election.cc:304] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:30.386189  4029 raft_consensus.cc:3060] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:30.392599  7145 raft_consensus.cc:3060] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:30.401185  4032 raft_consensus.cc:2468] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9.
W20260709 13:15:30.403077  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 79165.5us
I20260709 13:15:30.400436  7214 raft_consensus.cc:2804] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:30.405547  7214 raft_consensus.cc:697] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 10 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:30.406584  7214 consensus_queue.cc:237] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:30.408718  3922 leader_election.cc:304] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:30.409932  7231 consensus_queue.cc:1059] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:30.410998  7231 consensus_queue.cc:1059] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:30.406824  7048 raft_consensus.cc:515] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:30.412568  7231 raft_consensus.cc:2749] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:30.413303  7231 raft_consensus.cc:3055] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:30.413657  7231 raft_consensus.cc:740] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:30.414651  7208 raft_consensus.cc:3055] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:30.414697  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:30.415248  7208 raft_consensus.cc:740] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:30.415498  4705 raft_consensus.cc:3060] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:30.416258  7208 consensus_queue.cc:260] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:30.416946  6522 leader_election.cc:290] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:30.417953  7208 raft_consensus.cc:3060] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:30.421025  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:15:30.421607  7238 log.cc:927] Time spent T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.270s	user 0.004s	sys 0.000s
I20260709 13:15:30.423020  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:30.423992  4028 raft_consensus.cc:2468] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 8.
W20260709 13:15:30.425264  7240 log.cc:927] Time spent T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 13:15:30.393237  7220 consensus_queue.cc:260] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:30.428339  7220 raft_consensus.cc:3060] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:30.432413  3856 catalog_manager.cc:5697] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 reported cstate change: term changed from 3 to 5, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to d709ee666b774ec29aa732e508219938 (127.2.198.196). New cstate: current_term: 5 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:30.437775  7185 raft_consensus.cc:3060] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:30.437992  4107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45332 (request call id 1795) took 3253 ms. Trace:
W20260709 13:15:30.439980  7244 log.cc:927] Time spent T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:15:30.438472  4107 rpcz_store.cc:276] 0709 13:15:27.185626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.236896 (+2051270us) service_pool.cc:224] Handling call
0709 13:15:29.237382 (+   486us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:29.489726 (+252344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:29.489780 (+    54us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:29.490635 (+   855us) log.cc:844] Serialized 52 byte log entry
0709 13:15:30.140940 (+650305us) spinlock_profiling.cc:243] Waited 8.22 ms on lock 0x7b18003ad2c0. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f1522563e07 00007f152b3beab9 00007f152258069b 00007f152257e93f 00007f1522580c02 00007f152520820b 00007f152520dd23 00007f152520e0d1 00007f1525629a0f
0709 13:15:30.223044 (+ 82104us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:30.313191 (+ 90147us) log.cc:844] Serialized 14 byte log entry
0709 13:15:30.423189 (+109998us) spinlock_profiling.cc:243] Waited 1.19 ms on lock 0x7b18003ad2c0. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f15224fbc0a 00007f152bc3b219 00007f1522583a40 00007f152257e4e4 00007f152257e455 00007f15290663c7 00007f15256789a7 00007f15256880bf 00007f1525688038
0709 13:15:30.430721 (+  7532us) spinlock_profiling.cc:243] Waited 2.96 ms on lock 0x7b18003ad2c0. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f1522581522 00007f15225837c1 00007f1522583779 00007f1522583709 00007f15225836d1 00007f15225829cd 000000000038f354 000000000038f199 00007f152256483a
0709 13:15:30.436235 (+  5514us) log.cc:844] Serialized 14 byte log entry
0709 13:15:30.437459 (+  1224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:30.437570 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:30.437615 (+    45us) raft_consensus.cc:1685] finished
0709 13:15:30.437625 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:30.437782 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":376288,"prepare.queue_time_us":176301,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":3197,"raft.queue_time_us":238240,"raft.run_cpu_time_us":507,"raft.run_wall_time_us":19301,"spinlock_wait_cycles":28434304,"thread_start_us":34154,"threads_started":1,"wal-append.queue_time_us":726620}
I20260709 13:15:30.440455  7121 raft_consensus.cc:3060] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:30.443431  4033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41312 (request call id 412) took 1264 ms. Trace:
I20260709 13:15:30.443727  3952 raft_consensus.cc:1275] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:15:30.443867  4033 rpcz_store.cc:276] 0709 13:15:29.179317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.610689 (+431372us) service_pool.cc:224] Handling call
0709 13:15:29.656592 (+ 45903us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:29.932781 (+276189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:30.443140 (+510359us) spinlock_profiling.cc:243] Waited 275 ms on lock 0x7b54000483d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:30.443371 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":632546048}
I20260709 13:15:30.445272  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:30.449510  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:30.449605  7231 consensus_queue.cc:260] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:30.451956  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:30.452955  3955 raft_consensus.cc:2393] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 8: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:30.453066  3922 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:30.435209  3856 catalog_manager.cc:5697] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 reported cstate change: term changed from 4 to 6, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to d709ee666b774ec29aa732e508219938 (127.2.198.196). New cstate: current_term: 6 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:30.459875  7129 leader_election.cc:290] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:30.454874  3997 leader_election.cc:400] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Vote denied by peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339) with higher term. Message: Invalid argument: T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 8. Current term is 9.
I20260709 13:15:30.474499  3925 leader_election.cc:304] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:30.477423  4029 raft_consensus.cc:2468] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 8.
I20260709 13:15:30.479089  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:30.451936  7231 raft_consensus.cc:3060] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:30.456487  7048 leader_election.cc:290] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 election: Requested vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:30.488147  7226 raft_consensus.cc:2804] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:30.488409  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:30.488924  7226 raft_consensus.cc:697] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 7 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:30.489416  3955 raft_consensus.cc:2393] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 8: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:30.490469  3925 leader_election.cc:304] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:30.494606  4705 raft_consensus.cc:2468] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 12.
I20260709 13:15:30.496779  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:30.507390  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:30.508234  3955 raft_consensus.cc:2468] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 8.
I20260709 13:15:30.505914  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:30.516844  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:15:30.518748  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 65816.3us
I20260709 13:15:30.525601  3957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38612 (request call id 1253) took 1181 ms. Trace:
I20260709 13:15:30.509709  7048 raft_consensus.cc:2749] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:30.495182  6836 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:30.528046  3957 rpcz_store.cc:276] 0709 13:15:29.333679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.333863 (+   184us) service_pool.cc:224] Handling call
0709 13:15:30.506195 (+1172332us) spinlock_profiling.cc:243] Waited 805 ms on lock 0x7b54003ef654. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:30.514549 (+  8354us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1851865344}
I20260709 13:15:30.533797  4029 raft_consensus.cc:1275] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:15:30.536026  3955 raft_consensus.cc:1275] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:15:30.550912  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:15:30.554914  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 168953us
W20260709 13:15:30.563282  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:30.555044  6976 raft_consensus.cc:2749] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:30.572638  4029 pending_rounds.cc:85] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2: Aborting all ops after (but not including) 7
W20260709 13:15:30.578369  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:30.574697  4029 pending_rounds.cc:107] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:15:30.581105  4029 raft_consensus.cc:2889] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:30.582602  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:30.583487  3955 raft_consensus.cc:2368] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 11. Current term is 12.
I20260709 13:15:30.583377  3856 catalog_manager.cc:5697] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 reported cstate change: term changed from 2 to 7, leader changed from 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) to d709ee666b774ec29aa732e508219938 (127.2.198.196). New cstate: current_term: 7 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:15:30.584371  7245 log.cc:927] Time spent T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 13:15:30.585551  3856 catalog_manager.cc:5697] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 reported cstate change: term changed from 3 to 8, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 8 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
W20260709 13:15:30.586525  7246 log.cc:927] Time spent T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:15:30.593014  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:30.594161  4108 raft_consensus.cc:1240] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:30.594172  4675 leader_election.cc:304] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:30.602988  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:30.559381  7045 consensus_queue.cc:1048] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 13:15:30.608294  3925 leader_election.cc:304] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:30.612232  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:30.613411  3997 leader_election.cc:304] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:30.614192  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:30.610112  6967 raft_consensus.cc:2804] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:30.539840  4107 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:15:30.564000  7226 consensus_queue.cc:237] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:30.615513  4028 raft_consensus.cc:2410] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:15:30.633224  4704 raft_consensus.cc:1275] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:30.634534  4033 raft_consensus.cc:1240] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 13:15:30.644196  3922 leader_election.cc:304] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:30.649471  4034 raft_consensus.cc:2393] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 8: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
W20260709 13:15:30.633260  4674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:30.656322  3952 raft_consensus.cc:2410] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:15:30.657155  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 48982.8us
I20260709 13:15:30.658103  3925 leader_election.cc:304] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:30.624291  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:15:30.663673  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:30.661032  3950 raft_consensus.cc:2468] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 8.
I20260709 13:15:30.633387  3856 catalog_manager.cc:5697] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 reported cstate change: term changed from 2 to 5, leader changed from 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) to d709ee666b774ec29aa732e508219938 (127.2.198.196). New cstate: current_term: 5 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:30.678184  4108 raft_consensus.cc:1240] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:30.633816  4107 raft_consensus.cc:606] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Received request to transfer leadership to TS 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:30.679916  4107 raft_consensus.cc:614] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:30.620462  6967 raft_consensus.cc:493] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:30.637298  7182 raft_consensus.cc:3055] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:30.694705  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:30.621634  6836 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:30.661479  7145 raft_consensus.cc:2764] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:15:30.707480  4105 raft_consensus.cc:1240] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:30.603996  7056 raft_consensus.cc:515] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:30.716763  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:30.628536  7215 consensus_queue.cc:1059] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 13:15:30.697872  6967 raft_consensus.cc:3060] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:30.706240  7169 raft_consensus.cc:2804] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:30.697090  7182 raft_consensus.cc:740] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:30.718322  7046 raft_consensus.cc:2804] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:30.744666  4100 raft_consensus.cc:1240] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:30.699697  7185 consensus_queue.cc:1059] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:15:30.751905  4102 raft_consensus.cc:1275] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:15:30.755993  3856 catalog_manager.cc:5697] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 reported cstate change: term changed from 5 to 6, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 6 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:15:30.758476  3950 raft_consensus.cc:2393] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 7: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:30.732487  7048 raft_consensus.cc:2804] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:30.711581  7114 consensus_queue.cc:1059] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:15:30.766917  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
W20260709 13:15:30.763706  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 119719us
W20260709 13:15:30.777783  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:30.796764  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:30.769851  4108 raft_consensus.cc:1275] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:15:30.796690  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:30.802636  7115 consensus_queue.cc:1048] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:15:30.806695  6836 consensus_queue.cc:1048] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:30.807503  6836 consensus_queue.cc:1243] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer f1c75790cedf4f52a3463a255c7da059 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:15:30.808537  4099 raft_consensus.cc:1275] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:15:30.809862  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:30.810549  3955 raft_consensus.cc:3060] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:30.807507  4025 raft_consensus.cc:3060] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:15:30.811650  4100 raft_consensus.cc:3060] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:30.818815  4025 raft_consensus.cc:2468] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 8.
I20260709 13:15:30.823156  4100 raft_consensus.cc:2468] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 11.
W20260709 13:15:30.827807  7256 log.cc:927] Time spent T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:15:30.824856  4071 leader_election.cc:304] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:30.746688  7064 consensus_queue.cc:1059] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:15:30.835566  7115 raft_consensus.cc:2804] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:30.836098  7115 raft_consensus.cc:493] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:30.836550  7115 raft_consensus.cc:3060] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:30.840188  4071 leader_election.cc:400] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: Vote denied by peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339) with higher term. Message: Invalid argument: T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 11. Current term is 12.
I20260709 13:15:30.840730  4071 leader_election.cc:403] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:30.842010  4071 leader_election.cc:304] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:30.842765  7220 consensus_queue.cc:1048] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:30.843673  7129 raft_consensus.cc:493] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.843684  6836 raft_consensus.cc:3060] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Advancing to term 12
W20260709 13:15:30.852788  3855 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52104 (request call id 203) took 14248 ms (client timeout 15000 ms). Trace:
I20260709 13:15:30.803567  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:30.826393  6967 raft_consensus.cc:515] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:30.863590  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 159328us
I20260709 13:15:30.765697  7169 raft_consensus.cc:697] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:30.873113  3925 leader_election.cc:304] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:30.873361  3924 leader_election.cc:304] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:15:30.874135  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 73783.2us
I20260709 13:15:30.875031  3955 raft_consensus.cc:2468] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 9.
I20260709 13:15:30.794458  3856 catalog_manager.cc:5697] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 reported cstate change: leader changed from <none> to d709ee666b774ec29aa732e508219938 (127.2.198.196). New cstate: current_term: 7 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:30.879009  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:30.880963  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:30.882055  7043 raft_consensus.cc:2804] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:30.883766  3955 raft_consensus.cc:1240] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 7 LEADER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:15:30.884245  7043 raft_consensus.cc:493] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:30.896486  7043 raft_consensus.cc:3060] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:30.891606  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:30.899011  3856 catalog_manager.cc:5697] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 reported cstate change: term changed from 4 to 6, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to d709ee666b774ec29aa732e508219938 (127.2.198.196). New cstate: current_term: 6 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:30.900240  4104 raft_consensus.cc:2468] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7.
I20260709 13:15:30.905076  6967 leader_election.cc:290] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:30.884311  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:30.908551  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:30.911952  7094 raft_consensus.cc:3055] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:30.912369  7094 raft_consensus.cc:740] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:30.913326  7094 consensus_queue.cc:260] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:30.913581  7115 raft_consensus.cc:515] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:30.914683  7094 raft_consensus.cc:3060] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:30.870133  7129 raft_consensus.cc:515] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:30.917017  7145 raft_consensus.cc:3055] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:30.917429  7145 raft_consensus.cc:740] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:30.918386  7145 consensus_queue.cc:260] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:30.918840  7129 leader_election.cc:290] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:30.914705  3997 leader_election.cc:400] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: Vote denied by peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843) with higher term. Message: Invalid argument: T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 6. Current term is 7.
I20260709 13:15:30.931169  4104 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:15:30.932164  4104 raft_consensus.cc:606] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Received request to transfer leadership to TS 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:30.932750  4104 raft_consensus.cc:614] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:30.888459  7056 leader_election.cc:290] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Requested vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:30.940475  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
W20260709 13:15:30.862102  3855 rpcz_store.cc:269] 0709 13:15:16.604356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:16.604625 (+   269us) service_pool.cc:224] Handling call
0709 13:15:30.852459 (+14247834us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:24.193173 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:24.194009 (+   836us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:24.194070 (+    61us) write_op.cc:435] Acquired schema lock
0709 13:15:24.194092 (+    22us) tablet.cc:662] Decoding operations
0709 13:15:24.348661 (+154569us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:24.351244 (+  2583us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:24.354469 (+  3225us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:15:24.422473 (+ 68004us) tablet.cc:701] Row locks acquired
0709 13:15:24.429290 (+  6817us) write_op.cc:260] PREPARE: finished
0709 13:15:24.475874 (+ 46584us) write_op.cc:270] Start()
0709 13:15:24.534724 (+ 58850us) write_op.cc:276] Timestamp: P: 1783602924475801 usec, L: 0
0709 13:15:24.534750 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:15:24.535535 (+   785us) log.cc:844] Serialized 5586 byte log entry
0709 13:15:26.173917 (+1638382us) spinlock_profiling.cc:243] Waited 3.73 ms on lock 0x7b4400022b4c. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f15224a7c85 00007f15224a86a2 00007f152521a1db 00007f1525215aaf 00007f152520986e 00007f1525208bb6 00007f15252087d8 00007f1525212221 00007f15252121d9 00007f1525212169
0709 13:15:27.035839 (+861922us) op_driver.cc:464] REPLICATION: finished
0709 13:15:27.244781 (+208942us) write_op.cc:301] APPLY: starting
0709 13:15:27.247723 (+  2942us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:27.339211 (+ 91488us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:27.343261 (+  4050us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:27.360914 (+ 17653us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:27.361182 (+   268us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 13:15:27.361226 (+    44us) write_op.cc:312] APPLY: finished
0709 13:15:27.361574 (+   348us) log.cc:844] Serialized 101 byte log entry
0709 13:15:27.361788 (+   214us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:27.361949 (+   161us) write_op.cc:454] Released schema lock
0709 13:15:27.362005 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:27.362409 (+   404us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:27.362435 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3945,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":197607,"apply.run_cpu_time_us":4389,"apply.run_wall_time_us":125409,"num_ops":14,"prepare.queue_time_us":502513,"prepare.run_cpu_time_us":49441,"prepare.run_wall_time_us":614888,"raft.queue_time_us":493051,"raft.run_cpu_time_us":5055,"raft.run_wall_time_us":173094,"replication_time_us":2473246,"spinlock_wait_cycles":8577920,"thread_start_us":836488,"threads_started":4,"wal-append.queue_time_us":400745,"wal-append.run_cpu_time_us":76935,"wal-append.run_wall_time_us":3397056}]]}
I20260709 13:15:30.929479  6935 consensus_queue.cc:1059] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:15:30.953970  7215 raft_consensus.cc:3055] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:30.954496  7215 raft_consensus.cc:740] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:30.955771  7215 consensus_queue.cc:260] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:30.956295  7129 consensus_queue.cc:1048] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:30.956507  3997 leader_election.cc:304] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:15:30.957276  7215 raft_consensus.cc:3060] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:30.958945  3997 leader_election.cc:304] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:30.957647  7114 raft_consensus.cc:2804] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:30.960011  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:30.962065  6836 raft_consensus.cc:2749] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339) with higher term. Message: Invalid argument: T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 11. Current term is 12.
I20260709 13:15:30.933301  7220 raft_consensus.cc:493] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:30.967450  4105 raft_consensus.cc:3060] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:30.970968  3997 leader_election.cc:304] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:30.971055  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:30.941210  7145 raft_consensus.cc:3060] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:30.975180  2843 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:15:30.971719  7115 leader_election.cc:290] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:30.978448  2843 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:30.970837  7129 raft_consensus.cc:2804] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:30.980018  7129 raft_consensus.cc:493] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:30.980487  7129 raft_consensus.cc:3060] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:30.980700  7185 raft_consensus.cc:493] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.981217  7185 raft_consensus.cc:515] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:30.983351  7185 leader_election.cc:290] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:30.987116  4102 raft_consensus.cc:1275] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:15:30.964509  7114 raft_consensus.cc:493] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:30.992542  4104 raft_consensus.cc:2393] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 9: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:30.991714  4103 raft_consensus.cc:2468] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 8.
I20260709 13:15:30.996758  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:31.000947  4106 raft_consensus.cc:3060] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:30.988456  7220 raft_consensus.cc:515] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:30.992235  7114 raft_consensus.cc:3060] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:31.008394  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:31.011526  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:31.012722  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:31.020007  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 49200.6us
W20260709 13:15:31.020418  4672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:31.021286  4108 raft_consensus.cc:2468] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 8.
I20260709 13:15:31.022930  4026 raft_consensus.cc:1240] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:15:31.024371  7046 raft_consensus.cc:697] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 8 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:30.940505  7169 consensus_queue.cc:237] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:31.025492  7046 consensus_queue.cc:237] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:31.030915  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 157908us
W20260709 13:15:31.032325  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 209903us
I20260709 13:15:31.032648  3925 leader_election.cc:304] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:31.033216  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:31.026916  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:31.028018  7048 raft_consensus.cc:697] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 8 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:31.028661  7059 raft_consensus.cc:3055] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:15:31.047842  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:31.050889  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:31.071215  4674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:31.072832  4107 raft_consensus.cc:2393] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 11: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:31.075177  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:31.079527  3952 raft_consensus.cc:1240] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:15:31.079905  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:31.082579  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:31.083870  4674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:31.079130  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:31.086234  4034 raft_consensus.cc:3060] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:31.086604  4099 raft_consensus.cc:3060] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:31.014950  7115 raft_consensus.cc:493] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:31.090840  4025 raft_consensus.cc:1240] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:31.004284  6967 consensus_queue.cc:1048] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.054s
W20260709 13:15:31.093267  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 220020us
I20260709 13:15:31.094728  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:31.095518  4104 raft_consensus.cc:2393] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 7: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:31.097468  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:31.041086  7059 raft_consensus.cc:740] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:31.105840  4030 raft_consensus.cc:2468] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 6.
I20260709 13:15:31.102780  4029 raft_consensus.cc:1275] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:15:31.105044  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:31.072492  6768 raft_consensus.cc:2749] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:31.108207  4675 leader_election.cc:304] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:31.111423  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:31.114459  3997 leader_election.cc:304] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:15:31.114853  3950 raft_consensus.cc:1275] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:31.115057  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:31.031406  7182 consensus_queue.cc:260] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:31.116672  7208 raft_consensus.cc:2804] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:31.116621  7271 consensus_queue.cc:1059] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:31.117372  7208 raft_consensus.cc:697] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 8 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:31.112057  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:31.122139  3957 raft_consensus.cc:3060] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:31.123706  4026 raft_consensus.cc:1275] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:31.124459  7043 raft_consensus.cc:515] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:31.126786  7043 leader_election.cc:290] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:31.126965  7220 leader_election.cc:290] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:31.101414  7115 raft_consensus.cc:515] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:31.129019  4071 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:15:31.130194  7115 leader_election.cc:290] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:31.130395  4071 leader_election.cc:304] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:31.130792  7115 raft_consensus.cc:2804] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:31.131814  7169 raft_consensus.cc:2804] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:31.132402  7169 raft_consensus.cc:697] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 12 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:31.133440  7169 consensus_queue.cc:237] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:31.138202  4100 raft_consensus.cc:2393] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 8: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:31.139056  4105 raft_consensus.cc:2468] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 10.
I20260709 13:15:31.145561  4030 raft_consensus.cc:2393] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 8: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:31.147192  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:31.130704  7280 raft_consensus.cc:2804] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:31.099761  7226 consensus_queue.cc:1048] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:15:31.120209  7185 raft_consensus.cc:2804] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:31.203670  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:31.204604  4030 raft_consensus.cc:3060] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:31.141377  6836 raft_consensus.cc:2749] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:31.177745  7280 raft_consensus.cc:493] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:31.116722  6768 consensus_queue.cc:1048] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.080s
I20260709 13:15:31.228744  4106 raft_consensus.cc:2468] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 8.
I20260709 13:15:31.150444  7115 raft_consensus.cc:697] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:31.196247  7185 raft_consensus.cc:493] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:31.246500  4073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 102476us
I20260709 13:15:31.133448  7208 consensus_queue.cc:237] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:31.219743  7281 raft_consensus.cc:2804] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:31.224874  7280 raft_consensus.cc:3060] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:31.240737  7185 raft_consensus.cc:3060] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:31.258962  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 225428us
I20260709 13:15:31.149600  7048 consensus_queue.cc:237] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:31.263453  3956 pending_rounds.cc:85] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059: Aborting all ops after (but not including) 3
I20260709 13:15:31.266806  3956 pending_rounds.cc:107] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:15:31.267077  3956 raft_consensus.cc:2889] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:31.267021  4099 raft_consensus.cc:2468] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 6.
W20260709 13:15:31.252485  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 199204us
I20260709 13:15:31.238166  6836 consensus_queue.cc:1059] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.023s
W20260709 13:15:31.271842  3925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:31.286154  4033 raft_consensus.cc:1275] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:15:31.259002  7281 raft_consensus.cc:493] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:31.289582  4033 raft_consensus.cc:1275] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:15:31.289253  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 112023us
W20260709 13:15:31.318240  7277 log.cc:927] Time spent T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:15:31.323702  7115 consensus_queue.cc:237] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:31.340461  4034 raft_consensus.cc:2468] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 10.
I20260709 13:15:31.233520  7059 consensus_queue.cc:260] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:31.316012  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:31.310425  7281 raft_consensus.cc:3060] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:15:31.352160  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 237804us
I20260709 13:15:31.376446  3997 leader_election.cc:304] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:31.387038  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 76998.7us
I20260709 13:15:31.382184  6836 consensus_queue.cc:1243] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer f1c75790cedf4f52a3463a255c7da059 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:15:31.384183  7059 raft_consensus.cc:3060] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:31.443455  4672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:31.447386  3922 leader_election.cc:304] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
W20260709 13:15:31.448585  4673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:31.449155  4673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:31.449671  7287 raft_consensus.cc:2749] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:31.454635  3957 raft_consensus.cc:2468] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 9.
I20260709 13:15:31.451721  7295 consensus_queue.cc:1048] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:31.486430  3922 leader_election.cc:304] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:31.489564  3922 leader_election.cc:304] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:31.494166  3922 leader_election.cc:304] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:31.413125  6522 consensus_queue.cc:1048] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.053s
W20260709 13:15:31.496253  7129 consensus_meta.cc:287] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 0.515s	user 0.012s	sys 0.001s
W20260709 13:15:31.511657  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:31.512305  4674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:31.527750  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 113887us
I20260709 13:15:31.535774  7064 raft_consensus.cc:493] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:31.536559  7301 log.cc:927] Time spent T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:15:31.536391  7064 raft_consensus.cc:515] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:31.536319  7169 raft_consensus.cc:2749] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:31.537848  7169 raft_consensus.cc:2749] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:31.539115  7169 raft_consensus.cc:2749] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:31.541052  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:31.541703  4105 raft_consensus.cc:2468] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 9.
W20260709 13:15:31.548789  4674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:31.499362  7302 consensus_queue.cc:1048] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:15:31.543677  4672 leader_election.cc:304] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
W20260709 13:15:31.560105  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 65941.4us
W20260709 13:15:31.565825  7296 log.cc:927] Time spent T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:15:31.534198  7308 consensus_queue.cc:1059] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
W20260709 13:15:31.577265  7284 log.cc:927] Time spent T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.399s	user 0.001s	sys 0.000s
W20260709 13:15:31.541733  7259 log.cc:927] Time spent T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.655s	user 0.003s	sys 0.004s
I20260709 13:15:31.522898  7316 raft_consensus.cc:2804] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:31.510887  7129 raft_consensus.cc:515] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:31.587503  4672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:31.587894  4030 raft_consensus.cc:2468] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 9.
I20260709 13:15:31.539386  7064 leader_election.cc:290] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:31.648132  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 64563.2us
I20260709 13:15:31.527330  7288 consensus_queue.cc:1059] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.197s
I20260709 13:15:31.575362  7182 raft_consensus.cc:3060] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:31.585244  7114 consensus_meta.cc:287] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 0.539s	user 0.012s	sys 0.001s
I20260709 13:15:31.529695  7270 consensus_queue.cc:1048] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.200s
I20260709 13:15:31.726500  4033 raft_consensus.cc:1240] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 5. Current term is 6. Ops: []
W20260709 13:15:31.721263  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 267631us
I20260709 13:15:31.588867  7214 raft_consensus.cc:2804] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:15:31.778729  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 121138us
I20260709 13:15:31.669582  7308 raft_consensus.cc:493] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:31.834486  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 423508us
I20260709 13:15:31.836045  4071 leader_election.cc:304] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:15:31.847512  4673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:31.850867  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 64329.4us
I20260709 13:15:31.793211  7214 raft_consensus.cc:493] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:31.858580  3955 raft_consensus.cc:1240] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:31.854274  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:31.819726  7287 raft_consensus.cc:493] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.837639  7299 raft_consensus.cc:493] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:31.778051  7114 raft_consensus.cc:515] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:31.886094  7304 raft_consensus.cc:3055] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:31.886581  3953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 2004) took 1160 ms. Trace:
W20260709 13:15:31.887676  7312 log.cc:927] Time spent T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:15:31.853272  7316 raft_consensus.cc:697] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 11 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:31.863521  7214 raft_consensus.cc:3060] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:31.903023  7298 raft_consensus.cc:493] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:31.905967  3951 raft_consensus.cc:1275] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:15:31.908026  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:31.913878  7298 raft_consensus.cc:515] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:31.914795  7306 raft_consensus.cc:2804] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:31.916241  7298 leader_election.cc:290] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:31.908241  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:31.917066  3959 raft_consensus.cc:2468] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 7.
I20260709 13:15:31.893097  7304 raft_consensus.cc:740] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:31.918282  7304 consensus_queue.cc:260] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:31.920426  4672 leader_election.cc:336] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Timed out: RequestConsensusVote RPC to 127.2.198.193:35339 timed out after 1.510s (SENT)
I20260709 13:15:31.923854  7114 leader_election.cc:290] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: Requested vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:31.925027  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:31.926771  7290 raft_consensus.cc:493] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.927788  3997 leader_election.cc:304] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:31.887984  7299 raft_consensus.cc:515] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:31.928889  3997 leader_election.cc:304] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:31.924566  4031 raft_consensus.cc:1240] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:31.930811  7299 leader_election.cc:290] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:31.933094  7288 raft_consensus.cc:493] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:31.933637  7288 raft_consensus.cc:515] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:31.934386  4030 raft_consensus.cc:1275] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:15:31.923951  7318 consensus_queue.cc:1048] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:31.936455  7318 raft_consensus.cc:493] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.936985  7318 raft_consensus.cc:515] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:31.876022  7049 consensus_queue.cc:1048] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 13:15:31.937928  7129 leader_election.cc:290] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:31.938859  7129 raft_consensus.cc:3060] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:31.939373  7215 consensus_meta.cc:287] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938: Time spent flushing consensus metadata: real 0.976s	user 0.009s	sys 0.005s
I20260709 13:15:31.927296  7290 raft_consensus.cc:515] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:31.944339  4031 raft_consensus.cc:1275] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:15:31.893317  3953 rpcz_store.cc:276] 0709 13:15:30.620746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:30.623673 (+  2927us) service_pool.cc:224] Handling call
0709 13:15:30.624133 (+   460us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:30.745910 (+121777us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:30.745952 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:30.764016 (+ 18064us) log.cc:844] Serialized 26 byte log entry
0709 13:15:30.998434 (+234418us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:31.379052 (+380618us) spinlock_profiling.cc:243] Waited 8.93 ms on lock 0x7b48002dc6d8. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152a597aa1 00007f152a58eb37 00007f152a58e9ca 00007f152a68626f 00007f152a685f37 00007f152a69a55c 00007f152a69a508 00007f152a69a488 00007f152a69a443 00007f152a6996ec 00007f15295c3a96
0709 13:15:31.430241 (+ 51189us) log.cc:844] Serialized 14 byte log entry
0709 13:15:31.571387 (+141146us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b2400120cf8. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f15224079c4 00007f1522405acb 00007f15225c0dc9 00007f15225c0a55 00007f15225bffb0 00007f1525236488 00007f1525236be8 00007f152520e398 00007f152520976a 00007f1525208bb6
0709 13:15:31.584582 (+ 13195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:31.584674 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:31.781009 (+196335us) raft_consensus.cc:1685] finished
0709 13:15:31.781034 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:31.781215 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":573535,"prepare.queue_time_us":431829,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":190977,"raft.run_cpu_time_us":5085,"raft.run_wall_time_us":635387,"spinlock_wait_cycles":50966272,"thread_start_us":225719,"threads_started":2,"wal-append.queue_time_us":335381}
I20260709 13:15:31.946584  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:31.919332  7304 raft_consensus.cc:3060] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:31.949714  3954 consensus_meta.cc:287] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.602s	user 0.009s	sys 0.001s
I20260709 13:15:31.950181  3954 raft_consensus.cc:2468] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 8.
W20260709 13:15:31.944409  7317 log.cc:927] Time spent T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:15:31.952356  3956 raft_consensus.cc:1275] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:15:31.951965  3954 raft_consensus.cc:1240] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:15:31.960655  3950 raft_consensus.cc:1240] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
W20260709 13:15:31.927139  7145 consensus_meta.cc:287] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 0.939s	user 0.012s	sys 0.000s
I20260709 13:15:31.959297  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:31.958241  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:31.972811  3955 raft_consensus.cc:1240] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 5. Current term is 6. Ops: []
W20260709 13:15:31.985138  4674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:31.989933  4026 raft_consensus.cc:2468] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 8.
I20260709 13:15:32.001519  3956 raft_consensus.cc:1240] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:32.005532  3925 leader_election.cc:304] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:15:32.006588  4673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:32.007874  4028 raft_consensus.cc:2468] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 8.
I20260709 13:15:32.005347  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:15:31.971714  7094 consensus_meta.cc:287] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938: Time spent flushing consensus metadata: real 1.057s	user 0.012s	sys 0.004s
W20260709 13:15:31.980304  7185 consensus_meta.cc:287] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938: Time spent flushing consensus metadata: real 0.705s	user 0.013s	sys 0.000s
I20260709 13:15:31.970091  7299 raft_consensus.cc:2804] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:31.954649  7288 leader_election.cc:290] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:32.007236  7059 consensus_meta.cc:287] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938: Time spent flushing consensus metadata: real 0.597s	user 0.011s	sys 0.000s
I20260709 13:15:31.968883  7306 raft_consensus.cc:697] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:31.863525  7308 raft_consensus.cc:515] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:32.026216  7308 leader_election.cc:290] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:32.028110  7316 consensus_queue.cc:237] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:32.028062  7306 consensus_queue.cc:237] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:32.034741  3952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 2011) took 1411 ms. Trace:
I20260709 13:15:32.035205  3952 rpcz_store.cc:276] 0709 13:15:30.623483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:30.720568 (+ 97085us) service_pool.cc:224] Handling call
0709 13:15:30.732277 (+ 11709us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:31.087866 (+355589us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:32.034357 (+946491us) spinlock_profiling.cc:243] Waited 347 ms on lock 0x7b5400385254. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:32.034661 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":797719424}
I20260709 13:15:32.037142  7294 raft_consensus.cc:3055] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:32.016508  7185 raft_consensus.cc:515] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:32.037750  7294 raft_consensus.cc:740] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:32.015513  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:31.896792  7287 raft_consensus.cc:515] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:32.040585  6768 consensus_queue.cc:1048] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:32.042282  6768 raft_consensus.cc:2804] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:32.042654  7287 leader_election.cc:290] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:32.042678  6768 raft_consensus.cc:493] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:32.043911  6768 raft_consensus.cc:3060] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:32.044657  6522 raft_consensus.cc:493] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.021546  7214 raft_consensus.cc:515] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:32.037423  7321 consensus_queue.cc:1048] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:31.957571  7315 raft_consensus.cc:3055] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:32.047607  7315 raft_consensus.cc:740] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:32.017213  7322 raft_consensus.cc:493] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:32.055281  4674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:32.100349  3925 leader_election.cc:304] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:32.048612  7315 consensus_queue.cc:260] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:32.102243  7320 raft_consensus.cc:493] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.102978  7320 raft_consensus.cc:515] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:32.105867  7320 leader_election.cc:290] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:32.106784  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 241606us
I20260709 13:15:32.108284  7043 consensus_queue.cc:1059] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:32.108950  4074 leader_election.cc:304] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:32.038848  7294 consensus_queue.cc:260] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:32.113376  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:32.114957  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:32.116261  4034 raft_consensus.cc:2468] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
W20260709 13:15:32.117012  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 281037us
I20260709 13:15:32.022675  7299 raft_consensus.cc:493] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:32.132513  4705 raft_consensus.cc:2468] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7.
I20260709 13:15:32.119242  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:32.127188  3925 leader_election.cc:304] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:32.045274  6522 raft_consensus.cc:515] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:32.158772  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:32.117861  7115 raft_consensus.cc:3055] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:32.177950  3954 raft_consensus.cc:3060] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:32.143013  4074 leader_election.cc:304] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:32.139915  4073 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.003s	sys 0.010s
I20260709 13:15:32.181126  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:15:32.181658  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 54555.9us
I20260709 13:15:32.138657  7299 raft_consensus.cc:3060] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:32.181559  7288 raft_consensus.cc:493] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:32.180363  4073 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.003s	sys 0.010s
I20260709 13:15:32.172130  7043 raft_consensus.cc:2749] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:15:32.172130  7114 raft_consensus.cc:493] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.178383  7115 raft_consensus.cc:740] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
W20260709 13:15:32.212065  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 69152.7us
I20260709 13:15:32.220203  4074 leader_election.cc:304] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:32.213698  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 207117us
I20260709 13:15:32.188889  7320 raft_consensus.cc:2804] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:15:32.227646  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 298895us
I20260709 13:15:32.194015  7315 raft_consensus.cc:3060] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:32.194219  7294 raft_consensus.cc:3060] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:32.114454  7322 raft_consensus.cc:515] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:32.198802  7185 leader_election.cc:290] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:15:32.242273  4672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:32.211416  7321 raft_consensus.cc:493] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:32.226917  7320 raft_consensus.cc:493] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:32.277588  3954 raft_consensus.cc:2468] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 9.
I20260709 13:15:32.230679  7287 raft_consensus.cc:493] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:32.217667  7114 raft_consensus.cc:515] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:32.222110  7288 raft_consensus.cc:515] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:32.273108  7320 raft_consensus.cc:3060] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:32.273187  7208 raft_consensus.cc:493] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
W20260709 13:15:32.330933  3958 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.003s	sys 0.014s
W20260709 13:15:32.331418  3958 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.862s	user 0.004s	sys 0.015s
W20260709 13:15:32.297098  7281 consensus_meta.cc:287] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 0.918s	user 0.010s	sys 0.005s
W20260709 13:15:32.300664  3997 connection.cc:256] RPC call timeout handler was delayed by -1.3863534910001363s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2658s for a response
W20260709 13:15:32.334585  3997 connection.cc:256] RPC call timeout handler was delayed by -1.3862790700000005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2138s for a response
W20260709 13:15:32.335070  3997 connection.cc:256] RPC call timeout handler was delayed by -1.3862790700000005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2138s for a response
I20260709 13:15:32.341127  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:32.342038  4106 raft_consensus.cc:3060] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:32.345322  7319 raft_consensus.cc:493] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:32.346158  7319 raft_consensus.cc:515] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:32.301119  7286 raft_consensus.cc:2804] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:32.364517  6522 leader_election.cc:290] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:32.340318  7208 raft_consensus.cc:515] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:32.306012  7121 raft_consensus.cc:493] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.277593  7321 raft_consensus.cc:515] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:32.348130  7336 raft_consensus.cc:2749] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:32.301275  7145 raft_consensus.cc:493] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:32.336809  7331 raft_consensus.cc:493] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:32.306246  7287 raft_consensus.cc:515] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:32.427752  4674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:32.472546  4673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:32.500890  4674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:32.419795  3997 leader_election.cc:336] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Timed out: RequestConsensusVote RPC to 127.2.198.193:35339 timed out after 1.618s (SENT)
I20260709 13:15:32.356761  7129 raft_consensus.cc:2749] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:32.307283  7115 consensus_queue.cc:260] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:32.503129  3997 leader_election.cc:304] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:32.504261  4071 leader_election.cc:304] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:15:32.410038  4672 leader_election.cc:336] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Timed out: RequestConsensusVote RPC to 127.2.198.193:35339 timed out after 1.857s (SENT)
W20260709 13:15:32.506775  4673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:32.344632  7214 leader_election.cc:290] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:32.516381  4106 raft_consensus.cc:2468] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 10.
I20260709 13:15:32.374118  7286 raft_consensus.cc:493] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:32.466292  7280 consensus_meta.cc:287] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 1.202s	user 0.016s	sys 0.000s
W20260709 13:15:32.496307  7297 log.cc:927] Time spent T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:15:32.528045  4672 leader_election.cc:304] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:32.529363  4705 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57680 (request call id 680) took 1426 ms (client timeout 1736 ms). Trace:
W20260709 13:15:32.533870  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 313767us
I20260709 13:15:32.402910  7043 raft_consensus.cc:2749] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:32.455206  7333 raft_consensus.cc:493] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:32.533224  4705 rpcz_store.cc:269] 0709 13:15:31.096116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:31.096275 (+   159us) service_pool.cc:224] Handling call
0709 13:15:32.521959 (+1425684us) spinlock_profiling.cc:243] Waited 918 ms on lock 0x7b54005b0ed4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:32.522152 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2111283584}
I20260709 13:15:32.536028  4074 leader_election.cc:304] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:32.544296  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 124570us
I20260709 13:15:32.528667  7286 raft_consensus.cc:3060] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:32.537432  7185 raft_consensus.cc:2749] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:32.471009  6768 raft_consensus.cc:515] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:32.549438  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 139484us
I20260709 13:15:32.529675  7332 raft_consensus.cc:2804] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:32.355633  7281 raft_consensus.cc:515] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:32.576157  3956 raft_consensus.cc:2468] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 7.
I20260709 13:15:32.575953  4074 leader_election.cc:304] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:32.535450  7340 raft_consensus.cc:2749] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:32.524735  7121 raft_consensus.cc:515] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:32.590222  7114 leader_election.cc:290] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:32.592069  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:15:32.592624  4100 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45336 (request call id 1295) took 1712 ms (client timeout 2152 ms). Trace:
I20260709 13:15:32.592957  4034 raft_consensus.cc:2468] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 8.
W20260709 13:15:32.593448  7311 log.cc:927] Time spent T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.578s	user 0.006s	sys 0.000s
W20260709 13:15:32.593112  4100 rpcz_store.cc:269] 0709 13:15:30.880581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:30.880705 (+   124us) service_pool.cc:224] Handling call
0709 13:15:32.592397 (+1711692us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b54003aaf54. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:32.592556 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":589582592}
I20260709 13:15:32.532320  7145 raft_consensus.cc:515] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:32.598368  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:32.599349  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:32.535166  7280 raft_consensus.cc:515] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:32.602779  3997 leader_election.cc:336] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Timed out: RequestConsensusVote RPC to 127.2.198.193:35339 timed out after 1.627s (SENT)
I20260709 13:15:32.603453  3997 leader_election.cc:304] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:32.507750  7331 raft_consensus.cc:515] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:32.641911  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 77061.4us
I20260709 13:15:32.641600  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:32.645861  4074 leader_election.cc:304] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
W20260709 13:15:32.598956  6967 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.008s	sys 0.016s
I20260709 13:15:32.650825  4032 raft_consensus.cc:1240] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:32.650540  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:32.595826  7288 leader_election.cc:290] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:32.596081  7332 raft_consensus.cc:697] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:32.605723  7115 raft_consensus.cc:3060] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:32.539587  7333 raft_consensus.cc:515] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:32.651765  4027 raft_consensus.cc:2468] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 8.
I20260709 13:15:32.668578  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:32.669034  4027 raft_consensus.cc:2468] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9.
I20260709 13:15:32.669620  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:32.670217  4027 raft_consensus.cc:2393] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 8: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:32.661741  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:15:32.651592  6967 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.009s	sys 0.016s
I20260709 13:15:32.672744  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:32.673565  3954 raft_consensus.cc:2468] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 6.
I20260709 13:15:32.650627  7340 raft_consensus.cc:2749] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:32.642982  7290 leader_election.cc:290] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:32.675879  3925 leader_election.cc:304] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:32.676708  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:32.678680  3956 raft_consensus.cc:2468] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 8.
I20260709 13:15:32.656319  7319 leader_election.cc:290] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:32.653838  7337 raft_consensus.cc:493] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.682765  3925 leader_election.cc:304] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:32.684386  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:32.663667  7330 raft_consensus.cc:2749] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:32.660645  7352 raft_consensus.cc:2749] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:15:32.696908  7326 log.cc:927] Time spent T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.681s	user 0.001s	sys 0.005s
I20260709 13:15:32.699142  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:15:32.691381  7343 log.cc:927] Time spent T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:15:32.700052  4026 raft_consensus.cc:2393] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 in current term 8: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:32.701020  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:32.701579  4026 raft_consensus.cc:3060] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:32.702785  7286 raft_consensus.cc:515] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:32.704416  7341 log.cc:927] Time spent T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:15:32.705232  7286 leader_election.cc:290] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:32.706828  4025 raft_consensus.cc:1240] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:32.707288  7121 leader_election.cc:290] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:32.685173  6768 leader_election.cc:290] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:32.687469  7305 consensus_queue.cc:1059] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.119s
I20260709 13:15:32.687777  6935 raft_consensus.cc:493] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.709996  4027 raft_consensus.cc:3060] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:32.691283  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:32.711130  4028 raft_consensus.cc:2468] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 9.
I20260709 13:15:32.672751  7051 raft_consensus.cc:3055] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:32.675161  7214 raft_consensus.cc:493] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.712608  7305 consensus_queue.cc:1243] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer f1c75790cedf4f52a3463a255c7da059 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:15:32.729956  4033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38304 (request call id 2163) took 1418 ms. Trace:
I20260709 13:15:32.730391  4033 rpcz_store.cc:276] 0709 13:15:31.311514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:31.311825 (+   311us) service_pool.cc:224] Handling call
0709 13:15:31.318703 (+  6878us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:31.786912 (+468209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:32.729700 (+942788us) spinlock_profiling.cc:243] Waited 396 ms on lock 0x7b540026e3d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:32.729893 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":909878016}
I20260709 13:15:32.714237  6935 raft_consensus.cc:515] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:32.717581  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:32.720463  7287 leader_election.cc:290] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:32.682301  7336 raft_consensus.cc:2749] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:32.732264  7214 raft_consensus.cc:515] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:32.734617  7344 log.cc:927] Time spent T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:15:32.728247  7320 raft_consensus.cc:515] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:32.709911  7319 raft_consensus.cc:493] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:32.712935  7337 raft_consensus.cc:515] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:32.721053  7332 consensus_queue.cc:237] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:32.675690  7185 raft_consensus.cc:493] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:32.725559  7280 leader_election.cc:290] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:32.726305  7333 leader_election.cc:290] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:32.726845  7145 leader_election.cc:290] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:32.731824  4025 raft_consensus.cc:3060] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:15:32.731968  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 49293.3us
I20260709 13:15:32.722397  7051 raft_consensus.cc:740] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:32.721094  7281 leader_election.cc:290] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:32.712076  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:15:32.748741  4672 leader_election.cc:336] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Timed out: RequestConsensusVote RPC to 127.2.198.193:35339 timed out after 1.947s (SENT)
I20260709 13:15:32.803586  4672 leader_election.cc:304] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:32.803890  4025 raft_consensus.cc:2468] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 10.
I20260709 13:15:32.762318  3954 raft_consensus.cc:3060] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:32.735502  4026 raft_consensus.cc:2468] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 7.
I20260709 13:15:32.781419  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:32.761016  3925 leader_election.cc:304] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:15:32.780174  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 134396us
I20260709 13:15:32.874831  4074 leader_election.cc:304] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:32.875126  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 114219us
W20260709 13:15:32.876785  4674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:32.772488  7348 log.cc:927] Time spent T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
W20260709 13:15:32.880936  4071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:32.882088  7304 raft_consensus.cc:493] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.882720  7304 raft_consensus.cc:515] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:32.885104  6768 consensus_queue.cc:1059] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:32.885426  7304 leader_election.cc:290] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:15:32.744941  7310 log.cc:927] Time spent T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.944s	user 0.000s	sys 0.006s
W20260709 13:15:32.746750  7294 consensus_meta.cc:287] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.502s	user 0.004s	sys 0.004s
W20260709 13:15:32.749632  7299 consensus_meta.cc:287] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 0.553s	user 0.007s	sys 0.003s
I20260709 13:15:32.916154  3953 raft_consensus.cc:2368] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 8. Current term is 9.
I20260709 13:15:32.760371  7182 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.737664  7320 leader_election.cc:290] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:32.939488  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:32.946643  3951 raft_consensus.cc:2368] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 6. Current term is 7.
W20260709 13:15:32.946970  7339 log.cc:927] Time spent T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.599s	user 0.001s	sys 0.001s
I20260709 13:15:32.930119  3955 raft_consensus.cc:1275] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:15:32.777513  7331 leader_election.cc:290] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:32.736266  7214 leader_election.cc:290] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:32.939910  3958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 2008) took 2317 ms. Trace:
I20260709 13:15:32.949095  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:32.737672  6935 leader_election.cc:290] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:32.741725  7335 log.cc:927] Time spent T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.398s	user 0.000s	sys 0.002s
I20260709 13:15:32.938411  6839 raft_consensus.cc:2749] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:32.930339  7115 raft_consensus.cc:493] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:32.945771  7318 leader_election.cc:290] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:32.947868  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:32.887115  7226 raft_consensus.cc:2804] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:32.732885  6522 raft_consensus.cc:2804] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:32.738075  7319 raft_consensus.cc:515] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:32.779779  7315 consensus_meta.cc:287] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.535s	user 0.010s	sys 0.000s
I20260709 13:15:32.795387  7322 leader_election.cc:290] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:32.932214  7048 raft_consensus.cc:3055] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:32.780184  7056 raft_consensus.cc:493] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:32.957878  3954 raft_consensus.cc:2468] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 7.
W20260709 13:15:32.883386  7346 log.cc:927] Time spent T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.224s	user 0.002s	sys 0.001s
I20260709 13:15:32.964789  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:32.742475  7314 raft_consensus.cc:2804] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:32.973810  4027 raft_consensus.cc:2468] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9.
I20260709 13:15:32.914950  7337 leader_election.cc:290] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:32.945222  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 196531us
I20260709 13:15:33.003823  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:33.003841  3925 leader_election.cc:304] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:32.977916  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:33.005368  4071 leader_election.cc:400] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Vote denied by peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339) with higher term. Message: Invalid argument: T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 8. Current term is 9.
I20260709 13:15:32.975339  7333 raft_consensus.cc:2749] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:32.999754  3951 raft_consensus.cc:2468] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 11.
I20260709 13:15:32.749910  7185 raft_consensus.cc:515] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:33.005748  4071 leader_election.cc:403] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:15:33.004325  4672 leader_election.cc:336] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Timed out: RequestConsensusVote RPC to 127.2.198.193:35339 timed out after 2.159s (SENT)
I20260709 13:15:32.761699  7051 consensus_queue.cc:260] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:32.949275  3958 rpcz_store.cc:276] 0709 13:15:30.622284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:30.623850 (+  1566us) service_pool.cc:224] Handling call
0709 13:15:30.624368 (+   518us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:30.763366 (+138998us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:15:31.429127 (+665761us) spinlock_profiling.cc:243] Waited 7.97 ms on lock 0x7b1800338200. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f15224fbc0a 00007f152bc3b219 00007f1522583a40 00007f152257e4e4 00007f152257e455 00007f15290663c7 00007f15256789a7 00007f15256880bf 00007f1525688038
0709 13:15:31.429432 (+   305us) log.cc:844] Serialized 14 byte log entry
0709 13:15:32.331753 (+902321us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:32.334214 (+  2461us) log.cc:844] Serialized 26 byte log entry
0709 13:15:32.334363 (+   149us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:32.334394 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:32.334486 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:32.743975 (+409489us) spinlock_profiling.cc:243] Waited 16.7 ms on lock 0x7b4400022b4c. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f15224a7c85 00007f15224a86a2 00007f152521a1db 00007f1525215aaf 00007f152520986e 00007f1525208bb6 00007f15252087d8 00007f1525212221 00007f15252121d9 00007f1525212169
0709 13:15:32.939631 (+195656us) raft_consensus.cc:1685] finished
0709 13:15:32.939657 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:32.939814 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":374337,"prepare.queue_time_us":658877,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":193886,"raft.run_cpu_time_us":391,"raft.run_wall_time_us":36357,"spinlock_wait_cycles":56733824,"thread_start_us":900996,"threads_started":2,"wal-append.queue_time_us":128671}
I20260709 13:15:33.006980  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:33.024122  4705 raft_consensus.cc:2468] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7.
I20260709 13:15:33.024592  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:15:32.984930  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 110224us
I20260709 13:15:33.025918  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:33.026614  4701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:33.027086  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:33.027273  4074 leader_election.cc:304] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:33.027913  3954 raft_consensus.cc:2368] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 8. Current term is 9.
I20260709 13:15:33.028306  4672 leader_election.cc:304] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:33.017385  4673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:32.932655  7299 raft_consensus.cc:515] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:33.031060  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:32.944593  7182 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:32.978541  7226 raft_consensus.cc:493] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:33.000487  7048 raft_consensus.cc:740] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:32.981263  6522 raft_consensus.cc:493] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:33.040308  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:33.041146  3955 raft_consensus.cc:3060] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:33.029834  4673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:33.022341  6839 raft_consensus.cc:493] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.982493  7115 raft_consensus.cc:515] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:33.023288  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 380973us
I20260709 13:15:33.031495  4704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:33.033835  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:33.003690  7314 raft_consensus.cc:493] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:33.036465  7338 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.000s	sys 0.019s
I20260709 13:15:33.038131  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:33.027653  7305 raft_consensus.cc:3060] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:15:33.043466  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:33.074148  4704 raft_consensus.cc:2393] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 7: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
I20260709 13:15:33.074438  4705 raft_consensus.cc:2468] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 5.
I20260709 13:15:33.058390  4029 raft_consensus.cc:1240] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:33.005070  7056 raft_consensus.cc:515] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:33.066169  4674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:33.040046  7051 raft_consensus.cc:3060] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:33.070120  3957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35354 (request call id 356) took 1164 ms. Trace:
I20260709 13:15:33.039225  7169 raft_consensus.cc:493] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:33.042929  6522 raft_consensus.cc:3060] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:33.069329  7338 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.000s	sys 0.019s
I20260709 13:15:33.039419  6935 raft_consensus.cc:2749] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:15:33.082389  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:33.083280  4675 leader_election.cc:304] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:33.096722  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:33.008862  7336 consensus_queue.cc:1048] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:15:33.074542  7314 raft_consensus.cc:3060] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:33.085012  3957 rpcz_store.cc:276] 0709 13:15:31.905816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:31.954936 (+ 49120us) service_pool.cc:224] Handling call
0709 13:15:31.955271 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:31.962673 (+  7402us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:32.011636 (+ 48963us) log.cc:844] Serialized 14 byte log entry
0709 13:15:32.657775 (+646139us) log.cc:844] Serialized 14 byte log entry
0709 13:15:32.881094 (+223319us) spinlock_profiling.cc:243] Waited 9.51 ms on lock 0x7b18003ec3e0. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f152254f2a6 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f152254f2a6 00007f152254f240
0709 13:15:32.882254 (+  1160us) spinlock_profiling.cc:243] Waited 3.25 ms on lock 0x7b18003ec3e0. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f152254f2a6 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f15224a7c85 00007f15224a86a2 00007f152521a1db
0709 13:15:32.882827 (+   573us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b4400022b4c. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f15224a7c85 00007f15224a86a2 00007f152521a1db 00007f1525215aaf 00007f152520986e 00007f1525208bb6 00007f15252087d8 00007f1525212221 00007f15252121d9 00007f1525212169
0709 13:15:33.069730 (+186903us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:33.069790 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:33.069843 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:33.069916 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:33.070060 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19016,"prepare.queue_time_us":34424,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":196,"raft.queue_time_us":93086,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":239,"spinlock_wait_cycles":54514944,"thread_start_us":1032365,"threads_started":3,"wal-append.queue_time_us":532072}
W20260709 13:15:33.076180  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 71878.8us
I20260709 13:15:33.092082  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:33.103381  4672 leader_election.cc:304] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:33.074479  7360 raft_consensus.cc:2804] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:15:33.094623  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 67537.8us
I20260709 13:15:33.038049  7226 raft_consensus.cc:3060] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:15:33.093664  3997 leader_election.cc:336] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Timed out: RequestConsensusVote RPC to 127.2.198.193:35339 timed out after 1.736s (SENT)
I20260709 13:15:33.101114  3955 raft_consensus.cc:2468] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 8.
I20260709 13:15:33.115875  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:33.119359  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:33.115556  3997 leader_election.cc:304] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:33.116604  4074 leader_election.cc:304] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:33.084774  7359 raft_consensus.cc:2749] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:15:33.118803  4672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:33.074431  6839 raft_consensus.cc:515] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:33.126157  4701 raft_consensus.cc:2410] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:15:33.148594  3952 raft_consensus.cc:2393] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 5: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:33.127410  7360 raft_consensus.cc:697] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:33.168162  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:33.091184  7214 consensus_queue.cc:1048] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:15:33.107852  7331 raft_consensus.cc:2804] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:33.115715  7321 leader_election.cc:290] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:33.200222  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 83693.7us
I20260709 13:15:33.202600  4074 leader_election.cc:304] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:33.205577  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:33.197388  7359 raft_consensus.cc:2749] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:33.096035  7169 raft_consensus.cc:515] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:33.210227  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 116600us
W20260709 13:15:33.214383  3997 connection.cc:256] RPC call timeout handler was delayed by -1.3431534910000664s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2706s for a response
I20260709 13:15:33.192008  7114 raft_consensus.cc:2749] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:33.108101  7377 consensus_queue.cc:1059] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.091s
I20260709 13:15:33.218377  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:33.183696  7364 raft_consensus.cc:2804] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:33.219283  3952 raft_consensus.cc:2376] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d709ee666b774ec29aa732e508219938 in term 7. Re-sending same reply.
I20260709 13:15:33.224110  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:33.231317  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:33.233703  3955 raft_consensus.cc:2410] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:15:33.234210  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:33.235126  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:33.235798  3957 raft_consensus.cc:2376] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d709ee666b774ec29aa732e508219938 in term 9. Re-sending same reply.
I20260709 13:15:33.236065  3952 raft_consensus.cc:2393] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 7: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:33.244825  7336 consensus_queue.cc:1048] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:33.248297  6839 leader_election.cc:290] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:33.249154  6839 raft_consensus.cc:3055] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:33.249574  6839 raft_consensus.cc:740] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:33.250696  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:33.250512  6839 consensus_queue.cc:260] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:33.251577  4031 raft_consensus.cc:2368] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 8. Current term is 9.
I20260709 13:15:33.251628  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:33.252550  4027 raft_consensus.cc:2393] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 6: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:33.253319  7359 raft_consensus.cc:493] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.253778  4026 raft_consensus.cc:1240] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:15:33.253845  7359 raft_consensus.cc:515] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:33.255142  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:33.256114  4030 raft_consensus.cc:2410] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:15:33.228101  7332 raft_consensus.cc:2749] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:33.256975  7359 leader_election.cc:290] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:33.218792  7094 consensus_queue.cc:1059] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:15:33.258982  3950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35354 (request call id 358) took 1352 ms. Trace:
I20260709 13:15:33.259341  4029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38304 (request call id 2168) took 1326 ms. Trace:
I20260709 13:15:33.167873  7048 consensus_queue.cc:260] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:33.262306  7048 raft_consensus.cc:3060] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:33.262543  7094 consensus_queue.cc:1059] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:33.264575  7115 leader_election.cc:290] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:33.259390  3950 rpcz_store.cc:276] 0709 13:15:31.906472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:31.998499 (+ 92027us) service_pool.cc:224] Handling call
0709 13:15:32.010182 (+ 11683us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:32.335888 (+325706us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:15:32.596473 (+260585us) log.cc:844] Serialized 14 byte log entry
0709 13:15:33.031392 (+434919us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:33.032084 (+   692us) log.cc:844] Serialized 26 byte log entry
0709 13:15:33.032271 (+   187us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:33.032325 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:33.032817 (+   492us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:33.258786 (+225969us) raft_consensus.cc:1685] finished
0709 13:15:33.258806 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:33.258925 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26682,"prepare.queue_time_us":36728,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":10000,"raft.queue_time_us":48722,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":4729,"thread_start_us":913417,"threads_started":3,"wal-append.queue_time_us":470813}
I20260709 13:15:33.267637  7308 raft_consensus.cc:3055] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:33.268035  7308 raft_consensus.cc:740] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:33.214921  7357 consensus_queue.cc:1048] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.239s
I20260709 13:15:33.259837  4029 rpcz_store.cc:276] 0709 13:15:31.933291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:31.935632 (+  2341us) service_pool.cc:224] Handling call
0709 13:15:31.935948 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:33.075439 (+1139491us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:33.259127 (+183688us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54001e91d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:33.259280 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2580794112}
I20260709 13:15:33.274899  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:33.276526  4034 raft_consensus.cc:2393] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 8: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:33.284616  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:15:33.296187  3997 leader_election.cc:336] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Timed out: RequestConsensusVote RPC to 127.2.198.193:35339 timed out after 1.877s (SENT)
I20260709 13:15:33.298190  4027 raft_consensus.cc:2410] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:15:33.297148  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 49665.3us
I20260709 13:15:33.302795  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:33.303155  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:33.303658  4101 raft_consensus.cc:2393] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 8: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:33.303851  4105 raft_consensus.cc:2468] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9.
I20260709 13:15:33.304796  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:33.305318  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:33.259671  7359 raft_consensus.cc:493] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:33.316617  4071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:33.363556  4674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:33.377267  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:33.378376  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:33.379663  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:33.380477  4101 raft_consensus.cc:2393] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 7: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:33.381171  7305 raft_consensus.cc:2749] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339) with higher term. Message: Invalid argument: T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 8. Current term is 9.
I20260709 13:15:33.377422  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:33.383580  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:33.307619  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:33.397353  3997 leader_election.cc:304] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:33.410302  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 312484us
W20260709 13:15:33.300522  7368 log.cc:927] Time spent T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:15:33.417678  4100 raft_consensus.cc:1275] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:15:33.441967  4100 pending_rounds.cc:85] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Aborting all ops after (but not including) 3
I20260709 13:15:33.442345  4100 pending_rounds.cc:107] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:15:33.417982  7281 raft_consensus.cc:2749] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:15:33.417407  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 145161us
I20260709 13:15:33.295230  7185 leader_election.cc:290] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:33.301446  7299 leader_election.cc:290] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:33.395908  7214 raft_consensus.cc:3055] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:33.505321  4100 raft_consensus.cc:2889] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:33.426222  6522 raft_consensus.cc:515] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:33.427307  7337 consensus_queue.cc:1059] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:33.413983  7114 raft_consensus.cc:493] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:33.434227  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:33.396257  7338 raft_consensus.cc:493] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.305644  7377 raft_consensus.cc:3055] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:33.273240  7292 consensus_queue.cc:1059] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.268s
I20260709 13:15:33.382546  7182 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:33.520797  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 106657us
I20260709 13:15:33.576439  4675 leader_election.cc:304] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:33.522543  4032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38304 (request call id 2159) took 2234 ms. Trace:
I20260709 13:15:33.495920  7289 raft_consensus.cc:493] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:33.513996  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 282035us
I20260709 13:15:33.514673  7214 raft_consensus.cc:740] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:33.215463  7360 consensus_queue.cc:237] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:33.543064  3959 raft_consensus.cc:1240] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:33.578068  4032 rpcz_store.cc:276] 0709 13:15:31.271982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:31.277541 (+  5559us) service_pool.cc:224] Handling call
0709 13:15:31.277979 (+   438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:32.651277 (+1373298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:33.506091 (+854814us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b5400394c54. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:33.506357 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3156743424}
I20260709 13:15:33.524016  7320 raft_consensus.cc:493] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.594286  7320 raft_consensus.cc:515] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:33.597388  7320 leader_election.cc:290] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:33.415180  7359 raft_consensus.cc:515] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:33.600145  7359 leader_election.cc:290] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:33.604197  7314 raft_consensus.cc:515] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:33.606935  7314 leader_election.cc:290] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:33.529714  7377 raft_consensus.cc:740] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:33.612344  7281 raft_consensus.cc:493] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:33.529929  7114 raft_consensus.cc:515] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:33.612984  7281 raft_consensus.cc:515] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:33.587363  7115 raft_consensus.cc:493] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.616290  7115 raft_consensus.cc:515] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:33.617331  3954 raft_consensus.cc:2368] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 8. Current term is 9.
I20260709 13:15:33.622231  7380 raft_consensus.cc:2804] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:33.622990  7380 raft_consensus.cc:697] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 7 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:33.624171  7380 consensus_queue.cc:237] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:33.439410  7226 raft_consensus.cc:515] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:33.628530  3956 raft_consensus.cc:1240] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:33.628878  6522 leader_election.cc:290] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:33.629900  7226 leader_election.cc:290] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:33.630167  7214 consensus_queue.cc:260] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:33.529443  7185 consensus_queue.cc:1059] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.108s
I20260709 13:15:33.634855  7185 raft_consensus.cc:3055] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:33.635344  7185 raft_consensus.cc:740] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:33.636518  7185 consensus_queue.cc:260] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:33.638329  7185 raft_consensus.cc:3060] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:15:33.592785  7371 log.cc:927] Time spent T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:15:33.586845  7333 raft_consensus.cc:493] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.532418  7338 raft_consensus.cc:515] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:33.640718  7289 raft_consensus.cc:515] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:33.658780  4107 raft_consensus.cc:2468] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 12.
W20260709 13:15:33.586210  3997 leader_election.cc:336] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Timed out: RequestConsensusVote RPC to 127.2.198.193:35339 timed out after 1.897s (SENT)
W20260709 13:15:33.664772  7120 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.007s	sys 0.014s
I20260709 13:15:33.676884  4705 raft_consensus.cc:1275] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:15:33.652524  3924 leader_election.cc:304] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:33.582026  7361 raft_consensus.cc:3055] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:33.672791  4672 leader_election.cc:304] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:33.682384  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:33.683382  4104 raft_consensus.cc:2468] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 4.
W20260709 13:15:33.664340  7051 consensus_meta.cc:287] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.565s	user 0.007s	sys 0.003s
W20260709 13:15:33.667178  6976 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.013s	sys 0.038s
W20260709 13:15:33.703181  6976 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.013s	sys 0.038s
I20260709 13:15:33.703823  7114 leader_election.cc:290] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:33.709682  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:33.710279  7208 leader_election.cc:290] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:33.710462  4702 raft_consensus.cc:2468] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 12.
I20260709 13:15:33.713587  7338 leader_election.cc:290] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:33.715708  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:33.716373  4032 raft_consensus.cc:3060] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:33.695436  3924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:33.718261  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:33.718865  3959 raft_consensus.cc:2468] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 6.
I20260709 13:15:33.612782  7377 consensus_queue.cc:260] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:33.719897  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:33.697459  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:33.720804  3925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:33.722362  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:33.661631  7059 consensus_queue.cc:1048] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:15:33.723040  3951 raft_consensus.cc:2468] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 10.
I20260709 13:15:33.698976  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:33.724607  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:33.725714  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:33.726269  4101 raft_consensus.cc:2468] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 8.
I20260709 13:15:33.728204  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:33.729027  4026 raft_consensus.cc:2393] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 9: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:33.729197  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:33.729270  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:33.729807  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:33.730418  4026 raft_consensus.cc:2468] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 10.
I20260709 13:15:33.731176  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:33.720752  4029 raft_consensus.cc:2410] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:15:33.732188  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:33.732448  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:33.732787  4103 raft_consensus.cc:3060] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:33.733335  4029 raft_consensus.cc:2393] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 7: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
I20260709 13:15:33.663559  7357 raft_consensus.cc:493] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.734987  7357 raft_consensus.cc:515] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:33.737670  4104 raft_consensus.cc:2468] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 8.
I20260709 13:15:33.738355  7182 raft_consensus.cc:2804] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:33.738663  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:33.739276  4104 raft_consensus.cc:2468] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9.
I20260709 13:15:33.669179  7333 raft_consensus.cc:515] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:33.727460  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:33.731395  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:33.701612  7319 leader_election.cc:290] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:33.698137  7281 leader_election.cc:290] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:33.741255  4674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:33.677323  7120 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.007s	sys 0.014s
I20260709 13:15:33.741139  4101 raft_consensus.cc:2468] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
I20260709 13:15:33.743404  4108 raft_consensus.cc:1240] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:33.745904  4026 raft_consensus.cc:3060] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:33.769098  4672 leader_election.cc:304] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:33.663271  7304 raft_consensus.cc:493] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.754493  3999 leader_election.cc:304] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:33.773154  4704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:33.773022  7304 raft_consensus.cc:515] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:33.774904  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 236035us
W20260709 13:15:33.775688  3997 leader_election.cc:336] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Timed out: RequestConsensusVote RPC to 127.2.198.193:35339 timed out after 1.968s (SENT)
I20260709 13:15:33.776093  3997 leader_election.cc:304] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:33.681311  7361 raft_consensus.cc:740] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:33.742084  7115 leader_election.cc:290] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:33.766281  4030 raft_consensus.cc:1240] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:33.743199  7182 raft_consensus.cc:493] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:33.764147  6768 raft_consensus.cc:2804] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:33.792799  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:33.793715  4108 raft_consensus.cc:2468] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 10.
I20260709 13:15:33.779255  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:33.721153  7377 raft_consensus.cc:3060] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:33.783473  4703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:15:33.786607  3952 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.046s	sys 0.121s
I20260709 13:15:33.788105  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:33.777216  4099 raft_consensus.cc:2468] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7.
I20260709 13:15:33.797049  4703 raft_consensus.cc:2468] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 7.
I20260709 13:15:33.790233  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:33.762224  4032 raft_consensus.cc:2468] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9.
I20260709 13:15:33.797907  3951 raft_consensus.cc:2468] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 8.
I20260709 13:15:33.685005  7331 raft_consensus.cc:697] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 10 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:33.806859  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:15:33.799707  3952 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.047s	sys 0.121s
I20260709 13:15:33.690292  7314 consensus_queue.cc:1059] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 2, Time since last communication: 0.095s
I20260709 13:15:33.791275  7114 raft_consensus.cc:2804] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:33.799813  7059 raft_consensus.cc:2804] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:33.804563  3924 leader_election.cc:304] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:33.674078  7364 raft_consensus.cc:697] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 10 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:33.808409  4704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:33.810690  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:33.811406  4030 raft_consensus.cc:3055] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:33.828382  4030 raft_consensus.cc:740] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:33.786911  7281 raft_consensus.cc:2749] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:33.819468  4103 raft_consensus.cc:2468] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 8.
I20260709 13:15:33.798364  7182 raft_consensus.cc:3060] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:33.827114  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:33.833562  4029 raft_consensus.cc:2468] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7.
I20260709 13:15:33.827214  4026 raft_consensus.cc:2468] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7.
I20260709 13:15:33.829007  4032 raft_consensus.cc:1275] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:15:33.829996  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:33.845595  4108 raft_consensus.cc:2468] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 7.
I20260709 13:15:33.807332  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:33.866356  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:15:33.866895  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 62424us
I20260709 13:15:33.868275  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:33.869135  4103 raft_consensus.cc:2393] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 7: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:33.849067  4030 consensus_queue.cc:260] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:33.876117  4029 raft_consensus.cc:2468] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 8.
I20260709 13:15:33.829649  4700 raft_consensus.cc:1275] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:15:33.880640  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:33.882285  4099 raft_consensus.cc:3060] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:33.818560  7114 raft_consensus.cc:493] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
W20260709 13:15:33.883249  3925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:33.884389  4673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:33.886075  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:33.886842  4108 raft_consensus.cc:3060] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:33.890936  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:33.897737  3922 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:15:33.883774  7114 raft_consensus.cc:3060] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:33.848555  6522 raft_consensus.cc:493] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.906406  4030 raft_consensus.cc:3060] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:33.833377  6768 raft_consensus.cc:697] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 7 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:33.866880  7059 raft_consensus.cc:697] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 7 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
W20260709 13:15:33.914381  7381 log.cc:927] Time spent T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:15:33.850559  7333 leader_election.cc:290] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:33.912798  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:33.916110  4029 raft_consensus.cc:3060] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:33.825500  7338 consensus_queue.cc:1048] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:15:33.917212  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:33.922271  3922 leader_election.cc:304] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:33.924602  3922 leader_election.cc:304] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:33.884899  7304 leader_election.cc:290] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:15:33.926900  3997 leader_election.cc:336] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Timed out: RequestConsensusVote RPC to 127.2.198.193:35339 timed out after 2.099s (SENT)
I20260709 13:15:33.933194  3997 leader_election.cc:304] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:33.931360  4674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:33.906710  7226 raft_consensus.cc:2749] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:33.940514  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:33.925585  6522 raft_consensus.cc:515] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:33.957389  7289 leader_election.cc:290] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:33.932662  7315 raft_consensus.cc:2749] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:33.915251  7059 consensus_queue.cc:237] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:33.965816  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:33.909596  7208 raft_consensus.cc:2764] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:15:33.848585  7361 consensus_queue.cc:260] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:33.945464  6768 consensus_queue.cc:237] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:33.976444  4026 raft_consensus.cc:2468] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 3.
I20260709 13:15:33.965108  3956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 2032) took 1032 ms. Trace:
I20260709 13:15:33.977434  3956 rpcz_store.cc:276] 0709 13:15:32.932238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.262172 (+329934us) service_pool.cc:224] Handling call
0709 13:15:33.262474 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:33.628945 (+366471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:33.964841 (+335896us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b54001879d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:33.965042 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":841361280}
I20260709 13:15:33.939864  7314 raft_consensus.cc:2749] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:33.982514  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:33.978631  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:33.983414  4026 raft_consensus.cc:2468] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 7.
I20260709 13:15:33.966625  4029 raft_consensus.cc:2468] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9.
I20260709 13:15:33.967893  3958 raft_consensus.cc:2468] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 6.
I20260709 13:15:33.919370  7357 leader_election.cc:290] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:33.963794  3922 leader_election.cc:304] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:33.965586  7281 raft_consensus.cc:2749] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:15:33.987270  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 71173.9us
W20260709 13:15:33.994313  3997 leader_election.cc:336] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Timed out: RequestConsensusVote RPC to 127.2.198.193:35339 timed out after 2.107s (SENT)
I20260709 13:15:33.988463  7226 consensus_queue.cc:1048] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:33.918653  7331 consensus_queue.cc:237] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:34.014863  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 51140.6us
I20260709 13:15:34.019483  3922 leader_election.cc:304] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:33.999342  4099 raft_consensus.cc:2468] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9.
W20260709 13:15:33.981417  7386 log.cc:927] Time spent T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:15:34.003239  4108 raft_consensus.cc:2468] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7.
I20260709 13:15:33.940910  7364 consensus_queue.cc:237] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:34.031364  4073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 252180us
I20260709 13:15:34.033699  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:34.027876  3997 leader_election.cc:336] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Timed out: RequestConsensusVote RPC to 127.2.198.193:35339 timed out after 2.141s (SENT)
I20260709 13:15:34.034461  3922 leader_election.cc:304] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:15:34.037734  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 342539us
I20260709 13:15:34.004762  4030 raft_consensus.cc:1275] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 5. (term mismatch)
I20260709 13:15:34.038414  4030 pending_rounds.cc:85] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2: Aborting all ops after (but not including) 4
I20260709 13:15:34.018309  7361 raft_consensus.cc:3060] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:34.038622  4073 leader_election.cc:304] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:34.040376  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:34.041360  4025 raft_consensus.cc:2468] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 8.
I20260709 13:15:34.041481  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:34.043956  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:34.045161  4108 raft_consensus.cc:2393] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 8: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:34.033567  7120 raft_consensus.cc:2749] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:34.045555  4030 pending_rounds.cc:107] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 13:15:34.116430  4030 raft_consensus.cc:2889] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:15:34.084822  4675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:34.017841  7308 consensus_queue.cc:260] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:34.122298  4675 leader_election.cc:304] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:34.128031  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
W20260709 13:15:34.122993  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:34.128557  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:34.129518  4099 raft_consensus.cc:2410] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:15:34.026777  7315 consensus_queue.cc:1048] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
W20260709 13:15:34.133828  3924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:34.137496  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:34.127630  4031 raft_consensus.cc:2468] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 5.
I20260709 13:15:34.140415  4675 leader_election.cc:304] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:34.150715  4675 leader_election.cc:304] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
W20260709 13:15:34.156760  4074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:34.157269  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:34.157689  4074 leader_election.cc:400] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Vote denied by peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115) with higher term. Message: Invalid argument: T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 8. Current term is 9.
I20260709 13:15:34.158890  4074 leader_election.cc:304] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:34.160981  4074 leader_election.cc:304] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:34.167712  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:34.168762  4108 raft_consensus.cc:2393] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 8: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:34.171343  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:34.177590  4032 raft_consensus.cc:1275] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:15:34.178071  4032 pending_rounds.cc:85] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2: Aborting all ops after (but not including) 3
I20260709 13:15:34.178356  4032 pending_rounds.cc:107] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:15:34.178661  4032 raft_consensus.cc:2889] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:34.179263  4026 raft_consensus.cc:2468] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 10.
I20260709 13:15:34.169799  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:34.184903  4675 leader_election.cc:304] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:34.185738  4025 raft_consensus.cc:2468] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 8.
I20260709 13:15:34.129967  7045 raft_consensus.cc:2804] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:34.187857  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:34.149781  7185 consensus_meta.cc:287] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938: Time spent flushing consensus metadata: real 0.511s	user 0.015s	sys 0.000s
I20260709 13:15:34.192945  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:34.193780  4108 raft_consensus.cc:2468] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 8.
W20260709 13:15:34.191387  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 395173us
I20260709 13:15:34.195766  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:34.208743  4101 raft_consensus.cc:2468] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9.
I20260709 13:15:34.214854  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:34.170758  7094 raft_consensus.cc:2804] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:34.176796  6935 raft_consensus.cc:2804] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:34.176359  7382 raft_consensus.cc:2804] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:15:34.220135  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 198747us
I20260709 13:15:34.240950  4701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:15:34.249154  3924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:34.195945  6522 leader_election.cc:290] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:34.254156  4101 raft_consensus.cc:1275] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:15:34.192703  7045 raft_consensus.cc:493] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:34.288791  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:34.212544  7399 raft_consensus.cc:3060] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:34.224589  7304 raft_consensus.cc:2749] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:34.233520  7094 raft_consensus.cc:493] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.341955  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:34.239347  7382 raft_consensus.cc:493] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.238533  6935 raft_consensus.cc:493] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
W20260709 13:15:34.372131  4674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:34.241559  7359 raft_consensus.cc:2804] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:34.403553  4672 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:34.397126  4031 raft_consensus.cc:2393] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 10: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:34.266994  7045 raft_consensus.cc:3060] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:15:34.411736  3997 leader_election.cc:336] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Timed out: RequestConsensusVote RPC to 127.2.198.193:35339 timed out after 2.221s (SENT)
W20260709 13:15:34.433466  4673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:34.464923  4073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 429134us
I20260709 13:15:34.470221  4073 leader_election.cc:304] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:34.268721  7384 raft_consensus.cc:2804] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:15:34.344256  7292 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.016s	sys 0.027s
W20260709 13:15:34.395273  7391 log.cc:927] Time spent T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.420s	user 0.001s	sys 0.000s
I20260709 13:15:34.408812  6935 raft_consensus.cc:3060] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:34.490891  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:34.390066  7382 raft_consensus.cc:3060] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:34.471156  7389 log.cc:927] Time spent T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.489s	user 0.000s	sys 0.002s
W20260709 13:15:34.513382  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 468406us
W20260709 13:15:34.515115  4674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:34.514961  4071 leader_election.cc:304] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: d709ee666b774ec29aa732e508219938
W20260709 13:15:34.514271  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 117517us
I20260709 13:15:34.389642  7094 raft_consensus.cc:3060] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:34.411859  7314 raft_consensus.cc:2749] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:34.406170  7359 raft_consensus.cc:493] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:34.477846  7292 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.017s	sys 0.029s
I20260709 13:15:34.488209  7336 raft_consensus.cc:2804] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:34.390700  7395 consensus_queue.cc:1059] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.188s
I20260709 13:15:34.517854  7380 raft_consensus.cc:2804] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:15:34.558921  3997 leader_election.cc:336] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Timed out: RequestConsensusVote RPC to 127.2.198.193:35339 timed out after 2.221s (SENT)
I20260709 13:15:34.517657  7333 raft_consensus.cc:493] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.553587  7336 raft_consensus.cc:493] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:34.572587  3997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:34.572408  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 316082us
W20260709 13:15:34.574105  3997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:34.526571  7359 raft_consensus.cc:3060] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:34.579401  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:34.577742  7271 raft_consensus.cc:493] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:34.581218  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:34.566845  7220 raft_consensus.cc:2804] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:34.581250  7271 raft_consensus.cc:515] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:34.582091  7220 raft_consensus.cc:493] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:34.582832  7220 raft_consensus.cc:3060] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:34.580355  7336 raft_consensus.cc:3060] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:34.539606  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 378672us
I20260709 13:15:34.517223  4071 leader_election.cc:304] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:34.594547  4030 raft_consensus.cc:1275] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:34.570353  7380 raft_consensus.cc:697] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 9 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:34.589280  7414 raft_consensus.cc:3055] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:15:34.629958  3997 connection.cc:256] RPC call timeout handler was delayed by -2.2343528330000026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18200000000000002s for a response
W20260709 13:15:34.630754  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 227334us
I20260709 13:15:34.568547  7333 raft_consensus.cc:515] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:34.670292  3997 leader_election.cc:336] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Timed out: RequestConsensusVote RPC to 127.2.198.193:35339 timed out after 1.634s (SENT)
W20260709 13:15:34.671576  3997 leader_election.cc:336] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.634s (SENT)
I20260709 13:15:34.672048  3997 leader_election.cc:304] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:34.673492  3997 leader_election.cc:336] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.662s (SENT)
W20260709 13:15:34.674273  3997 leader_election.cc:336] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Timed out: RequestConsensusVote RPC to 127.2.198.193:35339 timed out after 1.662s (SENT)
I20260709 13:15:34.674803  3997 leader_election.cc:304] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:34.674134  7414 raft_consensus.cc:740] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:34.685184  7299 raft_consensus.cc:2749] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:34.692457  7397 log.cc:927] Time spent T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.437s	user 0.001s	sys 0.001s
I20260709 13:15:34.723649  7305 raft_consensus.cc:2804] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:15:34.724057  7394 log.cc:927] Time spent T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
I20260709 13:15:34.724393  7305 raft_consensus.cc:493] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.724965  7305 raft_consensus.cc:3060] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:15:34.717816  7398 log.cc:927] Time spent T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.247s	user 0.001s	sys 0.000s
I20260709 13:15:34.819593  7271 leader_election.cc:290] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:34.704350  7400 log.cc:927] Time spent T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.314s	user 0.000s	sys 0.001s
W20260709 13:15:34.715468  7392 log.cc:927] Time spent T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.379s	user 0.000s	sys 0.002s
I20260709 13:15:34.760753  7413 raft_consensus.cc:493] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.761184  7169 leader_election.cc:290] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:34.879637  7413 raft_consensus.cc:515] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:34.880347  4108 raft_consensus.cc:1275] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:15:34.881413  4108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45332 (request call id 1852) took 1134 ms. Trace:
I20260709 13:15:34.881901  4108 rpcz_store.cc:276] 0709 13:15:33.747467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.228649 (+481182us) service_pool.cc:224] Handling call
0709 13:15:34.826000 (+597351us) spinlock_profiling.cc:243] Waited 21.3 ms on lock 0x7b5800011798. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f1522549b71 00007f1522549a22 00007f152b462c09 00007f152a5bcee0 00007f152a6860ab 00007f152a686131 00007f152a647fc0 00007f152a632929 00007f152a6323d2 00007f1523ba9bd4
0709 13:15:34.879263 (+ 53263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:34.881036 (+  1773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:34.881336 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48934144}
I20260709 13:15:34.763123  7414 consensus_queue.cc:260] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:34.884030  3954 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38612 (request call id 1277) took 1963 ms (client timeout 2004 ms). Trace:
W20260709 13:15:34.764484  7408 log.cc:927] Time spent T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
W20260709 13:15:34.884881  3954 rpcz_store.cc:269] 0709 13:15:32.920312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.028682 (+108370us) service_pool.cc:224] Handling call
0709 13:15:34.822907 (+1794225us) spinlock_profiling.cc:243] Waited 548 ms on lock 0x7b5400384d54. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:34.883954 (+ 61047us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1259336576}
W20260709 13:15:34.886473  3958 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38612 (request call id 1283) took 1964 ms (client timeout 1941 ms). Trace:
I20260709 13:15:34.696225  7393 raft_consensus.cc:2749] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:34.766397  7182 consensus_meta.cc:287] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938: Time spent flushing consensus metadata: real 0.899s	user 0.013s	sys 0.012s
I20260709 13:15:34.767228  4672 leader_election.cc:304] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:34.767741  7121 raft_consensus.cc:3055] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:15:34.764896  7404 log.cc:927] Time spent T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:15:34.888051  7121 raft_consensus.cc:740] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
W20260709 13:15:34.888214  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 167205us
I20260709 13:15:34.888973  7383 raft_consensus.cc:2804] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:34.889467  7383 raft_consensus.cc:493] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.771984  7299 raft_consensus.cc:493] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:34.889844  7383 raft_consensus.cc:3060] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:34.890194  3959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 2038) took 1170 ms. Trace:
I20260709 13:15:34.770350  7382 raft_consensus.cc:515] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:34.782945  7333 leader_election.cc:290] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:34.785272  7308 raft_consensus.cc:3060] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:34.890741  3959 rpcz_store.cc:276] 0709 13:15:33.719914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.720023 (+   109us) service_pool.cc:224] Handling call
0709 13:15:33.720425 (+   402us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:33.775619 (+ 55194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:33.775650 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:33.807654 (+ 32004us) log.cc:844] Serialized 52 byte log entry
0709 13:15:34.119116 (+311462us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:34.187206 (+ 68090us) log.cc:844] Serialized 14 byte log entry
0709 13:15:34.187495 (+   289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:34.188761 (+  1266us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:34.889952 (+701191us) raft_consensus.cc:1685] finished
0709 13:15:34.889972 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:34.890133 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":159349,"prepare.queue_time_us":49045,"prepare.run_cpu_time_us":104,"prepare.run_wall_time_us":8640,"raft.queue_time_us":55241,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":17443,"thread_start_us":246916,"threads_started":1,"wal-append.queue_time_us":747426}
W20260709 13:15:34.776635  4107 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45332 (request call id 1835) took 1501 ms (client timeout 1630 ms). Trace:
I20260709 13:15:34.791932  4104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45332 (request call id 1845) took 1085 ms. Trace:
W20260709 13:15:34.892995  4107 rpcz_store.cc:269] 0709 13:15:33.275683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.294984 (+ 19301us) service_pool.cc:224] Handling call
0709 13:15:34.776396 (+1481412us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b54001b9c54. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:34.776552 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":506822272}
I20260709 13:15:34.894272  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:34.893007  7382 leader_election.cc:290] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:34.795768  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:34.893605  4104 rpcz_store.cc:276] 0709 13:15:33.706128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.739867 (+ 33739us) service_pool.cc:224] Handling call
0709 13:15:33.740169 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:33.776987 (+ 36818us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:15:34.030909 (+253922us) log.cc:844] Serialized 14 byte log entry
0709 13:15:34.546601 (+515692us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:34.571452 (+ 24851us) log.cc:844] Serialized 26 byte log entry
0709 13:15:34.573554 (+  2102us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:34.573881 (+   327us) log.cc:844] Serialized 14 byte log entry
0709 13:15:34.574064 (+   183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:34.574155 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:34.728947 (+154792us) spinlock_profiling.cc:243] Waited 4.3 ms on lock 0x7b1800482b00. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f152254f2a6 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152a597aa1 00007f152a58eb37 00007f152a58e9ca 00007f152a68626f
0709 13:15:34.791632 (+ 62685us) raft_consensus.cc:1685] finished
0709 13:15:34.791660 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:34.791857 (+   197us) inbound_call.cc:177] Queueing success response
0709 13:15:34.792245 (+   388us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b480009c0d8. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152a597aa1 00007f152a58eb37 00007f152a58e9ca 00007f152a68626f 00007f152a685f37 00007f152a69a55c 00007f152a69a508 00007f152a69a488 00007f152a69a443 00007f152a6996ec 00007f15295c3a96
Metrics: {"mutex_wait_us":130290,"prepare.queue_time_us":730689,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":95,"raft.queue_time_us":106090,"raft.run_cpu_time_us":14087,"raft.run_wall_time_us":1027859,"spinlock_wait_cycles":47538816,"thread_start_us":604495,"threads_started":2,"wal-append.queue_time_us":632897}
I20260709 13:15:34.897084  7413 leader_election.cc:290] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:34.797211  7056 leader_election.cc:290] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:34.805012  7384 raft_consensus.cc:493] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:34.898067  7384 raft_consensus.cc:3060] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:34.901104  3924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:34.903021  3924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:34.905076  7383 raft_consensus.cc:515] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:34.907450  7399 raft_consensus.cc:2749] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:34.909771  4703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:34.910588  4703 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 10.
W20260709 13:15:34.911506  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:34.915530  7169 raft_consensus.cc:493] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.915777  4103 raft_consensus.cc:1240] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:15:34.916568  4103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45336 (request call id 1313) took 1114 ms. Trace:
I20260709 13:15:34.916253  7169 raft_consensus.cc:515] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:34.916987  4103 rpcz_store.cc:276] 0709 13:15:33.801799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.915090 (+1113291us) service_pool.cc:224] Handling call
0709 13:15:34.915485 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:34.916284 (+   799us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:34.916511 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:34.918272  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 224858us
I20260709 13:15:34.919004  7169 leader_election.cc:290] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:34.920635  3997 leader_election.cc:336] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Timed out: RequestConsensusVote RPC to 127.2.198.193:35339 timed out after 2.129s (SENT)
I20260709 13:15:34.921190  3997 leader_election.cc:304] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:34.922204  4672 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:34.922940  7407 log.cc:927] Time spent T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.306s	user 0.001s	sys 0.002s
I20260709 13:15:34.923789  7056 raft_consensus.cc:493] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
W20260709 13:15:34.809304  7403 log.cc:927] Time spent T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.212s	user 0.002s	sys 0.000s
I20260709 13:15:34.924613  7056 raft_consensus.cc:515] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:34.884141  7414 raft_consensus.cc:3060] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:34.804855  7305 raft_consensus.cc:515] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:34.887990  7182 raft_consensus.cc:515] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:34.931707  3997 connection.cc:256] RPC call timeout handler was delayed by -2.0687528329999623s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20040000000000002s for a response
I20260709 13:15:34.931720  4704 raft_consensus.cc:3060] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:34.940191  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 139144us
I20260709 13:15:34.942862  7182 leader_election.cc:290] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 8 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:34.889101  7121 consensus_queue.cc:260] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:34.944067  7121 raft_consensus.cc:3060] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:34.946794  7393 raft_consensus.cc:2749] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:34.948475  7418 consensus_queue.cc:1048] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:34.952215  4102 raft_consensus.cc:2410] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:15:34.952690  7415 raft_consensus.cc:493] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.953267  7415 raft_consensus.cc:515] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:34.954461  4102 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45332 (request call id 1831) took 1679 ms (client timeout 2227 ms). Trace:
I20260709 13:15:34.956064  4105 raft_consensus.cc:1275] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:15:34.956485  4105 pending_rounds.cc:85] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc: Aborting all ops after (but not including) 4
I20260709 13:15:34.956292  6839 raft_consensus.cc:3060] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:34.956873  4105 pending_rounds.cc:107] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:15:34.957213  4105 raft_consensus.cc:2889] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:34.957556  7415 leader_election.cc:290] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:34.958638  4105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45332 (request call id 1843) took 1253 ms. Trace:
I20260709 13:15:34.959597  3951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35354 (request call id 376) took 1164 ms. Trace:
I20260709 13:15:34.959039  4105 rpcz_store.cc:276] 0709 13:15:33.705348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.708145 (+  2797us) service_pool.cc:224] Handling call
0709 13:15:34.955639 (+1247494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:34.957758 (+  2119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:34.958404 (+   646us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b5400197b50. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566d8ad 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:34.958554 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2868184320}
I20260709 13:15:34.780751  7380 consensus_queue.cc:237] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:34.962517  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:34.963228  4105 raft_consensus.cc:3060] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:34.790673  7214 raft_consensus.cc:3060] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:34.923916  7382 raft_consensus.cc:2749] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:34.960023  3951 rpcz_store.cc:276] 0709 13:15:33.794872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.798575 (+  3703us) service_pool.cc:224] Handling call
0709 13:15:33.798946 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:33.802331 (+  3385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:33.802368 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:33.802942 (+   574us) log.cc:844] Serialized 26 byte log entry
0709 13:15:34.239773 (+436831us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:34.351217 (+111444us) log.cc:844] Serialized 14 byte log entry
0709 13:15:34.402366 (+ 51149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:34.402732 (+   366us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:34.922305 (+519573us) spinlock_profiling.cc:243] Waited 32.3 ms on lock 0x7b4400022b4c. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f15224a7c85 00007f15224a86a2 00007f152521a1db 00007f1525215aaf 00007f152520986e 00007f1525208bb6 00007f15252087d8 00007f1525212221 00007f15252121d9 00007f1525212169
0709 13:15:34.959284 (+ 36979us) raft_consensus.cc:1685] finished
0709 13:15:34.959394 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:34.959519 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5976,"prepare.queue_time_us":110283,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":46096,"raft.queue_time_us":14677,"raft.run_cpu_time_us":344,"raft.run_wall_time_us":61707,"spinlock_wait_cycles":74361728,"thread_start_us":436425,"threads_started":1,"wal-append.queue_time_us":751841}
W20260709 13:15:34.954926  4102 rpcz_store.cc:269] 0709 13:15:33.274521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.274655 (+   134us) service_pool.cc:224] Handling call
0709 13:15:34.954171 (+1679516us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b5400197b54. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:34.954363 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3786665728}
I20260709 13:15:34.890159  7299 raft_consensus.cc:515] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:34.969820  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:34.970201  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:34.971987  4030 raft_consensus.cc:2468] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7.
I20260709 13:15:34.972244  4025 raft_consensus.cc:2410] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:15:34.970255  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:34.972867  4032 raft_consensus.cc:2368] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 for earlier term 8. Current term is 9.
I20260709 13:15:34.973285  4030 raft_consensus.cc:1275] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:15:34.932332  3997 connection.cc:256] RPC call timeout handler was delayed by -1.3847528329999932s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2764s for a response
W20260709 13:15:34.912964  7377 consensus_meta.cc:287] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938: Time spent flushing consensus metadata: real 1.107s	user 0.017s	sys 0.000s
W20260709 13:15:34.975873  3997 connection.cc:256] RPC call timeout handler was delayed by -1.3847528329999932s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2764s for a response
W20260709 13:15:34.984845  3997 connection.cc:256] RPC call timeout handler was delayed by -1.0166528329998528s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3173s for a response
W20260709 13:15:34.887020  3958 rpcz_store.cc:269] 0709 13:15:32.922165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.033520 (+111355us) service_pool.cc:224] Handling call
0709 13:15:34.824122 (+1790602us) spinlock_profiling.cc:243] Waited 668 ms on lock 0x7b54000f32d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:34.886368 (+ 62246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1535538944}
I20260709 13:15:34.978552  3925 leader_election.cc:304] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:34.987216  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:34.987965  4675 leader_election.cc:400] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 8 election: Vote denied by peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115) with higher term. Message: Invalid argument: T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 for earlier term 8. Current term is 9.
I20260709 13:15:34.988102  4032 raft_consensus.cc:2393] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 10: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:34.988291  4675 leader_election.cc:403] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:15:34.989862  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:34.986763  3997 leader_election.cc:304] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:34.989988  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:34.990633  4026 raft_consensus.cc:3060] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:34.991080  4030 raft_consensus.cc:2393] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 9: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:34.991386  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:34.991082  3997 leader_election.cc:304] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:34.992179  4032 raft_consensus.cc:2468] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 10.
I20260709 13:15:34.992362  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:34.993168  4105 raft_consensus.cc:2468] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 9.
I20260709 13:15:34.994318  4103 raft_consensus.cc:3060] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:34.993871  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 407406us
I20260709 13:15:34.995008  4701 raft_consensus.cc:2468] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 8.
I20260709 13:15:34.995189  4074 leader_election.cc:304] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:34.995776  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:34.996376  4029 raft_consensus.cc:3060] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:15:34.996763  4074 leader_election.cc:304] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:35.004197  7413 raft_consensus.cc:2749] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:15:34.985464  7420 log.cc:927] Time spent T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.299s	user 0.001s	sys 0.003s
I20260709 13:15:35.007355  4105 raft_consensus.cc:1275] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:15:35.011058  4025 raft_consensus.cc:1240] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 9. Current term is 10. Ops: []
W20260709 13:15:35.010378  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 493258us
I20260709 13:15:35.013417  4105 pending_rounds.cc:85] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Aborting all ops after (but not including) 7
I20260709 13:15:35.013804  4105 pending_rounds.cc:107] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:15:35.014156  4105 raft_consensus.cc:2889] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:34.976334  7115 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.985278  7314 raft_consensus.cc:493] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.994903  7226 raft_consensus.cc:2749] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:35.023036  3925 leader_election.cc:304] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:34.999428  7399 raft_consensus.cc:2749] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:35.034915  4103 raft_consensus.cc:1275] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:15:35.041941  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:35.043831  4074 leader_election.cc:304] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:35.053879  3997 leader_election.cc:304] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:15:34.927323  7056 leader_election.cc:290] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:35.027530  7208 consensus_queue.cc:1059] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:15:35.061291  7220 raft_consensus.cc:515] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:35.065966  4102 raft_consensus.cc:1240] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:35.074962  4026 raft_consensus.cc:2468] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 9.
I20260709 13:15:35.091804  4099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45332 (request call id 1848) took 1384 ms. Trace:
I20260709 13:15:35.118687  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:35.079190  7415 raft_consensus.cc:2749] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:35.094683  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:35.096539  4100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45332 (request call id 1840) took 1437 ms. Trace:
I20260709 13:15:35.122902  4025 raft_consensus.cc:2468] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 9.
I20260709 13:15:35.124410  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:35.125074  4025 raft_consensus.cc:2468] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 8.
I20260709 13:15:35.055758  7357 consensus_queue.cc:1048] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:15:35.100093  4032 raft_consensus.cc:1275] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:15:35.100639  7410 log.cc:927] Time spent T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:15:35.100950  7325 consensus_queue.cc:1059] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:35.101146  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:35.101785  4030 raft_consensus.cc:1275] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:15:35.102654  4704 raft_consensus.cc:2468] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9.
W20260709 13:15:35.104347  7336 consensus_meta.cc:287] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.519s	user 0.011s	sys 0.000s
W20260709 13:15:35.105862  6935 consensus_meta.cc:287] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938: Time spent flushing consensus metadata: real 0.559s	user 0.009s	sys 0.001s
I20260709 13:15:35.027273  7115 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:35.107864  4702 raft_consensus.cc:2410] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:15:35.077904  7045 consensus_meta.cc:287] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.600s	user 0.011s	sys 0.002s
I20260709 13:15:35.116175  7395 raft_consensus.cc:493] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.131675  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:35.160292  7382 raft_consensus.cc:2749] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115) with higher term. Message: Invalid argument: T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 for earlier term 8. Current term is 9.
I20260709 13:15:34.907394  7383 leader_election.cc:290] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:35.119455  4675 leader_election.cc:304] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:35.118556  4099 rpcz_store.cc:276] 0709 13:15:33.707091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.225804 (+518713us) service_pool.cc:224] Handling call
0709 13:15:34.258741 (+ 32937us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:34.336301 (+ 77560us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:34.336334 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:34.458190 (+121856us) log.cc:844] Serialized 52 byte log entry
0709 13:15:34.694974 (+236784us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:34.994136 (+299162us) log.cc:844] Serialized 14 byte log entry
0709 13:15:35.028519 (+ 34383us) log.cc:844] Serialized 14 byte log entry
0709 13:15:35.037342 (+  8823us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:35.037444 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:35.085382 (+ 47938us) spinlock_profiling.cc:243] Waited 3.82 ms on lock 0x7b18003cea40. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f152254f2a6 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152a597aa1 00007f152a58eb37 00007f152a58e9ca 00007f152a68626f
0709 13:15:35.091481 (+  6099us) raft_consensus.cc:1685] finished
0709 13:15:35.091514 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:35.091720 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":127247,"prepare.queue_time_us":384823,"prepare.run_cpu_time_us":112,"prepare.run_wall_time_us":8088,"raft.queue_time_us":146650,"raft.run_cpu_time_us":2574,"raft.run_wall_time_us":107271,"spinlock_wait_cycles":9474176,"thread_start_us":139283,"threads_started":1,"wal-append.queue_time_us":531367}
W20260709 13:15:35.200640  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 81305us
I20260709 13:15:35.201032  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:35.114912  7403 log.cc:927] Time spent T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:15:35.042156  7314 raft_consensus.cc:515] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:35.125883  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:35.205520  4025 raft_consensus.cc:2410] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:15:35.129400  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:35.122835  4100 rpcz_store.cc:276] 0709 13:15:33.659376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.659579 (+   203us) service_pool.cc:224] Handling call
0709 13:15:33.686361 (+ 26782us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:33.776264 (+ 89903us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:33.776312 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:33.785757 (+  9445us) log.cc:844] Serialized 52 byte log entry
0709 13:15:34.138449 (+352692us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:34.788514 (+650065us) spinlock_profiling.cc:243] Waited 3.03 ms on lock 0x7b480009c0d8. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152a597aa1 00007f152a58eb37 00007f152a58e9ca 00007f152a68626f 00007f152a685f37 00007f152a69a55c 00007f152a69a508 00007f152a69a488 00007f152a69a443 00007f152a6996ec 00007f15295c3a96
0709 13:15:34.808640 (+ 20126us) spinlock_profiling.cc:243] Waited 26 ms on lock 0x7b4400022b4c. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f15224a7c85 00007f15224a86a2 00007f152521a1db 00007f1525215aaf 00007f152520986e 00007f1525208bb6 00007f15252087d8 00007f1525212221 00007f15252121d9 00007f1525212169
0709 13:15:34.929257 (+120617us) spinlock_profiling.cc:243] Waited 1.6 ms on lock 0x7b18003ce8c0. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f15252164bc 00007f152256448b 00007f152b3beab9 00007f152258069b 00007f152257e93f 00007f152257e455 00007f15290663c7 00007f15256789a7 00007f15256880bf
0709 13:15:34.929449 (+   192us) log.cc:844] Serialized 14 byte log entry
0709 13:15:35.026346 (+ 96897us) log.cc:844] Serialized 14 byte log entry
0709 13:15:35.037237 (+ 10891us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:35.096221 (+ 58984us) spinlock_profiling.cc:243] Waited 89.3 ms on lock 0x7b54001b9254. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:35.096278 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:35.096321 (+    43us) raft_consensus.cc:1685] finished
0709 13:15:35.096334 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:35.096475 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":132360,"prepare.queue_time_us":522065,"prepare.run_cpu_time_us":423,"prepare.run_wall_time_us":3692,"raft.queue_time_us":33681,"raft.run_cpu_time_us":19648,"raft.run_wall_time_us":1019357,"spinlock_wait_cycles":275844736,"thread_start_us":670553,"threads_started":2,"wal-append.queue_time_us":758173}
I20260709 13:15:35.114566  7304 raft_consensus.cc:493] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.131433  7384 raft_consensus.cc:515] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:35.132467  4106 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.077s	sys 0.079s
W20260709 13:15:35.213474  4106 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.082s	sys 0.079s
I20260709 13:15:35.073259  7169 raft_consensus.cc:2804] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:35.166375  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
W20260709 13:15:35.130162  7114 consensus_meta.cc:287] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 1.145s	user 0.013s	sys 0.001s
I20260709 13:15:35.173944  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:35.152012  4074 leader_election.cc:304] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:35.188896  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:35.117560  4029 raft_consensus.cc:2468] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 9.
I20260709 13:15:35.160712  7418 raft_consensus.cc:493] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.164500  7045 raft_consensus.cc:515] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:35.160534  7336 raft_consensus.cc:515] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:35.111863  7333 raft_consensus.cc:493] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.206802  4102 raft_consensus.cc:2468] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 8.
I20260709 13:15:35.216581  7304 raft_consensus.cc:515] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:35.219861  7114 raft_consensus.cc:515] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:35.204327  7425 raft_consensus.cc:2804] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:35.222018  7169 raft_consensus.cc:697] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:35.226791  7169 consensus_queue.cc:237] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:35.219987  7359 consensus_meta.cc:287] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.628s	user 0.011s	sys 0.001s
I20260709 13:15:35.228008  7359 raft_consensus.cc:515] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:35.222070  7418 raft_consensus.cc:515] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:35.230240  7359 leader_election.cc:290] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 13 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:35.163658  6935 raft_consensus.cc:515] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:35.227402  7220 leader_election.cc:290] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:35.233908  7336 leader_election.cc:290] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:15:35.210700  3922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:35.219342  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 67489.5us
W20260709 13:15:35.216996  7361 consensus_meta.cc:287] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 1.172s	user 0.010s	sys 0.005s
W20260709 13:15:35.213964  7094 consensus_meta.cc:287] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938: Time spent flushing consensus metadata: real 0.666s	user 0.007s	sys 0.006s
I20260709 13:15:35.226997  7333 raft_consensus.cc:515] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:35.234511  4101 raft_consensus.cc:1240] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:35.222119  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:35.249203  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:35.235143  4707 raft_consensus.cc:1240] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:35.234987  4074 leader_election.cc:304] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:35.169534  7395 raft_consensus.cc:515] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:35.217916  4675 leader_election.cc:304] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:35.237506  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:35.239917  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:35.243000  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:15:35.222844  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:35.236838  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:35.259409  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:35.265079  3959 raft_consensus.cc:2468] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 7.
I20260709 13:15:35.260490  3951 raft_consensus.cc:3060] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:35.239444  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:35.223114  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:35.222232  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:35.261946  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 44144.7us
I20260709 13:15:35.269269  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:35.270251  3955 raft_consensus.cc:2376] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 6. Re-sending same reply.
I20260709 13:15:35.259980  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:35.272095  3950 raft_consensus.cc:2410] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:15:35.281018  3958 raft_consensus.cc:2468] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 10.
I20260709 13:15:35.226791  7332 raft_consensus.cc:493] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.342461  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:35.289492  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:35.343742  4108 raft_consensus.cc:2376] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9. Re-sending same reply.
I20260709 13:15:35.343730  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:35.347465  4026 raft_consensus.cc:3060] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:15:35.270239  4000 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.500s	user 0.001s	sys 0.018s
I20260709 13:15:35.289454  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:35.222733  7430 raft_consensus.cc:2804] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:35.355314  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:35.358006  4099 raft_consensus.cc:2468] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9.
I20260709 13:15:35.356531  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:15:35.358655  3922 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.967s (SENT) [suppressed 43 similar messages]
I20260709 13:15:35.359012  4029 raft_consensus.cc:2468] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 11.
I20260709 13:15:35.224406  7384 leader_election.cc:290] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:35.225292  7425 raft_consensus.cc:697] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 9 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:35.266135  6935 leader_election.cc:290] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:35.278260  7383 raft_consensus.cc:2804] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:35.243125  7305 leader_election.cc:290] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:35.362906  4704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57680 (request call id 690) took 1575 ms. Trace:
W20260709 13:15:35.279340  7364 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.011s	sys 0.050s
I20260709 13:15:35.401418  4704 rpcz_store.cc:276] 0709 13:15:33.787780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.788517 (+   737us) service_pool.cc:224] Handling call
0709 13:15:35.362679 (+1574162us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54006b1a54. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:35.362832 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2537596160}
I20260709 13:15:35.267167  7043 raft_consensus.cc:2804] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:35.369105  4701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:35.241962  7299 leader_election.cc:290] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:35.372112  4033 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.013s	sys 0.029s
I20260709 13:15:35.394050  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:15:35.425285  4033 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.013s	sys 0.032s
I20260709 13:15:35.224886  7304 leader_election.cc:290] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:35.342545  6967 raft_consensus.cc:493] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.260210  7094 raft_consensus.cc:515] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:35.412526  4702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57680 (request call id 692) took 1449 ms. Trace:
I20260709 13:15:35.267108  7415 consensus_queue.cc:1048] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.140s
I20260709 13:15:35.419155  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:35.430548  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:35.278019  7359 raft_consensus.cc:493] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:35.363961  7056 raft_consensus.cc:493] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:35.363907  7357 raft_consensus.cc:493] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
W20260709 13:15:35.435837  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 412893us
W20260709 13:15:35.408124  7364 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.016s	sys 0.057s
I20260709 13:15:35.433068  4702 rpcz_store.cc:276] 0709 13:15:33.963652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.964449 (+   797us) service_pool.cc:224] Handling call
0709 13:15:35.401707 (+1437258us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54006801d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:35.412422 (+ 10715us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2584106240}
W20260709 13:15:35.435484  7331 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.016s	sys 0.025s
I20260709 13:15:35.444959  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
W20260709 13:15:35.473067  4027 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.013s	sys 0.028s
W20260709 13:15:35.452626  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:35.475639  4027 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.013s	sys 0.028s
W20260709 13:15:35.473944  6839 consensus_meta.cc:287] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938: Time spent flushing consensus metadata: real 0.514s	user 0.012s	sys 0.002s
I20260709 13:15:35.429556  7383 raft_consensus.cc:697] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 9 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:35.445089  7299 raft_consensus.cc:3060] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:35.457056  4026 raft_consensus.cc:2468] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 11.
I20260709 13:15:35.461956  3925 leader_election.cc:304] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:35.494678  3925 leader_election.cc:304] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:35.463569  4105 raft_consensus.cc:2468] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9.
I20260709 13:15:35.422736  7043 raft_consensus.cc:493] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:35.458773  7314 leader_election.cc:290] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:35.471494  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:35.266872  7432 consensus_queue.cc:1048] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.155s
W20260709 13:15:35.473273  7331 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.016s	sys 0.025s
I20260709 13:15:35.355887  7332 raft_consensus.cc:515] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:35.428045  7384 consensus_queue.cc:1048] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:15:35.358052  7430 raft_consensus.cc:493] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:35.493284  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 450614us
I20260709 13:15:35.477807  7185 raft_consensus.cc:493] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.446782  6967 raft_consensus.cc:515] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:35.547752  3924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:35.541808  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:35.542565  3925 leader_election.cc:304] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:35.504309  7226 raft_consensus.cc:2804] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:35.472060  7357 raft_consensus.cc:515] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:35.469084  7056 raft_consensus.cc:515] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:35.565194  4028 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.002s	sys 0.039s
W20260709 13:15:35.599299  4028 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.002s	sys 0.040s
I20260709 13:15:35.600387  4028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38304 (request call id 2195) took 1885 ms. Trace:
I20260709 13:15:35.600529  4706 raft_consensus.cc:3060] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:35.600904  4028 rpcz_store.cc:276] 0709 13:15:33.715113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.737505 (+ 22392us) service_pool.cc:224] Handling call
0709 13:15:33.737771 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:33.737974 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:15:33.738197 (+   223us) log.cc:844] Serialized 14 byte log entry
0709 13:15:34.822163 (+1083966us) spinlock_profiling.cc:243] Waited 3.77 ms on lock 0x7b18004722a0. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f1522563e07 00007f152b3beab9 00007f152258069b 00007f152257e93f 00007f1522580c02 00007f152520820b 00007f152520dd23 00007f152520e23a 00007f1525678a2a
0709 13:15:35.599875 (+777712us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:35.599950 (+    75us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:35.600019 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:35.600130 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:35.600312 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":142,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"spinlock_wait_cycles":8673024,"thread_start_us":600357,"threads_started":1}
I20260709 13:15:35.508644  4705 raft_consensus.cc:1240] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 10 LEADER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 9. Current term is 10. Ops: []
W20260709 13:15:35.520999  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 467195us
I20260709 13:15:35.506263  7434 raft_consensus.cc:2764] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:15:35.504015  7271 consensus_queue.cc:1048] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 13:15:35.613799  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:35.618884  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 260235us
I20260709 13:15:35.588274  3954 raft_consensus.cc:2468] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 9.
I20260709 13:15:35.498900  7418 leader_election.cc:290] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:35.501648  7115 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:35.500916  7043 raft_consensus.cc:3060] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:35.575789  4103 raft_consensus.cc:2468] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 8.
I20260709 13:15:35.632277  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:35.605845  3997 leader_election.cc:304] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:35.470412  7359 raft_consensus.cc:515] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:35.502652  7208 raft_consensus.cc:2804] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:15:35.556625  7380 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.023s	sys 0.033s
I20260709 13:15:35.559362  7430 raft_consensus.cc:3060] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:35.624609  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:35.642802  3958 raft_consensus.cc:2393] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 10: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:35.635774  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:35.608909  7393 raft_consensus.cc:2804] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:35.637080  3959 raft_consensus.cc:1275] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:15:35.637725  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:35.638466  7357 leader_election.cc:290] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:35.638775  3952 raft_consensus.cc:1275] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:15:35.635919  7333 leader_election.cc:290] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:35.644534  3951 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 10.
I20260709 13:15:35.644987  3997 leader_election.cc:304] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:35.648415  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:35.558899  7185 raft_consensus.cc:515] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:35.649528  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:35.653460  3955 raft_consensus.cc:1240] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:35.648461  3957 raft_consensus.cc:2468] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 8.
W20260709 13:15:35.646006  4703 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.017s	sys 0.006s
W20260709 13:15:35.658013  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 252028us
I20260709 13:15:35.505859  7425 consensus_queue.cc:237] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:35.658700  4105 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9.
W20260709 13:15:35.642820  7380 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.023s	sys 0.034s
I20260709 13:15:35.639012  7434 raft_consensus.cc:493] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.638738  7094 leader_election.cc:290] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:35.677772  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:35.685962  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:35.691363  3953 raft_consensus.cc:2410] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:15:35.677706  3924 leader_election.cc:304] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:35.644234  7208 raft_consensus.cc:493] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
W20260709 13:15:35.688097  4703 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.017s	sys 0.006s
I20260709 13:15:35.671268  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:35.619490  7383 consensus_queue.cc:237] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:35.694051  3924 leader_election.cc:304] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:35.676051  7444 raft_consensus.cc:493] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
W20260709 13:15:35.741492  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 47565us
I20260709 13:15:35.651309  7045 leader_election.cc:290] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:35.729918  7435 log.cc:927] Time spent T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:15:35.744711  4033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38290 (request call id 1966) took 1620 ms. Trace:
I20260709 13:15:35.660980  7395 leader_election.cc:290] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:35.700917  7347 raft_consensus.cc:493] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.700847  7441 raft_consensus.cc:2804] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:35.732250  7056 leader_election.cc:290] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:35.718904  7208 raft_consensus.cc:3060] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:35.692387  7418 consensus_queue.cc:1059] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:15:35.741760  7361 raft_consensus.cc:2804] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:15:35.761631  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 116784us
I20260709 13:15:35.752362  7444 raft_consensus.cc:515] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:35.767861  3997 leader_election.cc:400] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: Vote denied by peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339) with higher term. Message: Invalid argument: T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 8. Current term is 9.
I20260709 13:15:35.768436  3997 leader_election.cc:403] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:15:35.769752  4706 raft_consensus.cc:2468] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 8.
I20260709 13:15:35.692896  7331 consensus_queue.cc:1048] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
W20260709 13:15:35.782083  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 282294us
I20260709 13:15:35.754240  7169 raft_consensus.cc:2804] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:15:35.816488  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 48829.9us
I20260709 13:15:35.817651  3997 leader_election.cc:304] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:35.826093  6967 leader_election.cc:290] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:35.765722  7347 raft_consensus.cc:515] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:35.829305  7347 leader_election.cc:290] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:35.815871  7448 raft_consensus.cc:2749] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:35.830718  7452 raft_consensus.cc:2749] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:35.773865  7226 raft_consensus.cc:697] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 7 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:35.833577  3925 leader_election.cc:304] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:35.764178  7441 raft_consensus.cc:493] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:35.842386  3997 leader_election.cc:304] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:35.774971  7361 raft_consensus.cc:493] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:35.844123  3997 leader_election.cc:304] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:35.846374  3997 leader_election.cc:304] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:35.833022  7226 consensus_queue.cc:237] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:35.836040  3925 leader_election.cc:304] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:35.693480  7434 raft_consensus.cc:515] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:35.848115  7361 raft_consensus.cc:3060] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:35.818773  7332 leader_election.cc:290] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:35.833590  7444 leader_election.cc:290] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:35.867272  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:35.839359  7448 raft_consensus.cc:2749] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339) with higher term. Message: Invalid argument: T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 8. Current term is 9.
I20260709 13:15:35.846714  7441 raft_consensus.cc:3060] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:35.864930  7045 raft_consensus.cc:2749] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:35.848490  7347 consensus_queue.cc:1048] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:15:35.856052  7169 raft_consensus.cc:697] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:35.865711  7056 consensus_queue.cc:1048] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:15:35.863508  4700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57680 (request call id 693) took 1720 ms. Trace:
I20260709 13:15:35.873956  7444 raft_consensus.cc:2804] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:15:35.877506  7446 log.cc:927] Time spent T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:15:35.874109  7458 raft_consensus.cc:2749] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:35.877291  6768 raft_consensus.cc:493] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:35.876895  3922 leader_election.cc:304] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:35.879200  7448 raft_consensus.cc:2749] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:15:35.996989  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 120336us
I20260709 13:15:35.878489  7449 raft_consensus.cc:2804] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:15:36.006846  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 171336us
W20260709 13:15:36.000371  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 154101us
I20260709 13:15:35.984120  7444 raft_consensus.cc:493] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:36.014302  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:36.017146  4032 raft_consensus.cc:2393] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 11: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:36.017913  4030 raft_consensus.cc:1240] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 13:15:36.009034  7437 log.cc:927] Time spent T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:15:35.998796  7455 raft_consensus.cc:2804] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:36.022764  3997 leader_election.cc:304] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:36.029052  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:36.013095  7045 raft_consensus.cc:2749] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:36.019068  7439 log.cc:927] Time spent T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.265s	user 0.001s	sys 0.001s
I20260709 13:15:36.032562  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:36.043995  4032 raft_consensus.cc:2468] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 8.
I20260709 13:15:36.018594  7444 raft_consensus.cc:3060] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:36.007023  6768 raft_consensus.cc:515] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:36.046644  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 44650.5us
I20260709 13:15:36.016350  7449 raft_consensus.cc:697] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
W20260709 13:15:36.031376  7438 log.cc:927] Time spent T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.296s	user 0.000s	sys 0.001s
I20260709 13:15:36.021734  7359 leader_election.cc:290] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:36.033732  7458 raft_consensus.cc:2804] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:15:36.074790  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 44524us
I20260709 13:15:36.029328  7455 raft_consensus.cc:493] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:36.079553  3922 leader_election.cc:304] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:36.082508  3922 leader_election.cc:304] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:36.034087  7454 consensus_queue.cc:1048] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:15:36.091830  4027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41312 (request call id 448) took 1124 ms. Trace:
I20260709 13:15:36.092356  4027 rpcz_store.cc:276] 0709 13:15:34.967464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.967626 (+   162us) service_pool.cc:224] Handling call
0709 13:15:34.967983 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:34.968226 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:34.968265 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:34.970516 (+  2251us) log.cc:844] Serialized 26 byte log entry
0709 13:15:35.476305 (+505789us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:35.476354 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:35.476555 (+   201us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:36.091563 (+615008us) raft_consensus.cc:1685] finished
0709 13:15:36.091588 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:36.091750 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":505476,"threads_started":1,"wal-append.queue_time_us":867485}
W20260709 13:15:36.097241  7453 log.cc:927] Time spent T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:15:36.097325  7454 raft_consensus.cc:2749] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:36.098574  7434 leader_election.cc:290] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:36.098338  7043 raft_consensus.cc:515] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:36.098865  7460 log.cc:927] Time spent T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:15:36.040419  7169 consensus_queue.cc:237] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:36.107963  7449 consensus_queue.cc:237] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:36.110001  7043 leader_election.cc:290] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:36.111068  4104 raft_consensus.cc:1240] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:36.041793  7456 consensus_queue.cc:1048] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:15:36.077280  7347 consensus_queue.cc:1048] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:15:36.126132  4034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41312 (request call id 447) took 1160 ms. Trace:
I20260709 13:15:36.085806  7455 raft_consensus.cc:3060] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:36.126623  4034 rpcz_store.cc:276] 0709 13:15:34.965729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.965948 (+   219us) service_pool.cc:224] Handling call
0709 13:15:34.966356 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:34.966776 (+   420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:34.966817 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:34.976104 (+  9287us) log.cc:844] Serialized 26 byte log entry
0709 13:15:35.468380 (+492276us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:35.468440 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:35.468537 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:36.125852 (+657315us) raft_consensus.cc:1685] finished
0709 13:15:36.125879 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:36.126040 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2822,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":12815,"spinlock_wait_cycles":418560,"thread_start_us":478837,"threads_started":1,"wal-append.queue_time_us":665429}
W20260709 13:15:36.093546  7299 consensus_meta.cc:287] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 0.590s	user 0.008s	sys 0.004s
I20260709 13:15:36.089038  7464 raft_consensus.cc:2749] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:15:36.169900  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 119531us
W20260709 13:15:36.184588  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 102193us
I20260709 13:15:36.187829  3922 leader_election.cc:304] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:36.188284  3925 leader_election.cc:304] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:36.189926  4034 raft_consensus.cc:1275] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:15:36.124420  7456 consensus_queue.cc:1243] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer 8952c48a6f3a43968f7d77f7bfc4d1bc log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:15:36.193091  3997 leader_election.cc:336] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.907s (SENT)
I20260709 13:15:36.196725  3997 leader_election.cc:304] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:36.134709  7461 raft_consensus.cc:493] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:36.188189  7299 raft_consensus.cc:2749] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:36.183557  7458 raft_consensus.cc:697] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:36.204572  4106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45332 (request call id 1842) took 2494 ms. Trace:
W20260709 13:15:36.199909  7465 log.cc:927] Time spent T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:15:36.206300  4106 rpcz_store.cc:276] 0709 13:15:33.704859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.705020 (+   161us) service_pool.cc:224] Handling call
0709 13:15:33.705366 (+   346us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:15:33.777599 (+ 72233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:33.777643 (+    44us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:15:33.784948 (+  7305us) log.cc:844] Serialized 78 byte log entry
0709 13:15:34.252666 (+467718us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:34.585808 (+333142us) log.cc:844] Serialized 14 byte log entry
0709 13:15:34.590463 (+  4655us) log.cc:844] Serialized 14 byte log entry
0709 13:15:34.937953 (+347490us) spinlock_profiling.cc:243] Waited 2.58 ms on lock 0x7b180028fb40. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f1522581522 00007f15225837c1 00007f1522583779 00007f1522583709 00007f15225836d1 00007f15225829cd 000000000038f354 000000000038f199 00007f152256483a
0709 13:15:35.214305 (+276352us) log.cc:844] Serialized 14 byte log entry
0709 13:15:35.219310 (+  5005us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.198962 (+979652us) spinlock_profiling.cc:243] Waited 36.4 ms on lock 0x7b54001b9754. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:36.199005 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:36.199042 (+    37us) raft_consensus.cc:1685] finished
0709 13:15:36.199049 (+     7us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:36.199209 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":168510,"prepare.queue_time_us":422829,"prepare.run_cpu_time_us":177,"prepare.run_wall_time_us":1357,"raft.queue_time_us":314332,"raft.run_cpu_time_us":581,"raft.run_wall_time_us":13882,"spinlock_wait_cycles":89748096,"thread_start_us":1275565,"threads_started":3,"wal-append.queue_time_us":745535}
I20260709 13:15:36.200474  7434 raft_consensus.cc:2749] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:36.216025  4026 raft_consensus.cc:2468] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7.
W20260709 13:15:36.209564  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 84060.1us
I20260709 13:15:36.222170  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:36.222820  4106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45336 (request call id 1327) took 1097 ms. Trace:
I20260709 13:15:36.223170  4106 rpcz_store.cc:276] 0709 13:15:35.125521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.221943 (+1096422us) service_pool.cc:224] Handling call
0709 13:15:36.222773 (+   830us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:36.205086  7121 raft_consensus.cc:3055] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:36.229894  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:36.230610  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:36.230629  3955 raft_consensus.cc:2468] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 5.
I20260709 13:15:36.231890  4705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57680 (request call id 687) took 2531 ms. Trace:
I20260709 13:15:36.231940  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:36.232756  4106 raft_consensus.cc:2468] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 11.
I20260709 13:15:36.232542  4705 rpcz_store.cc:276] 0709 13:15:33.696011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.760946 (+ 64935us) service_pool.cc:224] Handling call
0709 13:15:33.761293 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:35.604466 (+1843173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.227470 (+623004us) spinlock_profiling.cc:243] Waited 1.75 s on lock 0x7b54005b0254. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:36.227707 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4017921408}
I20260709 13:15:36.219823  7169 raft_consensus.cc:2804] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:36.233934  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:36.235314  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:36.236107  3952 raft_consensus.cc:3060] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:36.235421  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:36.238777  4672 leader_election.cc:304] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:36.199879  7208 raft_consensus.cc:515] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:36.209571  7461 raft_consensus.cc:515] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:36.239995  3954 raft_consensus.cc:1240] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:36.241329  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:36.241868  7461 leader_election.cc:290] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:36.243419  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:36.245002  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:35.752980  4033 rpcz_store.cc:276] 0709 13:15:34.124747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.124893 (+   146us) service_pool.cc:224] Handling call
0709 13:15:34.166982 (+ 42089us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:34.167222 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:15:34.795456 (+628234us) spinlock_profiling.cc:243] Waited 5.2 ms on lock 0x7b1800472ae0. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f15252164bc 00007f152256448b 00007f152b3beab9 00007f152258069b 00007f152257e93f 00007f152257e455 00007f15290663c7 00007f15256789a7 00007f15256880bf
0709 13:15:34.796191 (+   735us) log.cc:844] Serialized 14 byte log entry
0709 13:15:35.744363 (+948172us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:35.744416 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:35.744464 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:35.744524 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:35.744654 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":66802,"prepare.run_cpu_time_us":7735,"prepare.run_wall_time_us":61304,"raft.queue_time_us":275258,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":14149,"spinlock_wait_cycles":11983872,"thread_start_us":1179371,"threads_started":3,"wal-append.queue_time_us":749743}
I20260709 13:15:36.246312  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:36.246956  3958 raft_consensus.cc:3060] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:36.247984  7462 log.cc:927] Time spent T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 13:15:36.243216  7382 raft_consensus.cc:2804] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:36.234869  4106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45336 (request call id 1330) took 1106 ms. Trace:
I20260709 13:15:36.212394  7464 raft_consensus.cc:2804] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:36.251132  4106 rpcz_store.cc:276] 0709 13:15:35.128208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.233688 (+1105480us) service_pool.cc:224] Handling call
0709 13:15:36.234805 (+  1117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:36.251437  4099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45332 (request call id 1868) took 1120 ms. Trace:
I20260709 13:15:36.262686  3956 raft_consensus.cc:1275] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:36.264130  4099 rpcz_store.cc:276] 0709 13:15:35.144618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.200707 (+ 56089us) service_pool.cc:224] Handling call
0709 13:15:36.251265 (+1050558us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b5400259ed4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:36.251376 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":359284992}
I20260709 13:15:36.265662  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:36.266642  4033 raft_consensus.cc:2468] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9.
I20260709 13:15:35.884513  4700 rpcz_store.cc:276] 0709 13:15:34.134352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.139927 (+  5575us) service_pool.cc:224] Handling call
0709 13:15:34.241238 (+101311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:35.005286 (+764048us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:35.010498 (+  5212us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:35.112936 (+102438us) log.cc:844] Serialized 26 byte log entry
0709 13:15:35.659459 (+546523us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:35.739534 (+ 80075us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:35.742839 (+  3305us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:35.833875 (+ 91036us) raft_consensus.cc:1685] finished
0709 13:15:35.837934 (+  4059us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:35.851944 (+ 14010us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8662,"raft.queue_time_us":93953,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":24165,"thread_start_us":983363,"threads_started":2,"wal-append.queue_time_us":625602}
I20260709 13:15:36.270898  3958 raft_consensus.cc:2410] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:15:36.227173  7121 raft_consensus.cc:740] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:36.272200  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:36.250636  7382 raft_consensus.cc:493] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:36.276731  7382 raft_consensus.cc:3060] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:36.281447  7094 raft_consensus.cc:493] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:36.220821  7471 consensus_queue.cc:1048] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:15:36.282032  7094 raft_consensus.cc:515] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:36.283128  7458 consensus_queue.cc:237] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:36.284492  7094 leader_election.cc:290] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:36.275687  7364 consensus_queue.cc:1048] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:15:36.289966  4103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45336 (request call id 1329) took 1163 ms. Trace:
I20260709 13:15:36.290627  4103 rpcz_store.cc:276] 0709 13:15:35.127656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.221607 (+ 93951us) service_pool.cc:224] Handling call
0709 13:15:36.289714 (+1068107us) spinlock_profiling.cc:243] Waited 326 ms on lock 0x7b54001ba154. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:36.289873 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":749975552}
I20260709 13:15:36.279321  7114 leader_election.cc:290] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: Requested vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:36.303395  4103 raft_consensus.cc:1275] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:15:36.304281  4103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45332 (request call id 1869) took 1159 ms. Trace:
I20260709 13:15:36.296936  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:36.297832  7441 raft_consensus.cc:515] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:36.301187  4108 raft_consensus.cc:1275] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:15:36.305609  4108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45332 (request call id 1862) took 1177 ms. Trace:
I20260709 13:15:36.306035  4108 rpcz_store.cc:276] 0709 13:15:35.128635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.300232 (+1171597us) service_pool.cc:224] Handling call
0709 13:15:36.300663 (+   431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:36.305246 (+  4583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.305536 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:36.304729  4103 rpcz_store.cc:276] 0709 13:15:35.149983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.302553 (+1152570us) service_pool.cc:224] Handling call
0709 13:15:36.302943 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:36.303936 (+   993us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.304204 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:36.309908  4103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45332 (request call id 1877) took 1051 ms. Trace:
I20260709 13:15:36.275405  7121 consensus_queue.cc:260] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:36.312363  4106 raft_consensus.cc:1275] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:15:36.261999  7169 raft_consensus.cc:697] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:36.314579  3925 leader_election.cc:304] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:36.315323  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:36.313346  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:36.320287  4106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45332 (request call id 1878) took 1061 ms. Trace:
I20260709 13:15:36.254160  7464 raft_consensus.cc:493] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
W20260709 13:15:36.330654  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 109246us
I20260709 13:15:36.332687  3952 raft_consensus.cc:2468] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 9.
W20260709 13:15:36.332921  3997 leader_election.cc:336] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.966s (SENT)
I20260709 13:15:36.333564  3997 leader_election.cc:304] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:36.333961  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:36.334607  7114 raft_consensus.cc:2749] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:36.335045  3952 raft_consensus.cc:2368] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 10. Current term is 11.
I20260709 13:15:36.324906  4106 rpcz_store.cc:276] 0709 13:15:35.258469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.310721 (+1052252us) service_pool.cc:224] Handling call
0709 13:15:36.311034 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:36.320033 (+  8999us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.320233 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:36.319877  4103 rpcz_store.cc:276] 0709 13:15:35.258141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.308795 (+1050654us) service_pool.cc:224] Handling call
0709 13:15:36.309169 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:36.309444 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:36.309502 (+    58us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:36.309568 (+    66us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:36.309619 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.309696 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:36.309837 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:36.321462  4099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45332 (request call id 1876) took 1063 ms. Trace:
I20260709 13:15:36.335971  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:36.336166  4099 rpcz_store.cc:276] 0709 13:15:35.257843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.272563 (+1014720us) service_pool.cc:224] Handling call
0709 13:15:36.321364 (+ 48801us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:36.326777  3957 raft_consensus.cc:2368] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 8. Current term is 9.
I20260709 13:15:36.337342  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:36.338045  3952 raft_consensus.cc:2468] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 8.
W20260709 13:15:36.335435  3997 leader_election.cc:336] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 2.134s (SENT)
I20260709 13:15:36.339031  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:36.350363  3952 raft_consensus.cc:2376] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 10. Re-sending same reply.
I20260709 13:15:36.340024  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:36.327983  7464 raft_consensus.cc:3060] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:36.352290  3997 leader_election.cc:304] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:36.357493  7441 leader_election.cc:290] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:36.358395  7441 raft_consensus.cc:2804] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:36.358865  7441 raft_consensus.cc:493] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:36.342211  7361 raft_consensus.cc:515] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:36.361734  7361 leader_election.cc:290] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:36.362259  7361 raft_consensus.cc:493] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:36.365293  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:36.366169  3956 raft_consensus.cc:3060] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:36.352967  3905 placement_policy_util.cc:248] tablet 1d55b0c8cf6547cb8c135f6ecdfce39f: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
I20260709 13:15:36.313699  7347 consensus_queue.cc:1059] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:15:36.359326  7441 raft_consensus.cc:3060] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:36.319788  7444 raft_consensus.cc:515] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:36.372263  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:36.374989  3952 raft_consensus.cc:2393] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 10: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
W20260709 13:15:36.373330  3997 leader_election.cc:336] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 2.152s (SENT)
I20260709 13:15:36.378129  7393 raft_consensus.cc:493] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:36.378919  7393 raft_consensus.cc:3060] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:36.380080  7473 log.cc:927] Time spent T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:15:36.381279  4104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45332 (request call id 1861) took 2611 ms. Trace:
I20260709 13:15:36.381716  4104 rpcz_store.cc:276] 0709 13:15:33.769977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.897390 (+1127413us) service_pool.cc:224] Handling call
0709 13:15:35.754663 (+857273us) spinlock_profiling.cc:243] Waited 1.41 ms on lock 0x7b5800011798. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f1522549b71 00007f1522549a22 00007f152b462c09 00007f152a5bcee0 00007f152a6860ab 00007f152a686131 00007f152a647fc0 00007f152a632929 00007f152a6323d2 00007f1523ba9bd4
0709 13:15:35.754912 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:36.123651 (+368739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.380994 (+257343us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b54003bced4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:36.381207 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":821851392}
I20260709 13:15:36.383785  4105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45332 (request call id 1873) took 1127 ms. Trace:
I20260709 13:15:36.383953  7169 consensus_queue.cc:237] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:36.384317  4105 rpcz_store.cc:276] 0709 13:15:35.256835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.595301 (+338466us) service_pool.cc:224] Handling call
0709 13:15:36.383586 (+788285us) spinlock_profiling.cc:243] Waited 43.6 ms on lock 0x7b540003af54. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:36.383716 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":100372352}
I20260709 13:15:36.375454  7347 consensus_queue.cc:1243] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Peer d709ee666b774ec29aa732e508219938 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:15:36.399639  7414 raft_consensus.cc:3055] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:36.405364  7414 raft_consensus.cc:740] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:36.401167  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:36.401744  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:36.406925  4028 raft_consensus.cc:2393] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 in current term 6: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:36.402177  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:36.408221  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:36.402570  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:36.432412  4029 raft_consensus.cc:3060] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:15:36.402948  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:36.434980  4706 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 10.
W20260709 13:15:36.370105  7430 consensus_meta.cc:287] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.714s	user 0.006s	sys 0.008s
I20260709 13:15:36.374784  7475 raft_consensus.cc:493] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.436862  4705 raft_consensus.cc:3060] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:36.409291  4675 leader_election.cc:304] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:36.362741  7361 raft_consensus.cc:515] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:36.447243  3956 raft_consensus.cc:2410] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 13:15:36.451975  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 60854.8us
I20260709 13:15:36.447466  4033 raft_consensus.cc:2468] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 4.
W20260709 13:15:36.453558  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 80239.3us
I20260709 13:15:36.435997  7449 raft_consensus.cc:2749] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:36.401290  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:36.447053  7214 raft_consensus.cc:2749] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:36.447710  7430 raft_consensus.cc:515] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:36.411348  7444 leader_election.cc:290] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:36.471063  4102 raft_consensus.cc:2368] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 9. Current term is 10.
W20260709 13:15:36.473603  3997 leader_election.cc:336] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 2.317s (SENT)
I20260709 13:15:36.474319  3997 leader_election.cc:304] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:36.407424  7382 raft_consensus.cc:515] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:36.487151  4033 raft_consensus.cc:1275] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:15:36.488404  3997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:36.476092  7449 raft_consensus.cc:2749] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:36.491093  4705 raft_consensus.cc:2468] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 6.
I20260709 13:15:36.480398  7476 raft_consensus.cc:493] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:36.493820  3999 leader_election.cc:304] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:36.474617  7114 raft_consensus.cc:493] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:36.495338  4029 raft_consensus.cc:2468] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 5.
I20260709 13:15:36.463301  7393 raft_consensus.cc:515] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:36.499866  7463 raft_consensus.cc:2804] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:36.501520  7424 consensus_queue.cc:1048] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:15:36.494606  7461 raft_consensus.cc:493] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:36.503193  7461 raft_consensus.cc:515] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:36.505496  7461 leader_election.cc:290] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:36.482739  7455 raft_consensus.cc:515] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:36.506953  3955 raft_consensus.cc:2368] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 11. Current term is 12.
I20260709 13:15:36.490147  7214 raft_consensus.cc:493] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:36.507994  7455 leader_election.cc:290] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:36.507877  7214 raft_consensus.cc:515] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:36.497550  7441 raft_consensus.cc:515] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:36.510072  7214 leader_election.cc:290] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:36.498832  7114 raft_consensus.cc:515] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:36.510946  7441 leader_election.cc:290] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:36.512689  7114 leader_election.cc:290] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:36.513785  6768 leader_election.cc:290] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:36.494670  7444 raft_consensus.cc:493] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:36.452158  7475 raft_consensus.cc:515] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:36.517688  7444 raft_consensus.cc:515] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:36.519197  7475 leader_election.cc:290] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:36.519786  7475 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:36.497803  7430 leader_election.cc:290] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:36.520324  7475 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:36.521016  7364 raft_consensus.cc:493] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:36.521543  7364 raft_consensus.cc:515] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:36.522637  7475 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:36.522850  7380 raft_consensus.cc:3055] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:36.498425  7469 consensus_queue.cc:1059] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:15:36.513799  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:36.534440  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:36.470546  7414 consensus_queue.cc:260] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:36.524466  7364 leader_election.cc:290] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:36.523357  7380 raft_consensus.cc:740] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:36.541662  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:36.558835  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:36.494251  7476 raft_consensus.cc:515] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:36.559643  4032 raft_consensus.cc:3060] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:36.561262  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:36.592422  4028 raft_consensus.cc:3060] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:15:36.594406  4707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57666 (request call id 565) took 1652 ms. Trace:
I20260709 13:15:36.526311  7448 raft_consensus.cc:493] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:36.519835  7444 leader_election.cc:290] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:36.598740  7393 leader_election.cc:290] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:36.601269  7185 leader_election.cc:290] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:36.605281  7121 raft_consensus.cc:3060] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:36.536820  7461 raft_consensus.cc:493] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.612066  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:36.628913  4030 raft_consensus.cc:3060] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:15:36.595137  4707 rpcz_store.cc:276] 0709 13:15:34.942086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.947732 (+  5646us) service_pool.cc:224] Handling call
0709 13:15:34.948067 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:35.259379 (+311312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.594003 (+1334624us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b54006810d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:36.594313 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":659571584}
I20260709 13:15:36.622480  4034 raft_consensus.cc:1275] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:15:36.646159  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:36.647847  4032 raft_consensus.cc:2468] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9.
I20260709 13:15:36.647159  4034 raft_consensus.cc:2468] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 9.
I20260709 13:15:36.635890  7414 raft_consensus.cc:3060] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:36.631268  7448 raft_consensus.cc:515] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:36.505512  7464 raft_consensus.cc:515] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:36.670562  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:36.671617  4034 raft_consensus.cc:2468] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 8.
I20260709 13:15:36.680655  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:36.685581  3950 raft_consensus.cc:3060] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:36.692230  4030 raft_consensus.cc:2468] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 12.
I20260709 13:15:36.636443  7461 raft_consensus.cc:515] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:36.773773  3950 raft_consensus.cc:2468] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 6.
I20260709 13:15:36.668658  7463 raft_consensus.cc:697] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:36.769888  7361 leader_election.cc:290] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:36.788143  7463 consensus_queue.cc:237] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:36.790781  3997 leader_election.cc:304] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:36.717032  4028 raft_consensus.cc:2468] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9.
I20260709 13:15:36.792243  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:15:36.770285  7383 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.017s	sys 0.018s
I20260709 13:15:36.796797  3950 raft_consensus.cc:2376] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d709ee666b774ec29aa732e508219938 in term 9. Re-sending same reply.
I20260709 13:15:36.703293  7464 leader_election.cc:290] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:36.807435  7458 raft_consensus.cc:2749] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:15:36.824204  7488 log.cc:927] Time spent T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 13:15:36.743284  7476 leader_election.cc:290] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:36.801163  3997 leader_election.cc:304] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
W20260709 13:15:36.803226  7383 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.024s	sys 0.018s
I20260709 13:15:36.829463  3997 leader_election.cc:304] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:36.830902  7492 raft_consensus.cc:2749] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:36.834395  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:36.835095  4028 raft_consensus.cc:3060] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:36.794731  7382 leader_election.cc:290] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:36.839962  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:36.840870  4034 raft_consensus.cc:2468] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9.
I20260709 13:15:36.843304  4034 raft_consensus.cc:1240] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:36.844990  7461 leader_election.cc:290] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:36.846262  3950 raft_consensus.cc:1275] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:15:36.846192  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:36.848287  4034 raft_consensus.cc:2468] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 8.
I20260709 13:15:36.854740  3954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 2043) took 1231 ms. Trace:
I20260709 13:15:36.855353  3954 rpcz_store.cc:276] 0709 13:15:35.622977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.626628 (+  3651us) service_pool.cc:224] Handling call
0709 13:15:35.627079 (+   451us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:36.240378 (+613299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.854380 (+614002us) spinlock_profiling.cc:243] Waited 613 ms on lock 0x7b54000befd4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:36.854650 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1409137920}
I20260709 13:15:36.850696  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:36.863078  4034 raft_consensus.cc:3060] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:36.864244  4028 raft_consensus.cc:2468] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 10.
I20260709 13:15:36.865286  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:36.747972  7448 leader_election.cc:290] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:36.867487  4028 raft_consensus.cc:3060] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:15:36.680523  7380 consensus_queue.cc:260] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:36.877892  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:36.878499  7380 raft_consensus.cc:3060] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:36.879253  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:36.880453  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:36.881889  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:36.877947  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:36.883605  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:36.883723  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:36.885285  3954 raft_consensus.cc:2468] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 9.
I20260709 13:15:36.884598  3959 raft_consensus.cc:2468] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 7.
I20260709 13:15:36.885921  3956 raft_consensus.cc:1275] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:36.871372  7448 raft_consensus.cc:2804] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:36.886803  7448 raft_consensus.cc:493] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:36.887282  7448 raft_consensus.cc:3060] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:36.890551  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:36.894332  3997 leader_election.cc:304] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:36.896440  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:36.897197  3952 raft_consensus.cc:2393] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 8: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:36.897805  7393 raft_consensus.cc:2749] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:36.900281  4028 raft_consensus.cc:2468] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 6.
W20260709 13:15:36.907760  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:36.903782  4028 raft_consensus.cc:1275] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:15:36.913877  4034 raft_consensus.cc:2468] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9.
I20260709 13:15:36.914633  4100 consensus_queue.cc:237] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:15:36.916033  7332 raft_consensus.cc:493] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.930320  7332 raft_consensus.cc:515] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:36.932796  7332 leader_election.cc:290] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:36.934350  7332 raft_consensus.cc:493] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:36.935716  7399 raft_consensus.cc:493] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.936296  7399 raft_consensus.cc:515] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:36.938488  7399 leader_election.cc:290] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:36.934906  7332 raft_consensus.cc:515] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:36.950263  4071 leader_election.cc:304] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:36.952761  7308 raft_consensus.cc:493] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.953210  7332 leader_election.cc:290] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:36.953404  7308 raft_consensus.cc:515] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:36.956008  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:36.956772  4104 raft_consensus.cc:2393] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 in current term 8: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
W20260709 13:15:36.960166  4074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:36.961521  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:36.961731  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:36.962370  3956 raft_consensus.cc:2393] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 11: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:36.967067  4025 raft_consensus.cc:1240] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:36.975246  4099 raft_consensus.cc:1275] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:15:36.978902  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:36.965377  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:36.982620  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:36.986081  4099 raft_consensus.cc:1240] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:36.986136  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:36.987532  4105 raft_consensus.cc:3060] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:36.983457  3959 raft_consensus.cc:2376] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 9. Re-sending same reply.
I20260709 13:15:36.988446  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:36.990020  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:36.993597  4107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45332 (request call id 1858) took 3244 ms. Trace:
I20260709 13:15:36.976378  7306 raft_consensus.cc:493] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.998653  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:36.994182  4107 rpcz_store.cc:276] 0709 13:15:33.749297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.895310 (+1146013us) service_pool.cc:224] Handling call
0709 13:15:34.898271 (+  2961us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:34.898768 (+   497us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:15:35.020889 (+122121us) log.cc:844] Serialized 14 byte log entry
0709 13:15:35.497217 (+476328us) log.cc:844] Serialized 14 byte log entry
0709 13:15:35.497342 (+   125us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:35.507457 (+ 10115us) log.cc:844] Serialized 52 byte log entry
0709 13:15:35.507639 (+   182us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:35.507946 (+   307us) log.cc:844] Serialized 14 byte log entry
0709 13:15:36.901993 (+1394047us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b18002c1040. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f15224fbc0a 00007f152bc3b219 00007f152954258f 00007f1522581571 00007f15225837c1 00007f1522583779 00007f1522583709 00007f15225836d1 00007f15225829cd
0709 13:15:36.904306 (+  2313us) log.cc:844] Serialized 14 byte log entry
0709 13:15:36.993246 (+ 88940us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.993344 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:36.993388 (+    44us) raft_consensus.cc:1685] finished
0709 13:15:36.993402 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:36.993538 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1512914,"prepare.queue_time_us":129176,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":93,"raft.queue_time_us":1432098,"raft.run_cpu_time_us":528,"raft.run_wall_time_us":10131,"spinlock_wait_cycles":11996928,"thread_start_us":469962,"threads_started":2,"wal-append.queue_time_us":620421,"wal-append.run_cpu_time_us":3119,"wal-append.run_wall_time_us":1088554}
I20260709 13:15:36.999449  3959 raft_consensus.cc:2376] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 10. Re-sending same reply.
W20260709 13:15:37.000772  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 50566us
I20260709 13:15:37.001132  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:36.985385  7121 consensus_queue.cc:1048] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:15:37.008025  7432 consensus_queue.cc:1048] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:37.009514  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:37.010288  4034 raft_consensus.cc:2393] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 10: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:37.011030  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:37.011592  4034 raft_consensus.cc:3060] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:37.011798  4028 raft_consensus.cc:1240] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:15:37.012832  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:37.014111  4071 leader_election.cc:304] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:37.013892  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:37.015211  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:37.003640  3959 raft_consensus.cc:2393] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 9: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:37.004485  7302 consensus_queue.cc:1048] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:36.996886  7361 consensus_queue.cc:1048] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:15:37.002897  7308 leader_election.cc:290] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:37.002012  7306 raft_consensus.cc:515] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:36.997447  7347 consensus_queue.cc:1059] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:15:37.015966  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:37.025930  4030 raft_consensus.cc:2393] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 9: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:37.026098  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:37.026751  4032 raft_consensus.cc:2468] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 9.
I20260709 13:15:37.030411  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:37.031260  4709 raft_consensus.cc:1240] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 7. Current term is 8. Ops: []
W20260709 13:15:37.032449  7494 log.cc:927] Time spent T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.227s	user 0.001s	sys 0.001s
W20260709 13:15:37.033946  4672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:37.033898  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:37.034514  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:37.034709  4707 raft_consensus.cc:3060] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:37.035378  4099 raft_consensus.cc:2393] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 in current term 13: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
W20260709 13:15:37.035463  7490 log.cc:927] Time spent T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.209s	user 0.000s	sys 0.005s
I20260709 13:15:37.018221  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:37.020704  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:37.037806  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:37.038476  3955 raft_consensus.cc:2468] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 9.
I20260709 13:15:37.040463  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:37.041070  3958 raft_consensus.cc:3060] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:37.041168  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:37.043052  3997 leader_election.cc:400] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 election: Vote denied by peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339) with higher term. Message: Invalid argument: T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 10. Current term is 11.
I20260709 13:15:37.043354  3997 leader_election.cc:403] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 13:15:37.044055  4102 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45332 (request call id 1871) took 1788 ms (client timeout 1798 ms). Trace:
I20260709 13:15:37.044225  3997 leader_election.cc:304] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:15:37.044486  4102 rpcz_store.cc:269] 0709 13:15:35.255388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.471110 (+215722us) service_pool.cc:224] Handling call
0709 13:15:37.043884 (+1572774us) spinlock_profiling.cc:243] Waited 969 ms on lock 0x7b540042dbd4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:37.044001 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2227719936}
I20260709 13:15:37.045066  7393 raft_consensus.cc:2749] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339) with higher term. Message: Invalid argument: T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 10. Current term is 11.
I20260709 13:15:37.045787  7393 raft_consensus.cc:2804] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:37.045933  3997 leader_election.cc:304] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:37.046165  7393 raft_consensus.cc:493] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:37.046554  7393 raft_consensus.cc:3060] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:37.048508  7306 leader_election.cc:290] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:37.050076  7347 raft_consensus.cc:3055] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:37.050472  7347 raft_consensus.cc:740] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:37.051378  7347 consensus_queue.cc:260] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:37.052023  7226 raft_consensus.cc:493] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:37.052302  7487 log.cc:927] Time spent T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.226s	user 0.000s	sys 0.003s
I20260709 13:15:37.052740  7347 raft_consensus.cc:3060] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:37.052551  7226 raft_consensus.cc:515] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:37.054770  7226 leader_election.cc:290] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:37.056020  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:37.056819  4030 raft_consensus.cc:2393] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 8: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:37.016928  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:37.060240  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:37.061429  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:37.024715  4033 raft_consensus.cc:1240] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 LEADER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:36.993530  7476 consensus_queue.cc:1048] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:15:37.061357  7471 consensus_queue.cc:1059] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:37.063853  7458 raft_consensus.cc:3060] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:37.030452  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:37.055300  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:37.039402  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:37.103523  3955 raft_consensus.cc:2393] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 10: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:37.013844  7399 raft_consensus.cc:3060] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:37.031525  4701 raft_consensus.cc:1275] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:15:37.073509  4105 raft_consensus.cc:2468] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 5.
I20260709 13:15:37.076396  4707 raft_consensus.cc:2468] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9.
I20260709 13:15:37.076997  4672 leader_election.cc:304] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:37.109541  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:37.078974  3958 raft_consensus.cc:2468] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 10.
I20260709 13:15:37.110250  4705 raft_consensus.cc:2468] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 8.
I20260709 13:15:37.023788  7406 raft_consensus.cc:2749] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:37.086174  4101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45332 (request call id 1855) took 3337 ms. Trace:
I20260709 13:15:37.110560  4672 leader_election.cc:304] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:37.088228  4703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57666 (request call id 566) took 2145 ms. Trace:
I20260709 13:15:37.104369  3997 leader_election.cc:400] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: Vote denied by peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339) with higher term. Message: Invalid argument: T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 8. Current term is 9.
I20260709 13:15:37.104401  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:37.113529  3997 leader_election.cc:403] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:15:37.082525  4026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38304 (request call id 2219) took 1059 ms. Trace:
I20260709 13:15:37.114579  4026 rpcz_store.cc:276] 0709 13:15:36.010508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.010885 (+   377us) service_pool.cc:224] Handling call
0709 13:15:37.069966 (+1059081us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b54000474d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:37.070077 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":423188352}
I20260709 13:15:37.110929  4101 rpcz_store.cc:276] 0709 13:15:33.748387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.256202 (+507815us) service_pool.cc:224] Handling call
0709 13:15:34.778185 (+521983us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:35.249222 (+471037us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.829850 (+1580628us) spinlock_profiling.cc:243] Waited 456 ms on lock 0x7b54001b9c54. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:37.085926 (+256076us) spinlock_profiling.cc:243] Waited 441 ms on lock 0x7b54001b9c50. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566d8ad 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:37.086082 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2063455232}
I20260709 13:15:37.117481  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:37.117683  4672 leader_election.cc:304] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:37.118274  4099 raft_consensus.cc:2468] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 7.
I20260709 13:15:37.023149  4071 leader_election.cc:304] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:37.119428  4705 raft_consensus.cc:1240] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:37.119609  4107 raft_consensus.cc:1275] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:15:37.120544  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 97480.8us
I20260709 13:15:37.135216  4672 leader_election.cc:304] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:37.136917  4672 leader_election.cc:304] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:37.111897  4703 rpcz_store.cc:276] 0709 13:15:34.942420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.942738 (+   318us) service_pool.cc:224] Handling call
0709 13:15:34.943175 (+   437us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:34.998223 (+ 55048us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:34.998256 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:35.004758 (+  6502us) log.cc:844] Serialized 26 byte log entry
0709 13:15:37.086664 (+2081906us) spinlock_profiling.cc:243] Waited 4.44 ms on lock 0x7b1800473b60. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f15252164bc 00007f152256448b 00007f152b3beab9 00007f152258069b 00007f152257e93f 00007f1522580c02 00007f152520820b 00007f152520dd23 00007f152520e0d1
0709 13:15:37.086843 (+   179us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:37.086882 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:37.087937 (+  1055us) spinlock_profiling.cc:243] Waited 46.3 ms on lock 0x7b54004407d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:37.087984 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:37.088023 (+    39us) raft_consensus.cc:1685] finished
0709 13:15:37.088033 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:37.088169 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":304,"raft.queue_time_us":8457,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":15021,"spinlock_wait_cycles":116691456,"thread_start_us":697050,"threads_started":1,"wal-append.queue_time_us":698784,"wal-append.run_cpu_time_us":9276,"wal-append.run_wall_time_us":1103536}
I20260709 13:15:37.129715  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:37.139609  4073 leader_election.cc:304] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:37.125818  6967 raft_consensus.cc:2804] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:37.144744  7380 raft_consensus.cc:2749] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:37.145314  7451 consensus_queue.cc:1048] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:37.147030  7448 raft_consensus.cc:515] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:37.149749  7448 leader_election.cc:290] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:37.150658  4033 raft_consensus.cc:1240] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:37.088721  7331 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:37.122423  4071 leader_election.cc:304] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:37.155514  4073 leader_election.cc:304] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:37.161108  4034 raft_consensus.cc:2468] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 10.
I20260709 13:15:37.121094  7384 raft_consensus.cc:2749] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:37.196065  7448 raft_consensus.cc:2749] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339) with higher term. Message: Invalid argument: T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 8. Current term is 9.
I20260709 13:15:37.160719  6967 raft_consensus.cc:697] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 6 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:37.204577  6967 consensus_queue.cc:237] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:37.192735  7483 log.cc:927] Time spent T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:15:37.162691  7406 raft_consensus.cc:2804] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:37.161242  7382 raft_consensus.cc:3060] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:37.207580  4702 raft_consensus.cc:1240] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:37.194976  7308 raft_consensus.cc:2804] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:37.165666  7302 raft_consensus.cc:2749] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:15:37.208267  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 48665.4us
W20260709 13:15:37.176956  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 111702us
I20260709 13:15:37.127274  7338 raft_consensus.cc:2749] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:37.199582  7361 raft_consensus.cc:493] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:37.199391  7463 raft_consensus.cc:493] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:37.216018  4071 leader_election.cc:304] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:37.218420  3997 leader_election.cc:304] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:37.222829  3997 leader_election.cc:304] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:37.156889  7377 raft_consensus.cc:2749] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:37.213789  4672 leader_election.cc:304] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:37.225524  3997 leader_election.cc:304] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:37.197827  7220 consensus_queue.cc:1059] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:15:37.228929  4672 leader_election.cc:304] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:37.231066  4071 leader_election.cc:304] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:37.214692  7308 raft_consensus.cc:493] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:37.217554  7406 raft_consensus.cc:697] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:37.163019  7306 consensus_queue.cc:1059] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 13:15:37.210681  6839 consensus_queue.cc:1048] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:15:37.166633  7331 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:37.210809  7043 consensus_queue.cc:1059] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:15:37.230463  7461 raft_consensus.cc:2804] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:37.226979  7448 raft_consensus.cc:2804] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:37.232163  7380 raft_consensus.cc:2804] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:37.235757  7308 raft_consensus.cc:3060] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:37.249356  7302 raft_consensus.cc:3055] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:37.250504  7414 raft_consensus.cc:2749] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:37.250232  4071 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:37.252375  7043 raft_consensus.cc:3055] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:37.230274  7492 consensus_queue.cc:1048] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:15:37.271273  7043 raft_consensus.cc:740] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
W20260709 13:15:37.271915  7503 log.cc:927] Time spent T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:15:37.272553  7492 raft_consensus.cc:2804] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:37.272320  7043 consensus_queue.cc:260] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:37.273236  7492 raft_consensus.cc:697] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:37.273753  7043 raft_consensus.cc:3060] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:37.274432  7492 consensus_queue.cc:237] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:37.232014  7430 raft_consensus.cc:2749] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:15:37.277281  7208 leader_election.cc:290] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:37.259279  7302 raft_consensus.cc:740] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:37.281466  7302 consensus_queue.cc:260] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:37.282799  7302 raft_consensus.cc:3060] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:37.227767  7463 raft_consensus.cc:515] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:37.227454  7361 raft_consensus.cc:515] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:37.291008  4071 leader_election.cc:304] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:15:37.265749  7499 log.cc:927] Time spent T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:15:37.244220  7377 raft_consensus.cc:2804] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:15:37.296360  7504 log.cc:927] Time spent T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:15:37.296872  7414 raft_consensus.cc:2804] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:37.255822  7448 raft_consensus.cc:493] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:37.254107  7461 raft_consensus.cc:493] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:37.301637  4071 leader_election.cc:304] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:37.308713  4071 leader_election.cc:304] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:37.314139  4675 leader_election.cc:304] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:37.288218  7380 raft_consensus.cc:697] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [term 5 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:37.302178  7377 raft_consensus.cc:493] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:37.321698  7461 raft_consensus.cc:3060] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:37.327955  7357 raft_consensus.cc:2749] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:37.377343  7332 raft_consensus.cc:2804] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:37.411751  7377 raft_consensus.cc:3060] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:37.301955  7308 raft_consensus.cc:515] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:37.380405  7384 raft_consensus.cc:2804] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:37.477382  7226 consensus_queue.cc:1048] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:15:37.479202  7440 raft_consensus.cc:493] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
W20260709 13:15:37.494078  4071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:37.429039  7406 consensus_queue.cc:237] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:37.500895  7501 log.cc:927] Time spent T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.256s	user 0.001s	sys 0.001s
I20260709 13:15:37.507925  3953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35354 (request call id 386) took 1221 ms. Trace:
I20260709 13:15:37.508755  7361 leader_election.cc:290] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:37.494465  7380 consensus_queue.cc:237] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:37.487399  7332 raft_consensus.cc:697] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:37.485337  7384 raft_consensus.cc:493] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:37.519196  3957 raft_consensus.cc:2410] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:15:37.521171  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:37.538622  3952 raft_consensus.cc:2468] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 6.
I20260709 13:15:37.521606  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:37.508412  3953 rpcz_store.cc:276] 0709 13:15:36.287037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.353926 (+ 66889us) service_pool.cc:224] Handling call
0709 13:15:36.354407 (+   481us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:36.354717 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:36.354755 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:37.064494 (+709739us) spinlock_profiling.cc:243] Waited 8.11 ms on lock 0x7b2c00000c88. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1523f67a11 00007f1523f77372 00007f15256a9a01 00007f152566e43a 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2
0709 13:15:37.064934 (+   440us) log.cc:844] Serialized 26 byte log entry
0709 13:15:37.218843 (+153909us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:37.218896 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:37.218967 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:37.507516 (+288549us) raft_consensus.cc:1685] finished
0709 13:15:37.507556 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:37.507849 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18659584,"thread_start_us":153556,"threads_started":1,"wal-append.queue_time_us":312020}
I20260709 13:15:37.546227  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:15:37.548518  4073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:37.540829  3950 raft_consensus.cc:2468] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 7.
W20260709 13:15:37.552839  7393 consensus_meta.cc:287] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 0.506s	user 0.012s	sys 0.000s
I20260709 13:15:37.553292  7393 raft_consensus.cc:515] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:37.555486  7393 leader_election.cc:290] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:37.496078  7440 raft_consensus.cc:515] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:37.510066  7463 leader_election.cc:290] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:37.557799  7440 leader_election.cc:290] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:37.559460  7332 consensus_queue.cc:237] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:37.566501  3958 raft_consensus.cc:1240] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:15:37.570057  7461 raft_consensus.cc:515] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:37.572824  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 347371us
I20260709 13:15:37.580909  3997 leader_election.cc:400] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: Vote denied by peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339) with higher term. Message: Invalid argument: T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 11. Current term is 12.
I20260709 13:15:37.581279  3997 leader_election.cc:403] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:37.512705  7308 leader_election.cc:290] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:37.547727  7384 raft_consensus.cc:3060] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:37.582779  3958 raft_consensus.cc:1240] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 9. Current term is 10. Ops: []
W20260709 13:15:37.593792  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 364932us
I20260709 13:15:37.610049  7347 raft_consensus.cc:493] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.610653  7347 raft_consensus.cc:515] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:37.598495  7511 consensus_queue.cc:1048] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:15:37.614054  7347 leader_election.cc:290] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:37.598723  7463 raft_consensus.cc:2749] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339) with higher term. Message: Invalid argument: T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 11. Current term is 12.
I20260709 13:15:37.306980  7414 raft_consensus.cc:493] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:37.306835  7448 raft_consensus.cc:3060] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:37.625257  7414 raft_consensus.cc:3060] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:37.672847  6967 raft_consensus.cc:493] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.673563  6967 raft_consensus.cc:515] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:37.669588  7399 consensus_meta.cc:287] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.550s	user 0.013s	sys 0.000s
I20260709 13:15:37.684336  7399 raft_consensus.cc:2749] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:37.669013  7336 raft_consensus.cc:2749] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:37.687552  7384 raft_consensus.cc:515] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:37.689559  7377 raft_consensus.cc:515] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:37.666971  7382 raft_consensus.cc:2749] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:37.703902  7461 leader_election.cc:290] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:37.689805  7384 leader_election.cc:290] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:15:37.705833  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 381443us
W20260709 13:15:37.733249  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 407011us
I20260709 13:15:37.752243  3925 leader_election.cc:304] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:15:37.706960  3922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:37.755587  3925 leader_election.cc:304] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:15:37.732765  7458 consensus_meta.cc:287] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 0.623s	user 0.009s	sys 0.004s
I20260709 13:15:37.758576  3925 leader_election.cc:304] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:37.774178  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:37.774760  3925 leader_election.cc:304] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:37.775066  4031 raft_consensus.cc:2468] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 9.
I20260709 13:15:37.776451  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:37.761794  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:37.763460  7208 raft_consensus.cc:2804] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:37.764832  3951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35354 (request call id 381) took 1536 ms. Trace:
I20260709 13:15:37.779721  3951 rpcz_store.cc:276] 0709 13:15:36.228796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.228951 (+   155us) service_pool.cc:224] Handling call
0709 13:15:36.229252 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:36.786533 (+557281us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:15:36.786567 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:36.786632 (+    65us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:36.786669 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:37.763535 (+976866us) spinlock_profiling.cc:243] Waited 4.73 ms on lock 0x7b1800433a20. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f152254f2a6 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419
0709 13:15:37.764624 (+  1089us) spinlock_profiling.cc:243] Waited 521 ms on lock 0x7b54001694d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:37.764667 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:37.764776 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":100,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":4850,"spinlock_wait_cycles":1210193920}
I20260709 13:15:37.782356  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:37.784329  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:37.717940  6967 leader_election.cc:290] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:37.766400  7458 raft_consensus.cc:2749] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:15:37.741285  3997 leader_election.cc:336] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.507s (SENT)
I20260709 13:15:37.772059  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:37.791497  3997 leader_election.cc:304] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:37.773392  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:37.792464  4705 raft_consensus.cc:2368] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 8. Current term is 9.
I20260709 13:15:37.790346  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:37.793396  3951 raft_consensus.cc:2468] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 6.
I20260709 13:15:37.756487  7393 raft_consensus.cc:493] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:37.757743  7347 raft_consensus.cc:2804] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:37.741024  4700 raft_consensus.cc:1240] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 13 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:37.792630  4675 leader_election.cc:304] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:37.795365  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:37.799715  3951 raft_consensus.cc:1275] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:15:37.803933  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 62686.3us
W20260709 13:15:37.804947  3997 leader_election.cc:336] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.586s (SENT)
I20260709 13:15:37.805405  3997 leader_election.cc:304] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:37.808282  4706 raft_consensus.cc:1240] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:37.785801  7521 raft_consensus.cc:2804] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:37.785823  7517 raft_consensus.cc:2804] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:37.822278  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:37.823004  4103 raft_consensus.cc:3060] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:37.799190  7208 raft_consensus.cc:697] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 12 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:37.815707  7517 raft_consensus.cc:493] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:37.824992  7517 raft_consensus.cc:3060] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:15:37.826460  3997 leader_election.cc:336] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.606s (SENT)
W20260709 13:15:37.827793  3997 leader_election.cc:336] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.688s (SENT)
I20260709 13:15:37.828325  3997 leader_election.cc:304] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:37.830870  3997 leader_election.cc:304] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:37.829377  7510 raft_consensus.cc:2749] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:37.808658  7393 raft_consensus.cc:515] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:37.842417  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 49905.1us
I20260709 13:15:38.019920  4073 leader_election.cc:400] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 election: Vote denied by peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117) with higher term. Message: Invalid argument: T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 8. Current term is 9.
I20260709 13:15:38.020442  4073 leader_election.cc:403] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 13:15:38.021257  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 190565us
W20260709 13:15:38.025753  3997 leader_election.cc:336] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.746s (SENT)
I20260709 13:15:38.027221  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:38.027184  3997 leader_election.cc:304] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:37.841410  7393 leader_election.cc:290] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:37.819741  7458 raft_consensus.cc:2749] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:38.018958  4675 leader_election.cc:304] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:38.073060  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 54245.1us
I20260709 13:15:37.810263  7522 raft_consensus.cc:2749] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:15:37.821373  7493 log.cc:927] Time spent T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 1.019s	user 0.015s	sys 0.000s
I20260709 13:15:37.796485  7169 consensus_queue.cc:1059] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:15:38.125031  3954 raft_consensus.cc:1275] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:15:38.018231  7325 raft_consensus.cc:493] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.128182  7325 raft_consensus.cc:515] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:38.132020  4073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 112324us
W20260709 13:15:38.133571  4073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:38.136327  7531 log.cc:927] Time spent T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.294s	user 0.000s	sys 0.000s
I20260709 13:15:38.138753  7377 leader_election.cc:290] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 election: Requested vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:38.139394  4704 raft_consensus.cc:1275] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:38.139891  7522 raft_consensus.cc:493] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:38.140429  7522 raft_consensus.cc:515] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:38.141306  4705 raft_consensus.cc:1240] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:15:38.142781  7448 raft_consensus.cc:515] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:38.143631  7393 raft_consensus.cc:2749] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:37.821664  7521 raft_consensus.cc:697] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:38.135953  7406 consensus_queue.cc:1059] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:15:38.127642  7512 log.cc:927] Time spent T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.335s	user 0.001s	sys 0.000s
W20260709 13:15:38.185935  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 62645.1us
I20260709 13:15:38.049851  7380 raft_consensus.cc:2804] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:38.083913  6839 raft_consensus.cc:2749] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:38.143142  7522 leader_election.cc:290] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:38.183144  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 400414us
W20260709 13:15:38.085451  7495 log.cc:927] Time spent T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.255s	user 0.001s	sys 0.000s
I20260709 13:15:38.131457  7325 leader_election.cc:290] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:38.150611  4103 raft_consensus.cc:2468] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 9.
I20260709 13:15:38.083925  7510 raft_consensus.cc:2804] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:15:38.144382  7507 log.cc:927] Time spent T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:15:38.084214  7492 consensus_queue.cc:1048] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.138s
I20260709 13:15:38.209160  7536 raft_consensus.cc:493] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:38.208709  7517 raft_consensus.cc:515] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:38.208881  7521 consensus_queue.cc:237] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:38.238595  7536 raft_consensus.cc:515] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:38.195801  7518 raft_consensus.cc:493] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.241307  7536 leader_election.cc:290] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:38.241770  7518 raft_consensus.cc:515] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:38.191772  7380 raft_consensus.cc:493] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:38.218024  3925 leader_election.cc:304] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:38.224344  4107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34656 (request call id 454) took 1011 ms. Trace:
I20260709 13:15:38.236471  7542 raft_consensus.cc:3055] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:38.250413  3925 leader_election.cc:304] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:38.245431  4107 rpcz_store.cc:276] 0709 13:15:37.213185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.213352 (+   167us) service_pool.cc:224] Handling call
0709 13:15:37.221006 (+  7654us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:37.228760 (+  7754us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:37.228811 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:37.229463 (+   652us) log.cc:844] Serialized 26 byte log entry
0709 13:15:37.668608 (+439145us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:37.668674 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:37.668780 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:38.224014 (+555234us) raft_consensus.cc:1685] finished
0709 13:15:38.224050 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:38.224254 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18059,"raft.queue_time_us":8664,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":4692,"thread_start_us":421827,"threads_started":1,"wal-append.queue_time_us":508670}
I20260709 13:15:38.219388  7332 raft_consensus.cc:2749] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117) with higher term. Message: Invalid argument: T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 8. Current term is 9.
I20260709 13:15:38.223466  7510 raft_consensus.cc:493] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:38.220389  7393 raft_consensus.cc:493] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:38.249730  7380 raft_consensus.cc:3060] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:38.252149  7542 raft_consensus.cc:740] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
W20260709 13:15:38.286942  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 444368us
W20260709 13:15:38.298082  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 246996us
I20260709 13:15:38.294651  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:38.300968  4025 raft_consensus.cc:3060] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:38.276314  7510 raft_consensus.cc:3060] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:38.271675  7347 raft_consensus.cc:697] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
W20260709 13:15:38.314230  3997 leader_election.cc:336] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.877s (SENT)
I20260709 13:15:38.323329  3997 leader_election.cc:304] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:38.222244  7208 consensus_queue.cc:237] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:38.300387  7302 consensus_meta.cc:287] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 1.017s	user 0.006s	sys 0.008s
I20260709 13:15:38.292040  6967 raft_consensus.cc:493] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.293766  7492 raft_consensus.cc:493] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
W20260709 13:15:38.346233  3997 leader_election.cc:336] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 2.051s (SENT)
I20260709 13:15:38.346705  3997 leader_election.cc:304] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:38.356032  4025 raft_consensus.cc:2468] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 9.
I20260709 13:15:38.288924  7393 raft_consensus.cc:515] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:38.358629  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 138664us
I20260709 13:15:38.390440  7548 raft_consensus.cc:493] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.391242  7548 raft_consensus.cc:515] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:38.392638  7540 raft_consensus.cc:2804] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:38.393270  7540 raft_consensus.cc:697] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 10 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:38.393847  7548 leader_election.cc:290] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:38.394446  7548 raft_consensus.cc:2749] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:38.394243  7540 consensus_queue.cc:237] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:38.395195  7548 raft_consensus.cc:493] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:38.385041  7521 raft_consensus.cc:2804] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:38.353467  6967 raft_consensus.cc:515] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:38.395599  7476 raft_consensus.cc:3055] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:38.402516  7481 raft_consensus.cc:493] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.351912  7492 raft_consensus.cc:515] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:38.406364  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 358194us
W20260709 13:15:38.408249  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 62051.1us
W20260709 13:15:38.405254  7414 consensus_meta.cc:287] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.706s	user 0.008s	sys 0.005s
I20260709 13:15:38.405505  7522 raft_consensus.cc:2749] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:15:38.445389  3997 leader_election.cc:336] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 2.138s (SENT)
I20260709 13:15:38.405052  7517 leader_election.cc:290] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:38.464403  7552 raft_consensus.cc:493] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:38.363786  7542 consensus_queue.cc:260] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:38.408092  7448 leader_election.cc:290] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:38.469477  3922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:38.415875  7476 raft_consensus.cc:740] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:38.416461  7521 raft_consensus.cc:493] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
W20260709 13:15:38.477211  3922 leader_election.cc:336] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.967s (SENT)
I20260709 13:15:38.379248  7547 consensus_queue.cc:1048] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
W20260709 13:15:38.477602  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 227268us
I20260709 13:15:38.481856  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:38.388469  7347 consensus_queue.cc:237] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:38.488298  3955 raft_consensus.cc:2468] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 6.
I20260709 13:15:38.493121  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:38.494159  4103 raft_consensus.cc:2468] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 7.
I20260709 13:15:38.496150  4107 raft_consensus.cc:1275] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:38.489019  3925 leader_election.cc:304] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:38.475819  7553 raft_consensus.cc:493] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.439944  7548 raft_consensus.cc:515] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:38.499523  3954 raft_consensus.cc:1275] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:15:38.501611  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:38.483748  7521 raft_consensus.cc:3060] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:38.484091  7542 raft_consensus.cc:3060] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:38.479184  7448 raft_consensus.cc:493] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:38.505739  4672 leader_election.cc:304] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:38.466691  7414 raft_consensus.cc:515] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:38.445374  7481 raft_consensus.cc:515] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:38.529122  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 71252us
I20260709 13:15:38.486135  7518 leader_election.cc:290] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:38.475669  7045 consensus_queue.cc:1059] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:15:38.533360  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:38.534082  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:38.505043  7377 raft_consensus.cc:493] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.483552  7522 consensus_queue.cc:1048] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:15:38.545491  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:38.545892  4108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45332 (request call id 1870) took 3395 ms. Trace:
I20260709 13:15:38.546523  3950 raft_consensus.cc:2468] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 7.
I20260709 13:15:38.546377  4108 rpcz_store.cc:276] 0709 13:15:35.150473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.307069 (+1156596us) service_pool.cc:224] Handling call
0709 13:15:36.307518 (+   449us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:36.955766 (+648248us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:36.955798 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:36.963276 (+  7478us) log.cc:844] Serialized 26 byte log entry
0709 13:15:38.194964 (+1231688us) spinlock_profiling.cc:243] Waited 2.26 ms on lock 0x7b180037cae0. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f1522563e07 00007f152b3beab9 00007f152258069b 00007f152257e93f 00007f1522580c02 00007f152520820b 00007f152520dd23 00007f152520e0d1 00007f1525629a0f
0709 13:15:38.412878 (+217914us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:38.502428 (+ 89550us) log.cc:844] Serialized 14 byte log entry
0709 13:15:38.504136 (+  1708us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.504226 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:38.545590 (+ 41364us) raft_consensus.cc:1685] finished
0709 13:15:38.545686 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:38.545825 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":646900,"raft.queue_time_us":654393,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":27018,"spinlock_wait_cycles":5187328,"thread_start_us":306496,"threads_started":2,"wal-append.queue_time_us":1482147}
I20260709 13:15:38.535251  7425 consensus_queue.cc:1048] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:15:38.549266  7559 consensus_queue.cc:1048] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:15:38.550137  7489 raft_consensus.cc:493] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:38.556582  7546 raft_consensus.cc:493] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:38.556631  7559 raft_consensus.cc:493] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:38.556926  7489 raft_consensus.cc:515] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:38.557345  7546 raft_consensus.cc:515] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:38.557505  7559 raft_consensus.cc:515] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:38.559226  7561 consensus_queue.cc:1048] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:15:38.559464  7489 leader_election.cc:290] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:38.549101  7543 raft_consensus.cc:2804] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:38.559708  7406 raft_consensus.cc:493] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:38.559787  7559 leader_election.cc:290] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:38.560139  7543 raft_consensus.cc:493] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:38.560441  7559 raft_consensus.cc:493] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.560335  7406 raft_consensus.cc:515] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:38.560608  7543 raft_consensus.cc:3060] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:38.561174  7325 raft_consensus.cc:493] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.561110  7559 raft_consensus.cc:515] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:38.561757  7325 raft_consensus.cc:515] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:38.562582  7406 leader_election.cc:290] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:38.563129  7406 raft_consensus.cc:493] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:38.563771  7043 raft_consensus.cc:493] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.564268  7043 raft_consensus.cc:515] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:38.564705  7559 leader_election.cc:290] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:38.565785  7306 raft_consensus.cc:493] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.566258  7043 leader_election.cc:290] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:38.566284  7306 raft_consensus.cc:515] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:38.476557  7552 raft_consensus.cc:515] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:38.532291  7540 raft_consensus.cc:493] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:38.586330  7549 raft_consensus.cc:2804] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:38.587064  7549 raft_consensus.cc:697] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:38.588220  7549 consensus_queue.cc:237] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:38.591792  7393 leader_election.cc:290] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:38.569109  7406 raft_consensus.cc:515] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:38.508055  7553 raft_consensus.cc:515] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:38.578737  7546 leader_election.cc:290] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:38.530993  7448 raft_consensus.cc:515] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:38.726764  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:15:38.772992  3997 leader_election.cc:336] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 2.172s (SENT)
I20260709 13:15:38.770076  4672 leader_election.cc:304] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
W20260709 13:15:38.664268  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 63365.9us
I20260709 13:15:38.774148  3997 leader_election.cc:304] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:38.621881  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:38.778996  3953 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 10.
I20260709 13:15:38.778116  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:38.780125  4108 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 9.
W20260709 13:15:38.782255  3922 leader_election.cc:336] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.576s (SENT)
I20260709 13:15:38.782763  3922 leader_election.cc:304] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:38.550165  7557 raft_consensus.cc:493] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
W20260709 13:15:38.691020  7555 log.cc:927] Time spent T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:15:38.685727  7325 leader_election.cc:290] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:38.781705  7383 raft_consensus.cc:2804] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:38.792320  7481 leader_election.cc:290] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:38.792505  7306 leader_election.cc:290] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:38.790313  7522 raft_consensus.cc:2749] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:38.794255  3997 leader_election.cc:336] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.602s (SENT)
I20260709 13:15:38.794754  3997 leader_election.cc:304] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:38.546080  7377 raft_consensus.cc:515] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:38.597980  6967 leader_election.cc:290] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:38.799782  4104 pending_rounds.cc:85] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Aborting all ops after (but not including) 3
I20260709 13:15:38.800559  4104 pending_rounds.cc:107] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:15:38.800345  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:38.801011  4104 raft_consensus.cc:2889] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:36.417150  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:38.801712  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:38.785678  7406 leader_election.cc:290] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:38.792348  7383 raft_consensus.cc:697] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 9 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:38.805549  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:38.804833  3997 leader_election.cc:304] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:38.807283  4107 raft_consensus.cc:2393] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 11: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:38.808472  4108 raft_consensus.cc:1240] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:38.806663  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:38.810788  4101 raft_consensus.cc:2468] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 10.
I20260709 13:15:38.811796  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:38.812276  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:38.813089  4100 raft_consensus.cc:2468] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7.
I20260709 13:15:38.814194  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:38.814898  3953 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 10.
I20260709 13:15:38.663887  7380 raft_consensus.cc:515] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:38.818681  7568 raft_consensus.cc:2804] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:38.818998  4672 leader_election.cc:304] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:38.819941  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:38.820631  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:38.823336  4108 raft_consensus.cc:2368] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 9. Current term is 10.
I20260709 13:15:38.822292  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:38.823921  4107 raft_consensus.cc:3060] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:38.800450  7522 raft_consensus.cc:493] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.786268  7518 consensus_queue.cc:1048] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:15:38.838587  4700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57680 (request call id 707) took 1751 ms. Trace:
W20260709 13:15:38.841106  3957 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38606 (request call id 2070) took 1856 ms (client timeout 2209 ms). Trace:
I20260709 13:15:38.826958  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:15:38.841617  3957 rpcz_store.cc:269] 0709 13:15:36.984811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.055010 (+ 70199us) service_pool.cc:224] Handling call
0709 13:15:38.840827 (+1785817us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b540013a1d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:38.841032 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":956630912}
I20260709 13:15:38.844076  4033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38304 (request call id 2254) took 1773 ms. Trace:
I20260709 13:15:38.844525  4033 rpcz_store.cc:276] 0709 13:15:37.071068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.071686 (+   618us) service_pool.cc:224] Handling call
0709 13:15:37.071990 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:37.151162 (+ 79172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.843796 (+1692634us) spinlock_profiling.cc:243] Waited 78.4 ms on lock 0x7b54001dbd54. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:38.844004 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":180337920}
I20260709 13:15:38.845191  7325 raft_consensus.cc:493] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.845774  7325 raft_consensus.cc:515] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:38.848155  7325 leader_election.cc:290] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:38.850497  7325 raft_consensus.cc:493] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.850996  7325 raft_consensus.cc:515] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:38.851833  7384 raft_consensus.cc:2804] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:38.852269  7384 raft_consensus.cc:493] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:38.852660  7384 raft_consensus.cc:3060] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:38.853078  4703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57666 (request call id 577) took 1601 ms. Trace:
I20260709 13:15:38.853538  4703 rpcz_store.cc:276] 0709 13:15:37.254807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.254996 (+   189us) service_pool.cc:224] Handling call
0709 13:15:37.271723 (+ 16727us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:37.286194 (+ 14471us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:15:37.597706 (+311512us) log.cc:844] Serialized 14 byte log entry
0709 13:15:37.745364 (+147658us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:37.745440 (+    76us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:37.745505 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.852849 (+1107344us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b54004407d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:38.852904 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:38.853021 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1002,"prepare.queue_time_us":205234,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":108,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":5155,"spinlock_wait_cycles":38147200,"thread_start_us":444732,"threads_started":2,"wal-append.queue_time_us":225841}
I20260709 13:15:38.855033  7380 leader_election.cc:290] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:38.856292  7325 leader_election.cc:290] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:38.857607  3959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38612 (request call id 1323) took 1081 ms. Trace:
I20260709 13:15:38.858506  7338 raft_consensus.cc:3055] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:38.858640  3959 rpcz_store.cc:276] 0709 13:15:37.776485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.786100 (+  9615us) service_pool.cc:224] Handling call
0709 13:15:37.786516 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:37.821339 (+ 34823us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:37.821377 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:37.824224 (+  2847us) log.cc:844] Serialized 26 byte log entry
0709 13:15:38.535025 (+710801us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:38.535097 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.535886 (+   789us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:38.857373 (+321487us) raft_consensus.cc:1685] finished
0709 13:15:38.857395 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:38.857547 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15463,"raft.queue_time_us":35308,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":207308,"thread_start_us":374701,"threads_started":2,"wal-append.queue_time_us":721863}
I20260709 13:15:38.832077  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:38.839180  4700 rpcz_store.cc:276] 0709 13:15:37.087532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.101124 (+ 13592us) service_pool.cc:224] Handling call
0709 13:15:37.194537 (+ 93413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:37.808836 (+614299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.838248 (+1029412us) spinlock_profiling.cc:243] Waited 527 ms on lock 0x7b5400680e54. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:38.838503 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1212406016}
I20260709 13:15:38.861682  7338 raft_consensus.cc:740] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:38.862601  7338 consensus_queue.cc:260] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:38.863706  7338 raft_consensus.cc:3060] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:38.857465  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:38.864976  4071 leader_election.cc:304] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:38.647770  7540 raft_consensus.cc:515] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:38.831117  7522 raft_consensus.cc:515] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:38.860246  7377 leader_election.cc:290] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:38.869913  7553 leader_election.cc:290] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:38.809633  7517 raft_consensus.cc:2749] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:38.881017  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:38.870997  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:38.806663  7567 raft_consensus.cc:2749] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:38.874730  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:38.876943  4071 leader_election.cc:304] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:38.791515  7557 raft_consensus.cc:515] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:38.882906  4103 raft_consensus.cc:2468] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 9.
I20260709 13:15:38.803383  7543 raft_consensus.cc:515] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:38.890336  7543 leader_election.cc:290] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 8 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:38.894342  3958 pending_rounds.cc:85] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059: Aborting all ops after (but not including) 8
I20260709 13:15:38.894718  3958 pending_rounds.cc:107] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:15:38.895503  3958 raft_consensus.cc:2889] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:38.895987  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:38.864820  7568 raft_consensus.cc:493] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:38.906739  7568 raft_consensus.cc:3060] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:38.907197  7510 consensus_meta.cc:287] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 0.564s	user 0.012s	sys 0.000s
I20260709 13:15:38.896816  3953 raft_consensus.cc:3060] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:15:38.894706  4672 leader_election.cc:304] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:38.908327  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:38.899775  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:38.910127  4101 raft_consensus.cc:3060] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:38.867727  7552 leader_election.cc:290] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:38.900360  4107 raft_consensus.cc:2468] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 12.
W20260709 13:15:38.901278  3922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:38.920658  4103 raft_consensus.cc:1275] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:15:38.880458  7333 raft_consensus.cc:2804] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:38.858737  7383 consensus_queue.cc:237] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:38.912657  7359 raft_consensus.cc:2804] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:38.914002  7543 raft_consensus.cc:2804] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:38.923941  7333 raft_consensus.cc:493] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:38.945678  7543 raft_consensus.cc:493] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:38.945930  7333 raft_consensus.cc:3060] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:38.946215  7543 raft_consensus.cc:3060] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:38.951979  7359 raft_consensus.cc:493] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:38.952502  7359 raft_consensus.cc:3060] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:38.953037  7567 raft_consensus.cc:493] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.957401  7567 raft_consensus.cc:515] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:38.958256  7333 raft_consensus.cc:515] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:38.917951  7414 leader_election.cc:290] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:38.960774  7567 leader_election.cc:290] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:38.960835  7333 leader_election.cc:290] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:15:38.963012  3997 leader_election.cc:336] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.911s (SENT)
I20260709 13:15:38.963986  3997 leader_election.cc:304] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:38.964969  7567 raft_consensus.cc:2749] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:15:38.965958  3997 leader_election.cc:336] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.941s (SENT)
I20260709 13:15:38.968024  7359 raft_consensus.cc:515] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:38.971843  7359 leader_election.cc:290] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:15:38.973508  3997 leader_election.cc:336] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 2.015s (SENT)
I20260709 13:15:38.976928  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:38.977917  4107 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9.
I20260709 13:15:38.919692  7302 raft_consensus.cc:493] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:38.982911  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:38.914234  7306 consensus_queue.cc:1059] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:15:38.986182  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:38.986833  4107 raft_consensus.cc:2376] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 12. Re-sending same reply.
I20260709 13:15:38.956295  7543 raft_consensus.cc:515] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:38.912369  7510 raft_consensus.cc:515] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:38.989786  4101 raft_consensus.cc:2468] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 8.
I20260709 13:15:38.992020  4672 leader_election.cc:304] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:38.919502  7546 consensus_queue.cc:1059] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:15:38.998620  4107 raft_consensus.cc:1275] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:15:39.008558  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:38.996606  7377 raft_consensus.cc:2804] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:38.986953  7302 raft_consensus.cc:515] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:39.016764  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:39.007423  7448 leader_election.cc:290] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:15:39.022595  3925 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.006s	sys 0.007s
W20260709 13:15:39.023085  3925 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.006s	sys 0.007s
I20260709 13:15:39.024471  4033 raft_consensus.cc:1275] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:15:39.023438  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 534501us
I20260709 13:15:39.027050  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:39.028570  4025 raft_consensus.cc:1275] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:39.028546  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:39.029282  4034 raft_consensus.cc:3060] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:39.028999  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:39.030006  4031 raft_consensus.cc:2468] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 8.
I20260709 13:15:39.022712  7377 raft_consensus.cc:697] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 8 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:39.033496  7377 consensus_queue.cc:237] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:39.035951  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:39.036266  4700 raft_consensus.cc:1275] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:15:39.036677  4027 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 10.
W20260709 13:15:39.038762  7521 consensus_meta.cc:287] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.506s	user 0.003s	sys 0.007s
I20260709 13:15:39.039502  7540 leader_election.cc:290] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:15:39.039851  7563 log.cc:927] Time spent T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 13:15:39.047631  7510 leader_election.cc:290] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:39.052568  7557 leader_election.cc:290] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:39.039180  7521 raft_consensus.cc:515] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:39.057382  4701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:39.068400  4034 raft_consensus.cc:2468] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 10.
I20260709 13:15:39.069768  4703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:39.054706  4700 raft_consensus.cc:1240] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:39.070617  4703 raft_consensus.cc:2393] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 10: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
I20260709 13:15:39.070571  4675 leader_election.cc:304] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:39.073305  3925 leader_election.cc:304] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:39.074563  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:39.074072  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:39.075753  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:39.078634  4107 raft_consensus.cc:2393] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 7: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:39.083909  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:39.084656  4034 raft_consensus.cc:2468] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 8.
I20260709 13:15:39.085367  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:39.086122  4025 raft_consensus.cc:2393] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 7: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:39.086621  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:15:39.087324  3925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:39.074059  6967 consensus_queue.cc:1048] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:15:39.090595  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:39.059128  7522 leader_election.cc:290] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:39.091377  4027 raft_consensus.cc:2393] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 10: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
W20260709 13:15:39.091791  3997 leader_election.cc:336] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 2.220s (SENT)
I20260709 13:15:39.092433  3997 leader_election.cc:304] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:39.092885  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:39.093716  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:39.088128  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:39.094403  4028 raft_consensus.cc:2468] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9.
I20260709 13:15:39.094542  4030 raft_consensus.cc:1240] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 9. Current term is 10. Ops: [7.8-9.9]
I20260709 13:15:39.094689  4034 raft_consensus.cc:2468] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
I20260709 13:15:39.096124  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:39.079623  7557 raft_consensus.cc:493] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.097661  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:39.100344  4028 raft_consensus.cc:3060] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:15:39.100623  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:39.093576  4025 raft_consensus.cc:2468] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 10.
I20260709 13:15:39.103466  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:39.108392  3925 leader_election.cc:304] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:39.109464  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:39.110278  4033 raft_consensus.cc:2393] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 9: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:39.115849  3953 raft_consensus.cc:2468] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 8.
I20260709 13:15:39.070055  7546 consensus_queue.cc:1048] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:15:39.088797  7208 raft_consensus.cc:2804] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:39.075682  7059 consensus_queue.cc:1048] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:15:39.117923  7226 raft_consensus.cc:2804] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:39.088279  7518 raft_consensus.cc:2804] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:39.122632  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:39.123646  7543 leader_election.cc:290] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:39.125741  7302 leader_election.cc:290] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:39.129000  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:39.099689  7510 raft_consensus.cc:2749] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:39.122253  3925 leader_election.cc:304] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:39.098366  7521 leader_election.cc:290] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:39.157487  3925 leader_election.cc:304] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:39.165738  3925 leader_election.cc:304] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:39.166139  4702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57666 (request call id 576) took 2035 ms. Trace:
I20260709 13:15:39.098340  7557 raft_consensus.cc:515] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:39.147167  4073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:39.136364  7576 log.cc:927] Time spent T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:15:39.151754  4105 raft_consensus.cc:3060] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:39.140252  7208 raft_consensus.cc:493] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:39.188351  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:39.166652  4702 rpcz_store.cc:276] 0709 13:15:37.131117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.131275 (+   158us) service_pool.cc:224] Handling call
0709 13:15:37.131582 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:37.210894 (+ 79312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.165887 (+1954993us) spinlock_profiling.cc:243] Waited 75.7 ms on lock 0x7b5400610dd4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:39.166077 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":174110464}
I20260709 13:15:39.180392  4709 raft_consensus.cc:1240] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:39.181150  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:39.198062  4099 raft_consensus.cc:2468] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 8.
I20260709 13:15:39.155282  4028 raft_consensus.cc:2468] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 10.
I20260709 13:15:39.149276  7226 raft_consensus.cc:493] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:39.199340  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:39.201190  4675 leader_election.cc:304] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:39.203292  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:39.205133  4099 raft_consensus.cc:2468] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 10.
I20260709 13:15:39.205504  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:39.171926  7517 raft_consensus.cc:2804] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:39.215201  3957 raft_consensus.cc:1275] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:15:39.209692  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:39.217152  3954 raft_consensus.cc:2410] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:15:39.169734  7121 raft_consensus.cc:2804] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:39.217770  4100 raft_consensus.cc:2393] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 8: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:39.218880  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:39.219605  4100 raft_consensus.cc:2468] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9.
I20260709 13:15:39.220816  7333 consensus_queue.cc:1059] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:39.221761  7333 raft_consensus.cc:3055] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:39.222093  7333 raft_consensus.cc:740] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:39.196861  7208 raft_consensus.cc:3060] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:39.207851  7584 log.cc:927] Time spent T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:15:39.227924  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:39.191645  7393 raft_consensus.cc:493] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.231350  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:39.171783  7542 consensus_queue.cc:1059] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:15:39.207629  7521 raft_consensus.cc:2804] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:39.199188  7518 raft_consensus.cc:697] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 10 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:39.204733  7226 raft_consensus.cc:3060] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:39.147138  7384 raft_consensus.cc:515] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:39.237347  7333 consensus_queue.cc:260] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:39.253859  7333 raft_consensus.cc:3060] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:39.235526  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 87787us
I20260709 13:15:39.202663  7583 consensus_queue.cc:1059] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:15:39.200726  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:39.264176  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:39.264873  4034 raft_consensus.cc:3060] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:39.256328  4706 raft_consensus.cc:2393] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 11: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
I20260709 13:15:39.232474  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:39.236545  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:39.257632  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:39.266198  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:39.224766  7517 raft_consensus.cc:493] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:39.240430  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:39.230099  6967 raft_consensus.cc:493] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:39.246904  4105 raft_consensus.cc:2468] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 10.
I20260709 13:15:39.223826  7121 raft_consensus.cc:493] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
W20260709 13:15:39.255887  4071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:39.223483  7543 raft_consensus.cc:2804] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:39.267606  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:39.257107  7583 raft_consensus.cc:3055] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:15:39.248383  7521 raft_consensus.cc:493] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:39.272969  7518 consensus_queue.cc:237] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:39.275712  4100 raft_consensus.cc:2368] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 6. Current term is 7.
I20260709 13:15:39.256002  7325 raft_consensus.cc:3055] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:39.264698  4107 raft_consensus.cc:2468] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 8.
I20260709 13:15:39.306670  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:39.277274  3954 raft_consensus.cc:3060] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:39.241986  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:39.255451  7384 leader_election.cc:290] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 11 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:39.290081  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:39.298187  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:39.280665  7510 raft_consensus.cc:493] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:39.290876  7121 raft_consensus.cc:3060] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:39.278731  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:39.347039  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:39.280112  7517 raft_consensus.cc:3060] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:39.296347  7558 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:39.306354  7521 raft_consensus.cc:3060] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:15:39.367385  7585 log.cc:927] Time spent T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.250s	user 0.002s	sys 0.000s
I20260709 13:15:39.369680  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:15:39.312731  7586 log.cc:927] Time spent T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.232s	user 0.002s	sys 0.000s
I20260709 13:15:39.285171  6967 raft_consensus.cc:515] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:39.373277  3924 leader_election.cc:304] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:39.238734  7393 raft_consensus.cc:515] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:39.374512  7570 consensus_queue.cc:1059] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:39.375388  7393 leader_election.cc:290] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:39.375650  7570 raft_consensus.cc:2749] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:39.376344  7570 raft_consensus.cc:3055] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:39.376667  7570 raft_consensus.cc:740] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:39.377473  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:39.378108  4033 raft_consensus.cc:2468] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 9.
I20260709 13:15:39.379868  4675 leader_election.cc:304] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:39.317652  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:39.305495  4034 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 11.
I20260709 13:15:39.348606  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:39.320335  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:39.334666  4071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:39.346125  7543 raft_consensus.cc:697] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 10 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:39.352742  7510 raft_consensus.cc:515] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:39.361155  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:39.389863  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:39.391018  4101 raft_consensus.cc:2368] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 8. Current term is 9.
I20260709 13:15:39.391881  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:39.392122  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:39.392822  4107 raft_consensus.cc:2393] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 8: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:39.350838  3954 raft_consensus.cc:2468] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 10.
I20260709 13:15:39.364840  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:39.364521  4108 raft_consensus.cc:2368] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 11. Current term is 12.
I20260709 13:15:39.294065  7583 raft_consensus.cc:740] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:39.373494  6967 leader_election.cc:290] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:39.385890  7558 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:39.308041  7448 raft_consensus.cc:493] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.394528  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:39.306687  7325 raft_consensus.cc:740] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:39.397894  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:39.403503  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:39.404922  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:39.406116  4071 leader_election.cc:304] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:39.410559  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:39.413899  4101 raft_consensus.cc:2410] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:15:39.414513  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:39.309564  7302 consensus_queue.cc:1048] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.097s
I20260709 13:15:39.422422  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:39.680742  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:39.427333  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 261645us
I20260709 13:15:39.494573  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:39.613198  4074 leader_election.cc:304] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:39.840822  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 51511.3us
I20260709 13:15:39.882815  4101 raft_consensus.cc:2368] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 6. Current term is 7.
I20260709 13:15:39.445081  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:39.424315  3955 raft_consensus.cc:1240] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:15:39.441917  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
W20260709 13:15:39.913863  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 300909us
I20260709 13:15:39.930047  4099 raft_consensus.cc:2393] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 8: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:39.930084  4074 leader_election.cc:304] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:39.444526  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:39.904848  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:39.746924  4071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:39.932403  4071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:39.879482  7121 consensus_meta.cc:287] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.523s	user 0.012s	sys 0.000s
I20260709 13:15:39.413404  7377 raft_consensus.cc:493] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:39.601511  7530 log.cc:927] Time spent T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 1.475s	user 0.001s	sys 0.000s
W20260709 13:15:39.564356  7338 consensus_meta.cc:287] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.699s	user 0.008s	sys 0.005s
W20260709 13:15:39.695431  7526 log.cc:927] Time spent T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 1.552s	user 0.001s	sys 0.002s
W20260709 13:15:39.928797  4675 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.002s	sys 0.014s
W20260709 13:15:39.943933  4675 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.002s	sys 0.014s
W20260709 13:15:39.944307  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 564507us
I20260709 13:15:39.932196  4101 raft_consensus.cc:2468] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 7.
I20260709 13:15:39.426263  3954 raft_consensus.cc:1240] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:39.412990  7383 raft_consensus.cc:493] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.933717  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:39.934401  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:39.945641  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:39.946249  4101 raft_consensus.cc:2468] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 10.
I20260709 13:15:39.946713  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:39.947077  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:39.947500  4100 raft_consensus.cc:2393] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 9: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
W20260709 13:15:39.523826  7578 log.cc:927] Time spent T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.408s	user 0.002s	sys 0.000s
I20260709 13:15:39.948372  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:39.594167  7539 raft_consensus.cc:493] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.526116  7325 consensus_queue.cc:260] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:39.950217  7325 raft_consensus.cc:3060] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:39.949934  7539 raft_consensus.cc:515] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:39.952754  7539 leader_election.cc:290] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:39.943250  7415 raft_consensus.cc:2804] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:39.913189  7458 raft_consensus.cc:493] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:39.966756  7458 raft_consensus.cc:515] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:39.927304  7333 raft_consensus.cc:2804] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:39.968415  7333 raft_consensus.cc:493] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:39.968967  7333 raft_consensus.cc:3060] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:39.969892  7458 leader_election.cc:290] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:39.907354  7510 leader_election.cc:290] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:39.505530  7557 leader_election.cc:290] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:39.422608  7554 raft_consensus.cc:493] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.421888  7308 raft_consensus.cc:2804] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:39.512838  7583 consensus_queue.cc:260] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:39.518293  7226 raft_consensus.cc:515] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:39.572371  7331 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:39.563117  7556 raft_consensus.cc:2804] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:39.880297  3958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35354 (request call id 405) took 1326 ms. Trace:
I20260709 13:15:39.938922  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:39.943476  7121 raft_consensus.cc:515] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:40.005973  4106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34656 (request call id 456) took 2365 ms. Trace:
I20260709 13:15:40.028792  3958 rpcz_store.cc:276] 0709 13:15:38.553723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.553900 (+   177us) service_pool.cc:224] Handling call
0709 13:15:38.554328 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:38.896187 (+341859us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:38.896233 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:38.896743 (+   510us) log.cc:844] Serialized 26 byte log entry
0709 13:15:39.013008 (+116265us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:39.013045 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.603274 (+590229us) spinlock_profiling.cc:243] Waited 340 ms on lock 0x7b54001694d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:39.603339 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:39.603393 (+    54us) raft_consensus.cc:1685] finished
0709 13:15:39.603407 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:39.880207 (+276800us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":781511040,"thread_start_us":92811,"threads_started":1,"wal-append.queue_time_us":118868}
I20260709 13:15:39.415745  7448 raft_consensus.cc:515] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:39.884887  7517 raft_consensus.cc:515] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:40.027303  7456 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.884s	user 0.035s	sys 0.077s
I20260709 13:15:39.574520  7543 consensus_queue.cc:237] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:40.014679  7558 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:39.408463  7570 consensus_queue.cc:260] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:40.024122  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:40.073582  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:40.137388  4107 raft_consensus.cc:3060] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:15:40.138629  7415 raft_consensus.cc:697] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:39.946480  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:40.017230  7583 raft_consensus.cc:3060] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:40.032672  4106 rpcz_store.cc:276] 0709 13:15:37.640565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.641058 (+   493us) service_pool.cc:224] Handling call
0709 13:15:37.641472 (+   414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:37.641936 (+   464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:37.641978 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:37.667318 (+ 25340us) log.cc:844] Serialized 26 byte log entry
0709 13:15:37.795569 (+128251us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:37.795611 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:37.795681 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:39.600697 (+1805016us) spinlock_profiling.cc:243] Waited 40.2 ms on lock 0x7b4400022b4c. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f15224a7c85 00007f15224a86a2 00007f152521a1db 00007f1525215aaf 00007f152520986e 00007f1525208bb6 00007f15252087d8 00007f1525212221 00007f15252121d9 00007f1525212169
0709 13:15:39.972308 (+371611us) raft_consensus.cc:1685] finished
0709 13:15:39.972341 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:40.005849 (+ 33508us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":603,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":5259,"spinlock_wait_cycles":92544768,"thread_start_us":109737,"threads_started":1,"wal-append.queue_time_us":440791}
W20260709 13:15:40.061910  7456 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.919s	user 0.036s	sys 0.077s
W20260709 13:15:40.059779  7568 consensus_meta.cc:287] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 1.152s	user 0.009s	sys 0.006s
W20260709 13:15:40.059075  7521 consensus_meta.cc:287] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.693s	user 0.008s	sys 0.003s
W20260709 13:15:40.143893  7384 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.023s	sys 0.048s
I20260709 13:15:40.029598  7556 raft_consensus.cc:493] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:40.137583  7308 raft_consensus.cc:697] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:39.972335  7377 raft_consensus.cc:515] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:40.015293  7554 raft_consensus.cc:515] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:40.018607  7383 raft_consensus.cc:515] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:40.403478  3951 raft_consensus.cc:1240] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 6. Current term is 7. Ops: []
W20260709 13:15:40.464027  4071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.066941  3953 raft_consensus.cc:1240] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:40.404299  3959 raft_consensus.cc:2368] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 9. Current term is 10.
W20260709 13:15:40.181650  7384 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.023s	sys 0.048s
W20260709 13:15:40.405912  3999 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.198.196:37117 timed out after 1.583s (SENT) [suppressed 42 similar messages]
I20260709 13:15:40.188457  7415 consensus_queue.cc:237] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:40.466872  3999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 61196.2us
I20260709 13:15:40.407531  4026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41312 (request call id 481) took 1262 ms. Trace:
I20260709 13:15:40.469313  7612 raft_consensus.cc:493] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
W20260709 13:15:40.407927  3924 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.000s	sys 0.003s
W20260709 13:15:40.471012  3924 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.000s	sys 0.004s
W20260709 13:15:40.408733  3925 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.004s	sys 0.003s
W20260709 13:15:40.409395  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 471614us
W20260709 13:15:40.411212  4672 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.051s	sys 0.051s
I20260709 13:15:40.411828  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
W20260709 13:15:40.181481  7393 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.011s	sys 0.011s
I20260709 13:15:40.470438  7612 raft_consensus.cc:515] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:40.472275  7393 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.901s	user 0.054s	sys 0.081s
I20260709 13:15:40.469339  4026 rpcz_store.cc:276] 0709 13:15:39.147921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.148177 (+   256us) service_pool.cc:224] Handling call
0709 13:15:39.170092 (+ 21915us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:39.170438 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:39.170470 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:39.198454 (+ 27984us) log.cc:844] Serialized 26 byte log entry
0709 13:15:39.401462 (+203008us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:39.401511 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.401596 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:40.406682 (+1005086us) raft_consensus.cc:1685] finished
0709 13:15:40.406754 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:40.407180 (+   426us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9867,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":105,"thread_start_us":160886,"threads_started":1,"wal-append.queue_time_us":1081142}
W20260709 13:15:40.474238  4073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:40.474275  4672 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.052s	sys 0.051s
I20260709 13:15:40.325305  7517 leader_election.cc:290] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:40.314487  7518 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.952s	user 0.075s	sys 0.214s
W20260709 13:15:40.478299  7518 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.115s	user 0.095s	sys 0.236s
W20260709 13:15:40.478947  3925 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.004s	sys 0.003s
W20260709 13:15:40.479522  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 597017us
I20260709 13:15:40.479637  7613 raft_consensus.cc:493] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.480666  7613 raft_consensus.cc:515] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:40.481191  4700 raft_consensus.cc:1240] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 10 LEADER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:15:40.417793  7121 leader_election.cc:290] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:40.181615  7208 consensus_meta.cc:287] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.943s	user 0.013s	sys 0.001s
I20260709 13:15:40.484261  7208 raft_consensus.cc:515] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:40.418704  4025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41312 (request call id 483) took 1164 ms. Trace:
I20260709 13:15:40.359354  7554 leader_election.cc:290] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:40.360101  7570 raft_consensus.cc:3060] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:40.488101  4704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:15:40.290752  7596 log.cc:927] Time spent T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:15:40.488971  3957 raft_consensus.cc:2393] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 8: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:40.489357  4704 raft_consensus.cc:2393] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 10: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
I20260709 13:15:40.180727  7568 raft_consensus.cc:515] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:40.490595  7208 leader_election.cc:290] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:40.487341  4025 rpcz_store.cc:276] 0709 13:15:39.253787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.253971 (+   184us) service_pool.cc:224] Handling call
0709 13:15:39.254332 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:39.254709 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:39.254740 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:39.255244 (+   504us) log.cc:844] Serialized 26 byte log entry
0709 13:15:39.494691 (+239447us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:39.494736 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.494817 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:40.418092 (+923275us) raft_consensus.cc:1685] finished
0709 13:15:40.418132 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:40.418477 (+   345us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1107,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"thread_start_us":239097,"threads_started":1,"wal-append.queue_time_us":910787}
I20260709 13:15:40.493059  7568 leader_election.cc:290] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:40.494670  4703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57666 (request call id 584) took 1361 ms. Trace:
I20260709 13:15:40.495175  4703 rpcz_store.cc:276] 0709 13:15:39.132636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.134567 (+  1931us) service_pool.cc:224] Handling call
0709 13:15:39.135001 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:39.135440 (+   439us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:39.135480 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:39.136097 (+   617us) log.cc:844] Serialized 26 byte log entry
0709 13:15:39.520733 (+384636us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:39.521081 (+   348us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.521193 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:40.494079 (+972886us) raft_consensus.cc:1685] finished
0709 13:15:40.494121 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:40.494357 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10131,"raft.queue_time_us":1248,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":9591,"thread_start_us":384165,"threads_started":1,"wal-append.queue_time_us":927079}
I20260709 13:15:40.357044  7556 raft_consensus.cc:3060] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:40.430595  7448 leader_election.cc:290] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:40.432885  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:15:40.361375  7532 log.cc:927] Time spent T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 2.276s	user 0.004s	sys 0.000s
I20260709 13:15:40.434298  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:40.434841  7377 leader_election.cc:290] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:40.437492  7308 consensus_queue.cc:237] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:40.439764  7226 leader_election.cc:290] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:40.440181  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:40.441534  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:40.448242  7609 raft_consensus.cc:493] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.449610  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:40.293402  7476 consensus_queue.cc:260] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:40.474921  4073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.463140  7383 leader_election.cc:290] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:40.180347  7521 raft_consensus.cc:515] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:40.499090  7492 leader_election.cc:290] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:40.518620  4701 raft_consensus.cc:1240] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:15:40.518992  4099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45336 (request call id 1338) took 1249 ms. Trace:
I20260709 13:15:40.519126  7613 leader_election.cc:290] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:15:40.532930  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.534865  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:40.533113  7614 raft_consensus.cc:493] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.533566  7521 leader_election.cc:290] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:40.536494  4099 rpcz_store.cc:276] 0709 13:15:39.269535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.440821 (+1171286us) service_pool.cc:224] Handling call
0709 13:15:40.518854 (+ 78033us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:40.523427  7568 raft_consensus.cc:493] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.530745  7609 raft_consensus.cc:515] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:40.525808  7612 leader_election.cc:290] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:40.557518  4108 raft_consensus.cc:2393] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 8: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
W20260709 13:15:40.560322  7185 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.797s	user 0.017s	sys 0.015s
W20260709 13:15:40.751806  3999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 105393us
W20260709 13:15:40.561874  3924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:40.731858  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 145231us
I20260709 13:15:40.560650  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:40.751739  4102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45332 (request call id 1904) took 1541 ms. Trace:
W20260709 13:15:40.963843  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 392778us
I20260709 13:15:40.969722  7492 raft_consensus.cc:493] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:40.970817  7492 raft_consensus.cc:515] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:40.845376  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:40.684322  3998 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.976s	user 0.005s	sys 0.034s
I20260709 13:15:40.780541  4706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57692 (request call id 381) took 1692 ms. Trace:
I20260709 13:15:40.542397  7613 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
W20260709 13:15:40.560958  7185 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.858s	user 0.017s	sys 0.015s
W20260709 13:15:40.981945  3998 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.419s	user 0.005s	sys 0.054s
W20260709 13:15:40.982195  4107 consensus_meta.cc:287] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.815s	user 0.009s	sys 0.012s
I20260709 13:15:40.962416  4102 rpcz_store.cc:276] 0709 13:15:39.060072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.060228 (+   156us) service_pool.cc:224] Handling call
0709 13:15:39.060603 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:39.061008 (+   405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:39.061037 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:39.061582 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 13:15:40.481300 (+1419718us) spinlock_profiling.cc:243] Waited 2.49 ms on lock 0x7b180018b620. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f1522563e07 00007f152b3beab9 00007f152258069b 00007f152257e93f 00007f1522580c02 00007f152520820b 00007f152520dd23 00007f152520e0d1 00007f1525629a0f
0709 13:15:40.513717 (+ 32417us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:40.545512 (+ 31795us) log.cc:844] Serialized 14 byte log entry
0709 13:15:40.559200 (+ 13688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:40.580269 (+ 21069us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:40.580349 (+    80us) raft_consensus.cc:1685] finished
0709 13:15:40.589150 (+  8801us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:40.601731 (+ 12581us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":427879,"raft.run_cpu_time_us":349,"raft.run_wall_time_us":2210,"spinlock_wait_cycles":5723008,"thread_start_us":62969,"threads_started":2,"wal-append.queue_time_us":1436831}
I20260709 13:15:40.982748  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:40.989177  4106 raft_consensus.cc:2468] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 6.
I20260709 13:15:40.983489  7609 leader_election.cc:290] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:40.982105  4702 raft_consensus.cc:2468] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 9.
W20260709 13:15:40.782315  7573 log.cc:927] Time spent T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 1.586s	user 0.000s	sys 0.002s
W20260709 13:15:40.994088  4071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:40.843930  7582 log.cc:927] Time spent T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 1.683s	user 0.003s	sys 0.000s
I20260709 13:15:40.978179  4706 rpcz_store.cc:276] 0709 13:15:39.059203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.059647 (+   444us) service_pool.cc:224] Handling call
0709 13:15:40.751002 (+1691355us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b54001383d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:40.751365 (+   363us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":413400832}
I20260709 13:15:40.800195  7621 raft_consensus.cc:493] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.998617  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:40.562428  7476 raft_consensus.cc:3060] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:40.844234  7620 raft_consensus.cc:493] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:41.007037  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:41.016216  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:15:41.017441  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:41.004884  4108 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45336 (request call id 1339) took 1735 ms (client timeout 2172 ms). Trace:
I20260709 13:15:41.019413  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:40.579090  7568 raft_consensus.cc:515] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:41.019316  4108 rpcz_store.cc:269] 0709 13:15:39.269819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.561909 (+1292090us) service_pool.cc:224] Handling call
0709 13:15:41.004813 (+442904us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:41.000548  4107 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 11.
I20260709 13:15:40.780974  7548 leader_election.cc:290] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:40.786067  7612 raft_consensus.cc:493] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:40.647742  7614 raft_consensus.cc:515] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:41.030792  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:15:41.031886  4102 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45336 (request call id 1386) took 1436 ms (client timeout 1858 ms). Trace:
W20260709 13:15:41.034838  4102 rpcz_store.cc:269] 0709 13:15:39.602999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.018985 (+1415986us) service_pool.cc:224] Handling call
0709 13:15:41.031771 (+ 12786us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:41.037038  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:41.037283  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:41.038008  4108 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45336 (request call id 1340) took 1767 ms (client timeout 2191 ms). Trace:
W20260709 13:15:41.038010  4102 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45336 (request call id 1380) took 1444 ms (client timeout 1879 ms). Trace:
W20260709 13:15:41.040103  4102 rpcz_store.cc:269] 0709 13:15:39.593786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.036945 (+1443159us) service_pool.cc:224] Handling call
0709 13:15:41.037915 (+   970us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:41.043735  4107 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34656 (request call id 470) took 1761 ms (client timeout 2058 ms). Trace:
W20260709 13:15:41.038421  4108 rpcz_store.cc:269] 0709 13:15:39.270063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.033625 (+1763562us) service_pool.cc:224] Handling call
0709 13:15:41.037915 (+  4290us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:41.044365  4107 rpcz_store.cc:269] 0709 13:15:39.277623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.073164 (+795541us) service_pool.cc:224] Handling call
0709 13:15:41.033398 (+960234us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:41.047829  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 78629.2us
I20260709 13:15:41.017045  7609 raft_consensus.cc:493] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.003650  7613 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:41.043695  4099 raft_consensus.cc:2468] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 9.
I20260709 13:15:41.033169  7393 raft_consensus.cc:493] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
W20260709 13:15:41.052775  4099 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45336 (request call id 1379) took 1457 ms (client timeout 1852 ms). Trace:
W20260709 13:15:41.064020  4099 rpcz_store.cc:269] 0709 13:15:39.592921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.844698 (+1251777us) service_pool.cc:224] Handling call
0709 13:15:41.050225 (+205527us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:41.066704  7548 raft_consensus.cc:493] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.067581  7548 raft_consensus.cc:515] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:41.069854  3951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 2081) took 1886 ms. Trace:
I20260709 13:15:41.070317  7548 leader_election.cc:290] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:41.072451  4026 raft_consensus.cc:1275] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:15:41.072355  7393 raft_consensus.cc:515] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:41.070348  3951 rpcz_store.cc:276] 0709 13:15:39.183928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.185816 (+  1888us) service_pool.cc:224] Handling call
0709 13:15:39.186226 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:40.464008 (+1277782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:41.069428 (+605420us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54002189d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:41.069699 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2797295488}
I20260709 13:15:41.075836  7609 raft_consensus.cc:515] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:41.076258  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:41.076776  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:41.077132  4027 raft_consensus.cc:2468] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 5.
I20260709 13:15:41.077658  4107 raft_consensus.cc:2368] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 8. Current term is 9.
W20260709 13:15:41.078150  4107 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45336 (request call id 1349) took 1805 ms (client timeout 2220 ms). Trace:
I20260709 13:15:41.078325  7609 leader_election.cc:290] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:15:41.078635  4107 rpcz_store.cc:269] 0709 13:15:39.272364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.052416 (+1780052us) service_pool.cc:224] Handling call
0709 13:15:41.078063 (+ 25647us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:41.079037  7415 raft_consensus.cc:493] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
W20260709 13:15:41.079304  3959 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38606 (request call id 2098) took 1790 ms (client timeout 2209 ms). Trace:
I20260709 13:15:41.081585  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:41.082810  3950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38612 (request call id 1335) took 2513 ms. Trace:
W20260709 13:15:41.083184  7556 consensus_meta.cc:287] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938: Time spent flushing consensus metadata: real 0.584s	user 0.015s	sys 0.001s
I20260709 13:15:41.049528  7492 leader_election.cc:290] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:41.052232  7333 consensus_meta.cc:287] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 1.079s	user 0.016s	sys 0.010s
I20260709 13:15:41.085384  7614 leader_election.cc:290] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:15:41.088059  7583 consensus_meta.cc:287] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.926s	user 0.013s	sys 0.009s
I20260709 13:15:41.090710  7613 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:15:41.092064  3959 rpcz_store.cc:269] 0709 13:15:39.289286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.345827 (+ 56541us) service_pool.cc:224] Handling call
0709 13:15:41.079055 (+1733228us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b540013a1d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:41.079224 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2374985472}
I20260709 13:15:41.100833  7448 raft_consensus.cc:493] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:41.072242  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:41.101032  7612 raft_consensus.cc:515] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:41.107585  4108 raft_consensus.cc:2393] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 9: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:41.095736  7556 raft_consensus.cc:515] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:41.075433  7393 leader_election.cc:290] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:41.101120  3999 leader_election.cc:304] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:41.117157  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:41.049588  7521 raft_consensus.cc:493] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
W20260709 13:15:41.126603  4108 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45336 (request call id 1383) took 1531 ms (client timeout 1893 ms). Trace:
W20260709 13:15:41.140627  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.141402  7633 raft_consensus.cc:493] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:41.142210  7633 raft_consensus.cc:515] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:41.143024  7527 log.cc:927] Time spent T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 3.016s	user 0.003s	sys 0.003s
I20260709 13:15:41.143697  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:41.144140  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:41.144814  7633 leader_election.cc:290] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:15:41.145427  4099 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45336 (request call id 1360) took 1870 ms (client timeout 2235 ms). Trace:
W20260709 13:15:41.146142  4099 rpcz_store.cc:269] 0709 13:15:39.275422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.104892 (+1829470us) service_pool.cc:224] Handling call
0709 13:15:41.145331 (+ 40439us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:41.113147  7415 raft_consensus.cc:515] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:41.149134  7521 raft_consensus.cc:515] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:41.145709  4031 raft_consensus.cc:1275] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:15:41.139710  4108 rpcz_store.cc:269] 0709 13:15:39.594753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.081215 (+1486462us) service_pool.cc:224] Handling call
0709 13:15:41.117385 (+ 36170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:41.092366  3950 rpcz_store.cc:276] 0709 13:15:38.568948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.770256 (+201308us) service_pool.cc:224] Handling call
0709 13:15:38.784843 (+ 14587us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:38.797241 (+ 12398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:38.797293 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:38.797807 (+   514us) log.cc:844] Serialized 26 byte log entry
0709 13:15:38.964210 (+166403us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:38.964243 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.964297 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:40.666532 (+1702235us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x7b4400022b4c. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f15224a7c85 00007f15224a86a2 00007f152521a1db 00007f1525215aaf 00007f152520986e 00007f1525208bb6 00007f15252087d8 00007f1525212221 00007f15252121d9 00007f1525212169
0709 13:15:41.082252 (+415720us) raft_consensus.cc:1685] finished
0709 13:15:41.082271 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:41.082566 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60094,"raft.queue_time_us":15091,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":8922,"spinlock_wait_cycles":2690432,"thread_start_us":166112,"threads_started":1,"wal-append.queue_time_us":271330}
I20260709 13:15:41.154620  4702 raft_consensus.cc:2393] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 10: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
I20260709 13:15:41.157572  7625 consensus_queue.cc:1059] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:15:41.158797  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:41.161939  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:41.162427  3955 raft_consensus.cc:1275] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:15:41.052232  7620 raft_consensus.cc:515] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:41.052594  7621 raft_consensus.cc:515] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:41.163921  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:15:41.166558  4102 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45336 (request call id 1381) took 1560 ms (client timeout 1879 ms). Trace:
I20260709 13:15:41.165331  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:41.159387  4701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57680 (request call id 711) took 1994 ms. Trace:
W20260709 13:15:41.169768  4102 rpcz_store.cc:269] 0709 13:15:39.594112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.048492 (+1454380us) service_pool.cc:224] Handling call
0709 13:15:41.154852 (+106360us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:41.171098  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:41.171531  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:41.172006  4705 raft_consensus.cc:2393] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 10: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
W20260709 13:15:41.172449  4102 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45336 (request call id 1366) took 1819 ms (client timeout 2245 ms). Trace:
W20260709 13:15:41.172894  4102 rpcz_store.cc:269] 0709 13:15:39.353510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.171089 (+1817579us) service_pool.cc:224] Handling call
0709 13:15:41.172370 (+  1281us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:41.173038  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:41.171142  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:41.169924  4701 rpcz_store.cc:276] 0709 13:15:39.164968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.182161 (+ 17193us) service_pool.cc:224] Handling call
0709 13:15:40.502101 (+1319940us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:40.545039 (+ 42938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:41.159189 (+614150us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54005b0ed0. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566d8ad 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:41.159332 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3028084992}
W20260709 13:15:41.176594  3999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 75624.3us
W20260709 13:15:41.175240  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 60258.9us
I20260709 13:15:41.181353  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 13 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:15:41.184379  4099 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45336 (request call id 1382) took 1590 ms (client timeout 1949 ms). Trace:
W20260709 13:15:41.184803  4099 rpcz_store.cc:269] 0709 13:15:39.594453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.147265 (+1552812us) service_pool.cc:224] Handling call
0709 13:15:41.184308 (+ 37043us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:41.116034  7333 raft_consensus.cc:515] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:41.176543  7521 leader_election.cc:290] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:41.172456  7612 leader_election.cc:290] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:15:41.190874  3925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.189087  4107 raft_consensus.cc:2468] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 8.
W20260709 13:15:41.193936  4107 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45336 (request call id 1376) took 1602 ms (client timeout 1930 ms). Trace:
W20260709 13:15:41.194231  4107 rpcz_store.cc:269] 0709 13:15:39.591851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.096641 (+1504790us) service_pool.cc:224] Handling call
0709 13:15:41.193870 (+ 97229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:41.197614  3951 raft_consensus.cc:2410] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:15:41.196172  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:41.198271  3954 raft_consensus.cc:2468] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 9.
I20260709 13:15:41.202930  7556 leader_election.cc:290] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:41.205081  7620 leader_election.cc:290] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:41.201941  7466 raft_consensus.cc:3055] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:41.205785  7466 raft_consensus.cc:740] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:41.207731  3950 raft_consensus.cc:1240] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 8. Current term is 9. Ops: []
W20260709 13:15:41.208007  7594 log.cc:927] Time spent T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 1.645s	user 0.004s	sys 0.000s
W20260709 13:15:41.208932  3925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:41.214655  7589 log.cc:927] Time spent T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 1.958s	user 0.008s	sys 0.004s
I20260709 13:15:41.216995  6768 raft_consensus.cc:493] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:41.217576  7607 raft_consensus.cc:493] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.207263  7466 consensus_queue.cc:260] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:41.200428  4108 raft_consensus.cc:2468] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 9.
W20260709 13:15:41.220813  4108 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45336 (request call id 1384) took 1625 ms (client timeout 1959 ms). Trace:
W20260709 13:15:41.221189  4108 rpcz_store.cc:269] 0709 13:15:39.595055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.175710 (+1580655us) service_pool.cc:224] Handling call
0709 13:15:41.220750 (+ 45040us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:41.196841  7393 raft_consensus.cc:2804] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:41.222512  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:41.217654  6768 raft_consensus.cc:515] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:41.226365  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:41.227058  3952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 2077) took 3634 ms. Trace:
I20260709 13:15:41.228585  7333 leader_election.cc:290] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:41.227501  3952 rpcz_store.cc:276] 0709 13:15:37.545277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.579555 (+ 34278us) service_pool.cc:224] Handling call
0709 13:15:37.582162 (+  2607us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:37.602207 (+ 20045us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:37.602249 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:37.602935 (+   686us) log.cc:844] Serialized 52 byte log entry
0709 13:15:37.753214 (+150279us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:37.753259 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:37.753331 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:41.141558 (+3388227us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b4400022b4c. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f15224a7c85 00007f15224a86a2 00007f152521a1db 00007f1525215aaf 00007f152520986e 00007f1525208bb6 00007f15252087d8 00007f1525212221 00007f15252121d9 00007f1525212169
0709 13:15:41.165466 (+ 23908us) raft_consensus.cc:1685] finished
0709 13:15:41.165501 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:41.180082 (+ 14581us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15754,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":3552,"spinlock_wait_cycles":43772800,"thread_start_us":147025,"threads_started":1,"wal-append.queue_time_us":206137}
I20260709 13:15:41.229864  7635 consensus_queue.cc:1059] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:41.230999  7635 consensus_queue.cc:1243] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer f1c75790cedf4f52a3463a255c7da059 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:15:41.231460  7627 log.cc:927] Time spent T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:15:41.231650  7635 raft_consensus.cc:3055] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:41.232183  7635 raft_consensus.cc:740] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:41.232826  7568 leader_election.cc:290] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:41.232038  4074 leader_election.cc:304] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:41.192550  7448 raft_consensus.cc:515] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:41.237663  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:41.238278  4107 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45336 (request call id 1377) took 1646 ms (client timeout 2191 ms). Trace:
W20260709 13:15:41.238570  4107 rpcz_store.cc:269] 0709 13:15:39.592159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.200161 (+1608002us) service_pool.cc:224] Handling call
0709 13:15:41.238229 (+ 38068us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:41.224834  7393 raft_consensus.cc:493] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.239898  7347 raft_consensus.cc:493] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:41.240227  7393 raft_consensus.cc:3060] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:41.240814  7347 raft_consensus.cc:515] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:41.244059  4099 raft_consensus.cc:2468] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 6.
I20260709 13:15:41.244879  4701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:15:41.235945  4102 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45336 (request call id 1369) took 1738 ms (client timeout 2140 ms). Trace:
W20260709 13:15:41.244710  4099 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45336 (request call id 1370) took 1671 ms (client timeout 2103 ms). Trace:
W20260709 13:15:41.247941  4102 rpcz_store.cc:269] 0709 13:15:39.497537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.181835 (+1684298us) service_pool.cc:224] Handling call
0709 13:15:41.235888 (+ 54053us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:41.248131  4099 rpcz_store.cc:269] 0709 13:15:39.573765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.189634 (+1615869us) service_pool.cc:224] Handling call
0709 13:15:41.244652 (+ 55018us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:41.223701  7521 raft_consensus.cc:493] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.218354  7607 raft_consensus.cc:515] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:41.250427  4104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45332 (request call id 1887) took 2451 ms. Trace:
I20260709 13:15:41.250609  7521 raft_consensus.cc:515] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:41.252449  7607 leader_election.cc:290] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:41.251019  4104 rpcz_store.cc:276] 0709 13:15:38.799071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.799194 (+   123us) service_pool.cc:224] Handling call
0709 13:15:38.799528 (+   334us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:38.821213 (+ 21685us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:38.821250 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:38.834664 (+ 13414us) log.cc:844] Serialized 52 byte log entry
0709 13:15:40.801657 (+1966993us) spinlock_profiling.cc:243] Waited 25.7 ms on lock 0x7b180039d900. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f1522563e07 00007f152b3beab9 00007f152258069b 00007f152257e93f 00007f1522580c02 00007f152520820b 00007f152520dd23 00007f152520e0d1 00007f1525629a0f
0709 13:15:41.096732 (+295075us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:41.163886 (+ 67154us) log.cc:844] Serialized 14 byte log entry
0709 13:15:41.188433 (+ 24547us) log.cc:844] Serialized 14 byte log entry
0709 13:15:41.193124 (+  4691us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:41.200876 (+  7752us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:41.247696 (+ 46820us) raft_consensus.cc:1685] finished
0709 13:15:41.247722 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:41.250155 (+  2433us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57005,"prepare.queue_time_us":5402,"prepare.run_cpu_time_us":162,"prepare.run_wall_time_us":7766,"raft.queue_time_us":27299,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":23635,"spinlock_wait_cycles":66385536,"thread_start_us":200048,"threads_started":1,"wal-append.queue_time_us":2358495}
I20260709 13:15:41.254314  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:41.256270  4071 leader_election.cc:400] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 election: Vote denied by peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339) with higher term. Message: Invalid argument: T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 9. Current term is 10.
I20260709 13:15:41.256795  4071 leader_election.cc:403] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:15:41.256361  7336 consensus_queue.cc:1059] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:41.257275  7621 leader_election.cc:290] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:41.257542  7336 consensus_queue.cc:1048] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:41.257885  7621 raft_consensus.cc:3055] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:41.258257  7621 raft_consensus.cc:740] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:41.259601  7632 raft_consensus.cc:3060] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:41.261282  7626 consensus_queue.cc:1059] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:41.262815  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:41.268615  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:41.269099  4071 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:15:41.272423  3922 leader_election.cc:336] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.798s (SENT)
I20260709 13:15:41.272993  3922 leader_election.cc:304] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:41.273854  7625 raft_consensus.cc:2804] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:41.274364  7558 raft_consensus.cc:2749] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:41.274369  7625 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:41.275741  7625 raft_consensus.cc:3060] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:41.296736  4104 raft_consensus.cc:2468] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 6.
I20260709 13:15:41.320894  7626 raft_consensus.cc:2749] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:41.322052  7626 raft_consensus.cc:493] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.322754  7626 raft_consensus.cc:515] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:41.323858  7466 raft_consensus.cc:3060] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:41.260792  7621 consensus_queue.cc:260] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:41.340235  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 68036.9us
I20260709 13:15:41.340837  6768 leader_election.cc:290] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:41.341660  4701 raft_consensus.cc:1275] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:15:41.233690  7635 consensus_queue.cc:260] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:15:41.349702  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:41.355656  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.350831  4107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45336 (request call id 1355) took 2076 ms. Trace:
I20260709 13:15:41.357880  4107 rpcz_store.cc:276] 0709 13:15:39.274031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.297179 (+2023148us) service_pool.cc:224] Handling call
0709 13:15:41.350750 (+ 53571us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1156992}
I20260709 13:15:41.424561  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:41.369540  3999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 132177us
I20260709 13:15:41.426097  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:41.427212  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:41.427641  4108 raft_consensus.cc:2393] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 12: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:41.427887  4104 raft_consensus.cc:2468] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 13.
W20260709 13:15:41.428094  4108 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45336 (request call id 1343) took 2157 ms (client timeout 2776 ms). Trace:
W20260709 13:15:41.428485  4108 rpcz_store.cc:269] 0709 13:15:39.270800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.249572 (+1978772us) service_pool.cc:224] Handling call
0709 13:15:41.428038 (+178466us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":600832}
I20260709 13:15:41.431265  4108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34656 (request call id 471) took 2148 ms. Trace:
I20260709 13:15:41.432013  4108 rpcz_store.cc:276] 0709 13:15:39.282814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.429357 (+2146543us) service_pool.cc:224] Handling call
0709 13:15:41.430348 (+   991us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:41.430713 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:41.430737 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:41.430800 (+    63us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:41.430828 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:41.430879 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:41.431176 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:41.434701  4108 raft_consensus.cc:3060] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:41.435766  4107 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:15:41.436584  4107 raft_consensus.cc:606] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Received request to transfer leadership to TS 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:41.436940  4107 raft_consensus.cc:614] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:41.438328  4026 raft_consensus.cc:1275] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:15:41.439459  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:41.440121  7448 leader_election.cc:290] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:41.440203  4026 raft_consensus.cc:3060] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:41.440416  4027 raft_consensus.cc:1240] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 9. Current term is 10. Ops: [7.8-9.9]
I20260709 13:15:41.441201  4104 raft_consensus.cc:1275] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:15:41.441833  4104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45336 (request call id 1356) took 2167 ms. Trace:
I20260709 13:15:41.442183  4104 rpcz_store.cc:276] 0709 13:15:39.274302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.440521 (+2166219us) service_pool.cc:224] Handling call
0709 13:15:41.440859 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:41.441538 (+   679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:41.441751 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:41.442412  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:41.443271  4028 raft_consensus.cc:3060] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:41.441857  4027 raft_consensus.cc:3060] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:41.443712  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:41.444495  4030 raft_consensus.cc:3060] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:41.440222  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:41.446841  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:41.447227  4032 raft_consensus.cc:2393] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 8: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:41.447476  4033 raft_consensus.cc:3060] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:41.448614  4032 raft_consensus.cc:1275] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:15:41.446861  3997 leader_election.cc:336] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.522s (SENT)
I20260709 13:15:41.450807  3997 leader_election.cc:304] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:41.452680  3922 leader_election.cc:336] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.942s (SENT)
I20260709 13:15:41.453207  3922 leader_election.cc:304] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:41.455701  3956 raft_consensus.cc:1275] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:15:41.456125  3956 pending_rounds.cc:85] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059: Aborting all ops after (but not including) 6
I20260709 13:15:41.456387  3956 pending_rounds.cc:107] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:15:41.456682  3956 raft_consensus.cc:2889] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:41.457664  7549 raft_consensus.cc:493] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.457860  7568 raft_consensus.cc:2749] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:41.439476  7393 raft_consensus.cc:515] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:41.432200  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 232027us
W20260709 13:15:41.457688  4071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.438441  4107 raft_consensus.cc:1240] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:41.426766  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:41.462641  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.426232  4099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45336 (request call id 1389) took 1813 ms. Trace:
I20260709 13:15:41.464610  4107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45336 (request call id 1368) took 2063 ms. Trace:
I20260709 13:15:41.464838  4099 rpcz_store.cc:276] 0709 13:15:39.612614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.249006 (+1636392us) service_pool.cc:224] Handling call
0709 13:15:41.426164 (+177158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14720}
I20260709 13:15:41.465116  4107 rpcz_store.cc:276] 0709 13:15:39.397133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.437798 (+2040665us) service_pool.cc:224] Handling call
0709 13:15:41.438175 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:41.459730 (+ 21555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:41.459927 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:41.469219  7302 raft_consensus.cc:493] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.469893  7302 raft_consensus.cc:515] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:41.471829  6768 raft_consensus.cc:2749] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:41.472090  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:15:41.472536  3922 leader_election.cc:336] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.987s (SENT)
I20260709 13:15:41.474745  4102 raft_consensus.cc:2393] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 11: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
I20260709 13:15:41.475270  4102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45336 (request call id 1372) took 1885 ms. Trace:
I20260709 13:15:41.475646  4102 rpcz_store.cc:276] 0709 13:15:39.590350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.298170 (+1707820us) service_pool.cc:224] Handling call
0709 13:15:41.475206 (+177036us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:41.476280  4701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:41.476559  4025 raft_consensus.cc:1240] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:41.479957  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:41.483037  4030 raft_consensus.cc:2468] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9.
I20260709 13:15:41.519855  7377 consensus_queue.cc:1048] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:15:41.521490  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:41.483819  4029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38304 (request call id 2263) took 2397 ms. Trace:
I20260709 13:15:41.485081  6768 raft_consensus.cc:493] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:41.522686  6768 raft_consensus.cc:515] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:41.522297  4029 rpcz_store.cc:276] 0709 13:15:39.085939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.087360 (+  1421us) service_pool.cc:224] Handling call
0709 13:15:39.107008 (+ 19648us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:39.112198 (+  5190us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:15:39.130231 (+ 18033us) log.cc:844] Serialized 14 byte log entry
0709 13:15:39.227019 (+ 96788us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:39.235100 (+  8081us) log.cc:844] Serialized 26 byte log entry
0709 13:15:39.235300 (+   200us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:39.236021 (+   721us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.236105 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:41.213553 (+1977448us) spinlock_profiling.cc:243] Waited 3.17 ms on lock 0x7b4400022b4c. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f15224a7c85 00007f15224a86a2 00007f152521a1db 00007f1525215aaf 00007f152520986e 00007f1525208bb6 00007f15252087d8 00007f1525212221 00007f15252121d9 00007f1525212169
0709 13:15:41.459499 (+245946us) raft_consensus.cc:1685] finished
0709 13:15:41.473925 (+ 14426us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:41.483607 (+  9682us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":6625,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":12614,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":6829,"spinlock_wait_cycles":7290752,"thread_start_us":96145,"threads_started":1,"wal-append.queue_time_us":120795}
I20260709 13:15:41.527184  4029 raft_consensus.cc:1275] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:15:41.533097  4029 raft_consensus.cc:1275] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:15:41.533620  3957 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38606 (request call id 2094) took 2295 ms (client timeout 1602 ms). Trace:
W20260709 13:15:41.534245  3957 rpcz_store.cc:269] 0709 13:15:39.238645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.241758 (+  3113us) service_pool.cc:224] Handling call
0709 13:15:41.533302 (+2291544us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54001680d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:41.533496 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2714648320}
I20260709 13:15:41.458369  7549 raft_consensus.cc:515] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:41.487571  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 264517us
I20260709 13:15:41.487655  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:41.487859  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:15:41.477733  3922 connection.cc:256] RPC call timeout handler was delayed by -2.1743341709998276s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22440000000000004s for a response
I20260709 13:15:41.489709  7393 leader_election.cc:290] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:41.489629  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:41.490623  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:41.491667  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:41.497102  7466 consensus_queue.cc:1048] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:41.502739  7558 consensus_queue.cc:1048] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:41.547933  3857 catalog_manager.cc:5697] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 5 to 6, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 6 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
W20260709 13:15:41.549763  3922 leader_election.cc:336] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 2.068s (SENT)
I20260709 13:15:41.550333  3922 leader_election.cc:304] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
W20260709 13:15:41.510432  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 288902us
I20260709 13:15:41.510489  4099 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:15:41.551719  4099 raft_consensus.cc:606] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Received request to transfer leadership to TS 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:41.552148  4099 raft_consensus.cc:614] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:41.511881  4107 raft_consensus.cc:1275] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:15:41.519793  4701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:41.553205  4701 raft_consensus.cc:3060] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:41.520157  4675 leader_election.cc:304] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
W20260709 13:15:41.527227  3856 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44680 (request call id 120) took 21533 ms (client timeout 15000 ms). Trace:
I20260709 13:15:41.529345  7347 leader_election.cc:290] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:41.531534  4102 raft_consensus.cc:1275] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:15:41.486692  4074 leader_election.cc:304] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:41.538632  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 114146us
I20260709 13:15:41.533670  7625 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:41.550699  3857 catalog_manager.cc:5697] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 3 to 5, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 5 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:41.518186  4026 raft_consensus.cc:2468] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 11.
I20260709 13:15:41.526356  6768 leader_election.cc:290] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:41.543511  4034 raft_consensus.cc:2468] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9.
W20260709 13:15:41.555876  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.558754  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:41.561437  4033 raft_consensus.cc:2468] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7.
I20260709 13:15:41.563256  7306 raft_consensus.cc:3055] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:41.563764  7306 raft_consensus.cc:740] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:41.551935  7621 raft_consensus.cc:3060] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:41.572490  4104 raft_consensus.cc:1240] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:41.565317  7059 raft_consensus.cc:2804] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:41.568122  3925 leader_election.cc:304] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:41.596740  4028 raft_consensus.cc:2468] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 10.
I20260709 13:15:41.598248  7635 raft_consensus.cc:3060] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:41.598317  7314 raft_consensus.cc:2749] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:15:41.600324  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 113771us
I20260709 13:15:41.602597  4672 leader_election.cc:304] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:41.603974  3955 raft_consensus.cc:1275] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:15:41.605305  7636 raft_consensus.cc:2804] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:15:41.606353  3922 connection.cc:256] RPC call timeout handler was delayed by -1.9602831049999168s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1754s for a response
I20260709 13:15:41.578248  7059 raft_consensus.cc:493] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.613986  4108 raft_consensus.cc:1275] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:15:41.637504  4672 leader_election.cc:304] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:41.639940  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:41.640188  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:41.641139  7466 raft_consensus.cc:493] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:41.642614  7476 raft_consensus.cc:2804] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:15:41.645452  4073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:41.614109  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 52440.4us
W20260709 13:15:41.615315  3922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.646648  4108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45336 (request call id 1364) took 2341 ms. Trace:
I20260709 13:15:41.587704  7632 raft_consensus.cc:2749] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339) with higher term. Message: Invalid argument: T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 9. Current term is 10.
I20260709 13:15:41.649874  4108 rpcz_store.cc:276] 0709 13:15:39.303527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.433760 (+2130233us) service_pool.cc:224] Handling call
0709 13:15:41.434340 (+   580us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:41.644297 (+209957us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:41.644519 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:41.605847  7636 raft_consensus.cc:697] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 11 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
W20260709 13:15:41.651729  3922 connection.cc:256] RPC call timeout handler was delayed by -1.8926341709998269s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2557s for a response
I20260709 13:15:41.620532  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:41.655133  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:15:41.661042  3922 connection.cc:256] RPC call timeout handler was delayed by -1.8513831049999681s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1875s for a response
I20260709 13:15:41.654211  4701 raft_consensus.cc:2468] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 10.
W20260709 13:15:41.661456  3922 connection.cc:256] RPC call timeout handler was delayed by -1.7486341709998214s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2717s for a response
I20260709 13:15:41.596524  7613 raft_consensus.cc:2749] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:15:41.661875  3922 connection.cc:256] RPC call timeout handler was delayed by -1.710083104999967s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20320000000000002s for a response
W20260709 13:15:41.661653  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 110070us
W20260709 13:15:41.667089  7590 log.cc:927] Time spent T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 2.402s	user 0.003s	sys 0.000s
I20260709 13:15:41.644083  3857 catalog_manager.cc:5697] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:41.668427  3951 raft_consensus.cc:2410] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:15:41.648319  7059 raft_consensus.cc:3060] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:41.757118  4701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:41.756109  4703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:15:41.763954  4073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 66258.1us
W20260709 13:15:41.766052  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:41.680958  3922 connection.cc:256] RPC call timeout handler was delayed by -1.3295952689998103s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1626s for a response
I20260709 13:15:41.680347  3999 leader_election.cc:304] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
W20260709 13:15:41.756390  4106 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45336 (request call id 1341) took 2408 ms (client timeout 2140 ms). Trace:
I20260709 13:15:41.756706  4705 raft_consensus.cc:1240] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:41.664856  7476 raft_consensus.cc:697] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
W20260709 13:15:41.836297  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 172900us
I20260709 13:15:41.795490  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:41.810745  4107 raft_consensus.cc:1275] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:15:41.824249  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 63432.3us
W20260709 13:15:41.822068  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 219182us
W20260709 13:15:41.823259  4106 rpcz_store.cc:269] 0709 13:15:39.270314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.410724 (+1140410us) service_pool.cc:224] Handling call
0709 13:15:41.674087 (+1263363us) spinlock_profiling.cc:243] Waited 73.2 ms on lock 0x7b540042e0d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:41.678752 (+  4665us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":168388992}
I20260709 13:15:41.840758  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:41.841747  3952 raft_consensus.cc:2468] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 8.
W20260709 13:15:41.844870  3999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 164602us
I20260709 13:15:41.845772  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:41.852478  7540 consensus_queue.cc:1048] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.255s
I20260709 13:15:41.795439  7556 raft_consensus.cc:2804] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:41.868712  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:41.675136  7639 consensus_queue.cc:1048] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.200s
I20260709 13:15:41.849582  7568 raft_consensus.cc:2804] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:41.880636  7625 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:15:41.883195  3997 leader_election.cc:336] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.801s (SENT)
I20260709 13:15:41.883762  3997 leader_election.cc:304] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:41.885779  3997 leader_election.cc:336] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.751s (SENT)
I20260709 13:15:41.849359  7308 consensus_queue.cc:1048] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:15:41.888325  7492 raft_consensus.cc:2749] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:41.886354  3997 leader_election.cc:304] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:41.890336  7415 leader_election.cc:290] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:41.886520  3957 raft_consensus.cc:3060] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:41.880767  4074 leader_election.cc:304] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:41.879138  4672 leader_election.cc:304] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:41.893271  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:15:41.893347  3924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:41.554092  3856 rpcz_store.cc:269] 0709 13:15:19.985938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:20.010629 (+ 24691us) service_pool.cc:224] Handling call
0709 13:15:41.507088 (+21496459us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:31.128158 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:31.128847 (+   689us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:31.128910 (+    63us) write_op.cc:435] Acquired schema lock
0709 13:15:31.128928 (+    18us) tablet.cc:662] Decoding operations
0709 13:15:31.129911 (+   983us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:31.135517 (+  5606us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:31.135570 (+    53us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:15:31.136529 (+   959us) tablet.cc:701] Row locks acquired
0709 13:15:31.136579 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:15:31.136798 (+   219us) write_op.cc:270] Start()
0709 13:15:31.136974 (+   176us) write_op.cc:276] Timestamp: P: 1783602931136719 usec, L: 0
0709 13:15:31.137000 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:15:31.233736 (+ 96736us) log.cc:844] Serialized 3277 byte log entry
0709 13:15:32.577671 (+1343935us) op_driver.cc:464] REPLICATION: finished
0709 13:15:33.247885 (+670214us) write_op.cc:301] APPLY: starting
0709 13:15:33.248017 (+   132us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:33.248263 (+   246us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:33.248404 (+   141us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:33.249707 (+  1303us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:33.250099 (+   392us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:15:33.250144 (+    45us) write_op.cc:312] APPLY: finished
0709 13:15:33.250520 (+   376us) log.cc:844] Serialized 65 byte log entry
0709 13:15:33.255884 (+  5364us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:33.256034 (+   150us) write_op.cc:454] Released schema lock
0709 13:15:33.256114 (+    80us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:33.256558 (+   444us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:33.256594 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":363862,"reported_tablets":24,"child_traces":[["op",{"apply.queue_time_us":611244,"apply.run_cpu_time_us":3575,"apply.run_wall_time_us":20712,"num_ops":8,"prepare.queue_time_us":105200,"prepare.run_cpu_time_us":27508,"prepare.run_wall_time_us":312824,"raft.queue_time_us":623783,"raft.run_cpu_time_us":26305,"raft.run_wall_time_us":544328,"replication_time_us":1397789,"thread_start_us":958650,"threads_started":4,"wal-append.queue_time_us":588199,"wal-append.run_cpu_time_us":43645,"wal-append.run_wall_time_us":2413619}]]}
I20260709 13:15:41.866039  7556 raft_consensus.cc:493] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.907809  7469 raft_consensus.cc:493] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.907919  7556 raft_consensus.cc:3060] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:15:41.908706  7644 log.cc:927] Time spent T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.353s	user 0.000s	sys 0.001s
I20260709 13:15:41.908485  7469 raft_consensus.cc:515] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:41.865419  7558 consensus_queue.cc:1048] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:15:41.911119  7469 leader_election.cc:290] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:41.845793  7466 raft_consensus.cc:515] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:41.914052  7466 leader_election.cc:290] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:41.900455  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:41.901767  7476 consensus_queue.cc:237] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:41.904124  4103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45332 (request call id 1907) took 2803 ms. Trace:
I20260709 13:15:41.849730  7314 consensus_queue.cc:1048] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:15:41.916317  7572 raft_consensus.cc:2749] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:41.918898  7521 leader_election.cc:290] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:41.919528  6839 consensus_queue.cc:1048] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:41.919674  3857 catalog_manager.cc:5697] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 5 to 7, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 7 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:41.922463  7399 raft_consensus.cc:3055] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:41.921836  3857 catalog_manager.cc:5697] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 6 to 7, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 7 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:41.922923  7399 raft_consensus.cc:740] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:41.925904  3958 raft_consensus.cc:1240] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:41.935492  3955 raft_consensus.cc:2468] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 9.
I20260709 13:15:41.926215  7610 consensus_queue.cc:1048] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:15:41.917196  4103 rpcz_store.cc:276] 0709 13:15:39.074831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.074995 (+   164us) service_pool.cc:224] Handling call
0709 13:15:39.090760 (+ 15765us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:39.110210 (+ 19450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:39.110241 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:39.110760 (+   519us) log.cc:844] Serialized 26 byte log entry
0709 13:15:39.161837 (+ 51077us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:39.399286 (+237449us) log.cc:844] Serialized 14 byte log entry
0709 13:15:39.399634 (+   348us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.399740 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:41.563970 (+2164230us) spinlock_profiling.cc:243] Waited 5.58 ms on lock 0x7b4400022b4c. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f15224a7c85 00007f15224a86a2 00007f152521a1db 00007f1525215aaf 00007f152520986e 00007f1525208bb6 00007f15252087d8 00007f1525212221 00007f15252121d9 00007f1525212169
0709 13:15:41.858550 (+294580us) raft_consensus.cc:1685] finished
0709 13:15:41.865255 (+  6705us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:41.878371 (+ 13116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":38146,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":14352,"raft.queue_time_us":25494,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":14182,"spinlock_wait_cycles":12832128,"thread_start_us":247527,"threads_started":2,"wal-append.queue_time_us":39480}
I20260709 13:15:41.896591  7568 raft_consensus.cc:697] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:41.938910  7568 consensus_queue.cc:237] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:41.887480  7636 consensus_queue.cc:237] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:41.931720  3925 leader_election.cc:304] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:41.950596  4071 leader_election.cc:304] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:41.950943  3957 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 11.
W20260709 13:15:41.960263  3925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.931071  7632 raft_consensus.cc:2749] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:15:41.960912  3925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.962007  3951 raft_consensus.cc:1275] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:15:41.960785  7521 raft_consensus.cc:2749] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:15:41.963814  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 83204us
I20260709 13:15:41.983737  4104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34656 (request call id 472) took 1007 ms. Trace:
I20260709 13:15:41.984874  4104 rpcz_store.cc:276] 0709 13:15:40.967055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.443135 (+476080us) service_pool.cc:224] Handling call
0709 13:15:41.443443 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:41.576920 (+133477us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:41.973814 (+396894us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b54001bab54. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:41.974059 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":296258432}
W20260709 13:15:41.990075  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 76412.7us
I20260709 13:15:41.987984  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:41.971426  7621 raft_consensus.cc:2804] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:41.996580  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:42.000540  3955 raft_consensus.cc:1275] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:15:42.001094  3955 pending_rounds.cc:85] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059: Aborting all ops after (but not including) 8
I20260709 13:15:42.001381  3955 pending_rounds.cc:107] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:15:42.001680  3955 raft_consensus.cc:2889] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:42.007682  4025 raft_consensus.cc:2393] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 8: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:41.987382  7448 raft_consensus.cc:2749] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:41.999257  3951 raft_consensus.cc:2468] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 13.
I20260709 13:15:42.009486  3857 catalog_manager.cc:5697] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 5 to 6, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 6 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:41.972436  7415 consensus_queue.cc:1059] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:15:41.997839  7558 raft_consensus.cc:493] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.998528  7621 raft_consensus.cc:493] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:42.018999  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 133225us
I20260709 13:15:42.021867  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:42.032884  7059 raft_consensus.cc:515] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:42.035353  7059 leader_election.cc:290] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:42.043725  7361 raft_consensus.cc:493] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.044466  7361 raft_consensus.cc:515] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:42.047025  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 49906.1us
I20260709 13:15:42.047960  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:42.048417  4074 leader_election.cc:304] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:42.048627  4103 raft_consensus.cc:3060] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:42.053387  7645 log.cc:927] Time spent T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.585s	user 0.002s	sys 0.010s
I20260709 13:15:42.036798  7558 raft_consensus.cc:515] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:42.040839  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:42.072952  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:42.074798  4103 raft_consensus.cc:2468] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 7.
I20260709 13:15:42.030798  7621 raft_consensus.cc:3060] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:42.078464  7635 raft_consensus.cc:2749] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:42.084371  4031 raft_consensus.cc:2468] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 8.
I20260709 13:15:42.084080  3857 catalog_manager.cc:5697] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 5 to 7, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 7 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:42.089156  7558 leader_election.cc:290] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:15:42.084389  7656 log.cc:927] Time spent T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:15:42.096524  3953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 2080) took 2892 ms. Trace:
I20260709 13:15:42.096988  3953 rpcz_store.cc:276] 0709 13:15:39.183438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.185025 (+  1587us) service_pool.cc:224] Handling call
0709 13:15:39.185514 (+   489us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:40.465084 (+1279570us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:42.064684 (+1599600us) spinlock_profiling.cc:243] Waited 881 ms on lock 0x7b54001f7554. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:42.075833 (+ 11149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2026473344}
I20260709 13:15:42.097971  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:42.108675  7628 consensus_queue.cc:1059] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:42.109915  7635 raft_consensus.cc:3055] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:42.110328  7635 raft_consensus.cc:740] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:42.111430  7635 consensus_queue.cc:260] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:42.112771  7635 raft_consensus.cc:3060] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:42.113708  7361 leader_election.cc:290] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:42.115974  4672 leader_election.cc:304] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:42.117800  7601 raft_consensus.cc:2804] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:42.118290  7601 raft_consensus.cc:697] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [term 7 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:42.116173  7059 consensus_queue.cc:1059] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:42.115185  7185 consensus_queue.cc:1048] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:15:42.119982  7383 raft_consensus.cc:3055] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:42.120381  7383 raft_consensus.cc:740] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:42.121248  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:42.121344  7383 consensus_queue.cc:260] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:42.122085  4100 raft_consensus.cc:2376] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 6. Re-sending same reply.
W20260709 13:15:42.122689  4100 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45336 (request call id 1347) took 2850 ms (client timeout 2015 ms). Trace:
I20260709 13:15:42.122895  7383 raft_consensus.cc:3060] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:42.123730  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:42.124396  3954 raft_consensus.cc:2468] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 9.
I20260709 13:15:42.125663  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:42.126268  3954 raft_consensus.cc:2376] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d709ee666b774ec29aa732e508219938 in term 11. Re-sending same reply.
I20260709 13:15:42.127794  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:42.119385  7601 consensus_queue.cc:237] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:42.099169  7306 consensus_queue.cc:260] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:42.133245  7306 raft_consensus.cc:3060] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:42.136847  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:42.138715  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:42.140365  3999 leader_election.cc:304] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:42.140552  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:42.142041  7663 raft_consensus.cc:3060] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:42.142256  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:42.144217  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:42.145473  3956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 2099) took 2757 ms. Trace:
I20260709 13:15:42.146246  3956 rpcz_store.cc:276] 0709 13:15:39.388536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.913454 (+524918us) service_pool.cc:224] Handling call
0709 13:15:39.936699 (+ 23245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:41.457323 (+1520624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:42.145212 (+687889us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b54003ae8d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:42.145414 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3491810560}
I20260709 13:15:42.146710  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:42.147317  3950 raft_consensus.cc:2376] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d709ee666b774ec29aa732e508219938 in term 8. Re-sending same reply.
I20260709 13:15:42.150748  7549 leader_election.cc:290] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:42.153766  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:42.155954  3925 leader_election.cc:304] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:42.156823  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:42.157146  3925 leader_election.cc:304] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:42.158141  4033 raft_consensus.cc:2393] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 8: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:42.158524  3925 leader_election.cc:304] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:42.159528  7558 raft_consensus.cc:2804] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:42.159948  7558 raft_consensus.cc:493] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:42.161181  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 48544.9us
I20260709 13:15:42.160034  7440 raft_consensus.cc:2804] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:42.163174  7558 raft_consensus.cc:3060] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:42.168174  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:42.169804  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:42.174566  3925 leader_election.cc:304] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:15:42.123045  4100 rpcz_store.cc:269] 0709 13:15:39.271861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.948092 (+676231us) service_pool.cc:224] Handling call
0709 13:15:41.257157 (+1309065us) spinlock_profiling.cc:243] Waited 25 ms on lock 0x7b5800011798. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f1522549b71 00007f1522549eee 0000000000375939 00007f152a5bd1e0 00007f152a6860c4 00007f152a686131 00007f152a6340a0 00007f152a633984 00007f1523bae6d4 00007f1523bae662
0709 13:15:42.120996 (+863839us) spinlock_profiling.cc:243] Waited 5.38 ms on lock 0x7b5800011798. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f1522549f8c 00007f1522549ef6 0000000000375939 00007f152a5bd1e0 00007f152a6860c4 00007f152a686131 00007f152a6340a0 00007f152a633984 00007f1523bae6d4 00007f1523bae662
0709 13:15:42.122602 (+  1606us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":69968896}
I20260709 13:15:42.180482  3955 raft_consensus.cc:3060] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:42.193270  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:42.193876  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:15:42.200441  3997 leader_election.cc:336] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 2.140s (SENT)
I20260709 13:15:42.206070  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:42.211982  4031 raft_consensus.cc:1240] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:42.234012  3857 catalog_manager.cc:5697] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 1 to 7. New cstate: current_term: 7 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:42.280001  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:42.198288  7440 raft_consensus.cc:697] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 7 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
W20260709 13:15:42.281934  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.200158  7549 raft_consensus.cc:2804] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:42.295085  7626 leader_election.cc:290] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:42.198079  7628 consensus_queue.cc:1048] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 13:15:42.300786  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:42.309559  4027 raft_consensus.cc:3060] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:15:42.305912  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:42.300565  7440 consensus_queue.cc:237] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:42.210471  7469 consensus_queue.cc:1059] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.092s
I20260709 13:15:42.302976  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:42.313136  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:42.315337  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:42.287192  7169 raft_consensus.cc:2804] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:42.320843  3953 raft_consensus.cc:1240] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:42.321116  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:42.319343  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:42.271840  3925 leader_election.cc:304] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:42.314126  7448 raft_consensus.cc:493] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.216702  7556 raft_consensus.cc:515] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:42.325860  7549 raft_consensus.cc:697] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 11 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:42.357757  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:42.357131  3950 raft_consensus.cc:2468] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 8.
I20260709 13:15:42.347947  3857 catalog_manager.cc:5697] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 3 to 6, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 6 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:42.366487  3951 raft_consensus.cc:1240] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:42.386258  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:15:42.388332  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 116650us
I20260709 13:15:42.351945  7663 raft_consensus.cc:2749] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:42.413182  4707 raft_consensus.cc:2393] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 14: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
I20260709 13:15:42.423596  4027 raft_consensus.cc:2468] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 7.
W20260709 13:15:42.425742  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 231631us
I20260709 13:15:42.356602  7621 raft_consensus.cc:515] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:42.388047  7169 raft_consensus.cc:697] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 10 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:42.437733  4100 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:15:42.441537  4100 raft_consensus.cc:606] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Received request to transfer leadership to TS 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:42.441932  4100 raft_consensus.cc:614] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:42.415529  7361 raft_consensus.cc:2804] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:42.452478  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:42.388922  7448 raft_consensus.cc:515] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:42.464756  3997 connection.cc:256] RPC call timeout handler was delayed by -1.0913661870001761s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15510000000000002s for a response
W20260709 13:15:42.465345  3997 connection.cc:256] RPC call timeout handler was delayed by -1.0803568440001072s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1572s for a response
W20260709 13:15:42.465723  3997 connection.cc:256] RPC call timeout handler was delayed by -1.0799272860001565s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1572s for a response
I20260709 13:15:42.464758  4107 raft_consensus.cc:1240] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:15:42.467628  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:42.445117  7361 raft_consensus.cc:493] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:42.475318  4673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.475653  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:42.479490  3953 raft_consensus.cc:2393] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 8: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
W20260709 13:15:42.479776  4073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:42.480600  4073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.484005  4034 raft_consensus.cc:2393] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 10: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
W20260709 13:15:42.483978  3997 leader_election.cc:336] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.579s (SENT)
I20260709 13:15:42.486986  4703 raft_consensus.cc:1240] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:15:42.472278  7361 raft_consensus.cc:3060] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:42.489161  4701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:42.492646  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:42.492784  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:15:42.494833  4101 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45336 (request call id 1337) took 3192 ms (client timeout 2051 ms). Trace:
I20260709 13:15:42.495057  4701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:42.495359  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:42.499379  4700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57680 (request call id 710) took 3334 ms. Trace:
I20260709 13:15:42.488832  3857 catalog_manager.cc:5697] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 1 to 6, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 6 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:42.495296  4101 rpcz_store.cc:269] 0709 13:15:39.262590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.948108 (+685518us) service_pool.cc:224] Handling call
0709 13:15:42.435014 (+2486906us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400259ed4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:42.450461 (+ 15447us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2410754688}
I20260709 13:15:42.499785  4700 rpcz_store.cc:276] 0709 13:15:39.158274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.182096 (+ 23822us) service_pool.cc:224] Handling call
0709 13:15:39.232337 (+ 50241us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:40.481837 (+1249500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:42.481177 (+1999340us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54006b1a54. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:42.492153 (+ 10976us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2870012800}
I20260709 13:15:42.507442  4702 raft_consensus.cc:2468] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 10.
W20260709 13:15:42.516279  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 76359.8us
I20260709 13:15:42.561729  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:42.591606  3857 catalog_manager.cc:5697] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 5 to 6, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 6 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:42.609779  7448 leader_election.cc:290] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:42.611816  7169 consensus_queue.cc:237] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:42.617492  7670 log.cc:927] Time spent T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
W20260709 13:15:42.619119  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 141225us
W20260709 13:15:42.619927  3997 leader_election.cc:336] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.852s (SENT)
I20260709 13:15:42.620410  3997 leader_election.cc:304] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:42.631259  3925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.634461  3857 catalog_manager.cc:5697] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:42.718257  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:15:42.722173  3955 consensus_meta.cc:287] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.539s	user 0.010s	sys 0.005s
I20260709 13:15:42.488736  7549 consensus_queue.cc:237] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:42.697548  7393 raft_consensus.cc:2749] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:42.723657  3955 raft_consensus.cc:2468] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 7.
I20260709 13:15:42.732704  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:15:42.720878  7415 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.003s	sys 0.010s
I20260709 13:15:42.741652  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:42.749387  4101 raft_consensus.cc:3060] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:42.745090  3953 raft_consensus.cc:2468] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 10.
W20260709 13:15:42.752592  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 130724us
I20260709 13:15:42.729996  7556 leader_election.cc:290] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 14 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:42.753732  3857 catalog_manager.cc:5697] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 5 to 6, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 6 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:42.762857  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
W20260709 13:15:42.769029  7674 log.cc:927] Time spent T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:15:42.757408  7671 log.cc:927] Time spent T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.401s	user 0.000s	sys 0.002s
I20260709 13:15:42.780064  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:42.783330  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:15:42.746363  7415 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.004s	sys 0.011s
I20260709 13:15:42.800539  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:42.803967  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:42.753306  7621 leader_election.cc:290] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:15:42.821650  3997 leader_election.cc:336] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.879s (SENT)
I20260709 13:15:42.826401  3997 leader_election.cc:304] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:42.829304  3857 catalog_manager.cc:5697] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
W20260709 13:15:42.826017  7558 consensus_meta.cc:287] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.628s	user 0.012s	sys 0.002s
W20260709 13:15:42.828248  7306 consensus_meta.cc:287] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.694s	user 0.011s	sys 0.004s
I20260709 13:15:42.845479  7413 raft_consensus.cc:493] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.846279  7413 raft_consensus.cc:515] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:15:42.832715  7393 raft_consensus.cc:2749] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:15:42.853607  3997 leader_election.cc:336] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.879s (SENT)
W20260709 13:15:42.855517  3997 leader_election.cc:336] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.893s (SENT)
I20260709 13:15:42.872057  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:42.843469  7558 raft_consensus.cc:515] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:42.873031  7413 leader_election.cc:290] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:42.863785  7302 leader_election.cc:290] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:42.871469  4101 raft_consensus.cc:2468] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 14.
I20260709 13:15:42.875928  3952 raft_consensus.cc:1240] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:15:42.879848  4672 leader_election.cc:304] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:42.880673  7511 consensus_queue.cc:1048] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:42.881304  7059 consensus_queue.cc:1048] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:42.882999  7059 raft_consensus.cc:2749] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:42.883122  4672 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
W20260709 13:15:42.861871  7667 log.cc:927] Time spent T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.398s	user 0.003s	sys 0.000s
I20260709 13:15:42.884089  7377 raft_consensus.cc:2804] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:42.884548  7377 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
W20260709 13:15:42.886104  7383 consensus_meta.cc:287] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938: Time spent flushing consensus metadata: real 0.763s	user 0.011s	sys 0.005s
I20260709 13:15:42.885002  7377 raft_consensus.cc:3060] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:42.887694  3997 leader_election.cc:304] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:42.888653  7393 raft_consensus.cc:2749] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:15:42.892623  3997 leader_election.cc:336] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.959s (SENT)
I20260709 13:15:42.894888  7558 leader_election.cc:290] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:42.927661  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:42.928258  4030 raft_consensus.cc:1240] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:42.896220  4709 raft_consensus.cc:2468] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 10.
I20260709 13:15:42.898291  7377 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:42.898890  7607 raft_consensus.cc:3055] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:15:42.903072  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.904660  4707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57666 (request call id 591) took 1230 ms. Trace:
I20260709 13:15:42.908335  7399 consensus_queue.cc:260] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:42.910579  7361 raft_consensus.cc:515] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:42.918246  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:42.934769  4707 rpcz_store.cc:276] 0709 13:15:41.674193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.678646 (+  4453us) service_pool.cc:224] Handling call
0709 13:15:42.904327 (+1225681us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b5400680e54. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:42.904568 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1315846528}
I20260709 13:15:42.937289  4700 raft_consensus.cc:1275] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:15:42.919947  3997 leader_election.cc:304] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:42.922328  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:42.923987  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:42.937922  4103 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:15:42.924846  4028 raft_consensus.cc:1240] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:42.938619  4103 raft_consensus.cc:606] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Received request to transfer leadership to TS 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:42.939074  4103 raft_consensus.cc:614] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:42.927037  4026 raft_consensus.cc:1275] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:15:42.928288  4033 raft_consensus.cc:3060] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:42.931702  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:42.944523  4029 raft_consensus.cc:2393] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 8: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:42.920823  7476 raft_consensus.cc:493] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.933709  7607 raft_consensus.cc:740] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:42.958750  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:15:43.015673  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 123085us
W20260709 13:15:43.016501  3997 connection.cc:256] RPC call timeout handler was delayed by -1.0232554259998778s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1628s for a response
W20260709 13:15:43.020722  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 168922us
I20260709 13:15:42.952507  7393 raft_consensus.cc:2749] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:15:43.030428  3922 leader_election.cc:336] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.815s (SENT)
W20260709 13:15:43.032472  3997 leader_election.cc:336] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 2.191s (SENT)
I20260709 13:15:43.033610  7399 raft_consensus.cc:3060] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:43.047834  7632 raft_consensus.cc:3055] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:43.048450  4103 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:15:43.049155  4103 raft_consensus.cc:606] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Received request to transfer leadership to TS 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:43.049497  4103 raft_consensus.cc:614] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:43.051725  7377 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:43.027803  7471 consensus_queue.cc:1048] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:15:43.053156  7607 consensus_queue.cc:260] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:43.054710  7607 raft_consensus.cc:3060] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:43.055647  7361 leader_election.cc:290] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:43.012372  7687 consensus_queue.cc:1059] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.082s
I20260709 13:15:43.057684  7687 raft_consensus.cc:3055] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:15:43.055737  4073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:43.058849  4073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:43.061400  4672 leader_election.cc:304] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:42.957499  7476 raft_consensus.cc:515] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:43.090613  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:15:43.112928  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 85487.4us
I20260709 13:15:43.048473  7632 raft_consensus.cc:740] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:43.058149  7687 raft_consensus.cc:740] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:43.075809  7377 raft_consensus.cc:2804] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:15:43.137384  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 106995us
I20260709 13:15:43.142144  4033 raft_consensus.cc:2468] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 10.
I20260709 13:15:43.138716  2843 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:15:43.147123  4073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 86665.1us
I20260709 13:15:43.144695  7463 raft_consensus.cc:493] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:43.156572  2843 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:43.147944  7377 raft_consensus.cc:697] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 14 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:43.160995  7463 raft_consensus.cc:515] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:43.176890  7476 leader_election.cc:290] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:43.177724  7463 leader_election.cc:290] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:43.179646  4709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57666 (request call id 593) took 1006 ms. Trace:
I20260709 13:15:43.180140  4709 rpcz_store.cc:276] 0709 13:15:42.173060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:42.173207 (+   147us) service_pool.cc:224] Handling call
0709 13:15:43.179388 (+1006181us) spinlock_profiling.cc:243] Waited 693 ms on lock 0x7b54005979d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:43.179534 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1593187584}
I20260709 13:15:43.157205  7632 consensus_queue.cc:260] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:43.184137  3924 leader_election.cc:304] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:43.184727  7632 raft_consensus.cc:3060] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:43.186154  3924 leader_election.cc:304] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:43.188120  7542 raft_consensus.cc:2749] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:43.188634  7377 consensus_queue.cc:237] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:43.190100  7476 raft_consensus.cc:2749] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:43.200256  4073 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:43.201845  4107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34656 (request call id 484) took 1193 ms. Trace:
I20260709 13:15:43.202276  4107 rpcz_store.cc:276] 0709 13:15:42.008747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:42.008945 (+   198us) service_pool.cc:224] Handling call
0709 13:15:42.009388 (+   443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:42.468065 (+458677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:43.201535 (+733470us) spinlock_profiling.cc:243] Waited 452 ms on lock 0x7b540042e5d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:43.201774 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1040147840}
I20260709 13:15:43.206491  4025 raft_consensus.cc:1275] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:15:43.209019  4101 raft_consensus.cc:1275] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:43.212446  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:43.207563  7463 consensus_queue.cc:1048] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:15:43.160149  7687 consensus_queue.cc:260] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:43.229208  7687 raft_consensus.cc:3060] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:43.223229  4104 raft_consensus.cc:1275] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:15:43.237279  3924 leader_election.cc:304] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:43.240672  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:43.242851  7607 raft_consensus.cc:2804] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:43.243321  7607 raft_consensus.cc:493] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.243783  7607 raft_consensus.cc:3060] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:43.246762  7469 consensus_queue.cc:1048] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:43.247035  4071 leader_election.cc:304] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:43.249243  3997 leader_election.cc:304] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:43.249984  7469 consensus_queue.cc:1048] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:15:43.234439  7542 consensus_queue.cc:1175] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d709ee666b774ec29aa732e508219938" responder_term: 10 status { last_received { term: 9 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:15:43.252009  7463 raft_consensus.cc:2749] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:43.254155  3997 leader_election.cc:304] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:43.208005  7399 raft_consensus.cc:2804] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:43.260061  4073 leader_election.cc:304] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:43.265038  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:43.271165  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:43.271920  4032 raft_consensus.cc:3060] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:43.274290  4025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41312 (request call id 499) took 1108 ms. Trace:
I20260709 13:15:43.276299  4025 rpcz_store.cc:276] 0709 13:15:42.166207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:42.368547 (+202340us) service_pool.cc:224] Handling call
0709 13:15:42.864154 (+495607us) spinlock_profiling.cc:243] Waited 5.39 ms on lock 0x7b54001e8128. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152a597aa1 00007f152a612ebc 00007f152a64808c 00007f152a63293b 00007f152a6323d2 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c
0709 13:15:43.202273 (+338119us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:43.206946 (+  4673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:43.274005 (+ 67059us) spinlock_profiling.cc:243] Waited 338 ms on lock 0x7b54001e82d0. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566d8ad 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:43.274207 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":789558528}
I20260709 13:15:43.278303  7338 raft_consensus.cc:2804] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:43.283205  7338 raft_consensus.cc:493] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.283299  7414 raft_consensus.cc:493] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.283648  7338 raft_consensus.cc:3060] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:43.284071  7463 raft_consensus.cc:2749] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:43.283957  7414 raft_consensus.cc:515] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:43.286341  7413 raft_consensus.cc:2749] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:43.286656  7414 leader_election.cc:290] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:43.287063  7185 consensus_queue.cc:1048] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:43.289233  7399 raft_consensus.cc:697] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:43.290302  7399 consensus_queue.cc:237] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:43.298434  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:43.298463  7639 consensus_queue.cc:1048] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:15:43.299965  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 49125us
I20260709 13:15:43.302279  4029 raft_consensus.cc:1275] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:15:43.302572  3997 leader_election.cc:304] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:15:43.303387  7463 raft_consensus.cc:2804] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:43.303944  7463 raft_consensus.cc:493] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:43.304354  7463 raft_consensus.cc:3060] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:43.305045  7302 raft_consensus.cc:493] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.305604  7302 raft_consensus.cc:515] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:43.306839  7451 consensus_queue.cc:1059] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:15:43.307958  7451 raft_consensus.cc:3055] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:43.308323  7451 raft_consensus.cc:740] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:43.309275  7451 consensus_queue.cc:260] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:43.308743  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:43.310602  7451 raft_consensus.cc:3060] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:43.312609  7302 leader_election.cc:290] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:15:43.337733  4673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:43.340155  4032 raft_consensus.cc:2468] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9.
I20260709 13:15:43.351033  4025 raft_consensus.cc:1275] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:15:43.360221  4074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:43.281980  7628 consensus_queue.cc:1059] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 13:15:43.347786  7540 raft_consensus.cc:493] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:43.388212  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:43.393023  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:43.395845  7185 consensus_queue.cc:1048] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:15:43.405629  3997 leader_election.cc:336] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.551s (SENT)
I20260709 13:15:43.408228  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:43.419101  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:43.415637  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:43.414119  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:43.420367  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:43.421510  4107 raft_consensus.cc:1275] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:15:43.386019  7414 raft_consensus.cc:493] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.423305  4032 raft_consensus.cc:2468] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 9.
I20260709 13:15:43.425920  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:43.428586  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 13 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:43.415270  6768 consensus_queue.cc:1048] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:15:43.415445  7613 raft_consensus.cc:3055] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:43.431814  4101 raft_consensus.cc:1275] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:15:43.420591  3997 leader_election.cc:304] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:43.424612  7619 raft_consensus.cc:493] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.431434  7414 raft_consensus.cc:515] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:43.433874  4033 raft_consensus.cc:1240] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:43.438266  4034 raft_consensus.cc:1275] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:15:43.442216  4032 raft_consensus.cc:1275] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:15:43.434612  4101 pending_rounds.cc:85] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Aborting all ops after (but not including) 4
I20260709 13:15:43.443222  4101 pending_rounds.cc:107] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:15:43.440688  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:43.443961  4101 raft_consensus.cc:2889] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:43.440917  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:43.440126  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:43.404119  7540 raft_consensus.cc:515] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:43.452332  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 171346us
I20260709 13:15:43.434355  7613 raft_consensus.cc:740] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:43.475267  4027 raft_consensus.cc:1275] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:15:43.475584  4101 raft_consensus.cc:1275] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:15:43.477222  4099 raft_consensus.cc:2393] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 8: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:43.477254  4026 raft_consensus.cc:1240] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:43.470724  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:43.473378  4033 raft_consensus.cc:1275] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:43.473905  4108 raft_consensus.cc:2468] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7.
I20260709 13:15:43.480165  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
W20260709 13:15:43.495148  4073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:43.445729  7619 raft_consensus.cc:515] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:43.523766  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:43.487957  4105 raft_consensus.cc:1275] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:15:43.529645  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:43.530310  4102 raft_consensus.cc:3060] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:43.540534  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:43.536516  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:15:43.540153  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 134587us
I20260709 13:15:43.553017  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:43.569558  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:43.546470  4108 raft_consensus.cc:2393] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 9: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:43.575258  4103 raft_consensus.cc:2468] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 10.
I20260709 13:15:43.570293  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:43.577298  3952 raft_consensus.cc:3060] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:43.546633  4105 pending_rounds.cc:85] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc: Aborting all ops after (but not including) 5
I20260709 13:15:43.579438  4105 pending_rounds.cc:107] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 8.6
I20260709 13:15:43.581642  3924 leader_election.cc:304] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:43.584358  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:43.580284  4105 raft_consensus.cc:2917] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Aborting config change with OpId 8.6: Aborted: Op aborted by new leader
I20260709 13:15:43.577926  3925 leader_election.cc:304] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:43.590343  4105 raft_consensus.cc:2889] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:43.590821  3951 raft_consensus.cc:1240] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:15:43.591070  4105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:34646 (request call id 21) took 6682 ms. Trace:
I20260709 13:15:43.591503  3954 raft_consensus.cc:1240] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:43.591467  4105 rpcz_store.cc:276] 0709 13:15:36.909064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.909210 (+   146us) service_pool.cc:224] Handling call
0709 13:15:37.002546 (+ 93336us) log.cc:844] Serialized 506 byte log entry
0709 13:15:37.268992 (+266446us) spinlock_profiling.cc:243] Waited 3.48 ms on lock 0x7b180005b840. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f15225813f3 00007f15225837c1 00007f1522583779 00007f1522583709 00007f15225836d1 00007f15225829cd 000000000038f354 000000000038f199 00007f152256483a
0709 13:15:38.564999 (+1296007us) spinlock_profiling.cc:243] Waited 22.8 ms on lock 0x7b5400340920. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15255e7142 00007f15255c7eaa 00007f15255ced53 00007f15255cecd9 00007f15255cec69 00007f15255cec31 00007f15255cddfd 000000000038f354 000000000038f199 00007f1522581475
0709 13:15:38.870427 (+305428us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b180005b840. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f15225813f3 00007f15225837c1 00007f1522583779 00007f1522583709 00007f15225836d1 00007f15225829cd 000000000038f354 000000000038f199 00007f152256483a
0709 13:15:39.524078 (+653651us) spinlock_profiling.cc:243] Waited 2.37 ms on lock 0x7b5400340920. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15255eeb26 00007f15255e849a 00007f15255e7714 00007f15255c7eaa 00007f15255ced53 00007f15255cecd9 00007f15255cec69 00007f15255cec31 00007f15255cddfd 000000000038f354
0709 13:15:43.590957 (+4066879us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33825,"raft.queue_time_us":47991,"raft.run_cpu_time_us":61913,"raft.run_wall_time_us":3961559,"spinlock_wait_cycles":104076800,"thread_start_us":156835,"threads_started":1,"wal-append.queue_time_us":273962,"wal-append.run_cpu_time_us":2233,"wal-append.run_wall_time_us":1198951}
I20260709 13:15:43.592648  7338 raft_consensus.cc:515] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:43.595019  7414 leader_election.cc:290] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:15:43.596127  7715 log.cc:927] Time spent T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:15:43.597213  7338 leader_election.cc:290] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:15:43.599277  7713 log.cc:927] Time spent T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:15:43.532861  7663 raft_consensus.cc:2749] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:43.608469  4107 raft_consensus.cc:2468] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9.
I20260709 13:15:43.612697  4106 raft_consensus.cc:2468] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 10.
I20260709 13:15:43.612345  4029 raft_consensus.cc:1240] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 8. Current term is 9. Ops: []
W20260709 13:15:43.601008  3997 leader_election.cc:336] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.588s (SENT)
I20260709 13:15:43.603839  6768 raft_consensus.cc:2749] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:43.621677  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:43.569509  7613 consensus_queue.cc:260] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:43.621678  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:43.623281  7613 raft_consensus.cc:3060] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:43.626350  7521 raft_consensus.cc:2804] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:15:43.626716  7716 log.cc:927] Time spent T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 13:15:43.627288  3955 raft_consensus.cc:2468] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 9.
I20260709 13:15:43.630285  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:43.631108  3951 raft_consensus.cc:3060] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:43.641714  7463 raft_consensus.cc:515] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:43.646407  4104 raft_consensus.cc:2468] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9.
I20260709 13:15:43.623298  7619 leader_election.cc:290] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:15:43.654747  3905 auto_rebalancer.cc:629] Failed to schedule move for tablet 4e6407d1f930405b9aa0d4690377e1da: Aborted: Op aborted by new leader
W20260709 13:15:43.643930  7628 consensus_queue.cc:1175] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f1c75790cedf4f52a3463a255c7da059" responder_term: 11 status { last_received { term: 8 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 10. Current term is 11. Ops: [10.6-10.6]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:15:43.662834  7383 consensus_queue.cc:1048] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:15:43.666992  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 52416.3us
I20260709 13:15:43.668524  7558 consensus_queue.cc:1048] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:43.647037  7338 consensus_queue.cc:1059] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:15:43.671020  7521 raft_consensus.cc:697] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:43.672077  7521 consensus_queue.cc:237] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:43.681030  7540 leader_election.cc:290] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:43.682121  3997 leader_election.cc:304] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:43.687417  4073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:43.689750  3951 raft_consensus.cc:2468] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 9.
I20260709 13:15:43.690038  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:43.694636  4102 raft_consensus.cc:2468] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 11.
I20260709 13:15:43.728574  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:43.741258  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 55767.5us
W20260709 13:15:43.744522  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 51408.5us
I20260709 13:15:43.745003  4071 leader_election.cc:304] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:15:43.747339  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:43.751097  4071 leader_election.cc:304] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:43.752681  4104 raft_consensus.cc:2468] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9.
I20260709 13:15:43.763402  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:15:43.770675  4673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:43.774772  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:43.775441  4107 raft_consensus.cc:2468] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 10.
I20260709 13:15:43.777797  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:43.778396  4105 raft_consensus.cc:2376] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 12. Re-sending same reply.
I20260709 13:15:43.744382  7451 raft_consensus.cc:493] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
W20260709 13:15:43.789584  3999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 113327us
I20260709 13:15:43.793143  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:43.755076  7414 raft_consensus.cc:493] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:43.774524  7399 raft_consensus.cc:2804] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:43.736249  7607 raft_consensus.cc:515] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:43.829924  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:43.830695  4100 raft_consensus.cc:2468] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 7.
I20260709 13:15:43.833247  4101 raft_consensus.cc:2410] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:15:43.833791  7687 consensus_meta.cc:287] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.604s	user 0.006s	sys 0.004s
I20260709 13:15:43.803288  7325 raft_consensus.cc:2804] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:43.803525  7414 raft_consensus.cc:515] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:43.805083  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:43.866079  4105 raft_consensus.cc:2376] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9. Re-sending same reply.
I20260709 13:15:43.808288  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:43.867168  4103 raft_consensus.cc:2393] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 7: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:43.809149  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:43.810070  7663 raft_consensus.cc:2749] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:43.809938  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:43.810496  6967 raft_consensus.cc:493] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:43.813592  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:43.869505  4099 raft_consensus.cc:2468] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 8.
I20260709 13:15:43.816043  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:43.820983  7724 raft_consensus.cc:493] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.878566  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cf7690694c4d5988258ec1b641a2e6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:43.879778  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:43.834820  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:43.837121  4074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:43.838133  7399 raft_consensus.cc:697] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:43.783651  7463 leader_election.cc:290] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:43.843626  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:43.888962  4106 raft_consensus.cc:2393] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 14: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
W20260709 13:15:43.846602  7377 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.007s	sys 0.005s
I20260709 13:15:43.855815  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:43.799507  7451 raft_consensus.cc:515] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:43.858592  4705 raft_consensus.cc:1240] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:43.857318  3952 raft_consensus.cc:2468] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 9.
I20260709 13:15:43.860353  4107 consensus_queue.cc:237] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:15:43.864503  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:43.864733  4709 raft_consensus.cc:1275] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:15:43.865466  3955 raft_consensus.cc:1275] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:15:43.875237  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:43.910713  3951 raft_consensus.cc:3060] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:43.880846  4101 raft_consensus.cc:2468] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 12.
I20260709 13:15:43.913664  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:43.884966  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:43.908109  3957 raft_consensus.cc:1240] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:15:43.952250  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:43.953469  4106 raft_consensus.cc:2393] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 8: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:43.914394  4034 raft_consensus.cc:2468] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 10.
I20260709 13:15:43.957177  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:43.914582  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:43.960851  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:43.869382  7325 raft_consensus.cc:493] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.966264  4071 leader_election.cc:304] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:15:43.970816  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:43.971855  4101 raft_consensus.cc:2468] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7.
I20260709 13:15:43.975965  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:43.976840  4103 raft_consensus.cc:2468] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 8.
I20260709 13:15:43.982508  3951 raft_consensus.cc:2468] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 14.
I20260709 13:15:43.915195  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:43.897104  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:43.895798  7625 raft_consensus.cc:493] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.991614  4105 raft_consensus.cc:2468] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 7.
I20260709 13:15:43.972659  7325 raft_consensus.cc:3060] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:43.998600  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:44.003835  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:44.004536  4032 raft_consensus.cc:3060] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:15:44.004006  7399 consensus_queue.cc:237] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:44.006603  7607 leader_election.cc:290] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:44.001682  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:43.997977  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:44.007814  4101 raft_consensus.cc:2468] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 8.
I20260709 13:15:43.993378  4104 raft_consensus.cc:2468] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9.
I20260709 13:15:44.014182  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:43.999029  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:44.015350  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:44.015916  4101 raft_consensus.cc:2468] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 9.
I20260709 13:15:44.017310  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:44.018132  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
W20260709 13:15:43.985435  7377 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.007s	sys 0.010s
I20260709 13:15:44.019694  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
W20260709 13:15:44.032325  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 125369us
I20260709 13:15:44.032289  4105 raft_consensus.cc:2393] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 8: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:44.020113  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:43.995728  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:44.020242  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:44.035303  4101 raft_consensus.cc:2368] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 10. Current term is 11.
I20260709 13:15:43.993239  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:44.040055  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:43.994536  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:44.041568  4099 raft_consensus.cc:2468] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 10.
I20260709 13:15:44.028828  4103 raft_consensus.cc:2368] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 9. Current term is 10.
W20260709 13:15:44.034487  3922 connection.cc:256] RPC call timeout handler was delayed by -1.0232012750000195s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1794s for a response
I20260709 13:15:44.050554  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:44.051600  4705 raft_consensus.cc:3060] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:44.057952  4074 leader_election.cc:304] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:44.057858  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:44.058991  4102 raft_consensus.cc:2468] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 9.
I20260709 13:15:44.060274  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:44.060452  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:44.061554  4099 raft_consensus.cc:2393] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 12: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:44.064946  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:44.065765  4105 raft_consensus.cc:2393] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 7: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
W20260709 13:15:44.066367  4073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:44.066352  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:44.068810  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:44.053694  3925 leader_election.cc:304] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:44.070233  4101 raft_consensus.cc:1275] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:15:44.071056  4105 raft_consensus.cc:1275] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 14 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:15:44.019498  7632 raft_consensus.cc:2804] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:15:44.077330  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 476298us
I20260709 13:15:44.078534  4100 raft_consensus.cc:2468] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 9.
I20260709 13:15:43.906272  7724 raft_consensus.cc:515] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:44.083804  4026 raft_consensus.cc:3060] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:43.883122  6967 raft_consensus.cc:515] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:44.086122  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:44.089701  3951 raft_consensus.cc:2376] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 7. Re-sending same reply.
I20260709 13:15:44.090723  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:44.080894  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:44.079051  4099 raft_consensus.cc:1275] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:15:44.074645  7715 log.cc:927] Time spent T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:15:44.017349  7625 raft_consensus.cc:515] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:44.098709  4027 raft_consensus.cc:2468] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 9.
W20260709 13:15:44.089803  3997 leader_election.cc:336] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.628s (SENT)
I20260709 13:15:44.103135  3997 leader_election.cc:304] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:44.104753  3958 raft_consensus.cc:1275] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:15:44.105268  3958 pending_rounds.cc:85] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059: Aborting all ops after (but not including) 8
I20260709 13:15:44.105549  3958 pending_rounds.cc:107] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:15:44.105846  3958 raft_consensus.cc:2889] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:44.107635  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:44.083765  7338 raft_consensus.cc:3060] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:44.106966  3922 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:44.110769  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:44.117100  3959 raft_consensus.cc:2368] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 10. Current term is 11.
W20260709 13:15:44.116094  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 82973.5us
I20260709 13:15:44.132256  4106 raft_consensus.cc:2468] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 10.
I20260709 13:15:44.136847  4074 leader_election.cc:304] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:44.144636  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:15:44.150602  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 43763.7us
I20260709 13:15:44.135205  4032 raft_consensus.cc:2468] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 11.
I20260709 13:15:44.119058  7663 raft_consensus.cc:2749] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:44.165017  4026 raft_consensus.cc:2468] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 9.
I20260709 13:15:44.125782  7724 leader_election.cc:290] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:44.134160  7440 raft_consensus.cc:2749] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:15:44.177875  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 106890us
I20260709 13:15:44.155103  7476 raft_consensus.cc:2804] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:15:44.182852  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 93067.3us
I20260709 13:15:44.186089  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:15:44.189416  3997 leader_election.cc:336] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.667s (SENT)
W20260709 13:15:44.190824  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 69003.9us
I20260709 13:15:44.198511  4074 leader_election.cc:304] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:44.226032  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:44.250586  4673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:44.306710  4073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:44.320210  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:44.340479  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:15:44.345870  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 150076us
I20260709 13:15:44.175900  7687 consensus_queue.cc:1048] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:15:44.190522  7451 leader_election.cc:290] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:44.347100  3922 leader_election.cc:304] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:44.181926  7540 consensus_queue.cc:1048] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.158s
I20260709 13:15:44.324635  7414 leader_election.cc:290] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:44.322428  7686 consensus_queue.cc:1048] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:15:44.383415  3922 leader_election.cc:304] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
W20260709 13:15:44.384333  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 192481us
I20260709 13:15:44.499071  4705 raft_consensus.cc:2468] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 11.
W20260709 13:15:44.499387  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 116099us
W20260709 13:15:44.391804  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 202436us
W20260709 13:15:44.398121  4073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:44.500336  3922 leader_election.cc:304] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:44.395049  4027 raft_consensus.cc:1240] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:44.408490  7359 raft_consensus.cc:2749] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:44.502043  6967 leader_election.cc:290] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:44.379758  7735 log.cc:927] Time spent T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.260s	user 0.000s	sys 0.001s
I20260709 13:15:44.506033  3922 leader_election.cc:304] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
W20260709 13:15:44.508535  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 424001us
W20260709 13:15:44.428804  7738 log.cc:927] Time spent T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.305s	user 0.000s	sys 0.000s
W20260709 13:15:44.429698  7742 log.cc:927] Time spent T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
I20260709 13:15:44.375651  7632 raft_consensus.cc:697] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:44.690680  7632 consensus_queue.cc:237] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:44.401911  7542 raft_consensus.cc:2749] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:44.520996  4074 leader_election.cc:304] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:44.512281  7399 raft_consensus.cc:2749] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:44.523806  7440 raft_consensus.cc:3060] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:44.505568  7469 raft_consensus.cc:2749] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:44.509676  7625 leader_election.cc:290] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:15:44.681291  7325 consensus_meta.cc:287] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.679s	user 0.004s	sys 0.008s
W20260709 13:15:44.686698  7338 consensus_meta.cc:287] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.571s	user 0.007s	sys 0.001s
I20260709 13:15:44.385470  7451 consensus_queue.cc:1048] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.117s
W20260709 13:15:44.513898  7471 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.008s	sys 0.014s
I20260709 13:15:44.697438  4031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41312 (request call id 518) took 1064 ms. Trace:
W20260709 13:15:44.729535  4673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:44.755146  3997 leader_election.cc:336] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.853s (SENT)
I20260709 13:15:44.768112  3997 leader_election.cc:304] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:44.764387  7338 raft_consensus.cc:2749] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:15:44.753798  4672 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.019s	sys 0.030s
W20260709 13:15:44.769671  4672 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.020s	sys 0.030s
W20260709 13:15:44.770042  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 589832us
I20260709 13:15:44.773454  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:44.774121  4099 raft_consensus.cc:2468] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 6.
I20260709 13:15:44.779083  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:44.766201  7471 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.008s	sys 0.015s
I20260709 13:15:44.766748  4031 rpcz_store.cc:276] 0709 13:15:43.633023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.657936 (+ 24913us) service_pool.cc:224] Handling call
0709 13:15:43.658245 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:43.777887 (+119642us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:43.777919 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:43.801978 (+ 24059us) log.cc:844] Serialized 26 byte log entry
0709 13:15:43.809764 (+  7786us) spinlock_profiling.cc:243] Waited 4.11 ms on lock 0x7b48000cda58. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152a597aa1 00007f152a58eb37 00007f152a58e9ca 00007f152a68626f 00007f152a685f37 00007f152a69a55c 00007f152a69a508 00007f152a69a488 00007f152a69a443 00007f152a6996ec 00007f15295c3a96
0709 13:15:44.034758 (+224994us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:44.091654 (+ 56896us) log.cc:844] Serialized 14 byte log entry
0709 13:15:44.092027 (+   373us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:44.092220 (+   193us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:44.697050 (+604830us) raft_consensus.cc:1685] finished
0709 13:15:44.697180 (+   130us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:44.697362 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":192,"prepare.queue_time_us":55286,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":82753,"raft.run_cpu_time_us":3233,"raft.run_wall_time_us":81560,"spinlock_wait_cycles":9462016,"thread_start_us":265130,"threads_started":2,"wal-append.queue_time_us":225161}
I20260709 13:15:44.766307  7549 raft_consensus.cc:2804] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:15:44.784897  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:44.782904  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 277515us
W20260709 13:15:44.789049  4073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:44.778234  7625 raft_consensus.cc:2749] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:44.782538  7736 raft_consensus.cc:2749] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:15:44.790549  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 269627us
I20260709 13:15:44.765923  7325 raft_consensus.cc:515] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:44.798856  4074 leader_election.cc:304] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:44.803215  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 52372.5us
W20260709 13:15:44.803406  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 278850us
I20260709 13:15:44.804544  4027 raft_consensus.cc:1240] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:44.810644  4104 raft_consensus.cc:2368] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 9. Current term is 10.
I20260709 13:15:44.811519  7625 raft_consensus.cc:2749] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:44.818734  3922 leader_election.cc:304] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
W20260709 13:15:44.821413  3997 leader_election.cc:336] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.948s (SENT)
I20260709 13:15:44.821902  3997 leader_election.cc:304] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:44.833328  4074 leader_election.cc:304] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:44.792112  7722 consensus_queue.cc:1048] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:15:44.841904  3922 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:44.842963  7758 raft_consensus.cc:2749] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:44.843770  7542 raft_consensus.cc:2749] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:15:44.843008  3997 leader_election.cc:336] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 2.235s (SENT)
I20260709 13:15:44.848210  3997 leader_election.cc:304] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:44.849105  7760 raft_consensus.cc:2749] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:44.861690  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:44.863657  7476 raft_consensus.cc:493] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:44.864357  7476 raft_consensus.cc:3060] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:44.828608  7757 raft_consensus.cc:2749] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:44.869879  7758 raft_consensus.cc:493] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:44.870157  7722 raft_consensus.cc:493] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.870501  7758 raft_consensus.cc:515] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:44.870961  7722 raft_consensus.cc:515] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:44.872449  4104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45336 (request call id 1397) took 1060 ms. Trace:
I20260709 13:15:44.872844  4104 rpcz_store.cc:276] 0709 13:15:43.812269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.017907 (+205638us) service_pool.cc:224] Handling call
0709 13:15:44.872239 (+854332us) spinlock_profiling.cc:243] Waited 792 ms on lock 0x7b5400200154. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:44.872386 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1820756224}
I20260709 13:15:44.873781  7758 leader_election.cc:290] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:15:44.861915  7749 log.cc:927] Time spent T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.338s	user 0.005s	sys 0.008s
I20260709 13:15:44.832264  7736 raft_consensus.cc:2749] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:44.836107  7625 raft_consensus.cc:493] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
W20260709 13:15:44.879310  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 54856.6us
I20260709 13:15:44.880334  7325 leader_election.cc:290] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:44.882635  4672 leader_election.cc:304] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
W20260709 13:15:44.883639  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 50363.3us
I20260709 13:15:44.884513  4074 leader_election.cc:304] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:44.885313  7325 raft_consensus.cc:2749] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:44.887157  7639 raft_consensus.cc:2804] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:44.887665  7639 raft_consensus.cc:493] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:44.886063  7625 raft_consensus.cc:515] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:44.890739  7722 leader_election.cc:290] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:44.888921  7639 raft_consensus.cc:3060] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:44.891849  7759 consensus_queue.cc:1048] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:15:44.897200  4074 leader_election.cc:304] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:44.892880  4672 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:44.900964  7451 raft_consensus.cc:2749] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:44.909503  7625 leader_election.cc:290] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:15:44.910581  7728 log.cc:927] Time spent T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.905s	user 0.000s	sys 0.017s
I20260709 13:15:44.914553  4033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41312 (request call id 521) took 1034 ms. Trace:
I20260709 13:15:44.914958  4033 rpcz_store.cc:276] 0709 13:15:43.880606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.881145 (+   539us) service_pool.cc:224] Handling call
0709 13:15:43.881492 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:43.963370 (+ 81878us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:43.963410 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:43.972346 (+  8936us) log.cc:844] Serialized 26 byte log entry
0709 13:15:44.187856 (+215510us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:44.368690 (+180834us) log.cc:844] Serialized 14 byte log entry
0709 13:15:44.368928 (+   238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:44.369018 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:44.912305 (+543287us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b18004366c0. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f15225813f3 00007f15225837c1 00007f1522583779 00007f1522583709 00007f15225836d1 00007f15225829cd 000000000038f354 000000000038f199 00007f152256483a
0709 13:15:44.914234 (+  1929us) raft_consensus.cc:1685] finished
0709 13:15:44.914337 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:44.914488 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32732,"prepare.queue_time_us":180600,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":4787,"raft.queue_time_us":82463,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":21237,"spinlock_wait_cycles":50905216,"thread_start_us":137498,"threads_started":1,"wal-append.queue_time_us":381565}
I20260709 13:15:44.917259  7325 raft_consensus.cc:2749] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:44.920138  4029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38304 (request call id 2355) took 1040 ms. Trace:
I20260709 13:15:44.920641  4029 rpcz_store.cc:276] 0709 13:15:43.879464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.879702 (+   238us) service_pool.cc:224] Handling call
0709 13:15:43.880068 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:43.895780 (+ 15712us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:43.895811 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:43.895854 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:43.895896 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:44.919818 (+1023922us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b5400395b54. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:44.919881 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:44.920061 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35617536}
I20260709 13:15:44.927407  4074 leader_election.cc:304] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:44.928303  7325 raft_consensus.cc:2749] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:44.929193  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:44.929831  4074 leader_election.cc:304] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:44.928416  7182 raft_consensus.cc:493] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.930519  7182 raft_consensus.cc:515] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:44.932780  7182 leader_election.cc:290] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:44.935052  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:44.939621  7724 consensus_queue.cc:1048] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:15:44.947646  7338 raft_consensus.cc:2749] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:44.953833  4074 leader_election.cc:304] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:44.955286  4074 leader_election.cc:304] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:44.957717  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 57515.9us
I20260709 13:15:44.939880  7632 consensus_queue.cc:1059] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:15:44.957912  7625 raft_consensus.cc:2749] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:44.967024  7399 raft_consensus.cc:2749] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:44.941324  7325 consensus_queue.cc:1048] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:15:44.970499  4672 leader_election.cc:304] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:44.945783  7760 consensus_queue.cc:1059] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:15:44.983870  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:44.985759  7768 consensus_queue.cc:1048] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:44.988102  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:44.988729  3952 raft_consensus.cc:2468] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 10.
I20260709 13:15:44.989171  7440 raft_consensus.cc:2749] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:44.989557  4074 leader_election.cc:304] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:44.983949  4700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57692 (request call id 406) took 1117 ms. Trace:
I20260709 13:15:44.990995  4700 rpcz_store.cc:276] 0709 13:15:43.866386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.866591 (+   205us) service_pool.cc:224] Handling call
0709 13:15:43.894784 (+ 28193us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:43.987054 (+ 92270us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:43.987081 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:43.987124 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:43.987158 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:44.983743 (+996585us) spinlock_profiling.cc:243] Waited 92 ms on lock 0x7b5400630e54. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:44.983786 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:44.983895 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":211695872}
I20260709 13:15:44.993918  4074 leader_election.cc:304] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:44.994763  7632 raft_consensus.cc:2749] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:44.995703  4074 leader_election.cc:304] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:44.996888  4074 leader_election.cc:304] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:44.975294  7611 raft_consensus.cc:2749] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:45.001092  4074 leader_election.cc:304] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:45.012707  4073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:44.995464  7632 raft_consensus.cc:2749] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:45.001279  7440 raft_consensus.cc:493] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:45.012755  7361 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.008s	user 0.008s	sys 0.031s
I20260709 13:15:45.002312  7625 raft_consensus.cc:2749] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:45.014410  7628 raft_consensus.cc:3055] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:15:45.025822  7361 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.022s	user 0.009s	sys 0.031s
I20260709 13:15:45.025624  7752 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.029714  7724 raft_consensus.cc:493] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.031797  7628 raft_consensus.cc:740] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:45.038260  7325 raft_consensus.cc:2749] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:45.039374  7759 raft_consensus.cc:493] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.041144  7632 raft_consensus.cc:2804] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:45.028491  7440 raft_consensus.cc:515] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:45.046096  3997 leader_election.cc:336] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 2.776s (SENT)
I20260709 13:15:45.059782  3997 leader_election.cc:304] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:45.048940  7743 log.cc:927] Time spent T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.700s	user 0.000s	sys 0.025s
I20260709 13:15:45.057956  7632 raft_consensus.cc:493] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:45.044183  7752 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:45.048319  7724 raft_consensus.cc:515] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:45.057487  7476 raft_consensus.cc:515] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:45.067946  7760 raft_consensus.cc:2749] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:45.058951  7759 raft_consensus.cc:515] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:45.073376  7632 raft_consensus.cc:3060] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:45.086609  7399 raft_consensus.cc:3055] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:45.087088  7399 raft_consensus.cc:740] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:45.088078  7399 consensus_queue.cc:260] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:45.088776  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 49996.6us
W20260709 13:15:45.089461  3997 leader_election.cc:336] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 2.921s (SENT)
I20260709 13:15:45.080991  7440 leader_election.cc:290] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:45.081807  7476 leader_election.cc:290] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:45.081881  4030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38304 (request call id 2350) took 1206 ms. Trace:
W20260709 13:15:45.083947  7755 log.cc:927] Time spent T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.253s	user 0.003s	sys 0.000s
I20260709 13:15:45.081802  4027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38290 (request call id 2038) took 1191 ms. Trace:
I20260709 13:15:45.085521  7759 leader_election.cc:290] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:45.095818  4026 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38290 (request call id 2043) took 1198 ms (client timeout 1534 ms). Trace:
I20260709 13:15:45.097409  4027 rpcz_store.cc:276] 0709 13:15:43.890339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.768553 (+878214us) service_pool.cc:224] Handling call
0709 13:15:44.781666 (+ 13113us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:44.805150 (+ 23484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.081584 (+276434us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b5400396f54. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:45.081737 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51948800}
W20260709 13:15:45.099304  4026 rpcz_store.cc:269] 0709 13:15:43.891949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.967859 (+ 75910us) service_pool.cc:224] Handling call
0709 13:15:45.090588 (+1122729us) spinlock_profiling.cc:243] Waited 75.4 ms on lock 0x7b5400397954. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:45.090711 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":173372160}
W20260709 13:15:45.096640  3997 connection.cc:256] RPC call timeout handler was delayed by -1.2747333629999957s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2796s for a response
I20260709 13:15:45.091688  4030 rpcz_store.cc:276] 0709 13:15:43.875187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.875319 (+   132us) service_pool.cc:224] Handling call
0709 13:15:43.875766 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:43.987651 (+111885us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:43.987680 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:43.997454 (+  9774us) log.cc:844] Serialized 26 byte log entry
0709 13:15:44.074862 (+ 77408us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:44.074912 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:44.074988 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:45.015531 (+940543us) spinlock_profiling.cc:243] Waited 3.22 ms on lock 0x7b4400022b4c. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f15224a7c85 00007f15224a86a2 00007f152521a1db 00007f1525215aaf 00007f152520986e 00007f1525208bb6 00007f15252087d8 00007f1525212221 00007f15252121d9 00007f1525212169
0709 13:15:45.081594 (+ 66063us) raft_consensus.cc:1685] finished
0709 13:15:45.081615 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:45.081816 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93501,"raft.queue_time_us":111529,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":5977,"spinlock_wait_cycles":7397760,"thread_start_us":77005,"threads_started":1,"wal-append.queue_time_us":173664}
I20260709 13:15:45.083254  7724 leader_election.cc:290] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:15:45.100405  3997 connection.cc:256] RPC call timeout handler was delayed by -1.259433362999971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28130000000000005s for a response
W20260709 13:15:45.102041  3997 connection.cc:256] RPC call timeout handler was delayed by -1.1848273809998773s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1522s for a response
W20260709 13:15:45.102571  3997 connection.cc:256] RPC call timeout handler was delayed by -1.1848273809998773s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1522s for a response
W20260709 13:15:45.102958  3997 connection.cc:256] RPC call timeout handler was delayed by -1.1299273809997885s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1583s for a response
W20260709 13:15:45.103336  3997 connection.cc:256] RPC call timeout handler was delayed by -1.0975273809997361s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16190000000000002s for a response
I20260709 13:15:45.105607  3997 leader_election.cc:304] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:45.077980  7639 raft_consensus.cc:515] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:45.107751  7399 raft_consensus.cc:3060] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:45.110569  7639 leader_election.cc:290] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:45.115345  3997 leader_election.cc:304] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:45.115808  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 114808us
I20260709 13:15:45.116664  7760 raft_consensus.cc:2749] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:45.074100  7628 consensus_queue.cc:260] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:15:45.118969  4074 leader_election.cc:304] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:45.122057  3997 leader_election.cc:400] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Vote denied by peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339) with higher term. Message: Invalid argument: T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 10. Current term is 11.
I20260709 13:15:45.123652  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:45.115787  7724 raft_consensus.cc:2804] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:45.128623  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:45.130631  4027 raft_consensus.cc:2468] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 10.
I20260709 13:15:45.131098  3997 leader_election.cc:403] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:45.135811  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:45.127933  7771 raft_consensus.cc:493] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:45.147186  7611 raft_consensus.cc:493] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:45.137708  4675 leader_election.cc:304] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:45.147919  7771 raft_consensus.cc:515] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:45.147922  7611 raft_consensus.cc:515] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:45.150441  7771 leader_election.cc:290] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:45.128468  7759 consensus_queue.cc:1059] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:15:45.134688  7724 raft_consensus.cc:697] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:45.152217  7611 leader_election.cc:290] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:45.153354  7724 consensus_queue.cc:237] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:45.155180  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:45.156741  7414 raft_consensus.cc:2749] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:45.158363  7414 consensus_queue.cc:1048] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:45.161023  7760 raft_consensus.cc:2749] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339) with higher term. Message: Invalid argument: T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 10. Current term is 11.
I20260709 13:15:45.151401  7752 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:45.148499  7377 raft_consensus.cc:2804] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:45.167826  7377 raft_consensus.cc:493] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:45.168426  7377 raft_consensus.cc:3060] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:15:45.171502  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:45.227834  4673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:45.303828  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 176731us
W20260709 13:15:45.268637  7774 log.cc:927] Time spent T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:15:45.308194  4074 leader_election.cc:304] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:45.327802  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 205937us
I20260709 13:15:45.340808  7771 consensus_queue.cc:1048] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:15:45.353780  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:45.351087  3997 leader_election.cc:336] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.522s (SENT)
I20260709 13:15:45.354876  3997 leader_election.cc:304] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:45.360601  7632 raft_consensus.cc:515] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:45.362947  7632 leader_election.cc:290] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:45.367815  7760 raft_consensus.cc:2749] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:15:45.368242  3997 leader_election.cc:336] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.583s (SENT)
I20260709 13:15:45.368865  3997 leader_election.cc:304] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:45.373279  7760 raft_consensus.cc:2749] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:15:45.373857  3997 leader_election.cc:336] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.619s (SENT)
I20260709 13:15:45.374517  3997 leader_election.cc:304] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:45.375700  7760 raft_consensus.cc:2749] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:45.377246  7549 raft_consensus.cc:493] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:45.377924  7549 raft_consensus.cc:3060] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:45.353415  7783 raft_consensus.cc:2749] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:15:45.387065  3997 leader_election.cc:336] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.744s (SENT)
I20260709 13:15:45.387715  3997 leader_election.cc:304] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:45.389802  3957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35354 (request call id 432) took 1527 ms. Trace:
I20260709 13:15:45.390154  3957 rpcz_store.cc:276] 0709 13:15:43.861915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.862242 (+   327us) service_pool.cc:224] Handling call
0709 13:15:43.907888 (+ 45646us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:43.961551 (+ 53663us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.389603 (+1428052us) spinlock_profiling.cc:243] Waited 45.2 ms on lock 0x7b54003aedd0. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566d8ad 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:45.389742 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":104045952}
W20260709 13:15:45.392553  3997 leader_election.cc:336] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.858s (SENT)
I20260709 13:15:45.391568  7760 raft_consensus.cc:2749] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:45.403038  3957 raft_consensus.cc:3060] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:15:45.409907  3997 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.954s (SENT) [suppressed 49 similar messages]
I20260709 13:15:45.419586  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:45.422655  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:15:45.424412  3997 leader_election.cc:336] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 2.103s (SENT)
I20260709 13:15:45.425135  3997 leader_election.cc:304] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:45.430136  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:45.430581  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:45.431761  4700 raft_consensus.cc:2410] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 13:15:45.434089  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 125978us
I20260709 13:15:45.435508  4074 leader_election.cc:304] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:45.422130  7781 raft_consensus.cc:493] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:45.441694  4074 leader_election.cc:304] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:45.442147  7781 raft_consensus.cc:515] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:45.443414  4074 leader_election.cc:304] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:45.444226  7780 raft_consensus.cc:2749] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:45.444693  7781 leader_election.cc:290] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:45.442509  7783 raft_consensus.cc:2749] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:45.412245  7723 raft_consensus.cc:493] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
W20260709 13:15:45.447372  4108 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45332 (request call id 1945) took 1642 ms (client timeout 1755 ms). Trace:
I20260709 13:15:45.449765  4074 leader_election.cc:304] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:45.451946  4108 rpcz_store.cc:269] 0709 13:15:43.805022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.808883 (+  3861us) service_pool.cc:224] Handling call
0709 13:15:45.447164 (+1638281us) spinlock_profiling.cc:243] Waited 497 ms on lock 0x7b54000e8b54. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:45.447306 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1143148800}
I20260709 13:15:45.426995  7771 raft_consensus.cc:493] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:45.459794  3951 raft_consensus.cc:1240] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:45.460629  4074 leader_election.cc:304] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:45.426317  7760 raft_consensus.cc:493] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:45.440425  7414 raft_consensus.cc:2749] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:45.467907  3957 raft_consensus.cc:1275] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:15:45.447412  7619 consensus_queue.cc:1048] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
W20260709 13:15:45.465023  7746 log.cc:927] Time spent T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.952s	user 0.010s	sys 0.021s
I20260709 13:15:45.448201  7781 raft_consensus.cc:2749] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:45.475466  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:45.476202  3951 raft_consensus.cc:3060] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:45.477977  3924 leader_election.cc:304] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:45.478505  7784 consensus_queue.cc:1059] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:15:45.461746  7780 raft_consensus.cc:2749] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:45.466253  7632 raft_consensus.cc:2749] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:45.470867  7760 raft_consensus.cc:515] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:45.468592  7771 raft_consensus.cc:515] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:45.502885  7722 raft_consensus.cc:2804] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:45.503648  7722 raft_consensus.cc:697] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 11 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:45.504833  4034 raft_consensus.cc:1275] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:15:45.471839  3957 raft_consensus.cc:1275] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:15:45.506465  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:45.506587  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:45.508025  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:45.508251  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:45.508895  4100 raft_consensus.cc:2468] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 8.
I20260709 13:15:45.510246  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
W20260709 13:15:45.497583  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 51489us
I20260709 13:15:45.500466  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:45.500593  4031 raft_consensus.cc:1275] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:15:45.500191  7414 raft_consensus.cc:493] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.462055  7723 raft_consensus.cc:515] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:45.511758  3922 leader_election.cc:336] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.721s (SENT)
I20260709 13:15:45.514657  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:45.510679  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:45.518528  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:45.518847  4101 raft_consensus.cc:2468] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 9.
I20260709 13:15:45.515846  4105 raft_consensus.cc:2393] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 8: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:45.516237  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:45.516326  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:45.516484  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:45.521481  4106 raft_consensus.cc:2468] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 12.
I20260709 13:15:45.523718  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:45.524313  4104 raft_consensus.cc:2468] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 9.
I20260709 13:15:45.520128  4100 raft_consensus.cc:2376] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7. Re-sending same reply.
I20260709 13:15:45.527700  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:45.528203  4100 raft_consensus.cc:3060] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:45.502993  7760 leader_election.cc:290] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:45.504046  7771 leader_election.cc:290] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:45.529562  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 112399us
I20260709 13:15:45.530279  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:45.537462  4034 raft_consensus.cc:3060] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:45.532204  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:45.532670  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:45.535332  3951 raft_consensus.cc:2468] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 10.
W20260709 13:15:45.542016  3997 leader_election.cc:336] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.930s (SENT)
I20260709 13:15:45.545054  4029 raft_consensus.cc:1275] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:15:45.547264  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
W20260709 13:15:45.548493  3922 leader_election.cc:336] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.755s (SENT)
I20260709 13:15:45.549196  3922 leader_election.cc:304] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:45.550037  3997 leader_election.cc:304] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:45.552033  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:45.554636  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:45.556495  4031 raft_consensus.cc:1240] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:45.558949  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:45.560464  4025 raft_consensus.cc:3060] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:45.560891  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:45.561573  4105 raft_consensus.cc:2376] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9. Re-sending same reply.
I20260709 13:15:45.519376  7414 raft_consensus.cc:515] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:45.569772  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:45.572259  4108 raft_consensus.cc:2410] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:15:45.572296  3997 leader_election.cc:336] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.949s (SENT)
I20260709 13:15:45.558691  7760 raft_consensus.cc:2749] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:45.589766  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:45.588843  3997 leader_election.cc:304] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:45.592126  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 43691.3us
W20260709 13:15:45.593216  3922 leader_election.cc:336] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.903s (SENT)
I20260709 13:15:45.593770  3922 leader_election.cc:304] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:45.595803  4101 raft_consensus.cc:1275] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:15:45.571118  7607 raft_consensus.cc:2749] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:45.599472  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:45.602033  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:45.602818  4101 raft_consensus.cc:2393] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 10: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:45.603886  3997 leader_election.cc:304] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:45.599237  7789 consensus_queue.cc:1048] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:15:45.605444  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:45.571622  7377 raft_consensus.cc:515] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:45.559245  7722 consensus_queue.cc:237] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:45.614073  3922 leader_election.cc:336] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 2.078s (SENT)
I20260709 13:15:45.597759  7781 raft_consensus.cc:2749] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:45.615628  3922 leader_election.cc:304] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:45.618517  4074 leader_election.cc:304] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:45.565505  7784 consensus_queue.cc:1059] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:15:45.628341  4074 leader_election.cc:304] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:45.632630  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 70809.3us
I20260709 13:15:45.634717  4101 raft_consensus.cc:2468] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 10.
I20260709 13:15:45.637224  4071 leader_election.cc:304] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:45.645041  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:45.646224  4101 raft_consensus.cc:2368] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 9. Current term is 10.
W20260709 13:15:45.648231  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 44434.5us
I20260709 13:15:45.649173  3997 leader_election.cc:304] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:45.650028  7781 raft_consensus.cc:2749] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:45.643800  7338 raft_consensus.cc:2749] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:45.572968  7790 consensus_queue.cc:1048] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:15:45.649956  4074 leader_election.cc:304] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:45.657006  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:45.671309  4101 raft_consensus.cc:3060] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:45.621236  7724 raft_consensus.cc:2749] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:45.668161  7338 raft_consensus.cc:2749] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:45.632563  7780 raft_consensus.cc:493] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.669149  3997 leader_election.cc:304] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:45.621510  7792 raft_consensus.cc:2749] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:45.688690  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 74655.5us
W20260709 13:15:45.689558  3922 leader_election.cc:336] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 2.161s (SENT)
I20260709 13:15:45.686770  4101 raft_consensus.cc:2468] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 7.
I20260709 13:15:45.656459  7793 raft_consensus.cc:2749] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:45.672180  7784 raft_consensus.cc:493] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:45.700416  3922 leader_election.cc:336] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 2.170s (SENT)
I20260709 13:15:45.701438  3922 leader_election.cc:304] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:45.675017  7797 raft_consensus.cc:493] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:45.677073  7781 consensus_queue.cc:1048] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:15:45.692392  7800 consensus_queue.cc:1048] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
W20260709 13:15:45.700829  7745 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.176s	user 0.029s	sys 0.036s
I20260709 13:15:45.741237  4672 leader_election.cc:304] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:45.736773  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:45.709826  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:45.724059  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:15:45.713819  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 44794.2us
I20260709 13:15:45.747352  4031 raft_consensus.cc:2468] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 10.
I20260709 13:15:45.749142  3997 leader_election.cc:304] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:45.750869  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:45.751137  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:45.703822  7786 raft_consensus.cc:2804] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:45.752034  7185 raft_consensus.cc:2804] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:45.749614  4074 leader_election.cc:304] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:45.756003  7786 raft_consensus.cc:697] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:45.756330  7185 raft_consensus.cc:697] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 7 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:45.756784  7625 raft_consensus.cc:2804] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:45.757194  7625 raft_consensus.cc:493] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:45.757705  7625 raft_consensus.cc:3060] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:45.757258  7786 consensus_queue.cc:237] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:45.732322  7790 raft_consensus.cc:493] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:45.758998  7790 raft_consensus.cc:515] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:45.755434  3951 raft_consensus.cc:2468] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 9.
I20260709 13:15:45.761385  7790 leader_election.cc:290] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:15:45.722536  7791 log.cc:927] Time spent T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 13:15:45.703826  7784 raft_consensus.cc:515] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:45.693791  7780 raft_consensus.cc:515] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:45.746417  7745 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.222s	user 0.029s	sys 0.036s
I20260709 13:15:45.753765  4025 raft_consensus.cc:2468] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 10.
I20260709 13:15:45.785003  3997 leader_election.cc:304] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:45.786238  3997 leader_election.cc:304] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:45.786764  7736 raft_consensus.cc:2804] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:45.787185  7736 raft_consensus.cc:493] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:45.787334  3997 leader_election.cc:304] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:45.771350  4104 raft_consensus.cc:2376] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 10. Re-sending same reply.
I20260709 13:15:45.771814  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:45.789168  4101 raft_consensus.cc:2468] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 9.
I20260709 13:15:45.788446  4074 leader_election.cc:304] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:45.772156  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:45.704093  7723 leader_election.cc:290] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:45.773914  4034 raft_consensus.cc:2468] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 11.
W20260709 13:15:45.703408  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 66304us
I20260709 13:15:45.799821  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:45.805060  4101 raft_consensus.cc:2468] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 9.
I20260709 13:15:45.773495  4100 raft_consensus.cc:2468] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9.
I20260709 13:15:45.755607  3957 raft_consensus.cc:2468] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 10.
I20260709 13:15:45.741066  7549 raft_consensus.cc:515] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:45.731777  7338 raft_consensus.cc:2749] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:45.778404  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:45.812358  4029 raft_consensus.cc:1240] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 10. Current term is 11. Ops: [8.5-10.6]
I20260709 13:15:45.839203  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:45.839820  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:45.840471  3953 raft_consensus.cc:3060] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:45.840773  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:45.790068  7768 raft_consensus.cc:3055] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:45.787570  7736 raft_consensus.cc:3060] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:45.708372  7607 raft_consensus.cc:2749] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:15:45.757336  7185 consensus_queue.cc:237] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:45.742736  7619 raft_consensus.cc:3055] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:45.796188  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:45.857846  4031 raft_consensus.cc:3060] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:45.774253  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:45.858843  3955 raft_consensus.cc:2468] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 10.
I20260709 13:15:45.806360  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:45.859854  3954 raft_consensus.cc:2468] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 11.
I20260709 13:15:45.806385  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:45.861845  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:45.862605  4100 raft_consensus.cc:2376] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 11. Re-sending same reply.
I20260709 13:15:45.863840  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:45.733868  7377 leader_election.cc:290] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 11 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:45.841573  4099 raft_consensus.cc:2468] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 9.
I20260709 13:15:45.842378  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7a51e4b70a48daa8267297f285c661" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:45.572526  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:45.836907  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:45.821962  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:45.798969  7760 raft_consensus.cc:2749] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:45.820793  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:45.867233  4101 raft_consensus.cc:2468] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 9.
I20260709 13:15:45.865195  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:45.851243  3956 raft_consensus.cc:1240] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 10. Current term is 11. Ops: []
W20260709 13:15:45.848323  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 61027.8us
I20260709 13:15:45.869158  3997 leader_election.cc:304] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:45.869751  4101 raft_consensus.cc:1240] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:45.837109  7781 raft_consensus.cc:2804] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:45.857638  7619 raft_consensus.cc:740] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:45.841423  7724 raft_consensus.cc:2804] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:45.812158  7789 raft_consensus.cc:2804] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:45.770257  7797 raft_consensus.cc:515] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:45.870837  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:45.811801  7771 raft_consensus.cc:493] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:45.871461  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:45.872131  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:45.883257  4705 raft_consensus.cc:2393] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 11: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
I20260709 13:15:45.868577  4106 raft_consensus.cc:2393] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 10: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:45.874724  3997 leader_election.cc:304] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:45.887020  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 321942us
I20260709 13:15:45.846208  7768 raft_consensus.cc:740] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:45.888059  4106 raft_consensus.cc:1275] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:15:45.880546  4073 leader_election.cc:304] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:45.891094  4706 raft_consensus.cc:1275] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:15:45.893567  4706 pending_rounds.cc:85] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938: Aborting all ops after (but not including) 7
I20260709 13:15:45.893944  4706 pending_rounds.cc:107] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:15:45.894245  4706 raft_consensus.cc:2889] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:45.895474  4106 raft_consensus.cc:1240] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:45.904229  4071 leader_election.cc:304] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:45.875967  7781 raft_consensus.cc:493] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:45.870819  7799 raft_consensus.cc:2749] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:45.882104  7724 raft_consensus.cc:493] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:45.915334  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:45.915403  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:45.922842  3956 raft_consensus.cc:1275] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:15:45.898576  7789 raft_consensus.cc:697] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:45.912585  7781 raft_consensus.cc:3060] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:45.907241  7382 consensus_queue.cc:1059] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:15:45.907758  7399 raft_consensus.cc:2749] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:45.939927  7809 raft_consensus.cc:2749] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:45.940171  7795 consensus_queue.cc:1048] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:45.924160  7724 raft_consensus.cc:3060] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:45.899433  7771 raft_consensus.cc:515] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:45.953825  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:45.934392  7760 raft_consensus.cc:2804] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:45.963915  7549 leader_election.cc:290] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:45.964457  7784 leader_election.cc:290] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:45.965342  7661 raft_consensus.cc:3055] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:45.965853  7661 raft_consensus.cc:740] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:45.965938  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:45.966361  7780 leader_election.cc:290] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:45.937077  7745 raft_consensus.cc:2749] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:45.997364  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:45.998766  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:45.970392  7760 raft_consensus.cc:493] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:45.948045  7325 consensus_queue.cc:1059] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:15:45.934089  7619 consensus_queue.cc:260] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:46.014114  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 114494us
I20260709 13:15:46.019624  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:46.019646  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:46.011834  7760 raft_consensus.cc:3060] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:46.012439  7789 consensus_queue.cc:237] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:46.034336  3925 leader_election.cc:304] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
W20260709 13:15:46.037180  3922 leader_election.cc:336] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.626s (SENT)
I20260709 13:15:46.038177  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:46.048187  3925 leader_election.cc:304] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:46.068518  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:46.049468  7805 raft_consensus.cc:2749] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:46.053313  7619 raft_consensus.cc:3060] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:46.036847  7723 consensus_queue.cc:1048] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
W20260709 13:15:46.078307  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 203702us
W20260709 13:15:46.072309  7804 log.cc:927] Time spent T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 13:15:46.075176  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:46.079228  3997 leader_election.cc:304] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:46.062188  7625 raft_consensus.cc:515] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:46.102324  7805 consensus_queue.cc:1048] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:15:46.107446  7414 leader_election.cc:290] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:46.099211  3997 leader_election.cc:304] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:46.102950  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:46.110405  3997 leader_election.cc:304] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:46.111416  3997 leader_election.cc:304] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:46.110426  4101 raft_consensus.cc:2376] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9. Re-sending same reply.
I20260709 13:15:46.113031  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:46.053459  7816 consensus_queue.cc:1048] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:15:46.117223  4031 raft_consensus.cc:2468] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 11.
I20260709 13:15:46.121243  3997 leader_election.cc:304] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:46.100602  7786 raft_consensus.cc:2749] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:46.131455  4101 raft_consensus.cc:2368] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 11. Current term is 12.
I20260709 13:15:46.130842  3953 raft_consensus.cc:2468] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 11.
I20260709 13:15:46.136328  7786 raft_consensus.cc:2804] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:46.120061  7797 leader_election.cc:290] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:46.119992  7809 raft_consensus.cc:2804] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:46.141320  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
W20260709 13:15:46.152596  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 53474.4us
I20260709 13:15:46.136874  7786 raft_consensus.cc:493] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:46.155174  3922 leader_election.cc:304] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:46.126559  7821 raft_consensus.cc:2804] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:46.156517  4672 leader_election.cc:304] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:46.129767  7810 raft_consensus.cc:2804] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:15:46.142187  7812 log.cc:927] Time spent T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
W20260709 13:15:46.164253  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 113320us
I20260709 13:15:46.167534  4672 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:46.139521  7466 raft_consensus.cc:2749] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:46.172566  3925 leader_election.cc:304] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:46.156005  7786 raft_consensus.cc:3060] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:46.151710  7809 raft_consensus.cc:493] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:46.162896  7723 raft_consensus.cc:2749] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:46.189066  3922 leader_election.cc:304] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
W20260709 13:15:46.166059  7818 log.cc:927] Time spent T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:15:46.165580  7185 raft_consensus.cc:2804] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:15:46.176272  7813 log.cc:927] Time spent T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 13:15:46.155822  7805 consensus_queue.cc:1048] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:15:46.163347  7821 raft_consensus.cc:493] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:46.165036  7810 raft_consensus.cc:493] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:46.190698  7759 raft_consensus.cc:2804] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:46.218070  7759 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:46.218644  7759 raft_consensus.cc:3060] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:15:46.202953  7814 log.cc:927] Time spent T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 13:15:46.204295  7185 raft_consensus.cc:493] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:46.219887  7185 raft_consensus.cc:3060] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:15:46.220806  7811 log.cc:927] Time spent T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.287s	user 0.003s	sys 0.000s
I20260709 13:15:46.196105  7809 raft_consensus.cc:3060] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:15:46.224699  7823 log.cc:927] Time spent T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
W20260709 13:15:46.214303  7822 log.cc:927] Time spent T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:15:46.217406  7549 raft_consensus.cc:2749] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:15:46.271024  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 103605us
W20260709 13:15:46.272593  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 83675.2us
I20260709 13:15:46.272723  4672 leader_election.cc:304] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:46.212463  7816 raft_consensus.cc:2804] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:46.210700  7821 raft_consensus.cc:3060] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:46.233245  7810 raft_consensus.cc:3060] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:15:46.285975  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 164815us
I20260709 13:15:46.283565  7786 raft_consensus.cc:515] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:46.283883  7625 leader_election.cc:290] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:46.290406  3922 leader_election.cc:400] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 election: Vote denied by peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843) with higher term. Message: Invalid argument: T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 9. Current term is 10.
I20260709 13:15:46.290761  3922 leader_election.cc:403] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:15:46.296211  3922 leader_election.cc:304] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:46.286257  7752 raft_consensus.cc:2804] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:46.298550  7723 raft_consensus.cc:2749] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843) with higher term. Message: Invalid argument: T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 9. Current term is 10.
I20260709 13:15:46.300719  7752 raft_consensus.cc:493] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:46.288813  7816 raft_consensus.cc:697] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 11 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:46.270442  7185 raft_consensus.cc:515] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:46.314910  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:46.314785  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:46.300763  7549 raft_consensus.cc:2749] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:15:46.325400  7736 raft_consensus.cc:515] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:46.314478  7752 raft_consensus.cc:3060] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:46.328357  7185 leader_election.cc:290] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:46.328768  7628 raft_consensus.cc:3060] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:46.330317  7736 leader_election.cc:290] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:46.331787  4706 raft_consensus.cc:1240] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:46.333145  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:46.334609  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:46.335304  4108 raft_consensus.cc:2393] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 7: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:46.337217  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:46.346175  7780 raft_consensus.cc:3055] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:46.346609  7780 raft_consensus.cc:740] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:46.348178  7816 consensus_queue.cc:237] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:46.349746  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:46.350446  3951 raft_consensus.cc:2468] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 10.
I20260709 13:15:46.350629  7781 raft_consensus.cc:515] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:46.351814  7789 consensus_queue.cc:1048] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:46.353068  7781 leader_election.cc:290] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:46.312876  7805 consensus_queue.cc:1059] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:15:46.357108  7786 leader_election.cc:290] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:46.360607  7661 consensus_queue.cc:260] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:46.362703  7808 log.cc:927] Time spent T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.425s	user 0.002s	sys 0.000s
W20260709 13:15:46.384972  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 78219.1us
I20260709 13:15:46.386605  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:46.358035  7759 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:46.389981  7760 raft_consensus.cc:515] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:46.396837  4106 raft_consensus.cc:1275] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:15:46.397994  7828 consensus_queue.cc:1059] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:46.394254  7723 consensus_queue.cc:1048] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:15:46.331377  7724 raft_consensus.cc:515] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:46.408514  3922 leader_election.cc:304] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:46.410463  3997 leader_election.cc:304] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:46.414151  4705 raft_consensus.cc:1240] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:46.420948  3922 leader_election.cc:304] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:46.422676  3997 leader_election.cc:304] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:46.422914  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:46.423501  3958 raft_consensus.cc:3060] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:46.424394  7466 raft_consensus.cc:2749] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:46.421749  7786 raft_consensus.cc:2749] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:15:46.424774  7809 raft_consensus.cc:515] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:46.423925  3997 leader_election.cc:304] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:46.428773  3997 leader_election.cc:304] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:46.428515  7781 raft_consensus.cc:2749] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:46.440793  7760 leader_election.cc:290] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:46.441720  7759 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 11 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:46.439409  7810 raft_consensus.cc:515] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:46.445772  7724 leader_election.cc:290] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 13 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:46.447747  7786 raft_consensus.cc:2749] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:46.448242  7799 consensus_queue.cc:1059] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:46.434604  7821 raft_consensus.cc:515] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:46.456038  3997 leader_election.cc:304] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:46.461542  3997 leader_election.cc:304] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:46.464389  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:46.451610  7809 leader_election.cc:290] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:46.473141  7821 leader_election.cc:290] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:46.474629  4099 raft_consensus.cc:1275] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:15:46.457593  7828 raft_consensus.cc:2749] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:46.477253  7752 raft_consensus.cc:515] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:46.477587  7771 leader_election.cc:290] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:46.478259  4104 raft_consensus.cc:1240] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:15:46.479728  4700 raft_consensus.cc:1240] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 10. Current term is 11. Ops: []
W20260709 13:15:46.480933  7806 log.cc:927] Time spent T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.548s	user 0.003s	sys 0.000s
I20260709 13:15:46.484308  7799 consensus_queue.cc:1059] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:46.485021  4102 raft_consensus.cc:1275] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:15:46.463565  7724 raft_consensus.cc:2749] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:46.486111  7724 consensus_queue.cc:1059] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:46.458752  7760 raft_consensus.cc:2749] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:46.486908  7821 raft_consensus.cc:3055] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:46.487370  7821 raft_consensus.cc:740] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:46.488638  4105 raft_consensus.cc:2410] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:15:46.488209  7821 consensus_queue.cc:260] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:46.489547  7821 raft_consensus.cc:3060] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:46.492890  7810 leader_election.cc:290] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:46.493309  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:46.495932  4071 leader_election.cc:304] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:46.499023  7783 raft_consensus.cc:2804] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:46.499399  7783 raft_consensus.cc:493] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:46.484705  7780 consensus_queue.cc:260] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:46.500620  4104 raft_consensus.cc:1240] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:15:46.503014  4102 raft_consensus.cc:1275] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:46.505802  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:46.511271  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:15:46.513655  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.513072  4672 leader_election.cc:304] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:15:46.518968  3922 leader_election.cc:336] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 1.875s (SENT)
I20260709 13:15:46.520216  3958 raft_consensus.cc:2468] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 12.
I20260709 13:15:46.521942  4672 leader_election.cc:304] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:46.522921  3922 leader_election.cc:304] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:46.500120  7780 raft_consensus.cc:3060] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:46.524305  4071 leader_election.cc:304] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:46.499756  7783 raft_consensus.cc:3060] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:46.523195  7760 raft_consensus.cc:493] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:46.536067  7760 raft_consensus.cc:515] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:46.538396  7760 leader_election.cc:290] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:46.523375  7771 raft_consensus.cc:493] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:46.523119  7182 raft_consensus.cc:2804] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:46.539451  7771 raft_consensus.cc:515] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:46.541056  7182 raft_consensus.cc:697] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 11 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:46.541716  7771 leader_election.cc:290] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:46.542068  7182 consensus_queue.cc:237] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:46.477691  7759 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.508781  7752 leader_election.cc:290] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 11 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:46.532226  7549 raft_consensus.cc:3055] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:15:46.544075  7382 raft_consensus.cc:2749] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:46.546487  7549 raft_consensus.cc:740] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:46.520103  7810 raft_consensus.cc:2749] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:46.543931  7789 raft_consensus.cc:2804] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:46.545646  7607 raft_consensus.cc:3055] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:46.552480  7792 raft_consensus.cc:2749] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:46.563974  3922 leader_election.cc:336] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 2.003s (SENT)
I20260709 13:15:46.547413  7549 consensus_queue.cc:260] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:46.552076  7789 raft_consensus.cc:697] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:46.561740  7607 raft_consensus.cc:740] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:46.567245  3951 raft_consensus.cc:1240] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 11 LEADER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:46.548233  7759 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:46.572454  7607 consensus_queue.cc:260] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:46.583081  4029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38290 (request call id 2052) took 1048 ms. Trace:
I20260709 13:15:46.584384  4029 rpcz_store.cc:276] 0709 13:15:45.534486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.557319 (+ 22833us) service_pool.cc:224] Handling call
0709 13:15:45.805440 (+248121us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:45.838606 (+ 33166us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:46.582792 (+744186us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b54001d9f50. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566d8ad 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:46.582996 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":569704832}
W20260709 13:15:46.582175  7722 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.024s	sys 0.034s
I20260709 13:15:46.616566  7338 raft_consensus.cc:3055] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:46.617218  7338 raft_consensus.cc:740] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:46.615007  7768 consensus_queue.cc:260] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:46.620759  7661 raft_consensus.cc:3060] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:46.621016  7768 raft_consensus.cc:3060] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:46.618520  7338 consensus_queue.cc:260] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:46.609999  7722 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.024s	sys 0.034s
W20260709 13:15:46.624475  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.645617  7607 raft_consensus.cc:3060] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:46.649677  7810 raft_consensus.cc:493] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:46.650331  7810 raft_consensus.cc:515] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:46.651593  7338 raft_consensus.cc:3060] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:46.652731  7810 leader_election.cc:290] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:46.657012  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:15:46.662746  7839 log.cc:927] Time spent T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:15:46.663726  7789 consensus_queue.cc:237] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:46.669670  3997 leader_election.cc:304] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:46.672842  7759 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:46.673108  7771 consensus_queue.cc:1048] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:46.674465  7760 consensus_queue.cc:1059] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:46.675583  7760 raft_consensus.cc:3055] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:46.676033  7760 raft_consensus.cc:740] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:46.676072  7768 raft_consensus.cc:2749] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:46.677330  7760 consensus_queue.cc:260] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:46.679191  7760 raft_consensus.cc:3060] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:46.680670  7549 raft_consensus.cc:3060] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:46.682474  4100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45332 (request call id 1966) took 1078 ms. Trace:
I20260709 13:15:46.709482  4100 rpcz_store.cc:276] 0709 13:15:45.604107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.863517 (+259410us) service_pool.cc:224] Handling call
0709 13:15:46.682240 (+818723us) spinlock_profiling.cc:243] Waited 430 ms on lock 0x7b5400200154. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:46.682383 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":989784960}
I20260709 13:15:46.687253  4105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45332 (request call id 1955) took 1118 ms. Trace:
I20260709 13:15:46.710726  4105 rpcz_store.cc:276] 0709 13:15:45.569312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.569475 (+   163us) service_pool.cc:224] Handling call
0709 13:15:46.686981 (+1117506us) spinlock_profiling.cc:243] Waited 918 ms on lock 0x7b540028ffd4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:46.687175 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2110850304}
I20260709 13:15:46.691413  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:46.692013  4106 raft_consensus.cc:1275] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 13:15:46.711747  4106 pending_rounds.cc:85] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc: Aborting all ops after (but not including) 5
I20260709 13:15:46.712090  4106 pending_rounds.cc:107] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 6.6
I20260709 13:15:46.712404  4106 raft_consensus.cc:2917] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Aborting config change with OpId 6.6: Aborted: Op aborted by new leader
I20260709 13:15:46.712818  4106 raft_consensus.cc:2889] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:46.713353  4106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:34646 (request call id 22) took 2935 ms. Trace:
I20260709 13:15:46.713714  4106 rpcz_store.cc:276] 0709 13:15:43.778118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.788181 (+ 10063us) service_pool.cc:224] Handling call
0709 13:15:44.931216 (+1143035us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b2c0005a6a8. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1523f67a11 00007f1523f76a0a 00007f1523f76693 00007f1523f76631 00007f15256a93f1 00007f15255e29fe 00007f1525669749 00007f152566a76a 00007f152566991b 00007f152567503c 00007f15256746b3
0709 13:15:44.976258 (+ 45042us) log.cc:844] Serialized 506 byte log entry
0709 13:15:45.350712 (+374454us) spinlock_profiling.cc:243] Waited 37.4 ms on lock 0x7b54003df020. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15255e3dbe 00007f15255ee930 00007f15255ee8d8 00007f15255ee858 00007f15255ee813 00007f15255eda9c 00007f152b4d9626 00007f152b4d3dd8 00007f152562a7cb 00007f152562d2c0
0709 13:15:45.743987 (+393275us) spinlock_profiling.cc:243] Waited 61.6 ms on lock 0x7b54003df020. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15255eeb26 00007f15255e849a 00007f15255e7714 00007f15255c7eaa 00007f15255ced53 00007f15255cecd9 00007f15255cec69 00007f15255cec31 00007f15255cddfd 000000000038f354
0709 13:15:45.768648 (+ 24661us) spinlock_profiling.cc:243] Waited 3.12 ms on lock 0x7b54003df020. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15255e7062 00007f15255c7eaa 00007f15255ced53 00007f15255cecd9 00007f15255cec69 00007f15255cec31 00007f15255cddfd 000000000038f354 000000000038f199 00007f1522581475
0709 13:15:46.713255 (+944607us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":136565,"raft.run_cpu_time_us":11958,"raft.run_wall_time_us":1104856,"spinlock_wait_cycles":264968192,"thread_start_us":319490,"threads_started":2,"wal-append.queue_time_us":78856,"wal-append.run_cpu_time_us":6179,"wal-append.run_wall_time_us":1289554}
W20260709 13:15:46.705751  4672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:46.716275  3905 auto_rebalancer.cc:629] Failed to schedule move for tablet 3f641c5435604e30bb44aa411954bd2f: Aborted: Op aborted by new leader
I20260709 13:15:46.711895  4108 raft_consensus.cc:2468] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 10.
I20260709 13:15:46.721648  3952 raft_consensus.cc:1240] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:46.728174  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:46.732422  3951 raft_consensus.cc:1275] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:15:46.730242  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:46.733929  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:46.734207  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:46.740571  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:46.740651  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:46.741657  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:46.743006  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:46.745954  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:46.746387  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:46.747177  4027 raft_consensus.cc:1240] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:46.748853  4027 raft_consensus.cc:1240] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 13 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:46.750142  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:46.750363  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:46.752254  4029 raft_consensus.cc:3060] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:15:46.755429  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:46.752427  4032 raft_consensus.cc:2468] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 6.
I20260709 13:15:46.758762  4103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45332 (request call id 1979) took 1147 ms. Trace:
I20260709 13:15:46.763163  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:46.760213  4103 rpcz_store.cc:276] 0709 13:15:45.611025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:46.026904 (+415879us) service_pool.cc:224] Handling call
0709 13:15:46.027306 (+   402us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:15:46.032347 (+  5041us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:15:46.365561 (+333214us) spinlock_profiling.cc:243] Waited 2.49 ms on lock 0x7b180038b540. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f1522563e07 00007f152b3beab9 00007f152258069b 00007f152257e93f 00007f152257e455 00007f15290663c7 00007f15256789a7 00007f15256880bf 00007f1525688038
0709 13:15:46.510262 (+144701us) log.cc:844] Serialized 14 byte log entry
0709 13:15:46.560267 (+ 50005us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:15:46.560947 (+   680us) log.cc:844] Serialized 78 byte log entry
0709 13:15:46.561094 (+   147us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:46.561299 (+   205us) log.cc:844] Serialized 14 byte log entry
0709 13:15:46.561523 (+   224us) log.cc:844] Serialized 14 byte log entry
0709 13:15:46.569465 (+  7942us) log.cc:844] Serialized 14 byte log entry
0709 13:15:46.637577 (+ 68112us) spinlock_profiling.cc:243] Waited 8.98 ms on lock 0x7b180038b540. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f1522581522 00007f15225837c1 00007f1522583779 00007f1522583709 00007f15225836d1 00007f15225829cd 000000000038f354 000000000038f199 00007f152256483a
0709 13:15:46.758247 (+120670us) spinlock_profiling.cc:243] Waited 2.14 ms on lock 0x7b180038b540. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f15224fbc0a 00007f152bc3b219 00007f1522583a40 00007f152257e4e4 00007f152257e455 00007f1525666060 00007f1525678716 00007f1525689287 00007f1525689208
0709 13:15:46.758439 (+   192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:46.758523 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:46.758564 (+    41us) raft_consensus.cc:1685] finished
0709 13:15:46.758576 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:46.758703 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46741,"prepare.queue_time_us":312399,"prepare.run_cpu_time_us":163,"prepare.run_wall_time_us":3241,"raft.queue_time_us":30723,"raft.run_cpu_time_us":482,"raft.run_wall_time_us":20681,"spinlock_wait_cycles":32650112,"thread_start_us":169411,"threads_started":2,"wal-append.queue_time_us":100019}
I20260709 13:15:46.720672  7783 raft_consensus.cc:515] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:46.744926  7821 raft_consensus.cc:493] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:46.773813  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:46.776104  4026 raft_consensus.cc:1240] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:46.778497  4705 raft_consensus.cc:1275] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:15:46.782469  4026 raft_consensus.cc:1240] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:46.773932  7821 raft_consensus.cc:515] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:46.787528  7758 raft_consensus.cc:493] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.798676  7758 raft_consensus.cc:515] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:46.744789  7768 raft_consensus.cc:493] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.744562  7810 raft_consensus.cc:493] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.789335  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:46.797716  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:46.812223  4103 raft_consensus.cc:2376] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9. Re-sending same reply.
I20260709 13:15:46.798974  7783 leader_election.cc:290] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:46.818183  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:46.819324  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:46.819729  7849 consensus_queue.cc:1048] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:46.820482  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:46.821640  4032 raft_consensus.cc:1240] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 9. Current term is 10. Ops: []
W20260709 13:15:46.805291  3857 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52094 (request call id 200) took 25841 ms (client timeout 15000 ms). Trace:
W20260709 13:15:46.793495  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 54473.2us
I20260709 13:15:46.806384  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:46.813259  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:46.804836  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:46.807756  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
W20260709 13:15:46.823717  4071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.824196  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:46.793206  7848 raft_consensus.cc:493] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.800390  7768 raft_consensus.cc:515] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:46.796736  7821 leader_election.cc:290] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:46.797544  7182 consensus_queue.cc:1048] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:15:46.796847  4672 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:46.793114  7780 raft_consensus.cc:493] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.816809  7758 leader_election.cc:290] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:46.817421  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:46.837277  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:46.824378  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:46.846071  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 49311.7us
I20260709 13:15:46.825783  4107 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:15:46.826995  3951 raft_consensus.cc:1275] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:15:46.827296  4104 raft_consensus.cc:1240] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:15:46.827920  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:46.850471  4107 raft_consensus.cc:606] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Received request to transfer leadership to TS 6f5b5e4ed72944ecbda200012d141dc2
W20260709 13:15:46.830262  3905 auto_rebalancer.cc:629] Failed to schedule move for tablet b523c05ab48243118947b2e30890c0b4: Illegal state: Replica 8952c48a6f3a43968f7d77f7bfc4d1bc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:46.850934  4107 raft_consensus.cc:614] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:46.836395  7632 raft_consensus.cc:3055] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:46.853920  7632 raft_consensus.cc:740] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:46.856650  4026 raft_consensus.cc:1240] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 9. Current term is 10. Ops: []
W20260709 13:15:46.856828  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.857733  3952 consensus_queue.cc:237] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:15:46.860457  4074 leader_election.cc:304] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:46.866154  4032 raft_consensus.cc:1240] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:46.866200  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:46.868191  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:46.871246  3959 raft_consensus.cc:3060] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:15:46.830086  3857 rpcz_store.cc:269] 0709 13:15:20.934222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:20.934554 (+   332us) service_pool.cc:224] Handling call
0709 13:15:46.775222 (+25840668us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:43.207838 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:43.220334 (+ 12496us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:43.220390 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:15:43.220415 (+    25us) tablet.cc:662] Decoding operations
0709 13:15:43.221879 (+  1464us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:43.221957 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:43.221994 (+    37us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:15:43.223378 (+  1384us) tablet.cc:701] Row locks acquired
0709 13:15:43.223442 (+    64us) write_op.cc:260] PREPARE: finished
0709 13:15:43.272569 (+ 49127us) write_op.cc:270] Start()
0709 13:15:43.288293 (+ 15724us) write_op.cc:276] Timestamp: P: 1783602943258649 usec, L: 0
0709 13:15:43.288324 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:15:43.289135 (+   811us) log.cc:844] Serialized 5586 byte log entry
0709 13:15:43.859395 (+570260us) op_driver.cc:464] REPLICATION: finished
0709 13:15:44.174981 (+315586us) write_op.cc:301] APPLY: starting
0709 13:15:44.184473 (+  9492us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:44.384471 (+199998us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:44.451669 (+ 67198us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:44.529540 (+ 77871us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:44.530037 (+   497us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 13:15:44.530082 (+    45us) write_op.cc:312] APPLY: finished
0709 13:15:44.530527 (+   445us) log.cc:844] Serialized 101 byte log entry
0709 13:15:44.530751 (+   224us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:44.530985 (+   234us) write_op.cc:454] Released schema lock
0709 13:15:44.531077 (+    92us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:44.687690 (+156613us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:44.687727 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":46854,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":253511,"apply.run_cpu_time_us":9873,"apply.run_wall_time_us":403892,"num_ops":14,"prepare.queue_time_us":125403,"prepare.run_cpu_time_us":31119,"prepare.run_wall_time_us":372022,"raft.queue_time_us":233083,"raft.run_cpu_time_us":71587,"raft.run_wall_time_us":158480,"replication_time_us":570902,"thread_start_us":546417,"threads_started":4,"wal-append.queue_time_us":321351,"wal-append.run_cpu_time_us":19733,"wal-append.run_wall_time_us":1912786}]]}
I20260709 13:15:46.872944  4026 raft_consensus.cc:1240] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:46.820513  7809 consensus_queue.cc:1048] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:15:46.880609  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:46.867791  7752 raft_consensus.cc:2804] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:46.894578  4029 raft_consensus.cc:2468] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 12.
I20260709 13:15:46.825070  7810 raft_consensus.cc:515] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:46.899508  4672 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:46.909337  3922 leader_election.cc:336] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Timed out: RequestConsensusVote RPC to 127.2.198.195:37843 timed out after 2.557s (SENT)
I20260709 13:15:46.893631  7752 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:46.869248  7780 raft_consensus.cc:515] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:46.877992  7800 consensus_queue.cc:1048] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:15:46.931910  4030 raft_consensus.cc:1240] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:46.939049  3997 leader_election.cc:304] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:46.842984  7848 raft_consensus.cc:515] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:46.940927  3997 leader_election.cc:304] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:46.942411  3997 leader_election.cc:304] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:46.935745  4108 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "f1c75790cedf4f52a3463a255c7da059"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:15:46.943687  4108 raft_consensus.cc:606] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Received request to transfer leadership to TS f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:46.944121  4108 raft_consensus.cc:614] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:46.920327  7825 raft_consensus.cc:2749] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:15:46.955307  4108 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "f1c75790cedf4f52a3463a255c7da059"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:15:46.956209  4108 raft_consensus.cc:606] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Received request to transfer leadership to TS f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:46.956624  4108 raft_consensus.cc:614] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:46.964785  7361 consensus_queue.cc:1048] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:46.968664  3922 leader_election.cc:400] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843) with higher term. Message: Invalid argument: T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 11. Current term is 12.
I20260709 13:15:46.924583  7845 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:46.931219  3853 catalog_manager.cc:5697] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:46.936926  7752 raft_consensus.cc:3060] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:46.946658  7786 raft_consensus.cc:2749] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:47.000972  3853 catalog_manager.cc:5697] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:15:47.006907  4700 raft_consensus.cc:1240] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:46.948297  7809 raft_consensus.cc:2749] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:47.030227  3853 catalog_manager.cc:5697] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:46.940053  7771 consensus_queue.cc:1059] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:15:47.028278  7799 raft_consensus.cc:493] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.043102  4108 raft_consensus.cc:1275] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:15:47.039415  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:47.060771  3853 catalog_manager.cc:5697] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:47.063745  3959 raft_consensus.cc:2468] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 11.
I20260709 13:15:47.065719  3951 raft_consensus.cc:1240] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:47.067473  4071 leader_election.cc:304] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:47.003226  7824 consensus_queue.cc:1048] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:15:47.070394  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:47.022250  7724 raft_consensus.cc:2749] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:47.035135  7789 raft_consensus.cc:493] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.020227  7781 consensus_queue.cc:1059] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:15:47.077914  7810 leader_election.cc:290] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:47.079077  7780 leader_election.cc:290] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:47.079643  4026 raft_consensus.cc:1275] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:47.097206  4032 raft_consensus.cc:2468] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 11.
I20260709 13:15:47.080552  7338 raft_consensus.cc:2749] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:47.065712  7793 consensus_queue.cc:1048] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:15:47.082767  3925 leader_election.cc:304] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:47.085790  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:47.043931  7833 raft_consensus.cc:493] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:47.128638  3950 raft_consensus.cc:2468] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 7.
I20260709 13:15:47.073475  3853 catalog_manager.cc:5697] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 6 to 8, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to d709ee666b774ec29aa732e508219938 (127.2.198.196). New cstate: current_term: 8 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:15:47.099295  4030 raft_consensus.cc:1275] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:15:47.131716  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:47.100878  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:47.101770  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:47.134586  4031 raft_consensus.cc:1275] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:15:47.085052  7809 raft_consensus.cc:3055] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:47.008845  7845 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:47.145726  7414 consensus_queue.cc:1048] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:15:47.166338  7848 leader_election.cc:290] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:47.183059  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 100362us
I20260709 13:15:47.184022  7849 raft_consensus.cc:2749] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:15:47.185014  3925 leader_election.cc:304] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:15:47.185492  7849 consensus_queue.cc:1059] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:47.186614  7849 raft_consensus.cc:2804] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:47.187063  7849 raft_consensus.cc:493] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:47.120818  7619 raft_consensus.cc:2804] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:47.064908  7799 raft_consensus.cc:515] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:47.143155  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:47.109578  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:47.071357  7768 leader_election.cc:290] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:47.146817  4074 leader_election.cc:304] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:47.120080  7789 raft_consensus.cc:515] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:47.132536  4030 raft_consensus.cc:2468] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 8.
I20260709 13:15:47.116811  7723 consensus_queue.cc:1059] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 13:15:47.204716  3958 raft_consensus.cc:2468] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 9.
W20260709 13:15:47.214073  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 67350.9us
W20260709 13:15:47.195222  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 252885us
I20260709 13:15:47.143927  7809 raft_consensus.cc:740] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
W20260709 13:15:47.213397  3924 consensus_peers.cc:597] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 -> Peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117): Couldn't send request to peer d709ee666b774ec29aa732e508219938. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 65333bcc8c2a4b1a9f6f35670cefe7d0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:47.219892  3997 leader_election.cc:304] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:47.188205  3853 catalog_manager.cc:5697] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 5 to 9, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 9 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:47.229609  3997 leader_election.cc:304] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:47.238828  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 50536.7us
I20260709 13:15:47.188827  7619 raft_consensus.cc:697] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:47.239254  3997 leader_election.cc:304] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:47.240888  3997 leader_election.cc:304] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:47.189785  7793 raft_consensus.cc:3055] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:15:47.216454  7800 raft_consensus.cc:2749] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:47.219830  7816 raft_consensus.cc:493] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.243366  3853 catalog_manager.cc:5697] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:47.187513  7849 raft_consensus.cc:3060] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:47.250299  4032 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151"
dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
mode: GRACEFUL
new_leader_uuid: "f1c75790cedf4f52a3463a255c7da059"
 from {username='slave'} at 127.0.0.1:44232
I20260709 13:15:47.251061  4032 raft_consensus.cc:606] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Received request to transfer leadership to TS f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:47.231372  7786 raft_consensus.cc:2749] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:47.227676  7810 raft_consensus.cc:493] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.207783  7476 consensus_queue.cc:1059] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:15:47.143553  7833 raft_consensus.cc:515] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:47.251482  4032 raft_consensus.cc:614] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:47.207921  7722 consensus_queue.cc:1059] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:15:47.224210  7768 consensus_queue.cc:1048] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:15:47.261278  3853 catalog_manager.cc:5697] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 6 to 9, leader changed from 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 9 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:47.243762  7793 raft_consensus.cc:740] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:47.254276  7724 raft_consensus.cc:2749] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:47.272431  3853 catalog_manager.cc:5697] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 4 to 5, leader changed from d709ee666b774ec29aa732e508219938 (127.2.198.196) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 5 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:47.231098  7632 consensus_queue.cc:260] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:47.281834  7789 leader_election.cc:290] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:47.282709  7619 consensus_queue.cc:237] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:47.284833  7833 leader_election.cc:290] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:47.265354  7786 raft_consensus.cc:2749] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:47.256261  7723 consensus_queue.cc:1059] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:15:47.259172  7809 consensus_queue.cc:260] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:47.253803  7816 raft_consensus.cc:515] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:47.259810  7810 raft_consensus.cc:515] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:47.291314  7848 raft_consensus.cc:3055] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:47.291929  7845 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:47.269587  7847 raft_consensus.cc:3055] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:47.310139  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:47.323663  3958 raft_consensus.cc:1275] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:15:47.288714  7476 consensus_queue.cc:1059] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:47.331007  4026 raft_consensus.cc:1275] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:15:47.341732  7771 raft_consensus.cc:3055] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:47.404976  7771 raft_consensus.cc:740] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:47.406258  7771 consensus_queue.cc:260] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:47.345387  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:47.346052  4104 raft_consensus.cc:1275] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:15:47.348069  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:47.408620  4108 raft_consensus.cc:2468] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 10.
W20260709 13:15:47.325883  7851 log.cc:927] Time spent T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:15:47.261055  7792 consensus_queue.cc:1059] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
W20260709 13:15:47.326632  7414 consensus_queue.cc:1175] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d709ee666b774ec29aa732e508219938" responder_term: 11 status { last_received { term: 10 index: 9 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:15:47.368793  4071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:47.411247  7816 leader_election.cc:290] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:47.411511  4071 leader_election.cc:304] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:47.376081  2843 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:15:47.414826  2843 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:47.321012  7611 raft_consensus.cc:493] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:47.415771  7611 raft_consensus.cc:515] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:47.416704  4032 raft_consensus.cc:2410] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:15:47.417946  7810 leader_election.cc:290] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:47.418170  7611 leader_election.cc:290] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:47.376205  7724 raft_consensus.cc:493] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:47.419178  7724 raft_consensus.cc:515] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:47.421723  7724 leader_election.cc:290] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:47.379122  7848 raft_consensus.cc:740] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:47.423410  7848 consensus_queue.cc:260] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:47.378679  7779 raft_consensus.cc:493] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.425264  7779 raft_consensus.cc:515] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:47.409757  7752 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:47.429970  7752 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 11 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:47.431077  7771 raft_consensus.cc:3060] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:47.354563  7859 raft_consensus.cc:2749] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:47.442445  7863 raft_consensus.cc:3055] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:47.443090  7863 raft_consensus.cc:740] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:47.444226  7863 consensus_queue.cc:260] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:47.446159  7863 raft_consensus.cc:3060] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:47.383031  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:47.448140  4029 raft_consensus.cc:2468] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 8.
I20260709 13:15:47.449481  7821 raft_consensus.cc:493] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:47.450248  7821 raft_consensus.cc:515] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:47.457233  7821 leader_election.cc:290] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:47.458186  7758 raft_consensus.cc:493] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.458921  7758 raft_consensus.cc:515] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:47.461720  7758 leader_election.cc:290] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:15:47.386873  7856 log.cc:927] Time spent T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:15:47.389336  7847 raft_consensus.cc:740] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:47.468799  7847 consensus_queue.cc:260] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:47.470242  7847 raft_consensus.cc:3060] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:47.387643  7793 consensus_queue.cc:260] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:47.473587  7793 raft_consensus.cc:3060] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:15:47.475733  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:47.394757  7850 log.cc:927] Time spent T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
W20260709 13:15:47.401163  7857 log.cc:927] Time spent T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
W20260709 13:15:47.402688  7852 log.cc:927] Time spent T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:15:47.407948  4100 raft_consensus.cc:2468] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 8.
I20260709 13:15:47.410451  7792 raft_consensus.cc:3055] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:47.290798  7799 leader_election.cc:290] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:15:47.485081  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 73701.3us
W20260709 13:15:47.467319  7549 consensus_meta.cc:287] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.748s	user 0.009s	sys 0.002s
W20260709 13:15:47.499750  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 258949us
I20260709 13:15:47.500953  3997 leader_election.cc:304] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:47.486862  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 213531us
I20260709 13:15:47.487632  3853 catalog_manager.cc:5697] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:47.521173  3997 leader_election.cc:304] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:47.495832  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:47.522396  3997 leader_election.cc:304] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:47.523779  3997 leader_election.cc:304] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:47.522549  4034 raft_consensus.cc:2468] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 11.
I20260709 13:15:47.525753  3925 leader_election.cc:304] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:47.531188  4025 raft_consensus.cc:1240] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:47.535993  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:47.537106  4029 raft_consensus.cc:2468] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 8.
I20260709 13:15:47.521734  3853 catalog_manager.cc:5697] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 1 to 8. New cstate: current_term: 8 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:47.495008  7800 raft_consensus.cc:2804] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:47.553894  3997 leader_election.cc:304] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:47.494670  7792 raft_consensus.cc:740] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:47.560056  3997 leader_election.cc:304] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:47.561426  4029 raft_consensus.cc:1240] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:47.641073  7768 raft_consensus.cc:2749] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:47.642196  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 82273.7us
I20260709 13:15:47.643060  3997 leader_election.cc:304] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:47.639629  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 344454us
I20260709 13:15:47.644524  3853 catalog_manager.cc:5697] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:15:47.634639  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:47.646440  4705 raft_consensus.cc:2368] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 10. Current term is 11.
I20260709 13:15:47.525736  7786 raft_consensus.cc:2749] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:15:47.553495  7800 raft_consensus.cc:493] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.558327  7781 raft_consensus.cc:2749] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:47.542699  7821 raft_consensus.cc:2749] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:47.555953  7440 raft_consensus.cc:2804] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:47.562253  7724 raft_consensus.cc:2749] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:47.639528  7779 leader_election.cc:290] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:47.559263  7628 raft_consensus.cc:493] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
W20260709 13:15:47.673386  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 282888us
I20260709 13:15:47.649899  7810 raft_consensus.cc:2749] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:47.676391  4675 leader_election.cc:304] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:47.657276  7800 raft_consensus.cc:3060] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:47.556589  7549 consensus_queue.cc:1048] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.115s
I20260709 13:15:47.686450  3853 catalog_manager.cc:5697] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 4 to 7, leader changed from 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 7 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:47.665056  7440 raft_consensus.cc:493] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.662019  7783 raft_consensus.cc:493] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:47.661619  7768 raft_consensus.cc:2749] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:47.715195  3853 catalog_manager.cc:5697] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 2 to 8, leader changed from 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 8 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:47.675190  7377 consensus_queue.cc:1048] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:15:47.688608  7611 raft_consensus.cc:493] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.711586  7440 raft_consensus.cc:3060] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:47.679070  7865 consensus_queue.cc:1059] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:15:47.682065  7628 raft_consensus.cc:515] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:47.730628  7853 log.cc:927] Time spent T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.481s	user 0.000s	sys 0.005s
I20260709 13:15:47.758772  3853 catalog_manager.cc:5697] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 6 to 9, leader changed from d709ee666b774ec29aa732e508219938 (127.2.198.196) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 9 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:47.760798  3853 catalog_manager.cc:5697] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 7 to 8, leader changed from 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 8 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:47.730906  7872 raft_consensus.cc:2804] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:47.716060  7783 raft_consensus.cc:515] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:47.772930  3853 catalog_manager.cc:5697] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 6 to 8, leader changed from d709ee666b774ec29aa732e508219938 (127.2.198.196) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 8 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:15:47.795452  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 108424us
I20260709 13:15:47.798193  3853 catalog_manager.cc:5697] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:47.737777  7611 raft_consensus.cc:515] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:47.709059  7792 consensus_queue.cc:260] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:47.805691  3853 catalog_manager.cc:5697] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 4 to 7, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 7 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:47.795849  7872 raft_consensus.cc:697] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 11 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:47.817209  3853 catalog_manager.cc:5697] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 4 to 8, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 8 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
W20260709 13:15:47.822278  7866 log.cc:927] Time spent T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:15:47.821713  7872 consensus_queue.cc:237] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:47.828642  3925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:47.832845  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:47.836449  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:47.837049  4108 raft_consensus.cc:3060] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:47.838595  4106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45332 (request call id 1994) took 1050 ms. Trace:
I20260709 13:15:47.833737  3853 catalog_manager.cc:5697] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 7 to 10, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to d709ee666b774ec29aa732e508219938 (127.2.198.196). New cstate: current_term: 10 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
W20260709 13:15:47.828418  7862 log.cc:927] Time spent T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 13:15:47.839107  4106 rpcz_store.cc:276] 0709 13:15:46.788025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:46.789408 (+  1383us) service_pool.cc:224] Handling call
0709 13:15:46.789709 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:46.790074 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:46.790108 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:46.790603 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 13:15:47.051891 (+261288us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:47.071862 (+ 19971us) log.cc:844] Serialized 14 byte log entry
0709 13:15:47.075995 (+  4133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:47.076082 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:47.524821 (+448739us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b4400022b4c. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f15224a7c85 00007f15224a86a2 00007f152521a1db 00007f1525215aaf 00007f152520986e 00007f1525208bb6 00007f15252087d8 00007f1525212221 00007f15252121d9 00007f1525212169
0709 13:15:47.838230 (+313409us) raft_consensus.cc:1685] finished
0709 13:15:47.838343 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:47.838518 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3819,"prepare.queue_time_us":27966,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":24059,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":27529,"spinlock_wait_cycles":4458368,"thread_start_us":235873,"threads_started":1,"wal-append.queue_time_us":413013}
I20260709 13:15:47.854748  7889 raft_consensus.cc:493] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:47.855489  7632 raft_consensus.cc:3060] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:47.878422  7611 leader_election.cc:290] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:47.857295  7414 raft_consensus.cc:493] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
W20260709 13:15:47.865031  7869 log.cc:927] Time spent T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:15:47.866981  7883 raft_consensus.cc:493] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:47.862648  7549 raft_consensus.cc:493] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:47.885949  7792 raft_consensus.cc:3060] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:47.895450  4108 raft_consensus.cc:2468] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 11.
I20260709 13:15:47.888443  7884 consensus_queue.cc:1048] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
W20260709 13:15:47.901629  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:47.875998  7877 log.cc:927] Time spent T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
W20260709 13:15:47.871292  7874 log.cc:927] Time spent T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:15:47.872030  7628 leader_election.cc:290] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:47.935871  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:47.938480  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:47.939319  3951 raft_consensus.cc:2468] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 12.
I20260709 13:15:47.941560  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:47.943128  3922 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:47.937659  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:47.945149  3952 raft_consensus.cc:2468] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 8.
I20260709 13:15:47.947681  3997 leader_election.cc:304] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:47.950217  4027 raft_consensus.cc:1240] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 9. Current term is 10. Ops: []
W20260709 13:15:47.949604  3922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:47.952131  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:47.953310  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:47.953879  3997 leader_election.cc:304] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:47.955176  4026 raft_consensus.cc:1240] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:47.955403  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:47.959435  3925 leader_election.cc:304] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:47.956063  3956 raft_consensus.cc:2468] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 10.
I20260709 13:15:47.907678  7414 raft_consensus.cc:515] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:47.966063  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:47.966763  7414 leader_election.cc:290] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:47.967708  7723 raft_consensus.cc:2804] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:47.968166  7723 raft_consensus.cc:493] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.968533  7723 raft_consensus.cc:3060] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:47.971361  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:47.972071  4033 raft_consensus.cc:2468] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 11.
I20260709 13:15:47.975687  7628 raft_consensus.cc:493] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:47.976277  7628 raft_consensus.cc:515] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:47.978502  7628 leader_election.cc:290] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:47.980330  3997 leader_election.cc:304] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:47.897190  7889 raft_consensus.cc:515] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:47.948071  7845 raft_consensus.cc:2804] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:47.988595  3953 raft_consensus.cc:3060] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:15:47.956715  7771 raft_consensus.cc:2804] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:47.979104  7809 raft_consensus.cc:3060] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:47.960695  7768 raft_consensus.cc:2804] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:47.947099  7476 consensus_queue.cc:1048] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:15:47.935051  7549 raft_consensus.cc:515] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:47.995419  7771 raft_consensus.cc:493] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:48.015228  7771 raft_consensus.cc:3060] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:15:48.016788  7863 consensus_meta.cc:287] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.570s	user 0.014s	sys 0.000s
I20260709 13:15:48.021050  7549 leader_election.cc:290] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:15:48.005654  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 177171us
I20260709 13:15:47.986158  7810 raft_consensus.cc:2804] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:48.016716  7889 leader_election.cc:290] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:47.944173  7883 raft_consensus.cc:515] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:48.006421  7768 raft_consensus.cc:493] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:48.028712  7768 raft_consensus.cc:3060] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:48.023777  7361 raft_consensus.cc:3055] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:48.029243  7361 raft_consensus.cc:740] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:48.029495  7883 leader_election.cc:290] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:48.003916  7849 consensus_meta.cc:287] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.746s	user 0.009s	sys 0.005s
I20260709 13:15:48.012948  3953 raft_consensus.cc:2468] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 11.
I20260709 13:15:48.025251  3924 leader_election.cc:400] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: Vote denied by peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117) with higher term. Message: Invalid argument: T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 10. Current term is 11.
I20260709 13:15:48.030555  3958 raft_consensus.cc:2468] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 6.
W20260709 13:15:48.030647  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 45599.3us
W20260709 13:15:48.043843  4072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:48.030231  7361 consensus_queue.cc:260] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:48.059063  4028 raft_consensus.cc:1275] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:15:48.059480  4672 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:48.019253  7440 raft_consensus.cc:515] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:48.036804  3951 raft_consensus.cc:1275] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:15:48.023841  7810 raft_consensus.cc:493] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:48.081413  4672 leader_election.cc:304] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:48.085688  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:48.082647  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:48.087931  4027 raft_consensus.cc:2468] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 7.
I20260709 13:15:48.088665  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:48.086608  3951 raft_consensus.cc:2468] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 10.
I20260709 13:15:48.021711  7873 consensus_queue.cc:1059] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:15:48.093757  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:48.096391  3959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 2173) took 1012 ms. Trace:
I20260709 13:15:48.092572  7889 consensus_queue.cc:1059] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
W20260709 13:15:48.096385  7847 consensus_meta.cc:287] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.626s	user 0.013s	sys 0.002s
I20260709 13:15:48.097894  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:48.096928  3959 rpcz_store.cc:276] 0709 13:15:47.083923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.086898 (+  2975us) service_pool.cc:224] Handling call
0709 13:15:47.087293 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:47.123350 (+ 36057us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:47.123391 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:47.124034 (+   643us) log.cc:844] Serialized 26 byte log entry
0709 13:15:47.485871 (+361837us) spinlock_profiling.cc:243] Waited 22.3 ms on lock 0x7b18003afc00. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f1522563e07 00007f152b3beab9 00007f152258069b 00007f152257e93f 00007f1522580c02 00007f152520820b 00007f152520dd23 00007f152520e0d1 00007f1525629a0f
0709 13:15:47.933171 (+447300us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:47.933211 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:47.933287 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:48.096084 (+162797us) raft_consensus.cc:1685] finished
0709 13:15:48.096104 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:48.096325 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35583,"raft.queue_time_us":40147,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":9416,"spinlock_wait_cycles":51402112,"thread_start_us":447052,"threads_started":1,"wal-append.queue_time_us":853863}
I20260709 13:15:48.098676  4028 raft_consensus.cc:2393] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 11: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:48.100322  7848 raft_consensus.cc:3060] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:48.080554  7789 raft_consensus.cc:493] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.113193  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:48.080129  7845 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:48.116281  3956 raft_consensus.cc:2393] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 9: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:48.117295  4672 leader_election.cc:304] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:48.092296  7810 raft_consensus.cc:3060] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:48.057389  7849 raft_consensus.cc:515] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:48.092092  7752 raft_consensus.cc:2804] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:48.127836  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:48.090471  7867 raft_consensus.cc:493] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:48.132457  3959 raft_consensus.cc:2468] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 12.
I20260709 13:15:48.094406  7893 raft_consensus.cc:493] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
W20260709 13:15:48.222817  3924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:48.141662  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:48.225978  3957 raft_consensus.cc:1240] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:48.116108  7766 raft_consensus.cc:2749] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:48.118367  7845 raft_consensus.cc:3060] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:48.224507  4071 leader_election.cc:304] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:48.228367  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:15:48.222915  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 101318us
I20260709 13:15:48.139518  7871 raft_consensus.cc:2804] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:15:48.232784  7793 consensus_meta.cc:287] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.759s	user 0.016s	sys 0.000s
I20260709 13:15:48.126089  7771 raft_consensus.cc:515] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:48.251597  3959 raft_consensus.cc:2468] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 13.
I20260709 13:15:48.126509  7789 raft_consensus.cc:515] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:48.222170  7752 raft_consensus.cc:697] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 11 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:48.232396  7607 raft_consensus.cc:493] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:48.229031  7414 consensus_queue.cc:1048] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:15:48.243458  7871 raft_consensus.cc:493] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:48.144065  7867 raft_consensus.cc:515] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:48.276916  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:48.262897  7865 raft_consensus.cc:493] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:48.277629  4027 raft_consensus.cc:3060] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:48.264395  7628 raft_consensus.cc:2804] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:48.266510  7871 raft_consensus.cc:3060] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:48.223112  7893 raft_consensus.cc:515] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:48.263233  7607 raft_consensus.cc:515] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:48.275200  7896 log.cc:927] Time spent T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:15:48.292177  4027 raft_consensus.cc:2468] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9.
I20260709 13:15:48.273487  7760 raft_consensus.cc:493] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:48.279354  7628 raft_consensus.cc:493] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:48.320842  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:48.302174  7628 raft_consensus.cc:3060] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:48.282434  7865 raft_consensus.cc:515] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:48.296355  7723 raft_consensus.cc:515] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:48.333592  4074 leader_election.cc:304] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:48.336155  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:48.299901  7760 raft_consensus.cc:515] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:48.328353  7440 leader_election.cc:290] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:48.356462  3925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:48.356992  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:48.328109  7619 raft_consensus.cc:493] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:48.358817  3956 raft_consensus.cc:2393] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 9: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
W20260709 13:15:48.362214  7900 log.cc:927] Time spent T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:15:48.362704  7607 leader_election.cc:290] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:48.333861  7751 raft_consensus.cc:493] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:48.302831  7752 consensus_queue.cc:237] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:48.337484  7849 leader_election.cc:290] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:48.370647  4033 raft_consensus.cc:2393] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 13: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:48.365094  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:48.373977  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:15:48.375954  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 151537us
I20260709 13:15:48.363920  7779 raft_consensus.cc:493] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:48.392354  7909 raft_consensus.cc:2804] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:48.392477  7893 leader_election.cc:290] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:48.392910  7909 raft_consensus.cc:493] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:48.393296  7909 raft_consensus.cc:3060] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:48.394824  7865 leader_election.cc:290] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:48.398653  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:48.399847  4033 raft_consensus.cc:2393] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 11: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
I20260709 13:15:48.378469  7789 leader_election.cc:290] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:48.369171  7619 raft_consensus.cc:515] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:48.381043  7771 leader_election.cc:290] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 12 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:48.403894  7789 raft_consensus.cc:493] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.406867  7789 raft_consensus.cc:515] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:48.410323  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:48.410987  4705 raft_consensus.cc:2468] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 10.
I20260709 13:15:48.418287  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:48.388811  7414 consensus_queue.cc:1048] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:15:48.424808  7414 raft_consensus.cc:493] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:48.424592  7909 raft_consensus.cc:515] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:48.425482  7414 raft_consensus.cc:515] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:48.428520  7909 leader_election.cc:290] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:48.429307  7909 raft_consensus.cc:493] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:48.429889  7909 raft_consensus.cc:515] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:48.431116  7619 leader_election.cc:290] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:48.431775  7619 raft_consensus.cc:493] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:48.432240  7619 raft_consensus.cc:515] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:48.434315  7619 leader_election.cc:290] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:48.434502  7909 leader_election.cc:290] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:48.435860  7771 raft_consensus.cc:493] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:48.436422  7771 raft_consensus.cc:515] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:48.378538  7751 raft_consensus.cc:515] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:48.390494  7779 raft_consensus.cc:515] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:48.473227  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:15:48.476438  4000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:48.476261  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 142860us
I20260709 13:15:48.418262  7789 leader_election.cc:290] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:48.489507  7751 leader_election.cc:290] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:48.492610  4029 raft_consensus.cc:1275] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:15:48.493050  4029 pending_rounds.cc:85] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2: Aborting all ops after (but not including) 7
I20260709 13:15:48.493259  4029 pending_rounds.cc:107] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:15:48.493474  4029 raft_consensus.cc:2889] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:48.511739  7867 leader_election.cc:290] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:15:48.519838  3924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:48.520543  3924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:48.523800  7414 leader_election.cc:290] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:48.525077  7760 leader_election.cc:290] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:48.528285  7800 consensus_meta.cc:287] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.814s	user 0.008s	sys 0.004s
I20260709 13:15:48.528688  7800 raft_consensus.cc:515] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:48.530808  7800 leader_election.cc:290] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:48.538741  7845 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:48.541873  7875 log.cc:927] Time spent T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.713s	user 0.002s	sys 0.002s
I20260709 13:15:48.543013  7789 raft_consensus.cc:493] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:48.543466  7810 raft_consensus.cc:515] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:48.543624  7789 raft_consensus.cc:515] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:48.544768  7723 leader_election.cc:290] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:48.545707  7789 leader_election.cc:290] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:48.546792  7779 leader_election.cc:290] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:15:48.550450  7768 consensus_meta.cc:287] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 0.521s	user 0.011s	sys 0.001s
I20260709 13:15:48.550401  7810 leader_election.cc:290] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:48.522836  7628 raft_consensus.cc:515] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:48.555128  7628 leader_election.cc:290] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 13 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:48.556819  7847 raft_consensus.cc:3055] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:48.557438  7847 raft_consensus.cc:740] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:48.551651  4071 leader_election.cc:304] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:15:48.553133  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 61230.1us
I20260709 13:15:48.474007  7771 leader_election.cc:290] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:48.571717  4074 leader_election.cc:304] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:48.558696  7847 consensus_queue.cc:260] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:15:48.574507  7628 raft_consensus.cc:493] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:48.575151  7628 raft_consensus.cc:515] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:48.575776  7912 raft_consensus.cc:2749] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:48.577495  7628 leader_election.cc:290] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:48.579505  7783 leader_election.cc:290] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:48.568845  7805 raft_consensus.cc:3055] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:48.580202  7805 raft_consensus.cc:740] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:48.581040  7805 consensus_queue.cc:260] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:48.582350  7805 raft_consensus.cc:3060] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:48.584054  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:48.584800  4108 raft_consensus.cc:2468] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 8.
I20260709 13:15:48.551074  7768 raft_consensus.cc:515] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:48.590801  4031 raft_consensus.cc:2393] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 9: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:48.591169  4105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45332 (request call id 2010) took 1251 ms. Trace:
I20260709 13:15:48.591949  7768 leader_election.cc:290] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:48.592536  7768 raft_consensus.cc:493] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:48.593209  7768 raft_consensus.cc:515] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:48.591588  4105 rpcz_store.cc:276] 0709 13:15:47.343830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.344044 (+   214us) service_pool.cc:224] Handling call
0709 13:15:47.344573 (+   529us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:47.375284 (+ 30711us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:47.375321 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:47.382365 (+  7044us) log.cc:844] Serialized 52 byte log entry
0709 13:15:47.656412 (+274047us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:47.835952 (+179540us) log.cc:844] Serialized 14 byte log entry
0709 13:15:47.836331 (+   379us) log.cc:844] Serialized 14 byte log entry
0709 13:15:47.836561 (+   230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:47.836634 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:48.028240 (+191606us) spinlock_profiling.cc:243] Waited 3.29 ms on lock 0x7b480009c0d8. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152a597aa1 00007f152a58eb37 00007f152a58e9ca 00007f152a68626f 00007f152a685f37 00007f152a69a55c 00007f152a69a508 00007f152a69a488 00007f152a69a443 00007f152a6996ec 00007f15295c3a96
0709 13:15:48.363691 (+335451us) spinlock_profiling.cc:243] Waited 3.08 ms on lock 0x7b180044de20. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f1522581522 00007f15225837c1 00007f1522583779 00007f1522583709 00007f15225836d1 00007f15225829cd 000000000038f354 000000000038f199 00007f152256483a
0709 13:15:48.590300 (+226609us) spinlock_profiling.cc:243] Waited 7.13 ms on lock 0x7b24001ff748. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f15224079c4 00007f1522405acb 00007f15225c0dc9 00007f15225c0a55 00007f15225bffb0 00007f1525236488 00007f1525236be8 00007f152520e398 00007f152520976a 00007f1525208bb6
0709 13:15:48.590957 (+   657us) raft_consensus.cc:1685] finished
0709 13:15:48.590979 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:48.591110 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31813,"prepare.queue_time_us":242366,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":95,"raft.queue_time_us":10343,"raft.run_cpu_time_us":4294,"raft.run_wall_time_us":674475,"spinlock_wait_cycles":31032704,"thread_start_us":258725,"threads_started":2,"wal-append.queue_time_us":244125}
I20260709 13:15:48.596428  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:48.606302  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:48.606736  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:48.607487  4026 raft_consensus.cc:2393] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 9: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:48.608557  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:48.609302  4108 raft_consensus.cc:2393] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 7: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:48.609609  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:48.610023  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:48.611205  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:48.611837  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:48.612854  4102 raft_consensus.cc:2393] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 10: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:48.614214  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:48.613538  4105 raft_consensus.cc:1240] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:15:48.614704  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:48.615091  4103 raft_consensus.cc:2468] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 8.
I20260709 13:15:48.616669  4101 raft_consensus.cc:1240] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 LEADER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:15:48.617074  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:48.617800  4103 raft_consensus.cc:2368] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 12. Current term is 13.
I20260709 13:15:48.616514  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:48.618818  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:48.619908  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:48.620005  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:48.620860  3953 raft_consensus.cc:2468] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 9.
I20260709 13:15:48.621101  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:48.610214  3952 raft_consensus.cc:2468] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 10.
I20260709 13:15:48.623849  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:48.624670  4029 raft_consensus.cc:2468] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 10.
I20260709 13:15:48.626103  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:48.626698  4107 raft_consensus.cc:3060] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:48.628764  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:48.629560  4031 raft_consensus.cc:2468] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 11.
I20260709 13:15:48.630167  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:48.630448  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:48.632620  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:48.634027  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:48.632889  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:48.632582  3955 raft_consensus.cc:1275] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:15:48.635928  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:48.636324  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:48.636809  4034 raft_consensus.cc:2393] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 9: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:48.639206  7892 consensus_queue.cc:1048] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
W20260709 13:15:48.646432  7887 consensus_peers.cc:313] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 -> Peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117): Unable to generate Tablet Copy request for peer: Not found: Peer not tracked or queue not in leader mode.
I20260709 13:15:48.647830  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:48.649634  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:48.650446  4031 raft_consensus.cc:2393] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 10: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:48.650439  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:48.651623  4106 raft_consensus.cc:2368] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 12. Current term is 13.
I20260709 13:15:48.650043  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:48.652534  4102 raft_consensus.cc:2393] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 10: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:48.603601  7632 raft_consensus.cc:2804] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:48.658452  4107 raft_consensus.cc:2468] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 9.
I20260709 13:15:48.660509  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:48.661562  3957 raft_consensus.cc:2393] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 11: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:48.662750  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:48.664018  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:48.664770  4027 raft_consensus.cc:3060] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:48.664971  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:48.666039  3951 raft_consensus.cc:2393] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 9: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:48.604688  7768 leader_election.cc:290] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:48.587173  7871 raft_consensus.cc:515] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:48.688077  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:48.669374  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:48.677453  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:48.690464  4029 raft_consensus.cc:2393] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 10: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
W20260709 13:15:48.680789  7792 consensus_meta.cc:287] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.750s	user 0.011s	sys 0.001s
W20260709 13:15:48.683481  7848 consensus_meta.cc:287] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.583s	user 0.012s	sys 0.000s
I20260709 13:15:48.693624  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:15:48.697515  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 57234.7us
I20260709 13:15:48.699362  3958 raft_consensus.cc:2468] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 10.
W20260709 13:15:48.703284  3922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:48.704252  4027 raft_consensus.cc:2468] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 13.
I20260709 13:15:48.708041  4706 raft_consensus.cc:2393] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 10: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
I20260709 13:15:48.703974  3997 leader_election.cc:304] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:48.708218  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:48.708947  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:48.700161  3925 leader_election.cc:304] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:48.713279  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:48.713582  3925 leader_election.cc:304] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:48.663444  7632 raft_consensus.cc:493] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:48.711907  3997 leader_election.cc:304] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:48.710309  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:48.716029  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:48.716971  4705 raft_consensus.cc:2368] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 11. Current term is 12.
I20260709 13:15:48.713003  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:48.717139  4074 leader_election.cc:304] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:48.687567  7771 raft_consensus.cc:493] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:48.720920  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:48.721627  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:48.722012  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:48.722826  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:48.724399  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:48.725479  3997 leader_election.cc:400] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 12 election: Vote denied by peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843) with higher term. Message: Invalid argument: T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 12. Current term is 13.
I20260709 13:15:48.725862  3997 leader_election.cc:403] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:15:48.727197  3959 raft_consensus.cc:2393] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 9: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:48.726615  4074 leader_election.cc:304] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:48.728986  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:48.712999  7759 consensus_queue.cc:1059] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:15:48.733111  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:48.734206  7865 raft_consensus.cc:2749] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843) with higher term. Message: Invalid argument: T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 12. Current term is 13.
I20260709 13:15:48.736471  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:48.734864  7783 raft_consensus.cc:2804] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:48.716728  7810 raft_consensus.cc:2804] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:48.715960  7792 raft_consensus.cc:2804] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:48.716838  7632 raft_consensus.cc:3060] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:48.712916  7912 raft_consensus.cc:493] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:48.729749  7914 raft_consensus.cc:2749] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:48.742401  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:48.735605  4074 leader_election.cc:304] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:48.751150  7800 raft_consensus.cc:2804] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:15:48.730959  7882 raft_consensus.cc:2804] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:48.751497  3951 raft_consensus.cc:2468] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 12.
I20260709 13:15:48.730192  7908 raft_consensus.cc:2804] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:48.765481  3953 raft_consensus.cc:2468] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 10.
I20260709 13:15:48.750268  3959 raft_consensus.cc:2468] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 10.
I20260709 13:15:48.770938  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:48.722350  7779 consensus_queue.cc:1048] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:15:48.791551  3997 leader_election.cc:304] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:48.806488  3997 leader_election.cc:400] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843) with higher term. Message: Invalid argument: T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 12. Current term is 13.
I20260709 13:15:48.809756  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:48.813303  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:48.814291  4107 raft_consensus.cc:2393] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 9: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:48.808636  3997 leader_election.cc:304] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:48.741570  7792 raft_consensus.cc:493] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:48.740782  7810 raft_consensus.cc:493] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:48.820528  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:48.820675  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:48.741218  7783 raft_consensus.cc:493] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
W20260709 13:15:48.753845  7898 log.cc:927] Time spent T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.629s	user 0.000s	sys 0.004s
I20260709 13:15:48.802260  3953 raft_consensus.cc:3060] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:48.752794  7377 raft_consensus.cc:3055] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:48.737713  7809 consensus_queue.cc:1059] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:15:48.831566  7760 raft_consensus.cc:2804] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:48.832185  7810 raft_consensus.cc:3060] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:48.826781  4102 raft_consensus.cc:2468] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 10.
I20260709 13:15:48.832739  4104 raft_consensus.cc:2393] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 9: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:48.833702  7476 raft_consensus.cc:493] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:48.834209  7783 raft_consensus.cc:3060] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:48.835599  7906 raft_consensus.cc:493] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:48.838007  7889 raft_consensus.cc:493] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.839736  7792 raft_consensus.cc:3060] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:48.840251  3922 leader_election.cc:304] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
W20260709 13:15:48.898694  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 58529.4us
I20260709 13:15:48.756349  7845 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 election: Requested vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:48.765028  7912 raft_consensus.cc:515] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:48.777714  7882 raft_consensus.cc:697] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:48.753300  7800 raft_consensus.cc:697] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:48.903438  7800 consensus_queue.cc:237] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:48.905380  4073 leader_election.cc:304] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:48.906755  3999 leader_election.cc:304] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:48.778170  7361 raft_consensus.cc:3060] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:48.728139  7771 raft_consensus.cc:515] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:48.759231  7847 raft_consensus.cc:3060] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:48.770067  7908 raft_consensus.cc:493] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:48.861642  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:48.877099  4071 leader_election.cc:304] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:48.880860  3924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:48.889952  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:48.860792  7779 raft_consensus.cc:493] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:48.862165  7377 raft_consensus.cc:740] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:48.908689  4025 raft_consensus.cc:1275] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:15:48.907913  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:48.971299  7809 raft_consensus.cc:2749] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:48.972599  7867 raft_consensus.cc:493] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.973181  7867 raft_consensus.cc:515] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:48.975360  7912 leader_election.cc:290] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:48.976063  7882 consensus_queue.cc:237] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:48.907564  7760 raft_consensus.cc:697] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:48.914254  3922 leader_election.cc:304] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:48.903439  7871 leader_election.cc:290] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:48.920938  7619 raft_consensus.cc:2804] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:15:49.003113  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 88965.9us
I20260709 13:15:48.909834  7805 raft_consensus.cc:2749] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:48.898928  7906 raft_consensus.cc:515] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:48.955657  7908 raft_consensus.cc:3060] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:15:49.007611  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 130596us
I20260709 13:15:48.908850  3953 raft_consensus.cc:2468] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 13.
I20260709 13:15:48.908423  7889 raft_consensus.cc:515] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:49.015551  3922 leader_election.cc:304] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:15:48.907651  7476 raft_consensus.cc:515] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:48.984508  7867 leader_election.cc:290] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:49.005549  3924 leader_election.cc:304] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
W20260709 13:15:49.036429  3999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 129758us
I20260709 13:15:49.007792  7619 raft_consensus.cc:493] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:49.039460  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:49.009817  7912 raft_consensus.cc:2749] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:49.039703  7933 raft_consensus.cc:493] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.045419  3924 leader_election.cc:304] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:49.068320  3924 leader_election.cc:304] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:49.069947  3924 leader_election.cc:400] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 pre-election: Vote denied by peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117) with higher term. Message: Invalid argument: T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 11. Current term is 12.
I20260709 13:15:49.070276  3924 leader_election.cc:403] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:49.073273  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1851e462889842a49d577d585d278117" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:49.048296  3997 leader_election.cc:304] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:49.049911  4099 raft_consensus.cc:1240] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:15:49.013124  7809 raft_consensus.cc:493] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.008595  7902 raft_consensus.cc:2749] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:49.046418  4071 leader_election.cc:304] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:48.967253  7779 raft_consensus.cc:515] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:49.053759  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:49.151925  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:49.061712  7771 leader_election.cc:290] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:49.063354  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:49.172964  4106 raft_consensus.cc:3060] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:49.064767  7805 raft_consensus.cc:2804] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:49.078198  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:49.179361  4027 raft_consensus.cc:3060] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:49.036201  7414 consensus_queue.cc:1048] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:15:49.033995  7766 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.143392  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:49.141544  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:49.188750  4025 raft_consensus.cc:2468] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 11.
W20260709 13:15:49.149343  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 103016us
I20260709 13:15:49.192049  4071 leader_election.cc:304] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:49.051571  7619 raft_consensus.cc:3060] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:49.061188  7889 leader_election.cc:290] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:49.157294  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:49.174268  4028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38304 (request call id 2422) took 1033 ms. Trace:
I20260709 13:15:49.052677  7867 raft_consensus.cc:2749] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:49.077204  3997 leader_election.cc:304] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:49.073633  7466 raft_consensus.cc:3060] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:49.185272  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:49.073524  7868 raft_consensus.cc:2749] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:49.076663  7894 raft_consensus.cc:3060] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:15:49.004199  7377 consensus_queue.cc:260] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:49.194860  4026 raft_consensus.cc:2393] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 10: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:49.196040  4071 leader_election.cc:304] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:49.172713  7883 raft_consensus.cc:493] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:49.177529  7859 raft_consensus.cc:2749] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:49.203900  4028 rpcz_store.cc:276] 0709 13:15:48.140859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.141477 (+   618us) service_pool.cc:224] Handling call
0709 13:15:48.144830 (+  3353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:48.145115 (+   285us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:48.959750 (+814635us) spinlock_profiling.cc:243] Waited 2.37 ms on lock 0x7b1800485ec0. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f15252164bc 00007f152256448b 00007f152b3beab9 00007f152258069b 00007f152257e93f 00007f152257e455 00007f15290663c7 00007f15256789a7 00007f15256880bf
0709 13:15:48.959965 (+   215us) log.cc:844] Serialized 14 byte log entry
0709 13:15:49.173880 (+213915us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:49.173940 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:49.174000 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.174075 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:49.174204 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":155208,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"spinlock_wait_cycles":5444352,"thread_start_us":299886,"threads_started":2}
I20260709 13:15:49.155836  7912 raft_consensus.cc:493] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:49.177534  7805 raft_consensus.cc:493] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
W20260709 13:15:49.255563  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 59593us
I20260709 13:15:49.263200  4071 leader_election.cc:304] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:49.198527  4027 raft_consensus.cc:2468] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 12.
I20260709 13:15:49.185199  7771 raft_consensus.cc:2749] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:49.172240  7789 raft_consensus.cc:2749] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:49.194684  7800 raft_consensus.cc:493] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:49.158288  7809 raft_consensus.cc:515] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:49.077241  7933 raft_consensus.cc:515] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:49.265684  4071 leader_election.cc:304] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:49.267292  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 91865.4us
I20260709 13:15:49.217727  4104 raft_consensus.cc:2468] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 8.
I20260709 13:15:49.226135  7628 raft_consensus.cc:2749] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:49.298472  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:15:49.265481  7921 log.cc:927] Time spent T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:15:49.215600  7766 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:49.251035  7939 raft_consensus.cc:493] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.205080  7760 consensus_queue.cc:237] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:49.289651  4106 raft_consensus.cc:2468] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 12.
I20260709 13:15:49.266966  7805 raft_consensus.cc:3060] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:49.368813  3959 raft_consensus.cc:2410] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 13:15:49.377600  7632 consensus_meta.cc:287] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.608s	user 0.010s	sys 0.001s
W20260709 13:15:49.399248  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 226667us
W20260709 13:15:49.412017  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 334907us
I20260709 13:15:49.300913  7800 raft_consensus.cc:515] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:49.350703  7789 raft_consensus.cc:2749] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:49.263770  7883 raft_consensus.cc:515] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:49.444933  7939 raft_consensus.cc:515] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:49.368651  7895 log.cc:927] Time spent T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:15:49.416298  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 150501us
I20260709 13:15:49.265148  7912 raft_consensus.cc:515] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:49.369343  7771 raft_consensus.cc:493] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.368587  7932 raft_consensus.cc:493] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.411564  7414 raft_consensus.cc:2749] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:49.465178  7639 consensus_queue.cc:1048] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:15:49.495988  7906 leader_election.cc:290] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:49.448382  4675 leader_election.cc:304] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:49.419139  7338 raft_consensus.cc:2749] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:49.445159  7931 raft_consensus.cc:493] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.497768  7931 raft_consensus.cc:515] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:49.464541  3997 leader_election.cc:304] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:49.498608  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:49.499297  4027 raft_consensus.cc:2468] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9.
I20260709 13:15:49.499939  7906 raft_consensus.cc:2749] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:49.500397  7931 leader_election.cc:290] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:49.501937  3997 leader_election.cc:304] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
W20260709 13:15:49.503170  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 54873.5us
I20260709 13:15:49.478434  7940 raft_consensus.cc:2749] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:15:49.457831  7930 log.cc:927] Time spent T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:15:49.506850  7933 leader_election.cc:290] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:49.509145  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:49.511719  7338 raft_consensus.cc:493] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:49.512287  7338 raft_consensus.cc:515] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:49.514556  7338 leader_election.cc:290] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:49.518967  7771 raft_consensus.cc:515] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:49.521132  7771 leader_election.cc:290] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:49.521818  7936 log.cc:927] Time spent T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.483s	user 0.000s	sys 0.002s
W20260709 13:15:49.523437  7924 log.cc:927] Time spent T 00000000000000000000000000000000 P af4ff34c238b4043994545a7eb56815f: Append to log took a long time: real 0.539s	user 0.002s	sys 0.000s
I20260709 13:15:49.501974  7752 raft_consensus.cc:2749] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:15:49.527104  7925 log.cc:927] Time spent T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.475s	user 0.001s	sys 0.001s
I20260709 13:15:49.527310  7766 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:49.479489  7939 leader_election.cc:290] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:49.530959  7945 raft_consensus.cc:493] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.531508  7809 leader_election.cc:290] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:49.533072  7883 leader_election.cc:290] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:49.534631  3922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:49.480820  7361 consensus_meta.cc:287] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.558s	user 0.009s	sys 0.002s
I20260709 13:15:49.559625  7848 raft_consensus.cc:493] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.560137  7848 raft_consensus.cc:515] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:49.561144  7859 raft_consensus.cc:493] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.466965  4071 leader_election.cc:304] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:49.561655  7859 raft_consensus.cc:515] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:49.562906  7946 raft_consensus.cc:2749] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:49.563697  7722 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
W20260709 13:15:49.563860  7810 consensus_meta.cc:287] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 0.666s	user 0.009s	sys 0.003s
W20260709 13:15:49.564146  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 97319.9us
I20260709 13:15:49.564889  3925 leader_election.cc:304] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:49.504624  7476 leader_election.cc:290] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:49.565485  4071 leader_election.cc:304] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:49.505050  7932 raft_consensus.cc:515] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:49.538836  4108 raft_consensus.cc:1240] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 11. Current term is 12. Ops: []
W20260709 13:15:49.541054  7941 log.cc:927] Time spent T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.094s	user 0.002s	sys 0.000s
I20260709 13:15:49.541373  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:49.576167  4106 raft_consensus.cc:2468] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 11.
I20260709 13:15:49.541661  7940 raft_consensus.cc:2804] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:49.531597  7945 raft_consensus.cc:515] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:49.542590  7927 log.cc:927] Time spent T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.488s	user 0.003s	sys 0.000s
W20260709 13:15:49.541415  7928 log.cc:927] Time spent T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.364s	user 0.000s	sys 0.002s
W20260709 13:15:49.544536  7908 consensus_meta.cc:287] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.507s	user 0.010s	sys 0.000s
I20260709 13:15:49.598337  7908 raft_consensus.cc:515] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:49.545758  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:15:49.552103  7783 consensus_meta.cc:287] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.644s	user 0.011s	sys 0.000s
I20260709 13:15:49.566785  4071 leader_election.cc:304] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:49.568898  3959 raft_consensus.cc:1240] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:49.570173  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:49.576665  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:49.584757  7466 raft_consensus.cc:2749] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:49.602669  3925 leader_election.cc:304] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:15:49.608436  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 68602.4us
I20260709 13:15:49.587958  7932 leader_election.cc:290] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:49.575429  7883 raft_consensus.cc:493] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:49.593348  7889 raft_consensus.cc:2804] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:49.604907  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:49.633693  3959 raft_consensus.cc:2410] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:15:49.605782  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:49.605937  3997 leader_election.cc:304] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:49.605942  3922 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:15:49.606431  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:49.603631  3957 raft_consensus.cc:2468] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 10.
I20260709 13:15:49.609385  4071 leader_election.cc:304] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:49.609937  4032 raft_consensus.cc:1275] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 13 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:15:49.611765  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:49.611971  3950 raft_consensus.cc:1275] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:15:49.607919  7783 raft_consensus.cc:515] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:49.612452  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:49.617023  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:49.567451  7946 raft_consensus.cc:2749] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:15:49.600920  7792 consensus_meta.cc:287] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.684s	user 0.010s	sys 0.001s
I20260709 13:15:49.564582  7810 raft_consensus.cc:515] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:49.449477  7632 raft_consensus.cc:515] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:49.626928  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:49.628288  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:49.623339  7338 raft_consensus.cc:2749] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:49.607945  7940 raft_consensus.cc:697] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:49.630441  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:49.638592  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:49.640094  4071 leader_election.cc:304] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:49.634707  3954 raft_consensus.cc:2468] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 10.
I20260709 13:15:49.564252  7722 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:49.654424  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:49.670606  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 64773.7us
I20260709 13:15:49.659972  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:49.629554  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:49.748898  3956 raft_consensus.cc:2468] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 10.
W20260709 13:15:49.743819  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 103819us
I20260709 13:15:49.684186  4675 leader_election.cc:304] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:49.639035  7889 raft_consensus.cc:493] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:49.763937  7889 raft_consensus.cc:3060] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:49.640416  7883 raft_consensus.cc:515] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:49.768620  3958 raft_consensus.cc:2468] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 10.
I20260709 13:15:49.752157  7619 raft_consensus.cc:515] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:49.666628  7783 leader_election.cc:290] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:49.655896  7810 leader_election.cc:290] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:49.752740  7639 consensus_queue.cc:1059] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:15:49.654171  7792 raft_consensus.cc:515] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:49.773550  7639 raft_consensus.cc:3055] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:15:49.773996  7639 raft_consensus.cc:740] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:49.774552  7619 leader_election.cc:290] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:49.669272  7789 raft_consensus.cc:2804] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:49.642596  7879 raft_consensus.cc:2804] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:49.775454  4102 raft_consensus.cc:2468] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 9.
I20260709 13:15:49.649255  7779 leader_election.cc:290] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:49.776048  7789 raft_consensus.cc:493] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:49.749866  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:49.751323  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:15:49.751941  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 67882.9us
I20260709 13:15:49.822461  3959 raft_consensus.cc:3060] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:49.666282  4103 raft_consensus.cc:2468] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 11.
I20260709 13:15:49.756361  7950 raft_consensus.cc:493] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.757063  7863 raft_consensus.cc:493] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.760749  7825 raft_consensus.cc:2804] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:49.760808  7809 consensus_queue.cc:1059] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:15:49.629148  7951 raft_consensus.cc:493] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:49.654137  7805 raft_consensus.cc:515] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:49.664793  7908 leader_election.cc:290] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:49.690565  4672 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
W20260709 13:15:49.776717  4031 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.064s	sys 0.098s
W20260709 13:15:49.849187  4031 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.064s	sys 0.098s
I20260709 13:15:49.624610  7873 raft_consensus.cc:2804] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:15:49.671180  4099 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.003s	sys 0.024s
I20260709 13:15:49.774920  7639 consensus_queue.cc:260] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:49.648880  7865 raft_consensus.cc:3055] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:49.743395  3952 raft_consensus.cc:2468] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 10.
I20260709 13:15:49.785596  7377 raft_consensus.cc:3060] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:49.849323  7951 raft_consensus.cc:515] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:49.792018  7848 leader_election.cc:290] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:49.792872  7722 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:49.794472  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:15:49.795696  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 44302.4us
I20260709 13:15:49.783113  7883 leader_election.cc:290] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:49.796299  7414 raft_consensus.cc:2804] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:49.799189  7800 leader_election.cc:290] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:15:49.800653  7894 consensus_meta.cc:287] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.549s	user 0.009s	sys 0.002s
I20260709 13:15:49.781906  7632 leader_election.cc:290] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 13 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:49.804144  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:49.808339  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:49.782842  7945 leader_election.cc:290] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:49.813352  7912 leader_election.cc:290] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:49.821331  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:49.777494  3997 leader_election.cc:304] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:49.681617  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86669993fba94e65ba192aa115ed6e88" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:49.823696  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:49.822461  3954 raft_consensus.cc:2468] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 10.
I20260709 13:15:49.643427  7859 leader_election.cc:290] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:49.672789  7932 raft_consensus.cc:2749] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:49.895226  4034 raft_consensus.cc:2468] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 10.
I20260709 13:15:49.847748  3959 raft_consensus.cc:2468] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 8.
I20260709 13:15:49.846419  7950 raft_consensus.cc:515] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:49.775741  7879 raft_consensus.cc:697] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 12 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:49.857208  4071 leader_election.cc:304] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:49.822880  7810 raft_consensus.cc:493] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
W20260709 13:15:49.851255  4099 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.003s	sys 0.024s
W20260709 13:15:49.881114  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 190649us
I20260709 13:15:49.886569  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:49.904942  4700 raft_consensus.cc:3060] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:49.840790  7789 raft_consensus.cc:3060] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:49.895913  4025 raft_consensus.cc:2368] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 7. Current term is 8.
I20260709 13:15:49.911381  3925 leader_election.cc:304] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:49.896539  4030 raft_consensus.cc:2468] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 10.
W20260709 13:15:49.896540  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 119185us
I20260709 13:15:49.855108  7951 leader_election.cc:290] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:49.852454  7865 raft_consensus.cc:740] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
W20260709 13:15:49.906328  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 49236.6us
I20260709 13:15:49.884106  7792 leader_election.cc:290] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:49.913416  3997 leader_election.cc:304] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:49.851447  7873 raft_consensus.cc:493] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:49.873695  7825 raft_consensus.cc:697] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 12 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:49.917657  4071 leader_election.cc:304] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:49.892107  7952 raft_consensus.cc:493] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:49.903563  7894 raft_consensus.cc:2749] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117) with higher term. Message: Invalid argument: T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 11. Current term is 12.
I20260709 13:15:49.921092  3997 leader_election.cc:304] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:49.849023  7863 raft_consensus.cc:515] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:49.923414  3997 leader_election.cc:304] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:49.858116  4705 raft_consensus.cc:2393] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 11: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
I20260709 13:15:49.925364  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:49.928752  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:49.929322  3955 raft_consensus.cc:3060] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:49.930223  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:49.914971  3925 leader_election.cc:400] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Vote denied by peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115) with higher term. Message: Invalid argument: T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 7. Current term is 8.
I20260709 13:15:49.931092  3925 leader_election.cc:403] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:15:49.932175  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:49.934231  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:49.930779  3957 raft_consensus.cc:3060] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:49.935322  3997 leader_election.cc:304] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:49.896024  7414 raft_consensus.cc:493] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:49.912503  7912 raft_consensus.cc:2749] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:49.937513  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:49.939589  3954 raft_consensus.cc:2468] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 10.
I20260709 13:15:49.916240  7809 raft_consensus.cc:2804] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:15:49.963753  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 50824.2us
I20260709 13:15:49.965104  3956 raft_consensus.cc:1275] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 13 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:15:49.960536  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:49.916980  7882 raft_consensus.cc:2804] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:49.966928  3997 leader_election.cc:304] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:49.937731  7859 raft_consensus.cc:2804] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:49.914687  7611 consensus_queue.cc:1059] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:15:49.963793  7792 raft_consensus.cc:2749] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115) with higher term. Message: Invalid argument: T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 7. Current term is 8.
I20260709 13:15:49.980693  3955 raft_consensus.cc:2468] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 11.
I20260709 13:15:49.920111  7890 consensus_queue.cc:1048] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:15:49.938263  7632 raft_consensus.cc:3060] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:49.920068  7932 raft_consensus.cc:2749] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:49.967775  4103 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d4e65893d284960aef32d35d0db30a4"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:15:49.941308  7185 raft_consensus.cc:2804] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:50.013758  4103 raft_consensus.cc:606] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Received request to transfer leadership to TS 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:50.014252  4103 raft_consensus.cc:614] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:49.921569  7873 raft_consensus.cc:3060] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:50.016965  7863 leader_election.cc:290] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:49.969252  7950 leader_election.cc:290] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:49.978200  3953 raft_consensus.cc:2468] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 12.
I20260709 13:15:49.953704  7414 raft_consensus.cc:3060] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:49.912278  7810 raft_consensus.cc:515] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:49.975152  7931 raft_consensus.cc:2804] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:49.972249  7939 raft_consensus.cc:2804] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:49.987123  3958 raft_consensus.cc:2468] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 13.
I20260709 13:15:49.967356  3957 raft_consensus.cc:2468] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 11.
I20260709 13:15:49.999202  4071 leader_election.cc:304] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:49.939191  7952 raft_consensus.cc:515] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:50.036427  7952 leader_election.cc:290] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:50.039954  7931 raft_consensus.cc:493] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.040398  7939 raft_consensus.cc:493] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.040544  7931 raft_consensus.cc:3060] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:50.040920  7939 raft_consensus.cc:3060] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:50.045058  4071 leader_election.cc:304] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:15:50.011773  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 45678.8us
I20260709 13:15:49.976321  7882 raft_consensus.cc:493] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:49.972155  3997 leader_election.cc:304] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:49.975203  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:49.975687  7859 raft_consensus.cc:493] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:49.980242  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 331916us
I20260709 13:15:49.980129  7942 raft_consensus.cc:2804] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:50.054169  7951 consensus_queue.cc:1048] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:15:50.061012  7942 raft_consensus.cc:493] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.061450  7942 raft_consensus.cc:3060] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:50.061947  7956 consensus_queue.cc:1048] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:50.057922  7338 raft_consensus.cc:2804] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:50.058113  4074 leader_election.cc:304] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:50.063088  7338 raft_consensus.cc:697] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:49.916571  7940 consensus_queue.cc:237] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:50.063616  7779 raft_consensus.cc:2749] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:50.064076  7338 consensus_queue.cc:237] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:49.988379  7879 consensus_queue.cc:237] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:50.073397  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:50.047987  4071 leader_election.cc:304] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:50.071162  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:50.074249  4101 raft_consensus.cc:2468] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 11.
I20260709 13:15:50.043345  7945 raft_consensus.cc:493] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.078788  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:50.081250  4105 raft_consensus.cc:2468] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9.
I20260709 13:15:50.080323  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:50.069614  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 97531us
I20260709 13:15:50.083840  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:50.054934  7882 raft_consensus.cc:3060] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:50.085085  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:50.056404  7912 raft_consensus.cc:2804] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:50.070176  7859 raft_consensus.cc:3060] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:50.099885  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:50.100752  4102 raft_consensus.cc:2393] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 8: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:50.085783  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:50.074783  7914 raft_consensus.cc:2804] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:50.071628  7805 leader_election.cc:290] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 election: Requested vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:50.091871  7945 raft_consensus.cc:515] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:15:50.113236  7945 leader_election.cc:290] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:50.117280  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:50.120167  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:50.120941  4033 raft_consensus.cc:2393] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 9: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:50.122315  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:50.125799  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:50.129810  4101 raft_consensus.cc:1275] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:15:50.133188  7914 raft_consensus.cc:697] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:50.132930  7942 raft_consensus.cc:515] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:50.134279  7914 consensus_queue.cc:237] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:50.135999  7760 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.012s	sys 0.040s
I20260709 13:15:50.080821  7946 raft_consensus.cc:2804] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:15:50.136849  7946 raft_consensus.cc:697] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:50.138072  7946 consensus_queue.cc:237] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:50.140118  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:50.140960  4025 raft_consensus.cc:2393] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 13: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:50.131227  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:50.148563  4700 raft_consensus.cc:2468] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 11.
I20260709 13:15:50.011852  7865 consensus_queue.cc:260] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:50.157119  4100 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "f1c75790cedf4f52a3463a255c7da059"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:15:50.157759  4100 raft_consensus.cc:606] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Received request to transfer leadership to TS f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:50.158218  4100 raft_consensus.cc:614] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:50.154536  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:50.155808  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:50.159523  4106 raft_consensus.cc:2393] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 7: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:50.160960  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:50.162278  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:50.163336  4032 raft_consensus.cc:2368] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 10. Current term is 11.
I20260709 13:15:50.103597  3957 raft_consensus.cc:2468] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 13.
I20260709 13:15:50.091506  7912 raft_consensus.cc:493] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:50.023775  7825 consensus_queue.cc:237] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:50.172966  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:50.182801  4100 raft_consensus.cc:2468] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 9.
I20260709 13:15:50.185359  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:50.187079  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:50.188779  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:50.156013  7760 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.012s	sys 0.040s
I20260709 13:15:50.168345  7931 raft_consensus.cc:515] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:50.176020  7639 raft_consensus.cc:3060] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:50.177613  7961 raft_consensus.cc:493] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:50.178200  4031 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da"
dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
mode: GRACEFUL
new_leader_uuid: "f1c75790cedf4f52a3463a255c7da059"
 from {username='slave'} at 127.0.0.1:44232
I20260709 13:15:50.180068  7789 raft_consensus.cc:515] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:50.208618  4031 raft_consensus.cc:606] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Received request to transfer leadership to TS f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:50.211074  4031 raft_consensus.cc:614] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:50.210963  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:50.210047  3922 leader_election.cc:304] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:50.211740  4106 raft_consensus.cc:3060] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:50.173571  7912 raft_consensus.cc:3060] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:50.213894  3922 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:15:50.216216  7931 leader_election.cc:290] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:50.216419  7789 leader_election.cc:290] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:50.216933  7961 raft_consensus.cc:515] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:50.218778  3953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35354 (request call id 490) took 1062 ms. Trace:
I20260709 13:15:50.230268  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:50.230329  3953 rpcz_store.cc:276] 0709 13:15:49.156251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.156954 (+   703us) service_pool.cc:224] Handling call
0709 13:15:50.218570 (+1061616us) spinlock_profiling.cc:243] Waited 765 ms on lock 0x7b54001694d4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f15256722fa 00007f152a633b17 00007f1523bae6d4 00007f1523bae662 00007f1523bae591 00007f1523bae50c 00007f1523bad7c2 00007f15239a948c 00007f15239a88c6 00007f15239a826f
0709 13:15:50.218705 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1759071488}
I20260709 13:15:50.220623  7859 raft_consensus.cc:515] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:50.223692  7792 raft_consensus.cc:2749] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:50.225133  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:50.229509  4074 leader_election.cc:304] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:50.236997  4033 raft_consensus.cc:2468] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 11.
I20260709 13:15:50.173787  7889 raft_consensus.cc:515] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:50.243690  7414 raft_consensus.cc:515] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:50.244951  4034 raft_consensus.cc:2368] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 10. Current term is 11.
I20260709 13:15:50.245893  7859 leader_election.cc:290] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:50.246258  7809 raft_consensus.cc:493] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.246771  4108 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "f1c75790cedf4f52a3463a255c7da059"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:15:50.253876  7961 leader_election.cc:290] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:50.271502  7954 raft_consensus.cc:2749] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:50.271519  7809 raft_consensus.cc:3060] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:50.273974  7889 leader_election.cc:290] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:50.273912  3925 leader_election.cc:304] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:50.275857  3959 raft_consensus.cc:2368] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 11. Current term is 12.
I20260709 13:15:50.276577  4074 leader_election.cc:400] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Vote denied by peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115) with higher term. Message: Invalid argument: T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 10. Current term is 11.
I20260709 13:15:50.276908  4074 leader_election.cc:403] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:50.277179  4106 raft_consensus.cc:2468] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 8.
I20260709 13:15:50.277617  4074 leader_election.cc:304] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:50.306280  7414 leader_election.cc:290] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:50.308952  7185 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.309705  7185 raft_consensus.cc:3060] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:50.312563  7942 leader_election.cc:290] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:50.315948  7810 leader_election.cc:290] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:50.316826  7847 raft_consensus.cc:2804] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:50.317294  7847 raft_consensus.cc:493] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.317642  7847 raft_consensus.cc:3060] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:50.318552  7939 raft_consensus.cc:515] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:50.323755  7789 raft_consensus.cc:2804] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:50.324365  7789 raft_consensus.cc:697] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:50.325331  7789 consensus_queue.cc:237] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:50.327705  3997 leader_election.cc:304] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:50.315392  7964 log.cc:927] Time spent T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:15:50.236691  7887 raft_consensus.cc:2804] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:50.257555  3922 leader_election.cc:304] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:50.270610  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:50.336150  4030 raft_consensus.cc:2368] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 10. Current term is 11.
W20260709 13:15:50.341284  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 44236.5us
I20260709 13:15:50.254707  7632 raft_consensus.cc:2749] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:50.344324  3997 leader_election.cc:304] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:50.345429  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:50.356062  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:50.381182  4032 raft_consensus.cc:3060] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:50.349170  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:50.382138  3997 leader_election.cc:304] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:50.386361  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 128910us
I20260709 13:15:50.387636  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:50.388342  4107 raft_consensus.cc:3060] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:50.327698  7954 raft_consensus.cc:3060] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:15:50.393117  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:50.391561  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:50.394433  4028 raft_consensus.cc:2368] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 10. Current term is 11.
I20260709 13:15:50.394516  3997 leader_election.cc:304] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:50.381388  7887 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:50.462203  4074 leader_election.cc:400] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 election: Vote denied by peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115) with higher term. Message: Invalid argument: T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 10. Current term is 11.
I20260709 13:15:50.439216  3846 maintenance_manager.cc:419] P af4ff34c238b4043994545a7eb56815f: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033373
I20260709 13:15:50.479934  7887 raft_consensus.cc:3060] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:50.479990  4074 leader_election.cc:403] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:15:50.417299  7760 raft_consensus.cc:493] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:50.437222  4032 raft_consensus.cc:2468] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 12.
I20260709 13:15:50.394541  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:50.417062  7878 raft_consensus.cc:2749] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:50.389318  7940 raft_consensus.cc:2749] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:50.389487  7942 raft_consensus.cc:2749] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:50.361058  7957 raft_consensus.cc:2749] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:50.489547  4029 raft_consensus.cc:2468] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 10.
I20260709 13:15:50.395195  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:50.491297  4071 leader_election.cc:304] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
W20260709 13:15:50.493997  3998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:50.481964  7760 raft_consensus.cc:515] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:50.495755  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 101349us
I20260709 13:15:50.489002  4107 raft_consensus.cc:2468] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 11.
I20260709 13:15:50.496766  4108 raft_consensus.cc:606] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 LEADER]: Received request to transfer leadership to TS f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:50.498965  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 247003us
I20260709 13:15:50.507845  4074 leader_election.cc:400] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 election: Vote denied by peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115) with higher term. Message: Invalid argument: T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 10. Current term is 11.
I20260709 13:15:50.509642  4074 leader_election.cc:403] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:15:50.506309  7414 raft_consensus.cc:2749] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115) with higher term. Message: Invalid argument: T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 10. Current term is 11.
I20260709 13:15:50.508369  7942 raft_consensus.cc:2804] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:50.527983  3997 leader_election.cc:304] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:50.506476  7908 raft_consensus.cc:2804] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:50.537971  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:50.518769  7632 raft_consensus.cc:3060] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:50.519428  7942 raft_consensus.cc:493] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:50.541694  7873 consensus_meta.cc:287] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.526s	user 0.012s	sys 0.000s
I20260709 13:15:50.534950  7859 raft_consensus.cc:2804] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:50.541867  7908 raft_consensus.cc:697] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
W20260709 13:15:50.573973  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 186917us
I20260709 13:15:50.549291  7942 raft_consensus.cc:3060] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:50.575901  3922 leader_election.cc:304] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:50.578184  7889 raft_consensus.cc:3060] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:50.580047  7908 consensus_queue.cc:237] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:50.580469  7466 consensus_queue.cc:1048] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:50.587265  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:50.573048  7859 raft_consensus.cc:697] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:50.585399  7628 raft_consensus.cc:493] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:50.566540  7873 raft_consensus.cc:515] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:50.623441  7968 log.cc:927] Time spent T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
W20260709 13:15:50.645545  7967 log.cc:927] Time spent T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:15:50.645097  7865 raft_consensus.cc:3060] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:50.654198  7970 log.cc:927] Time spent T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:15:50.651149  7882 consensus_meta.cc:287] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.548s	user 0.012s	sys 0.000s
W20260709 13:15:50.667187  7974 log.cc:927] Time spent T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:15:50.672899  7942 raft_consensus.cc:515] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:50.675402  7942 leader_election.cc:290] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 14 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:50.677415  7939 leader_election.cc:290] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:50.716741  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 204603us
I20260709 13:15:50.721810  3950 raft_consensus.cc:2368] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 9. Current term is 10.
W20260709 13:15:50.589237  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 191768us
I20260709 13:15:50.725276  3925 leader_election.cc:304] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:50.766933  7760 leader_election.cc:290] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:50.767787  7883 raft_consensus.cc:493] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:50.769086  7883 raft_consensus.cc:515] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:50.661957  7882 raft_consensus.cc:515] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:50.780542  7947 raft_consensus.cc:493] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.781674  7947 raft_consensus.cc:515] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:50.784384  3954 raft_consensus.cc:2368] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 10. Current term is 11.
W20260709 13:15:50.789971  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 65257.8us
I20260709 13:15:50.621763  7628 raft_consensus.cc:515] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:50.800825  3925 leader_election.cc:304] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:50.803580  7939 raft_consensus.cc:493] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.803815  7980 raft_consensus.cc:493] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:50.804971  7980 raft_consensus.cc:515] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:50.804839  7939 raft_consensus.cc:515] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:50.651026  7859 consensus_queue.cc:237] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:50.655017  7873 leader_election.cc:290] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:50.818765  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:50.819856  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:50.821048  3958 raft_consensus.cc:3060] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:50.820992  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
W20260709 13:15:50.823869  7912 consensus_meta.cc:287] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.592s	user 0.011s	sys 0.002s
I20260709 13:15:50.824400  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:50.825371  3951 raft_consensus.cc:2393] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 11: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:50.819967  3953 raft_consensus.cc:3060] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:50.829849  7951 raft_consensus.cc:493] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:50.830480  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:50.830865  7951 raft_consensus.cc:515] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:50.834106  7951 leader_election.cc:290] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:50.835008  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:50.837955  7945 raft_consensus.cc:2804] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:50.838822  7945 raft_consensus.cc:697] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 12 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:50.839032  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:50.840253  7945 consensus_queue.cc:237] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:50.842593  4071 leader_election.cc:400] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 election: Vote denied by peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339) with higher term. Message: Invalid argument: T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 11. Current term is 12.
W20260709 13:15:50.843820  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 52447.3us
I20260709 13:15:50.844949  3925 leader_election.cc:304] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:50.846242  7990 raft_consensus.cc:2804] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:50.846753  7990 raft_consensus.cc:493] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.831528  3950 raft_consensus.cc:3060] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:50.847198  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:50.847499  7990 raft_consensus.cc:3060] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:50.837910  4101 raft_consensus.cc:1275] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:15:50.852041  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:50.853276  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:50.854224  4705 raft_consensus.cc:2468] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 7.
I20260709 13:15:50.824698  7912 raft_consensus.cc:515] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:50.783529  7882 leader_election.cc:290] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:50.864722  7939 leader_election.cc:290] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:50.865599  7883 leader_election.cc:290] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:15:50.871161  7809 consensus_meta.cc:287] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 0.597s	user 0.012s	sys 0.004s
I20260709 13:15:50.872166  4100 raft_consensus.cc:2468] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 10.
I20260709 13:15:50.871696  7628 leader_election.cc:290] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:15:50.873013  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 357497us
I20260709 13:15:50.873507  7912 leader_election.cc:290] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:50.899443  7980 leader_election.cc:290] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:50.876022  3999 leader_election.cc:304] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:50.883221  7942 consensus_queue.cc:1048] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:50.901574  7939 raft_consensus.cc:2804] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:50.902076  7939 raft_consensus.cc:493] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:50.902521  7939 raft_consensus.cc:3060] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:50.883749  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:50.884202  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:50.885848  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:50.906906  3955 raft_consensus.cc:2393] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 7: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
W20260709 13:15:50.894524  7991 log.cc:927] Time spent T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:15:50.909708  3997 leader_election.cc:304] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:50.911211  7914 raft_consensus.cc:2749] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:50.911890  7947 leader_election.cc:290] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:15:50.898415  7954 consensus_meta.cc:287] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Time spent flushing consensus metadata: real 0.501s	user 0.010s	sys 0.006s
W20260709 13:15:50.900398  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 58303.4us
I20260709 13:15:50.930063  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:50.934056  3957 raft_consensus.cc:3060] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:50.933048  3950 raft_consensus.cc:2468] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 11.
I20260709 13:15:50.947571  7954 raft_consensus.cc:2749] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115) with higher term. Message: Invalid argument: T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 10. Current term is 11.
I20260709 13:15:50.956002  4071 leader_election.cc:400] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Vote denied by peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339) with higher term. Message: Invalid argument: T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 10. Current term is 11.
I20260709 13:15:50.957595  4071 leader_election.cc:400] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Vote denied by peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339) with higher term. Message: Invalid argument: T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 9. Current term is 10.
I20260709 13:15:50.957906  4071 leader_election.cc:403] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:50.959329  7632 raft_consensus.cc:2749] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115) with higher term. Message: Invalid argument: T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 10. Current term is 11.
I20260709 13:15:50.964149  7887 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:50.965991  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:50.966922  7887 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 election: Requested vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:50.922910  7873 raft_consensus.cc:2749] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:50.980173  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:50.981614  4705 raft_consensus.cc:2368] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 10. Current term is 11.
I20260709 13:15:50.988384  7954 raft_consensus.cc:3060] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:15:50.994931  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
W20260709 13:15:50.997506  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 54810.7us
I20260709 13:15:51.000490  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:51.001441  3955 raft_consensus.cc:2468] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 12.
I20260709 13:15:51.002538  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:50.993399  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:51.009001  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:50.919471  7990 raft_consensus.cc:515] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:15:51.013139  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
W20260709 13:15:51.016026  7994 log.cc:927] Time spent T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:15:51.017081  4108 raft_consensus.cc:1240] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 LEADER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:51.023881  7990 leader_election.cc:290] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:51.025310  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:51.026415  3924 leader_election.cc:400] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 election: Vote denied by peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117) with higher term. Message: Invalid argument: T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 10. Current term is 11.
I20260709 13:15:51.026942  3924 leader_election.cc:403] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:15:51.040686  3950 raft_consensus.cc:1240] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Rejecting Update request from peer 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:50.927798  7809 raft_consensus.cc:515] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:51.013213  3952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38606 (request call id 2209) took 1088 ms. Trace:
I20260709 13:15:51.050884  3958 raft_consensus.cc:2468] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 11.
I20260709 13:15:51.043426  3959 raft_consensus.cc:2468] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 7.
I20260709 13:15:51.057268  4672 leader_election.cc:304] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:51.060976  3953 raft_consensus.cc:2468] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 11.
I20260709 13:15:51.064465  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:51.066375  7639 raft_consensus.cc:2804] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:51.066548  4025 raft_consensus.cc:1275] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:15:51.066936  7639 raft_consensus.cc:493] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:51.067382  7639 raft_consensus.cc:3060] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:51.068464  4033 raft_consensus.cc:1240] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 14 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:51.051270  3952 rpcz_store.cc:276] 0709 13:15:49.924221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.926971 (+  2750us) service_pool.cc:224] Handling call
0709 13:15:49.938571 (+ 11600us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:49.975130 (+ 36559us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:50.480213 (+505083us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b1800340840. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f1522563e07 00007f152b3beab9 00007f152258069b 00007f152257e93f 00007f152257e455 00007f15290663c7 00007f15256789a7 00007f15256880bf 00007f1525688038
0709 13:15:50.720292 (+240079us) log.cc:844] Serialized 14 byte log entry
0709 13:15:50.921471 (+201179us) log.cc:844] Serialized 14 byte log entry
0709 13:15:50.921718 (+   247us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:50.922332 (+   614us) log.cc:844] Serialized 26 byte log entry
0709 13:15:50.922481 (+   149us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:50.922519 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.012649 (+ 90130us) spinlock_profiling.cc:243] Waited 36.2 ms on lock 0x7b5400218ed4. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566ee01 00007f152566d83e 00007f152a632419 00007f1523ba9bd4 00007f1523ba9b62 00007f1523ba9a91 00007f1523ba9a0c 00007f1523ba8cc2 00007f15239a948c 00007f15239a88c6
0709 13:15:51.012720 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:51.012777 (+    57us) raft_consensus.cc:1685] finished
0709 13:15:51.012791 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:51.012977 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40017,"prepare.queue_time_us":268978,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":88,"raft.queue_time_us":51390,"raft.run_cpu_time_us":446,"raft.run_wall_time_us":3117,"spinlock_wait_cycles":120914048,"thread_start_us":278332,"threads_started":2,"wal-append.queue_time_us":115676}
I20260709 13:15:51.074956  4107 raft_consensus.cc:2468] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 11.
I20260709 13:15:51.080107  3954 raft_consensus.cc:1275] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:15:51.084266  7847 consensus_meta.cc:287] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.766s	user 0.014s	sys 0.005s
I20260709 13:15:51.085625  4107 raft_consensus.cc:1275] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:15:51.087890  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:51.089385  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:51.091617  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
W20260709 13:15:51.093473  7185 consensus_meta.cc:287] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938: Time spent flushing consensus metadata: real 0.783s	user 0.018s	sys 0.005s
I20260709 13:15:51.052265  7990 raft_consensus.cc:2749] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117) with higher term. Message: Invalid argument: T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 10. Current term is 11.
I20260709 13:15:51.102003  4102 raft_consensus.cc:3060] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:51.102245  3957 raft_consensus.cc:2468] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 14.
I20260709 13:15:51.105522  3955 raft_consensus.cc:1240] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 14 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 13. Current term is 14. Ops: []
W20260709 13:15:51.103333  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 56438.5us
I20260709 13:15:51.110991  4031 raft_consensus.cc:2368] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 10. Current term is 11.
I20260709 13:15:51.112192  7809 leader_election.cc:290] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:51.112941  7948 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:51.113299  7889 consensus_meta.cc:287] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059: Time spent flushing consensus metadata: real 0.535s	user 0.013s	sys 0.011s
I20260709 13:15:51.113852  7889 raft_consensus.cc:2749] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:51.113584  7948 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:51.130451  3997 leader_election.cc:304] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:51.135907  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:51.105619  7847 raft_consensus.cc:515] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:51.138672  4103 raft_consensus.cc:2468] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 11.
I20260709 13:15:51.143023  3951 raft_consensus.cc:2368] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 10. Current term is 11.
I20260709 13:15:51.147171  3997 leader_election.cc:304] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: d709ee666b774ec29aa732e508219938
I20260709 13:15:51.148370  7865 raft_consensus.cc:2804] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:51.148974  7865 raft_consensus.cc:697] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:51.149061  3997 leader_election.cc:304] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:51.150290  7865 consensus_queue.cc:237] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:51.152302  7946 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.152887  7946 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:51.154392  2843 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:15:51.154729  7908 raft_consensus.cc:493] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:51.155385  7908 raft_consensus.cc:515] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:51.158269  7908 leader_election.cc:290] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:51.158994  7954 raft_consensus.cc:2749] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339) with higher term. Message: Invalid argument: T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 9. Current term is 10.
I20260709 13:15:51.159422  7948 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:51.160018  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:51.161171  4073 leader_election.cc:304] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:51.129789  7973 consensus_queue.cc:1048] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:15:51.139431  4025 raft_consensus.cc:2368] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 10. Current term is 11.
I20260709 13:15:51.167024  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:51.202399  3951 raft_consensus.cc:2368] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 10. Current term is 11.
I20260709 13:15:51.170055  4101 raft_consensus.cc:2468] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 10.
I20260709 13:15:51.180411  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:51.165341  7632 raft_consensus.cc:2749] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:51.206940  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:51.207829  4034 raft_consensus.cc:2393] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 11: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:51.182529  7760 raft_consensus.cc:2804] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:51.209177  7760 raft_consensus.cc:493] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:51.209619  7760 raft_consensus.cc:3060] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:51.164727  7946 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:51.182847  7859 consensus_queue.cc:1059] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:15:51.163533  7639 raft_consensus.cc:515] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:51.212739  7859 raft_consensus.cc:3055] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:51.213138  7859 raft_consensus.cc:740] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:51.214169  7639 leader_election.cc:290] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 8 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:51.214084  7859 consensus_queue.cc:260] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:51.183207  7809 raft_consensus.cc:2804] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:51.216279  7809 raft_consensus.cc:697] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:51.109108  7185 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:51.217342  7809 consensus_queue.cc:237] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:51.219278  7185 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:51.220139  4707 raft_consensus.cc:2368] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 11. Current term is 12.
I20260709 13:15:51.186021  3997 leader_election.cc:304] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:51.192131  4071 leader_election.cc:400] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Vote denied by peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339) with higher term. Message: Invalid argument: T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 10. Current term is 11.
I20260709 13:15:51.225477  4071 leader_election.cc:403] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:51.226392  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:51.227077  4709 raft_consensus.cc:1275] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:15:51.227473  4709 pending_rounds.cc:85] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938: Aborting all ops after (but not including) 9
I20260709 13:15:51.192394  7942 raft_consensus.cc:493] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:51.227795  4709 pending_rounds.cc:107] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:15:51.228148  4709 raft_consensus.cc:2889] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:51.196887  7847 leader_election.cc:290] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:51.227303  4028 raft_consensus.cc:3060] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:51.199528  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:51.230114  4700 raft_consensus.cc:2468] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 12.
I20260709 13:15:51.178503  7759 consensus_queue.cc:1048] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:15:51.189550  7939 raft_consensus.cc:515] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:51.232561  4026 raft_consensus.cc:2468] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 7.
I20260709 13:15:51.232793  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:51.233371  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:51.233522  4099 raft_consensus.cc:2468] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 12.
I20260709 13:15:51.234015  3956 raft_consensus.cc:3060] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:51.228173  7942 raft_consensus.cc:515] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:51.235141  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:51.236243  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:51.236640  4672 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:51.236846  3958 raft_consensus.cc:3060] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:51.169950  4102 raft_consensus.cc:2468] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 11.
I20260709 13:15:51.196661  2843 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:51.240267  4073 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:51.241103  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:51.199506  4105 raft_consensus.cc:2468] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 11.
I20260709 13:15:51.215440  7859 raft_consensus.cc:3060] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:51.257085  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:15:51.259685  3853 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52104 (request call id 204) took 14307 ms (client timeout 15000 ms). Trace:
W20260709 13:15:51.268251  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 76373.7us
I20260709 13:15:51.276746  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:51.275754  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:51.234265  7939 leader_election.cc:290] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:51.277627  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:51.245738  7632 raft_consensus.cc:2804] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:51.288883  3951 raft_consensus.cc:1240] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 12 LEADER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:51.289914  4700 raft_consensus.cc:2368] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 7. Current term is 8.
I20260709 13:15:51.265012  7759 raft_consensus.cc:2804] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:51.302388  3958 raft_consensus.cc:2468] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 12.
I20260709 13:15:51.282040  7946 raft_consensus.cc:3060] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:15:51.303826  4709 raft_consensus.cc:1275] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:15:51.304642  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 118734us
I20260709 13:15:51.288587  7632 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:51.313714  7957 raft_consensus.cc:2804] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:51.314697  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:51.316593  4030 raft_consensus.cc:3060] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:51.293340  7759 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:51.260187  3853 rpcz_store.cc:269] 0709 13:15:36.952152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.953077 (+   925us) service_pool.cc:224] Handling call
0709 13:15:51.259349 (+14306272us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:48.143590 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:48.295513 (+151923us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:48.297209 (+  1696us) write_op.cc:435] Acquired schema lock
0709 13:15:48.298049 (+   840us) tablet.cc:662] Decoding operations
0709 13:15:48.604265 (+306216us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:48.636464 (+ 32199us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:48.639452 (+  2988us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:15:48.682482 (+ 43030us) tablet.cc:701] Row locks acquired
0709 13:15:48.682503 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:15:48.682654 (+   151us) write_op.cc:270] Start()
0709 13:15:48.682780 (+   126us) write_op.cc:276] Timestamp: P: 1783602948682607 usec, L: 0
0709 13:15:48.682802 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:15:48.759841 (+ 77039us) log.cc:844] Serialized 8326 byte log entry
0709 13:15:49.595291 (+835450us) spinlock_profiling.cc:243] Waited 1.08 ms on lock 0x7b180032a100. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f1522581522 00007f15225837c1 00007f1522583779 00007f1522583709 00007f15225836d1 00007f15225829cd 000000000038f354 000000000038f199 00007f152256483a
0709 13:15:50.208054 (+612763us) op_driver.cc:464] REPLICATION: finished
0709 13:15:50.575950 (+367896us) write_op.cc:301] APPLY: starting
0709 13:15:50.586018 (+ 10068us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:50.654631 (+ 68613us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:50.654656 (+    25us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:50.670824 (+ 16168us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:50.671289 (+   465us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=42
0709 13:15:50.671363 (+    74us) write_op.cc:312] APPLY: finished
0709 13:15:50.671963 (+   600us) log.cc:844] Serialized 145 byte log entry
0709 13:15:50.673006 (+  1043us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:50.673291 (+   285us) write_op.cc:454] Released schema lock
0709 13:15:50.673393 (+   102us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:50.676782 (+  3389us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:50.676835 (+    53us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1698737,"reported_tablets":43,"child_traces":[["op",{"apply.queue_time_us":338257,"apply.run_cpu_time_us":7950,"apply.run_wall_time_us":108469,"num_ops":21,"prepare.queue_time_us":85455,"prepare.run_cpu_time_us":48328,"prepare.run_wall_time_us":768372,"raft.queue_time_us":582204,"raft.run_cpu_time_us":15084,"raft.run_wall_time_us":347637,"replication_time_us":1486737,"spinlock_wait_cycles":2477312,"thread_start_us":823732,"threads_started":4,"wal-append.queue_time_us":147778}]]}
I20260709 13:15:51.310395  7632 raft_consensus.cc:3060] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:51.333657  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:51.319818  7759 raft_consensus.cc:3060] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:51.339991  4071 leader_election.cc:400] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 election: Vote denied by peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339) with higher term. Message: Invalid argument: T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 10. Current term is 11.
I20260709 13:15:51.340498  4071 leader_election.cc:403] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:15:51.320070  7957 raft_consensus.cc:697] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 14 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:51.307650  7951 consensus_queue.cc:1059] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:15:51.352420  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:51.345634  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:51.357257  4031 raft_consensus.cc:2393] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 11: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:51.364099  4074 leader_election.cc:400] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Vote denied by peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115) with higher term. Message: Invalid argument: T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 10. Current term is 11.
W20260709 13:15:51.377465  7999 log.cc:927] Time spent T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:15:51.379417  3922 leader_election.cc:304] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:51.381486  7942 leader_election.cc:290] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:51.384223  3855 catalog_manager.cc:5697] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:51.386140  3855 catalog_manager.cc:5697] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 7 to 8, leader changed from 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 8 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:51.392352  3999 leader_election.cc:400] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 election: Vote denied by peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117) with higher term. Message: Invalid argument: T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 7. Current term is 8.
I20260709 13:15:51.392755  3999 leader_election.cc:403] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 13:15:51.394213  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 54466.3us
I20260709 13:15:51.399072  3956 raft_consensus.cc:2468] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 8.
I20260709 13:15:51.399072  4028 raft_consensus.cc:2468] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 10.
I20260709 13:15:51.390762  7957 consensus_queue.cc:237] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:51.420423  4030 raft_consensus.cc:2468] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 11.
W20260709 13:15:51.419766  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 124534us
I20260709 13:15:51.338156  7805 consensus_queue.cc:1048] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.128s
I20260709 13:15:51.412923  7942 raft_consensus.cc:3060] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:51.450145  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:51.428566  7883 raft_consensus.cc:2804] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:51.463406  3951 raft_consensus.cc:2393] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 in current term 11: Already voted for candidate f1c75790cedf4f52a3463a255c7da059 in this term.
I20260709 13:15:51.468354  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:51.469399  3958 raft_consensus.cc:2368] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 7. Current term is 8.
I20260709 13:15:51.467453  3922 leader_election.cc:304] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:51.477726  3925 leader_election.cc:304] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:51.487532  3950 raft_consensus.cc:1275] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:15:51.484447  7883 raft_consensus.cc:697] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 10 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:51.503794  3997 leader_election.cc:304] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:51.507242  7805 raft_consensus.cc:2804] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:51.507587  7414 raft_consensus.cc:3060] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:51.507905  7805 raft_consensus.cc:697] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 11 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:51.509105  7805 consensus_queue.cc:237] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:15:51.515614  7338 consensus_queue.cc:1048] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 13:15:51.517359  7338 raft_consensus.cc:493] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:51.517967  7338 raft_consensus.cc:515] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:51.524128  7883 consensus_queue.cc:237] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:51.528661  7939 raft_consensus.cc:2804] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:51.536782  3855 catalog_manager.cc:5697] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 1 to 9, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 9 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:51.548614  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:51.501873  7847 raft_consensus.cc:2749] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:15:51.536134  7760 raft_consensus.cc:515] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:51.580574  4030 raft_consensus.cc:1240] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:51.583266  7760 leader_election.cc:290] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 13 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:51.584867  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:51.561765  3855 catalog_manager.cc:5697] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 4 to 9, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 9 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:51.592712  7414 raft_consensus.cc:2749] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339) with higher term. Message: Invalid argument: T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 10. Current term is 11.
I20260709 13:15:51.602530  7759 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:51.607841  7338 leader_election.cc:290] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:51.577483  7632 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:51.611622  7632 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 13 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:51.615876  7946 raft_consensus.cc:2749] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339) with higher term. Message: Invalid argument: T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 10. Current term is 11.
I20260709 13:15:51.618611  7759 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:51.615613  3855 catalog_manager.cc:5697] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 6 to 8, leader changed from 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 8 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:51.636853  3855 catalog_manager.cc:5697] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 7 to 8, leader changed from 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 8 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:51.650403  4101 raft_consensus.cc:2468] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 11.
I20260709 13:15:51.663961  3855 catalog_manager.cc:5697] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 3 to 9, leader changed from d709ee666b774ec29aa732e508219938 (127.2.198.196) to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 9 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:51.702946  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
W20260709 13:15:51.711953  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 285426us
I20260709 13:15:51.712162  4028 raft_consensus.cc:1240] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 13 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:15:51.704700  7865 raft_consensus.cc:493] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.805850  4031 raft_consensus.cc:1275] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:15:51.810154  4672 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:51.806550  4031 pending_rounds.cc:85] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2: Aborting all ops after (but not including) 6
I20260709 13:15:51.824270  4031 pending_rounds.cc:107] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:15:51.824649  4031 raft_consensus.cc:2889] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:51.842039  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:51.837872  3855 catalog_manager.cc:5697] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 2 to 10, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 10 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:51.848657  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:51.849531  4705 raft_consensus.cc:2393] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in current term 13: Already voted for candidate d709ee666b774ec29aa732e508219938 in this term.
I20260709 13:15:51.851325  4074 leader_election.cc:400] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Vote denied by peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115) with higher term. Message: Invalid argument: T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 10. Current term is 11.
I20260709 13:15:51.757807  7908 consensus_queue.cc:1059] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.125s
W20260709 13:15:51.856102  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 378479us
I20260709 13:15:51.825666  7865 raft_consensus.cc:515] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:51.862886  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 383077us
I20260709 13:15:51.868877  3925 leader_election.cc:304] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:51.885979  3855 catalog_manager.cc:5697] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 3 to 6, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to d709ee666b774ec29aa732e508219938 (127.2.198.196). New cstate: current_term: 6 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:15:51.892284  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:51.898459  4100 raft_consensus.cc:2393] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d709ee666b774ec29aa732e508219938 in current term 13: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:51.865828  7951 raft_consensus.cc:493] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.887230  7939 raft_consensus.cc:697] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:51.903205  3924 leader_election.cc:400] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 election: Vote denied by peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117) with higher term. Message: Invalid argument: T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 11. Current term is 12.
W20260709 13:15:51.891266  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 81260.1us
I20260709 13:15:51.909832  3924 leader_election.cc:403] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:15:51.913431  7951 raft_consensus.cc:515] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:51.915693  7982 raft_consensus.cc:2804] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:51.916337  7982 raft_consensus.cc:697] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 12 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:51.917445  7982 consensus_queue.cc:237] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:51.922185  8022 raft_consensus.cc:493] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:51.922441  7954 raft_consensus.cc:3055] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:51.922912  7954 raft_consensus.cc:740] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:51.922986  8022 raft_consensus.cc:515] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:51.927156  8010 log.cc:927] Time spent T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:15:51.928522  8008 log.cc:927] Time spent T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:15:51.915740  7865 leader_election.cc:290] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:51.933902  7954 consensus_queue.cc:260] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:51.935587  7954 raft_consensus.cc:3060] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:51.940085  7951 leader_election.cc:290] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:51.942631  7948 consensus_queue.cc:1059] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:15:51.945648  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 58457.8us
I20260709 13:15:51.946648  4074 leader_election.cc:304] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:51.949383  7987 raft_consensus.cc:2749] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:51.949769  7986 raft_consensus.cc:3055] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:15:51.950237  7986 raft_consensus.cc:740] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:51.951447  4074 leader_election.cc:400] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 election: Vote denied by peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115) with higher term. Message: Invalid argument: T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 10. Current term is 11.
I20260709 13:15:51.952402  4074 leader_election.cc:304] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:51.954421  4672 leader_election.cc:304] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:15:51.964421  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 497048us
I20260709 13:15:51.957561  3855 catalog_manager.cc:5697] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:51.955930  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 66274.4us
I20260709 13:15:51.978966  3997 leader_election.cc:400] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 7 election: Vote denied by peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339) with higher term. Message: Invalid argument: T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 7. Current term is 8.
I20260709 13:15:51.980394  3997 leader_election.cc:304] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:51.985601  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:51.986562  4025 raft_consensus.cc:2410] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:15:51.949431  7338 raft_consensus.cc:2749] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:51.965339  7908 raft_consensus.cc:2749] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:52.003697  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83b18c9e8b401c95ac6e2c0a420316" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:15:52.010095  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 98389.1us
W20260709 13:15:52.017467  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 114414us
I20260709 13:15:52.021451  3925 leader_election.cc:304] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:51.986373  7946 consensus_queue.cc:1059] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:15:51.951223  7986 consensus_queue.cc:260] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:52.040246  3959 raft_consensus.cc:1275] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:15:52.051266  4100 raft_consensus.cc:1275] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:15:52.056164  3959 raft_consensus.cc:1275] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:15:52.057144  3951 raft_consensus.cc:1275] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:15:52.028676  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:52.044046  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:52.026477  7990 raft_consensus.cc:2749] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117) with higher term. Message: Invalid argument: T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for earlier term 11. Current term is 12.
I20260709 13:15:52.042694  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:52.050359  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:52.041064  3955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:52.036744  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:52.049780  4102 raft_consensus.cc:1275] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:15:52.064585  3955 raft_consensus.cc:2468] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 8.
I20260709 13:15:52.020570  7809 raft_consensus.cc:2749] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:15:52.045284  3855 catalog_manager.cc:5697] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 8 to 9, leader changed from 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 9 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:52.071643  4100 raft_consensus.cc:1240] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:15:52.072515  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:52.062292  7942 consensus_meta.cc:287] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2: Time spent flushing consensus metadata: real 0.607s	user 0.012s	sys 0.002s
I20260709 13:15:52.027756  7987 raft_consensus.cc:2749] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:52.038318  8022 leader_election.cc:290] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:52.022840  8021 raft_consensus.cc:493] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:52.037190  8009 raft_consensus.cc:2804] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:52.085817  4101 raft_consensus.cc:1275] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:15:52.096086  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:52.082719  4099 raft_consensus.cc:2468] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 8.
I20260709 13:15:52.092470  3953 raft_consensus.cc:1240] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 14 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:15:52.099830  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:52.083726  7986 raft_consensus.cc:3060] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:52.100718  3957 raft_consensus.cc:2410] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8952c48a6f3a43968f7d77f7bfc4d1bc for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:15:52.090215  7942 raft_consensus.cc:2749] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117) with higher term. Message: Invalid argument: T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 7. Current term is 8.
I20260709 13:15:52.037367  8016 consensus_queue.cc:1048] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.107s
I20260709 13:15:52.037616  8015 consensus_queue.cc:1048] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 13:15:52.053085  8020 consensus_queue.cc:1048] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 13:15:52.119992  4071 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:52.037799  7939 consensus_queue.cc:237] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:52.106555  8009 raft_consensus.cc:697] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 8 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:52.114117  3855 catalog_manager.cc:5697] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 4 to 5, leader changed from 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 5 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:52.142298  3855 catalog_manager.cc:5697] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 3 to 5, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 5 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:52.111747  8021 raft_consensus.cc:515] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:52.130474  7951 consensus_queue.cc:1059] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:15:52.155117  3855 catalog_manager.cc:5697] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 4 to 9, leader changed from 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 9 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:52.155505  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:52.148562  7628 raft_consensus.cc:2749] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:15:52.172040  4103 raft_consensus.cc:3055] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:15:52.178452  4103 raft_consensus.cc:740] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:52.174854  4030 raft_consensus.cc:2468] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 8.
I20260709 13:15:52.181514  7800 raft_consensus.cc:493] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:52.197407  3997 leader_election.cc:304] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:52.197149  8022 consensus_queue.cc:1048] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:15:52.201149  8022 raft_consensus.cc:2804] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:15:52.202548  4673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.202641  8012 consensus_queue.cc:1048] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 13:15:52.177736  7951 consensus_queue.cc:1243] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer f1c75790cedf4f52a3463a255c7da059 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:15:52.205693  7760 consensus_queue.cc:1048] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
W20260709 13:15:52.205112  8027 log.cc:927] Time spent T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:15:52.208537  8022 raft_consensus.cc:493] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.208855  7800 raft_consensus.cc:515] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:52.210234  8009 consensus_queue.cc:237] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:52.197599  7859 consensus_queue.cc:1048] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:15:52.236799  4707 raft_consensus.cc:1240] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 13 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
W20260709 13:15:52.235129  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 149219us
I20260709 13:15:52.237746  7800 leader_election.cc:290] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:52.238656  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:52.242249  8021 leader_election.cc:290] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:52.231591  8022 raft_consensus.cc:3060] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:52.253998  8015 raft_consensus.cc:493] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.254773  8015 raft_consensus.cc:515] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:52.257544  8015 leader_election.cc:290] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:52.258905  8015 raft_consensus.cc:493] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.259474  8015 raft_consensus.cc:515] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:52.260052  7805 consensus_queue.cc:1059] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:52.261072  7805 raft_consensus.cc:3055] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:15:52.261451  7805 raft_consensus.cc:740] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:52.261651  8015 leader_election.cc:290] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:52.262323  7805 consensus_queue.cc:260] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:52.263800  7805 raft_consensus.cc:3060] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:52.281585  4074 leader_election.cc:304] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:52.283209  7800 raft_consensus.cc:2749] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:52.285629  4074 leader_election.cc:304] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:52.287897  4107 raft_consensus.cc:1275] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 14 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:15:52.288308  4107 pending_rounds.cc:85] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Aborting all ops after (but not including) 7
I20260709 13:15:52.288575  4107 pending_rounds.cc:107] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:15:52.288836  4107 raft_consensus.cc:2889] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:52.292259  4029 raft_consensus.cc:1275] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:15:52.292603  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:52.293344  4032 raft_consensus.cc:2468] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 11.
I20260709 13:15:52.296032  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:52.296762  7878 consensus_queue.cc:1048] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:52.297469  8021 raft_consensus.cc:2749] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:52.299630  3925 leader_election.cc:304] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:52.326102  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:15:52.322101  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 49412.7us
W20260709 13:15:52.327237  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 258566us
I20260709 13:15:52.353019  3922 leader_election.cc:304] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:52.365082  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:52.328912  7878 raft_consensus.cc:2804] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:52.375033  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c2da89f37f4113a8811c6e081da953" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:52.375957  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:52.329324  7942 consensus_queue.cc:1048] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:15:52.370222  7878 raft_consensus.cc:493] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.402478  4074 leader_election.cc:304] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:52.394824  4103 consensus_queue.cc:260] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:52.371876  7889 raft_consensus.cc:2804] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:52.393714  7878 raft_consensus.cc:3060] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:52.421375  4103 raft_consensus.cc:3060] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:52.420656  8017 raft_consensus.cc:2749] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:15:52.477006  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 55987.6us
I20260709 13:15:52.484876  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:52.490671  4105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:52.489678  4672 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:52.492733  4105 raft_consensus.cc:1275] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:15:52.493296  3997 leader_election.cc:304] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:52.494647  8009 raft_consensus.cc:2749] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:15:52.495183  7942 raft_consensus.cc:2749] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:15:52.495973  7942 consensus_queue.cc:1048] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:15:52.497372  3924 consensus_peers.cc:597] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 -> Peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117): Couldn't send request to peer d709ee666b774ec29aa732e508219938. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 65333bcc8c2a4b1a9f6f35670cefe7d0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:52.494980  7859 consensus_queue.cc:1048] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:52.510833  4032 raft_consensus.cc:1275] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:15:52.511381  8022 raft_consensus.cc:515] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:52.513684  8022 leader_election.cc:290] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:52.494868  3997 leader_election.cc:304] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:52.516543  4103 raft_consensus.cc:1275] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:15:52.486119  7889 raft_consensus.cc:697] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 11 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
W20260709 13:15:52.520267  8041 log.cc:927] Time spent T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.080s	user 0.004s	sys 0.000s
I20260709 13:15:52.524873  3950 raft_consensus.cc:1275] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:15:52.525522  3953 raft_consensus.cc:1275] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 14 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:15:52.525911  3955 raft_consensus.cc:1275] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:15:52.530522  4103 pending_rounds.cc:85] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc: Aborting all ops after (but not including) 6
I20260709 13:15:52.535746  3922 leader_election.cc:304] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:52.538739  3997 leader_election.cc:304] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:52.542101  4103 pending_rounds.cc:107] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:15:52.542559  4103 raft_consensus.cc:2889] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:52.542737  4100 raft_consensus.cc:1275] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:15:52.541935  7957 raft_consensus.cc:2749] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:52.565913  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:52.566917  4103 raft_consensus.cc:3060] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:52.552821  8022 raft_consensus.cc:2749] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:52.619751  4100 raft_consensus.cc:3060] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:52.550441  8019 consensus_queue.cc:1048] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:15:52.631407  4103 raft_consensus.cc:2468] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 9.
I20260709 13:15:52.646534  7889 consensus_queue.cc:237] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:52.694267  4073 leader_election.cc:304] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:52.700013  8020 raft_consensus.cc:493] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:52.693361  7990 raft_consensus.cc:493] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:52.700620  8020 raft_consensus.cc:515] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:52.701256  7990 raft_consensus.cc:515] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:15:52.703935  8047 log.cc:927] Time spent T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:15:52.703810  7990 leader_election.cc:290] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:52.709672  7632 raft_consensus.cc:2749] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:52.710988  7847 raft_consensus.cc:493] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.711524  7847 raft_consensus.cc:515] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:52.723073  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:52.723896  4709 raft_consensus.cc:2468] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 13.
I20260709 13:15:52.726639  3924 leader_election.cc:304] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:52.728869  7887 raft_consensus.cc:2804] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:52.729283  7887 raft_consensus.cc:493] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:52.729665  7887 raft_consensus.cc:3060] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:52.757156  4100 raft_consensus.cc:1275] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:15:52.783098  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:52.784307  4029 raft_consensus.cc:2393] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 13: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:52.786785  4032 raft_consensus.cc:1275] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:15:52.797640  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 236606us
I20260709 13:15:52.794453  8020 leader_election.cc:290] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:52.798930  4025 raft_consensus.cc:1275] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:15:52.799248  7859 raft_consensus.cc:493] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:52.799888  7859 raft_consensus.cc:515] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:52.801179  7182 consensus_queue.cc:1048] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:52.802099  7859 leader_election.cc:290] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:52.759392  7878 raft_consensus.cc:515] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:52.805063  7878 leader_election.cc:290] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:52.805785  3957 raft_consensus.cc:1240] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:15:52.809227  7954 consensus_queue.cc:1059] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:52.759842  8017 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.810132  7954 raft_consensus.cc:3055] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:15:52.810526  7954 raft_consensus.cc:740] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:52.810789  7948 consensus_queue.cc:1048] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:52.810571  8017 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:52.811684  7954 consensus_queue.cc:260] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:52.813728  7954 raft_consensus.cc:3060] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:52.815191  8017 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:52.817953  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:52.819015  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:52.831220  3957 raft_consensus.cc:2468] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 12.
I20260709 13:15:52.825501  8057 consensus_queue.cc:1048] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:52.826123  7847 leader_election.cc:290] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:52.840600  4071 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:52.828604  4106 raft_consensus.cc:1275] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:15:52.831838  4107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:52.842280  4107 raft_consensus.cc:2468] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 12.
I20260709 13:15:52.833199  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:52.836226  3997 leader_election.cc:304] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:52.856005  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:15:52.860280  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 61872.6us
I20260709 13:15:52.838899  7887 raft_consensus.cc:515] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:52.863807  7887 leader_election.cc:290] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 13 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:52.864005  7908 raft_consensus.cc:2804] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:52.864514  7908 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.864856  7908 raft_consensus.cc:3060] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:52.869349  8037 consensus_queue.cc:1048] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:52.884572  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
W20260709 13:15:52.887105  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 50961.9us
I20260709 13:15:52.893469  8019 consensus_queue.cc:1048] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:52.894948  8025 consensus_queue.cc:1048] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:52.921705  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:52.924888  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:52.929111  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:52.936793  8011 raft_consensus.cc:493] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:52.937475  8011 raft_consensus.cc:515] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:52.941982  7986 consensus_queue.cc:1048] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:52.943065  8038 raft_consensus.cc:2749] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:52.945400  3997 leader_election.cc:304] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:15:52.936623  7865 consensus_queue.cc:1048] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:52.948437  7942 raft_consensus.cc:2804] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:52.948853  7942 raft_consensus.cc:493] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:52.949241  7942 raft_consensus.cc:3060] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:52.905777  8020 raft_consensus.cc:2804] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:52.959193  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:52.939337  7805 raft_consensus.cc:493] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.966070  3957 raft_consensus.cc:1275] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:15:52.961946  8038 raft_consensus.cc:493] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:53.002410  8038 raft_consensus.cc:515] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:52.969722  8011 leader_election.cc:290] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:52.971601  7805 raft_consensus.cc:515] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:53.012980  4707 raft_consensus.cc:2468] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 13.
I20260709 13:15:52.988615  8067 ts_tablet_manager.cc:933] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938: Initiating tablet copy from peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339)
I20260709 13:15:53.025837  3924 leader_election.cc:304] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:52.984400  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:52.962670  7760 consensus_queue.cc:1048] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:15:52.975311  8020 raft_consensus.cc:697] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:53.033308  4033 raft_consensus.cc:2393] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 13: Already voted for candidate 6f5b5e4ed72944ecbda200012d141dc2 in this term.
I20260709 13:15:52.962980  8022 consensus_queue.cc:1048] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:15:52.978994  7889 raft_consensus.cc:493] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:15:53.058868  4106 raft_consensus.cc:2410] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:15:53.033869  8019 raft_consensus.cc:2804] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:15:53.072333  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:53.077701  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:53.065158  7805 leader_election.cc:290] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:53.108693  4074 leader_election.cc:304] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:53.111266  8012 raft_consensus.cc:2749] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:53.115985  8020 consensus_queue.cc:237] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:53.084009  8019 raft_consensus.cc:697] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 13 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:53.062549  7889 raft_consensus.cc:515] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:53.120786  8019 consensus_queue.cc:237] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:53.122099  7889 leader_election.cc:290] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:53.141079  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 56794.1us
I20260709 13:15:53.141103  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:53.148404  3953 raft_consensus.cc:3060] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:53.155236  3951 raft_consensus.cc:1275] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:15:53.157087  4029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:53.141979  7942 raft_consensus.cc:515] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:53.190147  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:53.191890  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:53.194603  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:53.197345  3953 raft_consensus.cc:2468] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 9.
I20260709 13:15:53.199700  7182 consensus_queue.cc:1048] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:53.207760  7987 raft_consensus.cc:493] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.208369  7987 raft_consensus.cc:515] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:53.210620  7987 leader_election.cc:290] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:53.224515  3922 leader_election.cc:304] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:53.226940  3922 leader_election.cc:304] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:53.228165  8037 raft_consensus.cc:2749] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:15:53.240736  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:15:53.247680  8075 log.cc:927] Time spent T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.144s	user 0.003s	sys 0.002s
W20260709 13:15:53.251799  8050 log.cc:927] Time spent T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:15:53.183151  8038 leader_election.cc:290] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:15:53.242771  8041 log.cc:927] Time spent T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:15:53.185460  8067 tablet_copy_client.cc:323] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938: tablet copy: Beginning tablet copy session from remote peer at address 127.2.198.193:35339
I20260709 13:15:53.267558  4032 raft_consensus.cc:1240] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 13 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:53.330799  4029 raft_consensus.cc:1275] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:15:53.334079  3997 leader_election.cc:304] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:53.337335  7865 raft_consensus.cc:2749] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:53.315802  7987 raft_consensus.cc:2749] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:53.356262  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:53.357811  7942 leader_election.cc:290] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 13 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:53.335450  8022 consensus_queue.cc:1048] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
W20260709 13:15:53.362314  8070 log.cc:927] Time spent T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.180s	user 0.002s	sys 0.000s
I20260709 13:15:53.352280  7908 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:53.394043  7908 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 13 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:53.394958  4100 raft_consensus.cc:1240] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 FOLLOWER]: Rejecting Update request from peer d709ee666b774ec29aa732e508219938 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:15:53.399780  7883 raft_consensus.cc:2955] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 11 LEADER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
W20260709 13:15:53.410650  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 57097.2us
W20260709 13:15:53.409488  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 212267us
I20260709 13:15:53.410562  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:53.414145  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:15:53.415688  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 215388us
I20260709 13:15:53.437429  4071 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:53.449275  8011 raft_consensus.cc:2749] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:15:53.440717  8077 consensus_queue.cc:1059] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:15:53.421404  8015 consensus_queue.cc:1048] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:15:53.476200  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:53.478610  4102 raft_consensus.cc:3060] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:53.479557  7871 consensus_queue.cc:1059] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:15:53.499815  8015 raft_consensus.cc:3055] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:15:53.500401  8015 raft_consensus.cc:740] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:53.505336  4102 raft_consensus.cc:2468] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 13.
I20260709 13:15:53.514263  4102 raft_consensus.cc:1240] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:15:53.514899  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:53.506178  8015 consensus_queue.cc:260] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:53.512205  4032 raft_consensus.cc:2955] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:15:53.543207  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:53.546895  7883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:35344 (request call id 15) took 6691 ms. Trace:
I20260709 13:15:53.547065  3968 tablet_copy_service.cc:140] P f1c75790cedf4f52a3463a255c7da059: Received BeginTabletCopySession request for tablet 65333bcc8c2a4b1a9f6f35670cefe7d0 from peer d709ee666b774ec29aa732e508219938 ({username='slave'} at 127.0.0.1:35354)
I20260709 13:15:53.547840  3968 tablet_copy_service.cc:161] P f1c75790cedf4f52a3463a255c7da059: Beginning new tablet copy session on tablet 65333bcc8c2a4b1a9f6f35670cefe7d0 from peer d709ee666b774ec29aa732e508219938 at {username='slave'} at 127.0.0.1:35354: session id = d709ee666b774ec29aa732e508219938-65333bcc8c2a4b1a9f6f35670cefe7d0
I20260709 13:15:53.550516  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:53.556762  4106 raft_consensus.cc:1275] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:15:53.540361  8015 raft_consensus.cc:3060] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:53.564893  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:53.658090  8084 log.cc:927] Time spent T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.134s	user 0.000s	sys 0.003s
I20260709 13:15:53.649662  7987 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:53.660656  8081 log.cc:927] Time spent T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:15:53.661891  7987 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:53.547557  7883 rpcz_store.cc:276] 0709 13:15:46.855210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:46.855422 (+   212us) service_pool.cc:224] Handling call
0709 13:15:46.875764 (+ 20342us) log.cc:844] Serialized 506 byte log entry
0709 13:15:47.179116 (+303352us) spinlock_profiling.cc:243] Waited 31.2 ms on lock 0x7b180041ffe0. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f15224fbc0a 00007f152bc3b219 00007f1522583a40 00007f152257e4e4 00007f152257e455 00007f15255c7b0b 00007f152564cb63 00007f1525674752 00007f152a634d29
0709 13:15:53.542288 (+6363172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24377,"raft.queue_time_us":46346,"raft.run_cpu_time_us":2243,"raft.run_wall_time_us":2249,"spinlock_wait_cycles":71699328,"thread_start_us":262531,"threads_started":1,"wal-append.queue_time_us":368365,"wal-append.run_cpu_time_us":3482,"wal-append.run_wall_time_us":1436148}
I20260709 13:15:53.656615  4103 raft_consensus.cc:2955] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:15:53.702881  3968 tablet_copy_source_session.cc:215] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:53.703852  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:53.706430  4101 raft_consensus.cc:2468] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 13.
I20260709 13:15:53.712391  8067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65333bcc8c2a4b1a9f6f35670cefe7d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:53.713352  3997 leader_election.cc:304] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:53.716759  7939 raft_consensus.cc:2804] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:15:53.717319  7939 raft_consensus.cc:697] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 13 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:53.718286  7939 consensus_queue.cc:237] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:53.734925  3922 leader_election.cc:304] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:53.738162  3955 raft_consensus.cc:1275] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:15:53.756892  3922 leader_election.cc:304] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:53.760672  3922 leader_election.cc:304] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
W20260709 13:15:53.779763  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 45895.9us
I20260709 13:15:53.782797  3922 leader_election.cc:304] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:15:53.810873  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:53.812085  4705 raft_consensus.cc:2468] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 13.
I20260709 13:15:53.821213  7889 consensus_queue.cc:1048] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:53.772511  8077 raft_consensus.cc:2749] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:53.834789  3924 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:53.787048  8057 raft_consensus.cc:2749] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:15:53.843102  3923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.835641  7889 raft_consensus.cc:2749] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:53.788334  7987 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:53.848093  4103 raft_consensus.cc:1275] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:15:53.849768  8072 consensus_queue.cc:1048] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:53.881599  4029 raft_consensus.cc:1275] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 13 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:15:53.883365  3856 catalog_manager.cc:5697] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:53.888296  4705 raft_consensus.cc:1275] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 13 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:15:53.888433  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 100093us
I20260709 13:15:53.888372  8009 raft_consensus.cc:3055] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:15:53.890244  8009 raft_consensus.cc:740] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:53.891127  8009 consensus_queue.cc:260] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:53.858708  7847 raft_consensus.cc:2804] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:15:53.921275  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 138610us
I20260709 13:15:53.906401  7847 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.926610  7847 raft_consensus.cc:3060] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:53.937922  3856 catalog_manager.cc:5697] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:53.941484  3856 catalog_manager.cc:5697] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:53.943236  3856 catalog_manager.cc:5697] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:53.945101  3856 catalog_manager.cc:5697] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 reported cstate change: term changed from 7 to 10, leader changed from d709ee666b774ec29aa732e508219938 (127.2.198.196) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 10 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:15:53.946851  3856 catalog_manager.cc:5697] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 reported cstate change: term changed from 8 to 10, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to d709ee666b774ec29aa732e508219938 (127.2.198.196). New cstate: current_term: 10 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:53.955291  3856 catalog_manager.cc:5697] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 reported cstate change: term changed from 9 to 10, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to d709ee666b774ec29aa732e508219938 (127.2.198.196). New cstate: current_term: 10 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:53.969406  8009 raft_consensus.cc:3060] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:53.983446  3856 catalog_manager.cc:5697] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:15:53.987255  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 82096.3us
I20260709 13:15:53.987198  7883 raft_consensus.cc:2749] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:15:53.992022  3855 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52092 (request call id 207) took 19501 ms (client timeout 15000 ms). Trace:
I20260709 13:15:53.993249  3856 catalog_manager.cc:5697] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:53.998605  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:53.983947  7889 consensus_queue.cc:1048] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:15:54.004806  3856 catalog_manager.cc:5697] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 reported cstate change: term changed from 5 to 6, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 6 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:15:54.021270  7987 consensus_queue.cc:1048] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:54.032663  8071 consensus_queue.cc:1048] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:15:53.992486  3855 rpcz_store.cc:269] 0709 13:15:34.556476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.567608 (+ 11132us) service_pool.cc:224] Handling call
0709 13:15:53.985768 (+19418160us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:52.651154 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:52.712354 (+ 61200us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:52.712412 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:15:52.712425 (+    13us) tablet.cc:662] Decoding operations
0709 13:15:52.713910 (+  1485us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:52.713989 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:52.714023 (+    34us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:15:52.715286 (+  1263us) tablet.cc:701] Row locks acquired
0709 13:15:52.715348 (+    62us) write_op.cc:260] PREPARE: finished
0709 13:15:52.715535 (+   187us) write_op.cc:270] Start()
0709 13:15:52.715728 (+   193us) write_op.cc:276] Timestamp: P: 1783602952715475 usec, L: 0
0709 13:15:52.715749 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:15:52.716503 (+   754us) log.cc:844] Serialized 5566 byte log entry
0709 13:15:53.266654 (+550151us) op_driver.cc:464] REPLICATION: finished
0709 13:15:53.377629 (+110975us) write_op.cc:301] APPLY: starting
0709 13:15:53.377757 (+   128us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:53.378837 (+  1080us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:53.378960 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:53.392631 (+ 13671us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:53.393090 (+   459us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=28
0709 13:15:53.393148 (+    58us) write_op.cc:312] APPLY: finished
0709 13:15:53.393637 (+   489us) log.cc:844] Serialized 101 byte log entry
0709 13:15:53.393866 (+   229us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:53.394050 (+   184us) write_op.cc:454] Released schema lock
0709 13:15:53.394140 (+    90us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:53.394649 (+   509us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:53.394681 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1279411,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":73525,"apply.run_cpu_time_us":5240,"apply.run_wall_time_us":16989,"num_ops":14,"prepare.queue_time_us":360605,"prepare.run_cpu_time_us":36571,"prepare.run_wall_time_us":217139,"raft.queue_time_us":123747,"raft.run_cpu_time_us":5093,"raft.run_wall_time_us":118447,"replication_time_us":516498,"thread_start_us":449131,"threads_started":4,"wal-append.queue_time_us":177201}]]}
I20260709 13:15:54.030568  3856 catalog_manager.cc:5697] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:54.061681  3856 catalog_manager.cc:5697] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 reported cstate change: term changed from 6 to 8, leader changed from d709ee666b774ec29aa732e508219938 (127.2.198.196) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 8 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:15:54.058473  7908 raft_consensus.cc:493] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.063838  7908 raft_consensus.cc:515] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:54.064026  3856 catalog_manager.cc:5697] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 reported cstate change: term changed from 3 to 6, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to d709ee666b774ec29aa732e508219938 (127.2.198.196). New cstate: current_term: 6 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:54.066196  7908 leader_election.cc:290] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:15:54.067764  8105 log.cc:927] Time spent T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:15:54.073165  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:54.060873  7847 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:54.076685  7847 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 14 election: Requested vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:54.085767  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:54.086447  4103 raft_consensus.cc:3060] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:54.089502  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:54.090236  4707 raft_consensus.cc:3060] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:54.091732  3956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:54.092532  3956 raft_consensus.cc:2468] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 12.
I20260709 13:15:54.101886  4071 leader_election.cc:304] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:54.103381  8017 raft_consensus.cc:2804] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:54.103940  8017 raft_consensus.cc:493] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:54.104384  8017 raft_consensus.cc:3060] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:54.115522  4103 raft_consensus.cc:2468] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 14.
I20260709 13:15:54.117529  4707 raft_consensus.cc:2468] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 14.
I20260709 13:15:54.124454  3924 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:54.125715  4106 raft_consensus.cc:1275] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:15:54.168802  3856 catalog_manager.cc:5697] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 reported cstate change: term changed from 6 to 7, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to d709ee666b774ec29aa732e508219938 (127.2.198.196). New cstate: current_term: 7 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:54.138092  8037 raft_consensus.cc:2804] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:54.185364  3856 catalog_manager.cc:5697] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 reported cstate change: term changed from 1 to 7, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to d709ee666b774ec29aa732e508219938 (127.2.198.196). New cstate: current_term: 7 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:54.186734  3856 catalog_manager.cc:5697] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 reported cstate change: term changed from 5 to 7, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to d709ee666b774ec29aa732e508219938 (127.2.198.196). New cstate: current_term: 7 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:54.182888  8037 raft_consensus.cc:697] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 14 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:54.148526  7859 consensus_queue.cc:1048] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:15:54.213519  8067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:57680 (request call id 756) took 1329 ms. Trace:
I20260709 13:15:54.214032  8067 rpcz_store.cc:276] 0709 13:15:52.906305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:52.924369 (+ 18064us) service_pool.cc:224] Handling call
0709 13:15:53.028316 (+103947us) ts_tablet_manager.cc:934] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938: Initiating tablet copy from peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339)
0709 13:15:53.710684 (+682368us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:15:53.990620 (+279936us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:53.994083 (+  3463us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:15:54.212564 (+218481us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:15:54.212956 (+   392us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:54.213343 (+   387us) ts_tablet_manager.cc:989] Replica registered.
0709 13:15:54.213407 (+    64us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":90380,"tablet-copy.queue_time_us":52315,"thread_start_us":114722,"threads_started":2}
I20260709 13:15:54.215296  8067 tablet_copy_client.cc:806] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:54.220916  8037 consensus_queue.cc:237] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:54.200290  4101 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:15:54.242645  4101 raft_consensus.cc:606] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Received request to transfer leadership to TS 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:54.243090  4101 raft_consensus.cc:614] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:54.243947  3957 raft_consensus.cc:1275] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 13 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:15:54.257485  8067 tablet_copy_client.cc:670] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:54.295842  4101 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "604474f002cb41eb9125fc14353547d2"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:15:54.298454  4101 raft_consensus.cc:606] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 LEADER]: Received request to transfer leadership to TS 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:54.257411  7939 consensus_queue.cc:1048] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
W20260709 13:15:54.343179  8108 log.cc:927] Time spent T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:15:54.332729  8107 log.cc:927] Time spent T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:15:54.352053  4101 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:15:54.352725  4101 raft_consensus.cc:606] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Received request to transfer leadership to TS 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:54.353480  4101 raft_consensus.cc:614] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:54.379283  4101 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b2556690d2041edb61d331163aced7d"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:15:54.380066  4101 raft_consensus.cc:606] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Received request to transfer leadership to TS 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:54.380417  4101 raft_consensus.cc:614] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:54.383883  3957 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714"
dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
mode: GRACEFUL
new_leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:35222
I20260709 13:15:54.353658  8020 raft_consensus.cc:493] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:15:54.384981  8020 raft_consensus.cc:515] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:54.384469  3957 raft_consensus.cc:606] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 13 LEADER]: Received request to transfer leadership to TS 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:54.387501  8020 leader_election.cc:290] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:54.402316  4101 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:15:54.432514  4101 raft_consensus.cc:606] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Received request to transfer leadership to TS 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:54.432934  4101 raft_consensus.cc:614] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:54.434620  2843 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:15:54.436636  2843 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:54.420197  8017 raft_consensus.cc:515] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:54.440815  3957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:54.444643  3957 raft_consensus.cc:3060] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:15:54.444723  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 192023us
I20260709 13:15:54.458016  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:54.459959  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:54.449667  8067 tablet_copy_client.cc:538] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:54.463367  4106 raft_consensus.cc:2368] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 12. Current term is 13.
I20260709 13:15:54.529990  3957 raft_consensus.cc:2468] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 13.
W20260709 13:15:54.528609  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 50568.7us
I20260709 13:15:54.533941  3997 leader_election.cc:400] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843) with higher term. Message: Invalid argument: T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 12. Current term is 13.
I20260709 13:15:54.534281  3997 leader_election.cc:403] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:54.537058  8069 raft_consensus.cc:3060] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:15:54.548805  4071 leader_election.cc:304] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:54.564764  8083 raft_consensus.cc:2804] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:15:54.565454  8083 raft_consensus.cc:697] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
W20260709 13:15:54.565614  8117 log.cc:927] Time spent T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:15:54.566394  8083 consensus_queue.cc:237] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:54.661563  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:15:54.611500  8017 leader_election.cc:290] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 13 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:15:54.691653  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 98485.5us
W20260709 13:15:54.672946  8109 log.cc:927] Time spent T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:15:54.734436  8069 raft_consensus.cc:2749] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843) with higher term. Message: Invalid argument: T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f5b5e4ed72944ecbda200012d141dc2 for earlier term 12. Current term is 13.
I20260709 13:15:54.850648  4030 raft_consensus.cc:2468] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 13.
W20260709 13:15:54.882292  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 132280us
W20260709 13:15:54.885151  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 131709us
I20260709 13:15:54.905812  4709 raft_consensus.cc:1275] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 14 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:15:54.918237  8067 tablet_bootstrap.cc:492] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938: Bootstrap starting.
I20260709 13:15:54.921336  8129 raft_consensus.cc:993] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc: : Instructing follower 6f5b5e4ed72944ecbda200012d141dc2 to start an election
I20260709 13:15:54.921941  8129 raft_consensus.cc:1081] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 LEADER]: Signalling peer 6f5b5e4ed72944ecbda200012d141dc2 to start an election
W20260709 13:15:54.932189  3845 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.236s	user 0.016s	sys 0.023s
I20260709 13:15:54.962455  8106 consensus_queue.cc:1048] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:54.958738  4032 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "604474f002cb41eb9125fc14353547d2"
dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:38290
I20260709 13:15:54.983031  4032 raft_consensus.cc:493] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:54.983474  4032 raft_consensus.cc:3060] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:54.996447  4099 raft_consensus.cc:1275] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 14 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:15:55.103343  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 53028us
I20260709 13:15:55.118192  4032 raft_consensus.cc:515] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:15:55.114598  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 104753us
I20260709 13:15:55.107348  8025 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
W20260709 13:15:55.169231  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 47993.6us
I20260709 13:15:55.127470  8132 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.151353  8025 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:55.189970  8132 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:55.200387  4028 raft_consensus.cc:1275] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 13 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:15:55.202348  8129 consensus_queue.cc:1048] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:55.274021  4032 leader_election.cc:290] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:15:55.282199  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 112124us
I20260709 13:15:55.288797  8019 consensus_queue.cc:1048] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:15:55.304025  8025 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:15:55.392032  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 133292us
I20260709 13:15:55.454823  8067 tablet_bootstrap.cc:492] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:55.456085  8067 tablet_bootstrap.cc:492] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938: Bootstrap complete.
I20260709 13:15:55.457000  8067 ts_tablet_manager.cc:1403] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938: Time spent bootstrapping tablet: real 0.539s	user 0.042s	sys 0.016s
I20260709 13:15:55.460500  8067 raft_consensus.cc:359] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:15:55.461170  8067 raft_consensus.cc:740] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Initialized, Role: LEARNER
I20260709 13:15:55.461681  8067 consensus_queue.cc:260] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:15:55.463353  8067 ts_tablet_manager.cc:1434] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.006s
I20260709 13:15:55.505404  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:55.523116  4034 raft_consensus.cc:1240] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Rejecting Update request from peer 8952c48a6f3a43968f7d77f7bfc4d1bc for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:55.524998  7912 consensus_queue.cc:1059] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:55.526186  7912 raft_consensus.cc:3055] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:55.526573  7912 raft_consensus.cc:740] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:55.527230  7912 consensus_queue.cc:260] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:55.529778  7912 raft_consensus.cc:3060] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:55.594792  8132 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:55.607205  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:55.611300  4709 raft_consensus.cc:2468] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 13.
I20260709 13:15:55.280190  3845 maintenance_manager.cc:643] P af4ff34c238b4043994545a7eb56815f: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 4.794s	user 0.203s	sys 0.084s Metrics: {"bytes_written":30710,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":112923,"dirs.run_cpu_time_us":550,"dirs.run_wall_time_us":20017,"drs_written":1,"lbm_read_time_us":18975,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":3,"lbm_write_time_us":80244,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":5,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"raft.queue_time_us":255315,"reinsert_count":0,"rows_written":63,"thread_start_us":304726,"threads_started":3,"update_count":35,"wal-append.queue_time_us":196306}
I20260709 13:15:55.651912  3846 maintenance_manager.cc:419] P af4ff34c238b4043994545a7eb56815f: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 8178 bytes on disk
I20260709 13:15:55.640136  3953 raft_consensus.cc:1275] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 13 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:15:55.653163  3924 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:55.659096  7873 raft_consensus.cc:2804] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:55.659570  7873 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:55.659943  7873 raft_consensus.cc:3060] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:55.669749  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:55.670535  4103 raft_consensus.cc:2468] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 13.
I20260709 13:15:55.643244  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:55.644045  3968 tablet_copy_service.cc:342] P f1c75790cedf4f52a3463a255c7da059: Request end of tablet copy session d709ee666b774ec29aa732e508219938-65333bcc8c2a4b1a9f6f35670cefe7d0 received from {username='slave'} at 127.0.0.1:35354
I20260709 13:15:55.675621  3968 tablet_copy_service.cc:434] P f1c75790cedf4f52a3463a255c7da059: ending tablet copy session d709ee666b774ec29aa732e508219938-65333bcc8c2a4b1a9f6f35670cefe7d0 on tablet 65333bcc8c2a4b1a9f6f35670cefe7d0 with peer d709ee666b774ec29aa732e508219938
I20260709 13:15:55.683418  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:55.691167  4709 raft_consensus.cc:1217] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938 [term 11 LEARNER]: Deduplicated request from leader. Original: 9.7->[11.8-11.8]   Dedup: 11.8->[]
I20260709 13:15:55.696557  3845 maintenance_manager.cc:643] P af4ff34c238b4043994545a7eb56815f: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.002s	user 0.001s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":591,"lbm_reads_lt_1ms":4}
I20260709 13:15:55.751099  7912 consensus_queue.cc:1048] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:55.765035  8133 raft_consensus.cc:993] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059: : Instructing follower 6f5b5e4ed72944ecbda200012d141dc2 to start an election
I20260709 13:15:55.766145  4103 raft_consensus.cc:2468] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 11.
I20260709 13:15:55.787725  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:55.788424  3953 raft_consensus.cc:3060] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:55.794674  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:15:55.799520  4103 raft_consensus.cc:2393] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 13: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:55.784461  8038 raft_consensus.cc:1081] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 13 LEADER]: Signalling peer 6f5b5e4ed72944ecbda200012d141dc2 to start an election
I20260709 13:15:55.810693  3953 raft_consensus.cc:2468] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 11.
I20260709 13:15:55.848279  3997 leader_election.cc:304] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
W20260709 13:15:55.859753  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 53502.4us
I20260709 13:15:55.865839  8069 raft_consensus.cc:2804] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:55.866496  8069 raft_consensus.cc:697] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:15:55.867393  8069 consensus_queue.cc:237] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:15:56.088223  8158 raft_consensus.cc:493] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:56.088943  8158 raft_consensus.cc:515] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:15:56.091389  8158 leader_election.cc:290] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:55.807226  7873 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:56.133610  3951 raft_consensus.cc:2468] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 13.
I20260709 13:15:56.134698  7873 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 13 election: Requested vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:15:56.199788  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 100736us
I20260709 13:15:56.238332  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:15:56.243505  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 382943us
I20260709 13:15:56.255645  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:56.257324  7951 raft_consensus.cc:493] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:56.258033  7951 raft_consensus.cc:515] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:15:56.261004  7951 leader_election.cc:290] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:15:56.262547  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:56.263428  4101 raft_consensus.cc:2393] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f1c75790cedf4f52a3463a255c7da059 in current term 13: Already voted for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in this term.
I20260709 13:15:56.278326  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:15:56.281073  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 446745us
I20260709 13:15:56.298403  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:56.303042  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:56.303727  4672 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:56.324342  4709 raft_consensus.cc:2468] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 13.
I20260709 13:15:56.326858  4071 leader_election.cc:304] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
W20260709 13:15:56.334972  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 62124.6us
I20260709 13:15:56.327878  7976 raft_consensus.cc:2804] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:56.348212  3924 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:56.333721  8083 raft_consensus.cc:2749] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:15:56.371863  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 66774.6us
W20260709 13:15:56.400261  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 62542.1us
I20260709 13:15:56.380281  8133 raft_consensus.cc:2804] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:15:56.427911  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 95953.3us
I20260709 13:15:56.434749  3997 leader_election.cc:304] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:56.439831  8071 raft_consensus.cc:2749] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:56.448076  8133 raft_consensus.cc:697] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 13 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:56.448632  8077 raft_consensus.cc:1064] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059: attempting to promote NON_VOTER d709ee666b774ec29aa732e508219938 to VOTER
I20260709 13:15:56.449143  8133 consensus_queue.cc:237] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:56.456403  4025 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714"
dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:38304
I20260709 13:15:56.457023  4025 raft_consensus.cc:493] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:56.457376  4025 raft_consensus.cc:3060] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:56.450901  8077 consensus_queue.cc:237] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:56.471343  4025 raft_consensus.cc:515] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:56.481334  4025 leader_election.cc:290] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 14 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:15:56.481844  3856 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44680 (request call id 121) took 12747 ms (client timeout 15000 ms). Trace:
I20260709 13:15:56.486552  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:56.487272  3952 raft_consensus.cc:3055] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:56.487640  3952 raft_consensus.cc:740] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:56.488675  3952 consensus_queue.cc:260] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:56.489915  3952 raft_consensus.cc:3060] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:56.492455  4101 raft_consensus.cc:1275] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:15:56.493912  8163 consensus_queue.cc:1048] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:15:56.498876  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 125701us
I20260709 13:15:56.502151  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:56.502756  4709 raft_consensus.cc:3060] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:56.504998  8138 raft_consensus.cc:493] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:15:56.505538  8138 raft_consensus.cc:515] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:56.511721  7976 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:56.512224  7976 raft_consensus.cc:3060] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:56.543397  8138 leader_election.cc:290] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:56.545461  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:15:56.548988  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 47176.9us
I20260709 13:15:56.554471  4034 raft_consensus.cc:1240] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 14 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:56.556604  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:56.589622  3925 leader_election.cc:304] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:15:56.591109  8106 raft_consensus.cc:2749] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:56.604982  3854 catalog_manager.cc:5697] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 5 to 7, leader changed from 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 7 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:56.633175  3951 raft_consensus.cc:1275] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:15:56.653184  8162 consensus_queue.cc:1048] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:15:56.665235  3854 catalog_manager.cc:5697] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 6 to 7, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 7 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:56.671865  4709 raft_consensus.cc:2468] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 14.
W20260709 13:15:56.482342  3856 rpcz_store.cc:269] 0709 13:15:43.791989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.805586 (+ 13597us) service_pool.cc:224] Handling call
0709 13:15:56.481774 (+12676188us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:54.474987 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:54.475876 (+   889us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:54.475934 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:15:54.475963 (+    29us) tablet.cc:662] Decoding operations
0709 13:15:54.676338 (+200375us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:54.693226 (+ 16888us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:54.696845 (+  3619us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:15:54.706169 (+  9324us) tablet.cc:701] Row locks acquired
0709 13:15:54.706191 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:15:54.706351 (+   160us) write_op.cc:270] Start()
0709 13:15:54.706480 (+   129us) write_op.cc:276] Timestamp: P: 1783602954706296 usec, L: 0
0709 13:15:54.706504 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:15:54.707309 (+   805us) log.cc:844] Serialized 6341 byte log entry
0709 13:15:55.281584 (+574275us) op_driver.cc:464] REPLICATION: finished
0709 13:15:55.364805 (+ 83221us) write_op.cc:301] APPLY: starting
0709 13:15:55.364919 (+   114us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:55.400871 (+ 35952us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:55.400985 (+   114us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:55.425558 (+ 24573us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:55.425913 (+   355us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 13:15:55.425970 (+    57us) write_op.cc:312] APPLY: finished
0709 13:15:55.426463 (+   493us) log.cc:844] Serialized 148 byte log entry
0709 13:15:55.426669 (+   206us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:55.426895 (+   226us) write_op.cc:454] Released schema lock
0709 13:15:55.426964 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:55.427409 (+   445us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:55.427446 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":127812,"reported_tablets":25,"child_traces":[["op",{"apply.queue_time_us":78703,"apply.run_cpu_time_us":26257,"apply.run_wall_time_us":62574,"cfile_cache_hit":62,"cfile_cache_hit_bytes":64883,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6220,"cfile_init":2,"lbm_read_time_us":1732,"lbm_reads_lt_1ms":12,"num_ops":16,"prepare.queue_time_us":184727,"prepare.run_cpu_time_us":6882,"prepare.run_wall_time_us":232692,"replication_time_us":532062,"thread_start_us":225645,"threads_started":2}]]}
I20260709 13:15:56.689180  3854 catalog_manager.cc:5697] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 8 to 9, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 9 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:56.704816  7976 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:56.715494  3854 catalog_manager.cc:5697] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:56.737222  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
W20260709 13:15:56.740618  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 45829.3us
I20260709 13:15:56.748484  3999 leader_election.cc:304] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:56.778509  7939 raft_consensus.cc:2804] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:56.779135  7939 raft_consensus.cc:697] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 14 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
W20260709 13:15:56.780491  8174 log.cc:927] Time spent T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:15:56.780349  7939 consensus_queue.cc:237] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:56.781214  7976 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 14 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:15:56.783102  3854 catalog_manager.cc:5697] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 8 to 9, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 9 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:56.786535  3854 catalog_manager.cc:5697] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 5 to 6, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 6 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:56.790004  3854 catalog_manager.cc:5697] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 9 to 11, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 11 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:56.791744  3854 catalog_manager.cc:5697] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 9 to 10, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 10 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:56.796705  8155 log.cc:927] Time spent T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:15:56.799997  3952 raft_consensus.cc:2468] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 14.
I20260709 13:15:56.800899  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:56.801548  4100 raft_consensus.cc:3060] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:56.793812  3854 catalog_manager.cc:5697] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 9 to 10, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 10 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
W20260709 13:15:56.837100  4129 debug-util.cc:398] Leaking SignalData structure 0x7b08001486a0 after lost signal to thread 2846
W20260709 13:15:56.838413  4129 debug-util.cc:398] Leaking SignalData structure 0x7b08000b2e60 after lost signal to thread 3891
I20260709 13:15:56.852368  4705 raft_consensus.cc:1275] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938 [term 11 LEARNER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:15:56.857746  4129 debug-util.cc:398] Leaking SignalData structure 0x7b080036dcc0 after lost signal to thread 3983
W20260709 13:15:56.858139  4129 debug-util.cc:398] Leaking SignalData structure 0x7b08002e4960 after lost signal to thread 3984
W20260709 13:15:56.859423  4129 debug-util.cc:398] Leaking SignalData structure 0x7b0800060b00 after lost signal to thread 4058
I20260709 13:15:56.867486  4100 raft_consensus.cc:2468] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 14.
W20260709 13:15:56.870173  4129 debug-util.cc:398] Leaking SignalData structure 0x7b08002e0ee0 after lost signal to thread 4059
W20260709 13:15:56.877223  4129 debug-util.cc:398] Leaking SignalData structure 0x7b08003de9e0 after lost signal to thread 4132
W20260709 13:15:56.877589  4129 debug-util.cc:398] Leaking SignalData structure 0x7b080022f480 after lost signal to thread 4133
W20260709 13:15:56.879330  4129 debug-util.cc:398] Leaking SignalData structure 0x7b080032b120 after lost signal to thread 4733
W20260709 13:15:56.880493  4129 debug-util.cc:398] Leaking SignalData structure 0x7b0800333da0 after lost signal to thread 8108
W20260709 13:15:56.885224  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 69850.5us
I20260709 13:15:56.888141  4028 raft_consensus.cc:1275] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:15:56.885319  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 76782.9us
I20260709 13:15:56.915668  3854 catalog_manager.cc:5697] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 3 to 9. New cstate: current_term: 9 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:56.943159  4672 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:56.976598  8086 raft_consensus.cc:2804] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:56.905738  7847 consensus_queue.cc:1048] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 13:15:57.015228  3854 catalog_manager.cc:5697] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 8 to 9, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 9 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:57.019713  3854 catalog_manager.cc:5697] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 4 to 8, leader changed from 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 8 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:57.044617  8086 raft_consensus.cc:697] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 14 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:57.045799  8086 consensus_queue.cc:237] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:57.047645  8138 consensus_queue.cc:1048] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:15:57.055502  3854 catalog_manager.cc:5697] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:57.094280  4705 raft_consensus.cc:2955] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 7 to 9, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:15:57.091100  8025 raft_consensus.cc:2955] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index 7 to 9, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:15:57.122673  3854 catalog_manager.cc:5697] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 8 to 9, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 9 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:57.166025  3854 catalog_manager.cc:5697] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 8 to 11, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 11 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:57.167481  3854 catalog_manager.cc:5697] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 8 to 9, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 9 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:57.186908  3854 catalog_manager.cc:5697] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:57.232142  4104 raft_consensus.cc:1240] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 14 FOLLOWER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:57.236258  4033 raft_consensus.cc:2955] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 7 to 9, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:15:57.253520  3953 raft_consensus.cc:1275] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 14 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:15:57.269268  4705 raft_consensus.cc:1240] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 14 LEADER]: Rejecting Update request from peer f1c75790cedf4f52a3463a255c7da059 for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:57.273226  8168 consensus_queue.cc:1059] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:57.275607  4106 raft_consensus.cc:2955] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 7 to 9, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:15:57.281246  8168 consensus_queue.cc:1243] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer d709ee666b774ec29aa732e508219938 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:15:57.289007  8138 raft_consensus.cc:3055] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:57.306010  8138 raft_consensus.cc:740] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:57.309412  4705 raft_consensus.cc:1275] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 14 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:15:57.310148  8138 consensus_queue.cc:260] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:57.311470  8138 raft_consensus.cc:3060] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:57.313664  8111 consensus_queue.cc:1048] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:57.405063  8122 consensus_queue.cc:1048] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:57.456322  3953 raft_consensus.cc:1275] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 14 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:15:57.456763  3953 pending_rounds.cc:85] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059: Aborting all ops after (but not including) 10
I20260709 13:15:57.457288  3953 pending_rounds.cc:107] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:15:57.457564  3953 raft_consensus.cc:2889] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:57.487068  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:57.502195  8166 consensus_queue.cc:1048] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:57.607014  4108 raft_consensus.cc:1275] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 14 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:15:57.608722  8167 consensus_queue.cc:1048] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:57.813828  3853 catalog_manager.cc:5697] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 6 to 7, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 7 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:57.819763  3853 catalog_manager.cc:5697] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 9 to 11, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 11 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:57.822669  3853 catalog_manager.cc:5697] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 7 to 12, leader changed from 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 12 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:57.824462  3853 catalog_manager.cc:5697] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 6 to 11, leader changed from d709ee666b774ec29aa732e508219938 (127.2.198.196) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 11 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:57.830910  3853 catalog_manager.cc:5697] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:57.840575  3854 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52094 (request call id 201) took 11090 ms. Trace:
I20260709 13:15:57.845839  3853 catalog_manager.cc:5697] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 9 to 11, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 11 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:57.847657  3853 catalog_manager.cc:5697] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 6 to 7, leader changed from 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) to d709ee666b774ec29aa732e508219938 (127.2.198.196). New cstate: current_term: 7 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:15:57.841058  3854 rpcz_store.cc:276] 0709 13:15:46.750328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:46.793452 (+ 43124us) service_pool.cc:224] Handling call
0709 13:15:57.840485 (+11047033us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:57.388193 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:57.389396 (+  1203us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:57.389442 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:15:57.389464 (+    22us) tablet.cc:662] Decoding operations
0709 13:15:57.391841 (+  2377us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:57.391930 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:57.391958 (+    28us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:15:57.393234 (+  1276us) tablet.cc:701] Row locks acquired
0709 13:15:57.393253 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:15:57.393401 (+   148us) write_op.cc:270] Start()
0709 13:15:57.393543 (+   142us) write_op.cc:276] Timestamp: P: 1783602957393357 usec, L: 0
0709 13:15:57.393580 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:15:57.394346 (+   766us) log.cc:844] Serialized 6746 byte log entry
0709 13:15:57.480566 (+ 86220us) op_driver.cc:464] REPLICATION: finished
0709 13:15:57.531163 (+ 50597us) write_op.cc:301] APPLY: starting
0709 13:15:57.532512 (+  1349us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:57.610381 (+ 77869us) spinlock_profiling.cc:243] Waited 68.3 ms on lock 0x7b5400428954. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d7571 00007f152566b32a 00007f15255f0f14 00007f15255f0ec3 00007f15255f0e38 00007f15255f0df3 00007f15255f00dc 00007f1525619e16 00007f1525601cbb 00007f15255ec39d 00007f15255efd75
0709 13:15:57.622569 (+ 12188us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b180002c080. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f152b449de1 00007f152b4565b1 00007f1522581522 00007f15225837c1 00007f1522583779 00007f1522583709 00007f15225836d1 00007f15225829cd 000000000038f354 000000000038f199 00007f152256483a
0709 13:15:57.686190 (+ 63621us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:57.686225 (+    35us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:57.741030 (+ 54805us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:57.741390 (+   360us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=34,mrs_lookups=0
0709 13:15:57.743382 (+  1992us) write_op.cc:312] APPLY: finished
0709 13:15:57.750011 (+  6629us) log.cc:844] Serialized 156 byte log entry
0709 13:15:57.754613 (+  4602us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:57.754831 (+   218us) write_op.cc:454] Released schema lock
0709 13:15:57.757242 (+  2411us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:57.764368 (+  7126us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:57.764420 (+    52us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":52,"child_traces":[["op",{"apply.queue_time_us":43227,"apply.run_cpu_time_us":28313,"apply.run_wall_time_us":234503,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75289,"num_ops":17,"prepare.queue_time_us":103040,"prepare.run_cpu_time_us":5900,"prepare.run_wall_time_us":82016,"raft.queue_time_us":1130,"raft.run_cpu_time_us":6536,"raft.run_wall_time_us":209355,"replication_time_us":86060,"spinlock_wait_cycles":182959488,"thread_start_us":136906,"threads_started":4,"wal-append.queue_time_us":1763}]]}
I20260709 13:15:57.852875  3853 catalog_manager.cc:5697] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 8 to 11, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 11 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:57.859779  3853 catalog_manager.cc:5697] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 9 to 11, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 11 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:57.862083  3853 catalog_manager.cc:5697] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 12 to 14, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 14 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:57.863835  3853 catalog_manager.cc:5697] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:57.865397  3853 catalog_manager.cc:5697] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:57.869488  3853 catalog_manager.cc:5697] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 11 to 13, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 13 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:57.870980  3853 catalog_manager.cc:5697] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:57.872161  3853 catalog_manager.cc:5697] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 7 to 9, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 9 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:57.873502  3853 catalog_manager.cc:5697] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:57.874707  3853 catalog_manager.cc:5697] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 9 to 11, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 11 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:57.877282  3853 catalog_manager.cc:5697] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 4 to 14. New cstate: current_term: 14 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:15:57.878939  3853 catalog_manager.cc:5697] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 6 to 10, leader changed from 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 10 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:57.880601  3853 catalog_manager.cc:5697] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 9 to 11, now has a pending config: VOTER f1c75790cedf4f52a3463a255c7da059 (127.2.198.193), VOTER 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194), VOTER 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195), NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196). New cstate: current_term: 11 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } } pending_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:15:57.882647  3853 catalog_manager.cc:5697] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:57.884225  3853 catalog_manager.cc:5697] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 6 to 9, leader changed from 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 9 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:57.916646  4709 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4"
dest_uuid: "d709ee666b774ec29aa732e508219938"
mode: GRACEFUL
new_leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
 from {username='slave'} at 127.0.0.1:60934
I20260709 13:15:57.917397  4709 raft_consensus.cc:606] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 14 LEADER]: Received request to transfer leadership to TS 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:57.922407  4108 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "f1c75790cedf4f52a3463a255c7da059"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:15:57.923058  4108 raft_consensus.cc:606] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Received request to transfer leadership to TS f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:57.926067  4108 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:15:57.926601  4108 raft_consensus.cc:606] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Received request to transfer leadership to TS 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:57.926934  4108 raft_consensus.cc:614] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:57.935973  4709 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce"
dest_uuid: "d709ee666b774ec29aa732e508219938"
mode: GRACEFUL
new_leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
 from {username='slave'} at 127.0.0.1:60934
I20260709 13:15:57.936755  4709 raft_consensus.cc:606] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Received request to transfer leadership to TS 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:15:57.937180  4709 raft_consensus.cc:614] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:57.943007  4108 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
mode: GRACEFUL
new_leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:15:57.943598  4108 raft_consensus.cc:606] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Received request to transfer leadership to TS 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:15:57.943934  4108 raft_consensus.cc:614] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:57.946527  2843 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:15:57.948622  2843 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:57.949126  8179 raft_consensus.cc:993] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc: : Instructing follower f1c75790cedf4f52a3463a255c7da059 to start an election
I20260709 13:15:57.949688  8179 raft_consensus.cc:1081] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Signalling peer f1c75790cedf4f52a3463a255c7da059 to start an election
I20260709 13:15:57.951673  3958 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712"
dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
 from {username='slave'} at 127.0.0.1:38606
I20260709 13:15:57.952240  3958 raft_consensus.cc:493] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:57.952620  3958 raft_consensus.cc:3060] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:57.962595  3958 raft_consensus.cc:515] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:57.985527  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:15:57.986202  4108 raft_consensus.cc:3055] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:57.986104  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:57.986644  4108 raft_consensus.cc:740] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:57.986827  4709 raft_consensus.cc:3060] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:57.987444  4108 consensus_queue.cc:260] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:57.988619  4108 raft_consensus.cc:3060] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:57.996336  4709 raft_consensus.cc:2468] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9.
I20260709 13:15:57.997802  3924 leader_election.cc:304] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:15:57.998723  8133 raft_consensus.cc:2804] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:57.998881  4108 raft_consensus.cc:2468] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c75790cedf4f52a3463a255c7da059 in term 9.
I20260709 13:15:57.999322  8133 raft_consensus.cc:697] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Becoming Leader. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:15:58.000296  8133 consensus_queue.cc:237] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:58.004734  3958 leader_election.cc:290] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 election: Requested vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:58.090611  3853 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52104 (request call id 205) took 4594 ms. Trace:
I20260709 13:15:58.091122  3853 rpcz_store.cc:276] 0709 13:15:53.496439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:53.496644 (+   205us) service_pool.cc:224] Handling call
0709 13:15:53.808618 (+311974us) spinlock_profiling.cc:243] Waited 53.2 ms on lock 0x7b5400002490. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f1522409db1 00007f1522549b71 00007f152254a0b2 00007f152b4c3a89 00007f152b45bda6 00007f152b42d088 00007f152b52b37e 00007f15299ec2a4 00007f15299ec232 00007f15299ec161 00007f15299ec0dc
0709 13:15:58.090507 (+4281889us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:57.899169 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:57.899768 (+   599us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:57.899801 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:15:57.899813 (+    12us) tablet.cc:662] Decoding operations
0709 13:15:57.901520 (+  1707us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:57.901576 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:57.901607 (+    31us) tablet.cc:685] Acquiring locks for 22 operations
0709 13:15:57.909953 (+  8346us) tablet.cc:701] Row locks acquired
0709 13:15:57.909969 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:15:57.910132 (+   163us) write_op.cc:270] Start()
0709 13:15:57.910246 (+   114us) write_op.cc:276] Timestamp: P: 1783602957910082 usec, L: 0
0709 13:15:57.910274 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:15:57.925487 (+ 15213us) log.cc:844] Serialized 8926 byte log entry
0709 13:15:57.931047 (+  5560us) op_driver.cc:464] REPLICATION: finished
0709 13:15:57.931448 (+   401us) write_op.cc:301] APPLY: starting
0709 13:15:57.931562 (+   114us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:57.974923 (+ 43361us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:57.975033 (+   110us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:58.047131 (+ 72098us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:58.047479 (+   348us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=44,key_file_lookups=44,delta_file_lookups=44,mrs_lookups=0
0709 13:15:58.047527 (+    48us) write_op.cc:312] APPLY: finished
0709 13:15:58.047981 (+   454us) log.cc:844] Serialized 196 byte log entry
0709 13:15:58.048173 (+   192us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:58.048390 (+   217us) write_op.cc:454] Released schema lock
0709 13:15:58.048477 (+    87us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:58.048956 (+   479us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:58.048990 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":55804,"reported_tablets":48,"spinlock_wait_cycles":122458496,"child_traces":[["op",{"apply.queue_time_us":124,"apply.run_cpu_time_us":28729,"apply.run_wall_time_us":117461,"cfile_cache_hit":88,"cfile_cache_hit_bytes":92092,"num_ops":22,"prepare.queue_time_us":681,"prepare.run_cpu_time_us":5524,"prepare.run_wall_time_us":31487,"replication_time_us":20610}]]}
I20260709 13:15:58.142560  3857 catalog_manager.cc:5697] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 10 to 12, leader changed from 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 12 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:58.164594  3857 catalog_manager.cc:5697] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 5 to 12. New cstate: current_term: 12 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:15:58.167785  3857 catalog_manager.cc:5697] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:58.169919  3857 catalog_manager.cc:5697] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 8 to 11, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 11 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:58.183770  3857 catalog_manager.cc:5697] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 10 to 13, leader changed from d709ee666b774ec29aa732e508219938 (127.2.198.196) to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 13 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:58.189106  3857 catalog_manager.cc:5697] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 10 to 11, leader changed from 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) to d709ee666b774ec29aa732e508219938 (127.2.198.196). New cstate: current_term: 11 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:15:58.191075  3857 catalog_manager.cc:5697] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: term changed from 9 to 11, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to d709ee666b774ec29aa732e508219938 (127.2.198.196). New cstate: current_term: 11 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:15:58.229859  7976 raft_consensus.cc:993] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938: : Instructing follower 8952c48a6f3a43968f7d77f7bfc4d1bc to start an election
I20260709 13:15:58.230504  7976 raft_consensus.cc:1081] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 14 LEADER]: Signalling peer 8952c48a6f3a43968f7d77f7bfc4d1bc to start an election
I20260709 13:15:58.232497  4106 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
 from {username='slave'} at 127.0.0.1:34656
I20260709 13:15:58.233114  4106 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:58.233506  4106 raft_consensus.cc:3060] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:58.269096  4106 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:58.274075  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:15:58.274827  3954 raft_consensus.cc:3060] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:58.275261  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:15:58.275928  4709 raft_consensus.cc:3055] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:58.276211  4709 raft_consensus.cc:740] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:15:58.276988  4709 consensus_queue.cc:260] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:58.278136  4709 raft_consensus.cc:3060] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:58.310077  4106 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 15 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:58.315507  4709 raft_consensus.cc:2468] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 15.
I20260709 13:15:58.321626  4073 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:15:58.322566  8179 raft_consensus.cc:2804] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:58.323407  8179 raft_consensus.cc:697] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 15 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:15:58.329164  8179 consensus_queue.cc:237] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:58.334292  3954 raft_consensus.cc:2468] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 15.
I20260709 13:15:58.336714  3856 catalog_manager.cc:5697] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 reported cstate change: term changed from 9 to 14, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 14 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:15:58.358480  3856 catalog_manager.cc:5697] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:58.361275  3856 catalog_manager.cc:5697] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938 reported cstate change: config changed from index -1 to 7, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added, no longer has a pending config: VOTER f1c75790cedf4f52a3463a255c7da059 (127.2.198.193), VOTER 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194), VOTER 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195), NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196). New cstate: current_term: 11 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:15:58.413018  3853 catalog_manager.cc:5697] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:15:58.414873  3853 catalog_manager.cc:5697] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 10 to 11, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 11 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
W20260709 13:15:58.417968  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 71341.1us
I20260709 13:15:58.417143  3853 catalog_manager.cc:5697] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:58.431404  3857 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52092 (request call id 208) took 4835 ms. Trace:
I20260709 13:15:58.435003  3857 rpcz_store.cc:276] 0709 13:15:53.595922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:53.596139 (+   217us) service_pool.cc:224] Handling call
0709 13:15:58.431317 (+4835178us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:58.198339 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:58.199047 (+   708us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:58.199084 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:15:58.199103 (+    19us) tablet.cc:662] Decoding operations
0709 13:15:58.218714 (+ 19611us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:58.218789 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:58.218830 (+    41us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:15:58.221577 (+  2747us) tablet.cc:701] Row locks acquired
0709 13:15:58.221830 (+   253us) write_op.cc:260] PREPARE: finished
0709 13:15:58.221967 (+   137us) write_op.cc:270] Start()
0709 13:15:58.222091 (+   124us) write_op.cc:276] Timestamp: P: 1783602958221928 usec, L: 0
0709 13:15:58.222114 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:15:58.223096 (+   982us) log.cc:844] Serialized 2845 byte log entry
0709 13:15:58.225458 (+  2362us) op_driver.cc:464] REPLICATION: finished
0709 13:15:58.227288 (+  1830us) write_op.cc:301] APPLY: starting
0709 13:15:58.227400 (+   112us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:58.233672 (+  6272us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:58.233770 (+    98us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:58.300521 (+ 66751us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:58.300917 (+   396us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 13:15:58.300979 (+    62us) write_op.cc:312] APPLY: finished
0709 13:15:58.301332 (+   353us) log.cc:844] Serialized 73 byte log entry
0709 13:15:58.302702 (+  1370us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:58.302843 (+   141us) write_op.cc:454] Released schema lock
0709 13:15:58.302897 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:58.339811 (+ 36914us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:58.339845 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8811,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":1570,"apply.run_cpu_time_us":11589,"apply.run_wall_time_us":112486,"cfile_cache_hit":28,"cfile_cache_hit_bytes":29302,"num_ops":7,"prepare.queue_time_us":123,"prepare.run_cpu_time_us":4288,"prepare.run_wall_time_us":25100,"replication_time_us":3185}]]}
I20260709 13:15:58.445106  3853 catalog_manager.cc:5697] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 12 to 13, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 13 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } }
I20260709 13:15:58.452785  3853 catalog_manager.cc:5697] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: config changed from index 7 to 9, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:15:58.469844  3853 catalog_manager.cc:5697] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 9 to 13, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 13 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:58.450126  3856 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44680 (request call id 122) took 1323 ms. Trace:
I20260709 13:15:58.496562  3856 rpcz_store.cc:276] 0709 13:15:57.126325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.127682 (+  1357us) service_pool.cc:224] Handling call
0709 13:15:58.383457 (+1255775us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:58.383489 (+    32us) write_op.cc:454] Released schema lock
0709 13:15:58.450030 (+ 66541us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:58.371392 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:58.371962 (+   570us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:58.371998 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:15:58.372016 (+    18us) tablet.cc:662] Decoding operations
0709 13:15:58.372601 (+   585us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:58.372682 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:58.372710 (+    28us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:15:58.373074 (+   364us) tablet.cc:701] Row locks acquired
0709 13:15:58.373089 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:15:58.373238 (+   149us) write_op.cc:270] Start()
0709 13:15:58.373353 (+   115us) write_op.cc:276] Timestamp: P: 1783602958373189 usec, L: 0
0709 13:15:58.373382 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:15:58.374077 (+   695us) log.cc:844] Serialized 1365 byte log entry
0709 13:15:58.376328 (+  2251us) op_driver.cc:464] REPLICATION: finished
0709 13:15:58.376798 (+   470us) write_op.cc:301] APPLY: starting
0709 13:15:58.376874 (+    76us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:58.378786 (+  1912us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:58.378884 (+    98us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:58.381394 (+  2510us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:58.381623 (+   229us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:15:58.381674 (+    51us) write_op.cc:312] APPLY: finished
0709 13:15:58.381925 (+   251us) log.cc:844] Serialized 41 byte log entry
0709 13:15:58.382794 (+   869us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:58.382901 (+   107us) write_op.cc:454] Released schema lock
0709 13:15:58.382949 (+    48us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"dns_us":249,"mutex_wait_us":36561,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":230,"apply.run_cpu_time_us":5279,"apply.run_wall_time_us":6504,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12558,"num_ops":3,"prepare.queue_time_us":104,"prepare.run_cpu_time_us":2998,"prepare.run_wall_time_us":2997,"replication_time_us":2822}]]}
I20260709 13:15:58.520327  4099 raft_consensus.cc:1275] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:15:58.523706  8202 consensus_queue.cc:1048] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:58.552232  4709 raft_consensus.cc:1275] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:15:58.555123  8025 consensus_queue.cc:1048] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:58.569579  3854 catalog_manager.cc:5697] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 13 to 14, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 14 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:15:58.579005  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 55885.9us
I20260709 13:15:58.697156  3853 catalog_manager.cc:5697] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 14 to 15, leader changed from d709ee666b774ec29aa732e508219938 (127.2.198.196) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 15 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:58.702548  3853 catalog_manager.cc:5697] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 8 to 9, leader changed from 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) to f1c75790cedf4f52a3463a255c7da059 (127.2.198.193). New cstate: current_term: 9 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:15:58.713974  3954 raft_consensus.cc:1275] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 15 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:15:58.720366  8169 consensus_queue.cc:1048] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:58.717185  4705 consensus_queue.cc:237] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:58.791262  4099 raft_consensus.cc:1275] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:15:58.795029  3954 consensus_queue.cc:237] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:58.803081  4705 raft_consensus.cc:1275] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 15 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:15:58.810688  3953 raft_consensus.cc:1275] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:15:58.816418  8211 consensus_queue.cc:1048] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:58.835923  8215 consensus_queue.cc:1048] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:15:58.843729  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 45169.4us
I20260709 13:15:58.869589  8206 consensus_queue.cc:1048] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:15:58.875942  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 47772us
I20260709 13:15:58.949697  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:15:59.022804  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 44487.8us
I20260709 13:15:59.089025  4034 raft_consensus.cc:1275] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:15:59.099020  8225 consensus_queue.cc:1048] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:15:59.147732  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 52928.1us
I20260709 13:15:59.166966  4705 raft_consensus.cc:1275] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:15:59.215914  8219 raft_consensus.cc:2955] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 11 LEADER]: Committing config change with OpId 11.11: config changed from index 6 to 11, VOTER 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
W20260709 13:15:59.259843  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 52260.2us
I20260709 13:15:59.281790  8232 raft_consensus.cc:2955] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:15:59.308809  4033 raft_consensus.cc:2955] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
W20260709 13:15:59.316653  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 108485us
W20260709 13:15:59.341912  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 132106us
I20260709 13:15:59.363039  8025 consensus_queue.cc:1048] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:15:59.382944  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 214841us
I20260709 13:15:59.391459  4108 raft_consensus.cc:2955] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 6 to 11, VOTER 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:15:59.403908  3843 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1d55b0c8cf6547cb8c135f6ecdfce39f with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:59.424492  3853 catalog_manager.cc:5697] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 reported cstate change: config changed from index 6 to 11, VOTER 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) evicted. New cstate: current_term: 11 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:15:59.429741  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 79039.2us
I20260709 13:15:59.432369  3841 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 65333bcc8c2a4b1a9f6f35670cefe7d0 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:15:59.432628  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 80635.3us
I20260709 13:15:59.443408  3856 catalog_manager.cc:5697] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: config changed from index 9 to 10, VOTER 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) evicted. New cstate: current_term: 11 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
W20260709 13:15:59.470734  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 127882us
I20260709 13:15:59.489800  3959 raft_consensus.cc:2955] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 6 to 11, VOTER 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:15:59.550388  4705 raft_consensus.cc:2955] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:15:59.708271  8217 raft_consensus.cc:493] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:15:59.708894  8217 raft_consensus.cc:515] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } attrs { replace: true } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:15:59.714841  4095 tablet_service.cc:1558] Processing DeleteTablet for tablet 65333bcc8c2a4b1a9f6f35670cefe7d0 with delete_type TABLET_DATA_TOMBSTONED (TS 8952c48a6f3a43968f7d77f7bfc4d1bc not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:43152
I20260709 13:15:59.715916  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f1c75790cedf4f52a3463a255c7da059" is_pre_election: true
I20260709 13:15:59.717391  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:15:59.718886  4074 leader_election.cc:304] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:15:59.720513  8179 raft_consensus.cc:2749] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:59.721907  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:15:59.725234  8217 leader_election.cc:290] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:15:59.729001  4017 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d55b0c8cf6547cb8c135f6ecdfce39f with delete_type TABLET_DATA_TOMBSTONED (TS 6f5b5e4ed72944ecbda200012d141dc2 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:35598
I20260709 13:15:59.745885  8247 tablet_replica.cc:333] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:15:59.751784  8247 raft_consensus.cc:2243] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.748113  8248 tablet_replica.cc:333] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:15:59.760227  8248 raft_consensus.cc:2243] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.761940  8247 raft_consensus.cc:2272] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.781098  8248 raft_consensus.cc:2272] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.785187  8248 ts_tablet_manager.cc:1916] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:59.786023  8247 ts_tablet_manager.cc:1916] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:59.913911  8247 ts_tablet_manager.cc:1929] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.9
I20260709 13:15:59.924535  8247 log.cc:1199] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Deleting WAL directory at /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/ts-2-root/wals/65333bcc8c2a4b1a9f6f35670cefe7d0
I20260709 13:15:59.923905  8248 ts_tablet_manager.cc:1929] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.10
I20260709 13:15:59.933283  3841 catalog_manager.cc:5028] TS 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): tablet 65333bcc8c2a4b1a9f6f35670cefe7d0 (table test-workload [id=8a2760e8528448a780fea6ccf25816cb]) successfully deleted
I20260709 13:15:59.933648  8248 log.cc:1199] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 6f5b5e4ed72944ecbda200012d141dc2: Deleting WAL directory at /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/ts-1-root/wals/1d55b0c8cf6547cb8c135f6ecdfce39f
W20260709 13:16:00.025027  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 79910.5us
I20260709 13:16:00.038301  3844 catalog_manager.cc:5028] TS 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): tablet 1d55b0c8cf6547cb8c135f6ecdfce39f (table test-workload [id=8a2760e8528448a780fea6ccf25816cb]) successfully deleted
I20260709 13:16:00.156946  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:16:00.193850  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 104538us
W20260709 13:16:00.197589  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 112896us
W20260709 13:16:00.200088  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 131735us
W20260709 13:16:00.253015  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 164310us
W20260709 13:16:00.279683  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 78951.4us
I20260709 13:16:00.329309  4705 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f"
dest_uuid: "d709ee666b774ec29aa732e508219938"
mode: GRACEFUL
new_leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
 from {username='slave'} at 127.0.0.1:60934
I20260709 13:16:00.330013  4705 raft_consensus.cc:606] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 11 LEADER]: Received request to transfer leadership to TS 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:16:00.342298  4705 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e"
dest_uuid: "d709ee666b774ec29aa732e508219938"
mode: GRACEFUL
new_leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
 from {username='slave'} at 127.0.0.1:60934
I20260709 13:16:00.342980  4705 raft_consensus.cc:606] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 10 LEADER]: Received request to transfer leadership to TS 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:16:00.349478  4705 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08"
dest_uuid: "d709ee666b774ec29aa732e508219938"
mode: GRACEFUL
new_leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:60934
I20260709 13:16:00.350106  4705 raft_consensus.cc:606] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 11 LEADER]: Received request to transfer leadership to TS 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:16:00.356994  3951 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6"
dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
mode: GRACEFUL
new_leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
 from {username='slave'} at 127.0.0.1:35222
I20260709 13:16:00.357659  3951 raft_consensus.cc:606] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 7 LEADER]: Received request to transfer leadership to TS 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:16:00.379487  3951 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3"
dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
mode: GRACEFUL
new_leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
 from {username='slave'} at 127.0.0.1:35222
I20260709 13:16:00.380229  3951 raft_consensus.cc:606] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 11 LEADER]: Received request to transfer leadership to TS 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:16:00.382516  2843 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:16:00.399082  2843 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:00.416752  8263 raft_consensus.cc:993] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059: : Instructing follower 8952c48a6f3a43968f7d77f7bfc4d1bc to start an election
I20260709 13:16:00.417388  8263 raft_consensus.cc:1081] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 7 LEADER]: Signalling peer 8952c48a6f3a43968f7d77f7bfc4d1bc to start an election
I20260709 13:16:00.429242  4104 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
 from {username='slave'} at 127.0.0.1:45332
I20260709 13:16:00.429922  4104 raft_consensus.cc:493] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:00.430272  4104 raft_consensus.cc:3060] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:00.449055  8257 raft_consensus.cc:993] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938: : Instructing follower 8952c48a6f3a43968f7d77f7bfc4d1bc to start an election
I20260709 13:16:00.449756  8219 raft_consensus.cc:1081] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 10 LEADER]: Signalling peer 8952c48a6f3a43968f7d77f7bfc4d1bc to start an election
I20260709 13:16:00.451531  4108 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
 from {username='slave'} at 127.0.0.1:34656
I20260709 13:16:00.452194  4108 raft_consensus.cc:493] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:00.452587  4108 raft_consensus.cc:3060] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:00.463101  4108 raft_consensus.cc:515] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:00.471388  4104 raft_consensus.cc:515] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:00.500432  8254 raft_consensus.cc:993] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938: : Instructing follower 6f5b5e4ed72944ecbda200012d141dc2 to start an election
I20260709 13:16:00.501444  8249 raft_consensus.cc:1081] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 11 LEADER]: Signalling peer 6f5b5e4ed72944ecbda200012d141dc2 to start an election
I20260709 13:16:00.503262  4025 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08"
dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:41312
I20260709 13:16:00.503969  4025 raft_consensus.cc:493] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:00.503932  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:16:00.504462  4025 raft_consensus.cc:3060] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:00.504594  4033 raft_consensus.cc:3060] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:00.512210  4033 raft_consensus.cc:2468] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 11.
I20260709 13:16:00.513684  4074 leader_election.cc:304] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:16:00.514364  4025 raft_consensus.cc:515] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:00.515741  8253 raft_consensus.cc:2804] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:00.516583  8253 raft_consensus.cc:697] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:16:00.517933  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bc23345fdc47d2b7e9b8964749236e" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:16:00.518584  4705 raft_consensus.cc:3055] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:00.518901  4705 raft_consensus.cc:740] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:16:00.519873  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:16:00.520041  4025 leader_election.cc:290] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 12 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:16:00.520479  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:16:00.521301  4104 leader_election.cc:290] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:16:00.521031  4033 raft_consensus.cc:3060] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:00.521993  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:16:00.522547  4709 raft_consensus.cc:3055] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:00.522845  4709 raft_consensus.cc:740] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:16:00.523630  4709 consensus_queue.cc:260] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:00.524995  3959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:16:00.525427  3959 raft_consensus.cc:3060] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:00.520481  3954 raft_consensus.cc:3055] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:00.526784  3954 raft_consensus.cc:740] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:16:00.518586  4108 leader_election.cc:290] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:16:00.531886  3954 consensus_queue.cc:260] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:00.533320  4709 raft_consensus.cc:3060] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:00.533758  3959 raft_consensus.cc:2468] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 12.
I20260709 13:16:00.535037  4705 consensus_queue.cc:260] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:00.536536  4705 raft_consensus.cc:3060] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:00.537451  3954 raft_consensus.cc:3060] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:00.539693  8253 consensus_queue.cc:237] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:00.558013  3997 leader_election.cc:304] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:16:00.558959  8238 raft_consensus.cc:2804] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:00.559566  8238 raft_consensus.cc:697] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:16:00.560575  8238 consensus_queue.cc:237] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:00.569036  3954 raft_consensus.cc:2468] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 8.
I20260709 13:16:00.580760  4071 leader_election.cc:304] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:16:00.581815  8253 raft_consensus.cc:2804] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:00.582405  8253 raft_consensus.cc:697] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:16:00.583388  8253 consensus_queue.cc:237] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:00.570995  4709 raft_consensus.cc:2468] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 12.
I20260709 13:16:00.577265  4705 raft_consensus.cc:2468] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 11.
I20260709 13:16:00.595194  4033 raft_consensus.cc:2468] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 8.
I20260709 13:16:00.612138  3853 catalog_manager.cc:5697] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 11 to 12, leader changed from d709ee666b774ec29aa732e508219938 (127.2.198.196) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 12 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:00.629750  8237 raft_consensus.cc:993] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059: : Instructing follower 8952c48a6f3a43968f7d77f7bfc4d1bc to start an election
I20260709 13:16:00.630462  8232 raft_consensus.cc:1081] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 11 LEADER]: Signalling peer 8952c48a6f3a43968f7d77f7bfc4d1bc to start an election
I20260709 13:16:00.633502  4108 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
 from {username='slave'} at 127.0.0.1:45332
I20260709 13:16:00.634227  4108 raft_consensus.cc:493] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:00.634605  4108 raft_consensus.cc:3060] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:00.635063  3854 catalog_manager.cc:5697] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 10 to 11, leader changed from d709ee666b774ec29aa732e508219938 (127.2.198.196) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 11 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:00.646064  4108 raft_consensus.cc:515] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:00.648424  4108 leader_election.cc:290] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:16:00.649098  3954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:16:00.649792  3954 raft_consensus.cc:3055] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:00.650072  3954 raft_consensus.cc:740] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:16:00.650810  3954 consensus_queue.cc:260] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:00.652063  3954 raft_consensus.cc:3060] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:00.656154  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:16:00.656821  4033 raft_consensus.cc:3060] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:00.688805  4033 raft_consensus.cc:2468] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 12.
I20260709 13:16:00.690254  4074 leader_election.cc:304] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:16:00.691213  8253 raft_consensus.cc:2804] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:00.691799  8253 raft_consensus.cc:697] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:16:00.692757  8253 consensus_queue.cc:237] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:00.697444  3954 raft_consensus.cc:2468] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 12.
I20260709 13:16:00.754922  8257 raft_consensus.cc:993] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938: : Instructing follower 8952c48a6f3a43968f7d77f7bfc4d1bc to start an election
I20260709 13:16:00.755525  8257 raft_consensus.cc:1081] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 11 LEADER]: Signalling peer 8952c48a6f3a43968f7d77f7bfc4d1bc to start an election
I20260709 13:16:00.776085  4108 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
 from {username='slave'} at 127.0.0.1:34656
I20260709 13:16:00.777072  4108 raft_consensus.cc:493] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:00.777580  4108 raft_consensus.cc:3060] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:00.828125  4108 raft_consensus.cc:515] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:00.830588  4108 leader_election.cc:290] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:16:00.831593  3958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:16:00.832268  3958 raft_consensus.cc:3060] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:00.833082  4709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:16:00.833940  4709 raft_consensus.cc:3055] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:00.834322  4709 raft_consensus.cc:740] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:16:00.835402  4709 consensus_queue.cc:260] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:00.838510  4709 raft_consensus.cc:3060] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:00.840646  3958 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 12.
I20260709 13:16:00.845028  4071 leader_election.cc:304] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:16:00.857991  8264 raft_consensus.cc:2804] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:00.858734  8264 raft_consensus.cc:697] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:16:00.857203  4709 raft_consensus.cc:2468] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 12.
I20260709 13:16:00.878558  3854 catalog_manager.cc:5697] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 7 to 8, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 8 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:00.998842  3854 catalog_manager.cc:5697] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 11 to 12, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 12 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:00.924187  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 53762us
I20260709 13:16:00.927500  4709 raft_consensus.cc:1275] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:16:00.877592  8264 consensus_queue.cc:237] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:01.110841  3958 consensus_queue.cc:237] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:16:01.157663  3952 raft_consensus.cc:1275] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:16:01.161535  8259 consensus_queue.cc:1048] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:01.181507  8260 consensus_queue.cc:1048] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:01.184451  4709 raft_consensus.cc:1275] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:16:01.250813  8238 consensus_queue.cc:1048] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:01.261931  3952 raft_consensus.cc:1275] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:16:01.291787  4025 raft_consensus.cc:1275] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:16:01.299885  4025 raft_consensus.cc:1275] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:16:01.321841  4033 raft_consensus.cc:1275] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:16:01.353525  8284 consensus_queue.cc:1048] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:01.364676  4709 raft_consensus.cc:3060] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938 [term 6 LEARNER]: Advancing to term 8
I20260709 13:16:01.376559  3954 raft_consensus.cc:1275] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:16:01.376569  8264 consensus_queue.cc:1048] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:01.361683  8284 consensus_queue.cc:1048] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:16:01.392089  8264 consensus_queue.cc:1048] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:01.395761  4030 raft_consensus.cc:1275] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:16:01.401984  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:01.418865  3856 catalog_manager.cc:5697] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 11 to 12, leader changed from d709ee666b774ec29aa732e508219938 (127.2.198.196) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 12 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:01.439812  8263 consensus_queue.cc:1048] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:16:01.441452  4099 raft_consensus.cc:1275] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:16:01.452916  8284 consensus_queue.cc:1048] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:01.536432  4709 raft_consensus.cc:1275] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938 [term 8 LEARNER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:16:01.556594  8232 consensus_queue.cc:1048] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:16:01.601594  8300 consensus_queue.cc:1048] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:01.604346  8300 consensus_queue.cc:1243] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Peer d709ee666b774ec29aa732e508219938 log is divergent from this leader: its last log entry 5.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:16:01.661533  8291 log.cc:927] Time spent T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 13:16:01.713907  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 92003.8us
W20260709 13:16:01.719071  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 83473.4us
I20260709 13:16:01.723271  4705 raft_consensus.cc:1275] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 13:16:01.728807  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 85427.6us
W20260709 13:16:01.744840  8294 log.cc:927] Time spent T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.246s	user 0.005s	sys 0.000s
I20260709 13:16:01.799283  3953 raft_consensus.cc:1275] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:16:01.801352  8279 consensus_queue.cc:1048] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:01.826265  8282 raft_consensus.cc:2955] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 8 LEADER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:16:01.849489  4700 pending_rounds.cc:85] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938: Aborting all ops after (but not including) 4
I20260709 13:16:01.851105  4700 pending_rounds.cc:107] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 5.5
I20260709 13:16:01.865885  4700 raft_consensus.cc:2917] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938 [term 8 LEARNER]: Aborting config change with OpId 5.5: Aborted: Op aborted by new leader
I20260709 13:16:01.868009  4700 raft_consensus.cc:2889] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938 [term 8 NON_PARTICIPANT]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:01.897979  4033 raft_consensus.cc:2955] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
W20260709 13:16:01.901949  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 110134us
I20260709 13:16:01.902009  8217 consensus_queue.cc:1048] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:16:01.937711  4028 consensus_queue.cc:237] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:16:02.031198  4700 raft_consensus.cc:2955] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938 [term 8 LEARNER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:16:02.177277  8256 raft_consensus.cc:1064] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059: attempting to promote NON_VOTER d709ee666b774ec29aa732e508219938 to VOTER
I20260709 13:16:02.205727  3856 catalog_manager.cc:5697] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938 reported cstate change: config changed from index -1 to 7, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New cstate: current_term: 8 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:16:02.208181  8256 consensus_queue.cc:237] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:02.286988  4104 raft_consensus.cc:1275] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:16:02.288465  4705 raft_consensus.cc:1275] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938 [term 8 LEARNER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:02.294497  8282 consensus_queue.cc:1048] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:02.306002  4032 raft_consensus.cc:1275] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:02.309710  8259 consensus_queue.cc:1048] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
W20260709 13:16:02.313705  3999 consensus_peers.cc:597] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117): Couldn't send request to peer d709ee666b774ec29aa732e508219938. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 20cb8f6ca1af4ec79acaa9f95e816ca6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:02.308826  8256 consensus_queue.cc:1048] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:16:02.330135  4099 raft_consensus.cc:1275] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:02.334961  3952 raft_consensus.cc:1275] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:16:02.345430  8237 raft_consensus.cc:2955] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index 7 to 8, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:16:02.357184  4028 raft_consensus.cc:2955] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:16:02.370067  8276 raft_consensus.cc:2955] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 LEADER]: Committing config change with OpId 11.7: config changed from index -1 to 7, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:16:02.374017  4104 raft_consensus.cc:2955] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Committing config change with OpId 11.7: config changed from index -1 to 7, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:16:02.378810  8250 consensus_queue.cc:1048] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:02.383585  8282 consensus_queue.cc:1048] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:02.406700  4700 raft_consensus.cc:2955] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:16:02.411502  4099 raft_consensus.cc:2955] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:16:02.414549  4102 consensus_queue.cc:237] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:16:02.483911  3952 raft_consensus.cc:2955] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Committing config change with OpId 11.7: config changed from index -1 to 7, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:16:02.497274  3958 raft_consensus.cc:1275] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:16:02.499786  8260 consensus_queue.cc:1048] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:02.503952  4032 raft_consensus.cc:1275] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:16:02.505630  8260 consensus_queue.cc:1048] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:16:02.503901  4073 consensus_peers.cc:597] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117): Couldn't send request to peer d709ee666b774ec29aa732e508219938. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 256a58e0d11d473c899ea90e30dbd511. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:02.515265  4099 raft_consensus.cc:2955] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:16:02.543092  3856 catalog_manager.cc:5697] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938 reported cstate change: config changed from index 7 to 8, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:16:02.621156  8260 raft_consensus.cc:2955] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 LEADER]: Committing config change with OpId 11.6: config changed from index -1 to 6, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:16:02.641312  3853 catalog_manager.cc:5697] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: config changed from index -1 to 7, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New cstate: current_term: 11 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:02.646297  3952 raft_consensus.cc:2955] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Committing config change with OpId 11.6: config changed from index -1 to 6, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:16:02.652423  4030 raft_consensus.cc:2955] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Committing config change with OpId 11.6: config changed from index -1 to 6, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:16:02.710650  4028 consensus_queue.cc:237] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:16:02.735735  3853 catalog_manager.cc:5697] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 reported cstate change: config changed from index -1 to 6, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New cstate: current_term: 11 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
W20260709 13:16:02.767355  3999 consensus_peers.cc:597] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117): Couldn't send request to peer d709ee666b774ec29aa732e508219938. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3f641c5435604e30bb44aa411954bd2f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:02.775494  4108 raft_consensus.cc:1275] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:16:02.776124  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 64614.6us
I20260709 13:16:02.775701  8329 ts_tablet_manager.cc:933] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P d709ee666b774ec29aa732e508219938: Initiating tablet copy from peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:16:02.829177  3952 raft_consensus.cc:1275] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:16:02.831073  8259 consensus_queue.cc:1048] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:02.832387  8250 consensus_queue.cc:1048] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:02.891870  8329 tablet_copy_client.cc:323] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P d709ee666b774ec29aa732e508219938: tablet copy: Beginning tablet copy session from remote peer at address 127.2.198.194:46115
I20260709 13:16:02.907068  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:02.920914  4044 tablet_copy_service.cc:140] P 6f5b5e4ed72944ecbda200012d141dc2: Received BeginTabletCopySession request for tablet 20cb8f6ca1af4ec79acaa9f95e816ca6 from peer d709ee666b774ec29aa732e508219938 ({username='slave'} at 127.0.0.1:41312)
I20260709 13:16:02.921736  4044 tablet_copy_service.cc:161] P 6f5b5e4ed72944ecbda200012d141dc2: Beginning new tablet copy session on tablet 20cb8f6ca1af4ec79acaa9f95e816ca6 from peer d709ee666b774ec29aa732e508219938 at {username='slave'} at 127.0.0.1:41312: session id = d709ee666b774ec29aa732e508219938-20cb8f6ca1af4ec79acaa9f95e816ca6
I20260709 13:16:02.937275  8277 raft_consensus.cc:2955] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 LEADER]: Committing config change with OpId 9.8: config changed from index -1 to 8, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:16:02.959075  4044 tablet_copy_source_session.cc:215] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:02.963578  3953 raft_consensus.cc:2955] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index -1 to 8, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:16:03.003787  4104 raft_consensus.cc:2955] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index -1 to 8, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:16:03.004976  3952 consensus_queue.cc:237] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:03.014123  4108 raft_consensus.cc:1275] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:16:03.016212  8237 consensus_queue.cc:1048] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:03.022377  4700 raft_consensus.cc:1275] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Refusing update from remote peer f1c75790cedf4f52a3463a255c7da059: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:16:03.026010  8256 consensus_queue.cc:1048] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:03.029390  8237 raft_consensus.cc:2955] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 8 LEADER]: Committing config change with OpId 8.9: config changed from index 8 to 9, VOTER 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:16:03.036870  4700 raft_consensus.cc:2955] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 8 to 9, VOTER 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:16:03.042265  3854 catalog_manager.cc:5697] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: config changed from index -1 to 8, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New cstate: current_term: 9 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:16:03.059336  3841 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 649df91131174f00af0e0a0240f80adb with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:03.063123  8329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20cb8f6ca1af4ec79acaa9f95e816ca6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:03.094197  3854 catalog_manager.cc:5697] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938 reported cstate change: config changed from index 8 to 9, VOTER 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) evicted. New cstate: current_term: 8 leader_uuid: "f1c75790cedf4f52a3463a255c7da059" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:16:03.119724  4017 tablet_service.cc:1558] Processing DeleteTablet for tablet 649df91131174f00af0e0a0240f80adb with delete_type TABLET_DATA_TOMBSTONED (TS 6f5b5e4ed72944ecbda200012d141dc2 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:35598
I20260709 13:16:03.124696  8337 tablet_replica.cc:333] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:16:03.126627  4104 raft_consensus.cc:2955] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 8 to 9, VOTER 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:16:03.128266  8337 raft_consensus.cc:2243] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:03.183422  8337 raft_consensus.cc:2272] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:03.218988  8338 ts_tablet_manager.cc:933] T 256a58e0d11d473c899ea90e30dbd511 P d709ee666b774ec29aa732e508219938: Initiating tablet copy from peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:16:03.201936  8337 ts_tablet_manager.cc:1916] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:03.233476  3952 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102"
dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
mode: GRACEFUL
new_leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:35222
I20260709 13:16:03.234668  3952 raft_consensus.cc:606] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 10 LEADER]: Received request to transfer leadership to TS 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:16:03.228510  8329 tablet_copy_client.cc:806] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:03.239173  3952 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b2556690d2041edb61d331163aced7d"
dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
mode: GRACEFUL
new_leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
 from {username='slave'} at 127.0.0.1:35222
I20260709 13:16:03.239873  3952 raft_consensus.cc:606] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 11 LEADER]: Received request to transfer leadership to TS 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:16:03.243467  8338 tablet_copy_client.cc:323] T 256a58e0d11d473c899ea90e30dbd511 P d709ee666b774ec29aa732e508219938: tablet copy: Beginning tablet copy session from remote peer at address 127.2.198.195:37843
I20260709 13:16:03.244081  3952 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f"
dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
mode: GRACEFUL
new_leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:35222
I20260709 13:16:03.245919  4117 tablet_copy_service.cc:140] P 8952c48a6f3a43968f7d77f7bfc4d1bc: Received BeginTabletCopySession request for tablet 256a58e0d11d473c899ea90e30dbd511 from peer d709ee666b774ec29aa732e508219938 ({username='slave'} at 127.0.0.1:34656)
I20260709 13:16:03.246708  4117 tablet_copy_service.cc:161] P 8952c48a6f3a43968f7d77f7bfc4d1bc: Beginning new tablet copy session on tablet 256a58e0d11d473c899ea90e30dbd511 from peer d709ee666b774ec29aa732e508219938 at {username='slave'} at 127.0.0.1:34656: session id = d709ee666b774ec29aa732e508219938-256a58e0d11d473c899ea90e30dbd511
I20260709 13:16:03.257637  4117 tablet_copy_source_session.cc:215] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:03.259459  3952 raft_consensus.cc:606] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Received request to transfer leadership to TS 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:16:03.261204  2843 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:16:03.261597  8338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 256a58e0d11d473c899ea90e30dbd511. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:03.263233  2843 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:03.299990  8329 tablet_copy_client.cc:670] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:03.307459  8329 tablet_copy_client.cc:538] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P d709ee666b774ec29aa732e508219938: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:03.322894  8340 ts_tablet_manager.cc:933] T 3f641c5435604e30bb44aa411954bd2f P d709ee666b774ec29aa732e508219938: Initiating tablet copy from peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:16:03.347594  8237 raft_consensus.cc:993] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059: : Instructing follower 6f5b5e4ed72944ecbda200012d141dc2 to start an election
I20260709 13:16:03.350661  8337 ts_tablet_manager.cc:1929] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 8.8
I20260709 13:16:03.362228  8333 raft_consensus.cc:1081] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Signalling peer 6f5b5e4ed72944ecbda200012d141dc2 to start an election
I20260709 13:16:03.352319  8340 tablet_copy_client.cc:323] T 3f641c5435604e30bb44aa411954bd2f P d709ee666b774ec29aa732e508219938: tablet copy: Beginning tablet copy session from remote peer at address 127.2.198.194:46115
I20260709 13:16:03.362377  8337 log.cc:1199] T 649df91131174f00af0e0a0240f80adb P 6f5b5e4ed72944ecbda200012d141dc2: Deleting WAL directory at /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/ts-1-root/wals/649df91131174f00af0e0a0240f80adb
I20260709 13:16:03.367126  3844 catalog_manager.cc:5028] TS 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): tablet 649df91131174f00af0e0a0240f80adb (table test-workload [id=8a2760e8528448a780fea6ccf25816cb]) successfully deleted
I20260709 13:16:03.368629  4044 tablet_copy_service.cc:140] P 6f5b5e4ed72944ecbda200012d141dc2: Received BeginTabletCopySession request for tablet 3f641c5435604e30bb44aa411954bd2f from peer d709ee666b774ec29aa732e508219938 ({username='slave'} at 127.0.0.1:41312)
I20260709 13:16:03.369254  4044 tablet_copy_service.cc:161] P 6f5b5e4ed72944ecbda200012d141dc2: Beginning new tablet copy session on tablet 3f641c5435604e30bb44aa411954bd2f from peer d709ee666b774ec29aa732e508219938 at {username='slave'} at 127.0.0.1:41312: session id = d709ee666b774ec29aa732e508219938-3f641c5435604e30bb44aa411954bd2f
I20260709 13:16:03.370893  8329 tablet_bootstrap.cc:492] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P d709ee666b774ec29aa732e508219938: Bootstrap starting.
I20260709 13:16:03.376978  4030 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f"
dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:38304
I20260709 13:16:03.384392  4030 raft_consensus.cc:493] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:03.384886  4030 raft_consensus.cc:3060] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:03.394802  4030 raft_consensus.cc:515] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:03.397625  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:16:03.398305  3953 raft_consensus.cc:3055] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:03.398324  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:16:03.398697  3953 raft_consensus.cc:740] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:16:03.399032  4108 raft_consensus.cc:3060] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:03.400840  3953 consensus_queue.cc:260] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:03.400501  4030 leader_election.cc:290] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:16:03.403223  8338 tablet_copy_client.cc:806] T 256a58e0d11d473c899ea90e30dbd511 P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:03.408423  3953 raft_consensus.cc:3060] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:03.409348  4044 tablet_copy_source_session.cc:215] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:03.422348  4108 raft_consensus.cc:2468] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 10.
I20260709 13:16:03.420186  8338 tablet_copy_client.cc:670] T 256a58e0d11d473c899ea90e30dbd511 P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:03.426468  8340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f641c5435604e30bb44aa411954bd2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:03.436033  3997 leader_election.cc:304] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:16:03.438053  8250 raft_consensus.cc:2804] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:03.438629  8250 raft_consensus.cc:697] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:16:03.442023  8338 tablet_copy_client.cc:538] T 256a58e0d11d473c899ea90e30dbd511 P d709ee666b774ec29aa732e508219938: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:03.439528  8250 consensus_queue.cc:237] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:03.468974  3953 raft_consensus.cc:2468] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 10.
I20260709 13:16:03.472111  8338 tablet_bootstrap.cc:492] T 256a58e0d11d473c899ea90e30dbd511 P d709ee666b774ec29aa732e508219938: Bootstrap starting.
I20260709 13:16:03.495867  8340 tablet_copy_client.cc:806] T 3f641c5435604e30bb44aa411954bd2f P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:03.496805  8340 tablet_copy_client.cc:670] T 3f641c5435604e30bb44aa411954bd2f P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:03.516294  8340 tablet_copy_client.cc:538] T 3f641c5435604e30bb44aa411954bd2f P d709ee666b774ec29aa732e508219938: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:03.536566  3853 catalog_manager.cc:5697] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 9 to 10, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 10 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:03.564965  8329 tablet_bootstrap.cc:492] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P d709ee666b774ec29aa732e508219938: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:03.568024  8329 tablet_bootstrap.cc:492] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P d709ee666b774ec29aa732e508219938: Bootstrap complete.
I20260709 13:16:03.580315  8329 ts_tablet_manager.cc:1403] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P d709ee666b774ec29aa732e508219938: Time spent bootstrapping tablet: real 0.210s	user 0.021s	sys 0.020s
I20260709 13:16:03.587754  8338 tablet_bootstrap.cc:492] T 256a58e0d11d473c899ea90e30dbd511 P d709ee666b774ec29aa732e508219938: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:03.588925  8338 tablet_bootstrap.cc:492] T 256a58e0d11d473c899ea90e30dbd511 P d709ee666b774ec29aa732e508219938: Bootstrap complete.
I20260709 13:16:03.593277  8338 ts_tablet_manager.cc:1403] T 256a58e0d11d473c899ea90e30dbd511 P d709ee666b774ec29aa732e508219938: Time spent bootstrapping tablet: real 0.121s	user 0.025s	sys 0.015s
I20260709 13:16:03.566309  8340 tablet_bootstrap.cc:492] T 3f641c5435604e30bb44aa411954bd2f P d709ee666b774ec29aa732e508219938: Bootstrap starting.
I20260709 13:16:03.608992  8338 raft_consensus.cc:359] T 256a58e0d11d473c899ea90e30dbd511 P d709ee666b774ec29aa732e508219938 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:16:03.617020  8338 raft_consensus.cc:740] T 256a58e0d11d473c899ea90e30dbd511 P d709ee666b774ec29aa732e508219938 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Initialized, Role: LEARNER
I20260709 13:16:03.617942  8329 raft_consensus.cc:359] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P d709ee666b774ec29aa732e508219938 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:16:03.634155  8329 raft_consensus.cc:740] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P d709ee666b774ec29aa732e508219938 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Initialized, Role: LEARNER
I20260709 13:16:03.618820  8338 consensus_queue.cc:260] T 256a58e0d11d473c899ea90e30dbd511 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:16:03.641691  8333 raft_consensus.cc:993] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059: : Instructing follower 6f5b5e4ed72944ecbda200012d141dc2 to start an election
I20260709 13:16:03.642019  8338 ts_tablet_manager.cc:1434] T 256a58e0d11d473c899ea90e30dbd511 P d709ee666b774ec29aa732e508219938: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
I20260709 13:16:03.642414  8333 raft_consensus.cc:1081] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 10 LEADER]: Signalling peer 6f5b5e4ed72944ecbda200012d141dc2 to start an election
I20260709 13:16:03.635064  8329 consensus_queue.cc:260] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:16:03.645383  4033 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102"
dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
 from {username='slave'} at 127.0.0.1:38304
I20260709 13:16:03.646009  4033 raft_consensus.cc:493] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:03.646479  4033 raft_consensus.cc:3060] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:03.657191  8329 ts_tablet_manager.cc:1434] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P d709ee666b774ec29aa732e508219938: Time spent starting tablet: real 0.076s	user 0.007s	sys 0.000s
I20260709 13:16:03.674134  4044 tablet_copy_service.cc:342] P 6f5b5e4ed72944ecbda200012d141dc2: Request end of tablet copy session d709ee666b774ec29aa732e508219938-20cb8f6ca1af4ec79acaa9f95e816ca6 received from {username='slave'} at 127.0.0.1:41312
I20260709 13:16:03.674703  4044 tablet_copy_service.cc:434] P 6f5b5e4ed72944ecbda200012d141dc2: ending tablet copy session d709ee666b774ec29aa732e508219938-20cb8f6ca1af4ec79acaa9f95e816ca6 on tablet 20cb8f6ca1af4ec79acaa9f95e816ca6 with peer d709ee666b774ec29aa732e508219938
I20260709 13:16:03.675232  4117 tablet_copy_service.cc:342] P 8952c48a6f3a43968f7d77f7bfc4d1bc: Request end of tablet copy session d709ee666b774ec29aa732e508219938-256a58e0d11d473c899ea90e30dbd511 received from {username='slave'} at 127.0.0.1:34656
I20260709 13:16:03.675792  4117 tablet_copy_service.cc:434] P 8952c48a6f3a43968f7d77f7bfc4d1bc: ending tablet copy session d709ee666b774ec29aa732e508219938-256a58e0d11d473c899ea90e30dbd511 on tablet 256a58e0d11d473c899ea90e30dbd511 with peer d709ee666b774ec29aa732e508219938
I20260709 13:16:03.691183  4033 raft_consensus.cc:515] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:03.694576  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:16:03.695276  3953 raft_consensus.cc:3055] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:03.695657  3953 raft_consensus.cc:740] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:16:03.696519  3953 consensus_queue.cc:260] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:03.698398  3953 raft_consensus.cc:3060] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:03.710866  4033 leader_election.cc:290] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:16:03.714103  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:16:03.714778  4108 raft_consensus.cc:3060] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:03.725129  8237 raft_consensus.cc:993] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059: : Instructing follower 8952c48a6f3a43968f7d77f7bfc4d1bc to start an election
I20260709 13:16:03.725734  8333 raft_consensus.cc:1081] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 11 LEADER]: Signalling peer 8952c48a6f3a43968f7d77f7bfc4d1bc to start an election
I20260709 13:16:03.727440  4104 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b2556690d2041edb61d331163aced7d"
dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
 from {username='slave'} at 127.0.0.1:45332
I20260709 13:16:03.728048  4104 raft_consensus.cc:493] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:03.728390  4104 raft_consensus.cc:3060] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:03.728988  4108 raft_consensus.cc:2468] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 11.
I20260709 13:16:03.730847  3953 raft_consensus.cc:2468] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 11.
I20260709 13:16:03.733059  3997 leader_election.cc:304] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:16:03.734102  8259 raft_consensus.cc:2804] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:03.734627  8259 raft_consensus.cc:697] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:16:03.735644  8259 consensus_queue.cc:237] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:03.738063  4104 raft_consensus.cc:515] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:03.745056  3953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "f1c75790cedf4f52a3463a255c7da059"
I20260709 13:16:03.745772  3953 raft_consensus.cc:3055] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:03.746132  3953 raft_consensus.cc:740] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f1c75790cedf4f52a3463a255c7da059, State: Running, Role: LEADER
I20260709 13:16:03.747008  3953 consensus_queue.cc:260] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:03.748553  3953 raft_consensus.cc:3060] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:03.752627  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:16:03.753297  4033 raft_consensus.cc:3060] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:03.760558  3953 raft_consensus.cc:2468] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 12.
I20260709 13:16:03.761737  4033 raft_consensus.cc:2468] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 12.
I20260709 13:16:03.762349  4104 leader_election.cc:290] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:16:03.770751  8340 tablet_bootstrap.cc:492] T 3f641c5435604e30bb44aa411954bd2f P d709ee666b774ec29aa732e508219938: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:03.771965  8340 tablet_bootstrap.cc:492] T 3f641c5435604e30bb44aa411954bd2f P d709ee666b774ec29aa732e508219938: Bootstrap complete.
I20260709 13:16:03.775147  4071 leader_election.cc:304] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059; no voters: 
I20260709 13:16:03.782006  8340 ts_tablet_manager.cc:1403] T 3f641c5435604e30bb44aa411954bd2f P d709ee666b774ec29aa732e508219938: Time spent bootstrapping tablet: real 0.216s	user 0.029s	sys 0.016s
I20260709 13:16:03.781247  3853 catalog_manager.cc:5697] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 10 to 11, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 11 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:03.783455  8334 raft_consensus.cc:2804] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:03.784049  8334 raft_consensus.cc:697] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:16:03.785003  8334 consensus_queue.cc:237] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:03.805532  8340 raft_consensus.cc:359] T 3f641c5435604e30bb44aa411954bd2f P d709ee666b774ec29aa732e508219938 [term 9 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:16:03.806800  8340 raft_consensus.cc:740] T 3f641c5435604e30bb44aa411954bd2f P d709ee666b774ec29aa732e508219938 [term 9 LEARNER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Initialized, Role: LEARNER
I20260709 13:16:03.807711  8340 consensus_queue.cc:260] T 3f641c5435604e30bb44aa411954bd2f P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:16:03.826122  4700 raft_consensus.cc:1217] T 256a58e0d11d473c899ea90e30dbd511 P d709ee666b774ec29aa732e508219938 [term 11 LEARNER]: Deduplicated request from leader. Original: 11.5->[11.6-11.6]   Dedup: 11.6->[]
I20260709 13:16:03.828052  8340 ts_tablet_manager.cc:1434] T 3f641c5435604e30bb44aa411954bd2f P d709ee666b774ec29aa732e508219938: Time spent starting tablet: real 0.046s	user 0.010s	sys 0.000s
I20260709 13:16:03.831880  4044 tablet_copy_service.cc:342] P 6f5b5e4ed72944ecbda200012d141dc2: Request end of tablet copy session d709ee666b774ec29aa732e508219938-3f641c5435604e30bb44aa411954bd2f received from {username='slave'} at 127.0.0.1:41312
I20260709 13:16:03.832428  4044 tablet_copy_service.cc:434] P 6f5b5e4ed72944ecbda200012d141dc2: ending tablet copy session d709ee666b774ec29aa732e508219938-3f641c5435604e30bb44aa411954bd2f on tablet 3f641c5435604e30bb44aa411954bd2f with peer d709ee666b774ec29aa732e508219938
I20260709 13:16:03.841794  4700 raft_consensus.cc:1217] T 3f641c5435604e30bb44aa411954bd2f P d709ee666b774ec29aa732e508219938 [term 9 LEARNER]: Deduplicated request from leader. Original: 9.7->[9.8-9.8]   Dedup: 9.8->[]
I20260709 13:16:03.921216  4700 raft_consensus.cc:1217] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P d709ee666b774ec29aa732e508219938 [term 11 LEARNER]: Deduplicated request from leader. Original: 11.6->[11.7-11.7]   Dedup: 11.7->[]
I20260709 13:16:03.921334  4104 raft_consensus.cc:1275] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:16:03.927014  3853 catalog_manager.cc:5697] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 11 to 12, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 12 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:03.929227  8324 consensus_queue.cc:1048] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:03.983920  3953 raft_consensus.cc:1275] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:16:03.991797  8348 consensus_queue.cc:1048] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
W20260709 13:16:04.081163  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 44095.2us
I20260709 13:16:04.204254  4033 raft_consensus.cc:1275] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:16:04.204610  8325 raft_consensus.cc:1064] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc: attempting to promote NON_VOTER d709ee666b774ec29aa732e508219938 to VOTER
I20260709 13:16:04.207631  8325 consensus_queue.cc:237] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 4, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:04.208079  8334 consensus_queue.cc:1048] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:04.243795  4700 raft_consensus.cc:1275] T 256a58e0d11d473c899ea90e30dbd511 P d709ee666b774ec29aa732e508219938 [term 11 LEARNER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:16:04.245671  8334 consensus_queue.cc:1048] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:04.255993  3953 raft_consensus.cc:1275] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:16:04.257846  4030 raft_consensus.cc:1275] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:16:04.257756  8347 consensus_queue.cc:1048] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:04.259410  8326 consensus_queue.cc:1048] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:04.274586  3952 raft_consensus.cc:1275] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:16:04.279739  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:04.283299  8334 consensus_queue.cc:1048] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:04.342124  3958 raft_consensus.cc:1275] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:16:04.374487  8326 consensus_queue.cc:1048] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:16:04.407508  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 64927.4us
I20260709 13:16:04.420126  2843 tablet_server.cc:179] TabletServer@127.2.198.193:0 shutting down...
I20260709 13:16:04.413712  8326 raft_consensus.cc:2955] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 LEADER]: Committing config change with OpId 11.7: config changed from index 6 to 7, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
W20260709 13:16:04.470052  4672 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 8 similar messages]
W20260709 13:16:04.472672  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 64243.8us
I20260709 13:16:04.488957  4104 raft_consensus.cc:1275] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:16:04.553412  8347 raft_consensus.cc:1064] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2: attempting to promote NON_VOTER d709ee666b774ec29aa732e508219938 to VOTER
I20260709 13:16:04.606833  8347 consensus_queue.cc:237] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:16:04.722182  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 252298us
W20260709 13:16:04.740134  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 204499us
W20260709 13:16:04.897574  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 57868.8us
I20260709 13:16:04.838406  4033 raft_consensus.cc:2955] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Committing config change with OpId 11.7: config changed from index 6 to 7, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
W20260709 13:16:04.912250  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 71801.3us
W20260709 13:16:04.931668  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:04.976016  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 79528.6us
W20260709 13:16:05.001134  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 528665us
I20260709 13:16:05.015798  4099 raft_consensus.cc:1275] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:16:05.026738  3999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.030982  8380 consensus_queue.cc:1048] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:05.040027  3854 catalog_manager.cc:5697] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: config changed from index 6 to 7, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:05.049670  8347 consensus_queue.cc:1048] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:05.051182  4705 raft_consensus.cc:1275] T 3f641c5435604e30bb44aa411954bd2f P d709ee666b774ec29aa732e508219938 [term 9 LEARNER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:16:05.054171  4705 raft_consensus.cc:2955] T 256a58e0d11d473c899ea90e30dbd511 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Committing config change with OpId 11.7: config changed from index 6 to 7, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
W20260709 13:16:04.999298  4672 consensus_peers.cc:597] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:05.085316  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 86075.9us
W20260709 13:16:05.087502  4672 consensus_peers.cc:597] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:05.112242  8324 consensus_queue.cc:1048] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:16:05.114727  3997 consensus_peers.cc:597] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:05.120873  8259 raft_consensus.cc:1064] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2: attempting to promote NON_VOTER d709ee666b774ec29aa732e508219938 to VOTER
W20260709 13:16:05.103718  4672 consensus_peers.cc:597] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:05.126943  4672 consensus_peers.cc:597] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:05.127583  4672 consensus_peers.cc:597] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:05.184752  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 75771.7us
I20260709 13:16:05.170094  8259 consensus_queue.cc:237] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 5, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:16:05.224432  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 44683.6us
W20260709 13:16:05.272809  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 43679.4us
W20260709 13:16:05.274065  3997 consensus_peers.cc:597] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:05.277307  3997 consensus_peers.cc:597] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:05.277923  3997 consensus_peers.cc:597] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:05.278373  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 137406us
W20260709 13:16:05.280217  3997 consensus_peers.cc:597] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:05.281498  3997 consensus_peers.cc:597] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:05.282248  3997 consensus_peers.cc:597] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:05.285447  3997 consensus_peers.cc:597] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:05.286193  3997 consensus_peers.cc:597] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:05.290375  3997 consensus_peers.cc:597] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:05.291010  3997 consensus_peers.cc:597] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:05.291878  3997 consensus_peers.cc:597] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:05.292680  3997 consensus_peers.cc:597] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:05.294246  3997 consensus_peers.cc:597] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:05.308300  4672 consensus_peers.cc:597] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:05.313858  4672 consensus_peers.cc:597] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:05.317726  4672 consensus_peers.cc:597] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:05.318403  4071 consensus_peers.cc:597] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:05.337700  4709 raft_consensus.cc:1275] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P d709ee666b774ec29aa732e508219938 [term 11 LEARNER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:16:05.337700  4071 consensus_peers.cc:597] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:05.353777  4104 raft_consensus.cc:1275] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:16:05.366362  8393 raft_consensus.cc:493] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
W20260709 13:16:05.359859  4071 consensus_peers.cc:597] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:05.368813  8377 raft_consensus.cc:493] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:16:05.370796  8393 raft_consensus.cc:515] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:05.381300  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:16:05.383888  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:16:05.371764  8377 raft_consensus.cc:515] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:05.396835  8368 raft_consensus.cc:493] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:16:05.397509  8368 raft_consensus.cc:515] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:16:05.398865  4071 consensus_peers.cc:597] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:05.399581  4071 consensus_peers.cc:597] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:05.400188  4071 consensus_peers.cc:597] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:05.400740  4071 consensus_peers.cc:597] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:05.401288  4071 consensus_peers.cc:597] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:05.402190  4071 consensus_peers.cc:597] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:05.402897  8388 raft_consensus.cc:493] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:16:05.403501  8388 raft_consensus.cc:515] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:05.403863  4709 raft_consensus.cc:2955] T 3f641c5435604e30bb44aa411954bd2f P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:16:05.405689  8388 leader_election.cc:290] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:16:05.365267  8369 consensus_queue.cc:1048] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:16:05.416352  8388 raft_consensus.cc:493] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:05.416998  8388 raft_consensus.cc:515] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:16:05.428781  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 61577.1us
I20260709 13:16:05.379204  8393 leader_election.cc:290] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:16:05.409688  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:16:05.444252  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:16:05.434384  4071 consensus_peers.cc:597] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:05.448879  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba65f329a14453da0acb3230a4ac721" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:16:05.451982  3922 leader_election.cc:304] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
W20260709 13:16:05.452471  4071 consensus_peers.cc:597] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:05.454644  4071 consensus_peers.cc:597] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:05.460781  8382 raft_consensus.cc:493] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:16:05.461411  8382 raft_consensus.cc:515] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:05.450788  8347 consensus_queue.cc:1048] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:16:05.466279  8333 raft_consensus.cc:2749] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:05.470347  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bb8c27fe534b22824e326e191a66f0" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:16:05.471432  8377 leader_election.cc:290] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:16:05.473400  4071 consensus_peers.cc:597] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:05.476392  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:16:05.478521  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:16:05.482187  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:16:05.469878  8368 leader_election.cc:290] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:16:05.470737  8382 leader_election.cc:290] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:16:05.476040  8373 raft_consensus.cc:493] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:16:05.493557  8393 raft_consensus.cc:493] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:16:05.495860  8381 raft_consensus.cc:493] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:05.513849  8377 raft_consensus.cc:493] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:16:05.422904  8380 raft_consensus.cc:2955] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 LEADER]: Committing config change with OpId 9.9: config changed from index 8 to 9, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:16:05.539870  8383 raft_consensus.cc:493] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:05.540587  8383 raft_consensus.cc:515] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:05.541355  8300 raft_consensus.cc:493] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:16:05.541913  8300 raft_consensus.cc:515] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:05.542914  8383 leader_election.cc:290] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:16:05.516559  8381 raft_consensus.cc:515] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:16:05.548754  8381 leader_election.cc:290] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:16:05.517446  8377 raft_consensus.cc:515] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:05.558792  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:16:05.559585  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:16:05.509584  8393 raft_consensus.cc:515] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:16:05.569900  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 125289us
I20260709 13:16:05.617434  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:16:05.625072  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 151756us
I20260709 13:16:05.516304  8373 raft_consensus.cc:515] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:05.650520  3922 leader_election.cc:304] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:16:05.649864  8383 raft_consensus.cc:493] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:16:05.662482  8383 raft_consensus.cc:515] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:05.663308  8237 raft_consensus.cc:2749] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:05.665335  8389 raft_consensus.cc:493] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:05.666079  8389 raft_consensus.cc:515] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:05.675843  8407 raft_consensus.cc:493] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:16:05.676802  8407 raft_consensus.cc:515] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:05.659767  8300 leader_election.cc:290] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:16:05.711789  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:16:05.712468  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 89533.8us
I20260709 13:16:05.686812  8383 leader_election.cc:290] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:16:05.716248  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 65870.2us
I20260709 13:16:05.718580  3922 leader_election.cc:304] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:16:05.688546  8388 leader_election.cc:290] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:16:05.709650  8381 raft_consensus.cc:493] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:05.734364  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7a2dc30a24e5caaa3806c68b96c08" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:16:05.714255  8377 leader_election.cc:290] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:16:05.741876  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d794b0f694d089b1b011ba8adea36" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:16:05.748687  8408 raft_consensus.cc:493] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:05.749307  8408 raft_consensus.cc:515] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:05.752502  8393 leader_election.cc:290] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:16:05.738948  8383 raft_consensus.cc:2749] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:05.753336  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:16:05.716940  8407 leader_election.cc:290] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:16:05.731971  8333 raft_consensus.cc:493] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:05.776808  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55dd6943e7742738991bb00da84127e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:16:05.780541  8383 raft_consensus.cc:493] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:16:05.789532  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4845eaa52cb4965b9c8922f37e2f606" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:16:05.783895  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff80427d8324bd386a3ac9ff13d768e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:16:05.740157  8237 raft_consensus.cc:493] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:05.800282  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:16:05.802327  3999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 135644us
I20260709 13:16:05.754590  8408 leader_election.cc:290] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:16:05.780198  8393 raft_consensus.cc:493] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:16:05.783598  8407 raft_consensus.cc:493] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:16:05.773571  8381 raft_consensus.cc:515] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:05.814217  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:16:05.814850  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:16:05.819808  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:16:05.820014  8388 raft_consensus.cc:493] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:16:05.819577  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd023a8b08e942db8236dd7bae557ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:16:05.826215  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:16:05.812893  8408 raft_consensus.cc:493] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:05.831666  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:16:05.835989  8415 raft_consensus.cc:493] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:05.836215  8373 leader_election.cc:290] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:16:05.813706  8237 raft_consensus.cc:515] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:05.840691  8237 leader_election.cc:290] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:16:05.836733  8415 raft_consensus.cc:515] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:05.822602  8393 raft_consensus.cc:515] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:05.842988  8393 leader_election.cc:290] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:16:05.843089  8415 leader_election.cc:290] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:16:05.845608  8377 raft_consensus.cc:493] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:05.846282  8377 raft_consensus.cc:515] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:05.803349  8383 raft_consensus.cc:515] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:05.820855  8300 raft_consensus.cc:493] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:16:05.847929  8300 raft_consensus.cc:515] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:05.814366  8407 raft_consensus.cc:515] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:05.820560  8388 raft_consensus.cc:515] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:05.858990  8408 raft_consensus.cc:515] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:05.801927  8333 raft_consensus.cc:515] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:05.897437  8407 leader_election.cc:290] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:16:05.904256  8381 leader_election.cc:290] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:16:05.904932  8408 leader_election.cc:290] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:16:05.905761  8377 leader_election.cc:290] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:16:05.907887  8333 leader_election.cc:290] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:16:05.909729  8388 leader_election.cc:290] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:16:05.910596  8389 leader_election.cc:290] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:16:05.898656  8383 leader_election.cc:290] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:16:05.943674  4100 raft_consensus.cc:2955] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:16:05.959306  8389 raft_consensus.cc:493] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:16:05.960081  8389 raft_consensus.cc:515] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:05.962366  8389 leader_election.cc:290] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:16:05.962404  8300 leader_election.cc:290] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:16:05.967716  8377 raft_consensus.cc:493] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:16:05.967885  8300 raft_consensus.cc:493] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:16:05.968433  8377 raft_consensus.cc:515] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:05.969992  3854 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52104 (request call id 232) took 1236 ms. Trace:
I20260709 13:16:05.970974  8377 leader_election.cc:290] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:16:05.968513  8300 raft_consensus.cc:515] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:05.985525  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2705becfe8874dbe97b71d14b12feb8f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:16:05.997507  8300 leader_election.cc:290] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:16:05.997678  4102 consensus_queue.cc:237] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:05.998205  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd24fa3ec4ab41cabe4bcfae21f055f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:16:05.999094  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:16:05.999790  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2641ff9849458a9200dfc5a9016cce" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:16:05.993868  8389 raft_consensus.cc:493] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:06.089454  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:16:06.089359  3924 leader_election.cc:304] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
W20260709 13:16:06.092677  3997 consensus_peers.cc:597] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:06.123284  3924 leader_election.cc:304] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
W20260709 13:16:06.171954  8391 log.cc:927] Time spent T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:16:05.970470  3854 rpcz_store.cc:276] 0709 13:16:04.733720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.734129 (+   409us) service_pool.cc:224] Handling call
0709 13:16:04.970640 (+236511us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b5400428954. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d8090 00007f1525676f3a 00007f152b42d1cc 00007f152b52b37e 00007f15299ec2a4 00007f15299ec232 00007f15299ec161 00007f15299ec0dc 00007f15299eb392 00007f15239a948c 00007f15239a88c6
0709 13:16:05.969898 (+999258us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:05.186343 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:05.208247 (+ 21904us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:05.208294 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:16:05.208339 (+    45us) tablet.cc:662] Decoding operations
0709 13:16:05.208734 (+   395us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:05.208818 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:05.208856 (+    38us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:16:05.209056 (+   200us) tablet.cc:701] Row locks acquired
0709 13:16:05.209075 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:16:05.209230 (+   155us) write_op.cc:270] Start()
0709 13:16:05.209374 (+   144us) write_op.cc:276] Timestamp: P: 1783602965209177 usec, L: 0
0709 13:16:05.209402 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:16:05.210132 (+   730us) log.cc:844] Serialized 599 byte log entry
0709 13:16:05.652918 (+442786us) op_driver.cc:464] REPLICATION: finished
0709 13:16:05.837726 (+184808us) write_op.cc:301] APPLY: starting
0709 13:16:05.837828 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:05.839048 (+  1220us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:05.839160 (+   112us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:05.839931 (+   771us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:05.840124 (+   193us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:16:05.840172 (+    48us) write_op.cc:312] APPLY: finished
0709 13:16:05.840382 (+   210us) log.cc:844] Serialized 25 byte log entry
0709 13:16:05.844247 (+  3865us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:05.844385 (+   138us) write_op.cc:454] Released schema lock
0709 13:16:05.844432 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:05.845735 (+  1303us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:05.845776 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":42150656,"child_traces":[["op",{"apply.queue_time_us":176105,"apply.run_cpu_time_us":3504,"apply.run_wall_time_us":7565,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8313,"num_ops":1,"prepare.queue_time_us":108786,"prepare.run_cpu_time_us":19619,"prepare.run_wall_time_us":122604,"raft.queue_time_us":258630,"raft.run_cpu_time_us":51943,"raft.run_wall_time_us":141104,"replication_time_us":420491,"thread_start_us":411859,"threads_started":4,"wal-append.queue_time_us":118418}]]}
I20260709 13:16:06.172394  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:16:06.034063  8388 raft_consensus.cc:493] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
W20260709 13:16:06.176482  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 53244.1us
I20260709 13:16:06.177627  3924 leader_election.cc:304] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:16:06.190486  8368 raft_consensus.cc:2749] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:06.170147  8382 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:16:06.192273  8382 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:06.194422  8382 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:16:06.200407  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:16:06.205195  4073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.179291  8393 raft_consensus.cc:2749] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:06.212560  8368 raft_consensus.cc:493] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:06.213315  8368 raft_consensus.cc:515] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:16:06.215873  8368 leader_election.cc:290] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:16:06.220134  8368 raft_consensus.cc:493] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:06.220741  8368 raft_consensus.cc:515] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:06.222925  8368 leader_election.cc:290] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:16:06.225441  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:16:06.185225  8373 raft_consensus.cc:2749] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:06.229107  4705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:16:06.232366  8388 raft_consensus.cc:515] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:06.027669  8389 raft_consensus.cc:515] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:06.239888  8389 leader_election.cc:290] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:16:06.248407  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:16:06.249212  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:16:06.249718  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:16:06.250262  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e863d888e2a4327a9127a43deb1f1b9" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:16:06.250705  4031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae506e79ba348b3b1db60ecc6ae6714" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:16:06.251757  4034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:16:06.251902  4033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:16:06.252171  4027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:16:06.253141  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:16:06.254462  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:16:06.249841  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:16:06.261780  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9873af7d73cf49f3b2d74a17cf7cd3bf" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:16:06.263250  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:16:06.234836  8388 leader_election.cc:290] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:16:06.286542  3853 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52094 (request call id 225) took 1218 ms. Trace:
I20260709 13:16:06.266328  8417 raft_consensus.cc:2955] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 LEADER]: Committing config change with OpId 11.8: config changed from index 7 to 8, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
W20260709 13:16:06.301509  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 179098us
I20260709 13:16:06.308359  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ea3a969108486bbbaaaf3697e1d3b5" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:16:06.309332  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d55b0c8cf6547cb8c135f6ecdfce39f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:16:06.309478  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59fe7d824ba4030a574c8f7172dab57" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:16:06.310190  4099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:16:06.316346  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6f1e6f6803e4a459cce95251d23c854" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:16:06.287281  3853 rpcz_store.cc:276] 0709 13:16:05.067853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.067999 (+   146us) service_pool.cc:224] Handling call
0709 13:16:06.286470 (+1218471us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5016,"reported_tablets":3,"spinlock_wait_cycles":4864}
I20260709 13:16:06.327106  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604474f002cb41eb9125fc14353547d2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:16:06.327401  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ffdd65ef5c4d8982bdf6556426ee40" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:16:06.327754  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3e65834a74410e9f2fa3b0e16b1e1e" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:16:06.174762  8407 raft_consensus.cc:493] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:16:06.329422  3922 leader_election.cc:304] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:16:06.331341  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:16:06.332353  4706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:16:06.337883  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:16:06.337548  4700 raft_consensus.cc:2955] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index 7 to 8, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
W20260709 13:16:06.359571  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 157501us
I20260709 13:16:06.356001  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ebbb84155f1455d87aab7fd5d78e3d8" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:16:06.365044  4702 raft_consensus.cc:1275] T 256a58e0d11d473c899ea90e30dbd511 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:16:06.367415  8431 raft_consensus.cc:2749] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:06.368985  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad706e81088440eaa86606b68c1c2c5f" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:16:06.377264  3922 leader_election.cc:304] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:16:06.380364  3922 leader_election.cc:304] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:16:06.335413  8407 raft_consensus.cc:515] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:06.388013  3922 leader_election.cc:304] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:16:06.388850  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:16:06.377950  4108 raft_consensus.cc:2955] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index 7 to 8, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:16:06.384147  8431 raft_consensus.cc:2749] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:06.399492  3922 leader_election.cc:304] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:16:06.388906  8333 raft_consensus.cc:2749] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:06.402872  3922 leader_election.cc:304] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:16:06.391829  8377 raft_consensus.cc:2749] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:06.409531  3922 leader_election.cc:304] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:16:06.405951  8389 raft_consensus.cc:2749] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:06.401852  8382 raft_consensus.cc:2749] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:06.433691  8383 raft_consensus.cc:2749] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:06.436690  8407 leader_election.cc:290] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:16:06.440475  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:16:06.440950  4026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:16:06.442026  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:16:06.444487  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d6732bceef4220a670ac449347258b" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:16:06.388888  8409 consensus_queue.cc:1048] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
W20260709 13:16:06.460753  3922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 48878.2us
I20260709 13:16:06.461812  3922 leader_election.cc:304] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:16:06.454196  3853 catalog_manager.cc:5697] T 3f641c5435604e30bb44aa411954bd2f P d709ee666b774ec29aa732e508219938 reported cstate change: config changed from index 8 to 9, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New cstate: current_term: 9 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:16:06.477598  3922 leader_election.cc:304] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:16:06.479581  8377 raft_consensus.cc:2749] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:06.480325  8377 raft_consensus.cc:2749] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:06.483039  3925 leader_election.cc:304] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:16:06.484135  8237 raft_consensus.cc:2749] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:06.485127  3925 leader_election.cc:304] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:16:06.486969  3925 leader_election.cc:304] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:16:06.488885  3922 leader_election.cc:304] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:16:06.489873  3922 leader_election.cc:304] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:16:06.486075  8381 raft_consensus.cc:2749] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:06.494168  8377 raft_consensus.cc:2749] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:06.497498  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:16:06.500844  8377 raft_consensus.cc:2749] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:06.501298  3922 leader_election.cc:304] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:16:06.503836  8381 raft_consensus.cc:2749] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:06.506067  3922 leader_election.cc:304] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
W20260709 13:16:06.509192  4071 consensus_peers.cc:597] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:06.519892  8381 raft_consensus.cc:2749] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:16:06.520818  3924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 53334.2us
I20260709 13:16:06.524858  3925 leader_election.cc:304] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:16:06.531752  8381 raft_consensus.cc:2749] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:06.539206  3925 leader_election.cc:304] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:16:06.540215  8377 raft_consensus.cc:2749] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:06.540936  8377 raft_consensus.cc:2749] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:06.541121  3925 leader_election.cc:304] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:16:06.542632  8377 raft_consensus.cc:2749] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:06.545135  3922 leader_election.cc:304] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:16:06.546054  8381 raft_consensus.cc:2749] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:06.588305  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3254b26cc140fc8d2500e3e12dfaf4" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:16:06.589907  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:16:06.542856  3925 leader_election.cc:304] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:16:06.591626  4100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97cd8a260df0424d973e61ef94d96102" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:16:06.594206  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6407d1f930405b9aa0d4690377e1da" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:16:06.598074  3925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 55320.7us
I20260709 13:16:06.598695  3925 leader_election.cc:304] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:16:06.610316  3925 leader_election.cc:304] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:16:06.607659  8420 raft_consensus.cc:2749] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:06.615715  8373 raft_consensus.cc:2749] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:06.617046  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a08c9f959924154b694899e3a318181" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:16:06.651407  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:16:06.656538  3922 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:16:06.658166  8373 raft_consensus.cc:2749] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:06.656599  3925 leader_election.cc:304] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:16:06.651077  8420 raft_consensus.cc:2749] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:06.674054  3925 leader_election.cc:304] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:16:06.672580  8431 raft_consensus.cc:2749] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:06.675051  2843 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:06.677975  8377 raft_consensus.cc:2749] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:06.677465  2843 tablet_replica.cc:333] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:06.678233  8411 raft_consensus.cc:2955] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 LEADER]: Committing config change with OpId 11.8: config changed from index 7 to 8, VOTER 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:16:06.680294  4700 raft_consensus.cc:2955] T 256a58e0d11d473c899ea90e30dbd511 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index 7 to 8, VOTER 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:16:06.679776  2843 raft_consensus.cc:2243] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:06.682054  2843 raft_consensus.cc:2272] T bd24fa3ec4ab41cabe4bcfae21f055f3 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:06.689774  3925 leader_election.cc:304] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:16:06.697088  2843 tablet_replica.cc:333] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:06.703528  3925 leader_election.cc:304] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:16:06.703420  8373 raft_consensus.cc:2749] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:06.712713  2843 raft_consensus.cc:2243] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:06.713483  2843 raft_consensus.cc:2272] T 5ba65f329a14453da0acb3230a4ac721 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:06.711645  3925 leader_election.cc:304] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:16:06.707415  8237 raft_consensus.cc:2749] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:06.722968  3925 leader_election.cc:304] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:16:06.726591  8388 raft_consensus.cc:2749] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:06.728094  2843 tablet_replica.cc:333] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:06.725570  8373 raft_consensus.cc:2749] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:06.745398  2843 raft_consensus.cc:2243] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:16:06.755242  2843 raft_consensus.cc:2272] T b820fbf0157d41e1b9205cc4eb1bb76c P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:06.757825  2843 tablet_replica.cc:333] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:06.759740  2843 raft_consensus.cc:2243] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:06.761855  2843 raft_consensus.cc:2272] T f59fe7d824ba4030a574c8f7172dab57 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:06.765269  2843 tablet_replica.cc:333] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:06.772887  2843 raft_consensus.cc:2243] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:06.773787  2843 raft_consensus.cc:2272] T 7ebbb84155f1455d87aab7fd5d78e3d8 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:06.796540  3841 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 256a58e0d11d473c899ea90e30dbd511 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:06.806336  2843 tablet_replica.cc:333] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:06.807478  2843 raft_consensus.cc:2243] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:16:06.813292  2843 raft_consensus.cc:2272] T f915c4d38c324e5990b58ac46421dfbc P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:06.824921  2843 tablet_replica.cc:333] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:06.825910  2843 raft_consensus.cc:2243] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:06.826519  2843 raft_consensus.cc:2272] T a55dd6943e7742738991bb00da84127e P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:06.829450  2843 tablet_replica.cc:333] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:06.830255  2843 raft_consensus.cc:2243] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:16:06.831295  2843 raft_consensus.cc:2272] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:06.851441  2843 tablet_replica.cc:333] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:06.852387  2843 raft_consensus.cc:2243] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:16:06.853559  2843 raft_consensus.cc:2272] T 4d2c2416b3b84475b42a757829fd63a8 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:06.869869  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 53322.9us
I20260709 13:16:06.897359  2843 tablet_replica.cc:333] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:06.898540  2843 raft_consensus.cc:2243] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:06.899374  2843 raft_consensus.cc:2272] T dc2641ff9849458a9200dfc5a9016cce P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:06.907513  2843 tablet_replica.cc:333] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:06.908450  2843 raft_consensus.cc:2243] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:06.930574  2843 raft_consensus.cc:2272] T 2705becfe8874dbe97b71d14b12feb8f P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:06.931588  3853 catalog_manager.cc:5697] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P d709ee666b774ec29aa732e508219938 reported cstate change: config changed from index 7 to 8, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:16:06.933933  3853 catalog_manager.cc:5697] T 256a58e0d11d473c899ea90e30dbd511 P d709ee666b774ec29aa732e508219938 reported cstate change: config changed from index 7 to 8, VOTER 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) evicted. New cstate: current_term: 11 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:16:06.941680  2843 tablet_replica.cc:333] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:06.942740  2843 raft_consensus.cc:2243] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:06.943466  2843 raft_consensus.cc:2272] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:06.946573  8423 raft_consensus.cc:493] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:16:06.947180  8423 raft_consensus.cc:515] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:06.957803  4032 consensus_queue.cc:237] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:06.960224  8423 leader_election.cc:290] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:16:06.961359  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:16:06.966336  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256a58e0d11d473c899ea90e30dbd511" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:16:06.946596  2843 tablet_replica.cc:333] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:06.970013  3997 leader_election.cc:304] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:16:06.972566  8423 raft_consensus.cc:2749] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:06.986126  2843 raft_consensus.cc:2243] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 7 LEADER]: Raft consensus shutting down.
W20260709 13:16:06.985191  3997 leader_election.cc:336] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:06.999894  4017 tablet_service.cc:1558] Processing DeleteTablet for tablet 256a58e0d11d473c899ea90e30dbd511 with delete_type TABLET_DATA_TOMBSTONED (TS 6f5b5e4ed72944ecbda200012d141dc2 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:35598
I20260709 13:16:07.011656  2843 raft_consensus.cc:2272] T e7b8e59a6e504b3189b0b875dabf2b96 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:07.013620  4028 consensus_queue.cc:237] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:07.031877  4700 raft_consensus.cc:1275] T 3f641c5435604e30bb44aa411954bd2f P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:16:07.034025  8427 consensus_queue.cc:1048] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:07.040750  4702 raft_consensus.cc:1275] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:07.042528  4102 raft_consensus.cc:1275] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:07.049619  8259 consensus_queue.cc:1048] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:16:07.073405  8417 raft_consensus.cc:2955] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index 8 to 9, VOTER f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:16:07.084053  4102 raft_consensus.cc:1275] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:16:07.088543  8442 tablet_replica.cc:333] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:16:07.089807  8442 raft_consensus.cc:2243] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:07.090523  2843 tablet_replica.cc:333] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:07.090768  8442 raft_consensus.cc:2272] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:07.093154  8423 consensus_queue.cc:1048] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:07.091434  2843 raft_consensus.cc:2243] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:07.107640  8423 raft_consensus.cc:2955] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 LEADER]: Committing config change with OpId 9.10: config changed from index 9 to 10, VOTER f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:16:07.084411  8427 consensus_queue.cc:1048] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:16:07.155381  8442 ts_tablet_manager.cc:1916] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:07.109843  2843 pending_rounds.cc:70] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059: Trying to abort 1 pending ops.
I20260709 13:16:07.113274  4104 raft_consensus.cc:2955] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Committing config change with OpId 9.10: config changed from index 9 to 10, VOTER f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:16:07.158594  2843 pending_rounds.cc:77] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059: Aborting op as it isn't in flight: id { term: 11 index: 7 } timestamp: 7305637741387214848 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "256a58e0d11d473c899ea90e30dbd511" old_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } } new_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } } }
I20260709 13:16:07.160287  2843 raft_consensus.cc:2917] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Aborting config change with OpId 11.7: Aborted: Op aborted
I20260709 13:16:07.160759  2843 raft_consensus.cc:2889] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:16:07.180123  2843 raft_consensus.cc:2272] T 256a58e0d11d473c899ea90e30dbd511 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:07.219610  8444 log.cc:927] Time spent T 3f641c5435604e30bb44aa411954bd2f P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:16:07.259205  4700 raft_consensus.cc:2955] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, VOTER f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:16:07.260221  4104 raft_consensus.cc:2955] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, VOTER f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:16:07.257634  3856 catalog_manager.cc:5697] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: config changed from index 8 to 9, VOTER f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) evicted. New cstate: current_term: 11 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:07.264880  3857 catalog_manager.cc:5697] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: config changed from index 9 to 10, VOTER f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) evicted. New cstate: current_term: 9 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:16:07.276654  3844 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 20cb8f6ca1af4ec79acaa9f95e816ca6 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:07.277760  3844 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3f641c5435604e30bb44aa411954bd2f with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:07.283886  4707 raft_consensus.cc:2955] T 3f641c5435604e30bb44aa411954bd2f P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Committing config change with OpId 9.10: config changed from index 9 to 10, VOTER f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:16:07.315714  2843 tablet_replica.cc:333] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:07.316787  2843 raft_consensus.cc:2243] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:07.317381  2843 raft_consensus.cc:2272] T 97cd8a260df0424d973e61ef94d96102 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:07.374598  2843 tablet_replica.cc:333] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:07.375793  2843 raft_consensus.cc:2243] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:07.378103  8442 ts_tablet_manager.cc:1929] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.7
I20260709 13:16:07.378513  2843 raft_consensus.cc:2272] T 40ffdd65ef5c4d8982bdf6556426ee40 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:07.378772  8442 log.cc:1199] T 256a58e0d11d473c899ea90e30dbd511 P 6f5b5e4ed72944ecbda200012d141dc2: Deleting WAL directory at /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602804652623-2843-0/minicluster-data/ts-1-root/wals/256a58e0d11d473c899ea90e30dbd511
I20260709 13:16:07.380707  3844 catalog_manager.cc:5028] TS 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): tablet 256a58e0d11d473c899ea90e30dbd511 (table test-workload [id=8a2760e8528448a780fea6ccf25816cb]) successfully deleted
I20260709 13:16:07.382836  8389 raft_consensus.cc:493] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:07.383460  8389 raft_consensus.cc:515] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:07.387748  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:16:07.392349  3841 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 104638us
I20260709 13:16:07.394178  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d672aa4b8b8e421ea43cee412d9da66a" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:16:07.395411  3925 leader_election.cc:304] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:16:07.398440  8373 raft_consensus.cc:2749] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:07.391602  8389 leader_election.cc:290] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:16:07.413378  2843 tablet_replica.cc:333] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:07.414482  2843 raft_consensus.cc:2243] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:16:07.415617  2843 raft_consensus.cc:2272] T 649df91131174f00af0e0a0240f80adb P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:07.420169  3841 catalog_manager.cc:4755] TS f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 3f641c5435604e30bb44aa411954bd2f: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 13:16:07.423286  2843 tablet_replica.cc:333] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:07.433466  2843 raft_consensus.cc:2243] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:07.434235  2843 raft_consensus.cc:2272] T 08d6732bceef4220a670ac449347258b P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:07.458786  2843 tablet_replica.cc:333] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:07.459836  2843 raft_consensus.cc:2243] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:16:07.461088  2843 raft_consensus.cc:2272] T 5e21bc17c8f64c43938a80f74620d90a P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:07.478994  2843 tablet_replica.cc:333] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:07.479900  2843 raft_consensus.cc:2243] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:07.480564  2843 raft_consensus.cc:2272] T 4a08c9f959924154b694899e3a318181 P f1c75790cedf4f52a3463a255c7da059 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:07.495745  2843 tablet_replica.cc:333] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:07.496776  2843 raft_consensus.cc:2243] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:07.497453  2843 raft_consensus.cc:2272] T 6ff80427d8324bd386a3ac9ff13d768e P f1c75790cedf4f52a3463a255c7da059 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:07.500344  2843 tablet_replica.cc:333] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:07.501165  2843 raft_consensus.cc:2243] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:07.502274  2843 raft_consensus.cc:2272] T f4845eaa52cb4965b9c8922f37e2f606 P f1c75790cedf4f52a3463a255c7da059 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:07.541471  2843 tablet_replica.cc:333] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:07.542482  2843 raft_consensus.cc:2243] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:16:07.543815  2843 raft_consensus.cc:2272] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:07.565168  2843 tablet_replica.cc:333] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:07.566282  2843 raft_consensus.cc:2243] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:07.572873  2843 raft_consensus.cc:2272] T 37bb8c27fe534b22824e326e191a66f0 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:07.576189  2843 tablet_replica.cc:333] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:07.580401  2843 raft_consensus.cc:2243] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:07.592687  2843 raft_consensus.cc:2272] T b523c05ab48243118947b2e30890c0b4 P f1c75790cedf4f52a3463a255c7da059 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:07.595750  2843 tablet_replica.cc:333] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:07.596585  2843 raft_consensus.cc:2243] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:16:07.597780  2843 raft_consensus.cc:2272] T c18bd2f3197a4762aec88dec3caa6712 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:07.626762  2843 tablet_replica.cc:333] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:07.638535  2843 raft_consensus.cc:2243] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:07.639277  2843 raft_consensus.cc:2272] T cd023a8b08e942db8236dd7bae557ca6 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:07.651369  2843 tablet_replica.cc:333] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:07.652315  2843 raft_consensus.cc:2243] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:07.653040  2843 raft_consensus.cc:2272] T f6f1e6f6803e4a459cce95251d23c854 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:07.661840  2843 tablet_replica.cc:333] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:07.672564  2843 raft_consensus.cc:2243] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:16:07.674010  2843 raft_consensus.cc:2272] T cc52edd660634ce5bc356665dd499a61 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:07.685597  2843 tablet_replica.cc:333] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:07.686669  2843 raft_consensus.cc:2243] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 11 LEADER]: Raft consensus shutting down.
W20260709 13:16:07.686726  4071 consensus_peers.cc:597] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:07.688181  2843 raft_consensus.cc:2272] T b2879f06fa90455ea323efd79c11c330 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:07.691442  2843 tablet_replica.cc:333] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:07.711244  2843 raft_consensus.cc:2243] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:07.711941  2843 raft_consensus.cc:2272] T 9b2556690d2041edb61d331163aced7d P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:07.733767  2843 tablet_replica.cc:333] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:07.734876  2843 raft_consensus.cc:2243] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:07.738049  2843 raft_consensus.cc:2272] T 7f3e65834a74410e9f2fa3b0e16b1e1e P f1c75790cedf4f52a3463a255c7da059 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:07.752168  2843 tablet_replica.cc:333] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:07.753201  2843 raft_consensus.cc:2243] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:16:07.754514  2843 raft_consensus.cc:2272] T b1073c870d784f068fdb3f222623f5a3 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:07.765264  2843 tablet_replica.cc:333] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:07.767683  2843 raft_consensus.cc:2243] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:16:07.770298  2843 raft_consensus.cc:2272] T f9cefab1b91e4d728ddf2663bc49d316 P f1c75790cedf4f52a3463a255c7da059 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:07.780515  2843 tablet_replica.cc:333] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:07.781510  2843 raft_consensus.cc:2243] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:07.792296  2843 raft_consensus.cc:2272] T 13ea3a969108486bbbaaaf3697e1d3b5 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:07.795276  2843 tablet_replica.cc:333] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:07.796144  2843 raft_consensus.cc:2243] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:16:07.797870  2843 raft_consensus.cc:2272] T 0c7551e973324a21b094c1d2869495ac P f1c75790cedf4f52a3463a255c7da059 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:07.807521  2843 tablet_replica.cc:333] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:07.820662  2843 raft_consensus.cc:2243] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:07.823487  2843 raft_consensus.cc:2272] T 3f641c5435604e30bb44aa411954bd2f P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:07.836143  2843 tablet_replica.cc:333] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:07.837342  2843 raft_consensus.cc:2243] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:07.838163  2843 raft_consensus.cc:2272] T 9873af7d73cf49f3b2d74a17cf7cd3bf P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:07.841790  2843 tablet_replica.cc:333] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:07.842702  2843 raft_consensus.cc:2243] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:07.843477  2843 raft_consensus.cc:2272] T 4e6407d1f930405b9aa0d4690377e1da P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:07.846841  2843 tablet_replica.cc:333] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:07.847769  2843 raft_consensus.cc:2243] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:07.848655  2843 raft_consensus.cc:2272] T 6b3254b26cc140fc8d2500e3e12dfaf4 P f1c75790cedf4f52a3463a255c7da059 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:07.851847  2843 tablet_replica.cc:333] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:07.852677  2843 raft_consensus.cc:2243] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:07.853356  2843 raft_consensus.cc:2272] T 412d794b0f694d089b1b011ba8adea36 P f1c75790cedf4f52a3463a255c7da059 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:07.857100  2843 tablet_replica.cc:333] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:07.857445  8389 raft_consensus.cc:493] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d709ee666b774ec29aa732e508219938)
I20260709 13:16:07.858059  2843 raft_consensus.cc:2243] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:16:07.859421  2843 raft_consensus.cc:2272] T c29b05201a5f4c6089866210cf02f151 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:07.858065  8389 raft_consensus.cc:515] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:07.862568  2843 tablet_replica.cc:333] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:07.863574  2843 raft_consensus.cc:2243] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:07.864302  2843 raft_consensus.cc:2272] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:07.864805  8389 leader_election.cc:290] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:16:07.867074  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:16:07.864960  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622bcde3b6ba43678f5eb621e8259db2" candidate_uuid: "f1c75790cedf4f52a3463a255c7da059" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:16:07.869128  8423 raft_consensus.cc:493] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:16:07.869745  8423 raft_consensus.cc:515] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:07.871198  2843 tablet_replica.cc:333] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:07.872136  8423 leader_election.cc:290] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:16:07.875778  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:16:07.880666  3924 leader_election.cc:304] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1c75790cedf4f52a3463a255c7da059; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
W20260709 13:16:07.881524  3924 raft_consensus.cc:2686] T 622bcde3b6ba43678f5eb621e8259db2 P f1c75790cedf4f52a3463a255c7da059: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:16:07.875154  2843 raft_consensus.cc:2243] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:07.901615  2843 raft_consensus.cc:2272] T 604474f002cb41eb9125fc14353547d2 P f1c75790cedf4f52a3463a255c7da059 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:07.902199  4672 consensus_peers.cc:597] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:07.901629  3997 leader_election.cc:336] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:07.903820  3997 leader_election.cc:304] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
W20260709 13:16:07.907914  3997 consensus_peers.cc:597] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:07.909555  8423 raft_consensus.cc:2749] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:07.909799  8417 raft_consensus.cc:493] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:16:07.910363  8417 raft_consensus.cc:515] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:07.912431  8417 leader_election.cc:290] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:16:07.916491  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:16:07.916501  3997 leader_election.cc:336] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:07.922294  2843 tablet_replica.cc:333] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:07.923615  3997 leader_election.cc:304] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:07.928423  8417 raft_consensus.cc:2749] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:07.929553  2843 raft_consensus.cc:2243] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:07.930868  2843 raft_consensus.cc:2272] T f492997a6e0f48c5b9e231e43f19e3f3 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:07.933971  2843 tablet_replica.cc:333] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:07.937260  2843 raft_consensus.cc:2243] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:07.940323  2843 raft_consensus.cc:2272] T ad706e81088440eaa86606b68c1c2c5f P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:07.945689  2843 tablet_replica.cc:333] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:07.948201  2843 raft_consensus.cc:2243] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:07.951913  2843 raft_consensus.cc:2272] T 6e863d888e2a4327a9127a43deb1f1b9 P f1c75790cedf4f52a3463a255c7da059 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:07.954856  2843 tablet_replica.cc:333] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:07.961875  2843 raft_consensus.cc:2243] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:07.964398  2843 raft_consensus.cc:2272] T d672aa4b8b8e421ea43cee412d9da66a P f1c75790cedf4f52a3463a255c7da059 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:07.968961  4071 consensus_peers.cc:597] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:07.971614  2843 tablet_replica.cc:333] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:07.972489  2843 raft_consensus.cc:2243] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:07.981467  2843 raft_consensus.cc:2272] T eae506e79ba348b3b1db60ecc6ae6714 P f1c75790cedf4f52a3463a255c7da059 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:07.998762  2843 tablet_replica.cc:333] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:07.999866  2843 raft_consensus.cc:2243] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:08.000830  2843 raft_consensus.cc:2272] T 1d55b0c8cf6547cb8c135f6ecdfce39f P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:08.003996  2843 tablet_replica.cc:333] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059: stopping tablet replica
I20260709 13:16:08.005705  2843 raft_consensus.cc:2243] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:08.008890  2843 raft_consensus.cc:2272] T b7e7a2dc30a24e5caaa3806c68b96c08 P f1c75790cedf4f52a3463a255c7da059 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:08.049526  4071 consensus_peers.cc:597] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:08.072985  8336 raft_consensus.cc:493] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:16:08.073693  8336 raft_consensus.cc:515] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:16:08.080152  4672 leader_election.cc:336] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:08.082327  8336 leader_election.cc:290] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:16:08.082399  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:16:08.084033  4675 leader_election.cc:304] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:08.085191  8336 raft_consensus.cc:2749] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:08.094244  8370 raft_consensus.cc:493] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:16:08.094887  8370 raft_consensus.cc:515] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:08.097473  8370 leader_election.cc:290] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:16:08.098548  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:16:08.100370  4071 leader_election.cc:336] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:08.100917  4074 leader_election.cc:304] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:08.102815  8370 raft_consensus.cc:2749] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:16:08.116552  3997 consensus_peers.cc:597] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:08.143862  4071 consensus_peers.cc:597] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:08.150072  4672 consensus_peers.cc:597] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:08.161877  3997 consensus_peers.cc:597] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:08.175701  4071 consensus_peers.cc:597] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:08.178421  3997 consensus_peers.cc:597] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:08.184504  3997 consensus_peers.cc:597] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:08.218667  8370 raft_consensus.cc:493] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:16:08.219360  8370 raft_consensus.cc:515] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:08.221737  8370 leader_election.cc:290] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:16:08.229224  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:16:08.230093  4028 raft_consensus.cc:2468] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 7.
I20260709 13:16:08.231560  4074 leader_election.cc:304] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:16:08.232668  8370 raft_consensus.cc:2804] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:08.233115  8370 raft_consensus.cc:493] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:16:08.233497  8370 raft_consensus.cc:3060] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:08.251533  8443 raft_consensus.cc:493] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:16:08.252254  8443 raft_consensus.cc:515] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:08.254558  8443 leader_election.cc:290] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:16:08.256534  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:16:08.257301  4700 raft_consensus.cc:2468] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 11.
I20260709 13:16:08.262516  3999 leader_election.cc:304] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:16:08.264091  8443 raft_consensus.cc:2804] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:08.264628  8443 raft_consensus.cc:493] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
W20260709 13:16:08.263269  3997 consensus_peers.cc:597] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:08.265019  8443 raft_consensus.cc:3060] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:08.266191  3997 leader_election.cc:336] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:08.269723  8370 raft_consensus.cc:515] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:08.271795  8417 raft_consensus.cc:493] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:16:08.272253  8370 leader_election.cc:290] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:16:08.272344  8417 raft_consensus.cc:515] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:08.275213  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f915c4d38c324e5990b58ac46421dfbc" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:16:08.275871  4028 raft_consensus.cc:3060] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:08.281983  8448 raft_consensus.cc:493] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:16:08.282635  8448 raft_consensus.cc:515] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:08.284112  8417 leader_election.cc:290] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:16:08.285933  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:16:08.286628  4104 raft_consensus.cc:2468] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 7.
I20260709 13:16:08.286938  8448 leader_election.cc:290] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:16:08.289433  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:16:08.296041  4032 raft_consensus.cc:2468] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 10.
I20260709 13:16:08.298691  4074 leader_election.cc:304] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
W20260709 13:16:08.305078  4672 consensus_peers.cc:597] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:08.305887  8449 raft_consensus.cc:2804] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:08.306427  8449 raft_consensus.cc:493] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:16:08.306875  8449 raft_consensus.cc:3060] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:08.292101  4071 consensus_peers.cc:597] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:08.299515  3997 leader_election.cc:304] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
W20260709 13:16:08.308025  4071 leader_election.cc:336] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:08.308288  8417 raft_consensus.cc:2804] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:08.308764  8417 raft_consensus.cc:493] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:16:08.309166  8417 raft_consensus.cc:3060] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:08.315833  4071 consensus_peers.cc:597] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:08.316506  4071 leader_election.cc:336] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:08.323088  4071 leader_election.cc:336] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:08.324175  4071 consensus_peers.cc:597] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:08.289446  4028 raft_consensus.cc:2468] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 8.
I20260709 13:16:08.326808  4074 leader_election.cc:304] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
W20260709 13:16:08.327678  4071 consensus_peers.cc:597] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:08.328485  8376 raft_consensus.cc:2804] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:08.331774  8443 raft_consensus.cc:515] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:16:08.323030  3997 leader_election.cc:336] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:08.335598  8443 leader_election.cc:290] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 12 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:16:08.336630  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65333bcc8c2a4b1a9f6f35670cefe7d0" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:16:08.337244  4700 raft_consensus.cc:3060] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:08.341704  3997 leader_election.cc:336] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:08.343159  8449 raft_consensus.cc:515] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:16:08.357200  3997 consensus_peers.cc:597] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:08.359402  4071 consensus_peers.cc:597] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:08.354314  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820fbf0157d41e1b9205cc4eb1bb76c" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:16:08.368702  4025 raft_consensus.cc:3060] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:08.351166  4700 raft_consensus.cc:2468] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 12.
W20260709 13:16:08.368737  4071 leader_election.cc:336] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:08.371002  3999 leader_election.cc:304] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: f1c75790cedf4f52a3463a255c7da059
W20260709 13:16:08.379159  3997 consensus_peers.cc:597] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:08.380182  8443 raft_consensus.cc:2804] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:08.380730  8443 raft_consensus.cc:697] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:16:08.381654  8443 consensus_queue.cc:237] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:08.343497  8417 raft_consensus.cc:515] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:08.358247  8449 leader_election.cc:290] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:16:08.391266  3997 leader_election.cc:336] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:08.392297  8417 leader_election.cc:290] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:16:08.393831  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2c2416b3b84475b42a757829fd63a8" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:16:08.394429  4104 raft_consensus.cc:3060] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:08.413444  8449 raft_consensus.cc:493] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:16:08.414249  8449 raft_consensus.cc:515] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:16:08.416141  4672 consensus_peers.cc:597] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:08.416692  8449 leader_election.cc:290] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:16:08.418388  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:16:08.419210  4025 raft_consensus.cc:2468] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 11.
I20260709 13:16:08.422120  4104 raft_consensus.cc:2468] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 8.
I20260709 13:16:08.425112  4074 leader_election.cc:304] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
W20260709 13:16:08.425457  4071 leader_election.cc:336] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:08.423905  3997 leader_election.cc:304] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
W20260709 13:16:08.432116  4071 consensus_peers.cc:597] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:08.433238  4074 leader_election.cc:304] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:08.439728  8423 raft_consensus.cc:2804] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:08.440354  8423 raft_consensus.cc:697] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:16:08.441231  8423 consensus_queue.cc:237] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:08.438750  8448 raft_consensus.cc:2804] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:16:08.458328  4672 consensus_peers.cc:597] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:08.447846  8449 raft_consensus.cc:2749] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:08.448397  8376 raft_consensus.cc:697] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:16:08.466571  8376 consensus_queue.cc:237] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:08.462035  8448 raft_consensus.cc:697] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:16:08.485275  8448 consensus_queue.cc:237] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:08.478780  8417 raft_consensus.cc:493] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:16:08.491670  8417 raft_consensus.cc:515] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:08.507229  8417 leader_election.cc:290] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:16:08.548808  4071 consensus_peers.cc:597] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:08.549665  8451 raft_consensus.cc:493] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:16:08.550467  8451 raft_consensus.cc:515] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:16:08.559579  4672 consensus_peers.cc:597] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:08.563843  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:16:08.564643  4032 raft_consensus.cc:2468] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 9.
I20260709 13:16:08.571725  4074 leader_election.cc:304] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:16:08.577826  8451 leader_election.cc:290] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:16:08.578780  4071 leader_election.cc:336] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:08.580852  8452 raft_consensus.cc:2804] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:08.581457  8452 raft_consensus.cc:493] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:16:08.590445  8452 raft_consensus.cc:3060] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:08.590672  3841 catalog_manager.cc:4755] TS f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 3f641c5435604e30bb44aa411954bd2f: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 13:16:08.605986  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:16:08.606626  8457 raft_consensus.cc:493] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:16:08.607303  4104 raft_consensus.cc:2468] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 7.
I20260709 13:16:08.607370  8457 raft_consensus.cc:515] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:08.610169  8457 leader_election.cc:290] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:16:08.613879  4672 consensus_peers.cc:597] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:08.614318  3997 leader_election.cc:304] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:16:08.615272  8457 raft_consensus.cc:2804] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:08.615732  8457 raft_consensus.cc:493] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:16:08.616398  8457 raft_consensus.cc:3060] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:08.619709  3856 catalog_manager.cc:5697] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 7 to 8, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 8 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:08.621814  3856 catalog_manager.cc:5697] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 11 to 12, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 12 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:08.622735  8451 raft_consensus.cc:493] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:16:08.632910  8451 raft_consensus.cc:515] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:08.635286  8451 leader_election.cc:290] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:16:08.630641  4672 consensus_peers.cc:597] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:08.631116  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:16:08.632042  8452 raft_consensus.cc:515] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:08.637852  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:16:08.638233  3997 consensus_peers.cc:597] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:08.640496  3997 consensus_peers.cc:597] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:08.641167  3997 consensus_peers.cc:597] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:08.641812  4071 leader_election.cc:336] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:08.642409  4071 leader_election.cc:304] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
W20260709 13:16:08.641779  3997 leader_election.cc:336] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:08.632293  3905 auto_rebalancer.cc:629] Failed to schedule move for tablet 79e5ee76c81a42c8a9510d0d5d7b55b2: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:08.643110  8451 raft_consensus.cc:2749] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:08.645717  3997 leader_election.cc:336] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:08.647735  3997 leader_election.cc:304] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:08.648574  8461 raft_consensus.cc:2749] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:08.649255  4032 consensus_queue.cc:237] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:16:08.650017  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e21bc17c8f64c43938a80f74620d90a" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:16:08.650673  4025 raft_consensus.cc:3060] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:08.651769  8452 leader_election.cc:290] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:16:08.630113  8457 raft_consensus.cc:515] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:08.652709  8449 raft_consensus.cc:493] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:16:08.653582  8449 raft_consensus.cc:515] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:08.652693  8452 raft_consensus.cc:493] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:16:08.656678  8452 raft_consensus.cc:515] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:08.657217  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:16:08.657742  3857 catalog_manager.cc:5697] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 7 to 8, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 8 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:08.658831  8452 leader_election.cc:290] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:16:08.659533  8457 leader_election.cc:290] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:16:08.655622  8449 leader_election.cc:290] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:16:08.661005  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:16:08.662801  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b8e59a6e504b3189b0b875dabf2b96" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:16:08.663398  4103 raft_consensus.cc:3060] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:08.664369  4025 raft_consensus.cc:2468] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 10.
W20260709 13:16:08.665525  3997 leader_election.cc:336] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:08.665666  4074 leader_election.cc:304] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:16:08.666615  8449 raft_consensus.cc:2804] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:08.667157  8449 raft_consensus.cc:697] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:16:08.668154  8449 consensus_queue.cc:237] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:08.659472  3857 catalog_manager.cc:5697] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 10 to 11, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 11 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:08.675614  4071 leader_election.cc:336] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:08.679618  4071 leader_election.cc:336] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:08.680058  4071 leader_election.cc:304] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
W20260709 13:16:08.680516  3997 consensus_peers.cc:597] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:08.680809  8451 raft_consensus.cc:2749] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:08.678402  4103 raft_consensus.cc:2468] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 8.
I20260709 13:16:08.684413  3997 leader_election.cc:304] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
W20260709 13:16:08.684545  4071 leader_election.cc:336] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:08.685206  4071 leader_election.cc:304] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: d709ee666b774ec29aa732e508219938, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:08.686306  8461 raft_consensus.cc:2804] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:08.687062  8461 raft_consensus.cc:697] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:16:08.687206  8452 raft_consensus.cc:2749] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:08.688030  8461 consensus_queue.cc:237] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:16:08.692236  3999 consensus_peers.cc:597] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117): Couldn't send request to peer d709ee666b774ec29aa732e508219938. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b523c05ab48243118947b2e30890c0b4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:08.704625  4103 raft_consensus.cc:1275] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 14 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:16:08.710814  8461 consensus_queue.cc:1048] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:16:08.712872  3997 consensus_peers.cc:597] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:08.717214  8458 raft_consensus.cc:493] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:16:08.717839  8458 raft_consensus.cc:515] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:08.720587  8458 leader_election.cc:290] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:16:08.724473  4672 leader_election.cc:336] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:08.731910  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:16:08.734633  4675 leader_election.cc:304] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:08.735836  8378 raft_consensus.cc:2749] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:08.768046  8457 raft_consensus.cc:2955] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 14 LEADER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:16:08.769989  4101 raft_consensus.cc:2955] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:16:08.793483  4700 raft_consensus.cc:1275] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:16:08.794986  8454 consensus_queue.cc:1048] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:08.840386  8378 raft_consensus.cc:493] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:16:08.841269  8378 raft_consensus.cc:515] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:08.843827  8378 leader_election.cc:290] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:16:08.850417  4101 consensus_queue.cc:237] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:16:08.852172  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:16:08.852871  4103 raft_consensus.cc:2468] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 8.
W20260709 13:16:08.859241  4071 consensus_peers.cc:597] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:08.862119  4672 leader_election.cc:304] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:16:08.863302  8458 raft_consensus.cc:2804] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:08.863849  8458 raft_consensus.cc:493] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:16:08.864343  8458 raft_consensus.cc:3060] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:08.877756  4672 leader_election.cc:336] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:08.888585  8458 raft_consensus.cc:515] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:16:08.900815  4073 consensus_peers.cc:597] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer d709ee666b774ec29aa732e508219938 (127.2.198.196:37117): Couldn't send request to peer d709ee666b774ec29aa732e508219938. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9b2556690d2041edb61d331163aced7d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:08.901875  4025 raft_consensus.cc:1275] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:16:08.904421  8452 consensus_queue.cc:1048] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:08.916289  3856 catalog_manager.cc:5697] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 7 to 8, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 8 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:08.918109  3856 catalog_manager.cc:5697] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: config changed from index -1 to 9, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New cstate: current_term: 14 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:08.922451  8417 raft_consensus.cc:493] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:16:08.923697  8454 raft_consensus.cc:493] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:16:08.924268  8454 raft_consensus.cc:515] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:08.925186  8458 leader_election.cc:290] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:16:08.926472  8454 leader_election.cc:290] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:16:08.923062  8417 raft_consensus.cc:515] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:08.929307  8417 leader_election.cc:290] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:16:08.933063  4101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:16:08.933943  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:16:08.941057  4672 leader_election.cc:336] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:08.942961  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649df91131174f00af0e0a0240f80adb" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:16:08.943576  4104 raft_consensus.cc:3060] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:08.943521  8370 raft_consensus.cc:493] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:16:08.947870  8370 raft_consensus.cc:515] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:08.949968  8370 leader_election.cc:290] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:16:08.950958  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
W20260709 13:16:08.955562  4071 consensus_peers.cc:597] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:08.956645  8449 raft_consensus.cc:493] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
W20260709 13:16:08.959151  3997 consensus_peers.cc:597] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:08.959867  3997 consensus_peers.cc:597] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:08.957218  8449 raft_consensus.cc:515] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:16:08.960422  3997 leader_election.cc:336] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:08.960865  3997 leader_election.cc:304] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:08.961627  8454 raft_consensus.cc:2749] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:08.961838  3997 leader_election.cc:336] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:08.962021  8449 leader_election.cc:290] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:16:08.961325  4104 raft_consensus.cc:2468] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 9.
I20260709 13:16:08.962363  3997 leader_election.cc:304] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:08.964449  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:16:08.963398  8454 raft_consensus.cc:2749] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:08.967283  4030 raft_consensus.cc:2468] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 11.
I20260709 13:16:08.967561  4672 leader_election.cc:304] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:08.970323  4074 leader_election.cc:304] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:16:08.971201  8370 raft_consensus.cc:2804] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:08.971657  8370 raft_consensus.cc:493] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:16:08.972261  8370 raft_consensus.cc:3060] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:08.984089  8378 raft_consensus.cc:2804] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:09.002197  8458 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:16:09.004230  4030 raft_consensus.cc:1275] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:16:09.011390  3853 catalog_manager.cc:5697] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 9 to 10, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 10 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:09.018376  4071 leader_election.cc:336] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:09.021049  8451 raft_consensus.cc:493] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:16:09.021623  8451 raft_consensus.cc:515] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:09.023140  8376 raft_consensus.cc:2955] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 LEADER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:16:09.028427  8452 raft_consensus.cc:493] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:16:09.028014  4025 raft_consensus.cc:2955] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:16:09.029090  8452 raft_consensus.cc:515] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:09.033034  8451 leader_election.cc:290] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:16:09.033357  4030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:16:09.034051  4030 raft_consensus.cc:2468] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 8.
I20260709 13:16:09.034991  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2" is_pre_election: true
I20260709 13:16:09.035115  4074 leader_election.cc:304] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:16:09.035668  4032 raft_consensus.cc:2468] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 8.
I20260709 13:16:09.019359  4071 leader_election.cc:304] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:09.036702  8449 consensus_queue.cc:1048] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:09.036948  8448 raft_consensus.cc:2804] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:09.037452  8448 raft_consensus.cc:493] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:16:09.037849  8448 raft_consensus.cc:3060] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:09.031255  8452 leader_election.cc:290] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:16:09.038406  8449 raft_consensus.cc:2749] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:09.039431  4074 leader_election.cc:304] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:16:09.040704  8451 raft_consensus.cc:2804] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:09.041090  8451 raft_consensus.cc:493] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:16:09.041431  8451 raft_consensus.cc:3060] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:09.002955  8458 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:09.044370  8458 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:16:09.045544  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
W20260709 13:16:09.052666  4672 leader_election.cc:336] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:09.053483  8448 raft_consensus.cc:515] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:09.053134  4672 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
W20260709 13:16:09.056038  3997 consensus_peers.cc:597] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:09.056138  4030 raft_consensus.cc:1275] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:16:09.067895  8458 raft_consensus.cc:2749] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:09.068885  4104 raft_consensus.cc:1275] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:09.073748  8449 consensus_queue.cc:1048] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:09.080865  8454 consensus_queue.cc:1048] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:16:09.086637  4071 leader_election.cc:336] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:09.089828  8378 raft_consensus.cc:697] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938 [term 9 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:16:09.095229  8454 raft_consensus.cc:493] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:16:09.105880  8454 raft_consensus.cc:515] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:09.108644  8454 leader_election.cc:290] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:16:09.098579  8370 raft_consensus.cc:515] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:09.112270  8370 leader_election.cc:290] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:16:09.096837  8483 raft_consensus.cc:493] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:16:09.113849  8448 leader_election.cc:290] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:16:09.113721  8483 raft_consensus.cc:515] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:09.118297  8457 raft_consensus.cc:493] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:16:09.119874  4025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29b05201a5f4c6089866210cf02f151" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:16:09.120143  4028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5ee76c81a42c8a9510d0d5d7b55b2" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:16:09.120527  4025 raft_consensus.cc:3060] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:09.120668  4028 raft_consensus.cc:3060] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:09.121901  4672 leader_election.cc:336] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
W20260709 13:16:09.109452  4071 consensus_peers.cc:597] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:09.135300  4025 raft_consensus.cc:2468] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 12.
W20260709 13:16:09.141829  3905 auto_rebalancer.cc:629] Failed to schedule move for tablet b820fbf0157d41e1b9205cc4eb1bb76c: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:16:09.127674  8457 raft_consensus.cc:515] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:09.145306  8483 leader_election.cc:290] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:16:09.146687  8451 raft_consensus.cc:515] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:09.118599  8378 consensus_queue.cc:237] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:16:09.152346  4071 consensus_peers.cc:597] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:09.155144  4071 leader_election.cc:336] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:09.152560  4028 raft_consensus.cc:2468] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 9.
I20260709 13:16:09.153354  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:16:09.160238  4103 raft_consensus.cc:2468] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 9.
W20260709 13:16:09.169214  4071 consensus_peers.cc:597] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:09.170890  4071 leader_election.cc:336] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:09.173461  4672 leader_election.cc:304] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:09.178345  4074 leader_election.cc:304] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:16:09.180898  8458 raft_consensus.cc:2804] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:09.182060  8458 raft_consensus.cc:493] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:16:09.183135  8458 raft_consensus.cc:3060] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:09.188098  4074 leader_election.cc:304] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:16:09.191444  8376 raft_consensus.cc:2804] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:09.192082  8376 raft_consensus.cc:697] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:16:09.193033  8376 consensus_queue.cc:237] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:09.192097  8461 raft_consensus.cc:493] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:16:09.194258  8461 raft_consensus.cc:515] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:09.191227  8449 raft_consensus.cc:2804] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:16:09.210989  8487 log.cc:927] Time spent T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:16:09.212196  8457 leader_election.cc:290] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:16:09.216329  4025 raft_consensus.cc:1275] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:09.217216  4032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9cefab1b91e4d728ddf2663bc49d316" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f5b5e4ed72944ecbda200012d141dc2"
I20260709 13:16:09.237308  4032 raft_consensus.cc:3060] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:09.212922  8451 leader_election.cc:290] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:16:09.252849  4071 leader_election.cc:336] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
W20260709 13:16:09.253819  4071 leader_election.cc:336] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:09.264164  4032 raft_consensus.cc:2468] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 9.
W20260709 13:16:09.271050  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 80543.7us
I20260709 13:16:09.253682  8449 raft_consensus.cc:697] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:16:09.280045  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:16:09.283746  4707 raft_consensus.cc:2468] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 11.
W20260709 13:16:09.314728  4071 leader_election.cc:336] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:09.318176  8449 consensus_queue.cc:237] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:09.329196  8461 leader_election.cc:290] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:16:09.291397  8370 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:16:09.331825  8370 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:09.334692  8370 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:16:09.338747  4071 leader_election.cc:336] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
W20260709 13:16:09.369169  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 88036.6us
I20260709 13:16:09.370154  4074 leader_election.cc:304] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:09.373956  3999 leader_election.cc:304] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:16:09.378412  8503 raft_consensus.cc:2804] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:09.378971  8503 raft_consensus.cc:493] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:16:09.379397  8503 raft_consensus.cc:3060] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:09.388962  8502 raft_consensus.cc:2804] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:09.389853  8502 raft_consensus.cc:697] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:16:09.391064  8502 consensus_queue.cc:237] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:09.400810  4104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:16:09.401711  4104 raft_consensus.cc:2468] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 9.
I20260709 13:16:09.391723  8499 ts_tablet_manager.cc:933] T b523c05ab48243118947b2e30890c0b4 P d709ee666b774ec29aa732e508219938: Initiating tablet copy from peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:16:09.278148  8489 consensus_queue.cc:1048] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.087s
I20260709 13:16:09.467233  8458 raft_consensus.cc:515] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:09.478838  8458 leader_election.cc:290] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:16:09.480065  3997 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111) [suppressed 315 similar messages]
I20260709 13:16:09.521440  3997 leader_election.cc:304] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:16:09.522796  8457 raft_consensus.cc:2804] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:09.523245  8457 raft_consensus.cc:493] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:16:09.523662  8457 raft_consensus.cc:3060] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:09.529513  4700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:16:09.530512  4700 raft_consensus.cc:2468] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 14.
W20260709 13:16:09.533768  8491 log.cc:927] Time spent T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:16:09.543864  4073 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: f1c75790cedf4f52a3463a255c7da059
W20260709 13:16:09.584158  3997 leader_election.cc:336] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:09.587056  8513 ts_tablet_manager.cc:933] T 9b2556690d2041edb61d331163aced7d P d709ee666b774ec29aa732e508219938: Initiating tablet copy from peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:16:09.598073  8499 tablet_copy_client.cc:323] T b523c05ab48243118947b2e30890c0b4 P d709ee666b774ec29aa732e508219938: tablet copy: Beginning tablet copy session from remote peer at address 127.2.198.194:46115
I20260709 13:16:09.556496  8503 raft_consensus.cc:515] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:09.552757  8500 raft_consensus.cc:2804] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:16:09.717164  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 82948us
I20260709 13:16:09.771380  4044 tablet_copy_service.cc:140] P 6f5b5e4ed72944ecbda200012d141dc2: Received BeginTabletCopySession request for tablet b523c05ab48243118947b2e30890c0b4 from peer d709ee666b774ec29aa732e508219938 ({username='slave'} at 127.0.0.1:41312)
W20260709 13:16:09.771749  4675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 52416.8us
I20260709 13:16:09.772420  4044 tablet_copy_service.cc:161] P 6f5b5e4ed72944ecbda200012d141dc2: Beginning new tablet copy session on tablet b523c05ab48243118947b2e30890c0b4 from peer d709ee666b774ec29aa732e508219938 at {username='slave'} at 127.0.0.1:41312: session id = d709ee666b774ec29aa732e508219938-b523c05ab48243118947b2e30890c0b4
W20260709 13:16:09.777087  2843 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 3980)
W20260709 13:16:09.788513  3999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 206109us
I20260709 13:16:09.718674  8500 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 14 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:16:09.603160  8457 raft_consensus.cc:515] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:09.828001  8500 raft_consensus.cc:3060] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:16:09.880614  3841 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 71066.1us
I20260709 13:16:09.885555  8503 leader_election.cc:290] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 12 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:16:09.891242  4044 tablet_copy_source_session.cc:215] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:16:09.914505  3841 catalog_manager.cc:4755] TS f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 3f641c5435604e30bb44aa411954bd2f: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:09.918277  8457 leader_election.cc:290] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:16:09.923411  8500 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:09.927074  8500 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 15 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:16:09.928524  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 423103us
I20260709 13:16:09.931068  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18bd2f3197a4762aec88dec3caa6712" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:16:09.931800  4103 raft_consensus.cc:3060] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:09.895175  8513 tablet_copy_client.cc:323] T 9b2556690d2041edb61d331163aced7d P d709ee666b774ec29aa732e508219938: tablet copy: Beginning tablet copy session from remote peer at address 127.2.198.195:37843
I20260709 13:16:09.945613  4101 raft_consensus.cc:1275] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:16:09.948247  4103 raft_consensus.cc:2468] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 10.
W20260709 13:16:09.949682  4074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:46115, user_credentials={real_user=slave}} blocked reactor thread for 484786us
I20260709 13:16:09.965148  4117 tablet_copy_service.cc:140] P 8952c48a6f3a43968f7d77f7bfc4d1bc: Received BeginTabletCopySession request for tablet 9b2556690d2041edb61d331163aced7d from peer d709ee666b774ec29aa732e508219938 ({username='slave'} at 127.0.0.1:34656)
I20260709 13:16:09.965828  4117 tablet_copy_service.cc:161] P 8952c48a6f3a43968f7d77f7bfc4d1bc: Beginning new tablet copy session on tablet 9b2556690d2041edb61d331163aced7d from peer d709ee666b774ec29aa732e508219938 at {username='slave'} at 127.0.0.1:34656: session id = d709ee666b774ec29aa732e508219938-9b2556690d2041edb61d331163aced7d
W20260709 13:16:09.971958  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 385557us
W20260709 13:16:09.972568  3997 consensus_peers.cc:597] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:09.973114  3997 leader_election.cc:336] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
W20260709 13:16:09.974314  3997 leader_election.cc:336] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:09.987095  4702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7551e973324a21b094c1d2869495ac" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:16:09.987874  4702 raft_consensus.cc:3060] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:09.988226  8499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b523c05ab48243118947b2e30890c0b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:09.989238  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2879f06fa90455ea323efd79c11c330" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938"
I20260709 13:16:09.989960  4707 raft_consensus.cc:3060] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:09.991007  3853 catalog_manager.cc:5697] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: config changed from index -1 to 8, NON_VOTER d709ee666b774ec29aa732e508219938 (127.2.198.196) added. New cstate: current_term: 12 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } } }
I20260709 13:16:10.001760  8458 consensus_queue.cc:1048] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:16:09.996553  4672 leader_election.cc:304] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:16:10.011094  3856 catalog_manager.cc:5697] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938 reported cstate change: term changed from 8 to 9, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to d709ee666b774ec29aa732e508219938 (127.2.198.196). New cstate: current_term: 9 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:10.014214  4707 raft_consensus.cc:2468] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 12.
I20260709 13:16:10.021265  4702 raft_consensus.cc:2468] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8952c48a6f3a43968f7d77f7bfc4d1bc in term 15.
I20260709 13:16:10.025517  4102 raft_consensus.cc:1275] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:16:10.039183  8458 raft_consensus.cc:2804] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:10.039839  8458 raft_consensus.cc:697] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 10 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:16:10.040728  8458 consensus_queue.cc:237] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:10.042081  4117 tablet_copy_source_session.cc:215] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:10.043037  4106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1073c870d784f068fdb3f222623f5a3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:16:10.043267  4103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:16:10.043697  4106 raft_consensus.cc:3060] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:10.044713  4103 raft_consensus.cc:2468] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 10.
I20260709 13:16:10.045382  4032 raft_consensus.cc:1275] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:16:10.044534  4672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37843, user_credentials={real_user=slave}} blocked reactor thread for 48066.6us
I20260709 13:16:10.047901  3999 leader_election.cc:304] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:16:10.054073  8497 raft_consensus.cc:2804] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:16:10.080470  4071 consensus_peers.cc:597] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:10.072086  4073 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
I20260709 13:16:10.079850  8497 raft_consensus.cc:697] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:16:10.085444  8489 raft_consensus.cc:2804] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:10.085973  8489 raft_consensus.cc:697] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 15 LEADER]: Becoming Leader. State: Replica: 8952c48a6f3a43968f7d77f7bfc4d1bc, State: Running, Role: LEADER
I20260709 13:16:10.086172  8497 consensus_queue.cc:237] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:10.086885  8489 consensus_queue.cc:237] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:10.093227  8510 consensus_queue.cc:1048] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:10.108609  8509 consensus_queue.cc:1048] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:16:10.120021  4071 leader_election.cc:336] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:10.124872  4106 raft_consensus.cc:2468] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 10.
I20260709 13:16:10.140172  3997 leader_election.cc:304] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:10.147611  8455 raft_consensus.cc:2804] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:10.143769  3997 leader_election.cc:304] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 
I20260709 13:16:10.148172  8455 raft_consensus.cc:493] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f1c75790cedf4f52a3463a255c7da059)
I20260709 13:16:10.159828  8455 raft_consensus.cc:3060] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:10.169637  3997 leader_election.cc:336] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
W20260709 13:16:10.170742  3997 leader_election.cc:336] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:10.171581  8486 raft_consensus.cc:2804] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:10.172233  8486 raft_consensus.cc:697] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
I20260709 13:16:10.173141  8486 consensus_queue.cc:237] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:10.177711  8513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b2556690d2041edb61d331163aced7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:10.179381  4030 raft_consensus.cc:1275] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:16:10.204358  8531 log.cc:927] Time spent T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:16:10.199326  8509 consensus_queue.cc:1048] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
W20260709 13:16:10.232831  4071 consensus_peers.cc:597] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:10.264595  4071 consensus_peers.cc:597] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:10.273607  8499 tablet_copy_client.cc:806] T b523c05ab48243118947b2e30890c0b4 P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:10.231189  8455 raft_consensus.cc:515] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:10.282243  8455 leader_election.cc:290] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 election: Requested vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:16:10.297818  4108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc52edd660634ce5bc356665dd499a61" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:16:10.298620  4108 raft_consensus.cc:3060] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:10.302855  8499 tablet_copy_client.cc:670] T b523c05ab48243118947b2e30890c0b4 P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:10.345882  8499 tablet_copy_client.cc:538] T b523c05ab48243118947b2e30890c0b4 P d709ee666b774ec29aa732e508219938: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:16:10.360188  4071 consensus_peers.cc:597] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:10.367256  3997 leader_election.cc:336] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:10.369964  4027 raft_consensus.cc:1275] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:10.371981  4108 raft_consensus.cc:2468] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f5b5e4ed72944ecbda200012d141dc2 in term 11.
I20260709 13:16:10.373582  3997 leader_election.cc:304] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:10.376165  8489 consensus_queue.cc:1048] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:16:10.379066  8455 raft_consensus.cc:2804] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:10.405575  8455 raft_consensus.cc:697] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 LEADER]: Becoming Leader. State: Replica: 6f5b5e4ed72944ecbda200012d141dc2, State: Running, Role: LEADER
W20260709 13:16:10.400367  8541 log.cc:927] Time spent T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc: Append to log took a long time: real 0.088s	user 0.001s	sys 0.003s
I20260709 13:16:10.406767  8455 consensus_queue.cc:237] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:10.419045  8499 tablet_bootstrap.cc:492] T b523c05ab48243118947b2e30890c0b4 P d709ee666b774ec29aa732e508219938: Bootstrap starting.
I20260709 13:16:10.468170  3853 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52094 (request call id 234) took 1001 ms. Trace:
I20260709 13:16:10.470189  3857 catalog_manager.cc:5697] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 11 to 12, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 12 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:10.471669  3857 catalog_manager.cc:5697] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 8 to 9, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 9 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:10.468751  3853 rpcz_store.cc:276] 0709 13:16:09.466619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.466787 (+   168us) service_pool.cc:224] Handling call
0709 13:16:09.636464 (+169677us) spinlock_profiling.cc:243] Waited 1.42 ms on lock 0x7b5400428954. stack: 00007f152254f343 00007f152254f240 00007f1521ede1d4 00007f152bc1c304 00007f152bc1c299 00007f15255d8090 00007f1525676f3a 00007f152b42d1cc 00007f152b52b37e 00007f15299ec2a4 00007f15299ec232 00007f15299ec161 00007f15299ec0dc 00007f15299eb392 00007f15239a948c 00007f15239a88c6
0709 13:16:10.468110 (+831646us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:10.107394 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:10.108126 (+   732us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:10.108160 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:16:10.108178 (+    18us) tablet.cc:662] Decoding operations
0709 13:16:10.108613 (+   435us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:10.108695 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:10.108726 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:16:10.108918 (+   192us) tablet.cc:701] Row locks acquired
0709 13:16:10.108938 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:16:10.109086 (+   148us) write_op.cc:270] Start()
0709 13:16:10.109207 (+   121us) write_op.cc:276] Timestamp: P: 1783602970109035 usec, L: 0
0709 13:16:10.109232 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:16:10.110135 (+   903us) log.cc:844] Serialized 599 byte log entry
0709 13:16:10.283512 (+173377us) op_driver.cc:464] REPLICATION: finished
0709 13:16:10.401815 (+118303us) write_op.cc:301] APPLY: starting
0709 13:16:10.401913 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:10.403101 (+  1188us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:10.403203 (+   102us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:10.417016 (+ 13813us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:10.422739 (+  5723us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:16:10.422788 (+    49us) write_op.cc:312] APPLY: finished
0709 13:16:10.425801 (+  3013us) log.cc:844] Serialized 25 byte log entry
0709 13:16:10.432024 (+  6223us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:10.433646 (+  1622us) write_op.cc:454] Released schema lock
0709 13:16:10.433701 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:10.443586 (+  9885us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:10.449730 (+  6144us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":3,"spinlock_wait_cycles":3277440,"child_traces":[["op",{"apply.queue_time_us":118016,"apply.run_cpu_time_us":3916,"apply.run_wall_time_us":36327,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8313,"num_ops":1,"prepare.queue_time_us":113029,"prepare.run_cpu_time_us":14157,"prepare.run_wall_time_us":47370,"raft.queue_time_us":260110,"raft.run_cpu_time_us":30288,"raft.run_wall_time_us":204407,"replication_time_us":174089,"thread_start_us":318551,"threads_started":4,"wal-append.queue_time_us":35638}]]}
W20260709 13:16:10.524266  4071 consensus_peers.cc:597] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:10.546559  8546 log.cc:927] Time spent T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:16:10.551324  4702 raft_consensus.cc:1275] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:16:10.554642  4707 raft_consensus.cc:1275] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 15 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:16:10.554872  3856 catalog_manager.cc:5697] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 reported cstate change: term changed from 9 to 10, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to d709ee666b774ec29aa732e508219938 (127.2.198.196). New cstate: current_term: 10 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:10.554292  8532 consensus_queue.cc:1048] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:16:10.561655  8502 consensus_queue.cc:1048] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
W20260709 13:16:10.574702  3997 consensus_peers.cc:597] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:10.585426  4071 consensus_peers.cc:597] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:10.609565  4071 consensus_peers.cc:597] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:10.688421  4071 consensus_peers.cc:597] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:10.731649  8513 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:57666 (request call id 754) took 1215 ms. Trace:
I20260709 13:16:10.732244  8513 rpcz_store.cc:276] 0709 13:16:09.516657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.516788 (+   131us) service_pool.cc:224] Handling call
0709 13:16:09.587465 (+ 70677us) ts_tablet_manager.cc:934] T 9b2556690d2041edb61d331163aced7d P d709ee666b774ec29aa732e508219938: Initiating tablet copy from peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
0709 13:16:10.176218 (+588753us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:16:10.448383 (+272165us) tablet_metadata.cc:665] Metadata flushed
0709 13:16:10.448540 (+   157us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:16:10.727884 (+279344us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:16:10.728322 (+   438us) tablet_replica.cc:206] Creating consensus instance
0709 13:16:10.731442 (+  3120us) ts_tablet_manager.cc:989] Replica registered.
0709 13:16:10.731525 (+    83us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":13569,"tablet-copy.queue_time_us":69692,"thread_start_us":312546,"threads_started":2}
I20260709 13:16:10.734021  8513 tablet_copy_client.cc:806] T 9b2556690d2041edb61d331163aced7d P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:10.734683  8513 tablet_copy_client.cc:670] T 9b2556690d2041edb61d331163aced7d P d709ee666b774ec29aa732e508219938: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:10.738013  3856 catalog_manager.cc:5697] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 8 to 9, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 9 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:10.744737  3856 catalog_manager.cc:5697] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: term changed from 14 to 15, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195). New cstate: current_term: 15 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:10.754513  4108 raft_consensus.cc:1275] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:16:10.768445  8458 consensus_queue.cc:1048] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:10.770526  8513 tablet_copy_client.cc:538] T 9b2556690d2041edb61d331163aced7d P d709ee666b774ec29aa732e508219938: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:16:10.778813  2843 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 3980)
I20260709 13:16:10.829970  3857 catalog_manager.cc:5697] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 11 to 12, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 12 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:10.844316  3997 consensus_peers.cc:597] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:10.832806  3857 catalog_manager.cc:5697] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 9 to 10, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 10 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:10.846540  3857 catalog_manager.cc:5697] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: term changed from 10 to 11, leader changed from f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) to 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194). New cstate: current_term: 11 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:10.848730  4108 raft_consensus.cc:1275] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:10.854866  4108 raft_consensus.cc:1275] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:16:10.920581  8513 tablet_bootstrap.cc:492] T 9b2556690d2041edb61d331163aced7d P d709ee666b774ec29aa732e508219938: Bootstrap starting.
I20260709 13:16:10.948783  8486 consensus_queue.cc:1048] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
W20260709 13:16:10.973302  4672 consensus_peers.cc:597] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:10.977368  3997 consensus_peers.cc:597] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:10.977712  4071 consensus_peers.cc:597] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:10.978158  3997 consensus_peers.cc:597] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:10.964401  8461 consensus_queue.cc:1048] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
W20260709 13:16:11.000017  4071 consensus_peers.cc:597] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:11.002959  8499 tablet_bootstrap.cc:492] T b523c05ab48243118947b2e30890c0b4 P d709ee666b774ec29aa732e508219938: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:16:11.020872  4071 consensus_peers.cc:597] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:11.043006  4071 consensus_peers.cc:597] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:11.044127  8499 tablet_bootstrap.cc:492] T b523c05ab48243118947b2e30890c0b4 P d709ee666b774ec29aa732e508219938: Bootstrap complete.
I20260709 13:16:11.058835  8499 ts_tablet_manager.cc:1403] T b523c05ab48243118947b2e30890c0b4 P d709ee666b774ec29aa732e508219938: Time spent bootstrapping tablet: real 0.647s	user 0.039s	sys 0.009s
W20260709 13:16:11.083772  4071 consensus_peers.cc:597] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:11.126250  3997 consensus_peers.cc:597] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:11.127225  3997 consensus_peers.cc:597] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:11.126240  4672 consensus_peers.cc:597] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:11.130183  4672 leader_election.cc:336] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
W20260709 13:16:11.132846  4672 consensus_peers.cc:597] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:11.141012  4071 consensus_peers.cc:597] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:11.149304  8499 raft_consensus.cc:359] T b523c05ab48243118947b2e30890c0b4 P d709ee666b774ec29aa732e508219938 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:16:11.150432  8499 raft_consensus.cc:740] T b523c05ab48243118947b2e30890c0b4 P d709ee666b774ec29aa732e508219938 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Initialized, Role: LEARNER
W20260709 13:16:11.170948  4071 consensus_peers.cc:597] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:11.151266  8499 consensus_queue.cc:260] T b523c05ab48243118947b2e30890c0b4 P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:16:11.207242  8499 ts_tablet_manager.cc:1434] T b523c05ab48243118947b2e30890c0b4 P d709ee666b774ec29aa732e508219938: Time spent starting tablet: real 0.136s	user 0.007s	sys 0.000s
I20260709 13:16:11.220755  4707 raft_consensus.cc:1217] T b523c05ab48243118947b2e30890c0b4 P d709ee666b774ec29aa732e508219938 [term 14 LEARNER]: Deduplicated request from leader. Original: 14.8->[14.9-14.9]   Dedup: 14.9->[]
I20260709 13:16:11.231591  4044 tablet_copy_service.cc:342] P 6f5b5e4ed72944ecbda200012d141dc2: Request end of tablet copy session d709ee666b774ec29aa732e508219938-b523c05ab48243118947b2e30890c0b4 received from {username='slave'} at 127.0.0.1:41312
I20260709 13:16:11.232131  4044 tablet_copy_service.cc:434] P 6f5b5e4ed72944ecbda200012d141dc2: ending tablet copy session d709ee666b774ec29aa732e508219938-b523c05ab48243118947b2e30890c0b4 on tablet b523c05ab48243118947b2e30890c0b4 with peer d709ee666b774ec29aa732e508219938
I20260709 13:16:11.238730  8513 tablet_bootstrap.cc:492] T 9b2556690d2041edb61d331163aced7d P d709ee666b774ec29aa732e508219938: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:11.239929  8513 tablet_bootstrap.cc:492] T 9b2556690d2041edb61d331163aced7d P d709ee666b774ec29aa732e508219938: Bootstrap complete.
I20260709 13:16:11.240833  8513 ts_tablet_manager.cc:1403] T 9b2556690d2041edb61d331163aced7d P d709ee666b774ec29aa732e508219938: Time spent bootstrapping tablet: real 0.321s	user 0.030s	sys 0.021s
I20260709 13:16:11.247505  8513 raft_consensus.cc:359] T 9b2556690d2041edb61d331163aced7d P d709ee666b774ec29aa732e508219938 [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:16:11.248597  8513 raft_consensus.cc:740] T 9b2556690d2041edb61d331163aced7d P d709ee666b774ec29aa732e508219938 [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: d709ee666b774ec29aa732e508219938, State: Initialized, Role: LEARNER
I20260709 13:16:11.249404  8513 consensus_queue.cc:260] T 9b2556690d2041edb61d331163aced7d P d709ee666b774ec29aa732e508219938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: NON_VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: true } }
I20260709 13:16:11.251514  8513 ts_tablet_manager.cc:1434] T 9b2556690d2041edb61d331163aced7d P d709ee666b774ec29aa732e508219938: Time spent starting tablet: real 0.010s	user 0.000s	sys 0.004s
I20260709 13:16:11.254070  4117 tablet_copy_service.cc:342] P 8952c48a6f3a43968f7d77f7bfc4d1bc: Request end of tablet copy session d709ee666b774ec29aa732e508219938-9b2556690d2041edb61d331163aced7d received from {username='slave'} at 127.0.0.1:34656
I20260709 13:16:11.254546  4117 tablet_copy_service.cc:434] P 8952c48a6f3a43968f7d77f7bfc4d1bc: ending tablet copy session d709ee666b774ec29aa732e508219938-9b2556690d2041edb61d331163aced7d on tablet 9b2556690d2041edb61d331163aced7d with peer d709ee666b774ec29aa732e508219938
W20260709 13:16:11.312085  3999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:37117, user_credentials={real_user=slave}} blocked reactor thread for 67676.4us
W20260709 13:16:11.523700  4071 consensus_peers.cc:597] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:11.524369  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 46085.1us
W20260709 13:16:11.533164  3997 consensus_peers.cc:597] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:11.535092  3997 consensus_peers.cc:597] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:11.654695  3997 consensus_peers.cc:597] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:11.671103  4707 raft_consensus.cc:1217] T 9b2556690d2041edb61d331163aced7d P d709ee666b774ec29aa732e508219938 [term 12 LEARNER]: Deduplicated request from leader. Original: 12.7->[12.8-12.8]   Dedup: 12.8->[]
W20260709 13:16:11.675422  3997 consensus_peers.cc:597] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:11.745362  3997 consensus_peers.cc:597] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:11.748946  3997 consensus_peers.cc:597] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:11.764071  4672 consensus_peers.cc:597] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:11.779600  2843 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 3980)
I20260709 13:16:11.786041  8455 raft_consensus.cc:1064] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2: attempting to promote NON_VOTER d709ee666b774ec29aa732e508219938 to VOTER
I20260709 13:16:11.795925  8455 consensus_queue.cc:237] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 7, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:16:11.809135  3997 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.2.198.254:36531, user_credentials={real_user=slave}} blocked reactor thread for 47384.4us
W20260709 13:16:11.821650  4672 consensus_peers.cc:597] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:11.838881  3997 consensus_peers.cc:597] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:11.853257  3997 consensus_peers.cc:597] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:11.871311  4707 raft_consensus.cc:1275] T b523c05ab48243118947b2e30890c0b4 P d709ee666b774ec29aa732e508219938 [term 14 LEARNER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:16:11.873565  8486 consensus_queue.cc:1048] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:16:11.895299  4071 consensus_peers.cc:597] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:11.895336  4102 raft_consensus.cc:1275] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 14 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:16:11.908679  8497 consensus_queue.cc:1048] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:16:11.925786  3997 consensus_peers.cc:597] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:12.009279  4071 consensus_peers.cc:597] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:12.018371  4071 consensus_peers.cc:597] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:12.034499  8486 raft_consensus.cc:2955] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index 9 to 10, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:16:12.037730  4707 raft_consensus.cc:2955] T b523c05ab48243118947b2e30890c0b4 P d709ee666b774ec29aa732e508219938 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
W20260709 13:16:12.057086  3997 consensus_peers.cc:597] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:12.089646  3997 consensus_peers.cc:597] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:12.114957  3997 consensus_peers.cc:597] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:12.141059  3841 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 45226.8us
W20260709 13:16:12.145934  3841 catalog_manager.cc:4755] TS f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 20cb8f6ca1af4ec79acaa9f95e816ca6: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
W20260709 13:16:12.162671  4071 consensus_peers.cc:597] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:12.180320  4104 raft_consensus.cc:2955] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:16:12.210336  3856 catalog_manager.cc:5697] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 reported cstate change: config changed from index 9 to 10, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:12.263320  8509 raft_consensus.cc:1064] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc: attempting to promote NON_VOTER d709ee666b774ec29aa732e508219938 to VOTER
I20260709 13:16:12.267166  8509 consensus_queue.cc:237] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 6, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:16:12.278623  4672 consensus_peers.cc:597] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:12.302568  4707 raft_consensus.cc:1275] T 9b2556690d2041edb61d331163aced7d P d709ee666b774ec29aa732e508219938 [term 12 LEARNER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:16:12.304570  8502 consensus_queue.cc:1048] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:12.304458  4027 raft_consensus.cc:1275] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Refusing update from remote peer 8952c48a6f3a43968f7d77f7bfc4d1bc: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:16:12.317852  8370 consensus_queue.cc:1048] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:16:12.325294  4071 consensus_peers.cc:597] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:12.341225  8509 raft_consensus.cc:2955] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index 8 to 9, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:16:12.343345  4702 raft_consensus.cc:2955] T 9b2556690d2041edb61d331163aced7d P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:16:12.363945  4025 raft_consensus.cc:2955] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
W20260709 13:16:12.419973  3997 consensus_peers.cc:597] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:12.420668  4071 consensus_peers.cc:597] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:12.442093  4672 consensus_peers.cc:597] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:12.521493  4025 consensus_queue.cc:237] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:12.547655  4702 raft_consensus.cc:1275] T b523c05ab48243118947b2e30890c0b4 P d709ee666b774ec29aa732e508219938 [term 14 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:16:12.549760  8461 consensus_queue.cc:1048] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:12.551224  3853 catalog_manager.cc:5697] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc reported cstate change: config changed from index 8 to 9, d709ee666b774ec29aa732e508219938 (127.2.198.196) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:12.559530  8562 raft_consensus.cc:2955] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:16:12.565896  4707 raft_consensus.cc:2955] T b523c05ab48243118947b2e30890c0b4 P d709ee666b774ec29aa732e508219938 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:16:12.575767  4104 raft_consensus.cc:1275] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 14 FOLLOWER]: Refusing update from remote peer 6f5b5e4ed72944ecbda200012d141dc2: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:16:12.595263  4672 consensus_peers.cc:597] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:12.620239  4672 consensus_peers.cc:597] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:12.665778  8461 consensus_queue.cc:1048] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:12.685273  3844 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b523c05ab48243118947b2e30890c0b4 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:12.689437  3857 catalog_manager.cc:5697] T b523c05ab48243118947b2e30890c0b4 P d709ee666b774ec29aa732e508219938 reported cstate change: config changed from index 10 to 11, VOTER f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) evicted. New cstate: current_term: 14 leader_uuid: "6f5b5e4ed72944ecbda200012d141dc2" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
I20260709 13:16:12.750604  4108 raft_consensus.cc:2955] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER f1c75790cedf4f52a3463a255c7da059 (127.2.198.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } } }
W20260709 13:16:12.780272  2843 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 3980)
W20260709 13:16:12.862994  4071 consensus_peers.cc:597] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:12.878005  4672 consensus_peers.cc:597] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:12.980814  4071 consensus_peers.cc:597] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:13.039474  4071 consensus_peers.cc:597] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:13.079962  4071 consensus_peers.cc:597] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:13.133991  4071 consensus_peers.cc:597] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:13.199514  4672 consensus_peers.cc:597] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:13.252724  3841 catalog_manager.cc:4755] TS f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet b523c05ab48243118947b2e30890c0b4: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
W20260709 13:16:13.294171  4071 consensus_peers.cc:597] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:13.310835  4071 consensus_peers.cc:597] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:13.307418  3997 consensus_peers.cc:597] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:13.331804  3997 consensus_peers.cc:597] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:13.342023  4672 consensus_peers.cc:597] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:13.348687  4071 consensus_peers.cc:597] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:13.366499  3997 consensus_peers.cc:597] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:13.390342  4071 consensus_peers.cc:597] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:13.419776  3997 consensus_peers.cc:597] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:13.533706  4672 consensus_peers.cc:597] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:13.548677  4071 consensus_peers.cc:597] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:13.560878  4071 consensus_peers.cc:597] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:13.599457  4071 consensus_peers.cc:597] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:13.628579  4071 consensus_peers.cc:597] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:13.639717  3997 consensus_peers.cc:597] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:13.687906  3997 consensus_peers.cc:597] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:13.741379  3997 consensus_peers.cc:597] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:13.780894  2843 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 3980)
W20260709 13:16:13.818463  3997 consensus_peers.cc:597] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:13.844851  3997 consensus_peers.cc:597] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:13.944767  3997 consensus_peers.cc:597] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:13.989280  3997 consensus_peers.cc:597] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:14.047603  4071 consensus_peers.cc:597] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:14.048286  4071 consensus_peers.cc:597] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:14.076632  3997 consensus_peers.cc:597] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:14.120744  4071 consensus_peers.cc:597] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:14.195143  4672 consensus_peers.cc:597] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:14.199901  4672 consensus_peers.cc:597] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:14.417389  3997 consensus_peers.cc:597] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:14.418205  3997 consensus_peers.cc:597] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:14.440510  3997 consensus_peers.cc:597] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:14.503741  4071 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111) [suppressed 457 similar messages]
W20260709 13:16:14.510023  4071 consensus_peers.cc:597] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:14.532400  3997 consensus_peers.cc:597] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:14.566612  3997 consensus_peers.cc:597] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:14.597723  4071 consensus_peers.cc:597] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:14.673207  4071 consensus_peers.cc:597] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:14.765751  4672 consensus_peers.cc:597] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:14.781454  2843 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 3980)
W20260709 13:16:14.945032  3997 consensus_peers.cc:597] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:14.952909  4672 consensus_peers.cc:597] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:14.970870  4071 consensus_peers.cc:597] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:15.149834  4672 consensus_peers.cc:597] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:15.221362  4071 consensus_peers.cc:597] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:15.223064  3841 catalog_manager.cc:4755] TS f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet b523c05ab48243118947b2e30890c0b4: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
W20260709 13:16:15.268723  4672 consensus_peers.cc:597] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:15.342056  4071 consensus_peers.cc:597] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:15.416663  4672 consensus_peers.cc:597] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:15.521740  4071 consensus_peers.cc:597] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:15.623188  4071 consensus_peers.cc:597] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:15.649919  4672 consensus_peers.cc:597] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:15.678035  4071 consensus_peers.cc:597] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:15.710101  4071 consensus_peers.cc:597] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:15.736622  3997 consensus_peers.cc:597] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:15.749505  3997 consensus_peers.cc:597] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:15.782002  2843 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 3980)
W20260709 13:16:15.860884  3997 consensus_peers.cc:597] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:15.862157  4071 consensus_peers.cc:597] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:15.865425  3997 consensus_peers.cc:597] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:15.892256  4071 consensus_peers.cc:597] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:15.929060  4071 consensus_peers.cc:597] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:15.948573  4071 consensus_peers.cc:597] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:15.971498  4071 consensus_peers.cc:597] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:16.014403  4071 consensus_peers.cc:597] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:16.029666  4672 consensus_peers.cc:597] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:16.094128  4071 consensus_peers.cc:597] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:16.145208  4672 consensus_peers.cc:597] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:16.190225  3997 consensus_peers.cc:597] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:16.217900  3997 consensus_peers.cc:597] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:16.227097  3997 consensus_peers.cc:597] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:16.244735  3997 consensus_peers.cc:597] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:16.315201  3841 catalog_manager.cc:4755] TS f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 3f641c5435604e30bb44aa411954bd2f: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
W20260709 13:16:16.383867  3997 consensus_peers.cc:597] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:16.388015  3997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 46853.6us
W20260709 13:16:16.440495  4672 consensus_peers.cc:597] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:16.476214  3997 consensus_peers.cc:597] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:16.476346  4071 consensus_peers.cc:597] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:16.500308  3997 consensus_peers.cc:597] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:16.555941  4071 consensus_peers.cc:597] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:16.597890  3997 consensus_peers.cc:597] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:16.746048  3997 consensus_peers.cc:597] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:16.772511  4071 consensus_peers.cc:597] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:16:16.875451  2843 tablet_server.cc:196] TabletServer@127.2.198.193:0 shutdown complete.
W20260709 13:16:16.998716  4672 consensus_peers.cc:597] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:17.001600  3997 consensus_peers.cc:597] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:17.022837  4071 consensus_peers.cc:597] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:17.074637  4071 consensus_peers.cc:597] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:17.090828  3997 consensus_peers.cc:597] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:17.160208  3997 consensus_peers.cc:597] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:17.187108  4071 consensus_peers.cc:597] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:17.231204  4071 consensus_peers.cc:597] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:17.303861  3997 consensus_peers.cc:597] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:17.402241  4672 consensus_peers.cc:597] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:17.420459  3841 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 85044.1us
W20260709 13:16:17.451434  3841 catalog_manager.cc:4755] TS f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet b523c05ab48243118947b2e30890c0b4: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
W20260709 13:16:17.534176  4672 consensus_peers.cc:597] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:17.628187  4672 consensus_peers.cc:597] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:16:17.681093  2843 tablet_server.cc:179] TabletServer@127.2.198.194:0 shutting down...
W20260709 13:16:17.735520  4074 consensus_peers.cc:597] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:17.748194  4074 consensus_peers.cc:597] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:17.746486  4672 consensus_peers.cc:597] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:17.757422  3997 consensus_peers.cc:597] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:17.785094  4071 consensus_peers.cc:597] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:17.794006  4074 consensus_peers.cc:597] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:17.798348  4675 consensus_peers.cc:597] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:17.809963  4074 consensus_peers.cc:597] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:17.810626  4071 consensus_peers.cc:597] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:16:17.783248  4672 consensus_peers.cc:597] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:17.842674  4675 consensus_peers.cc:597] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:17.845592  4675 consensus_peers.cc:597] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:17.846395  4675 consensus_peers.cc:597] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:17.876258  4074 consensus_peers.cc:597] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:17.906363  4074 consensus_peers.cc:597] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:17.916157  4074 consensus_peers.cc:597] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:17.919997  4071 consensus_peers.cc:597] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:16:17.921797  4074 consensus_peers.cc:597] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:17.937256  4074 consensus_peers.cc:597] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:17.965071  4675 consensus_peers.cc:597] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:17.973619  4071 consensus_peers.cc:597] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:17.974942  4675 consensus_peers.cc:597] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:17.985941  4074 consensus_peers.cc:597] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:18.037391  4074 consensus_peers.cc:597] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:18.038419  4074 consensus_peers.cc:597] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:18.039810  4675 consensus_peers.cc:597] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:18.041450  4675 consensus_peers.cc:597] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:18.074118  4675 consensus_peers.cc:597] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:18.105736  4074 consensus_peers.cc:597] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:18.127269  4675 consensus_peers.cc:597] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:18.154846  2843 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:16:18.170207  3997 consensus_peers.cc:597] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:16:18.171645  2843 tablet_replica.cc:333] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:16:18.173087  2843 raft_consensus.cc:2243] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:18.175607  2843 raft_consensus.cc:2272] T bd24fa3ec4ab41cabe4bcfae21f055f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:18.182283  2843 tablet_replica.cc:333] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:16:18.183264  2843 raft_consensus.cc:2243] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:18.184072  2843 raft_consensus.cc:2272] T b820fbf0157d41e1b9205cc4eb1bb76c P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:18.186302  4074 consensus_peers.cc:597] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:18.186954  4672 consensus_peers.cc:597] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:16:18.188284  2843 tablet_replica.cc:333] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:16:18.189330  2843 raft_consensus.cc:2243] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:18.190044  2843 raft_consensus.cc:2272] T f59fe7d824ba4030a574c8f7172dab57 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:18.193149  2843 tablet_replica.cc:333] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
W20260709 13:16:18.193187  3997 consensus_peers.cc:597] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:16:18.194324  2843 raft_consensus.cc:2243] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:18.195629  2843 raft_consensus.cc:2272] T 5ba65f329a14453da0acb3230a4ac721 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:18.201840  2843 tablet_replica.cc:333] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:16:18.203349  2843 raft_consensus.cc:2243] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:16:18.204528  2843 raft_consensus.cc:2272] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:18.224148  4074 consensus_peers.cc:597] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:18.207734  2843 tablet_replica.cc:333] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:16:18.227787  2843 raft_consensus.cc:2243] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:18.229723  2843 raft_consensus.cc:2272] T f915c4d38c324e5990b58ac46421dfbc P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:18.233054  2843 tablet_replica.cc:333] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:16:18.234015  2843 raft_consensus.cc:2243] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:16:18.235173  2843 raft_consensus.cc:2272] T a55dd6943e7742738991bb00da84127e P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:18.238009  2843 tablet_replica.cc:333] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:16:18.238847  2843 raft_consensus.cc:2243] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:16:18.240028  2843 raft_consensus.cc:2272] T d672aa4b8b8e421ea43cee412d9da66a P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:18.247871  4074 consensus_peers.cc:597] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:18.250697  4675 consensus_peers.cc:597] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:18.257699  2843 tablet_replica.cc:333] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
W20260709 13:16:18.292063  4071 consensus_peers.cc:597] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:16:18.292181  3997 consensus_peers.cc:597] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:16:18.292762  2843 raft_consensus.cc:2243] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:18.293550  2843 raft_consensus.cc:2272] T 6e863d888e2a4327a9127a43deb1f1b9 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:18.304332  2843 tablet_replica.cc:333] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:16:18.306320  2843 raft_consensus.cc:2243] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 LEADER]: Raft consensus shutting down.
W20260709 13:16:18.310390  4675 consensus_peers.cc:597] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:18.313009  2843 raft_consensus.cc:2272] T 4d2c2416b3b84475b42a757829fd63a8 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:18.317430  2843 tablet_replica.cc:333] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:16:18.320051  2843 raft_consensus.cc:2243] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:16:18.322382  2843 raft_consensus.cc:2272] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:18.343392  4071 consensus_peers.cc:597] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:16:18.345456  2843 tablet_replica.cc:333] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:16:18.346410  2843 raft_consensus.cc:2243] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:16:18.349171  2843 raft_consensus.cc:2272] T e7b8e59a6e504b3189b0b875dabf2b96 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:18.367043  2843 tablet_replica.cc:333] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:16:18.368024  2843 raft_consensus.cc:2243] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:18.368798  2843 raft_consensus.cc:2272] T ba7a51e4b70a48daa8267297f285c661 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:18.372902  2843 tablet_replica.cc:333] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:16:18.373809  2843 raft_consensus.cc:2243] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:18.374687  2843 raft_consensus.cc:2272] T 11c2da89f37f4113a8811c6e081da953 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:18.377406  2843 tablet_replica.cc:333] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:16:18.378134  2843 raft_consensus.cc:2243] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:16:18.379209  2843 raft_consensus.cc:2272] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:18.392812  2843 tablet_replica.cc:333] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:16:18.393779  2843 raft_consensus.cc:2243] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:18.394588  2843 raft_consensus.cc:2272] T 0d4e65893d284960aef32d35d0db30a4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:18.397526  2843 tablet_replica.cc:333] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
W20260709 13:16:18.397948  4071 consensus_peers.cc:597] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:16:18.398483  2843 raft_consensus.cc:2243] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:16:18.404722  2843 raft_consensus.cc:2272] T 2705becfe8874dbe97b71d14b12feb8f P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:18.414844  4071 consensus_peers.cc:597] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:16:18.419976  2843 tablet_replica.cc:333] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:16:18.422117  2843 raft_consensus.cc:2243] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:18.422955  2843 raft_consensus.cc:2272] T 08d6732bceef4220a670ac449347258b P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:18.426084  2843 tablet_replica.cc:333] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:16:18.426904  2843 raft_consensus.cc:2243] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Raft consensus shutting down.
W20260709 13:16:18.420554  3997 consensus_peers.cc:597] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:16:18.427505  2843 raft_consensus.cc:2272] T cd023a8b08e942db8236dd7bae557ca6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:18.459419  4071 consensus_peers.cc:597] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:16:18.466463  3997 consensus_peers.cc:597] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:18.470644  4071 consensus_peers.cc:597] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:16:18.468844  2843 tablet_replica.cc:333] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:16:18.474665  2843 raft_consensus.cc:2243] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:18.475749  2843 raft_consensus.cc:2272] T f6f1e6f6803e4a459cce95251d23c854 P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:18.505002  2843 tablet_replica.cc:333] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
W20260709 13:16:18.508255  4071 consensus_peers.cc:597] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:16:18.509121  2843 raft_consensus.cc:2243] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:18.510010  2843 raft_consensus.cc:2272] T 86669993fba94e65ba192aa115ed6e88 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:18.531561  2843 tablet_replica.cc:333] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:16:18.532447  2843 raft_consensus.cc:2243] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:16:18.533967  2843 raft_consensus.cc:2272] T 97cd8a260df0424d973e61ef94d96102 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:18.538172  2843 tablet_replica.cc:333] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:16:18.541446  2843 raft_consensus.cc:2243] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Raft consensus shutting down.
W20260709 13:16:18.542052  4672 consensus_peers.cc:597] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:16:18.544546  2843 raft_consensus.cc:2272] T 1851e462889842a49d577d585d278117 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:18.548555  2843 tablet_replica.cc:333] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:16:18.549727  2843 raft_consensus.cc:2243] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:18.550503  2843 raft_consensus.cc:2272] T 97cf7690694c4d5988258ec1b641a2e6 P 6f5b5e4ed72944ecbda200012d141dc2 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:18.582397  2843 tablet_replica.cc:333] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:16:18.590834  2843 raft_consensus.cc:2243] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:18.591777  2843 raft_consensus.cc:2272] T 40ffdd65ef5c4d8982bdf6556426ee40 P 6f5b5e4ed72944ecbda200012d141dc2 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:18.607071  2843 tablet_replica.cc:333] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:16:18.608014  2843 raft_consensus.cc:2243] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:18.608801  2843 raft_consensus.cc:2272] T 5e21bc17c8f64c43938a80f74620d90a P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:18.612402  2843 tablet_replica.cc:333] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:16:18.613251  2843 raft_consensus.cc:2243] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:18.613903  2843 raft_consensus.cc:2272] T 4a08c9f959924154b694899e3a318181 P 6f5b5e4ed72944ecbda200012d141dc2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:18.616937  2843 tablet_replica.cc:333] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:16:18.621548  2843 raft_consensus.cc:2243] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:18.622364  2843 raft_consensus.cc:2272] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:18.625231  2843 tablet_replica.cc:333] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:16:18.626070  2843 raft_consensus.cc:2243] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:18.626709  2843 raft_consensus.cc:2272] T f9cefab1b91e4d728ddf2663bc49d316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:18.639272  3997 consensus_peers.cc:597] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:16:18.645462  2843 tablet_replica.cc:333] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:16:18.646715  2843 raft_consensus.cc:2243] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:16:18.647919  2843 raft_consensus.cc:2272] T 13ea3a969108486bbbaaaf3697e1d3b5 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:18.652221  2843 tablet_replica.cc:333] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:16:18.675408  2843 raft_consensus.cc:2243] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:16:18.676633  2843 raft_consensus.cc:2272] T 3f641c5435604e30bb44aa411954bd2f P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:18.679716  2843 tablet_replica.cc:333] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:16:18.680576  2843 raft_consensus.cc:2243] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:18.681242  2843 raft_consensus.cc:2272] T 4b83b18c9e8b401c95ac6e2c0a420316 P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:18.685160  8486 raft_consensus.cc:493] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:16:18.685720  8486 raft_consensus.cc:515] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:18.689767  8486 leader_election.cc:290] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:16:18.690119  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:16:18.695374  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2556690d2041edb61d331163aced7d" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:16:18.696712  2843 tablet_replica.cc:333] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:16:18.698549  3997 leader_election.cc:304] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938
I20260709 13:16:18.699417  8486 raft_consensus.cc:2749] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:18.698945  2843 raft_consensus.cc:2243] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:16:18.708308  2843 raft_consensus.cc:2272] T cc52edd660634ce5bc356665dd499a61 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:18.711923  2843 tablet_replica.cc:333] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:16:18.712911  2843 raft_consensus.cc:2243] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Raft consensus shutting down.
W20260709 13:16:18.714073  4071 consensus_peers.cc:597] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:16:18.714875  3997 leader_election.cc:336] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:18.716826  2843 raft_consensus.cc:2272] T 21bc23345fdc47d2b7e9b8964749236e P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:18.722910  2843 tablet_replica.cc:333] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:16:18.723888  2843 raft_consensus.cc:2243] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:16:18.732457  2843 raft_consensus.cc:2272] T b2879f06fa90455ea323efd79c11c330 P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:18.736936  2843 tablet_replica.cc:333] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:16:18.737859  2843 raft_consensus.cc:2243] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 14 LEADER]: Raft consensus shutting down.
W20260709 13:16:18.740342  3997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.741402  2843 raft_consensus.cc:2272] T b523c05ab48243118947b2e30890c0b4 P 6f5b5e4ed72944ecbda200012d141dc2 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:18.745764  2843 tablet_replica.cc:333] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:16:18.756515  2843 raft_consensus.cc:2243] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:16:18.757951  2843 raft_consensus.cc:2272] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 6f5b5e4ed72944ecbda200012d141dc2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:18.761265  2843 tablet_replica.cc:333] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:16:18.762270  2843 raft_consensus.cc:2243] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:18.763437  2843 raft_consensus.cc:2272] T 9b2556690d2041edb61d331163aced7d P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:18.770588  2843 tablet_replica.cc:333] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:16:18.781895  2843 raft_consensus.cc:2243] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:18.792840  8486 raft_consensus.cc:493] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:16:18.793430  8486 raft_consensus.cc:515] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:18.795454  8486 leader_election.cc:290] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:16:18.799109  2843 raft_consensus.cc:2272] T 622bcde3b6ba43678f5eb621e8259db2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:18.801105  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f492997a6e0f48c5b9e231e43f19e3f3" candidate_uuid: "6f5b5e4ed72944ecbda200012d141dc2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:16:18.811957  2843 tablet_replica.cc:333] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:16:18.813050  2843 raft_consensus.cc:2243] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:18.814011  2843 raft_consensus.cc:2272] T 6ff80427d8324bd386a3ac9ff13d768e P 6f5b5e4ed72944ecbda200012d141dc2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:18.817313  2843 tablet_replica.cc:333] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:16:18.818276  2843 raft_consensus.cc:2243] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 LEADER]: Raft consensus shutting down.
W20260709 13:16:18.818511  3997 consensus_peers.cc:597] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:16:18.819046  3997 leader_election.cc:336] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:18.819480  3997 leader_election.cc:304] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f5b5e4ed72944ecbda200012d141dc2; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:18.821449  8486 raft_consensus.cc:2749] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:18.819664  2843 raft_consensus.cc:2272] T 4e6407d1f930405b9aa0d4690377e1da P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:18.825250  2843 tablet_replica.cc:333] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
W20260709 13:16:18.825476  4071 consensus_peers.cc:597] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:16:18.833588  2843 raft_consensus.cc:2243] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:18.834832  2843 raft_consensus.cc:2272] T 9873af7d73cf49f3b2d74a17cf7cd3bf P 6f5b5e4ed72944ecbda200012d141dc2 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:18.841039  2843 tablet_replica.cc:333] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:16:18.851184  2843 raft_consensus.cc:2243] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:16:18.855219  2843 raft_consensus.cc:2272] T ad706e81088440eaa86606b68c1c2c5f P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:18.861843  2843 tablet_replica.cc:333] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:16:18.866042  2843 raft_consensus.cc:2243] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 LEADER]: Raft consensus shutting down.
W20260709 13:16:18.870913  4672 consensus_peers.cc:597] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:16:18.883220  2843 raft_consensus.cc:2272] T 604474f002cb41eb9125fc14353547d2 P 6f5b5e4ed72944ecbda200012d141dc2 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:18.885934  4672 consensus_peers.cc:597] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:16:18.895596  2843 tablet_replica.cc:333] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:16:18.897202  2843 raft_consensus.cc:2243] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:18.906519  2843 raft_consensus.cc:2272] T f492997a6e0f48c5b9e231e43f19e3f3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:18.913722  2843 tablet_replica.cc:333] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:16:18.914844  2843 raft_consensus.cc:2243] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:18.915665  2843 raft_consensus.cc:2272] T c29b05201a5f4c6089866210cf02f151 P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:18.930184  2843 tablet_replica.cc:333] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:16:18.931090  2843 raft_consensus.cc:2243] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:16:18.932372  2843 raft_consensus.cc:2272] T b7e7a2dc30a24e5caaa3806c68b96c08 P 6f5b5e4ed72944ecbda200012d141dc2 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:18.953289  2843 tablet_replica.cc:333] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:16:18.954716  2843 raft_consensus.cc:2243] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:16:18.961735  2843 raft_consensus.cc:2272] T eae506e79ba348b3b1db60ecc6ae6714 P 6f5b5e4ed72944ecbda200012d141dc2 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:18.964975  2843 tablet_replica.cc:333] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2: stopping tablet replica
I20260709 13:16:18.973318  2843 raft_consensus.cc:2243] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:16:18.974910  2843 raft_consensus.cc:2272] T b1073c870d784f068fdb3f222623f5a3 P 6f5b5e4ed72944ecbda200012d141dc2 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:19.001389  4071 consensus_peers.cc:597] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:16:19.018549  4071 consensus_peers.cc:597] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:19.112692  4071 consensus_peers.cc:597] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:16:19.251130  8509 raft_consensus.cc:493] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:19.251719  8509 raft_consensus.cc:515] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:16:19.259888  4071 leader_election.cc:336] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
W20260709 13:16:19.263186  4074 leader_election.cc:336] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:19.263657  4074 leader_election.cc:304] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:19.264477  8600 raft_consensus.cc:2749] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:19.253917  8509 leader_election.cc:290] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:16:19.331941  8603 raft_consensus.cc:493] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:19.332541  8603 raft_consensus.cc:515] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:19.334786  8603 leader_election.cc:290] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:16:19.339118  4675 leader_election.cc:336] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
W20260709 13:16:19.357767  4672 leader_election.cc:336] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:19.358237  4672 leader_election.cc:304] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:19.360023  8603 raft_consensus.cc:2749] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:19.383958  8509 raft_consensus.cc:493] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:19.384507  8509 raft_consensus.cc:515] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:19.386494  8509 leader_election.cc:290] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:16:19.391336  4071 leader_election.cc:336] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:19.405920  8509 raft_consensus.cc:493] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:19.409334  8509 raft_consensus.cc:515] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:19.411283  8509 leader_election.cc:290] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:16:19.417038  4071 leader_election.cc:336] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
W20260709 13:16:19.429661  4074 leader_election.cc:336] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
I20260709 13:16:19.430143  4074 leader_election.cc:304] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:19.436228  8509 raft_consensus.cc:2749] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:16:19.454038  4074 leader_election.cc:336] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
I20260709 13:16:19.454537  4074 leader_election.cc:304] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:19.455303  8509 raft_consensus.cc:2749] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:16:19.499495  4071 consensus_peers.cc:597] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:19.520359  4071 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111) [suppressed 564 similar messages]
I20260709 13:16:19.545576  8509 raft_consensus.cc:493] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:19.546185  8509 raft_consensus.cc:515] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:19.548641  8509 leader_election.cc:290] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:16:19.549764  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
W20260709 13:16:19.556373  4074 leader_election.cc:336] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
I20260709 13:16:19.556911  4074 leader_election.cc:304] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:16:19.558923  8600 raft_consensus.cc:2749] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:19.567035  8600 raft_consensus.cc:493] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:19.567611  8600 raft_consensus.cc:515] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:19.569960  8600 leader_election.cc:290] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:16:19.575212  4071 leader_election.cc:336] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
W20260709 13:16:19.579671  4074 leader_election.cc:336] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
I20260709 13:16:19.580133  4074 leader_election.cc:304] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
W20260709 13:16:19.580770  4672 consensus_peers.cc:597] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:16:19.580955  8600 raft_consensus.cc:2749] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:19.590302  8600 raft_consensus.cc:493] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:19.590937  8600 raft_consensus.cc:515] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:19.594128  8600 leader_election.cc:290] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:16:19.601390  4071 leader_election.cc:336] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
W20260709 13:16:19.606995  4074 leader_election.cc:336] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
I20260709 13:16:19.607512  4074 leader_election.cc:304] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:19.608335  8600 raft_consensus.cc:2749] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:19.682574  4071 consensus_peers.cc:597] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:19.719833  4071 consensus_peers.cc:597] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:16:19.774590  8604 raft_consensus.cc:493] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:19.775177  8604 raft_consensus.cc:515] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:19.777531  8604 leader_election.cc:290] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:16:19.781704  8566 raft_consensus.cc:493] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:19.782513  8566 raft_consensus.cc:515] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:16:19.783609  4074 leader_election.cc:336] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
I20260709 13:16:19.784683  8566 leader_election.cc:290] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:16:19.778333  8509 raft_consensus.cc:493] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:19.787585  8509 raft_consensus.cc:515] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:19.790449  8509 leader_election.cc:290] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:16:19.796295  4074 leader_election.cc:336] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
I20260709 13:16:19.798667  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:16:19.799423  4102 raft_consensus.cc:2468] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 11.
W20260709 13:16:19.809253  4675 leader_election.cc:336] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
W20260709 13:16:19.814426  4071 leader_election.cc:336] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:19.828374  4071 leader_election.cc:304] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:19.825337  8604 raft_consensus.cc:493] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:19.832931  8604 raft_consensus.cc:515] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:19.835824  8604 leader_election.cc:290] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
I20260709 13:16:19.836440  8604 raft_consensus.cc:2749] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:19.830752  4672 leader_election.cc:304] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:16:19.837471  8610 raft_consensus.cc:2804] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:19.837836  8610 raft_consensus.cc:493] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:19.838184  8610 raft_consensus.cc:3060] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:19.841521  4074 leader_election.cc:336] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
I20260709 13:16:19.850287  8610 raft_consensus.cc:515] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:19.854650  8600 raft_consensus.cc:493] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:19.881134  8600 raft_consensus.cc:515] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:19.883950  8600 leader_election.cc:290] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:16:19.889681  4074 leader_election.cc:336] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
I20260709 13:16:19.891759  8610 leader_election.cc:290] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:16:19.880004  4672 consensus_peers.cc:597] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:16:19.898058  8600 raft_consensus.cc:493] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:19.904736  8600 raft_consensus.cc:515] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:19.906991  8600 leader_election.cc:290] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:16:19.912838  4074 leader_election.cc:336] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
I20260709 13:16:19.915091  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20cb8f6ca1af4ec79acaa9f95e816ca6" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:16:19.915786  4102 raft_consensus.cc:3060] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:19.923961  8600 raft_consensus.cc:493] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:19.924685  8600 raft_consensus.cc:515] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:19.927342  8600 leader_election.cc:290] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:16:19.931228  4102 raft_consensus.cc:2468] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 12.
W20260709 13:16:19.934577  4074 leader_election.cc:336] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
W20260709 13:16:19.937526  4675 leader_election.cc:336] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
I20260709 13:16:19.942396  4672 leader_election.cc:304] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2
W20260709 13:16:19.900285  4071 leader_election.cc:336] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:19.944268  4071 leader_election.cc:304] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:19.902473  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:16:19.901703  8604 raft_consensus.cc:493] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:19.949298  4073 leader_election.cc:304] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:16:19.948055  8604 raft_consensus.cc:515] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:19.950814  8611 raft_consensus.cc:2749] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:16:19.951997  4071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:35339, user_credentials={real_user=slave}} blocked reactor thread for 51752.8us
I20260709 13:16:19.952520  8611 raft_consensus.cc:2749] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:19.952648  8604 leader_election.cc:290] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), d709ee666b774ec29aa732e508219938 (127.2.198.196:37117)
W20260709 13:16:19.956964  4074 leader_election.cc:336] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
I20260709 13:16:19.959982  8604 raft_consensus.cc:493] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:19.960570  8604 raft_consensus.cc:515] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:19.961514  8603 raft_consensus.cc:2804] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:19.962049  8603 raft_consensus.cc:697] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P d709ee666b774ec29aa732e508219938 [term 12 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:16:19.962918  8604 leader_election.cc:290] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:16:19.963007  8603 consensus_queue.cc:237] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:19.968895  8566 raft_consensus.cc:493] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:19.969389  8566 raft_consensus.cc:515] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:16:19.967370  4074 leader_election.cc:336] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
I20260709 13:16:19.971957  4707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d709ee666b774ec29aa732e508219938" is_pre_election: true
I20260709 13:16:19.973606  4073 leader_election.cc:304] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, d709ee666b774ec29aa732e508219938
I20260709 13:16:19.971336  8566 leader_election.cc:290] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:16:19.977644  8604 raft_consensus.cc:2749] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:16:19.985785  4675 leader_election.cc:336] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
W20260709 13:16:20.016605  4071 leader_election.cc:336] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:20.017376  4071 leader_election.cc:304] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:20.020100  8600 raft_consensus.cc:2749] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:16:20.026041  4071 leader_election.cc:336] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:20.026643  4071 leader_election.cc:304] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
W20260709 13:16:20.028235  4672 leader_election.cc:336] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:20.028729  4672 leader_election.cc:304] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:20.030483  8608 raft_consensus.cc:2749] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:20.027485  8600 raft_consensus.cc:2749] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:20.041929  3857 catalog_manager.cc:5697] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P d709ee666b774ec29aa732e508219938 reported cstate change: term changed from 11 to 12, leader changed from 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) to d709ee666b774ec29aa732e508219938 (127.2.198.196). New cstate: current_term: 12 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:20.051591  4071 leader_election.cc:336] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
W20260709 13:16:20.051782  4672 consensus_peers.cc:597] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:16:20.052574  4071 leader_election.cc:304] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
W20260709 13:16:20.053581  4071 leader_election.cc:336] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:20.053989  4071 leader_election.cc:304] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:20.055840  8604 raft_consensus.cc:2749] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:20.064605  8600 raft_consensus.cc:2749] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:20.065440  8566 raft_consensus.cc:493] T 3f641c5435604e30bb44aa411954bd2f P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:20.066040  8566 raft_consensus.cc:515] T 3f641c5435604e30bb44aa411954bd2f P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:16:20.066507  4074 consensus_peers.cc:597] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:20.069530  8566 leader_election.cc:290] T 3f641c5435604e30bb44aa411954bd2f P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:16:20.070549  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:16:20.071286  4102 raft_consensus.cc:2468] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 9.
I20260709 13:16:20.072861  4672 leader_election.cc:304] T 3f641c5435604e30bb44aa411954bd2f P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 
W20260709 13:16:20.073734  4675 leader_election.cc:336] T 3f641c5435604e30bb44aa411954bd2f P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
I20260709 13:16:20.074748  8566 raft_consensus.cc:2804] T 3f641c5435604e30bb44aa411954bd2f P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:20.075141  8566 raft_consensus.cc:493] T 3f641c5435604e30bb44aa411954bd2f P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:20.075436  8566 raft_consensus.cc:3060] T 3f641c5435604e30bb44aa411954bd2f P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:20.079067  8600 raft_consensus.cc:493] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:20.079658  8600 raft_consensus.cc:515] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:20.096973  8600 leader_election.cc:290] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:16:20.101382  4071 consensus_peers.cc:597] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:16:20.104094  8566 raft_consensus.cc:515] T 3f641c5435604e30bb44aa411954bd2f P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:20.109558  8608 raft_consensus.cc:493] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:20.110334  8566 leader_election.cc:290] T 3f641c5435604e30bb44aa411954bd2f P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:16:20.110211  8608 raft_consensus.cc:515] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:20.110500  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f641c5435604e30bb44aa411954bd2f" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:16:20.111284  4102 raft_consensus.cc:3060] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:20.112684  8608 leader_election.cc:290] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:16:20.114744  4675 leader_election.cc:336] T 3f641c5435604e30bb44aa411954bd2f P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
W20260709 13:16:20.119696  4675 leader_election.cc:336] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
W20260709 13:16:20.120508  4672 leader_election.cc:336] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:20.120913  4672 leader_election.cc:304] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:20.122213  8608 raft_consensus.cc:2749] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:16:20.121675  4074 consensus_peers.cc:597] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:20.123401  4074 leader_election.cc:336] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
W20260709 13:16:20.125494  4071 leader_election.cc:336] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:20.125921  4071 leader_election.cc:304] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:20.126664  8611 raft_consensus.cc:2749] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:20.119210  4102 raft_consensus.cc:2468] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 10.
I20260709 13:16:20.128233  4672 leader_election.cc:304] T 3f641c5435604e30bb44aa411954bd2f P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2
W20260709 13:16:20.132061  4675 consensus_peers.cc:597] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:20.132412  8611 raft_consensus.cc:493] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:20.132887  8608 raft_consensus.cc:2804] T 3f641c5435604e30bb44aa411954bd2f P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:20.133033  8611 raft_consensus.cc:515] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:20.133698  8608 raft_consensus.cc:697] T 3f641c5435604e30bb44aa411954bd2f P d709ee666b774ec29aa732e508219938 [term 10 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
W20260709 13:16:20.139912  4074 leader_election.cc:336] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
I20260709 13:16:20.141182  8611 leader_election.cc:290] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:16:20.144266  4071 leader_election.cc:336] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:20.144694  4071 leader_election.cc:304] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:20.145660  8604 raft_consensus.cc:2749] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:20.145537  8608 consensus_queue.cc:237] T 3f641c5435604e30bb44aa411954bd2f P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:20.177512  3857 catalog_manager.cc:5697] T 3f641c5435604e30bb44aa411954bd2f P d709ee666b774ec29aa732e508219938 reported cstate change: term changed from 9 to 10, leader changed from 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) to d709ee666b774ec29aa732e508219938 (127.2.198.196). New cstate: current_term: 10 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:20.186048  8608 raft_consensus.cc:493] T b523c05ab48243118947b2e30890c0b4 P d709ee666b774ec29aa732e508219938 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:20.186825  8608 raft_consensus.cc:515] T b523c05ab48243118947b2e30890c0b4 P d709ee666b774ec29aa732e508219938 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:16:20.193585  4675 leader_election.cc:336] T b523c05ab48243118947b2e30890c0b4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
W20260709 13:16:20.202705  4672 consensus_peers.cc:597] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:16:20.205242  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" is_pre_election: true
I20260709 13:16:20.205842  8608 leader_election.cc:290] T b523c05ab48243118947b2e30890c0b4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
I20260709 13:16:20.205989  4102 raft_consensus.cc:2468] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 14.
I20260709 13:16:20.207463  4672 leader_election.cc:304] T b523c05ab48243118947b2e30890c0b4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:16:20.209362  8608 raft_consensus.cc:2804] T b523c05ab48243118947b2e30890c0b4 P d709ee666b774ec29aa732e508219938 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:20.209830  8608 raft_consensus.cc:493] T b523c05ab48243118947b2e30890c0b4 P d709ee666b774ec29aa732e508219938 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:20.210251  8608 raft_consensus.cc:3060] T b523c05ab48243118947b2e30890c0b4 P d709ee666b774ec29aa732e508219938 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:20.226961  8608 raft_consensus.cc:515] T b523c05ab48243118947b2e30890c0b4 P d709ee666b774ec29aa732e508219938 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:16:20.234514  4074 consensus_peers.cc:597] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:20.246326  4675 leader_election.cc:336] T b523c05ab48243118947b2e30890c0b4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
I20260709 13:16:20.242532  4102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b523c05ab48243118947b2e30890c0b4" candidate_uuid: "d709ee666b774ec29aa732e508219938" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc"
I20260709 13:16:20.255831  4102 raft_consensus.cc:3060] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:20.241394  8608 leader_election.cc:290] T b523c05ab48243118947b2e30890c0b4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 15 election: Requested vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:16:20.276196  4672 consensus_peers.cc:597] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:16:20.281898  4102 raft_consensus.cc:2468] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d709ee666b774ec29aa732e508219938 in term 15.
W20260709 13:16:20.287428  2843 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 4055)
I20260709 13:16:20.288612  4672 leader_election.cc:304] T b523c05ab48243118947b2e30890c0b4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2
I20260709 13:16:20.289558  8608 raft_consensus.cc:2804] T b523c05ab48243118947b2e30890c0b4 P d709ee666b774ec29aa732e508219938 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:20.290097  8608 raft_consensus.cc:697] T b523c05ab48243118947b2e30890c0b4 P d709ee666b774ec29aa732e508219938 [term 15 LEADER]: Becoming Leader. State: Replica: d709ee666b774ec29aa732e508219938, State: Running, Role: LEADER
I20260709 13:16:20.291036  8608 consensus_queue.cc:237] T b523c05ab48243118947b2e30890c0b4 P d709ee666b774ec29aa732e508219938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:16:20.293828  4071 consensus_peers.cc:597] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:16:20.296348  4071 consensus_peers.cc:597] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:20.297032  4074 consensus_peers.cc:597] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:20.312238  3857 catalog_manager.cc:5697] T b523c05ab48243118947b2e30890c0b4 P d709ee666b774ec29aa732e508219938 reported cstate change: term changed from 14 to 15, leader changed from 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194) to d709ee666b774ec29aa732e508219938 (127.2.198.196). New cstate: current_term: 15 leader_uuid: "d709ee666b774ec29aa732e508219938" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:20.323144  4672 consensus_peers.cc:597] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:16:20.339360  4675 consensus_peers.cc:597] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:20.345361  8603 raft_consensus.cc:493] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:20.345999  8603 raft_consensus.cc:515] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:20.348376  8603 leader_election.cc:290] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:16:20.358170  4675 leader_election.cc:336] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
W20260709 13:16:20.359241  4672 leader_election.cc:336] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:20.359719  4672 leader_election.cc:304] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:20.361043  8603 raft_consensus.cc:2749] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:16:20.381572  4675 consensus_peers.cc:597] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:20.404469  4675 consensus_peers.cc:597] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:20.407833  8604 raft_consensus.cc:493] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:20.408516  8604 raft_consensus.cc:515] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:16:20.419857  4074 leader_election.cc:336] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
W20260709 13:16:20.421322  4071 leader_election.cc:336] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:20.421772  4071 leader_election.cc:304] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:20.422549  8611 raft_consensus.cc:2749] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:20.423712  8604 leader_election.cc:290] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:16:20.433295  4074 consensus_peers.cc:597] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:20.440176  4071 consensus_peers.cc:597] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:16:20.440958  4675 consensus_peers.cc:597] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:20.441481  4675 consensus_peers.cc:597] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:20.460640  4675 consensus_peers.cc:597] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:20.479585  4071 consensus_peers.cc:597] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:20.543956  4074 consensus_peers.cc:597] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:20.564196  4074 consensus_peers.cc:597] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:20.564736  4074 consensus_peers.cc:597] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:20.568488  4102 raft_consensus.cc:1275] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:16:20.573210  4675 consensus_peers.cc:597] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:20.574606  8603 consensus_queue.cc:1048] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:16:20.590497  4675 consensus_peers.cc:597] T 3f641c5435604e30bb44aa411954bd2f P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:20.601589  4074 consensus_peers.cc:597] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:20.630379  4071 consensus_peers.cc:597] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:16:20.646436  4074 consensus_peers.cc:597] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:20.647037  4074 consensus_peers.cc:597] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:20.647459  4074 consensus_peers.cc:597] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:20.656286  4675 consensus_peers.cc:597] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:20.665853  4675 consensus_peers.cc:597] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:20.676765  4074 consensus_peers.cc:597] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:20.682508  4074 consensus_peers.cc:597] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:20.685626  4071 consensus_peers.cc:597] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:16:20.685883  4102 raft_consensus.cc:1275] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 15 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:16:20.688131  8603 consensus_queue.cc:1048] T b523c05ab48243118947b2e30890c0b4 P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:16:20.692175  4675 consensus_peers.cc:597] T b523c05ab48243118947b2e30890c0b4 P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:20.749343  4074 consensus_peers.cc:597] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:20.756656  4675 consensus_peers.cc:597] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:20.765887  4672 consensus_peers.cc:597] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:16:20.771468  4102 raft_consensus.cc:1275] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Refusing update from remote peer d709ee666b774ec29aa732e508219938: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:16:20.776119  8624 consensus_queue.cc:1048] T 3f641c5435604e30bb44aa411954bd2f P d709ee666b774ec29aa732e508219938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:16:20.850247  4675 consensus_peers.cc:597] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:20.908754  4074 consensus_peers.cc:597] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:20.915405  2843 tablet_server.cc:196] TabletServer@127.2.198.194:0 shutdown complete.
W20260709 13:16:20.923147  4071 consensus_peers.cc:597] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:16:20.923772  4071 consensus_peers.cc:597] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:16:20.978255  4672 consensus_peers.cc:597] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:21.039080  4071 consensus_peers.cc:597] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:21.049422  4071 consensus_peers.cc:597] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:16:21.049491  4675 consensus_peers.cc:597] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:21.150990  2843 tablet_server.cc:179] TabletServer@127.2.198.195:0 shutting down...
W20260709 13:16:21.160267  4672 consensus_peers.cc:597] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:21.210690  4071 consensus_peers.cc:597] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:16:21.213109  4672 consensus_peers.cc:597] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:16:21.214211  4672 consensus_peers.cc:597] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P d709ee666b774ec29aa732e508219938 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:21.220511  4071 consensus_peers.cc:597] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:16:21.227069  4672 consensus_peers.cc:597] T 3f641c5435604e30bb44aa411954bd2f P d709ee666b774ec29aa732e508219938 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:21.238277  4672 consensus_peers.cc:597] T b523c05ab48243118947b2e30890c0b4 P d709ee666b774ec29aa732e508219938 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:21.241981  4672 consensus_peers.cc:597] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:21.244854  8627 raft_consensus.cc:493] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:21.245512  8627 raft_consensus.cc:515] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
W20260709 13:16:21.255895  4672 consensus_peers.cc:597] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:21.257272  8627 leader_election.cc:290] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:16:21.258140  4071 leader_election.cc:336] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
W20260709 13:16:21.264334  4074 leader_election.cc:336] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
I20260709 13:16:21.265055  4074 leader_election.cc:304] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:21.268508  8627 raft_consensus.cc:2749] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:21.285164  8627 raft_consensus.cc:493] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:21.286252  8627 raft_consensus.cc:515] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:21.293555  8627 leader_election.cc:290] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:16:21.301666  4074 leader_election.cc:336] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
W20260709 13:16:21.302635  4071 leader_election.cc:336] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:21.303148  4071 leader_election.cc:304] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
W20260709 13:16:21.304986  4672 consensus_peers.cc:597] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:21.305649  8626 raft_consensus.cc:2749] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:21.363174  4071 consensus_peers.cc:597] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:16:21.381963  4672 consensus_peers.cc:597] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:21.384059  8626 raft_consensus.cc:493] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:21.384706  8626 raft_consensus.cc:515] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:21.387121  8626 leader_election.cc:290] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:16:21.392287  4672 consensus_peers.cc:597] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:21.397806  4071 leader_election.cc:336] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
W20260709 13:16:21.399500  4074 leader_election.cc:336] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
I20260709 13:16:21.400106  4074 leader_election.cc:304] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:21.404177  8626 raft_consensus.cc:2749] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:21.454572  2843 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:21.469720  8611 raft_consensus.cc:493] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:21.471203  8611 raft_consensus.cc:515] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:21.483726  8611 leader_election.cc:290] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:16:21.494956  4672 consensus_peers.cc:597] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:21.507388  4672 consensus_peers.cc:597] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:21.512168  4672 consensus_peers.cc:597] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:21.515232  2843 tablet_replica.cc:333] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
W20260709 13:16:21.516656  4071 leader_election.cc:336] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
W20260709 13:16:21.517437  4071 consensus_peers.cc:597] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:16:21.518051  2843 raft_consensus.cc:2243] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 LEADER]: Raft consensus shutting down.
W20260709 13:16:21.522394  4074 leader_election.cc:336] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
I20260709 13:16:21.522814  4074 leader_election.cc:304] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:21.523684  8611 raft_consensus.cc:2749] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:21.526985  2843 raft_consensus.cc:2272] T b820fbf0157d41e1b9205cc4eb1bb76c P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:21.529897  8603 raft_consensus.cc:493] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:21.531147  8603 raft_consensus.cc:515] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:21.531965  8611 raft_consensus.cc:493] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:21.532963  8611 raft_consensus.cc:515] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:21.534629  8603 leader_election.cc:290] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:16:21.536376  8611 leader_election.cc:290] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:16:21.540829  4675 leader_election.cc:336] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
W20260709 13:16:21.544754  4672 leader_election.cc:336] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:21.545217  4672 leader_election.cc:304] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
W20260709 13:16:21.545922  4071 leader_election.cc:336] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
W20260709 13:16:21.546444  4074 leader_election.cc:336] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
I20260709 13:16:21.546867  4074 leader_election.cc:304] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:21.548595  8627 raft_consensus.cc:2749] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:21.549661  8603 raft_consensus.cc:2749] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:21.554893  2843 tablet_replica.cc:333] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:16:21.557225  2843 raft_consensus.cc:2243] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:16:21.559957  2843 raft_consensus.cc:2272] T f59fe7d824ba4030a574c8f7172dab57 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:21.563714  2843 tablet_replica.cc:333] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:16:21.565570  2843 raft_consensus.cc:2243] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:21.566383  2843 raft_consensus.cc:2272] T 7ebbb84155f1455d87aab7fd5d78e3d8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:21.583824  2843 tablet_replica.cc:333] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:16:21.596386  2843 raft_consensus.cc:2243] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 LEADER]: Raft consensus shutting down.
W20260709 13:16:21.594355  4672 consensus_peers.cc:597] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:21.605014  2843 raft_consensus.cc:2272] T 5ba65f329a14453da0acb3230a4ac721 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:21.607640  4672 consensus_peers.cc:597] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:21.612576  8627 raft_consensus.cc:493] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:21.613389  8627 raft_consensus.cc:515] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:21.615990  8627 leader_election.cc:290] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:16:21.623980  2843 tablet_replica.cc:333] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:16:21.626372  2843 raft_consensus.cc:2243] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:16:21.634956  2843 raft_consensus.cc:2272] T f915c4d38c324e5990b58ac46421dfbc P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:21.638458  4074 leader_election.cc:336] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
W20260709 13:16:21.643227  4071 leader_election.cc:336] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:21.643721  4071 leader_election.cc:304] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:21.645853  8611 raft_consensus.cc:2749] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:16:21.651886  3841 catalog_manager.cc:4755] TS f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet b523c05ab48243118947b2e30890c0b4: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:21.662619  2843 tablet_replica.cc:333] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:16:21.664142  2843 raft_consensus.cc:2243] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:21.665395  2843 raft_consensus.cc:2272] T a55dd6943e7742738991bb00da84127e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:21.669430  2843 tablet_replica.cc:333] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:16:21.670719  2843 raft_consensus.cc:2243] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:21.681892  2843 raft_consensus.cc:2272] T 4d2c2416b3b84475b42a757829fd63a8 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:21.690812  8608 raft_consensus.cc:493] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:21.692102  2843 tablet_replica.cc:333] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:16:21.691774  8608 raft_consensus.cc:515] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:21.693938  2843 raft_consensus.cc:2243] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:16:21.695225  8608 leader_election.cc:290] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:16:21.723660  4071 consensus_peers.cc:597] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:16:21.725284  4675 leader_election.cc:336] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
I20260709 13:16:21.748262  2843 raft_consensus.cc:2272] T dc2641ff9849458a9200dfc5a9016cce P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:21.754271  4071 consensus_peers.cc:597] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:16:21.776619  2843 tablet_replica.cc:333] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:16:21.777911  2843 raft_consensus.cc:2243] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:21.779001  2843 raft_consensus.cc:2272] T e7b8e59a6e504b3189b0b875dabf2b96 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:21.781036  4672 leader_election.cc:336] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:21.781587  4672 leader_election.cc:304] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:21.782481  8566 raft_consensus.cc:2749] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:21.782764  2843 tablet_replica.cc:333] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:16:21.784353  2843 raft_consensus.cc:2243] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:16:21.785952  2843 raft_consensus.cc:2272] T 256a58e0d11d473c899ea90e30dbd511 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:21.786194  8611 raft_consensus.cc:493] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:21.786881  8611 raft_consensus.cc:515] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:21.789597  8611 leader_election.cc:290] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:16:21.801309  4074 leader_election.cc:336] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
W20260709 13:16:21.804075  4672 consensus_peers.cc:597] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:21.805749  4071 leader_election.cc:336] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:21.806285  4071 leader_election.cc:304] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:21.807289  8627 raft_consensus.cc:2749] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:16:21.824990  4672 consensus_peers.cc:597] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:21.827378  2843 tablet_replica.cc:333] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:16:21.843724  2843 raft_consensus.cc:2243] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:21.844910  2843 raft_consensus.cc:2272] T 11c2da89f37f4113a8811c6e081da953 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:21.848825  2843 tablet_replica.cc:333] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:16:21.850076  2843 raft_consensus.cc:2243] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:21.874406  2843 raft_consensus.cc:2272] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:21.904968  2843 tablet_replica.cc:333] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:16:21.906124  2843 raft_consensus.cc:2243] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:16:21.908046  2843 raft_consensus.cc:2272] T cd023a8b08e942db8236dd7bae557ca6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:21.911808  2843 tablet_replica.cc:333] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:16:21.912868  2843 raft_consensus.cc:2243] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:16:21.914594  2843 raft_consensus.cc:2272] T f6f1e6f6803e4a459cce95251d23c854 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:21.918383  2843 tablet_replica.cc:333] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:16:21.919394  2843 raft_consensus.cc:2243] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:21.920481  2843 raft_consensus.cc:2272] T ba7a51e4b70a48daa8267297f285c661 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:21.924007  2843 tablet_replica.cc:333] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:16:21.925194  2843 raft_consensus.cc:2243] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:21.926170  2843 raft_consensus.cc:2272] T 0d4e65893d284960aef32d35d0db30a4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:21.929667  2843 tablet_replica.cc:333] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:16:21.930588  2843 raft_consensus.cc:2243] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:21.931481  2843 raft_consensus.cc:2272] T 2705becfe8874dbe97b71d14b12feb8f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:21.935062  2843 tablet_replica.cc:333] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:16:21.938553  2843 raft_consensus.cc:2243] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:16:21.941747  2843 raft_consensus.cc:2272] T 5e21bc17c8f64c43938a80f74620d90a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:21.945331  2843 tablet_replica.cc:333] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:16:21.946358  2843 raft_consensus.cc:2243] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:16:21.948084  2843 raft_consensus.cc:2272] T 4a08c9f959924154b694899e3a318181 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:21.958511  2843 tablet_replica.cc:333] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:16:21.959918  2843 raft_consensus.cc:2243] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:21.966265  2843 raft_consensus.cc:2272] T 86669993fba94e65ba192aa115ed6e88 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:21.982180  2843 tablet_replica.cc:333] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:16:21.983258  2843 raft_consensus.cc:2243] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:21.984202  2843 raft_consensus.cc:2272] T 97cd8a260df0424d973e61ef94d96102 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:21.988096  2843 tablet_replica.cc:333] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
W20260709 13:16:21.992295  4672 consensus_peers.cc:597] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:16:21.993606  2843 raft_consensus.cc:2243] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:21.994884  2843 raft_consensus.cc:2272] T 1851e462889842a49d577d585d278117 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:21.998932  2843 tablet_replica.cc:333] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:16:21.999990  2843 raft_consensus.cc:2243] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:22.002220  2843 raft_consensus.cc:2272] T 97cf7690694c4d5988258ec1b641a2e6 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:22.008013  8603 raft_consensus.cc:493] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:22.008701  8603 raft_consensus.cc:515] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:22.010753  8603 leader_election.cc:290] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:16:22.019479  4672 leader_election.cc:336] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:22.020006  2843 tablet_replica.cc:333] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
W20260709 13:16:22.022927  4675 leader_election.cc:336] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
I20260709 13:16:22.023427  4675 leader_election.cc:304] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:22.024286  8603 raft_consensus.cc:2749] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:22.029129  2843 raft_consensus.cc:2243] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:16:22.030761  2843 raft_consensus.cc:2272] T 40ffdd65ef5c4d8982bdf6556426ee40 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:22.031042  8627 raft_consensus.cc:493] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:22.031757  8627 raft_consensus.cc:515] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:22.034106  8627 leader_election.cc:290] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:16:22.034189  2843 tablet_replica.cc:333] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:16:22.035847  2843 raft_consensus.cc:2243] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:22.038336  2843 raft_consensus.cc:2272] T 649df91131174f00af0e0a0240f80adb P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:22.050869  4074 leader_election.cc:336] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
W20260709 13:16:22.051955  4071 leader_election.cc:336] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:22.052335  4071 leader_election.cc:304] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:22.053536  8627 raft_consensus.cc:2749] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:22.057650  2843 tablet_replica.cc:333] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:16:22.058753  2843 raft_consensus.cc:2243] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:22.059860  2843 raft_consensus.cc:2272] T cc52edd660634ce5bc356665dd499a61 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:22.063181  2843 tablet_replica.cc:333] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:16:22.064204  2843 raft_consensus.cc:2243] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:16:22.065773  2843 raft_consensus.cc:2272] T 21bc23345fdc47d2b7e9b8964749236e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:22.067509  8627 raft_consensus.cc:493] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:22.068163  8627 raft_consensus.cc:515] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:22.076089  2843 tablet_replica.cc:333] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:16:22.077534  2843 raft_consensus.cc:2243] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 13:16:22.083318  4074 leader_election.cc:336] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
I20260709 13:16:22.088397  2843 raft_consensus.cc:2272] T b523c05ab48243118947b2e30890c0b4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:22.090646  4071 leader_election.cc:336] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:22.091138  4071 leader_election.cc:304] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:22.092192  8627 leader_election.cc:290] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
I20260709 13:16:22.093004  8627 raft_consensus.cc:2749] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:22.097797  2843 tablet_replica.cc:333] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:16:22.100066  2843 raft_consensus.cc:2243] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:22.101275  2843 raft_consensus.cc:2272] T c18bd2f3197a4762aec88dec3caa6712 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:22.106576  2843 tablet_replica.cc:333] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:16:22.107788  2843 raft_consensus.cc:2243] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:16:22.109745  2843 raft_consensus.cc:2272] T 79e5ee76c81a42c8a9510d0d5d7b55b2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:22.110386  8611 raft_consensus.cc:493] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:22.110976  8611 raft_consensus.cc:515] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:22.113317  8611 leader_election.cc:290] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:16:22.118446  4071 leader_election.cc:336] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
W20260709 13:16:22.119081  4074 leader_election.cc:336] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
I20260709 13:16:22.119560  4074 leader_election.cc:304] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:22.120950  8611 raft_consensus.cc:2749] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:22.124815  2843 tablet_replica.cc:333] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:16:22.130380  2843 raft_consensus.cc:2243] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:22.131717  2843 raft_consensus.cc:2272] T 37bb8c27fe534b22824e326e191a66f0 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:22.134919  2843 tablet_replica.cc:333] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:16:22.135907  2843 raft_consensus.cc:2243] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:22.136178  8611 raft_consensus.cc:493] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:22.136852  2843 raft_consensus.cc:2272] T b1073c870d784f068fdb3f222623f5a3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:22.136965  8611 raft_consensus.cc:515] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } }
I20260709 13:16:22.148448  2843 tablet_replica.cc:333] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:16:22.149969  2843 raft_consensus.cc:2243] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Raft consensus shutting down.
W20260709 13:16:22.152760  4071 leader_election.cc:336] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:22.154579  2843 raft_consensus.cc:2272] T 3f641c5435604e30bb44aa411954bd2f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:22.158540  8611 leader_election.cc:290] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:16:22.172662  4074 leader_election.cc:336] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
I20260709 13:16:22.173262  4074 leader_election.cc:304] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8952c48a6f3a43968f7d77f7bfc4d1bc; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:22.174114  8611 raft_consensus.cc:2749] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:22.181947  2843 tablet_replica.cc:333] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:16:22.183472  2843 raft_consensus.cc:2243] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:22.184494  2843 raft_consensus.cc:2272] T 4b83b18c9e8b401c95ac6e2c0a420316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:22.187894  2843 tablet_replica.cc:333] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:16:22.188833  2843 raft_consensus.cc:2243] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:16:22.190311  2843 raft_consensus.cc:2272] T 0c7551e973324a21b094c1d2869495ac P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:22.193681  2843 tablet_replica.cc:333] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:16:22.194444  2843 raft_consensus.cc:2243] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:16:22.197834  2843 raft_consensus.cc:2272] T 9b2556690d2041edb61d331163aced7d P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:22.202666  2843 tablet_replica.cc:333] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:16:22.203833  2843 raft_consensus.cc:2243] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:22.204741  2843 raft_consensus.cc:2272] T 7f3e65834a74410e9f2fa3b0e16b1e1e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:22.212667  2843 tablet_replica.cc:333] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:16:22.213511  2843 raft_consensus.cc:2243] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:22.214520  2843 raft_consensus.cc:2272] T d672aa4b8b8e421ea43cee412d9da66a P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:22.217967  2843 tablet_replica.cc:333] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:16:22.218781  2843 raft_consensus.cc:2243] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:22.219450  2843 raft_consensus.cc:2272] T ad706e81088440eaa86606b68c1c2c5f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:22.223091  2843 tablet_replica.cc:333] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:16:22.223935  2843 raft_consensus.cc:2243] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:16:22.225417  2843 raft_consensus.cc:2272] T 6ff80427d8324bd386a3ac9ff13d768e P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:22.248075  2843 tablet_replica.cc:333] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:16:22.249323  2843 raft_consensus.cc:2243] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:22.250140  2843 raft_consensus.cc:2272] T 604474f002cb41eb9125fc14353547d2 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:22.257839  2843 tablet_replica.cc:333] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:16:22.258718  2843 raft_consensus.cc:2243] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 LEADER]: Raft consensus shutting down.
W20260709 13:16:22.259197  4672 consensus_peers.cc:597] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:16:22.261106  2843 raft_consensus.cc:2272] T f492997a6e0f48c5b9e231e43f19e3f3 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:22.270108  2843 tablet_replica.cc:333] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:16:22.271027  2843 raft_consensus.cc:2243] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:22.272149  2843 raft_consensus.cc:2272] T f4845eaa52cb4965b9c8922f37e2f606 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:22.275219  2843 tablet_replica.cc:333] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:16:22.276042  2843 raft_consensus.cc:2243] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:16:22.277614  2843 raft_consensus.cc:2272] T f9cefab1b91e4d728ddf2663bc49d316 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:22.280820  2843 tablet_replica.cc:333] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:16:22.281574  2843 raft_consensus.cc:2243] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:22.284479  2843 raft_consensus.cc:2272] T 13ea3a969108486bbbaaaf3697e1d3b5 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:22.298360  2843 tablet_replica.cc:333] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:16:22.299186  2843 raft_consensus.cc:2243] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:16:22.300627  2843 raft_consensus.cc:2272] T 1d55b0c8cf6547cb8c135f6ecdfce39f P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:22.303653  2843 tablet_replica.cc:333] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:16:22.304409  2843 raft_consensus.cc:2243] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:22.305063  2843 raft_consensus.cc:2272] T 4e6407d1f930405b9aa0d4690377e1da P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:22.308208  2843 tablet_replica.cc:333] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:16:22.308962  2843 raft_consensus.cc:2243] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:16:22.310397  2843 raft_consensus.cc:2272] T 6b3254b26cc140fc8d2500e3e12dfaf4 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:22.313592  2843 tablet_replica.cc:333] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:16:22.314322  2843 raft_consensus.cc:2243] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:22.315199  2843 raft_consensus.cc:2272] T 412d794b0f694d089b1b011ba8adea36 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:22.318486  2843 tablet_replica.cc:333] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc: stopping tablet replica
I20260709 13:16:22.321660  2843 raft_consensus.cc:2243] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:16:22.332571  2843 raft_consensus.cc:2272] T c29b05201a5f4c6089866210cf02f151 P 8952c48a6f3a43968f7d77f7bfc4d1bc [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:22.457674  4675 consensus_peers.cc:597] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:22.471321  4672 consensus_peers.cc:597] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:16:22.475845  8608 raft_consensus.cc:493] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:22.476454  8608 raft_consensus.cc:515] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:16:22.483261  4675 leader_election.cc:336] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
I20260709 13:16:22.482864  8608 leader_election.cc:290] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:16:22.489902  4672 leader_election.cc:336] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:22.490358  4672 leader_election.cc:304] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:22.491514  8608 raft_consensus.cc:2749] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:16:22.666935  4672 consensus_peers.cc:597] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:16:22.786535  4675 consensus_peers.cc:597] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:22.791515  8566 raft_consensus.cc:493] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:16:22.792169  8566 raft_consensus.cc:515] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:22.794278  8566 leader_election.cc:290] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:16:22.802695  4672 leader_election.cc:336] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
W20260709 13:16:22.803403  4672 leader_election.cc:336] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Network error: Client connection negotiation failed: client connection to 127.2.198.195:37843: connect: Connection refused (error 111)
I20260709 13:16:22.803794  4672 leader_election.cc:304] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:22.811764  8566 raft_consensus.cc:2749] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:16:22.852609  4675 consensus_peers.cc:597] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:22.858392  4675 consensus_peers.cc:597] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:22.863395  4672 consensus_peers.cc:597] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:16:22.884861  4672 consensus_peers.cc:597] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:16:22.919509  4675 consensus_peers.cc:597] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:23.033865  4675 consensus_peers.cc:597] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:23.065677  4675 consensus_peers.cc:597] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:23.088644  4675 consensus_peers.cc:597] T b523c05ab48243118947b2e30890c0b4 P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:23.185993  4675 consensus_peers.cc:597] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:23.193704  8566 raft_consensus.cc:493] T 9b2556690d2041edb61d331163aced7d P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:16:23.194438  8566 raft_consensus.cc:515] T 9b2556690d2041edb61d331163aced7d P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:23.197386  8566 leader_election.cc:290] T 9b2556690d2041edb61d331163aced7d P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:16:23.203702  4675 leader_election.cc:336] T 9b2556690d2041edb61d331163aced7d P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
W20260709 13:16:23.210232  4675 consensus_peers.cc:597] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:23.218268  4672 leader_election.cc:336] T 9b2556690d2041edb61d331163aced7d P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:23.218762  4672 leader_election.cc:304] T 9b2556690d2041edb61d331163aced7d P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:23.219761  8566 raft_consensus.cc:2749] T 9b2556690d2041edb61d331163aced7d P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:16:23.220850  4672 leader_election.cc:336] T 9b2556690d2041edb61d331163aced7d P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Network error: Client connection negotiation failed: client connection to 127.2.198.195:37843: connect: Connection refused (error 111)
I20260709 13:16:23.247300  8566 raft_consensus.cc:493] T 256a58e0d11d473c899ea90e30dbd511 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:16:23.247908  8566 raft_consensus.cc:515] T 256a58e0d11d473c899ea90e30dbd511 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:23.249888  8566 leader_election.cc:290] T 256a58e0d11d473c899ea90e30dbd511 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:16:23.263798  4675 consensus_peers.cc:597] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:23.277521  4672 leader_election.cc:336] T 256a58e0d11d473c899ea90e30dbd511 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
W20260709 13:16:23.278345  4672 leader_election.cc:336] T 256a58e0d11d473c899ea90e30dbd511 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Network error: Client connection negotiation failed: client connection to 127.2.198.195:37843: connect: Connection refused (error 111)
I20260709 13:16:23.278720  4672 leader_election.cc:304] T 256a58e0d11d473c899ea90e30dbd511 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:23.282924  8566 raft_consensus.cc:2749] T 256a58e0d11d473c899ea90e30dbd511 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:16:23.289743  4675 consensus_peers.cc:597] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:23.315826  4672 consensus_peers.cc:597] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.195:37843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:23.336035  8566 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:16:23.336665  8566 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:23.338924  8566 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:16:23.348549  4672 leader_election.cc:336] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
W20260709 13:16:23.349242  4672 leader_election.cc:336] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Network error: Client connection negotiation failed: client connection to 127.2.198.195:37843: connect: Connection refused (error 111)
I20260709 13:16:23.349632  4672 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:23.350744  8566 raft_consensus.cc:2749] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:16:23.439354  4675 consensus_peers.cc:597] T 3f641c5435604e30bb44aa411954bd2f P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:23.440447  8566 raft_consensus.cc:493] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:16:23.441049  8566 raft_consensus.cc:515] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:16:23.447717  4672 leader_election.cc:336] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Network error: Client connection negotiation failed: client connection to 127.2.198.195:37843: connect: Connection refused (error 111)
I20260709 13:16:23.449187  8566 leader_election.cc:290] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:16:23.457515  4672 consensus_peers.cc:597] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:16:23.461479  4675 leader_election.cc:336] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
I20260709 13:16:23.461966  4675 leader_election.cc:304] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:16:23.464645  8566 raft_consensus.cc:2749] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:16:23.471253  4672 consensus_peers.cc:597] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:16:23.520771  4675 consensus_peers.cc:597] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:23.528736  4672 consensus_peers.cc:597] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.195:37843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:23.530426  8566 raft_consensus.cc:493] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:16:23.531067  8566 raft_consensus.cc:515] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:23.538852  8566 leader_election.cc:290] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:16:23.544196  4672 leader_election.cc:336] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
W20260709 13:16:23.553956  4672 leader_election.cc:336] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Network error: Client connection negotiation failed: client connection to 127.2.198.195:37843: connect: Connection refused (error 111)
I20260709 13:16:23.554402  4672 leader_election.cc:304] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:23.555200  8566 raft_consensus.cc:2749] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:16:23.586488  4672 consensus_peers.cc:597] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:16:23.630973  2843 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 4129)
W20260709 13:16:23.668355  4672 consensus_peers.cc:597] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.195:37843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:23.671993  4672 consensus_peers.cc:597] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:16:23.683693  4675 consensus_peers.cc:597] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:23.690877  4672 consensus_peers.cc:597] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P d709ee666b774ec29aa732e508219938 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.195:37843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:23.749596  4672 consensus_peers.cc:597] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.195:37843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:23.775125  4672 consensus_peers.cc:597] T b523c05ab48243118947b2e30890c0b4 P d709ee666b774ec29aa732e508219938 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.195:37843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:23.777155  8608 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:16:23.777861  8608 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:23.781473  8608 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:16:23.792512  4672 leader_election.cc:336] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Network error: Client connection negotiation failed: client connection to 127.2.198.195:37843: connect: Connection refused (error 111)
W20260709 13:16:23.798308  4672 leader_election.cc:336] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:23.798815  4672 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:23.799677  8608 raft_consensus.cc:2749] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:16:23.805470  4672 consensus_peers.cc:597] T 3f641c5435604e30bb44aa411954bd2f P d709ee666b774ec29aa732e508219938 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.195:37843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:23.930104  4672 consensus_peers.cc:597] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.195:37843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:23.978271  4672 consensus_peers.cc:597] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.195:37843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:23.988154  4672 consensus_peers.cc:597] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.195:37843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:24.044512  4672 consensus_peers.cc:597] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.195:37843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:24.161669  4672 consensus_peers.cc:597] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.195:37843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:24.187099  4672 consensus_peers.cc:597] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:16:24.205655  4672 consensus_peers.cc:597] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.195:37843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:24.249557  4672 consensus_peers.cc:597] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.195:37843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:24.281792  4672 consensus_peers.cc:597] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.195:37843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:24.336580  8566 raft_consensus.cc:493] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:24.337237  8566 raft_consensus.cc:515] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:24.339706  8566 leader_election.cc:290] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:16:24.349035  4675 leader_election.cc:336] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
W20260709 13:16:24.374146  4672 leader_election.cc:336] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:24.374797  4672 leader_election.cc:304] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:24.375778  8608 raft_consensus.cc:2749] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:24.453840  8608 raft_consensus.cc:493] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:24.454464  8608 raft_consensus.cc:515] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:16:24.461810  4672 leader_election.cc:336] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
W20260709 13:16:24.465345  4675 leader_election.cc:336] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
I20260709 13:16:24.465795  4675 leader_election.cc:304] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:24.466516  8566 raft_consensus.cc:2749] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:24.456914  8608 leader_election.cc:290] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:16:24.525877  4675 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111) [suppressed 611 similar messages]
W20260709 13:16:24.567633  3841 catalog_manager.cc:4755] TS f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 20cb8f6ca1af4ec79acaa9f95e816ca6: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
W20260709 13:16:24.631560  2843 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 4129)
I20260709 13:16:24.686987  8608 raft_consensus.cc:493] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:24.689976  8608 raft_consensus.cc:515] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:24.692396  8608 leader_election.cc:290] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:16:24.697788  4675 leader_election.cc:336] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
W20260709 13:16:24.699196  4672 consensus_peers.cc:597] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:16:24.710470  4672 leader_election.cc:336] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:24.710935  4672 leader_election.cc:304] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:24.717746  8608 raft_consensus.cc:2749] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:24.722849  8608 raft_consensus.cc:493] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:24.723502  8608 raft_consensus.cc:515] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:24.729655  8608 leader_election.cc:290] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:16:24.731041  4675 leader_election.cc:336] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
W20260709 13:16:24.739575  4672 leader_election.cc:336] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:24.740089  4672 leader_election.cc:304] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:24.740895  8608 raft_consensus.cc:2749] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:24.838027  8608 raft_consensus.cc:493] T 256a58e0d11d473c899ea90e30dbd511 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:16:24.838775  8608 raft_consensus.cc:515] T 256a58e0d11d473c899ea90e30dbd511 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:24.841632  8608 leader_election.cc:290] T 256a58e0d11d473c899ea90e30dbd511 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:16:24.855353  4672 leader_election.cc:336] T 256a58e0d11d473c899ea90e30dbd511 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
W20260709 13:16:24.857785  4672 leader_election.cc:336] T 256a58e0d11d473c899ea90e30dbd511 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Network error: Client connection negotiation failed: client connection to 127.2.198.195:37843: connect: Connection refused (error 111)
I20260709 13:16:24.858253  4672 leader_election.cc:304] T 256a58e0d11d473c899ea90e30dbd511 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:24.858997  8608 raft_consensus.cc:2749] T 256a58e0d11d473c899ea90e30dbd511 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:24.880319  8608 raft_consensus.cc:493] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:16:24.880892  8608 raft_consensus.cc:515] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:24.883180  8608 leader_election.cc:290] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:16:24.897213  4672 leader_election.cc:336] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
W20260709 13:16:24.897980  4672 leader_election.cc:336] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Network error: Client connection negotiation failed: client connection to 127.2.198.195:37843: connect: Connection refused (error 111)
I20260709 13:16:24.898412  4672 leader_election.cc:304] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:24.899176  8566 raft_consensus.cc:2749] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:16:25.026194  4672 consensus_peers.cc:597] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:16:25.039728  8566 raft_consensus.cc:493] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:16:25.040446  8566 raft_consensus.cc:515] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:25.044595  8608 raft_consensus.cc:493] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:16:25.045202  8608 raft_consensus.cc:515] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:25.051600  8608 leader_election.cc:290] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:16:25.052541  4672 leader_election.cc:336] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:25.042847  8566 leader_election.cc:290] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:16:25.053287  4672 leader_election.cc:336] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Network error: Client connection negotiation failed: client connection to 127.2.198.195:37843: connect: Connection refused (error 111)
I20260709 13:16:25.053741  4672 leader_election.cc:304] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:25.054505  8566 raft_consensus.cc:2749] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:16:25.053730  4675 leader_election.cc:336] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
W20260709 13:16:25.062830  4672 leader_election.cc:336] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Network error: Client connection negotiation failed: client connection to 127.2.198.195:37843: connect: Connection refused (error 111)
I20260709 13:16:25.063608  4672 leader_election.cc:304] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:16:25.064471  8566 raft_consensus.cc:2749] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:16:25.146839  4675 consensus_peers.cc:597] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:25.203967  4672 consensus_peers.cc:597] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:16:25.244644  4672 consensus_peers.cc:597] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:16:25.297575  4675 consensus_peers.cc:597] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:25.344023  4675 consensus_peers.cc:597] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:16:25.365850  8608 raft_consensus.cc:493] T 9b2556690d2041edb61d331163aced7d P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:16:25.366602  8608 raft_consensus.cc:515] T 9b2556690d2041edb61d331163aced7d P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } attrs { replace: true } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:25.369722  8608 leader_election.cc:290] T 9b2556690d2041edb61d331163aced7d P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:16:25.381100  4675 leader_election.cc:336] T 9b2556690d2041edb61d331163aced7d P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
W20260709 13:16:25.388119  4672 leader_election.cc:336] T 9b2556690d2041edb61d331163aced7d P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:25.391006  4672 leader_election.cc:304] T 9b2556690d2041edb61d331163aced7d P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:25.392411  8608 raft_consensus.cc:2749] T 9b2556690d2041edb61d331163aced7d P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:16:25.392560  4672 leader_election.cc:336] T 9b2556690d2041edb61d331163aced7d P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Network error: Client connection negotiation failed: client connection to 127.2.198.195:37843: connect: Connection refused (error 111)
W20260709 13:16:25.394393  4675 consensus_peers.cc:597] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:25.422276  4675 consensus_peers.cc:597] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:25.454931  4675 consensus_peers.cc:597] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:16:25.474328  8608 raft_consensus.cc:493] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:16:25.475036  8608 raft_consensus.cc:515] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:25.477530  8608 leader_election.cc:290] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:16:25.487386  4672 leader_election.cc:336] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
W20260709 13:16:25.490942  4672 leader_election.cc:336] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Network error: Client connection negotiation failed: client connection to 127.2.198.195:37843: connect: Connection refused (error 111)
I20260709 13:16:25.491499  4672 leader_election.cc:304] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:25.492352  8608 raft_consensus.cc:2749] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:16:25.531037  4672 consensus_peers.cc:597] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:16:25.556262  4675 consensus_peers.cc:597] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:25.580916  4675 consensus_peers.cc:597] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:25.632124  2843 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 4129)
I20260709 13:16:25.747587  8608 raft_consensus.cc:493] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:16:25.748189  8608 raft_consensus.cc:515] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:25.750212  8608 leader_election.cc:290] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:16:25.754910  4675 consensus_peers.cc:597] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:25.765097  4675 consensus_peers.cc:597] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:25.778913  4672 leader_election.cc:336] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Network error: Client connection negotiation failed: client connection to 127.2.198.195:37843: connect: Connection refused (error 111)
W20260709 13:16:25.781507  4672 leader_election.cc:336] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:25.782060  4672 leader_election.cc:304] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:25.782815  8608 raft_consensus.cc:2749] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:16:25.783067  4672 consensus_peers.cc:597] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:16:25.816087  4672 consensus_peers.cc:597] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.195:37843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:25.867225  4675 consensus_peers.cc:597] T b523c05ab48243118947b2e30890c0b4 P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:25.884801  4675 consensus_peers.cc:597] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:25.910794  4675 consensus_peers.cc:597] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:25.920449  4672 consensus_peers.cc:597] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.195:37843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:25.968288  4672 consensus_peers.cc:597] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:16:26.004390  4672 consensus_peers.cc:597] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:16:26.074952  4675 consensus_peers.cc:597] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:16:26.080156  8608 raft_consensus.cc:493] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
I20260709 13:16:26.080741  8608 raft_consensus.cc:515] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:26.085739  8608 leader_election.cc:290] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:16:26.088574  4675 leader_election.cc:336] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
W20260709 13:16:26.104580  4672 leader_election.cc:336] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
W20260709 13:16:26.106391  4675 consensus_peers.cc:597] T 3f641c5435604e30bb44aa411954bd2f P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:26.105166  4672 leader_election.cc:304] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:26.107697  8608 raft_consensus.cc:2749] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:16:26.114101  4672 consensus_peers.cc:597] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:16:26.149263  4672 consensus_peers.cc:597] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.195:37843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:26.212378  4672 consensus_peers.cc:597] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.195:37843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:26.273901  4672 consensus_peers.cc:597] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.195:37843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:26.277143  4672 consensus_peers.cc:597] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P d709ee666b774ec29aa732e508219938 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.195:37843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:26.293658  4672 consensus_peers.cc:597] T 3f641c5435604e30bb44aa411954bd2f P d709ee666b774ec29aa732e508219938 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.195:37843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:26.370963  4672 consensus_peers.cc:597] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.195:37843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:26.397056  4672 consensus_peers.cc:597] T b523c05ab48243118947b2e30890c0b4 P d709ee666b774ec29aa732e508219938 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.195:37843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:26.560285  8635 raft_consensus.cc:493] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f5b5e4ed72944ecbda200012d141dc2)
W20260709 13:16:26.632669  2843 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 4129)
I20260709 13:16:26.561399  8635 raft_consensus.cc:515] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:26.648537  8635 leader_election.cc:290] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115)
W20260709 13:16:26.665333  4675 leader_election.cc:336] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
I20260709 13:16:26.688345  8636 raft_consensus.cc:493] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:16:26.689004  8636 raft_consensus.cc:515] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:26.691319  8636 leader_election.cc:290] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:16:26.693395  4672 consensus_peers.cc:597] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.195:37843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:26.694094  4672 consensus_peers.cc:597] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.195:37843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:26.695773  4672 leader_election.cc:336] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:26.696272  4672 leader_election.cc:304] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:26.697167  8636 raft_consensus.cc:2749] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:16:26.728492  4672 consensus_peers.cc:597] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.195:37843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:26.729205  4672 consensus_peers.cc:597] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.195:37843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:26.736581  4672 leader_election.cc:336] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
W20260709 13:16:26.738327  4672 leader_election.cc:336] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Network error: Client connection negotiation failed: client connection to 127.2.198.195:37843: connect: Connection refused (error 111)
I20260709 13:16:26.746672  4672 leader_election.cc:304] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:26.747705  8636 raft_consensus.cc:2749] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:16:26.757655  4672 consensus_peers.cc:597] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:16:26.766829  4672 consensus_peers.cc:597] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.195:37843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:26.867063  8608 raft_consensus.cc:493] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:16:26.867710  8608 raft_consensus.cc:515] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f5b5e4ed72944ecbda200012d141dc2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 46115 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
W20260709 13:16:26.873344  4672 consensus_peers.cc:597] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 -> Peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Couldn't send request to peer 8952c48a6f3a43968f7d77f7bfc4d1bc. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.195:37843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:26.878721  8608 leader_election.cc:290] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:16:26.894853  4672 leader_election.cc:336] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Network error: Client connection negotiation failed: client connection to 127.2.198.195:37843: connect: Connection refused (error 111)
W20260709 13:16:26.896328  4675 leader_election.cc:336] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111)
I20260709 13:16:26.896863  4675 leader_election.cc:304] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 6f5b5e4ed72944ecbda200012d141dc2, 8952c48a6f3a43968f7d77f7bfc4d1bc
I20260709 13:16:26.898307  8608 raft_consensus.cc:2749] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:16:26.908557  4672 consensus_peers.cc:597] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:16:26.938171  8608 raft_consensus.cc:493] T 256a58e0d11d473c899ea90e30dbd511 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8952c48a6f3a43968f7d77f7bfc4d1bc)
I20260709 13:16:26.939002  8608 raft_consensus.cc:515] T 256a58e0d11d473c899ea90e30dbd511 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1c75790cedf4f52a3463a255c7da059" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35339 } } peers { permanent_uuid: "8952c48a6f3a43968f7d77f7bfc4d1bc" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37843 } } peers { permanent_uuid: "d709ee666b774ec29aa732e508219938" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 37117 } attrs { promote: false } }
I20260709 13:16:26.941356  8608 leader_election.cc:290] T 256a58e0d11d473c899ea90e30dbd511 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339), 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843)
W20260709 13:16:26.952175  4672 leader_election.cc:336] T 256a58e0d11d473c899ea90e30dbd511 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
W20260709 13:16:26.953003  4672 leader_election.cc:336] T 256a58e0d11d473c899ea90e30dbd511 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 8952c48a6f3a43968f7d77f7bfc4d1bc (127.2.198.195:37843): Network error: Client connection negotiation failed: client connection to 127.2.198.195:37843: connect: Connection refused (error 111)
I20260709 13:16:26.953451  4672 leader_election.cc:304] T 256a58e0d11d473c899ea90e30dbd511 P d709ee666b774ec29aa732e508219938 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d709ee666b774ec29aa732e508219938; no voters: 8952c48a6f3a43968f7d77f7bfc4d1bc, f1c75790cedf4f52a3463a255c7da059
I20260709 13:16:26.954430  8608 raft_consensus.cc:2749] T 256a58e0d11d473c899ea90e30dbd511 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:27.313934  2843 tablet_server.cc:196] TabletServer@127.2.198.195:0 shutdown complete.
I20260709 13:16:27.482089  2843 tablet_server.cc:179] TabletServer@127.2.198.196:0 shutting down...
W20260709 13:16:27.483036  4672 consensus_peers.cc:597] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 -> Peer f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): Couldn't send request to peer f1c75790cedf4f52a3463a255c7da059. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:16:27.507668  3888 debug-util.cc:398] Leaking SignalData structure 0x7b0800245480 after lost signal to thread 2846
W20260709 13:16:27.509229  3888 debug-util.cc:398] Leaking SignalData structure 0x7b080022fb60 after lost signal to thread 3891
W20260709 13:16:27.511080  3888 debug-util.cc:398] Leaking SignalData structure 0x7b080016acc0 after lost signal to thread 4733
I20260709 13:16:27.595328  2843 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:27.596527  2843 tablet_replica.cc:333] T 9b2556690d2041edb61d331163aced7d P d709ee666b774ec29aa732e508219938: stopping tablet replica
I20260709 13:16:27.598067  2843 raft_consensus.cc:2243] T 9b2556690d2041edb61d331163aced7d P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:27.599176  2843 raft_consensus.cc:2272] T 9b2556690d2041edb61d331163aced7d P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:27.601666  4675 consensus_peers.cc:597] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 -> Peer 6f5b5e4ed72944ecbda200012d141dc2 (127.2.198.194:46115): Couldn't send request to peer 6f5b5e4ed72944ecbda200012d141dc2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:46115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:16:27.603142  2843 tablet_replica.cc:333] T b523c05ab48243118947b2e30890c0b4 P d709ee666b774ec29aa732e508219938: stopping tablet replica
I20260709 13:16:27.604233  2843 raft_consensus.cc:2243] T b523c05ab48243118947b2e30890c0b4 P d709ee666b774ec29aa732e508219938 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:16:27.606033  2843 raft_consensus.cc:2272] T b523c05ab48243118947b2e30890c0b4 P d709ee666b774ec29aa732e508219938 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.610013  2843 tablet_replica.cc:333] T 3f641c5435604e30bb44aa411954bd2f P d709ee666b774ec29aa732e508219938: stopping tablet replica
I20260709 13:16:27.611123  2843 raft_consensus.cc:2243] T 3f641c5435604e30bb44aa411954bd2f P d709ee666b774ec29aa732e508219938 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:16:27.612952  2843 raft_consensus.cc:2272] T 3f641c5435604e30bb44aa411954bd2f P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.616647  2843 tablet_replica.cc:333] T 256a58e0d11d473c899ea90e30dbd511 P d709ee666b774ec29aa732e508219938: stopping tablet replica
I20260709 13:16:27.617655  2843 raft_consensus.cc:2243] T 256a58e0d11d473c899ea90e30dbd511 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:27.618873  2843 raft_consensus.cc:2272] T 256a58e0d11d473c899ea90e30dbd511 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.622745  2843 tablet_replica.cc:333] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P d709ee666b774ec29aa732e508219938: stopping tablet replica
I20260709 13:16:27.623713  2843 raft_consensus.cc:2243] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P d709ee666b774ec29aa732e508219938 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:16:27.625573  2843 raft_consensus.cc:2272] T 20cb8f6ca1af4ec79acaa9f95e816ca6 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.629253  2843 tablet_replica.cc:333] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938: stopping tablet replica
I20260709 13:16:27.630254  2843 raft_consensus.cc:2243] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:27.631219  2843 raft_consensus.cc:2272] T 65333bcc8c2a4b1a9f6f35670cefe7d0 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.634891  2843 tablet_replica.cc:333] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938: stopping tablet replica
I20260709 13:16:27.635814  2843 raft_consensus.cc:2243] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:16:27.637627  2843 raft_consensus.cc:2272] T 649df91131174f00af0e0a0240f80adb P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.641227  2843 tablet_replica.cc:333] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938: stopping tablet replica
I20260709 13:16:27.642177  2843 raft_consensus.cc:2243] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:16:27.643477  2843 raft_consensus.cc:2272] T 6e863d888e2a4327a9127a43deb1f1b9 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.646636  2843 tablet_replica.cc:333] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938: stopping tablet replica
I20260709 13:16:27.647446  2843 raft_consensus.cc:2243] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:16:27.648624  2843 raft_consensus.cc:2272] T 86669993fba94e65ba192aa115ed6e88 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.651558  2843 tablet_replica.cc:333] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938: stopping tablet replica
I20260709 13:16:27.652398  2843 raft_consensus.cc:2243] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:16:27.653651  2843 raft_consensus.cc:2272] T 97cf7690694c4d5988258ec1b641a2e6 P d709ee666b774ec29aa732e508219938 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.657084  2843 tablet_replica.cc:333] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938: stopping tablet replica
I20260709 13:16:27.657903  2843 raft_consensus.cc:2243] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:16:27.659135  2843 raft_consensus.cc:2272] T 37bb8c27fe534b22824e326e191a66f0 P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.662424  2843 tablet_replica.cc:333] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938: stopping tablet replica
I20260709 13:16:27.663250  2843 raft_consensus.cc:2243] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:16:27.664390  2843 raft_consensus.cc:2272] T 412d794b0f694d089b1b011ba8adea36 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.667587  2843 tablet_replica.cc:333] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938: stopping tablet replica
I20260709 13:16:27.668390  2843 raft_consensus.cc:2243] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:27.668987  2843 raft_consensus.cc:2272] T 6b3254b26cc140fc8d2500e3e12dfaf4 P d709ee666b774ec29aa732e508219938 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.672302  2843 tablet_replica.cc:333] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938: stopping tablet replica
I20260709 13:16:27.673166  2843 raft_consensus.cc:2243] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:27.673928  2843 raft_consensus.cc:2272] T eae506e79ba348b3b1db60ecc6ae6714 P d709ee666b774ec29aa732e508219938 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.676906  2843 tablet_replica.cc:333] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938: stopping tablet replica
I20260709 13:16:27.677825  2843 raft_consensus.cc:2243] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:27.678498  2843 raft_consensus.cc:2272] T 21bc23345fdc47d2b7e9b8964749236e P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.681875  2843 tablet_replica.cc:333] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938: stopping tablet replica
I20260709 13:16:27.682749  2843 raft_consensus.cc:2243] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:16:27.684118  2843 raft_consensus.cc:2272] T 622bcde3b6ba43678f5eb621e8259db2 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.687228  2843 tablet_replica.cc:333] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938: stopping tablet replica
I20260709 13:16:27.688109  2843 raft_consensus.cc:2243] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:27.688999  2843 raft_consensus.cc:2272] T 0c7551e973324a21b094c1d2869495ac P d709ee666b774ec29aa732e508219938 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.691895  2843 tablet_replica.cc:333] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938: stopping tablet replica
I20260709 13:16:27.692790  2843 raft_consensus.cc:2243] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:16:27.695050  2843 raft_consensus.cc:2272] T 1851e462889842a49d577d585d278117 P d709ee666b774ec29aa732e508219938 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.698133  2843 tablet_replica.cc:333] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938: stopping tablet replica
I20260709 13:16:27.698977  2843 raft_consensus.cc:2243] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:16:27.700250  2843 raft_consensus.cc:2272] T bd24fa3ec4ab41cabe4bcfae21f055f3 P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.703405  2843 tablet_replica.cc:333] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938: stopping tablet replica
I20260709 13:16:27.704282  2843 raft_consensus.cc:2243] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:27.704916  2843 raft_consensus.cc:2272] T b7e7a2dc30a24e5caaa3806c68b96c08 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.708112  2843 tablet_replica.cc:333] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938: stopping tablet replica
I20260709 13:16:27.708899  2843 raft_consensus.cc:2243] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:16:27.710101  2843 raft_consensus.cc:2272] T 4b83b18c9e8b401c95ac6e2c0a420316 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.712955  2843 tablet_replica.cc:333] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938: stopping tablet replica
I20260709 13:16:27.713805  2843 raft_consensus.cc:2243] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:16:27.715011  2843 raft_consensus.cc:2272] T ba7a51e4b70a48daa8267297f285c661 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.717978  2843 tablet_replica.cc:333] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938: stopping tablet replica
I20260709 13:16:27.718760  2843 raft_consensus.cc:2243] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:16:27.720032  2843 raft_consensus.cc:2272] T 0d4e65893d284960aef32d35d0db30a4 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.723058  2843 tablet_replica.cc:333] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938: stopping tablet replica
I20260709 13:16:27.723917  2843 raft_consensus.cc:2243] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:16:27.725023  2843 raft_consensus.cc:2272] T 11c2da89f37f4113a8811c6e081da953 P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.727908  2843 tablet_replica.cc:333] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938: stopping tablet replica
I20260709 13:16:27.728708  2843 raft_consensus.cc:2243] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:16:27.729979  2843 raft_consensus.cc:2272] T 9873af7d73cf49f3b2d74a17cf7cd3bf P d709ee666b774ec29aa732e508219938 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.732733  2843 tablet_replica.cc:333] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938: stopping tablet replica
I20260709 13:16:27.733537  2843 raft_consensus.cc:2243] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:27.734179  2843 raft_consensus.cc:2272] T 1d55b0c8cf6547cb8c135f6ecdfce39f P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.737313  2843 tablet_replica.cc:333] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938: stopping tablet replica
I20260709 13:16:27.738107  2843 raft_consensus.cc:2243] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:16:27.739517  2843 raft_consensus.cc:2272] T f4845eaa52cb4965b9c8922f37e2f606 P d709ee666b774ec29aa732e508219938 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.742630  2843 tablet_replica.cc:333] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938: stopping tablet replica
I20260709 13:16:27.743419  2843 raft_consensus.cc:2243] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:16:27.744668  2843 raft_consensus.cc:2272] T 08d6732bceef4220a670ac449347258b P d709ee666b774ec29aa732e508219938 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.747666  2843 tablet_replica.cc:333] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938: stopping tablet replica
I20260709 13:16:27.748420  2843 raft_consensus.cc:2243] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:16:27.749714  2843 raft_consensus.cc:2272] T c18bd2f3197a4762aec88dec3caa6712 P d709ee666b774ec29aa732e508219938 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.752676  2843 tablet_replica.cc:333] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938: stopping tablet replica
I20260709 13:16:27.753413  2843 raft_consensus.cc:2243] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:27.754220  2843 raft_consensus.cc:2272] T b2879f06fa90455ea323efd79c11c330 P d709ee666b774ec29aa732e508219938 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.757006  2843 tablet_replica.cc:333] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938: stopping tablet replica
I20260709 13:16:27.757727  2843 raft_consensus.cc:2243] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:27.758435  2843 raft_consensus.cc:2272] T dc2641ff9849458a9200dfc5a9016cce P d709ee666b774ec29aa732e508219938 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.982280  2843 tablet_server.cc:196] TabletServer@127.2.198.196:0 shutdown complete.
I20260709 13:16:28.083556  2843 master.cc:562] Master@127.2.198.254:36531 shutting down...
W20260709 13:16:28.124483  3905 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:16:28.124904  3905 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:16:28.125183  3905 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:16:29.876682  3841 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111) [suppressed 280 similar messages]
W20260709 13:16:29.880136  3841 catalog_manager.cc:4755] TS f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet b523c05ab48243118947b2e30890c0b4: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
W20260709 13:16:40.986733  3841 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
W20260709 13:16:40.990882  3841 catalog_manager.cc:4755] TS f1c75790cedf4f52a3463a255c7da059 (127.2.198.193:35339): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 20cb8f6ca1af4ec79acaa9f95e816ca6: Network error: Client connection negotiation failed: client connection to 127.2.198.193:35339: connect: Connection refused (error 111)
I20260709 13:16:41.746129  2843 raft_consensus.cc:2243] T 00000000000000000000000000000000 P af4ff34c238b4043994545a7eb56815f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:41.747664  2843 raft_consensus.cc:2272] T 00000000000000000000000000000000 P af4ff34c238b4043994545a7eb56815f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:41.748140  2843 tablet_replica.cc:333] T 00000000000000000000000000000000 P af4ff34c238b4043994545a7eb56815f: stopping tablet replica
I20260709 13:16:41.890940  2843 master.cc:584] Master@127.2.198.254:36531 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (171841 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:16:42.012291  2843 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.198.254:33107
I20260709 13:16:42.013595  2843 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:42.020001  8643 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:42.020534  8644 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:42.021353  8646 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:42.021950  2843 server_base.cc:1061] running on GCE node
I20260709 13:16:42.025411  2843 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:42.025612  2843 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:42.025821  2843 hybrid_clock.cc:648] HybridClock initialized: now 1783603002025776 us; error 0 us; skew 500 ppm
I20260709 13:16:42.026396  2843 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:42.029621  2843 webserver.cc:533] Webserver started at http://127.2.198.254:42509/ using document root <none> and password file <none>
I20260709 13:16:42.030210  2843 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:42.030407  2843 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:42.030725  2843 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:42.032218  2843 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602804652623-2843-0/minicluster-data/master-0-root/instance:
uuid: "3126b3b07ecf4c1da945305b7e462ddc"
format_stamp: "Formatted at 2026-07-09 13:16:42 on dist-test-slave-fc6v"
I20260709 13:16:42.037184  2843 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.003s
I20260709 13:16:42.040817  8651 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:42.041564  2843 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:16:42.041878  2843 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602804652623-2843-0/minicluster-data/master-0-root
uuid: "3126b3b07ecf4c1da945305b7e462ddc"
format_stamp: "Formatted at 2026-07-09 13:16:42 on dist-test-slave-fc6v"
I20260709 13:16:42.042179  2843 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602804652623-2843-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602804652623-2843-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602804652623-2843-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:42.083348  2843 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:42.084873  2843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:42.129098  2843 rpc_server.cc:307] RPC server started. Bound to: 127.2.198.254:33107
I20260709 13:16:42.129213  8702 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.198.254:33107 every 8 connection(s)
I20260709 13:16:42.133671  8703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:42.146272  8703 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3126b3b07ecf4c1da945305b7e462ddc: Bootstrap starting.
I20260709 13:16:42.152100  8703 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3126b3b07ecf4c1da945305b7e462ddc: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:42.157347  8703 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3126b3b07ecf4c1da945305b7e462ddc: No bootstrap required, opened a new log
I20260709 13:16:42.159936  8703 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3126b3b07ecf4c1da945305b7e462ddc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3126b3b07ecf4c1da945305b7e462ddc" member_type: VOTER }
I20260709 13:16:42.160457  8703 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3126b3b07ecf4c1da945305b7e462ddc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:42.160717  8703 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3126b3b07ecf4c1da945305b7e462ddc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3126b3b07ecf4c1da945305b7e462ddc, State: Initialized, Role: FOLLOWER
I20260709 13:16:42.161432  8703 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3126b3b07ecf4c1da945305b7e462ddc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3126b3b07ecf4c1da945305b7e462ddc" member_type: VOTER }
I20260709 13:16:42.161952  8703 raft_consensus.cc:399] T 00000000000000000000000000000000 P 3126b3b07ecf4c1da945305b7e462ddc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:16:42.162214  8703 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3126b3b07ecf4c1da945305b7e462ddc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:16:42.162528  8703 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3126b3b07ecf4c1da945305b7e462ddc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:42.167914  8703 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3126b3b07ecf4c1da945305b7e462ddc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3126b3b07ecf4c1da945305b7e462ddc" member_type: VOTER }
I20260709 13:16:42.168540  8703 leader_election.cc:304] T 00000000000000000000000000000000 P 3126b3b07ecf4c1da945305b7e462ddc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3126b3b07ecf4c1da945305b7e462ddc; no voters: 
I20260709 13:16:42.169808  8703 leader_election.cc:290] T 00000000000000000000000000000000 P 3126b3b07ecf4c1da945305b7e462ddc [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:16:42.170321  8706 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3126b3b07ecf4c1da945305b7e462ddc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:42.171897  8706 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3126b3b07ecf4c1da945305b7e462ddc [term 1 LEADER]: Becoming Leader. State: Replica: 3126b3b07ecf4c1da945305b7e462ddc, State: Running, Role: LEADER
I20260709 13:16:42.172678  8706 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3126b3b07ecf4c1da945305b7e462ddc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3126b3b07ecf4c1da945305b7e462ddc" member_type: VOTER }
I20260709 13:16:42.173139  8703 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3126b3b07ecf4c1da945305b7e462ddc [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:16:42.180095  8708 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3126b3b07ecf4c1da945305b7e462ddc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3126b3b07ecf4c1da945305b7e462ddc. Latest consensus state: current_term: 1 leader_uuid: "3126b3b07ecf4c1da945305b7e462ddc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3126b3b07ecf4c1da945305b7e462ddc" member_type: VOTER } }
I20260709 13:16:42.180073  8707 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3126b3b07ecf4c1da945305b7e462ddc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3126b3b07ecf4c1da945305b7e462ddc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3126b3b07ecf4c1da945305b7e462ddc" member_type: VOTER } }
I20260709 13:16:42.181020  8708 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3126b3b07ecf4c1da945305b7e462ddc [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:42.181061  8707 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3126b3b07ecf4c1da945305b7e462ddc [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:42.185163  8715 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:16:42.190505  8715 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:16:42.191848  2843 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:16:42.199970  8715 catalog_manager.cc:1383] Generated new cluster ID: 08b645977033496ea0758b200deb1b45
I20260709 13:16:42.200273  8715 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:16:42.218957  8715 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:16:42.220467  8715 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:16:42.241979  8715 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 3126b3b07ecf4c1da945305b7e462ddc: Generated new TSK 0
I20260709 13:16:42.242702  8715 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:16:42.259181  2843 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:42.266207  8724 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:42.267374  8725 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:42.269462  8727 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:42.270107  2843 server_base.cc:1061] running on GCE node
I20260709 13:16:42.272262  2843 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:42.272478  2843 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:42.272605  2843 hybrid_clock.cc:648] HybridClock initialized: now 1783603002272593 us; error 0 us; skew 500 ppm
I20260709 13:16:42.273123  2843 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:42.275715  2843 webserver.cc:533] Webserver started at http://127.2.198.193:33957/ using document root <none> and password file <none>
I20260709 13:16:42.276187  2843 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:42.276360  2843 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:42.276592  2843 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:42.277844  2843 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602804652623-2843-0/minicluster-data/ts-0-root/instance:
uuid: "895d3c58761f427c9c5b3cb41246c243"
format_stamp: "Formatted at 2026-07-09 13:16:42 on dist-test-slave-fc6v"
I20260709 13:16:42.282593  2843 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:16:42.286244  8732 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:42.287032  2843 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:16:42.287338  2843 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602804652623-2843-0/minicluster-data/ts-0-root
uuid: "895d3c58761f427c9c5b3cb41246c243"
format_stamp: "Formatted at 2026-07-09 13:16:42 on dist-test-slave-fc6v"
I20260709 13:16:42.287688  2843 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602804652623-2843-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602804652623-2843-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602804652623-2843-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:42.303386  2843 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:42.304751  2843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:42.306277  2843 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:42.308751  2843 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:42.308960  2843 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:42.309242  2843 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:42.309424  2843 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:42.357270  2843 rpc_server.cc:307] RPC server started. Bound to: 127.2.198.193:39173
I20260709 13:16:42.357409  8794 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.198.193:39173 every 8 connection(s)
I20260709 13:16:42.363250  2843 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:42.371399  8799 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:42.372490  8800 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:42.376796  8802 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:42.376988  2843 server_base.cc:1061] running on GCE node
I20260709 13:16:42.377692  8795 heartbeater.cc:344] Connected to a master server at 127.2.198.254:33107
I20260709 13:16:42.378192  8795 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:42.379235  8795 heartbeater.cc:507] Master 127.2.198.254:33107 requested a full tablet report, sending...
I20260709 13:16:42.379443  2843 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:42.379781  2843 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:42.379987  2843 hybrid_clock.cc:648] HybridClock initialized: now 1783603002379949 us; error 0 us; skew 500 ppm
I20260709 13:16:42.380849  2843 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:42.381775  8668 ts_manager.cc:194] Registered new tserver with Master: 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:42.383936  2843 webserver.cc:533] Webserver started at http://127.2.198.194:45421/ using document root <none> and password file <none>
I20260709 13:16:42.384692  2843 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:42.384644  8668 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37670
I20260709 13:16:42.385131  2843 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:42.385538  2843 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:42.387008  2843 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602804652623-2843-0/minicluster-data/ts-1-root/instance:
uuid: "7d3072f2af0b481d94ed70632b90e8c6"
format_stamp: "Formatted at 2026-07-09 13:16:42 on dist-test-slave-fc6v"
I20260709 13:16:42.391990  2843 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:16:42.395767  8807 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:42.396605  2843 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:16:42.396929  2843 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602804652623-2843-0/minicluster-data/ts-1-root
uuid: "7d3072f2af0b481d94ed70632b90e8c6"
format_stamp: "Formatted at 2026-07-09 13:16:42 on dist-test-slave-fc6v"
I20260709 13:16:42.397256  2843 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602804652623-2843-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602804652623-2843-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602804652623-2843-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:42.424288  2843 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:42.425756  2843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:42.427439  2843 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:42.429952  2843 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:42.430190  2843 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:42.430444  2843 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:42.430632  2843 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:42.477263  2843 rpc_server.cc:307] RPC server started. Bound to: 127.2.198.194:35315
I20260709 13:16:42.477384  8869 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.198.194:35315 every 8 connection(s)
I20260709 13:16:42.482522  2843 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:42.490981  8873 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:42.493153  8874 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:42.494997  8876 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:42.495990  8870 heartbeater.cc:344] Connected to a master server at 127.2.198.254:33107
I20260709 13:16:42.496349  2843 server_base.cc:1061] running on GCE node
I20260709 13:16:42.496507  8870 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:42.497519  2843 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:16:42.497597  8870 heartbeater.cc:507] Master 127.2.198.254:33107 requested a full tablet report, sending...
W20260709 13:16:42.497876  2843 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:42.498126  2843 hybrid_clock.cc:648] HybridClock initialized: now 1783603002498103 us; error 0 us; skew 500 ppm
I20260709 13:16:42.498953  2843 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:42.500168  8668 ts_manager.cc:194] Registered new tserver with Master: 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:42.501763  2843 webserver.cc:533] Webserver started at http://127.2.198.195:33731/ using document root <none> and password file <none>
I20260709 13:16:42.501997  8668 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37676
I20260709 13:16:42.502246  2843 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:42.502465  2843 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:42.502704  2843 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:42.504617  2843 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602804652623-2843-0/minicluster-data/ts-2-root/instance:
uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
format_stamp: "Formatted at 2026-07-09 13:16:42 on dist-test-slave-fc6v"
I20260709 13:16:42.509514  2843 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:16:42.513108  8881 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:42.513886  2843 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:16:42.514194  2843 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602804652623-2843-0/minicluster-data/ts-2-root
uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
format_stamp: "Formatted at 2026-07-09 13:16:42 on dist-test-slave-fc6v"
I20260709 13:16:42.514510  2843 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602804652623-2843-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602804652623-2843-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602804652623-2843-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:42.545756  2843 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:42.547250  2843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:42.548691  2843 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:42.551056  2843 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:42.551298  2843 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:42.551592  2843 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:42.551782  2843 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:16:42.600042  2843 rpc_server.cc:307] RPC server started. Bound to: 127.2.198.195:37671
I20260709 13:16:42.600178  8943 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.198.195:37671 every 8 connection(s)
I20260709 13:16:42.605746  2843 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:42.614233  8947 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:42.615141  8948 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:42.617491  2843 server_base.cc:1061] running on GCE node
W20260709 13:16:42.617640  8950 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:42.618768  2843 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:42.619030  2843 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:42.619240  2843 hybrid_clock.cc:648] HybridClock initialized: now 1783603002619223 us; error 0 us; skew 500 ppm
I20260709 13:16:42.619900  2843 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:42.622629  8944 heartbeater.cc:344] Connected to a master server at 127.2.198.254:33107
I20260709 13:16:42.622987  2843 webserver.cc:533] Webserver started at http://127.2.198.196:36935/ using document root <none> and password file <none>
I20260709 13:16:42.623126  8944 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:42.623804  2843 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:42.624111  2843 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:42.624291  8944 heartbeater.cc:507] Master 127.2.198.254:33107 requested a full tablet report, sending...
I20260709 13:16:42.624462  2843 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:42.625977  2843 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602804652623-2843-0/minicluster-data/ts-3-root/instance:
uuid: "e8bb7e1240f44fda8b83e4c124852032"
format_stamp: "Formatted at 2026-07-09 13:16:42 on dist-test-slave-fc6v"
I20260709 13:16:42.626704  8668 ts_manager.cc:194] Registered new tserver with Master: 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:42.628328  8668 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37678
I20260709 13:16:42.631016  2843 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.002s
I20260709 13:16:42.635001  8955 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:42.635871  2843 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:16:42.636202  2843 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602804652623-2843-0/minicluster-data/ts-3-root
uuid: "e8bb7e1240f44fda8b83e4c124852032"
format_stamp: "Formatted at 2026-07-09 13:16:42 on dist-test-slave-fc6v"
I20260709 13:16:42.636514  2843 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602804652623-2843-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602804652623-2843-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602804652623-2843-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:42.648795  2843 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:42.650287  2843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:42.652017  2843 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:42.654868  2843 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:42.655128  2843 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:42.655424  2843 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:42.655642  2843 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:16:42.704695  2843 rpc_server.cc:307] RPC server started. Bound to: 127.2.198.196:46105
I20260709 13:16:42.704813  9017 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.198.196:46105 every 8 connection(s)
I20260709 13:16:42.720937  9018 heartbeater.cc:344] Connected to a master server at 127.2.198.254:33107
I20260709 13:16:42.721451  9018 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:42.722358  9018 heartbeater.cc:507] Master 127.2.198.254:33107 requested a full tablet report, sending...
I20260709 13:16:42.724457  8668 ts_manager.cc:194] Registered new tserver with Master: e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:42.724624  2843 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.016444902s
I20260709 13:16:42.725989  8668 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37686
I20260709 13:16:42.755105  8668 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37700:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:16:43.012657  8760 tablet_service.cc:1511] Processing CreateTablet for tablet 3f0c32d9abf04206a6f08210b3a30794 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:16:43.014462  8760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f0c32d9abf04206a6f08210b3a30794. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.016278  8759 tablet_service.cc:1511] Processing CreateTablet for tablet ef723f9c640849d3890c61c07ffd0378 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:16:43.017989  8759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef723f9c640849d3890c61c07ffd0378. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.021430  8758 tablet_service.cc:1511] Processing CreateTablet for tablet f46053ed2641458a87c97152e4979c35 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:16:43.023104  8758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f46053ed2641458a87c97152e4979c35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.032998  8835 tablet_service.cc:1511] Processing CreateTablet for tablet 3f0c32d9abf04206a6f08210b3a30794 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:16:43.033803  8833 tablet_service.cc:1511] Processing CreateTablet for tablet 734d16820c5640729de24c6edf4c5ed8 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:16:43.034651  8835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f0c32d9abf04206a6f08210b3a30794. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.035341  8833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 734d16820c5640729de24c6edf4c5ed8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.039090  8834 tablet_service.cc:1511] Processing CreateTablet for tablet ef723f9c640849d3890c61c07ffd0378 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:16:43.042173  8757 tablet_service.cc:1511] Processing CreateTablet for tablet d46902173b5c4283b315c6def6f13c31 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:16:43.043730  8757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d46902173b5c4283b315c6def6f13c31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.042699  8834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef723f9c640849d3890c61c07ffd0378. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.047534  8756 tablet_service.cc:1511] Processing CreateTablet for tablet 4e1e1e84d68946d682e0944fbd3c51a8 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:16:43.049084  8756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e1e1e84d68946d682e0944fbd3c51a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.049386  8832 tablet_service.cc:1511] Processing CreateTablet for tablet d46902173b5c4283b315c6def6f13c31 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:16:43.050889  8832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d46902173b5c4283b315c6def6f13c31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.053047  8755 tablet_service.cc:1511] Processing CreateTablet for tablet be1c593726564ba7ae9e8b66d1989f69 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:16:43.053500  8754 tablet_service.cc:1511] Processing CreateTablet for tablet 932e5cbccd33414f8b05280505fd8bc7 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:16:43.054704  8755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be1c593726564ba7ae9e8b66d1989f69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.055400  8754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 932e5cbccd33414f8b05280505fd8bc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.060045  8753 tablet_service.cc:1511] Processing CreateTablet for tablet ed4d847e589942fcbf6dadbb578327f2 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:16:43.061769  8753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed4d847e589942fcbf6dadbb578327f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.066383  8752 tablet_service.cc:1511] Processing CreateTablet for tablet 485b2d9b05744b4f9a22e8f0e8b66e0d (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:16:43.068168  8752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 485b2d9b05744b4f9a22e8f0e8b66e0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.072752  8751 tablet_service.cc:1511] Processing CreateTablet for tablet 1d5284f5b067413e9fc2a383cc318735 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:16:43.074375  8751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d5284f5b067413e9fc2a383cc318735. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.077468  8831 tablet_service.cc:1511] Processing CreateTablet for tablet 4e1e1e84d68946d682e0944fbd3c51a8 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:16:43.079380  8831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e1e1e84d68946d682e0944fbd3c51a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.098552  8983 tablet_service.cc:1511] Processing CreateTablet for tablet 3f0c32d9abf04206a6f08210b3a30794 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:16:43.100996  8982 tablet_service.cc:1511] Processing CreateTablet for tablet f46053ed2641458a87c97152e4979c35 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:16:43.103227  8981 tablet_service.cc:1511] Processing CreateTablet for tablet 734d16820c5640729de24c6edf4c5ed8 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:16:43.105405  8980 tablet_service.cc:1511] Processing CreateTablet for tablet 4e1e1e84d68946d682e0944fbd3c51a8 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:16:43.108810  8978 tablet_service.cc:1511] Processing CreateTablet for tablet 21893ae95aed4157a65823826a6badf0 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:16:43.113430  8976 tablet_service.cc:1511] Processing CreateTablet for tablet 485b2d9b05744b4f9a22e8f0e8b66e0d (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:16:43.116214  8975 tablet_service.cc:1511] Processing CreateTablet for tablet 197670bf2e8f4301b060ed8ef6862b22 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:16:43.117733  8979 tablet_service.cc:1511] Processing CreateTablet for tablet be1c593726564ba7ae9e8b66d1989f69 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:16:43.111291  8977 tablet_service.cc:1511] Processing CreateTablet for tablet ed4d847e589942fcbf6dadbb578327f2 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:16:43.120700  8974 tablet_service.cc:1511] Processing CreateTablet for tablet 8a25176ebf484df29f67908cfa6e2b48 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:16:43.125360  8983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f0c32d9abf04206a6f08210b3a30794. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.129083  8978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21893ae95aed4157a65823826a6badf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.136229  8975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 197670bf2e8f4301b060ed8ef6862b22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.140226  8981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 734d16820c5640729de24c6edf4c5ed8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.144213  8982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f46053ed2641458a87c97152e4979c35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.148391  8979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be1c593726564ba7ae9e8b66d1989f69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.152271  8980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e1e1e84d68946d682e0944fbd3c51a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.156306  8976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 485b2d9b05744b4f9a22e8f0e8b66e0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.160346  8977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed4d847e589942fcbf6dadbb578327f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.164331  8974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a25176ebf484df29f67908cfa6e2b48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.166183  8752 tablet_service.cc:1511] Processing CreateTablet for tablet ae1fc430ae3d4315aad2c0eed2f026aa (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:16:43.168288  8752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae1fc430ae3d4315aad2c0eed2f026aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.186802  8758 tablet_service.cc:1511] Processing CreateTablet for tablet 8a25176ebf484df29f67908cfa6e2b48 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:16:43.188555  8758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a25176ebf484df29f67908cfa6e2b48. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:16:43.191154  8716 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:43.205091  8830 tablet_service.cc:1511] Processing CreateTablet for tablet 21893ae95aed4157a65823826a6badf0 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:16:43.206828  8830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21893ae95aed4157a65823826a6badf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.213932  8834 tablet_service.cc:1511] Processing CreateTablet for tablet ed4d847e589942fcbf6dadbb578327f2 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:16:43.216202  8828 tablet_service.cc:1511] Processing CreateTablet for tablet 1d5284f5b067413e9fc2a383cc318735 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:16:43.216997  8826 tablet_service.cc:1511] Processing CreateTablet for tablet 67ea3c8e514f41549c3a96b74a9b5be9 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:16:43.214201  8829 tablet_service.cc:1511] Processing CreateTablet for tablet 197670bf2e8f4301b060ed8ef6862b22 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:16:43.219086  8827 tablet_service.cc:1511] Processing CreateTablet for tablet 8a25176ebf484df29f67908cfa6e2b48 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:16:43.222708  8834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed4d847e589942fcbf6dadbb578327f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.223459  8827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a25176ebf484df29f67908cfa6e2b48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.227782  8829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 197670bf2e8f4301b060ed8ef6862b22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.228494  8828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d5284f5b067413e9fc2a383cc318735. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.229264  8826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67ea3c8e514f41549c3a96b74a9b5be9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.234840  8754 tablet_service.cc:1511] Processing CreateTablet for tablet 825ea78cebec4b10a2f8d03b45d929fa (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:16:43.236526  8754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 825ea78cebec4b10a2f8d03b45d929fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.252898  8757 tablet_service.cc:1511] Processing CreateTablet for tablet 7bcde3fdb9314ca4b3422d395a673be5 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:16:43.254551  8757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bcde3fdb9314ca4b3422d395a673be5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.255635  8909 tablet_service.cc:1511] Processing CreateTablet for tablet ef723f9c640849d3890c61c07ffd0378 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:16:43.260740  8906 tablet_service.cc:1511] Processing CreateTablet for tablet d46902173b5c4283b315c6def6f13c31 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:16:43.260563  8903 tablet_service.cc:1511] Processing CreateTablet for tablet 932e5cbccd33414f8b05280505fd8bc7 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:16:43.262992  8907 tablet_service.cc:1511] Processing CreateTablet for tablet 734d16820c5640729de24c6edf4c5ed8 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:16:43.264438  8902 tablet_service.cc:1511] Processing CreateTablet for tablet 485b2d9b05744b4f9a22e8f0e8b66e0d (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:16:43.265233  8908 tablet_service.cc:1511] Processing CreateTablet for tablet f46053ed2641458a87c97152e4979c35 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:16:43.267431  8904 tablet_service.cc:1511] Processing CreateTablet for tablet 21893ae95aed4157a65823826a6badf0 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:16:43.268287  8901 tablet_service.cc:1511] Processing CreateTablet for tablet 197670bf2e8f4301b060ed8ef6862b22 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:16:43.271763  8905 tablet_service.cc:1511] Processing CreateTablet for tablet be1c593726564ba7ae9e8b66d1989f69 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:16:43.271556  8900 tablet_service.cc:1511] Processing CreateTablet for tablet 1d5284f5b067413e9fc2a383cc318735 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:16:43.280046  9039 tablet_bootstrap.cc:492] T 734d16820c5640729de24c6edf4c5ed8 P 7d3072f2af0b481d94ed70632b90e8c6: Bootstrap starting.
I20260709 13:16:43.280902  8828 tablet_service.cc:1511] Processing CreateTablet for tablet 825ea78cebec4b10a2f8d03b45d929fa (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:16:43.281044  8832 tablet_service.cc:1511] Processing CreateTablet for tablet 7bcde3fdb9314ca4b3422d395a673be5 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:16:43.282270  8835 tablet_service.cc:1511] Processing CreateTablet for tablet 932e5cbccd33414f8b05280505fd8bc7 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:16:43.286372  8752 tablet_service.cc:1511] Processing CreateTablet for tablet ab679ea0af724bd39f753eb407c73264 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:16:43.287786  8752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab679ea0af724bd39f753eb407c73264. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.295279  8751 tablet_service.cc:1511] Processing CreateTablet for tablet f80d602267cf421690d5fe6d3922e0cb (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:16:43.298034  8751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f80d602267cf421690d5fe6d3922e0cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.302733  8909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef723f9c640849d3890c61c07ffd0378. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.305189  8753 tablet_service.cc:1511] Processing CreateTablet for tablet 448f6ffb482841a3b489476becf2f851 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:16:43.306670  8753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 448f6ffb482841a3b489476becf2f851. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.315171  8756 tablet_service.cc:1511] Processing CreateTablet for tablet 4352fad232ab47588683e51cf4b62080 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:16:43.316867  8756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4352fad232ab47588683e51cf4b62080. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.327956  8832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bcde3fdb9314ca4b3422d395a673be5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.328267  8901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 197670bf2e8f4301b060ed8ef6862b22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.328958  8760 tablet_service.cc:1511] Processing CreateTablet for tablet 9f7eec107ecc40f38d14871d9227b25f (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:16:43.329705  8835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 932e5cbccd33414f8b05280505fd8bc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.330418  8760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f7eec107ecc40f38d14871d9227b25f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.331230  8828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 825ea78cebec4b10a2f8d03b45d929fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.332193  8907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 734d16820c5640729de24c6edf4c5ed8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.336167  8905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be1c593726564ba7ae9e8b66d1989f69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.340154  8904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21893ae95aed4157a65823826a6badf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.344219  8900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d5284f5b067413e9fc2a383cc318735. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.348212  8908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f46053ed2641458a87c97152e4979c35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.349810  8906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d46902173b5c4283b315c6def6f13c31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.351291  8903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 932e5cbccd33414f8b05280505fd8bc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.359918  8902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 485b2d9b05744b4f9a22e8f0e8b66e0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.370368  8833 tablet_service.cc:1511] Processing CreateTablet for tablet 359d64d36e684763884c576f961f829d (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:16:43.372023  8833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 359d64d36e684763884c576f961f829d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.388053  8795 heartbeater.cc:499] Master 127.2.198.254:33107 was elected leader, sending a full tablet report...
I20260709 13:16:43.388695  8755 tablet_service.cc:1511] Processing CreateTablet for tablet 390c483b2a1c42b897e166b1a381851c (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:16:43.390218  8755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 390c483b2a1c42b897e166b1a381851c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.401093  8831 tablet_service.cc:1511] Processing CreateTablet for tablet 448f6ffb482841a3b489476becf2f851 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:16:43.402807  8831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 448f6ffb482841a3b489476becf2f851. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.418092  9039 tablet_bootstrap.cc:654] T 734d16820c5640729de24c6edf4c5ed8 P 7d3072f2af0b481d94ed70632b90e8c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:43.429419  8826 tablet_service.cc:1511] Processing CreateTablet for tablet 2c3f7327ddfa499ab1e3f0996a560618 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:16:43.435966  8826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c3f7327ddfa499ab1e3f0996a560618. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.453061  9038 tablet_bootstrap.cc:492] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:43.454356  9040 tablet_bootstrap.cc:492] T 21893ae95aed4157a65823826a6badf0 P e8bb7e1240f44fda8b83e4c124852032: Bootstrap starting.
I20260709 13:16:43.460687  8980 tablet_service.cc:1511] Processing CreateTablet for tablet 825ea78cebec4b10a2f8d03b45d929fa (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:16:43.462143  8980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 825ea78cebec4b10a2f8d03b45d929fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.484395  8976 tablet_service.cc:1511] Processing CreateTablet for tablet ab679ea0af724bd39f753eb407c73264 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:16:43.487046  8976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab679ea0af724bd39f753eb407c73264. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.426860  8832 tablet_service.cc:1511] Processing CreateTablet for tablet f80d602267cf421690d5fe6d3922e0cb (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:16:43.492901  8832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f80d602267cf421690d5fe6d3922e0cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.501518  8835 tablet_service.cc:1511] Processing CreateTablet for tablet 390c483b2a1c42b897e166b1a381851c (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:16:43.503051  8835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 390c483b2a1c42b897e166b1a381851c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.505163  8870 heartbeater.cc:499] Master 127.2.198.254:33107 was elected leader, sending a full tablet report...
I20260709 13:16:43.517716  9038 tablet_bootstrap.cc:654] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:43.435263  8982 tablet_service.cc:1511] Processing CreateTablet for tablet ae1fc430ae3d4315aad2c0eed2f026aa (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:16:43.544885  8982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae1fc430ae3d4315aad2c0eed2f026aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.435263  8830 tablet_service.cc:1511] Processing CreateTablet for tablet 9f7eec107ecc40f38d14871d9227b25f (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:16:43.565127  8830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f7eec107ecc40f38d14871d9227b25f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:16:43.579711  8652 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.2.198.196:46105, user_credentials={real_user=slave}} blocked reactor thread for 79098.2us
I20260709 13:16:43.596189  8978 tablet_service.cc:1511] Processing CreateTablet for tablet 4352fad232ab47588683e51cf4b62080 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:16:43.597579  9039 tablet_bootstrap.cc:492] T 734d16820c5640729de24c6edf4c5ed8 P 7d3072f2af0b481d94ed70632b90e8c6: No bootstrap required, opened a new log
I20260709 13:16:43.598943  9039 ts_tablet_manager.cc:1403] T 734d16820c5640729de24c6edf4c5ed8 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent bootstrapping tablet: real 0.319s	user 0.051s	sys 0.057s
W20260709 13:16:43.597620  8654 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.2.198.193:39173, user_credentials={real_user=slave}} blocked reactor thread for 109246us
I20260709 13:16:43.602015  9040 tablet_bootstrap.cc:654] T 21893ae95aed4157a65823826a6badf0 P e8bb7e1240f44fda8b83e4c124852032: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:43.607663  8834 tablet_service.cc:1511] Processing CreateTablet for tablet d64af92885f944f9b1ecf193ede281b3 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:16:43.608443  8975 tablet_service.cc:1511] Processing CreateTablet for tablet 2c3f7327ddfa499ab1e3f0996a560618 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:16:43.609176  8834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d64af92885f944f9b1ecf193ede281b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.609881  8975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c3f7327ddfa499ab1e3f0996a560618. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.611596  8979 tablet_service.cc:1511] Processing CreateTablet for tablet 448f6ffb482841a3b489476becf2f851 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:16:43.612898  8979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 448f6ffb482841a3b489476becf2f851. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.608522  8760 tablet_service.cc:1511] Processing CreateTablet for tablet 1c9bb56a39d44b71b44c334e0bea59a5 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:16:43.614584  8760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c9bb56a39d44b71b44c334e0bea59a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.619026  8828 tablet_service.cc:1511] Processing CreateTablet for tablet 17e47826fe4e4662baba1d095c341c1b (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:16:43.620530  8828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17e47826fe4e4662baba1d095c341c1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.602391  9039 raft_consensus.cc:359] T 734d16820c5640729de24c6edf4c5ed8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:43.603904  8907 tablet_service.cc:1511] Processing CreateTablet for tablet ae1fc430ae3d4315aad2c0eed2f026aa (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:16:43.623742  9039 raft_consensus.cc:385] T 734d16820c5640729de24c6edf4c5ed8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:43.624174  9039 raft_consensus.cc:740] T 734d16820c5640729de24c6edf4c5ed8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Initialized, Role: FOLLOWER
I20260709 13:16:43.608848  8981 tablet_service.cc:1511] Processing CreateTablet for tablet 67ea3c8e514f41549c3a96b74a9b5be9 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:16:43.624789  8907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae1fc430ae3d4315aad2c0eed2f026aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.625365  8981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67ea3c8e514f41549c3a96b74a9b5be9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.625185  9039 consensus_queue.cc:260] T 734d16820c5640729de24c6edf4c5ed8 P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:43.628535  8983 tablet_service.cc:1511] Processing CreateTablet for tablet 390c483b2a1c42b897e166b1a381851c (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:16:43.630126  8983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 390c483b2a1c42b897e166b1a381851c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.633036  8905 tablet_service.cc:1511] Processing CreateTablet for tablet 67ea3c8e514f41549c3a96b74a9b5be9 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:16:43.638787  8944 heartbeater.cc:499] Master 127.2.198.254:33107 was elected leader, sending a full tablet report...
I20260709 13:16:43.651723  8905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67ea3c8e514f41549c3a96b74a9b5be9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.652920  9039 ts_tablet_manager.cc:1434] T 734d16820c5640729de24c6edf4c5ed8 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent starting tablet: real 0.054s	user 0.011s	sys 0.001s
I20260709 13:16:43.656735  9042 tablet_bootstrap.cc:492] T be1c593726564ba7ae9e8b66d1989f69 P 43c6faa9496d44dda6b6eaed09cdfd12: Bootstrap starting.
I20260709 13:16:43.698736  9039 tablet_bootstrap.cc:492] T ef723f9c640849d3890c61c07ffd0378 P 7d3072f2af0b481d94ed70632b90e8c6: Bootstrap starting.
I20260709 13:16:43.657119  8976 tablet_service.cc:1511] Processing CreateTablet for tablet 359d64d36e684763884c576f961f829d (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:16:43.666837  8974 tablet_service.cc:1511] Processing CreateTablet for tablet 1c9bb56a39d44b71b44c334e0bea59a5 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:16:43.674137  8908 tablet_service.cc:1511] Processing CreateTablet for tablet 7bcde3fdb9314ca4b3422d395a673be5 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:16:43.684715  8977 tablet_service.cc:1511] Processing CreateTablet for tablet d64af92885f944f9b1ecf193ede281b3 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:16:43.687963  8978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4352fad232ab47588683e51cf4b62080. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.707195  8757 tablet_service.cc:1511] Processing CreateTablet for tablet 17e47826fe4e4662baba1d095c341c1b (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:16:43.708695  8757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17e47826fe4e4662baba1d095c341c1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.711609  8976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 359d64d36e684763884c576f961f829d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.712649  8755 tablet_service.cc:1511] Processing CreateTablet for tablet 65900ac9e06944639fe557200317fe05 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:16:43.714071  8755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65900ac9e06944639fe557200317fe05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.689531  8835 tablet_service.cc:1511] Processing CreateTablet for tablet 65900ac9e06944639fe557200317fe05 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:16:43.691314  8979 tablet_service.cc:1511] Processing CreateTablet for tablet 65900ac9e06944639fe557200317fe05 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:16:43.716729  8835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65900ac9e06944639fe557200317fe05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.716729  8979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65900ac9e06944639fe557200317fe05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.724534  8977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d64af92885f944f9b1ecf193ede281b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.727999  8974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c9bb56a39d44b71b44c334e0bea59a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.729257  9018 heartbeater.cc:499] Master 127.2.198.254:33107 was elected leader, sending a full tablet report...
W20260709 13:16:43.732962  8871 tablet.cc:2406] T 734d16820c5640729de24c6edf4c5ed8 P 7d3072f2af0b481d94ed70632b90e8c6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:16:43.753094  8906 tablet_service.cc:1511] Processing CreateTablet for tablet f80d602267cf421690d5fe6d3922e0cb (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:16:43.758715  8904 tablet_service.cc:1511] Processing CreateTablet for tablet 4352fad232ab47588683e51cf4b62080 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:16:43.691125  8903 tablet_service.cc:1511] Processing CreateTablet for tablet ab679ea0af724bd39f753eb407c73264 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:16:43.779752  8908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bcde3fdb9314ca4b3422d395a673be5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.770207  9039 tablet_bootstrap.cc:654] T ef723f9c640849d3890c61c07ffd0378 P 7d3072f2af0b481d94ed70632b90e8c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:43.786448  8904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4352fad232ab47588683e51cf4b62080. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.791896  8903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab679ea0af724bd39f753eb407c73264. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.792677  8901 tablet_service.cc:1511] Processing CreateTablet for tablet 2c3f7327ddfa499ab1e3f0996a560618 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:16:43.794210  8901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c3f7327ddfa499ab1e3f0996a560618. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.798338  8982 tablet_service.cc:1511] Processing CreateTablet for tablet 80fde6a0b6334446923248a50e223397 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:16:43.800097  8982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80fde6a0b6334446923248a50e223397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.804193  8902 tablet_service.cc:1511] Processing CreateTablet for tablet 359d64d36e684763884c576f961f829d (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:16:43.805460  9040 tablet_bootstrap.cc:492] T 21893ae95aed4157a65823826a6badf0 P e8bb7e1240f44fda8b83e4c124852032: No bootstrap required, opened a new log
I20260709 13:16:43.805897  8902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 359d64d36e684763884c576f961f829d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.806075  9040 ts_tablet_manager.cc:1403] T 21893ae95aed4157a65823826a6badf0 P e8bb7e1240f44fda8b83e4c124852032: Time spent bootstrapping tablet: real 0.352s	user 0.015s	sys 0.041s
I20260709 13:16:43.807825  8906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f80d602267cf421690d5fe6d3922e0cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.810964  8900 tablet_service.cc:1511] Processing CreateTablet for tablet 9f7eec107ecc40f38d14871d9227b25f (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:16:43.812511  8900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f7eec107ecc40f38d14871d9227b25f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.812885  8909 tablet_service.cc:1511] Processing CreateTablet for tablet 1c9bb56a39d44b71b44c334e0bea59a5 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:16:43.814320  8909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c9bb56a39d44b71b44c334e0bea59a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.820839  9042 tablet_bootstrap.cc:654] T be1c593726564ba7ae9e8b66d1989f69 P 43c6faa9496d44dda6b6eaed09cdfd12: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:43.821794  9040 raft_consensus.cc:359] T 21893ae95aed4157a65823826a6badf0 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:43.822574  9040 raft_consensus.cc:385] T 21893ae95aed4157a65823826a6badf0 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:43.822855  9040 raft_consensus.cc:740] T 21893ae95aed4157a65823826a6badf0 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Initialized, Role: FOLLOWER
I20260709 13:16:43.830164  8754 tablet_service.cc:1511] Processing CreateTablet for tablet 80fde6a0b6334446923248a50e223397 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:16:43.832450  8754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80fde6a0b6334446923248a50e223397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.833846  9038 tablet_bootstrap.cc:492] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243: No bootstrap required, opened a new log
I20260709 13:16:43.834476  9038 ts_tablet_manager.cc:1403] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.382s	user 0.004s	sys 0.024s
I20260709 13:16:43.838069  9038 raft_consensus.cc:359] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:43.838840  9038 raft_consensus.cc:385] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:43.839169  9038 raft_consensus.cc:740] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:43.846022  9038 consensus_queue.cc:260] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:43.831684  9040 consensus_queue.cc:260] T 21893ae95aed4157a65823826a6badf0 P e8bb7e1240f44fda8b83e4c124852032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:43.860837  8907 tablet_service.cc:1511] Processing CreateTablet for tablet d64af92885f944f9b1ecf193ede281b3 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:16:43.862440  8907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d64af92885f944f9b1ecf193ede281b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.906160  8834 tablet_service.cc:1511] Processing CreateTablet for tablet e3ee8f06068449de90c7fb0479f504ca (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:16:43.908334  8834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3ee8f06068449de90c7fb0479f504ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.911389  9039 tablet_bootstrap.cc:492] T ef723f9c640849d3890c61c07ffd0378 P 7d3072f2af0b481d94ed70632b90e8c6: No bootstrap required, opened a new log
I20260709 13:16:43.912053  9039 ts_tablet_manager.cc:1403] T ef723f9c640849d3890c61c07ffd0378 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent bootstrapping tablet: real 0.214s	user 0.015s	sys 0.001s
I20260709 13:16:43.915675  9039 raft_consensus.cc:359] T ef723f9c640849d3890c61c07ffd0378 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:43.916404  9039 raft_consensus.cc:385] T ef723f9c640849d3890c61c07ffd0378 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:43.923622  9039 raft_consensus.cc:740] T ef723f9c640849d3890c61c07ffd0378 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Initialized, Role: FOLLOWER
I20260709 13:16:43.925107  9040 ts_tablet_manager.cc:1434] T 21893ae95aed4157a65823826a6badf0 P e8bb7e1240f44fda8b83e4c124852032: Time spent starting tablet: real 0.119s	user 0.015s	sys 0.000s
I20260709 13:16:43.924733  9039 consensus_queue.cc:260] T ef723f9c640849d3890c61c07ffd0378 P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:43.932740  9040 tablet_bootstrap.cc:492] T f46053ed2641458a87c97152e4979c35 P e8bb7e1240f44fda8b83e4c124852032: Bootstrap starting.
I20260709 13:16:43.926662  8903 tablet_service.cc:1511] Processing CreateTablet for tablet 17e47826fe4e4662baba1d095c341c1b (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:16:43.926625  9038 ts_tablet_manager.cc:1434] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.092s	user 0.010s	sys 0.035s
I20260709 13:16:43.940757  8903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17e47826fe4e4662baba1d095c341c1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.941376  9038 tablet_bootstrap.cc:492] T f46053ed2641458a87c97152e4979c35 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:43.946419  9042 tablet_bootstrap.cc:492] T be1c593726564ba7ae9e8b66d1989f69 P 43c6faa9496d44dda6b6eaed09cdfd12: No bootstrap required, opened a new log
I20260709 13:16:43.947016  9042 ts_tablet_manager.cc:1403] T be1c593726564ba7ae9e8b66d1989f69 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent bootstrapping tablet: real 0.291s	user 0.019s	sys 0.004s
I20260709 13:16:43.938247  8908 tablet_service.cc:1511] Processing CreateTablet for tablet 80fde6a0b6334446923248a50e223397 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:16:43.949311  8908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80fde6a0b6334446923248a50e223397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.952775  9039 ts_tablet_manager.cc:1434] T ef723f9c640849d3890c61c07ffd0378 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.003s
I20260709 13:16:43.952893  9042 raft_consensus.cc:359] T be1c593726564ba7ae9e8b66d1989f69 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:43.953845  9042 raft_consensus.cc:385] T be1c593726564ba7ae9e8b66d1989f69 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:43.954069  9039 tablet_bootstrap.cc:492] T 3f0c32d9abf04206a6f08210b3a30794 P 7d3072f2af0b481d94ed70632b90e8c6: Bootstrap starting.
I20260709 13:16:43.954159  9042 raft_consensus.cc:740] T be1c593726564ba7ae9e8b66d1989f69 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Initialized, Role: FOLLOWER
I20260709 13:16:43.958772  9048 raft_consensus.cc:493] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.963922  8905 tablet_service.cc:1511] Processing CreateTablet for tablet e3ee8f06068449de90c7fb0479f504ca (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:16:43.965588  8905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3ee8f06068449de90c7fb0479f504ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.959324  9048 raft_consensus.cc:515] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:43.982959  9048 leader_election.cc:290] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:43.955237  9042 consensus_queue.cc:260] T be1c593726564ba7ae9e8b66d1989f69 P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:43.987730  9038 tablet_bootstrap.cc:654] T f46053ed2641458a87c97152e4979c35 P 895d3c58761f427c9c5b3cb41246c243: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.000749  9039 tablet_bootstrap.cc:654] T 3f0c32d9abf04206a6f08210b3a30794 P 7d3072f2af0b481d94ed70632b90e8c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.004657  8976 tablet_service.cc:1511] Processing CreateTablet for tablet e3ee8f06068449de90c7fb0479f504ca (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:16:44.007048  9040 tablet_bootstrap.cc:654] T f46053ed2641458a87c97152e4979c35 P e8bb7e1240f44fda8b83e4c124852032: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.032644  8830 tablet_service.cc:1511] Processing CreateTablet for tablet f3ea64f4f4c54500a95692118660d9b4 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:16:44.034391  8830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3ea64f4f4c54500a95692118660d9b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.051904  8976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3ee8f06068449de90c7fb0479f504ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.055904  8754 tablet_service.cc:1511] Processing CreateTablet for tablet f3ea64f4f4c54500a95692118660d9b4 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:16:44.055770  8906 tablet_service.cc:1511] Processing CreateTablet for tablet f3ea64f4f4c54500a95692118660d9b4 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:16:44.056324  8982 tablet_service.cc:1511] Processing CreateTablet for tablet 1521cafcc31b47c58829494618fc0cd8 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:16:44.057719  9042 ts_tablet_manager.cc:1434] T be1c593726564ba7ae9e8b66d1989f69 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent starting tablet: real 0.110s	user 0.028s	sys 0.023s
I20260709 13:16:44.065825  8754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3ea64f4f4c54500a95692118660d9b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.066385  8906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3ea64f4f4c54500a95692118660d9b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.069181  8834 tablet_service.cc:1511] Processing CreateTablet for tablet 1521cafcc31b47c58829494618fc0cd8 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:16:44.069533  8757 tablet_service.cc:1511] Processing CreateTablet for tablet 1521cafcc31b47c58829494618fc0cd8 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:16:44.070813  8757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1521cafcc31b47c58829494618fc0cd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.076141  8982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1521cafcc31b47c58829494618fc0cd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.079788  8978 tablet_service.cc:1511] Processing CreateTablet for tablet 2945a5b174e14a5a9052897942f876c2 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:16:44.081341  8978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2945a5b174e14a5a9052897942f876c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.081794  8909 tablet_service.cc:1511] Processing CreateTablet for tablet 2945a5b174e14a5a9052897942f876c2 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:16:44.083169  8909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2945a5b174e14a5a9052897942f876c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.070813  8834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1521cafcc31b47c58829494618fc0cd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.096387  9039 tablet_bootstrap.cc:492] T 3f0c32d9abf04206a6f08210b3a30794 P 7d3072f2af0b481d94ed70632b90e8c6: No bootstrap required, opened a new log
I20260709 13:16:44.097078  9039 ts_tablet_manager.cc:1403] T 3f0c32d9abf04206a6f08210b3a30794 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent bootstrapping tablet: real 0.143s	user 0.018s	sys 0.009s
I20260709 13:16:44.097230  9042 tablet_bootstrap.cc:492] T 734d16820c5640729de24c6edf4c5ed8 P 43c6faa9496d44dda6b6eaed09cdfd12: Bootstrap starting.
I20260709 13:16:44.111004  8760 tablet_service.cc:1511] Processing CreateTablet for tablet 2945a5b174e14a5a9052897942f876c2 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:16:44.112706  8760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2945a5b174e14a5a9052897942f876c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.113874  9039 raft_consensus.cc:359] T 3f0c32d9abf04206a6f08210b3a30794 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:44.114753  9039 raft_consensus.cc:385] T 3f0c32d9abf04206a6f08210b3a30794 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.115054  9039 raft_consensus.cc:740] T 3f0c32d9abf04206a6f08210b3a30794 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.116520  9040 tablet_bootstrap.cc:492] T f46053ed2641458a87c97152e4979c35 P e8bb7e1240f44fda8b83e4c124852032: No bootstrap required, opened a new log
I20260709 13:16:44.118369  9040 ts_tablet_manager.cc:1403] T f46053ed2641458a87c97152e4979c35 P e8bb7e1240f44fda8b83e4c124852032: Time spent bootstrapping tablet: real 0.186s	user 0.035s	sys 0.007s
I20260709 13:16:44.122124  9040 raft_consensus.cc:359] T f46053ed2641458a87c97152e4979c35 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:44.117180  9039 consensus_queue.cc:260] T 3f0c32d9abf04206a6f08210b3a30794 P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:44.123943  9044 raft_consensus.cc:493] T 734d16820c5640729de24c6edf4c5ed8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.134430  9044 raft_consensus.cc:515] T 734d16820c5640729de24c6edf4c5ed8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:44.135432  8835 tablet_service.cc:1511] Processing CreateTablet for tablet dc5cf20be8db404dbda7f0b4a676ab31 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:16:44.136996  8835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc5cf20be8db404dbda7f0b4a676ab31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.144158  9042 tablet_bootstrap.cc:654] T 734d16820c5640729de24c6edf4c5ed8 P 43c6faa9496d44dda6b6eaed09cdfd12: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.143877  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1c593726564ba7ae9e8b66d1989f69" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:44.145073  8919 raft_consensus.cc:2468] T be1c593726564ba7ae9e8b66d1989f69 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 0.
I20260709 13:16:44.146229  9044 leader_election.cc:290] T 734d16820c5640729de24c6edf4c5ed8 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:44.146706  8736 leader_election.cc:304] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243; no voters: 
I20260709 13:16:44.147861  9048 raft_consensus.cc:2804] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:44.148389  9048 raft_consensus.cc:493] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.148849  9048 raft_consensus.cc:3060] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:44.149710  9039 ts_tablet_manager.cc:1434] T 3f0c32d9abf04206a6f08210b3a30794 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.004s
I20260709 13:16:44.153119  9039 tablet_bootstrap.cc:492] T d46902173b5c4283b315c6def6f13c31 P 7d3072f2af0b481d94ed70632b90e8c6: Bootstrap starting.
I20260709 13:16:44.158622  9038 tablet_bootstrap.cc:492] T f46053ed2641458a87c97152e4979c35 P 895d3c58761f427c9c5b3cb41246c243: No bootstrap required, opened a new log
I20260709 13:16:44.159312  9038 ts_tablet_manager.cc:1403] T f46053ed2641458a87c97152e4979c35 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.218s	user 0.019s	sys 0.007s
I20260709 13:16:44.176642  8974 tablet_service.cc:1511] Processing CreateTablet for tablet dc5cf20be8db404dbda7f0b4a676ab31 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:16:44.177603  8755 tablet_service.cc:1511] Processing CreateTablet for tablet d09ffcae84334482a706af1e812c7c9d (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:16:44.178234  8974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc5cf20be8db404dbda7f0b4a676ab31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.179005  8755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d09ffcae84334482a706af1e812c7c9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.159571  9048 raft_consensus.cc:515] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:44.180786  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1c593726564ba7ae9e8b66d1989f69" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:44.181353  9048 leader_election.cc:290] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 election: Requested vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
W20260709 13:16:44.182828  8733 leader_election.cc:343] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:44.184090  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1c593726564ba7ae9e8b66d1989f69" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
W20260709 13:16:44.185580  8733 leader_election.cc:343] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:44.190253  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1c593726564ba7ae9e8b66d1989f69" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:16:44.180682  8830 tablet_service.cc:1511] Processing CreateTablet for tablet d09ffcae84334482a706af1e812c7c9d (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:16:44.191166  8919 raft_consensus.cc:3060] T be1c593726564ba7ae9e8b66d1989f69 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:44.191359  8905 tablet_service.cc:1511] Processing CreateTablet for tablet dc5cf20be8db404dbda7f0b4a676ab31 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:16:44.192099  8830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d09ffcae84334482a706af1e812c7c9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.192775  8905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc5cf20be8db404dbda7f0b4a676ab31. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:16:44.194387  8716 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:44.190207  8908 tablet_service.cc:1511] Processing CreateTablet for tablet d09ffcae84334482a706af1e812c7c9d (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:16:44.171134  9038 raft_consensus.cc:359] T f46053ed2641458a87c97152e4979c35 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:44.195264  9038 raft_consensus.cc:385] T f46053ed2641458a87c97152e4979c35 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.195616  9038 raft_consensus.cc:740] T f46053ed2641458a87c97152e4979c35 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.195775  8908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d09ffcae84334482a706af1e812c7c9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.167019  9040 raft_consensus.cc:385] T f46053ed2641458a87c97152e4979c35 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.199065  9040 raft_consensus.cc:740] T f46053ed2641458a87c97152e4979c35 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.200089  9040 consensus_queue.cc:260] T f46053ed2641458a87c97152e4979c35 P e8bb7e1240f44fda8b83e4c124852032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:44.202962  9040 ts_tablet_manager.cc:1434] T f46053ed2641458a87c97152e4979c35 P e8bb7e1240f44fda8b83e4c124852032: Time spent starting tablet: real 0.084s	user 0.007s	sys 0.000s
I20260709 13:16:44.204123  9040 tablet_bootstrap.cc:492] T 734d16820c5640729de24c6edf4c5ed8 P e8bb7e1240f44fda8b83e4c124852032: Bootstrap starting.
I20260709 13:16:44.204358  9038 consensus_queue.cc:260] T f46053ed2641458a87c97152e4979c35 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:44.206071  9042 tablet_bootstrap.cc:492] T 734d16820c5640729de24c6edf4c5ed8 P 43c6faa9496d44dda6b6eaed09cdfd12: No bootstrap required, opened a new log
I20260709 13:16:44.218613  8979 tablet_service.cc:1511] Processing CreateTablet for tablet 852f0ef4508245e2812b76665a70bbf8 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:16:44.224273  9042 ts_tablet_manager.cc:1403] T 734d16820c5640729de24c6edf4c5ed8 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent bootstrapping tablet: real 0.127s	user 0.009s	sys 0.008s
I20260709 13:16:44.225204  8979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 852f0ef4508245e2812b76665a70bbf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.225878  9038 ts_tablet_manager.cc:1434] T f46053ed2641458a87c97152e4979c35 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.058s	user 0.008s	sys 0.000s
I20260709 13:16:44.227126  9038 tablet_bootstrap.cc:492] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:44.228041  9042 raft_consensus.cc:359] T 734d16820c5640729de24c6edf4c5ed8 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:44.228924  9042 raft_consensus.cc:385] T 734d16820c5640729de24c6edf4c5ed8 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.229254  9042 raft_consensus.cc:740] T 734d16820c5640729de24c6edf4c5ed8 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.230114  9042 consensus_queue.cc:260] T 734d16820c5640729de24c6edf4c5ed8 P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:44.235594  8919 raft_consensus.cc:2468] T be1c593726564ba7ae9e8b66d1989f69 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 1.
I20260709 13:16:44.236940  8736 leader_election.cc:304] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243; no voters: e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:44.238351  9050 raft_consensus.cc:2804] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:44.238895  9050 raft_consensus.cc:697] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243 [term 1 LEADER]: Becoming Leader. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Running, Role: LEADER
I20260709 13:16:44.239898  9050 consensus_queue.cc:237] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:44.175408  9039 tablet_bootstrap.cc:654] T d46902173b5c4283b315c6def6f13c31 P 7d3072f2af0b481d94ed70632b90e8c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.247270  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "734d16820c5640729de24c6edf4c5ed8" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
W20260709 13:16:44.249372  8808 leader_election.cc:343] T 734d16820c5640729de24c6edf4c5ed8 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:44.255198  9042 ts_tablet_manager.cc:1434] T 734d16820c5640729de24c6edf4c5ed8 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.004s
I20260709 13:16:44.256608  8754 tablet_service.cc:1511] Processing CreateTablet for tablet 852f0ef4508245e2812b76665a70bbf8 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:16:44.258090  8754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 852f0ef4508245e2812b76665a70bbf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.264742  8832 tablet_service.cc:1511] Processing CreateTablet for tablet 852f0ef4508245e2812b76665a70bbf8 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:16:44.266237  8832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 852f0ef4508245e2812b76665a70bbf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.268333  9049 raft_consensus.cc:493] T f46053ed2641458a87c97152e4979c35 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.268528  8976 tablet_service.cc:1511] Processing CreateTablet for tablet 574915613e8a4d3481aef27d3a977caa (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:16:44.268939  9049 raft_consensus.cc:515] T f46053ed2641458a87c97152e4979c35 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:44.269414  8903 tablet_service.cc:1511] Processing CreateTablet for tablet 574915613e8a4d3481aef27d3a977caa (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:16:44.270002  8976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 574915613e8a4d3481aef27d3a977caa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.270750  8903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 574915613e8a4d3481aef27d3a977caa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.271932  9049 leader_election.cc:290] T f46053ed2641458a87c97152e4979c35 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:44.274330  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "734d16820c5640729de24c6edf4c5ed8" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:44.275130  8919 raft_consensus.cc:2468] T 734d16820c5640729de24c6edf4c5ed8 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 0.
I20260709 13:16:44.276117  9052 raft_consensus.cc:493] T 734d16820c5640729de24c6edf4c5ed8 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.276412  8811 leader_election.cc:304] T 734d16820c5640729de24c6edf4c5ed8 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6; no voters: e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:44.276643  9052 raft_consensus.cc:515] T 734d16820c5640729de24c6edf4c5ed8 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:44.277806  9044 raft_consensus.cc:2804] T 734d16820c5640729de24c6edf4c5ed8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:44.278182  9044 raft_consensus.cc:493] T 734d16820c5640729de24c6edf4c5ed8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.278514  9044 raft_consensus.cc:3060] T 734d16820c5640729de24c6edf4c5ed8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:44.302536  9052 leader_election.cc:290] T 734d16820c5640729de24c6edf4c5ed8 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:44.313357  9040 tablet_bootstrap.cc:654] T 734d16820c5640729de24c6edf4c5ed8 P e8bb7e1240f44fda8b83e4c124852032: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.332687  9049 raft_consensus.cc:493] T 21893ae95aed4157a65823826a6badf0 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.333379  9049 raft_consensus.cc:515] T 21893ae95aed4157a65823826a6badf0 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:44.304404  9042 tablet_bootstrap.cc:492] T f46053ed2641458a87c97152e4979c35 P 43c6faa9496d44dda6b6eaed09cdfd12: Bootstrap starting.
I20260709 13:16:44.358489  9070 raft_consensus.cc:493] T 3f0c32d9abf04206a6f08210b3a30794 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.366400  9070 raft_consensus.cc:515] T 3f0c32d9abf04206a6f08210b3a30794 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:44.369313  9070 leader_election.cc:290] T 3f0c32d9abf04206a6f08210b3a30794 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:44.377084  9039 tablet_bootstrap.cc:492] T d46902173b5c4283b315c6def6f13c31 P 7d3072f2af0b481d94ed70632b90e8c6: No bootstrap required, opened a new log
I20260709 13:16:44.377781  9039 ts_tablet_manager.cc:1403] T d46902173b5c4283b315c6def6f13c31 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent bootstrapping tablet: real 0.225s	user 0.014s	sys 0.011s
I20260709 13:16:44.381636  9044 raft_consensus.cc:515] T 734d16820c5640729de24c6edf4c5ed8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:44.383828  9049 leader_election.cc:290] T 21893ae95aed4157a65823826a6badf0 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:44.385250  9038 tablet_bootstrap.cc:654] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 895d3c58761f427c9c5b3cb41246c243: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.385083  8755 tablet_service.cc:1511] Processing CreateTablet for tablet 574915613e8a4d3481aef27d3a977caa (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:16:44.386699  8755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 574915613e8a4d3481aef27d3a977caa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.387107  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46053ed2641458a87c97152e4979c35" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:44.389082  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21893ae95aed4157a65823826a6badf0" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:44.390311  8974 tablet_service.cc:1511] Processing CreateTablet for tablet b8ded21dd9a54bc8b9cd260808162d0d (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
W20260709 13:16:44.390744  8959 leader_election.cc:343] T f46053ed2641458a87c97152e4979c35 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:44.391937  8959 leader_election.cc:343] T 21893ae95aed4157a65823826a6badf0 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:44.401981  8835 tablet_service.cc:1511] Processing CreateTablet for tablet b8ded21dd9a54bc8b9cd260808162d0d (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:16:44.406433  8835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8ded21dd9a54bc8b9cd260808162d0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.408321  8974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8ded21dd9a54bc8b9cd260808162d0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.409636  9039 raft_consensus.cc:359] T d46902173b5c4283b315c6def6f13c31 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:44.410470  9039 raft_consensus.cc:385] T d46902173b5c4283b315c6def6f13c31 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.410791  9039 raft_consensus.cc:740] T d46902173b5c4283b315c6def6f13c31 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.412348  9044 leader_election.cc:290] T 734d16820c5640729de24c6edf4c5ed8 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 election: Requested vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:44.431718  9042 tablet_bootstrap.cc:654] T f46053ed2641458a87c97152e4979c35 P 43c6faa9496d44dda6b6eaed09cdfd12: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.441411  8909 tablet_service.cc:1511] Processing CreateTablet for tablet b8ded21dd9a54bc8b9cd260808162d0d (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:16:44.443853  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "734d16820c5640729de24c6edf4c5ed8" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:16:44.444559  8919 raft_consensus.cc:3060] T 734d16820c5640729de24c6edf4c5ed8 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:44.446735  8909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8ded21dd9a54bc8b9cd260808162d0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.448089  8757 tablet_service.cc:1511] Processing CreateTablet for tablet c17f01b356e04590838cc6e6bb27bf64 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:16:44.449503  8757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c17f01b356e04590838cc6e6bb27bf64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.444669  8666 catalog_manager.cc:5697] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243 reported cstate change: term changed from 0 to 1, leader changed from <none> to 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "895d3c58761f427c9c5b3cb41246c243" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:44.454213  8919 raft_consensus.cc:2468] T 734d16820c5640729de24c6edf4c5ed8 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 1.
I20260709 13:16:44.466168  9072 raft_consensus.cc:493] T ef723f9c640849d3890c61c07ffd0378 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.466429  8906 tablet_service.cc:1511] Processing CreateTablet for tablet c17f01b356e04590838cc6e6bb27bf64 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:16:44.467926  8906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c17f01b356e04590838cc6e6bb27bf64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.473145  8811 leader_election.cc:304] T 734d16820c5640729de24c6edf4c5ed8 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6; no voters: 
I20260709 13:16:44.474169  9044 raft_consensus.cc:2804] T 734d16820c5640729de24c6edf4c5ed8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:44.474725  9044 raft_consensus.cc:697] T 734d16820c5640729de24c6edf4c5ed8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 LEADER]: Becoming Leader. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Running, Role: LEADER
I20260709 13:16:44.466964  9072 raft_consensus.cc:515] T ef723f9c640849d3890c61c07ffd0378 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:44.475658  9044 consensus_queue.cc:237] T 734d16820c5640729de24c6edf4c5ed8 P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:44.477355  9072 leader_election.cc:290] T ef723f9c640849d3890c61c07ffd0378 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:44.481098  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef723f9c640849d3890c61c07ffd0378" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:44.486586  8845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "734d16820c5640729de24c6edf4c5ed8" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
W20260709 13:16:44.488770  8811 leader_election.cc:343] T ef723f9c640849d3890c61c07ffd0378 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:44.490417  8770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f0c32d9abf04206a6f08210b3a30794" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:44.492660  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef723f9c640849d3890c61c07ffd0378" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
W20260709 13:16:44.495088  8810 leader_election.cc:343] T 3f0c32d9abf04206a6f08210b3a30794 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:44.496105  8810 leader_election.cc:343] T ef723f9c640849d3890c61c07ffd0378 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:44.496650  8810 leader_election.cc:304] T ef723f9c640849d3890c61c07ffd0378 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:44.419289  9039 consensus_queue.cc:260] T d46902173b5c4283b315c6def6f13c31 P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:44.500109  9070 raft_consensus.cc:2749] T ef723f9c640849d3890c61c07ffd0378 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:44.502404  9039 ts_tablet_manager.cc:1434] T d46902173b5c4283b315c6def6f13c31 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent starting tablet: real 0.124s	user 0.005s	sys 0.005s
I20260709 13:16:44.509141  8830 tablet_service.cc:1511] Processing CreateTablet for tablet c17f01b356e04590838cc6e6bb27bf64 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:16:44.510553  8830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c17f01b356e04590838cc6e6bb27bf64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.511831  9050 raft_consensus.cc:493] T f46053ed2641458a87c97152e4979c35 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.512364  9050 raft_consensus.cc:515] T f46053ed2641458a87c97152e4979c35 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:44.514714  9050 leader_election.cc:290] T f46053ed2641458a87c97152e4979c35 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:44.516531  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46053ed2641458a87c97152e4979c35" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:44.516841  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46053ed2641458a87c97152e4979c35" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:44.517323  8993 raft_consensus.cc:2468] T f46053ed2641458a87c97152e4979c35 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 0.
W20260709 13:16:44.518591  8736 leader_election.cc:343] T f46053ed2641458a87c97152e4979c35 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:44.503688  9039 tablet_bootstrap.cc:492] T 1d5284f5b067413e9fc2a383cc318735 P 7d3072f2af0b481d94ed70632b90e8c6: Bootstrap starting.
I20260709 13:16:44.519200  8733 leader_election.cc:304] T f46053ed2641458a87c97152e4979c35 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243, e8bb7e1240f44fda8b83e4c124852032; no voters: 43c6faa9496d44dda6b6eaed09cdfd12
I20260709 13:16:44.520576  9050 raft_consensus.cc:2804] T f46053ed2641458a87c97152e4979c35 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:44.520998  9050 raft_consensus.cc:493] T f46053ed2641458a87c97152e4979c35 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.521355  9050 raft_consensus.cc:3060] T f46053ed2641458a87c97152e4979c35 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:44.534890  8976 tablet_service.cc:1511] Processing CreateTablet for tablet 5a26acd2175646e3a53b493571852af4 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:16:44.536495  8976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a26acd2175646e3a53b493571852af4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.541520  9039 tablet_bootstrap.cc:654] T 1d5284f5b067413e9fc2a383cc318735 P 7d3072f2af0b481d94ed70632b90e8c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.548722  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f0c32d9abf04206a6f08210b3a30794" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:44.550763  9042 tablet_bootstrap.cc:492] T f46053ed2641458a87c97152e4979c35 P 43c6faa9496d44dda6b6eaed09cdfd12: No bootstrap required, opened a new log
I20260709 13:16:44.550633  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "734d16820c5640729de24c6edf4c5ed8" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
I20260709 13:16:44.551640  9042 ts_tablet_manager.cc:1403] T f46053ed2641458a87c97152e4979c35 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent bootstrapping tablet: real 0.265s	user 0.027s	sys 0.008s
I20260709 13:16:44.551136  8667 catalog_manager.cc:5697] T 734d16820c5640729de24c6edf4c5ed8 P 7d3072f2af0b481d94ed70632b90e8c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194). New cstate: current_term: 1 leader_uuid: "7d3072f2af0b481d94ed70632b90e8c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:44.554490  8808 leader_election.cc:343] T 3f0c32d9abf04206a6f08210b3a30794 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:44.560272  8834 tablet_service.cc:1511] Processing CreateTablet for tablet 5a26acd2175646e3a53b493571852af4 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:16:44.561846  8834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a26acd2175646e3a53b493571852af4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.564983  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46053ed2641458a87c97152e4979c35" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:44.569255  8754 tablet_service.cc:1511] Processing CreateTablet for tablet 5a26acd2175646e3a53b493571852af4 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:16:44.569995  9050 raft_consensus.cc:515] T f46053ed2641458a87c97152e4979c35 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:44.570938  8754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a26acd2175646e3a53b493571852af4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.571830  8769 raft_consensus.cc:2393] T f46053ed2641458a87c97152e4979c35 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bb7e1240f44fda8b83e4c124852032 in current term 1: Already voted for candidate 895d3c58761f427c9c5b3cb41246c243 in this term.
I20260709 13:16:44.572796  8906 tablet_service.cc:1511] Processing CreateTablet for tablet dde08046aca642488918d1f2b978c126 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:16:44.574361  8906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dde08046aca642488918d1f2b978c126. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.574657  8808 leader_election.cc:304] T 3f0c32d9abf04206a6f08210b3a30794 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6; no voters: 895d3c58761f427c9c5b3cb41246c243, e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:44.575963  9044 raft_consensus.cc:2749] T 3f0c32d9abf04206a6f08210b3a30794 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:44.578248  9042 raft_consensus.cc:359] T f46053ed2641458a87c97152e4979c35 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:44.579373  9042 raft_consensus.cc:385] T f46053ed2641458a87c97152e4979c35 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.576191  8958 leader_election.cc:304] T f46053ed2641458a87c97152e4979c35 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bb7e1240f44fda8b83e4c124852032; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:44.581197  9049 raft_consensus.cc:3060] T f46053ed2641458a87c97152e4979c35 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:44.584858  8808 leader_election.cc:343] T 734d16820c5640729de24c6edf4c5ed8 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:44.589975  8982 tablet_service.cc:1511] Processing CreateTablet for tablet dde08046aca642488918d1f2b978c126 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:16:44.591662  8757 tablet_service.cc:1511] Processing CreateTablet for tablet dde08046aca642488918d1f2b978c126 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:16:44.592708  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46053ed2641458a87c97152e4979c35" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:16:44.594338  8909 tablet_service.cc:1511] Processing CreateTablet for tablet 51992816e23f4cf99d31cec60fa429b9 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:16:44.595724  8909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51992816e23f4cf99d31cec60fa429b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.595165  8832 tablet_service.cc:1511] Processing CreateTablet for tablet 51992816e23f4cf99d31cec60fa429b9 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:16:44.597024  8832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51992816e23f4cf99d31cec60fa429b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.598989  8982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dde08046aca642488918d1f2b978c126. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.614585  8845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21893ae95aed4157a65823826a6badf0" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:44.617434  8757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dde08046aca642488918d1f2b978c126. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.618225  8979 tablet_service.cc:1511] Processing CreateTablet for tablet 51992816e23f4cf99d31cec60fa429b9 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:16:44.579793  9042 raft_consensus.cc:740] T f46053ed2641458a87c97152e4979c35 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Initialized, Role: FOLLOWER
W20260709 13:16:44.626350  8957 leader_election.cc:343] T 21893ae95aed4157a65823826a6badf0 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:44.626994  8957 leader_election.cc:304] T 21893ae95aed4157a65823826a6badf0 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bb7e1240f44fda8b83e4c124852032; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6
I20260709 13:16:44.626583  8979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51992816e23f4cf99d31cec60fa429b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.629944  9038 tablet_bootstrap.cc:492] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 895d3c58761f427c9c5b3cb41246c243: No bootstrap required, opened a new log
I20260709 13:16:44.630527  9038 ts_tablet_manager.cc:1403] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.404s	user 0.031s	sys 0.029s
I20260709 13:16:44.638696  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "734d16820c5640729de24c6edf4c5ed8" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
W20260709 13:16:44.640843  8882 leader_election.cc:343] T 734d16820c5640729de24c6edf4c5ed8 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:44.641436  8882 leader_election.cc:304] T 734d16820c5640729de24c6edf4c5ed8 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12; no voters: 7d3072f2af0b481d94ed70632b90e8c6, e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:44.642395  9052 raft_consensus.cc:2749] T 734d16820c5640729de24c6edf4c5ed8 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:44.639353  8755 tablet_service.cc:1511] Processing CreateTablet for tablet 6fa028ad690c4f3c94ec7c6443a3f1d3 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:16:44.634357  9038 raft_consensus.cc:359] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:44.646780  9050 leader_election.cc:290] T f46053ed2641458a87c97152e4979c35 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 election: Requested vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:44.644332  9049 raft_consensus.cc:2749] T f46053ed2641458a87c97152e4979c35 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:44.647030  8978 tablet_service.cc:1511] Processing CreateTablet for tablet f3abbeb71eba411bb6dfec800d3bd9c0 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:16:44.647374  8755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fa028ad690c4f3c94ec7c6443a3f1d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.648499  8978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3abbeb71eba411bb6dfec800d3bd9c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.645721  9042 consensus_queue.cc:260] T f46053ed2641458a87c97152e4979c35 P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:44.647962  9049 raft_consensus.cc:2749] T 21893ae95aed4157a65823826a6badf0 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:44.651964  8903 tablet_service.cc:1511] Processing CreateTablet for tablet 6fa028ad690c4f3c94ec7c6443a3f1d3 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:16:44.652577  8835 tablet_service.cc:1511] Processing CreateTablet for tablet f3abbeb71eba411bb6dfec800d3bd9c0 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:16:44.653474  8903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fa028ad690c4f3c94ec7c6443a3f1d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.653518  9042 ts_tablet_manager.cc:1434] T f46053ed2641458a87c97152e4979c35 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent starting tablet: real 0.101s	user 0.003s	sys 0.006s
I20260709 13:16:44.654306  8835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3abbeb71eba411bb6dfec800d3bd9c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.654799  9042 tablet_bootstrap.cc:492] T 932e5cbccd33414f8b05280505fd8bc7 P 43c6faa9496d44dda6b6eaed09cdfd12: Bootstrap starting.
I20260709 13:16:44.657490  8760 tablet_service.cc:1511] Processing CreateTablet for tablet f3abbeb71eba411bb6dfec800d3bd9c0 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:16:44.658833  8760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3abbeb71eba411bb6dfec800d3bd9c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.660518  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46053ed2641458a87c97152e4979c35" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
I20260709 13:16:44.662556  8919 raft_consensus.cc:3060] T f46053ed2641458a87c97152e4979c35 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:44.663086  9040 tablet_bootstrap.cc:492] T 734d16820c5640729de24c6edf4c5ed8 P e8bb7e1240f44fda8b83e4c124852032: No bootstrap required, opened a new log
I20260709 13:16:44.663798  9040 ts_tablet_manager.cc:1403] T 734d16820c5640729de24c6edf4c5ed8 P e8bb7e1240f44fda8b83e4c124852032: Time spent bootstrapping tablet: real 0.460s	user 0.044s	sys 0.063s
I20260709 13:16:44.671644  9039 tablet_bootstrap.cc:492] T 1d5284f5b067413e9fc2a383cc318735 P 7d3072f2af0b481d94ed70632b90e8c6: No bootstrap required, opened a new log
I20260709 13:16:44.672297  9039 ts_tablet_manager.cc:1403] T 1d5284f5b067413e9fc2a383cc318735 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent bootstrapping tablet: real 0.169s	user 0.007s	sys 0.017s
I20260709 13:16:44.685305  8905 tablet_service.cc:1511] Processing CreateTablet for tablet 68650af2b1894208a4cc0a1c6ddf880b (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:16:44.686848  8905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68650af2b1894208a4cc0a1c6ddf880b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.693004  9039 raft_consensus.cc:359] T 1d5284f5b067413e9fc2a383cc318735 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:44.693907  9039 raft_consensus.cc:385] T 1d5284f5b067413e9fc2a383cc318735 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.694242  9039 raft_consensus.cc:740] T 1d5284f5b067413e9fc2a383cc318735 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.668078  9038 raft_consensus.cc:385] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.701858  9038 raft_consensus.cc:740] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.695098  9039 consensus_queue.cc:260] T 1d5284f5b067413e9fc2a383cc318735 P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:44.667488  9040 raft_consensus.cc:359] T 734d16820c5640729de24c6edf4c5ed8 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:44.699278  8919 raft_consensus.cc:2468] T f46053ed2641458a87c97152e4979c35 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 1.
I20260709 13:16:44.695663  8830 tablet_service.cc:1511] Processing CreateTablet for tablet 6fa028ad690c4f3c94ec7c6443a3f1d3 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:16:44.715710  8830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fa028ad690c4f3c94ec7c6443a3f1d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.715850  8982 tablet_service.cc:1511] Processing CreateTablet for tablet 68650af2b1894208a4cc0a1c6ddf880b (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:16:44.717278  8982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68650af2b1894208a4cc0a1c6ddf880b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.722198  8992 raft_consensus.cc:2468] T f46053ed2641458a87c97152e4979c35 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 1.
I20260709 13:16:44.706550  9038 consensus_queue.cc:260] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:44.736343  8733 leader_election.cc:304] T f46053ed2641458a87c97152e4979c35 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:16:44.737370  9050 raft_consensus.cc:2804] T f46053ed2641458a87c97152e4979c35 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:44.737973  9050 raft_consensus.cc:697] T f46053ed2641458a87c97152e4979c35 P 895d3c58761f427c9c5b3cb41246c243 [term 1 LEADER]: Becoming Leader. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Running, Role: LEADER
I20260709 13:16:44.738920  9050 consensus_queue.cc:237] T f46053ed2641458a87c97152e4979c35 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:44.740003  8757 tablet_service.cc:1511] Processing CreateTablet for tablet 68650af2b1894208a4cc0a1c6ddf880b (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:16:44.741622  8757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68650af2b1894208a4cc0a1c6ddf880b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.710942  9040 raft_consensus.cc:385] T 734d16820c5640729de24c6edf4c5ed8 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.742609  9040 raft_consensus.cc:740] T 734d16820c5640729de24c6edf4c5ed8 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.733587  9042 tablet_bootstrap.cc:654] T 932e5cbccd33414f8b05280505fd8bc7 P 43c6faa9496d44dda6b6eaed09cdfd12: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.743520  9040 consensus_queue.cc:260] T 734d16820c5640729de24c6edf4c5ed8 P e8bb7e1240f44fda8b83e4c124852032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:44.746207  9040 ts_tablet_manager.cc:1434] T 734d16820c5640729de24c6edf4c5ed8 P e8bb7e1240f44fda8b83e4c124852032: Time spent starting tablet: real 0.082s	user 0.004s	sys 0.002s
W20260709 13:16:44.709465  8957 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:35315, user_credentials={real_user=slave}} blocked reactor thread for 84148.4us
I20260709 13:16:44.737413  9038 ts_tablet_manager.cc:1434] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.107s	user 0.009s	sys 0.000s
I20260709 13:16:44.749161  9038 tablet_bootstrap.cc:492] T ef723f9c640849d3890c61c07ffd0378 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:44.778976  9038 tablet_bootstrap.cc:654] T ef723f9c640849d3890c61c07ffd0378 P 895d3c58761f427c9c5b3cb41246c243: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.781872  8835 tablet_service.cc:1511] Processing CreateTablet for tablet 55bac44fd5a3462593ab47f6b6f44c6e (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:16:44.794402  8835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55bac44fd5a3462593ab47f6b6f44c6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.798111  9039 ts_tablet_manager.cc:1434] T 1d5284f5b067413e9fc2a383cc318735 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent starting tablet: real 0.125s	user 0.007s	sys 0.001s
I20260709 13:16:44.797756  8905 tablet_service.cc:1511] Processing CreateTablet for tablet 55bac44fd5a3462593ab47f6b6f44c6e (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:16:44.808670  8982 tablet_service.cc:1511] Processing CreateTablet for tablet 55bac44fd5a3462593ab47f6b6f44c6e (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:16:44.810353  8982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55bac44fd5a3462593ab47f6b6f44c6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.799455  8905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55bac44fd5a3462593ab47f6b6f44c6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.812875  9040 tablet_bootstrap.cc:492] T 4e1e1e84d68946d682e0944fbd3c51a8 P e8bb7e1240f44fda8b83e4c124852032: Bootstrap starting.
I20260709 13:16:44.799431  9039 tablet_bootstrap.cc:492] T 7bcde3fdb9314ca4b3422d395a673be5 P 7d3072f2af0b481d94ed70632b90e8c6: Bootstrap starting.
I20260709 13:16:44.818193  9042 tablet_bootstrap.cc:492] T 932e5cbccd33414f8b05280505fd8bc7 P 43c6faa9496d44dda6b6eaed09cdfd12: No bootstrap required, opened a new log
I20260709 13:16:44.824409  8760 tablet_service.cc:1511] Processing CreateTablet for tablet cc6e2639db63487cae6a125c8d5fe1d8 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:16:44.827669  9042 ts_tablet_manager.cc:1403] T 932e5cbccd33414f8b05280505fd8bc7 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent bootstrapping tablet: real 0.173s	user 0.017s	sys 0.009s
I20260709 13:16:44.829198  8906 tablet_service.cc:1511] Processing CreateTablet for tablet cc6e2639db63487cae6a125c8d5fe1d8 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:16:44.832891  8906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc6e2639db63487cae6a125c8d5fe1d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.834049  9038 tablet_bootstrap.cc:492] T ef723f9c640849d3890c61c07ffd0378 P 895d3c58761f427c9c5b3cb41246c243: No bootstrap required, opened a new log
I20260709 13:16:44.834693  9038 ts_tablet_manager.cc:1403] T ef723f9c640849d3890c61c07ffd0378 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.086s	user 0.009s	sys 0.013s
I20260709 13:16:44.834888  8978 tablet_service.cc:1511] Processing CreateTablet for tablet 69e5f8bfdb5a46808e713e051a38866d (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:16:44.837200  8754 tablet_service.cc:1511] Processing CreateTablet for tablet 69e5f8bfdb5a46808e713e051a38866d (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:16:44.838063  9038 raft_consensus.cc:359] T ef723f9c640849d3890c61c07ffd0378 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:44.838840  9038 raft_consensus.cc:385] T ef723f9c640849d3890c61c07ffd0378 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.839161  9038 raft_consensus.cc:740] T ef723f9c640849d3890c61c07ffd0378 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.839473  8754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69e5f8bfdb5a46808e713e051a38866d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.840405  8830 tablet_service.cc:1511] Processing CreateTablet for tablet cc6e2639db63487cae6a125c8d5fe1d8 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:16:44.841776  8830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc6e2639db63487cae6a125c8d5fe1d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.847580  8760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc6e2639db63487cae6a125c8d5fe1d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.837759  9042 raft_consensus.cc:359] T 932e5cbccd33414f8b05280505fd8bc7 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:44.860538  9042 raft_consensus.cc:385] T 932e5cbccd33414f8b05280505fd8bc7 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.850558  9048 consensus_queue.cc:1048] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:44.874558  9042 raft_consensus.cc:740] T 932e5cbccd33414f8b05280505fd8bc7 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.846366  8978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69e5f8bfdb5a46808e713e051a38866d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.874068  8909 tablet_service.cc:1511] Processing CreateTablet for tablet 9fdcbb0a74a64826ab0665c349b16200 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:16:44.870545  9039 tablet_bootstrap.cc:654] T 7bcde3fdb9314ca4b3422d395a673be5 P 7d3072f2af0b481d94ed70632b90e8c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.869441  8834 tablet_service.cc:1511] Processing CreateTablet for tablet 69e5f8bfdb5a46808e713e051a38866d (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:16:44.845976  9038 consensus_queue.cc:260] T ef723f9c640849d3890c61c07ffd0378 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:44.876595  9044 raft_consensus.cc:493] T d46902173b5c4283b315c6def6f13c31 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.876861  8982 tablet_service.cc:1511] Processing CreateTablet for tablet 9fdcbb0a74a64826ab0665c349b16200 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:16:44.884320  9048 raft_consensus.cc:493] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.891784  9048 raft_consensus.cc:515] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:44.892295  9044 raft_consensus.cc:515] T d46902173b5c4283b315c6def6f13c31 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:44.894662  9044 leader_election.cc:290] T d46902173b5c4283b315c6def6f13c31 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:44.884438  8909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fdcbb0a74a64826ab0665c349b16200. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.895346  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "485b2d9b05744b4f9a22e8f0e8b66e0d" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:44.896178  8834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69e5f8bfdb5a46808e713e051a38866d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:16:44.897531  8736 leader_election.cc:343] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:44.898492  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46902173b5c4283b315c6def6f13c31" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
W20260709 13:16:44.899845  8811 leader_election.cc:343] T d46902173b5c4283b315c6def6f13c31 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:44.901105  9048 leader_election.cc:290] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
W20260709 13:16:44.903694  8733 consensus_peers.cc:597] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243 -> Peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Couldn't send request to peer e8bb7e1240f44fda8b83e4c124852032. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:44.905220  9038 ts_tablet_manager.cc:1434] T ef723f9c640849d3890c61c07ffd0378 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.070s	user 0.005s	sys 0.005s
I20260709 13:16:44.906454  9038 tablet_bootstrap.cc:492] T 3f0c32d9abf04206a6f08210b3a30794 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:44.906711  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "485b2d9b05744b4f9a22e8f0e8b66e0d" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:44.909657  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46902173b5c4283b315c6def6f13c31" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
W20260709 13:16:44.911405  8810 leader_election.cc:343] T d46902173b5c4283b315c6def6f13c31 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:44.910831  8666 catalog_manager.cc:5697] T f46053ed2641458a87c97152e4979c35 P 895d3c58761f427c9c5b3cb41246c243 reported cstate change: term changed from 0 to 1, leader changed from <none> to 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "895d3c58761f427c9c5b3cb41246c243" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:44.911921  8810 leader_election.cc:304] T d46902173b5c4283b315c6def6f13c31 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:44.912032  9042 consensus_queue.cc:260] T 932e5cbccd33414f8b05280505fd8bc7 P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:44.913164  9044 raft_consensus.cc:2749] T d46902173b5c4283b315c6def6f13c31 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:44.914783  9042 ts_tablet_manager.cc:1434] T 932e5cbccd33414f8b05280505fd8bc7 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent starting tablet: real 0.085s	user 0.004s	sys 0.003s
W20260709 13:16:44.915412  8733 leader_election.cc:343] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:44.905230  9040 tablet_bootstrap.cc:654] T 4e1e1e84d68946d682e0944fbd3c51a8 P e8bb7e1240f44fda8b83e4c124852032: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.917235  8733 leader_election.cc:304] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:44.917701  8982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fdcbb0a74a64826ab0665c349b16200. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.916503  8757 tablet_service.cc:1511] Processing CreateTablet for tablet 9fdcbb0a74a64826ab0665c349b16200 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:16:44.919314  8757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fdcbb0a74a64826ab0665c349b16200. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.925748  9044 raft_consensus.cc:493] T 1d5284f5b067413e9fc2a383cc318735 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.926537  9044 raft_consensus.cc:515] T 1d5284f5b067413e9fc2a383cc318735 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:44.929462  9044 leader_election.cc:290] T 1d5284f5b067413e9fc2a383cc318735 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:44.930845  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5284f5b067413e9fc2a383cc318735" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
W20260709 13:16:44.932909  8811 leader_election.cc:343] T 1d5284f5b067413e9fc2a383cc318735 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:44.940753  8832 tablet_service.cc:1511] Processing CreateTablet for tablet 278f12b812a8473f8e3fddc73feabb62 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:16:44.942219  8832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 278f12b812a8473f8e3fddc73feabb62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.939105  9072 consensus_queue.cc:1048] T 734d16820c5640729de24c6edf4c5ed8 P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:44.945967  9042 tablet_bootstrap.cc:492] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12: Bootstrap starting.
I20260709 13:16:44.947400  9048 raft_consensus.cc:2749] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:44.950250  9052 raft_consensus.cc:493] T 932e5cbccd33414f8b05280505fd8bc7 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.950814  9052 raft_consensus.cc:515] T 932e5cbccd33414f8b05280505fd8bc7 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:44.956856  9052 leader_election.cc:290] T 932e5cbccd33414f8b05280505fd8bc7 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:44.958742  8845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932e5cbccd33414f8b05280505fd8bc7" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:44.961094  8974 tablet_service.cc:1511] Processing CreateTablet for tablet 278f12b812a8473f8e3fddc73feabb62 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:16:44.962605  8974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 278f12b812a8473f8e3fddc73feabb62. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:16:44.964474  8883 leader_election.cc:343] T 932e5cbccd33414f8b05280505fd8bc7 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:44.974882  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5284f5b067413e9fc2a383cc318735" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:44.976629  9038 tablet_bootstrap.cc:654] T 3f0c32d9abf04206a6f08210b3a30794 P 895d3c58761f427c9c5b3cb41246c243: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:44.997974  8810 leader_election.cc:343] T 1d5284f5b067413e9fc2a383cc318735 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:44.998603  8810 leader_election.cc:304] T 1d5284f5b067413e9fc2a383cc318735 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:44.999506  9044 raft_consensus.cc:2749] T 1d5284f5b067413e9fc2a383cc318735 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:45.002394  8903 tablet_service.cc:1511] Processing CreateTablet for tablet 278f12b812a8473f8e3fddc73feabb62 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:16:45.004014  8903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 278f12b812a8473f8e3fddc73feabb62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:45.012974  9039 tablet_bootstrap.cc:492] T 7bcde3fdb9314ca4b3422d395a673be5 P 7d3072f2af0b481d94ed70632b90e8c6: No bootstrap required, opened a new log
I20260709 13:16:45.013661  9039 ts_tablet_manager.cc:1403] T 7bcde3fdb9314ca4b3422d395a673be5 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent bootstrapping tablet: real 0.214s	user 0.008s	sys 0.008s
I20260709 13:16:45.016662  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932e5cbccd33414f8b05280505fd8bc7" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:45.024150  9039 raft_consensus.cc:359] T 7bcde3fdb9314ca4b3422d395a673be5 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:45.026966  9039 raft_consensus.cc:385] T 7bcde3fdb9314ca4b3422d395a673be5 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.027271  9039 raft_consensus.cc:740] T 7bcde3fdb9314ca4b3422d395a673be5 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Initialized, Role: FOLLOWER
W20260709 13:16:45.027907  8884 leader_election.cc:343] T 932e5cbccd33414f8b05280505fd8bc7 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:45.033860  8884 leader_election.cc:304] T 932e5cbccd33414f8b05280505fd8bc7 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12; no voters: 7d3072f2af0b481d94ed70632b90e8c6, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:45.034973  9052 raft_consensus.cc:2749] T 932e5cbccd33414f8b05280505fd8bc7 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:45.035627  8835 tablet_service.cc:1511] Processing CreateTablet for tablet 45613c5d357b40b8af0ced6c8725c559 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:16:45.037072  8835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45613c5d357b40b8af0ced6c8725c559. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:45.038398  8905 tablet_service.cc:1511] Processing CreateTablet for tablet 45613c5d357b40b8af0ced6c8725c559 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:16:45.039778  8905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45613c5d357b40b8af0ced6c8725c559. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:45.047343  9040 tablet_bootstrap.cc:492] T 4e1e1e84d68946d682e0944fbd3c51a8 P e8bb7e1240f44fda8b83e4c124852032: No bootstrap required, opened a new log
I20260709 13:16:45.048032  9040 ts_tablet_manager.cc:1403] T 4e1e1e84d68946d682e0944fbd3c51a8 P e8bb7e1240f44fda8b83e4c124852032: Time spent bootstrapping tablet: real 0.235s	user 0.034s	sys 0.036s
I20260709 13:16:45.048717  9039 consensus_queue.cc:260] T 7bcde3fdb9314ca4b3422d395a673be5 P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:45.060738  8982 tablet_service.cc:1511] Processing CreateTablet for tablet c44c5aa220814dfd9fc9bb07cd5b1cf7 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:16:45.067168  8982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c44c5aa220814dfd9fc9bb07cd5b1cf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:45.051331  9039 ts_tablet_manager.cc:1434] T 7bcde3fdb9314ca4b3422d395a673be5 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260709 13:16:45.056492  9042 tablet_bootstrap.cc:654] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.052850  9082 raft_consensus.cc:493] T 734d16820c5640729de24c6edf4c5ed8 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.051343  9040 raft_consensus.cc:359] T 4e1e1e84d68946d682e0944fbd3c51a8 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:45.059701  8754 tablet_service.cc:1511] Processing CreateTablet for tablet 45613c5d357b40b8af0ced6c8725c559 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:16:45.092474  9040 raft_consensus.cc:385] T 4e1e1e84d68946d682e0944fbd3c51a8 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.108534  8757 tablet_service.cc:1511] Processing CreateTablet for tablet c44c5aa220814dfd9fc9bb07cd5b1cf7 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:16:45.109263  8835 tablet_service.cc:1511] Processing CreateTablet for tablet c44c5aa220814dfd9fc9bb07cd5b1cf7 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:16:45.109839  8757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c44c5aa220814dfd9fc9bb07cd5b1cf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:45.101871  8906 tablet_service.cc:1511] Processing CreateTablet for tablet 097c705b65de4abe884afdb1fcaaa054 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:16:45.108004  9039 tablet_bootstrap.cc:492] T 4e1e1e84d68946d682e0944fbd3c51a8 P 7d3072f2af0b481d94ed70632b90e8c6: Bootstrap starting.
I20260709 13:16:45.110462  8835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c44c5aa220814dfd9fc9bb07cd5b1cf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:45.114194  8906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 097c705b65de4abe884afdb1fcaaa054. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:45.108531  9040 raft_consensus.cc:740] T 4e1e1e84d68946d682e0944fbd3c51a8 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.114943  8754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45613c5d357b40b8af0ced6c8725c559. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:45.117625  9038 tablet_bootstrap.cc:492] T 3f0c32d9abf04206a6f08210b3a30794 P 895d3c58761f427c9c5b3cb41246c243: No bootstrap required, opened a new log
I20260709 13:16:45.087812  9082 raft_consensus.cc:515] T 734d16820c5640729de24c6edf4c5ed8 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:45.141773  9082 leader_election.cc:290] T 734d16820c5640729de24c6edf4c5ed8 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:45.144507  8845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "734d16820c5640729de24c6edf4c5ed8" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:45.148495  8992 raft_consensus.cc:3060] T 734d16820c5640729de24c6edf4c5ed8 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:45.148917  9038 ts_tablet_manager.cc:1403] T 3f0c32d9abf04206a6f08210b3a30794 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.243s	user 0.028s	sys 0.004s
I20260709 13:16:45.159780  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "734d16820c5640729de24c6edf4c5ed8" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:45.160691  8760 tablet_service.cc:1511] Processing CreateTablet for tablet 097c705b65de4abe884afdb1fcaaa054 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:16:45.162217  8760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 097c705b65de4abe884afdb1fcaaa054. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:45.152439  9040 consensus_queue.cc:260] T 4e1e1e84d68946d682e0944fbd3c51a8 P e8bb7e1240f44fda8b83e4c124852032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:45.166791  9038 raft_consensus.cc:359] T 3f0c32d9abf04206a6f08210b3a30794 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:45.168388  9038 raft_consensus.cc:385] T 3f0c32d9abf04206a6f08210b3a30794 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.168704  9038 raft_consensus.cc:740] T 3f0c32d9abf04206a6f08210b3a30794 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.166703  8959 leader_election.cc:304] T 734d16820c5640729de24c6edf4c5ed8 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bb7e1240f44fda8b83e4c124852032; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6
I20260709 13:16:45.174525  9040 ts_tablet_manager.cc:1434] T 4e1e1e84d68946d682e0944fbd3c51a8 P e8bb7e1240f44fda8b83e4c124852032: Time spent starting tablet: real 0.126s	user 0.007s	sys 0.004s
I20260709 13:16:45.183221  9082 raft_consensus.cc:2749] T 734d16820c5640729de24c6edf4c5ed8 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:45.188721  9038 consensus_queue.cc:260] T 3f0c32d9abf04206a6f08210b3a30794 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:45.191519  9038 ts_tablet_manager.cc:1434] T 3f0c32d9abf04206a6f08210b3a30794 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.000s
W20260709 13:16:45.198498  8716 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:45.204250  9038 tablet_bootstrap.cc:492] T 4e1e1e84d68946d682e0944fbd3c51a8 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:45.200240  8974 tablet_service.cc:1511] Processing CreateTablet for tablet 097c705b65de4abe884afdb1fcaaa054 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:16:45.206221  8835 tablet_service.cc:1511] Processing CreateTablet for tablet 2accf622ad6243e3b7b496fb979fe9d4 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:16:45.207226  8974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 097c705b65de4abe884afdb1fcaaa054. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:45.207569  8835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2accf622ad6243e3b7b496fb979fe9d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:45.202582  9042 tablet_bootstrap.cc:492] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12: No bootstrap required, opened a new log
I20260709 13:16:45.210779  9042 ts_tablet_manager.cc:1403] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent bootstrapping tablet: real 0.295s	user 0.015s	sys 0.010s
I20260709 13:16:45.211759  9040 tablet_bootstrap.cc:492] T 485b2d9b05744b4f9a22e8f0e8b66e0d P e8bb7e1240f44fda8b83e4c124852032: Bootstrap starting.
I20260709 13:16:45.214126  9042 raft_consensus.cc:359] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:45.214951  9042 raft_consensus.cc:385] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.215308  9042 raft_consensus.cc:740] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.216485  9042 consensus_queue.cc:260] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:45.219151  9042 ts_tablet_manager.cc:1434] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:16:45.220364  9042 tablet_bootstrap.cc:492] T 197670bf2e8f4301b060ed8ef6862b22 P 43c6faa9496d44dda6b6eaed09cdfd12: Bootstrap starting.
I20260709 13:16:45.202281  9039 tablet_bootstrap.cc:654] T 4e1e1e84d68946d682e0944fbd3c51a8 P 7d3072f2af0b481d94ed70632b90e8c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.227366  8906 tablet_service.cc:1511] Processing CreateTablet for tablet 2accf622ad6243e3b7b496fb979fe9d4 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:16:45.228866  8906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2accf622ad6243e3b7b496fb979fe9d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:45.241945  8982 tablet_service.cc:1511] Processing CreateTablet for tablet 2accf622ad6243e3b7b496fb979fe9d4 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:16:45.243395  8982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2accf622ad6243e3b7b496fb979fe9d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:45.246780  9100 raft_consensus.cc:493] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.247596  9038 tablet_bootstrap.cc:654] T 4e1e1e84d68946d682e0944fbd3c51a8 P 895d3c58761f427c9c5b3cb41246c243: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.247375  9100 raft_consensus.cc:515] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:45.250641  9100 leader_election.cc:290] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:45.231323  9099 consensus_queue.cc:1048] T 734d16820c5640729de24c6edf4c5ed8 P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 13:16:45.252094  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "485b2d9b05744b4f9a22e8f0e8b66e0d" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:45.252898  8769 raft_consensus.cc:2468] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 0.
I20260709 13:16:45.254139  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "485b2d9b05744b4f9a22e8f0e8b66e0d" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:45.255947  9050 raft_consensus.cc:493] T 3f0c32d9abf04206a6f08210b3a30794 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.256515  9050 raft_consensus.cc:515] T 3f0c32d9abf04206a6f08210b3a30794 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:45.261757  8884 leader_election.cc:304] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243; no voters: 
I20260709 13:16:45.248476  9040 tablet_bootstrap.cc:654] T 485b2d9b05744b4f9a22e8f0e8b66e0d P e8bb7e1240f44fda8b83e4c124852032: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.262751  9100 raft_consensus.cc:2804] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:45.263141  9100 raft_consensus.cc:493] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.263491  9100 raft_consensus.cc:3060] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:45.263574  8882 leader_election.cc:343] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:45.267995  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f0c32d9abf04206a6f08210b3a30794" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
W20260709 13:16:45.271458  8733 leader_election.cc:343] T 3f0c32d9abf04206a6f08210b3a30794 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:45.273484  8760 tablet_service.cc:1511] Processing CreateTablet for tablet 4fd6605b785643deac78902ee4fc6896 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:16:45.274997  8760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fd6605b785643deac78902ee4fc6896. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:45.274557  9050 leader_election.cc:290] T 3f0c32d9abf04206a6f08210b3a30794 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:45.276280  9082 raft_consensus.cc:493] T 4e1e1e84d68946d682e0944fbd3c51a8 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.276851  9082 raft_consensus.cc:515] T 4e1e1e84d68946d682e0944fbd3c51a8 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:45.279569  9082 leader_election.cc:290] T 4e1e1e84d68946d682e0944fbd3c51a8 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:45.281440  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1e1e84d68946d682e0944fbd3c51a8" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:45.281857  9042 tablet_bootstrap.cc:654] T 197670bf2e8f4301b060ed8ef6862b22 P 43c6faa9496d44dda6b6eaed09cdfd12: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:45.283195  8958 leader_election.cc:343] T 4e1e1e84d68946d682e0944fbd3c51a8 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:45.287163  8835 tablet_service.cc:1511] Processing CreateTablet for tablet 4fd6605b785643deac78902ee4fc6896 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:16:45.288617  8835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fd6605b785643deac78902ee4fc6896. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:45.291788  9050 raft_consensus.cc:493] T ef723f9c640849d3890c61c07ffd0378 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.292474  9050 raft_consensus.cc:515] T ef723f9c640849d3890c61c07ffd0378 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:45.296064  9050 leader_election.cc:290] T ef723f9c640849d3890c61c07ffd0378 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:45.296999  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef723f9c640849d3890c61c07ffd0378" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
W20260709 13:16:45.298552  8736 leader_election.cc:343] T ef723f9c640849d3890c61c07ffd0378 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:45.312130  8905 tablet_service.cc:1511] Processing CreateTablet for tablet 4fd6605b785643deac78902ee4fc6896 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:16:45.313834  8905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fd6605b785643deac78902ee4fc6896. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:45.288450  9100 raft_consensus.cc:515] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:45.316990  9039 tablet_bootstrap.cc:492] T 4e1e1e84d68946d682e0944fbd3c51a8 P 7d3072f2af0b481d94ed70632b90e8c6: No bootstrap required, opened a new log
I20260709 13:16:45.326037  9039 ts_tablet_manager.cc:1403] T 4e1e1e84d68946d682e0944fbd3c51a8 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent bootstrapping tablet: real 0.231s	user 0.013s	sys 0.006s
I20260709 13:16:45.334100  9040 tablet_bootstrap.cc:492] T 485b2d9b05744b4f9a22e8f0e8b66e0d P e8bb7e1240f44fda8b83e4c124852032: No bootstrap required, opened a new log
I20260709 13:16:45.334764  9040 ts_tablet_manager.cc:1403] T 485b2d9b05744b4f9a22e8f0e8b66e0d P e8bb7e1240f44fda8b83e4c124852032: Time spent bootstrapping tablet: real 0.123s	user 0.006s	sys 0.007s
I20260709 13:16:45.333695  8760 tablet_service.cc:1511] Processing CreateTablet for tablet 675795627b9b4542805157dd7ec531cd (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:16:45.337900  8974 tablet_service.cc:1511] Processing CreateTablet for tablet 675795627b9b4542805157dd7ec531cd (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:16:45.339450  8974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 675795627b9b4542805157dd7ec531cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:45.337129  8760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 675795627b9b4542805157dd7ec531cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:45.343968  8903 tablet_service.cc:1511] Processing CreateTablet for tablet 45d9eb22dee8411b82eb768686e34604 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:16:45.344746  8835 tablet_service.cc:1511] Processing CreateTablet for tablet 675795627b9b4542805157dd7ec531cd (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:16:45.345465  8903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45d9eb22dee8411b82eb768686e34604. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:45.346033  8835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 675795627b9b4542805157dd7ec531cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:45.348573  9100 leader_election.cc:290] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Requested vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:45.348820  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "485b2d9b05744b4f9a22e8f0e8b66e0d" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
I20260709 13:16:45.350099  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "485b2d9b05744b4f9a22e8f0e8b66e0d" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243"
I20260709 13:16:45.356238  8769 raft_consensus.cc:3060] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:45.352083  8845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1e1e84d68946d682e0944fbd3c51a8" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
W20260709 13:16:45.361264  8882 leader_election.cc:343] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:45.364370  9048 consensus_queue.cc:1048] T f46053ed2641458a87c97152e4979c35 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:45.365453  9050 consensus_queue.cc:1048] T f46053ed2641458a87c97152e4979c35 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:45.370937  9040 raft_consensus.cc:359] T 485b2d9b05744b4f9a22e8f0e8b66e0d P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:45.371908  9040 raft_consensus.cc:385] T 485b2d9b05744b4f9a22e8f0e8b66e0d P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.372231  9040 raft_consensus.cc:740] T 485b2d9b05744b4f9a22e8f0e8b66e0d P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.373052  9040 consensus_queue.cc:260] T 485b2d9b05744b4f9a22e8f0e8b66e0d P e8bb7e1240f44fda8b83e4c124852032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:45.373744  8982 tablet_service.cc:1511] Processing CreateTablet for tablet 45d9eb22dee8411b82eb768686e34604 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:16:45.375205  8982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45d9eb22dee8411b82eb768686e34604. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:45.375576  9040 ts_tablet_manager.cc:1434] T 485b2d9b05744b4f9a22e8f0e8b66e0d P e8bb7e1240f44fda8b83e4c124852032: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.001s
I20260709 13:16:45.376720  9040 tablet_bootstrap.cc:492] T ab679ea0af724bd39f753eb407c73264 P e8bb7e1240f44fda8b83e4c124852032: Bootstrap starting.
W20260709 13:16:45.378177  8957 leader_election.cc:343] T 4e1e1e84d68946d682e0944fbd3c51a8 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:45.378793  8957 leader_election.cc:304] T 4e1e1e84d68946d682e0944fbd3c51a8 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bb7e1240f44fda8b83e4c124852032; no voters: 7d3072f2af0b481d94ed70632b90e8c6, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:45.379696  9082 raft_consensus.cc:2749] T 4e1e1e84d68946d682e0944fbd3c51a8 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:45.380926  9039 raft_consensus.cc:359] T 4e1e1e84d68946d682e0944fbd3c51a8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:45.382889  9039 raft_consensus.cc:385] T 4e1e1e84d68946d682e0944fbd3c51a8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.383627  9039 raft_consensus.cc:740] T 4e1e1e84d68946d682e0944fbd3c51a8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.385251  9038 tablet_bootstrap.cc:492] T 4e1e1e84d68946d682e0944fbd3c51a8 P 895d3c58761f427c9c5b3cb41246c243: No bootstrap required, opened a new log
I20260709 13:16:45.385197  8760 tablet_service.cc:1511] Processing CreateTablet for tablet 45d9eb22dee8411b82eb768686e34604 (DEFAULT_TABLE table=test-workload [id=4e46b05d68954a36b8c41216b65b1c39]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:16:45.385699  9042 tablet_bootstrap.cc:492] T 197670bf2e8f4301b060ed8ef6862b22 P 43c6faa9496d44dda6b6eaed09cdfd12: No bootstrap required, opened a new log
I20260709 13:16:45.389614  8760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45d9eb22dee8411b82eb768686e34604. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:45.388584  9040 tablet_bootstrap.cc:654] T ab679ea0af724bd39f753eb407c73264 P e8bb7e1240f44fda8b83e4c124852032: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.391814  9042 ts_tablet_manager.cc:1403] T 197670bf2e8f4301b060ed8ef6862b22 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent bootstrapping tablet: real 0.172s	user 0.022s	sys 0.004s
I20260709 13:16:45.390694  9038 ts_tablet_manager.cc:1403] T 4e1e1e84d68946d682e0944fbd3c51a8 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.186s	user 0.013s	sys 0.005s
I20260709 13:16:45.396624  8769 raft_consensus.cc:2468] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 1.
I20260709 13:16:45.405663  8845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f0c32d9abf04206a6f08210b3a30794" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:45.424492  8845 raft_consensus.cc:2468] T 3f0c32d9abf04206a6f08210b3a30794 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 0.
I20260709 13:16:45.407080  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef723f9c640849d3890c61c07ffd0378" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:45.408754  9099 raft_consensus.cc:493] T 7bcde3fdb9314ca4b3422d395a673be5 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.425923  8844 raft_consensus.cc:2468] T ef723f9c640849d3890c61c07ffd0378 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 0.
I20260709 13:16:45.421612  9082 raft_consensus.cc:493] T 485b2d9b05744b4f9a22e8f0e8b66e0d P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.427171  9082 raft_consensus.cc:515] T 485b2d9b05744b4f9a22e8f0e8b66e0d P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:45.430105  9082 leader_election.cc:290] T 485b2d9b05744b4f9a22e8f0e8b66e0d P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:45.423305  9038 raft_consensus.cc:359] T 4e1e1e84d68946d682e0944fbd3c51a8 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:45.425766  9099 raft_consensus.cc:515] T 7bcde3fdb9314ca4b3422d395a673be5 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:45.430666  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "485b2d9b05744b4f9a22e8f0e8b66e0d" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:45.431697  8917 raft_consensus.cc:2393] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bb7e1240f44fda8b83e4c124852032 in current term 1: Already voted for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in this term.
I20260709 13:16:45.419519  9042 raft_consensus.cc:359] T 197670bf2e8f4301b060ed8ef6862b22 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:45.434175  9042 raft_consensus.cc:385] T 197670bf2e8f4301b060ed8ef6862b22 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.435590  8884 leader_election.cc:304] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243; no voters: e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:45.437511  9100 raft_consensus.cc:2804] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:45.438910  9039 consensus_queue.cc:260] T 4e1e1e84d68946d682e0944fbd3c51a8 P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:45.438048  9100 raft_consensus.cc:697] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Becoming Leader. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Running, Role: LEADER
I20260709 13:16:45.441270  9100 consensus_queue.cc:237] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:45.439040  8734 leader_election.cc:304] T 3f0c32d9abf04206a6f08210b3a30794 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6, 895d3c58761f427c9c5b3cb41246c243; no voters: e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:45.432194  9038 raft_consensus.cc:385] T 4e1e1e84d68946d682e0944fbd3c51a8 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.449689  8734 leader_election.cc:304] T ef723f9c640849d3890c61c07ffd0378 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6, 895d3c58761f427c9c5b3cb41246c243; no voters: 43c6faa9496d44dda6b6eaed09cdfd12
I20260709 13:16:45.455679  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bcde3fdb9314ca4b3422d395a673be5" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
W20260709 13:16:45.457818  8811 leader_election.cc:343] T 7bcde3fdb9314ca4b3422d395a673be5 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:45.458940  9099 leader_election.cc:290] T 7bcde3fdb9314ca4b3422d395a673be5 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:45.447659  9048 raft_consensus.cc:2804] T 3f0c32d9abf04206a6f08210b3a30794 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:45.459923  9048 raft_consensus.cc:493] T 3f0c32d9abf04206a6f08210b3a30794 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.460450  9048 raft_consensus.cc:3060] T 3f0c32d9abf04206a6f08210b3a30794 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:45.465687  9039 ts_tablet_manager.cc:1434] T 4e1e1e84d68946d682e0944fbd3c51a8 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent starting tablet: real 0.139s	user 0.005s	sys 0.002s
I20260709 13:16:45.471683  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "485b2d9b05744b4f9a22e8f0e8b66e0d" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:45.473143  8769 raft_consensus.cc:2393] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bb7e1240f44fda8b83e4c124852032 in current term 1: Already voted for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in this term.
I20260709 13:16:45.475386  9050 raft_consensus.cc:2804] T ef723f9c640849d3890c61c07ffd0378 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:45.475942  9050 raft_consensus.cc:493] T ef723f9c640849d3890c61c07ffd0378 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.476325  9050 raft_consensus.cc:3060] T ef723f9c640849d3890c61c07ffd0378 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:45.475432  9039 tablet_bootstrap.cc:492] T 67ea3c8e514f41549c3a96b74a9b5be9 P 7d3072f2af0b481d94ed70632b90e8c6: Bootstrap starting.
I20260709 13:16:45.447974  9038 raft_consensus.cc:740] T 4e1e1e84d68946d682e0944fbd3c51a8 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.479732  8958 leader_election.cc:304] T 485b2d9b05744b4f9a22e8f0e8b66e0d P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bb7e1240f44fda8b83e4c124852032; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:45.481209  9082 raft_consensus.cc:3060] T 485b2d9b05744b4f9a22e8f0e8b66e0d P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:45.438328  9042 raft_consensus.cc:740] T 197670bf2e8f4301b060ed8ef6862b22 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.482591  9042 consensus_queue.cc:260] T 197670bf2e8f4301b060ed8ef6862b22 P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:45.486330  9042 ts_tablet_manager.cc:1434] T 197670bf2e8f4301b060ed8ef6862b22 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent starting tablet: real 0.070s	user 0.008s	sys 0.000s
I20260709 13:16:45.480540  9038 consensus_queue.cc:260] T 4e1e1e84d68946d682e0944fbd3c51a8 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:45.488763  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bcde3fdb9314ca4b3422d395a673be5" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:45.497829  9082 raft_consensus.cc:2749] T 485b2d9b05744b4f9a22e8f0e8b66e0d P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:45.501319  9038 ts_tablet_manager.cc:1434] T 4e1e1e84d68946d682e0944fbd3c51a8 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.081s	user 0.007s	sys 0.001s
I20260709 13:16:45.502808  9038 tablet_bootstrap.cc:492] T ed4d847e589942fcbf6dadbb578327f2 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:45.503786  9042 tablet_bootstrap.cc:492] T d46902173b5c4283b315c6def6f13c31 P 43c6faa9496d44dda6b6eaed09cdfd12: Bootstrap starting.
W20260709 13:16:45.520843  8810 leader_election.cc:343] T 7bcde3fdb9314ca4b3422d395a673be5 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:45.521468  8810 leader_election.cc:304] T 7bcde3fdb9314ca4b3422d395a673be5 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:45.524276  9099 raft_consensus.cc:2749] T 7bcde3fdb9314ca4b3422d395a673be5 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:45.531234  9038 tablet_bootstrap.cc:654] T ed4d847e589942fcbf6dadbb578327f2 P 895d3c58761f427c9c5b3cb41246c243: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.530947  8668 catalog_manager.cc:5697] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195). New cstate: current_term: 1 leader_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:45.534242  9042 tablet_bootstrap.cc:654] T d46902173b5c4283b315c6def6f13c31 P 43c6faa9496d44dda6b6eaed09cdfd12: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.539917  9039 tablet_bootstrap.cc:654] T 67ea3c8e514f41549c3a96b74a9b5be9 P 7d3072f2af0b481d94ed70632b90e8c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.518947  9050 raft_consensus.cc:515] T ef723f9c640849d3890c61c07ffd0378 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
W20260709 13:16:45.536010  8736 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37671, user_credentials={real_user=slave}} blocked reactor thread for 56453.8us
W20260709 13:16:45.535640  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:35315, user_credentials={real_user=slave}} blocked reactor thread for 87059.4us
I20260709 13:16:45.552577  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef723f9c640849d3890c61c07ffd0378" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:16:45.553002  9040 tablet_bootstrap.cc:492] T ab679ea0af724bd39f753eb407c73264 P e8bb7e1240f44fda8b83e4c124852032: No bootstrap required, opened a new log
I20260709 13:16:45.553815  9040 ts_tablet_manager.cc:1403] T ab679ea0af724bd39f753eb407c73264 P e8bb7e1240f44fda8b83e4c124852032: Time spent bootstrapping tablet: real 0.177s	user 0.038s	sys 0.038s
I20260709 13:16:45.554847  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef723f9c640849d3890c61c07ffd0378" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
I20260709 13:16:45.551046  9050 leader_election.cc:290] T ef723f9c640849d3890c61c07ffd0378 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 election: Requested vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:45.552945  9048 raft_consensus.cc:515] T 3f0c32d9abf04206a6f08210b3a30794 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:45.555560  8844 raft_consensus.cc:3060] T ef723f9c640849d3890c61c07ffd0378 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:45.559648  9048 leader_election.cc:290] T 3f0c32d9abf04206a6f08210b3a30794 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 election: Requested vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:45.560616  8845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f0c32d9abf04206a6f08210b3a30794" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
I20260709 13:16:45.560560  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f0c32d9abf04206a6f08210b3a30794" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
I20260709 13:16:45.561339  8845 raft_consensus.cc:3060] T 3f0c32d9abf04206a6f08210b3a30794 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:45.562682  8733 leader_election.cc:343] T 3f0c32d9abf04206a6f08210b3a30794 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:45.563763  9100 raft_consensus.cc:493] T 197670bf2e8f4301b060ed8ef6862b22 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.564499  9100 raft_consensus.cc:515] T 197670bf2e8f4301b060ed8ef6862b22 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:45.567436  9100 leader_election.cc:290] T 197670bf2e8f4301b060ed8ef6862b22 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:45.570168  8845 raft_consensus.cc:2468] T 3f0c32d9abf04206a6f08210b3a30794 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 1.
I20260709 13:16:45.570370  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "197670bf2e8f4301b060ed8ef6862b22" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
W20260709 13:16:45.570557  8736 leader_election.cc:343] T ef723f9c640849d3890c61c07ffd0378 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:45.571781  8734 leader_election.cc:304] T 3f0c32d9abf04206a6f08210b3a30794 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6, 895d3c58761f427c9c5b3cb41246c243; no voters: e8bb7e1240f44fda8b83e4c124852032
W20260709 13:16:45.572008  8883 leader_election.cc:343] T 197670bf2e8f4301b060ed8ef6862b22 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:45.572731  9048 raft_consensus.cc:2804] T 3f0c32d9abf04206a6f08210b3a30794 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:45.573247  9048 raft_consensus.cc:697] T 3f0c32d9abf04206a6f08210b3a30794 P 895d3c58761f427c9c5b3cb41246c243 [term 1 LEADER]: Becoming Leader. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Running, Role: LEADER
I20260709 13:16:45.573300  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "197670bf2e8f4301b060ed8ef6862b22" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:45.574311  9048 consensus_queue.cc:237] T 3f0c32d9abf04206a6f08210b3a30794 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
W20260709 13:16:45.574958  8882 leader_election.cc:343] T 197670bf2e8f4301b060ed8ef6862b22 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:45.575425  8882 leader_election.cc:304] T 197670bf2e8f4301b060ed8ef6862b22 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12; no voters: 7d3072f2af0b481d94ed70632b90e8c6, e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:45.576615  9100 raft_consensus.cc:2749] T 197670bf2e8f4301b060ed8ef6862b22 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:45.558984  9040 raft_consensus.cc:359] T ab679ea0af724bd39f753eb407c73264 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:45.586371  9040 raft_consensus.cc:385] T ab679ea0af724bd39f753eb407c73264 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.588049  9040 raft_consensus.cc:740] T ab679ea0af724bd39f753eb407c73264 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.590247  9039 tablet_bootstrap.cc:492] T 67ea3c8e514f41549c3a96b74a9b5be9 P 7d3072f2af0b481d94ed70632b90e8c6: No bootstrap required, opened a new log
I20260709 13:16:45.590799  9039 ts_tablet_manager.cc:1403] T 67ea3c8e514f41549c3a96b74a9b5be9 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent bootstrapping tablet: real 0.116s	user 0.007s	sys 0.011s
I20260709 13:16:45.592388  9042 tablet_bootstrap.cc:492] T d46902173b5c4283b315c6def6f13c31 P 43c6faa9496d44dda6b6eaed09cdfd12: No bootstrap required, opened a new log
I20260709 13:16:45.593009  9042 ts_tablet_manager.cc:1403] T d46902173b5c4283b315c6def6f13c31 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent bootstrapping tablet: real 0.106s	user 0.013s	sys 0.032s
I20260709 13:16:45.587033  8844 raft_consensus.cc:2468] T ef723f9c640849d3890c61c07ffd0378 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 1.
I20260709 13:16:45.594406  8734 leader_election.cc:304] T ef723f9c640849d3890c61c07ffd0378 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6, 895d3c58761f427c9c5b3cb41246c243; no voters: 43c6faa9496d44dda6b6eaed09cdfd12
I20260709 13:16:45.594157  9040 consensus_queue.cc:260] T ab679ea0af724bd39f753eb407c73264 P e8bb7e1240f44fda8b83e4c124852032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:45.596298  9042 raft_consensus.cc:359] T d46902173b5c4283b315c6def6f13c31 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:45.596490  9039 raft_consensus.cc:359] T 67ea3c8e514f41549c3a96b74a9b5be9 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:45.596933  9040 ts_tablet_manager.cc:1434] T ab679ea0af724bd39f753eb407c73264 P e8bb7e1240f44fda8b83e4c124852032: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 13:16:45.597309  9042 raft_consensus.cc:385] T d46902173b5c4283b315c6def6f13c31 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.597761  9042 raft_consensus.cc:740] T d46902173b5c4283b315c6def6f13c31 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.597321  9039 raft_consensus.cc:385] T 67ea3c8e514f41549c3a96b74a9b5be9 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.598507  9039 raft_consensus.cc:740] T 67ea3c8e514f41549c3a96b74a9b5be9 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.598678  9042 consensus_queue.cc:260] T d46902173b5c4283b315c6def6f13c31 P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:45.599231  9039 consensus_queue.cc:260] T 67ea3c8e514f41549c3a96b74a9b5be9 P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:45.600011  9038 tablet_bootstrap.cc:492] T ed4d847e589942fcbf6dadbb578327f2 P 895d3c58761f427c9c5b3cb41246c243: No bootstrap required, opened a new log
I20260709 13:16:45.600723  9048 raft_consensus.cc:2804] T ef723f9c640849d3890c61c07ffd0378 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:45.600750  9038 ts_tablet_manager.cc:1403] T ed4d847e589942fcbf6dadbb578327f2 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.098s	user 0.009s	sys 0.011s
I20260709 13:16:45.601540  9042 ts_tablet_manager.cc:1434] T d46902173b5c4283b315c6def6f13c31 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.003s
I20260709 13:16:45.602728  9042 tablet_bootstrap.cc:492] T 21893ae95aed4157a65823826a6badf0 P 43c6faa9496d44dda6b6eaed09cdfd12: Bootstrap starting.
I20260709 13:16:45.603572  9040 tablet_bootstrap.cc:492] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032: Bootstrap starting.
I20260709 13:16:45.601500  9048 raft_consensus.cc:697] T ef723f9c640849d3890c61c07ffd0378 P 895d3c58761f427c9c5b3cb41246c243 [term 1 LEADER]: Becoming Leader. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Running, Role: LEADER
I20260709 13:16:45.606051  9038 raft_consensus.cc:359] T ed4d847e589942fcbf6dadbb578327f2 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:45.608971  9038 raft_consensus.cc:385] T ed4d847e589942fcbf6dadbb578327f2 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.609325  9038 raft_consensus.cc:740] T ed4d847e589942fcbf6dadbb578327f2 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.610384  9038 consensus_queue.cc:260] T ed4d847e589942fcbf6dadbb578327f2 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:45.611332  9042 tablet_bootstrap.cc:654] T 21893ae95aed4157a65823826a6badf0 P 43c6faa9496d44dda6b6eaed09cdfd12: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.607698  9048 consensus_queue.cc:237] T ef723f9c640849d3890c61c07ffd0378 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:45.614048  9038 ts_tablet_manager.cc:1434] T ed4d847e589942fcbf6dadbb578327f2 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 13:16:45.615291  9038 tablet_bootstrap.cc:492] T ae1fc430ae3d4315aad2c0eed2f026aa P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:45.615629  9040 tablet_bootstrap.cc:654] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.631575  9038 tablet_bootstrap.cc:654] T ae1fc430ae3d4315aad2c0eed2f026aa P 895d3c58761f427c9c5b3cb41246c243: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.631834  9040 tablet_bootstrap.cc:492] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032: No bootstrap required, opened a new log
I20260709 13:16:45.632664  9040 ts_tablet_manager.cc:1403] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.003s
I20260709 13:16:45.638780  9040 raft_consensus.cc:359] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:45.639189  8667 catalog_manager.cc:5697] T 3f0c32d9abf04206a6f08210b3a30794 P 895d3c58761f427c9c5b3cb41246c243 reported cstate change: term changed from 0 to 1, leader changed from <none> to 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "895d3c58761f427c9c5b3cb41246c243" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:45.640393  9040 raft_consensus.cc:385] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.640956  9040 raft_consensus.cc:740] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.641806  9040 consensus_queue.cc:260] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:45.644510  9040 ts_tablet_manager.cc:1434] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:16:45.650286  9040 tablet_bootstrap.cc:492] T ed4d847e589942fcbf6dadbb578327f2 P e8bb7e1240f44fda8b83e4c124852032: Bootstrap starting.
I20260709 13:16:45.646266  9039 ts_tablet_manager.cc:1434] T 67ea3c8e514f41549c3a96b74a9b5be9 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent starting tablet: real 0.055s	user 0.005s	sys 0.004s
I20260709 13:16:45.646390  9042 tablet_bootstrap.cc:492] T 21893ae95aed4157a65823826a6badf0 P 43c6faa9496d44dda6b6eaed09cdfd12: No bootstrap required, opened a new log
I20260709 13:16:45.652225  9042 ts_tablet_manager.cc:1403] T 21893ae95aed4157a65823826a6badf0 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent bootstrapping tablet: real 0.050s	user 0.009s	sys 0.018s
I20260709 13:16:45.654452  9042 raft_consensus.cc:359] T 21893ae95aed4157a65823826a6badf0 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:45.655000  9042 raft_consensus.cc:385] T 21893ae95aed4157a65823826a6badf0 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.655228  9042 raft_consensus.cc:740] T 21893ae95aed4157a65823826a6badf0 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.656157  9040 tablet_bootstrap.cc:654] T ed4d847e589942fcbf6dadbb578327f2 P e8bb7e1240f44fda8b83e4c124852032: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.656073  9042 consensus_queue.cc:260] T 21893ae95aed4157a65823826a6badf0 P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:45.657306  9038 tablet_bootstrap.cc:492] T ae1fc430ae3d4315aad2c0eed2f026aa P 895d3c58761f427c9c5b3cb41246c243: No bootstrap required, opened a new log
I20260709 13:16:45.657837  9038 ts_tablet_manager.cc:1403] T ae1fc430ae3d4315aad2c0eed2f026aa P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.043s	user 0.012s	sys 0.004s
I20260709 13:16:45.660404  9039 tablet_bootstrap.cc:492] T 21893ae95aed4157a65823826a6badf0 P 7d3072f2af0b481d94ed70632b90e8c6: Bootstrap starting.
I20260709 13:16:45.661470  9038 raft_consensus.cc:359] T ae1fc430ae3d4315aad2c0eed2f026aa P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:45.676635  9038 raft_consensus.cc:385] T ae1fc430ae3d4315aad2c0eed2f026aa P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.677057  9038 raft_consensus.cc:740] T ae1fc430ae3d4315aad2c0eed2f026aa P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.677991  9038 consensus_queue.cc:260] T ae1fc430ae3d4315aad2c0eed2f026aa P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:45.681468  9038 ts_tablet_manager.cc:1434] T ae1fc430ae3d4315aad2c0eed2f026aa P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.002s
I20260709 13:16:45.668752  9042 ts_tablet_manager.cc:1434] T 21893ae95aed4157a65823826a6badf0 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:16:45.674398  8667 catalog_manager.cc:5697] T ef723f9c640849d3890c61c07ffd0378 P 895d3c58761f427c9c5b3cb41246c243 reported cstate change: term changed from 0 to 1, leader changed from <none> to 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "895d3c58761f427c9c5b3cb41246c243" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:45.684003  9042 tablet_bootstrap.cc:492] T ef723f9c640849d3890c61c07ffd0378 P 43c6faa9496d44dda6b6eaed09cdfd12: Bootstrap starting.
I20260709 13:16:45.682821  9038 tablet_bootstrap.cc:492] T d46902173b5c4283b315c6def6f13c31 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:45.682809  9039 tablet_bootstrap.cc:654] T 21893ae95aed4157a65823826a6badf0 P 7d3072f2af0b481d94ed70632b90e8c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.701115  9042 tablet_bootstrap.cc:654] T ef723f9c640849d3890c61c07ffd0378 P 43c6faa9496d44dda6b6eaed09cdfd12: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.702436  9040 tablet_bootstrap.cc:492] T ed4d847e589942fcbf6dadbb578327f2 P e8bb7e1240f44fda8b83e4c124852032: No bootstrap required, opened a new log
I20260709 13:16:45.703017  9040 ts_tablet_manager.cc:1403] T ed4d847e589942fcbf6dadbb578327f2 P e8bb7e1240f44fda8b83e4c124852032: Time spent bootstrapping tablet: real 0.053s	user 0.013s	sys 0.037s
I20260709 13:16:45.703111  9038 tablet_bootstrap.cc:654] T d46902173b5c4283b315c6def6f13c31 P 895d3c58761f427c9c5b3cb41246c243: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.706954  9040 raft_consensus.cc:359] T ed4d847e589942fcbf6dadbb578327f2 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:45.709141  9040 raft_consensus.cc:385] T ed4d847e589942fcbf6dadbb578327f2 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.709467  9040 raft_consensus.cc:740] T ed4d847e589942fcbf6dadbb578327f2 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.710245  9040 consensus_queue.cc:260] T ed4d847e589942fcbf6dadbb578327f2 P e8bb7e1240f44fda8b83e4c124852032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:45.712255  9039 tablet_bootstrap.cc:492] T 21893ae95aed4157a65823826a6badf0 P 7d3072f2af0b481d94ed70632b90e8c6: No bootstrap required, opened a new log
I20260709 13:16:45.712833  9040 ts_tablet_manager.cc:1434] T ed4d847e589942fcbf6dadbb578327f2 P e8bb7e1240f44fda8b83e4c124852032: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.002s
I20260709 13:16:45.712826  9039 ts_tablet_manager.cc:1403] T 21893ae95aed4157a65823826a6badf0 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent bootstrapping tablet: real 0.053s	user 0.011s	sys 0.002s
I20260709 13:16:45.713476  9038 tablet_bootstrap.cc:492] T d46902173b5c4283b315c6def6f13c31 P 895d3c58761f427c9c5b3cb41246c243: No bootstrap required, opened a new log
I20260709 13:16:45.714013  9038 ts_tablet_manager.cc:1403] T d46902173b5c4283b315c6def6f13c31 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.000s
I20260709 13:16:45.714386  9040 tablet_bootstrap.cc:492] T 3f0c32d9abf04206a6f08210b3a30794 P e8bb7e1240f44fda8b83e4c124852032: Bootstrap starting.
I20260709 13:16:45.715196  9082 raft_consensus.cc:493] T ab679ea0af724bd39f753eb407c73264 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.715842  9082 raft_consensus.cc:515] T ab679ea0af724bd39f753eb407c73264 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:45.716809  9038 raft_consensus.cc:359] T d46902173b5c4283b315c6def6f13c31 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:45.717523  9038 raft_consensus.cc:385] T d46902173b5c4283b315c6def6f13c31 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.717787  9038 raft_consensus.cc:740] T d46902173b5c4283b315c6def6f13c31 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.718082  9042 tablet_bootstrap.cc:492] T ef723f9c640849d3890c61c07ffd0378 P 43c6faa9496d44dda6b6eaed09cdfd12: No bootstrap required, opened a new log
I20260709 13:16:45.718564  9042 ts_tablet_manager.cc:1403] T ef723f9c640849d3890c61c07ffd0378 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent bootstrapping tablet: real 0.035s	user 0.016s	sys 0.003s
I20260709 13:16:45.719394  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab679ea0af724bd39f753eb407c73264" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:45.720012  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab679ea0af724bd39f753eb407c73264" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
W20260709 13:16:45.720969  8958 leader_election.cc:343] T ab679ea0af724bd39f753eb407c73264 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:45.721565  9042 raft_consensus.cc:359] T ef723f9c640849d3890c61c07ffd0378 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:45.721943  9082 leader_election.cc:290] T ab679ea0af724bd39f753eb407c73264 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:45.721662  9038 consensus_queue.cc:260] T d46902173b5c4283b315c6def6f13c31 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:45.722328  9042 raft_consensus.cc:385] T ef723f9c640849d3890c61c07ffd0378 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:16:45.721580  8959 leader_election.cc:343] T ab679ea0af724bd39f753eb407c73264 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:45.716372  9039 raft_consensus.cc:359] T 21893ae95aed4157a65823826a6badf0 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:45.723134  8959 leader_election.cc:304] T ab679ea0af724bd39f753eb407c73264 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bb7e1240f44fda8b83e4c124852032; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:45.722642  9042 raft_consensus.cc:740] T ef723f9c640849d3890c61c07ffd0378 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.724385  9082 raft_consensus.cc:2749] T ab679ea0af724bd39f753eb407c73264 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:45.724450  9042 consensus_queue.cc:260] T ef723f9c640849d3890c61c07ffd0378 P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:45.725270  9039 raft_consensus.cc:385] T 21893ae95aed4157a65823826a6badf0 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.725706  9039 raft_consensus.cc:740] T 21893ae95aed4157a65823826a6badf0 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.726524  9039 consensus_queue.cc:260] T 21893ae95aed4157a65823826a6badf0 P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:45.728991  9039 ts_tablet_manager.cc:1434] T 21893ae95aed4157a65823826a6badf0 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:16:45.732595  9038 ts_tablet_manager.cc:1434] T d46902173b5c4283b315c6def6f13c31 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 13:16:45.733722  9039 tablet_bootstrap.cc:492] T 932e5cbccd33414f8b05280505fd8bc7 P 7d3072f2af0b481d94ed70632b90e8c6: Bootstrap starting.
I20260709 13:16:45.734674  9042 ts_tablet_manager.cc:1434] T ef723f9c640849d3890c61c07ffd0378 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.002s
I20260709 13:16:45.735235  9040 tablet_bootstrap.cc:654] T 3f0c32d9abf04206a6f08210b3a30794 P e8bb7e1240f44fda8b83e4c124852032: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.735939  9042 tablet_bootstrap.cc:492] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12: Bootstrap starting.
I20260709 13:16:45.743189  9042 tablet_bootstrap.cc:654] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.744712  9038 tablet_bootstrap.cc:492] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:45.754877  9039 tablet_bootstrap.cc:654] T 932e5cbccd33414f8b05280505fd8bc7 P 7d3072f2af0b481d94ed70632b90e8c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.758831  9038 tablet_bootstrap.cc:654] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.759127  9042 tablet_bootstrap.cc:492] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12: No bootstrap required, opened a new log
I20260709 13:16:45.759315  9040 tablet_bootstrap.cc:492] T 3f0c32d9abf04206a6f08210b3a30794 P e8bb7e1240f44fda8b83e4c124852032: No bootstrap required, opened a new log
I20260709 13:16:45.759696  9042 ts_tablet_manager.cc:1403] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.008s
I20260709 13:16:45.760221  9040 ts_tablet_manager.cc:1403] T 3f0c32d9abf04206a6f08210b3a30794 P e8bb7e1240f44fda8b83e4c124852032: Time spent bootstrapping tablet: real 0.046s	user 0.019s	sys 0.006s
I20260709 13:16:45.762883  9042 raft_consensus.cc:359] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:45.763671  9042 raft_consensus.cc:385] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.763978  9042 raft_consensus.cc:740] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.764432  9040 raft_consensus.cc:359] T 3f0c32d9abf04206a6f08210b3a30794 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:45.764776  9042 consensus_queue.cc:260] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:45.765413  9040 raft_consensus.cc:385] T 3f0c32d9abf04206a6f08210b3a30794 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.765952  9040 raft_consensus.cc:740] T 3f0c32d9abf04206a6f08210b3a30794 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.766716  9040 consensus_queue.cc:260] T 3f0c32d9abf04206a6f08210b3a30794 P e8bb7e1240f44fda8b83e4c124852032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:45.767436  9042 ts_tablet_manager.cc:1434] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 13:16:45.768941  9040 ts_tablet_manager.cc:1434] T 3f0c32d9abf04206a6f08210b3a30794 P e8bb7e1240f44fda8b83e4c124852032: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:16:45.769120  9042 tablet_bootstrap.cc:492] T ae1fc430ae3d4315aad2c0eed2f026aa P 43c6faa9496d44dda6b6eaed09cdfd12: Bootstrap starting.
I20260709 13:16:45.770090  9040 tablet_bootstrap.cc:492] T 197670bf2e8f4301b060ed8ef6862b22 P e8bb7e1240f44fda8b83e4c124852032: Bootstrap starting.
I20260709 13:16:45.776968  9039 tablet_bootstrap.cc:492] T 932e5cbccd33414f8b05280505fd8bc7 P 7d3072f2af0b481d94ed70632b90e8c6: No bootstrap required, opened a new log
I20260709 13:16:45.777652  9039 ts_tablet_manager.cc:1403] T 932e5cbccd33414f8b05280505fd8bc7 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.009s
I20260709 13:16:45.777920  9040 tablet_bootstrap.cc:654] T 197670bf2e8f4301b060ed8ef6862b22 P e8bb7e1240f44fda8b83e4c124852032: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.779937  9038 tablet_bootstrap.cc:492] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243: No bootstrap required, opened a new log
I20260709 13:16:45.780500  9038 ts_tablet_manager.cc:1403] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.036s	user 0.016s	sys 0.000s
I20260709 13:16:45.781687  9039 raft_consensus.cc:359] T 932e5cbccd33414f8b05280505fd8bc7 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:45.782521  9039 raft_consensus.cc:385] T 932e5cbccd33414f8b05280505fd8bc7 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.782861  9039 raft_consensus.cc:740] T 932e5cbccd33414f8b05280505fd8bc7 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.783766  9039 consensus_queue.cc:260] T 932e5cbccd33414f8b05280505fd8bc7 P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:45.784422  9038 raft_consensus.cc:359] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:45.785398  9038 raft_consensus.cc:385] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.785833  9038 raft_consensus.cc:740] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.786835  9038 consensus_queue.cc:260] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:45.789906  9038 ts_tablet_manager.cc:1434] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 13:16:45.791369  9038 tablet_bootstrap.cc:492] T 932e5cbccd33414f8b05280505fd8bc7 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:45.797096  9042 tablet_bootstrap.cc:654] T ae1fc430ae3d4315aad2c0eed2f026aa P 43c6faa9496d44dda6b6eaed09cdfd12: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.799970  9038 tablet_bootstrap.cc:654] T 932e5cbccd33414f8b05280505fd8bc7 P 895d3c58761f427c9c5b3cb41246c243: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.809517  9042 tablet_bootstrap.cc:492] T ae1fc430ae3d4315aad2c0eed2f026aa P 43c6faa9496d44dda6b6eaed09cdfd12: No bootstrap required, opened a new log
I20260709 13:16:45.810070  9042 ts_tablet_manager.cc:1403] T ae1fc430ae3d4315aad2c0eed2f026aa P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent bootstrapping tablet: real 0.041s	user 0.017s	sys 0.000s
I20260709 13:16:45.813134  9042 raft_consensus.cc:359] T ae1fc430ae3d4315aad2c0eed2f026aa P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:45.813854  9042 raft_consensus.cc:385] T ae1fc430ae3d4315aad2c0eed2f026aa P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.814139  9042 raft_consensus.cc:740] T ae1fc430ae3d4315aad2c0eed2f026aa P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.814909  9039 ts_tablet_manager.cc:1434] T 932e5cbccd33414f8b05280505fd8bc7 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 13:16:45.814828  9042 consensus_queue.cc:260] T ae1fc430ae3d4315aad2c0eed2f026aa P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:45.818934  9038 tablet_bootstrap.cc:492] T 932e5cbccd33414f8b05280505fd8bc7 P 895d3c58761f427c9c5b3cb41246c243: No bootstrap required, opened a new log
I20260709 13:16:45.819715  9038 ts_tablet_manager.cc:1403] T 932e5cbccd33414f8b05280505fd8bc7 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.016s
I20260709 13:16:45.820730  9039 tablet_bootstrap.cc:492] T 197670bf2e8f4301b060ed8ef6862b22 P 7d3072f2af0b481d94ed70632b90e8c6: Bootstrap starting.
I20260709 13:16:45.823596  9038 raft_consensus.cc:359] T 932e5cbccd33414f8b05280505fd8bc7 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:45.824610  9038 raft_consensus.cc:385] T 932e5cbccd33414f8b05280505fd8bc7 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.824981  9038 raft_consensus.cc:740] T 932e5cbccd33414f8b05280505fd8bc7 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.825954  9038 consensus_queue.cc:260] T 932e5cbccd33414f8b05280505fd8bc7 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:45.826654  9042 ts_tablet_manager.cc:1434] T ae1fc430ae3d4315aad2c0eed2f026aa P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:16:45.829160  9038 ts_tablet_manager.cc:1434] T 932e5cbccd33414f8b05280505fd8bc7 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:16:45.830907  9042 tablet_bootstrap.cc:492] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12: Bootstrap starting.
I20260709 13:16:45.832113  9048 raft_consensus.cc:493] T d46902173b5c4283b315c6def6f13c31 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.832623  9048 raft_consensus.cc:515] T d46902173b5c4283b315c6def6f13c31 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:45.834896  9048 leader_election.cc:290] T d46902173b5c4283b315c6def6f13c31 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:45.836623  9038 tablet_bootstrap.cc:492] T 8a25176ebf484df29f67908cfa6e2b48 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:45.838660  9042 tablet_bootstrap.cc:654] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.839052  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46902173b5c4283b315c6def6f13c31" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:45.839818  8844 raft_consensus.cc:2468] T d46902173b5c4283b315c6def6f13c31 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 0.
I20260709 13:16:45.840899  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46902173b5c4283b315c6def6f13c31" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:45.841594  8918 raft_consensus.cc:2468] T d46902173b5c4283b315c6def6f13c31 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 0.
I20260709 13:16:45.845436  9100 raft_consensus.cc:493] T ae1fc430ae3d4315aad2c0eed2f026aa P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.845943  9100 raft_consensus.cc:515] T ae1fc430ae3d4315aad2c0eed2f026aa P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:45.846218  8736 leader_election.cc:304] T d46902173b5c4283b315c6def6f13c31 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243; no voters: 
I20260709 13:16:45.848249  9100 leader_election.cc:290] T ae1fc430ae3d4315aad2c0eed2f026aa P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:45.848434  9038 tablet_bootstrap.cc:654] T 8a25176ebf484df29f67908cfa6e2b48 P 895d3c58761f427c9c5b3cb41246c243: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.850342  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1fc430ae3d4315aad2c0eed2f026aa" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:45.851358  9048 raft_consensus.cc:2804] T d46902173b5c4283b315c6def6f13c31 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:45.852133  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1fc430ae3d4315aad2c0eed2f026aa" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
W20260709 13:16:45.852442  8882 leader_election.cc:343] T ae1fc430ae3d4315aad2c0eed2f026aa P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:45.862515  8769 raft_consensus.cc:2468] T ae1fc430ae3d4315aad2c0eed2f026aa P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 0.
I20260709 13:16:45.864445  8884 leader_election.cc:304] T ae1fc430ae3d4315aad2c0eed2f026aa P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243; no voters: e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:45.865757  9100 raft_consensus.cc:2804] T ae1fc430ae3d4315aad2c0eed2f026aa P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:45.866138  9100 raft_consensus.cc:493] T ae1fc430ae3d4315aad2c0eed2f026aa P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.866484  9100 raft_consensus.cc:3060] T ae1fc430ae3d4315aad2c0eed2f026aa P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:45.864406  9048 raft_consensus.cc:493] T d46902173b5c4283b315c6def6f13c31 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.875295  9048 raft_consensus.cc:3060] T d46902173b5c4283b315c6def6f13c31 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:45.876761  9082 raft_consensus.cc:493] T ed4d847e589942fcbf6dadbb578327f2 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.877506  9082 raft_consensus.cc:515] T ed4d847e589942fcbf6dadbb578327f2 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:45.879428  9039 tablet_bootstrap.cc:654] T 197670bf2e8f4301b060ed8ef6862b22 P 7d3072f2af0b481d94ed70632b90e8c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.880914  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4d847e589942fcbf6dadbb578327f2" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:45.881162  9082 leader_election.cc:290] T ed4d847e589942fcbf6dadbb578327f2 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:45.881664  8769 raft_consensus.cc:2468] T ed4d847e589942fcbf6dadbb578327f2 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 0.
I20260709 13:16:45.883626  9038 tablet_bootstrap.cc:492] T 8a25176ebf484df29f67908cfa6e2b48 P 895d3c58761f427c9c5b3cb41246c243: No bootstrap required, opened a new log
I20260709 13:16:45.883733  8958 leader_election.cc:304] T ed4d847e589942fcbf6dadbb578327f2 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:16:45.884259  9038 ts_tablet_manager.cc:1403] T 8a25176ebf484df29f67908cfa6e2b48 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.048s	user 0.019s	sys 0.021s
I20260709 13:16:45.884913  9082 raft_consensus.cc:2804] T ed4d847e589942fcbf6dadbb578327f2 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:45.885418  9082 raft_consensus.cc:493] T ed4d847e589942fcbf6dadbb578327f2 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.885478  9040 tablet_bootstrap.cc:492] T 197670bf2e8f4301b060ed8ef6862b22 P e8bb7e1240f44fda8b83e4c124852032: No bootstrap required, opened a new log
I20260709 13:16:45.884223  9048 raft_consensus.cc:515] T d46902173b5c4283b315c6def6f13c31 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:45.886147  9040 ts_tablet_manager.cc:1403] T 197670bf2e8f4301b060ed8ef6862b22 P e8bb7e1240f44fda8b83e4c124852032: Time spent bootstrapping tablet: real 0.116s	user 0.057s	sys 0.047s
I20260709 13:16:45.885910  9082 raft_consensus.cc:3060] T ed4d847e589942fcbf6dadbb578327f2 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:45.888443  8845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46902173b5c4283b315c6def6f13c31" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
I20260709 13:16:45.888835  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46902173b5c4283b315c6def6f13c31" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:16:45.889281  8845 raft_consensus.cc:3060] T d46902173b5c4283b315c6def6f13c31 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:45.889575  8918 raft_consensus.cc:3060] T d46902173b5c4283b315c6def6f13c31 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:45.882777  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4d847e589942fcbf6dadbb578327f2" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:45.882331  9100 raft_consensus.cc:515] T ae1fc430ae3d4315aad2c0eed2f026aa P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
W20260709 13:16:45.896410  8957 leader_election.cc:343] T ed4d847e589942fcbf6dadbb578327f2 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:45.902534  8845 raft_consensus.cc:2468] T d46902173b5c4283b315c6def6f13c31 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 1.
I20260709 13:16:45.897891  9040 raft_consensus.cc:359] T 197670bf2e8f4301b060ed8ef6862b22 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:45.903592  9040 raft_consensus.cc:385] T 197670bf2e8f4301b060ed8ef6862b22 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.903913  9040 raft_consensus.cc:740] T 197670bf2e8f4301b060ed8ef6862b22 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.903990  8734 leader_election.cc:304] T d46902173b5c4283b315c6def6f13c31 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6, 895d3c58761f427c9c5b3cb41246c243; no voters: 
I20260709 13:16:45.904321  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1fc430ae3d4315aad2c0eed2f026aa" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
I20260709 13:16:45.904654  9040 consensus_queue.cc:260] T 197670bf2e8f4301b060ed8ef6862b22 P e8bb7e1240f44fda8b83e4c124852032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:45.905604  9044 raft_consensus.cc:493] T 4e1e1e84d68946d682e0944fbd3c51a8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.899807  9082 raft_consensus.cc:515] T ed4d847e589942fcbf6dadbb578327f2 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
W20260709 13:16:45.905948  8882 leader_election.cc:343] T ae1fc430ae3d4315aad2c0eed2f026aa P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:45.906181  9044 raft_consensus.cc:515] T 4e1e1e84d68946d682e0944fbd3c51a8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:45.906680  9038 raft_consensus.cc:359] T 8a25176ebf484df29f67908cfa6e2b48 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:45.907424  9038 raft_consensus.cc:385] T 8a25176ebf484df29f67908cfa6e2b48 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.907732  9038 raft_consensus.cc:740] T 8a25176ebf484df29f67908cfa6e2b48 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.907850  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1fc430ae3d4315aad2c0eed2f026aa" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243"
I20260709 13:16:45.908778  8770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4d847e589942fcbf6dadbb578327f2" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243"
I20260709 13:16:45.908568  9038 consensus_queue.cc:260] T 8a25176ebf484df29f67908cfa6e2b48 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:45.909060  9116 raft_consensus.cc:2804] T d46902173b5c4283b315c6def6f13c31 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:45.908519  8769 raft_consensus.cc:3060] T ae1fc430ae3d4315aad2c0eed2f026aa P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:45.910815  9038 ts_tablet_manager.cc:1434] T 8a25176ebf484df29f67908cfa6e2b48 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:16:45.910908  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1e1e84d68946d682e0944fbd3c51a8" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:45.911774  8768 raft_consensus.cc:2468] T 4e1e1e84d68946d682e0944fbd3c51a8 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 0.
I20260709 13:16:45.912523  9038 tablet_bootstrap.cc:492] T 448f6ffb482841a3b489476becf2f851 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:45.912763  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1e1e84d68946d682e0944fbd3c51a8" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:45.909426  8770 raft_consensus.cc:3060] T ed4d847e589942fcbf6dadbb578327f2 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:45.913384  8993 raft_consensus.cc:2468] T 4e1e1e84d68946d682e0944fbd3c51a8 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 0.
I20260709 13:16:45.914865  8808 leader_election.cc:304] T 4e1e1e84d68946d682e0944fbd3c51a8 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:16:45.916002  9130 raft_consensus.cc:2804] T 4e1e1e84d68946d682e0944fbd3c51a8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:45.916337  9116 raft_consensus.cc:697] T d46902173b5c4283b315c6def6f13c31 P 895d3c58761f427c9c5b3cb41246c243 [term 1 LEADER]: Becoming Leader. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Running, Role: LEADER
I20260709 13:16:45.908568  9044 leader_election.cc:290] T 4e1e1e84d68946d682e0944fbd3c51a8 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:45.917390  9116 consensus_queue.cc:237] T d46902173b5c4283b315c6def6f13c31 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:45.916435  9130 raft_consensus.cc:493] T 4e1e1e84d68946d682e0944fbd3c51a8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.919351  9130 raft_consensus.cc:3060] T 4e1e1e84d68946d682e0944fbd3c51a8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:45.919943  9038 tablet_bootstrap.cc:654] T 448f6ffb482841a3b489476becf2f851 P 895d3c58761f427c9c5b3cb41246c243: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.905862  9100 leader_election.cc:290] T ae1fc430ae3d4315aad2c0eed2f026aa P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Requested vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:45.930395  8770 raft_consensus.cc:2468] T ed4d847e589942fcbf6dadbb578327f2 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 1.
I20260709 13:16:45.932621  8958 leader_election.cc:304] T ed4d847e589942fcbf6dadbb578327f2 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:16:45.932637  9038 tablet_bootstrap.cc:492] T 448f6ffb482841a3b489476becf2f851 P 895d3c58761f427c9c5b3cb41246c243: No bootstrap required, opened a new log
I20260709 13:16:45.933691  9038 ts_tablet_manager.cc:1403] T 448f6ffb482841a3b489476becf2f851 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.012s
I20260709 13:16:45.937494  9038 raft_consensus.cc:359] T 448f6ffb482841a3b489476becf2f851 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:45.938472  9038 raft_consensus.cc:385] T 448f6ffb482841a3b489476becf2f851 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.938805  9038 raft_consensus.cc:740] T 448f6ffb482841a3b489476becf2f851 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.939733  9038 consensus_queue.cc:260] T 448f6ffb482841a3b489476becf2f851 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:45.941784  9082 leader_election.cc:290] T ed4d847e589942fcbf6dadbb578327f2 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 election: Requested vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:45.941653  8845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4d847e589942fcbf6dadbb578327f2" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
I20260709 13:16:45.943356  9082 raft_consensus.cc:493] T 3f0c32d9abf04206a6f08210b3a30794 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:45.944193  8957 leader_election.cc:343] T ed4d847e589942fcbf6dadbb578327f2 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:45.945411  9038 ts_tablet_manager.cc:1434] T 448f6ffb482841a3b489476becf2f851 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:16:45.950366  9100 consensus_queue.cc:1048] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:45.951236  9038 tablet_bootstrap.cc:492] T f80d602267cf421690d5fe6d3922e0cb P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:45.950379  9082 raft_consensus.cc:515] T 3f0c32d9abf04206a6f08210b3a30794 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:45.946843  9130 raft_consensus.cc:515] T 4e1e1e84d68946d682e0944fbd3c51a8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:45.948036  9042 tablet_bootstrap.cc:492] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12: No bootstrap required, opened a new log
I20260709 13:16:45.942140  8769 raft_consensus.cc:2468] T ae1fc430ae3d4315aad2c0eed2f026aa P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 1.
I20260709 13:16:45.954859  9042 ts_tablet_manager.cc:1403] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent bootstrapping tablet: real 0.124s	user 0.014s	sys 0.015s
I20260709 13:16:45.955646  8884 leader_election.cc:304] T ae1fc430ae3d4315aad2c0eed2f026aa P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243; no voters: e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:45.956918  9100 raft_consensus.cc:2804] T ae1fc430ae3d4315aad2c0eed2f026aa P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:45.956827  9050 raft_consensus.cc:493] T 8a25176ebf484df29f67908cfa6e2b48 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.957576  9050 raft_consensus.cc:515] T 8a25176ebf484df29f67908cfa6e2b48 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:45.961364  8845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a25176ebf484df29f67908cfa6e2b48" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:45.962375  9050 leader_election.cc:290] T 8a25176ebf484df29f67908cfa6e2b48 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
W20260709 13:16:45.963475  8734 leader_election.cc:343] T 8a25176ebf484df29f67908cfa6e2b48 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:45.965195  9038 tablet_bootstrap.cc:654] T f80d602267cf421690d5fe6d3922e0cb P 895d3c58761f427c9c5b3cb41246c243: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.966770  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f0c32d9abf04206a6f08210b3a30794" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:45.970295  9100 raft_consensus.cc:697] T ae1fc430ae3d4315aad2c0eed2f026aa P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Becoming Leader. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Running, Role: LEADER
I20260709 13:16:45.971282  9100 consensus_queue.cc:237] T ae1fc430ae3d4315aad2c0eed2f026aa P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:45.973141  9052 raft_consensus.cc:493] T ef723f9c640849d3890c61c07ffd0378 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.974154  9052 raft_consensus.cc:515] T ef723f9c640849d3890c61c07ffd0378 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:45.937302  8918 raft_consensus.cc:2468] T d46902173b5c4283b315c6def6f13c31 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 1.
I20260709 13:16:45.977429  9130 leader_election.cc:290] T 4e1e1e84d68946d682e0944fbd3c51a8 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 election: Requested vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:45.978451  9052 leader_election.cc:290] T ef723f9c640849d3890c61c07ffd0378 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:45.979139  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1e1e84d68946d682e0944fbd3c51a8" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
I20260709 13:16:45.983402  8845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef723f9c640849d3890c61c07ffd0378" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:45.984133  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef723f9c640849d3890c61c07ffd0378" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:45.984030  9042 raft_consensus.cc:359] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:45.984814  8993 raft_consensus.cc:3060] T 4e1e1e84d68946d682e0944fbd3c51a8 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:45.985271  9042 raft_consensus.cc:385] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.985693  9042 raft_consensus.cc:740] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.986693  9042 consensus_queue.cc:260] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:45.984297  8845 raft_consensus.cc:2393] T ef723f9c640849d3890c61c07ffd0378 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43c6faa9496d44dda6b6eaed09cdfd12 in current term 1: Already voted for candidate 895d3c58761f427c9c5b3cb41246c243 in this term.
I20260709 13:16:45.989595  8883 leader_election.cc:304] T ef723f9c640849d3890c61c07ffd0378 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12; no voters: 7d3072f2af0b481d94ed70632b90e8c6, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:45.990505  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1e1e84d68946d682e0944fbd3c51a8" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243"
I20260709 13:16:45.992017  8769 raft_consensus.cc:3060] T 4e1e1e84d68946d682e0944fbd3c51a8 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:45.995728  9148 raft_consensus.cc:2804] T ed4d847e589942fcbf6dadbb578327f2 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:45.987062  9048 leader_election.cc:290] T d46902173b5c4283b315c6def6f13c31 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 election: Requested vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:46.004922  9042 ts_tablet_manager.cc:1434] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.000s
I20260709 13:16:46.006196  8993 raft_consensus.cc:2468] T 4e1e1e84d68946d682e0944fbd3c51a8 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 1.
I20260709 13:16:46.016687  9042 tablet_bootstrap.cc:492] T 7bcde3fdb9314ca4b3422d395a673be5 P 43c6faa9496d44dda6b6eaed09cdfd12: Bootstrap starting.
I20260709 13:16:46.002671  9082 leader_election.cc:290] T 3f0c32d9abf04206a6f08210b3a30794 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:46.007388  9148 raft_consensus.cc:697] T ed4d847e589942fcbf6dadbb578327f2 P e8bb7e1240f44fda8b83e4c124852032 [term 1 LEADER]: Becoming Leader. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Running, Role: LEADER
I20260709 13:16:46.016189  9052 raft_consensus.cc:3060] T ef723f9c640849d3890c61c07ffd0378 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.027050  9040 ts_tablet_manager.cc:1434] T 197670bf2e8f4301b060ed8ef6862b22 P e8bb7e1240f44fda8b83e4c124852032: Time spent starting tablet: real 0.141s	user 0.038s	sys 0.039s
I20260709 13:16:46.028184  9040 tablet_bootstrap.cc:492] T 8a25176ebf484df29f67908cfa6e2b48 P e8bb7e1240f44fda8b83e4c124852032: Bootstrap starting.
I20260709 13:16:46.031139  9039 tablet_bootstrap.cc:492] T 197670bf2e8f4301b060ed8ef6862b22 P 7d3072f2af0b481d94ed70632b90e8c6: No bootstrap required, opened a new log
I20260709 13:16:46.031669  9039 ts_tablet_manager.cc:1403] T 197670bf2e8f4301b060ed8ef6862b22 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent bootstrapping tablet: real 0.211s	user 0.051s	sys 0.030s
I20260709 13:16:46.033244  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f0c32d9abf04206a6f08210b3a30794" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:46.034157  8844 raft_consensus.cc:2393] T 3f0c32d9abf04206a6f08210b3a30794 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bb7e1240f44fda8b83e4c124852032 in current term 1: Already voted for candidate 895d3c58761f427c9c5b3cb41246c243 in this term.
I20260709 13:16:46.035142  8667 catalog_manager.cc:5697] T d46902173b5c4283b315c6def6f13c31 P 895d3c58761f427c9c5b3cb41246c243 reported cstate change: term changed from 0 to 1, leader changed from <none> to 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "895d3c58761f427c9c5b3cb41246c243" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:46.030416  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a25176ebf484df29f67908cfa6e2b48" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
W20260709 13:16:46.041433  8733 leader_election.cc:343] T 8a25176ebf484df29f67908cfa6e2b48 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:46.041898  8733 leader_election.cc:304] T 8a25176ebf484df29f67908cfa6e2b48 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243; no voters: 7d3072f2af0b481d94ed70632b90e8c6, e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:46.042783  9038 tablet_bootstrap.cc:492] T f80d602267cf421690d5fe6d3922e0cb P 895d3c58761f427c9c5b3cb41246c243: No bootstrap required, opened a new log
I20260709 13:16:46.043308  9038 ts_tablet_manager.cc:1403] T f80d602267cf421690d5fe6d3922e0cb P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.092s	user 0.010s	sys 0.006s
I20260709 13:16:46.043355  9115 raft_consensus.cc:2749] T 8a25176ebf484df29f67908cfa6e2b48 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:46.044442  9148 consensus_queue.cc:237] T ed4d847e589942fcbf6dadbb578327f2 P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:46.045047  9039 raft_consensus.cc:359] T 197670bf2e8f4301b060ed8ef6862b22 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:46.046868  9038 raft_consensus.cc:359] T f80d602267cf421690d5fe6d3922e0cb P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:46.051153  9039 raft_consensus.cc:385] T 197670bf2e8f4301b060ed8ef6862b22 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.051224  9144 raft_consensus.cc:493] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.030823  8808 leader_election.cc:304] T 4e1e1e84d68946d682e0944fbd3c51a8 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:16:46.052423  9039 raft_consensus.cc:740] T 197670bf2e8f4301b060ed8ef6862b22 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.051874  9038 raft_consensus.cc:385] T f80d602267cf421690d5fe6d3922e0cb P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.053267  9038 raft_consensus.cc:740] T f80d602267cf421690d5fe6d3922e0cb P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.056046  9039 consensus_queue.cc:260] T 197670bf2e8f4301b060ed8ef6862b22 P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:46.055016  9044 raft_consensus.cc:493] T 67ea3c8e514f41549c3a96b74a9b5be9 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.056164  9038 consensus_queue.cc:260] T f80d602267cf421690d5fe6d3922e0cb P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:46.054234  9130 raft_consensus.cc:2804] T 4e1e1e84d68946d682e0944fbd3c51a8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:46.058857  9115 consensus_queue.cc:1048] T 3f0c32d9abf04206a6f08210b3a30794 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:16:46.065574  9130 raft_consensus.cc:697] T 4e1e1e84d68946d682e0944fbd3c51a8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 LEADER]: Becoming Leader. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Running, Role: LEADER
I20260709 13:16:46.062575  8957 leader_election.cc:304] T 3f0c32d9abf04206a6f08210b3a30794 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bb7e1240f44fda8b83e4c124852032; no voters: 7d3072f2af0b481d94ed70632b90e8c6, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:46.066545  9130 consensus_queue.cc:237] T 4e1e1e84d68946d682e0944fbd3c51a8 P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:46.067613  9044 raft_consensus.cc:515] T 67ea3c8e514f41549c3a96b74a9b5be9 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
W20260709 13:16:46.059978  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:35315, user_credentials={real_user=slave}} blocked reactor thread for 69512.5us
I20260709 13:16:46.070012  9044 leader_election.cc:290] T 67ea3c8e514f41549c3a96b74a9b5be9 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:46.070335  9115 raft_consensus.cc:493] T 932e5cbccd33414f8b05280505fd8bc7 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.070817  9115 raft_consensus.cc:515] T 932e5cbccd33414f8b05280505fd8bc7 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:46.073577  9048 consensus_queue.cc:1048] T ef723f9c640849d3890c61c07ffd0378 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:46.071992  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ea3c8e514f41549c3a96b74a9b5be9" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:46.075959  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932e5cbccd33414f8b05280505fd8bc7" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:46.076658  8917 raft_consensus.cc:2468] T 932e5cbccd33414f8b05280505fd8bc7 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 0.
I20260709 13:16:46.077400  9115 leader_election.cc:290] T 932e5cbccd33414f8b05280505fd8bc7 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:46.078176  8736 leader_election.cc:304] T 932e5cbccd33414f8b05280505fd8bc7 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243; no voters: 
I20260709 13:16:46.079195  9038 ts_tablet_manager.cc:1434] T f80d602267cf421690d5fe6d3922e0cb P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.035s	user 0.004s	sys 0.005s
I20260709 13:16:46.080546  9038 tablet_bootstrap.cc:492] T 4352fad232ab47588683e51cf4b62080 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
W20260709 13:16:46.079595  8811 leader_election.cc:343] T 67ea3c8e514f41549c3a96b74a9b5be9 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:46.079483  9151 consensus_queue.cc:1048] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 13:16:46.051996  9144 raft_consensus.cc:515] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:46.082598  8992 raft_consensus.cc:3060] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.083308  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932e5cbccd33414f8b05280505fd8bc7" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:46.083987  9144 leader_election.cc:290] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:46.084280  8844 raft_consensus.cc:2468] T 932e5cbccd33414f8b05280505fd8bc7 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 0.
I20260709 13:16:46.095130  9039 ts_tablet_manager.cc:1434] T 197670bf2e8f4301b060ed8ef6862b22 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent starting tablet: real 0.063s	user 0.009s	sys 0.000s
I20260709 13:16:46.096580  8770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1c593726564ba7ae9e8b66d1989f69" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:46.100272  9039 tablet_bootstrap.cc:492] T 825ea78cebec4b10a2f8d03b45d929fa P 7d3072f2af0b481d94ed70632b90e8c6: Bootstrap starting.
I20260709 13:16:46.061301  9100 raft_consensus.cc:493] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.087715  9115 raft_consensus.cc:2804] T 932e5cbccd33414f8b05280505fd8bc7 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:46.087605  8769 raft_consensus.cc:2468] T 4e1e1e84d68946d682e0944fbd3c51a8 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 1.
I20260709 13:16:46.105556  9048 raft_consensus.cc:493] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.109365  9145 raft_consensus.cc:3060] T 3f0c32d9abf04206a6f08210b3a30794 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.106912  9044 raft_consensus.cc:493] T 21893ae95aed4157a65823826a6badf0 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.102686  9100 raft_consensus.cc:515] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
W20260709 13:16:46.093750  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:46105, user_credentials={real_user=slave}} blocked reactor thread for 102310us
I20260709 13:16:46.106154  9115 raft_consensus.cc:493] T 932e5cbccd33414f8b05280505fd8bc7 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.153034  9115 raft_consensus.cc:3060] T 932e5cbccd33414f8b05280505fd8bc7 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.149279  9044 raft_consensus.cc:515] T 21893ae95aed4157a65823826a6badf0 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:46.166977  9044 leader_election.cc:290] T 21893ae95aed4157a65823826a6badf0 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:46.167977  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21893ae95aed4157a65823826a6badf0" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:46.169538  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21893ae95aed4157a65823826a6badf0" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:46.170308  8991 raft_consensus.cc:2468] T 21893ae95aed4157a65823826a6badf0 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 0.
I20260709 13:16:46.171836  8808 leader_election.cc:304] T 21893ae95aed4157a65823826a6badf0 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:16:46.173031  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ea3c8e514f41549c3a96b74a9b5be9" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:46.179741  9130 raft_consensus.cc:2804] T 21893ae95aed4157a65823826a6badf0 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:46.180230  9130 raft_consensus.cc:493] T 21893ae95aed4157a65823826a6badf0 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.180596  9130 raft_consensus.cc:3060] T 21893ae95aed4157a65823826a6badf0 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.155290  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1c593726564ba7ae9e8b66d1989f69" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
W20260709 13:16:46.184485  8808 leader_election.cc:343] T 67ea3c8e514f41549c3a96b74a9b5be9 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:46.185042  8808 leader_election.cc:304] T 67ea3c8e514f41549c3a96b74a9b5be9 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:46.185331  9116 raft_consensus.cc:493] T 448f6ffb482841a3b489476becf2f851 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.186064  9116 raft_consensus.cc:515] T 448f6ffb482841a3b489476becf2f851 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:46.120416  9048 raft_consensus.cc:515] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:46.191409  9048 leader_election.cc:290] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:46.173285  9153 raft_consensus.cc:493] T 21893ae95aed4157a65823826a6badf0 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.191987  9044 raft_consensus.cc:2749] T 67ea3c8e514f41549c3a96b74a9b5be9 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:46.192147  9153 raft_consensus.cc:515] T 21893ae95aed4157a65823826a6badf0 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:46.194638  9153 leader_election.cc:290] T 21893ae95aed4157a65823826a6badf0 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:46.195209  8918 raft_consensus.cc:2468] T 21893ae95aed4157a65823826a6badf0 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 0.
I20260709 13:16:46.184626  9042 tablet_bootstrap.cc:654] T 7bcde3fdb9314ca4b3422d395a673be5 P 43c6faa9496d44dda6b6eaed09cdfd12: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.185364  8959 leader_election.cc:304] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bb7e1240f44fda8b83e4c124852032; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:46.198177  9130 raft_consensus.cc:515] T 21893ae95aed4157a65823826a6badf0 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:46.200120  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21893ae95aed4157a65823826a6badf0" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:46.200994  8844 raft_consensus.cc:2393] T 21893ae95aed4157a65823826a6badf0 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43c6faa9496d44dda6b6eaed09cdfd12 in current term 1: Already voted for candidate 7d3072f2af0b481d94ed70632b90e8c6 in this term.
I20260709 13:16:46.202212  9052 raft_consensus.cc:2749] T ef723f9c640849d3890c61c07ffd0378 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:46.203222  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21893ae95aed4157a65823826a6badf0" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
I20260709 13:16:46.173081  9099 raft_consensus.cc:493] T 197670bf2e8f4301b060ed8ef6862b22 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.203904  8993 raft_consensus.cc:3060] T 21893ae95aed4157a65823826a6badf0 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.204144  9099 raft_consensus.cc:515] T 197670bf2e8f4301b060ed8ef6862b22 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:46.206565  9040 tablet_bootstrap.cc:654] T 8a25176ebf484df29f67908cfa6e2b48 P e8bb7e1240f44fda8b83e4c124852032: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.209578  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21893ae95aed4157a65823826a6badf0" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:16:46.210198  8918 raft_consensus.cc:3060] T 21893ae95aed4157a65823826a6badf0 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.212548  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "197670bf2e8f4301b060ed8ef6862b22" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:46.213229  8991 raft_consensus.cc:2468] T 197670bf2e8f4301b060ed8ef6862b22 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 0.
I20260709 13:16:46.213974  9038 tablet_bootstrap.cc:654] T 4352fad232ab47588683e51cf4b62080 P 895d3c58761f427c9c5b3cb41246c243: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.191560  9116 leader_election.cc:290] T 448f6ffb482841a3b489476becf2f851 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:46.206813  9099 leader_election.cc:290] T 197670bf2e8f4301b060ed8ef6862b22 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:46.218207  9130 leader_election.cc:290] T 21893ae95aed4157a65823826a6badf0 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 election: Requested vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:46.233263  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "197670bf2e8f4301b060ed8ef6862b22" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:46.250988  8990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448f6ffb482841a3b489476becf2f851" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
W20260709 13:16:46.253752  8733 leader_election.cc:343] T 448f6ffb482841a3b489476becf2f851 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:46.233693  8808 leader_election.cc:304] T 197670bf2e8f4301b060ed8ef6862b22 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:16:46.245523  8917 raft_consensus.cc:2468] T 197670bf2e8f4301b060ed8ef6862b22 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 0.
I20260709 13:16:46.268163  9130 raft_consensus.cc:2804] T 197670bf2e8f4301b060ed8ef6862b22 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:46.268632  9130 raft_consensus.cc:493] T 197670bf2e8f4301b060ed8ef6862b22 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.269034  9130 raft_consensus.cc:3060] T 197670bf2e8f4301b060ed8ef6862b22 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.271186  8989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21893ae95aed4157a65823826a6badf0" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:46.273875  8882 leader_election.cc:304] T 21893ae95aed4157a65823826a6badf0 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12; no voters: 7d3072f2af0b481d94ed70632b90e8c6, e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:46.277599  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5284f5b067413e9fc2a383cc318735" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:46.278580  8844 raft_consensus.cc:2468] T 1d5284f5b067413e9fc2a383cc318735 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 0.
I20260709 13:16:46.278684  9039 tablet_bootstrap.cc:654] T 825ea78cebec4b10a2f8d03b45d929fa P 7d3072f2af0b481d94ed70632b90e8c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.281559  8734 leader_election.cc:304] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6, 895d3c58761f427c9c5b3cb41246c243; no voters: 
I20260709 13:16:46.282943  9050 raft_consensus.cc:2804] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:46.283443  9050 raft_consensus.cc:493] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.283882  9050 raft_consensus.cc:3060] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:46.285074  8716 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:46.254479  8666 catalog_manager.cc:5697] T ae1fc430ae3d4315aad2c0eed2f026aa P 43c6faa9496d44dda6b6eaed09cdfd12 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195). New cstate: current_term: 1 leader_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:46.303474  8668 catalog_manager.cc:5697] T 4e1e1e84d68946d682e0944fbd3c51a8 P 7d3072f2af0b481d94ed70632b90e8c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194). New cstate: current_term: 1 leader_uuid: "7d3072f2af0b481d94ed70632b90e8c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:46.294152  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5284f5b067413e9fc2a383cc318735" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:46.296447  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5284f5b067413e9fc2a383cc318735" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:46.290220  8993 raft_consensus.cc:2468] T 21893ae95aed4157a65823826a6badf0 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 1.
I20260709 13:16:46.296475  9145 raft_consensus.cc:2749] T 3f0c32d9abf04206a6f08210b3a30794 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:46.292759  9100 leader_election.cc:290] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:46.294595  9050 raft_consensus.cc:515] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:46.326890  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448f6ffb482841a3b489476becf2f851" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:46.342226  8808 leader_election.cc:304] T 21893ae95aed4157a65823826a6badf0 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:16:46.343183  9044 raft_consensus.cc:2804] T 21893ae95aed4157a65823826a6badf0 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:46.320230  9115 raft_consensus.cc:515] T 932e5cbccd33414f8b05280505fd8bc7 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:46.357439  9048 consensus_queue.cc:1048] T 3f0c32d9abf04206a6f08210b3a30794 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:46.359890  9115 leader_election.cc:290] T 932e5cbccd33414f8b05280505fd8bc7 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 election: Requested vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:46.360889  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932e5cbccd33414f8b05280505fd8bc7" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
I20260709 13:16:46.361558  8841 raft_consensus.cc:3060] T 932e5cbccd33414f8b05280505fd8bc7 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.365662  9130 raft_consensus.cc:515] T 197670bf2e8f4301b060ed8ef6862b22 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:46.345263  9044 raft_consensus.cc:697] T 21893ae95aed4157a65823826a6badf0 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 LEADER]: Becoming Leader. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Running, Role: LEADER
I20260709 13:16:46.346690  9042 tablet_bootstrap.cc:492] T 7bcde3fdb9314ca4b3422d395a673be5 P 43c6faa9496d44dda6b6eaed09cdfd12: No bootstrap required, opened a new log
I20260709 13:16:46.371243  9042 ts_tablet_manager.cc:1403] T 7bcde3fdb9314ca4b3422d395a673be5 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent bootstrapping tablet: real 0.355s	user 0.027s	sys 0.008s
I20260709 13:16:46.371869  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5284f5b067413e9fc2a383cc318735" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
I20260709 13:16:46.372400  9040 tablet_bootstrap.cc:492] T 8a25176ebf484df29f67908cfa6e2b48 P e8bb7e1240f44fda8b83e4c124852032: No bootstrap required, opened a new log
I20260709 13:16:46.371709  9044 consensus_queue.cc:237] T 21893ae95aed4157a65823826a6badf0 P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:46.372893  9040 ts_tablet_manager.cc:1403] T 8a25176ebf484df29f67908cfa6e2b48 P e8bb7e1240f44fda8b83e4c124852032: Time spent bootstrapping tablet: real 0.345s	user 0.015s	sys 0.011s
I20260709 13:16:46.357848  8769 raft_consensus.cc:2393] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43c6faa9496d44dda6b6eaed09cdfd12 in current term 1: Already voted for candidate 895d3c58761f427c9c5b3cb41246c243 in this term.
I20260709 13:16:46.368479  9050 leader_election.cc:290] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 election: Requested vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
W20260709 13:16:46.369540  8734 leader_election.cc:343] T 448f6ffb482841a3b489476becf2f851 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:46.382279  8734 leader_election.cc:304] T 448f6ffb482841a3b489476becf2f851 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243; no voters: 7d3072f2af0b481d94ed70632b90e8c6, e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:46.384773  9040 raft_consensus.cc:359] T 8a25176ebf484df29f67908cfa6e2b48 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:46.385430  9040 raft_consensus.cc:385] T 8a25176ebf484df29f67908cfa6e2b48 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.385718  9040 raft_consensus.cc:740] T 8a25176ebf484df29f67908cfa6e2b48 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.386384  9040 consensus_queue.cc:260] T 8a25176ebf484df29f67908cfa6e2b48 P e8bb7e1240f44fda8b83e4c124852032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:46.357465  8664 catalog_manager.cc:5697] T ed4d847e589942fcbf6dadbb578327f2 P e8bb7e1240f44fda8b83e4c124852032 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196). New cstate: current_term: 1 leader_uuid: "e8bb7e1240f44fda8b83e4c124852032" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:46.330837  8842 raft_consensus.cc:2468] T 1d5284f5b067413e9fc2a383cc318735 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 0.
I20260709 13:16:46.377247  9042 raft_consensus.cc:359] T 7bcde3fdb9314ca4b3422d395a673be5 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:46.398447  9042 raft_consensus.cc:385] T 7bcde3fdb9314ca4b3422d395a673be5 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.398895  9042 raft_consensus.cc:740] T 7bcde3fdb9314ca4b3422d395a673be5 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.400020  9042 consensus_queue.cc:260] T 7bcde3fdb9314ca4b3422d395a673be5 P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:46.395959  9115 raft_consensus.cc:2749] T 448f6ffb482841a3b489476becf2f851 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:46.424679  9040 ts_tablet_manager.cc:1434] T 8a25176ebf484df29f67908cfa6e2b48 P e8bb7e1240f44fda8b83e4c124852032: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.002s
I20260709 13:16:46.426239  9040 tablet_bootstrap.cc:492] T 448f6ffb482841a3b489476becf2f851 P e8bb7e1240f44fda8b83e4c124852032: Bootstrap starting.
I20260709 13:16:46.432994  9042 ts_tablet_manager.cc:1434] T 7bcde3fdb9314ca4b3422d395a673be5 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent starting tablet: real 0.061s	user 0.008s	sys 0.000s
I20260709 13:16:46.434904  9042 tablet_bootstrap.cc:492] T 67ea3c8e514f41549c3a96b74a9b5be9 P 43c6faa9496d44dda6b6eaed09cdfd12: Bootstrap starting.
I20260709 13:16:46.442284  9039 tablet_bootstrap.cc:492] T 825ea78cebec4b10a2f8d03b45d929fa P 7d3072f2af0b481d94ed70632b90e8c6: No bootstrap required, opened a new log
I20260709 13:16:46.442926  9039 ts_tablet_manager.cc:1403] T 825ea78cebec4b10a2f8d03b45d929fa P 7d3072f2af0b481d94ed70632b90e8c6: Time spent bootstrapping tablet: real 0.343s	user 0.013s	sys 0.018s
W20260709 13:16:46.421844  8811 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37671, user_credentials={real_user=slave}} blocked reactor thread for 68418.6us
I20260709 13:16:46.416740  8918 raft_consensus.cc:2468] T 21893ae95aed4157a65823826a6badf0 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 1.
I20260709 13:16:46.463294  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5284f5b067413e9fc2a383cc318735" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:16:46.464095  8919 raft_consensus.cc:3060] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.467357  8883 leader_election.cc:304] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6; no voters: 
I20260709 13:16:46.464097  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932e5cbccd33414f8b05280505fd8bc7" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:16:46.468230  8917 raft_consensus.cc:3060] T 932e5cbccd33414f8b05280505fd8bc7 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.447122  9144 raft_consensus.cc:2749] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:16:46.470463  8882 consensus_peers.cc:597] T ae1fc430ae3d4315aad2c0eed2f026aa P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Couldn't send request to peer e8bb7e1240f44fda8b83e4c124852032. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:46.455924  9052 raft_consensus.cc:2749] T 21893ae95aed4157a65823826a6badf0 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:46.474745  9038 tablet_bootstrap.cc:492] T 4352fad232ab47588683e51cf4b62080 P 895d3c58761f427c9c5b3cb41246c243: No bootstrap required, opened a new log
I20260709 13:16:46.475337  9038 ts_tablet_manager.cc:1403] T 4352fad232ab47588683e51cf4b62080 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.395s	user 0.023s	sys 0.002s
I20260709 13:16:46.484705  9050 consensus_queue.cc:1048] T ef723f9c640849d3890c61c07ffd0378 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:46.486429  9050 raft_consensus.cc:493] T f80d602267cf421690d5fe6d3922e0cb P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.487483  8919 raft_consensus.cc:2468] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 1.
I20260709 13:16:46.489560  8841 raft_consensus.cc:2468] T 932e5cbccd33414f8b05280505fd8bc7 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 1.
I20260709 13:16:46.486979  9050 raft_consensus.cc:515] T f80d602267cf421690d5fe6d3922e0cb P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:46.490681  9161 raft_consensus.cc:2764] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:16:46.492051  9050 leader_election.cc:290] T f80d602267cf421690d5fe6d3922e0cb P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:46.492799  9040 tablet_bootstrap.cc:654] T 448f6ffb482841a3b489476becf2f851 P e8bb7e1240f44fda8b83e4c124852032: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.494836  8845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80d602267cf421690d5fe6d3922e0cb" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:46.496373  8734 leader_election.cc:304] T 932e5cbccd33414f8b05280505fd8bc7 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6, 895d3c58761f427c9c5b3cb41246c243; no voters: 
I20260709 13:16:46.499753  9100 raft_consensus.cc:493] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.500279  9100 raft_consensus.cc:515] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:46.501919  9042 tablet_bootstrap.cc:654] T 67ea3c8e514f41549c3a96b74a9b5be9 P 43c6faa9496d44dda6b6eaed09cdfd12: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.494895  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "197670bf2e8f4301b060ed8ef6862b22" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
I20260709 13:16:46.502296  9130 leader_election.cc:290] T 197670bf2e8f4301b060ed8ef6862b22 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 election: Requested vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:46.508064  8991 raft_consensus.cc:3060] T 197670bf2e8f4301b060ed8ef6862b22 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.510159  8917 raft_consensus.cc:2468] T 932e5cbccd33414f8b05280505fd8bc7 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 1.
I20260709 13:16:46.505651  9039 raft_consensus.cc:359] T 825ea78cebec4b10a2f8d03b45d929fa P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:46.513398  9039 raft_consensus.cc:385] T 825ea78cebec4b10a2f8d03b45d929fa P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.513839  9039 raft_consensus.cc:740] T 825ea78cebec4b10a2f8d03b45d929fa P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.514943  9038 raft_consensus.cc:359] T 4352fad232ab47588683e51cf4b62080 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:46.515473  9038 raft_consensus.cc:385] T 4352fad232ab47588683e51cf4b62080 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.515796  9038 raft_consensus.cc:740] T 4352fad232ab47588683e51cf4b62080 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.514518  9039 consensus_queue.cc:260] T 825ea78cebec4b10a2f8d03b45d929fa P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:46.512447  9050 raft_consensus.cc:2804] T 932e5cbccd33414f8b05280505fd8bc7 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:46.520800  9050 raft_consensus.cc:697] T 932e5cbccd33414f8b05280505fd8bc7 P 895d3c58761f427c9c5b3cb41246c243 [term 1 LEADER]: Becoming Leader. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Running, Role: LEADER
I20260709 13:16:46.521727  9050 consensus_queue.cc:237] T 932e5cbccd33414f8b05280505fd8bc7 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:46.517257  9038 consensus_queue.cc:260] T 4352fad232ab47588683e51cf4b62080 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:46.504405  9100 leader_election.cc:290] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:46.529652  9038 ts_tablet_manager.cc:1434] T 4352fad232ab47588683e51cf4b62080 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.000s
I20260709 13:16:46.530515  9038 tablet_bootstrap.cc:492] T 825ea78cebec4b10a2f8d03b45d929fa P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
W20260709 13:16:46.522835  8957 consensus_peers.cc:597] T ed4d847e589942fcbf6dadbb578327f2 P e8bb7e1240f44fda8b83e4c124852032 -> Peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Couldn't send request to peer 7d3072f2af0b481d94ed70632b90e8c6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:46.533036  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "197670bf2e8f4301b060ed8ef6862b22" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:16:46.533772  8917 raft_consensus.cc:3060] T 197670bf2e8f4301b060ed8ef6862b22 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.533823  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5284f5b067413e9fc2a383cc318735" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:46.534533  8916 raft_consensus.cc:2376] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 1. Re-sending same reply.
I20260709 13:16:46.538275  9144 consensus_queue.cc:1048] T ed4d847e589942fcbf6dadbb578327f2 P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:46.538600  9130 consensus_queue.cc:1048] T 4e1e1e84d68946d682e0944fbd3c51a8 P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:46.542289  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab679ea0af724bd39f753eb407c73264" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
W20260709 13:16:46.546360  8884 leader_election.cc:343] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:46.518122  8734 leader_election.cc:343] T f80d602267cf421690d5fe6d3922e0cb P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:46.548172  9116 consensus_queue.cc:1048] T d46902173b5c4283b315c6def6f13c31 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:46.519287  8736 leader_election.cc:304] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243; no voters: 7d3072f2af0b481d94ed70632b90e8c6
I20260709 13:16:46.553117  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80d602267cf421690d5fe6d3922e0cb" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
W20260709 13:16:46.555245  8736 leader_election.cc:343] T f80d602267cf421690d5fe6d3922e0cb P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:46.551281  9160 raft_consensus.cc:2804] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:46.557550  9039 ts_tablet_manager.cc:1434] T 825ea78cebec4b10a2f8d03b45d929fa P 7d3072f2af0b481d94ed70632b90e8c6: Time spent starting tablet: real 0.114s	user 0.007s	sys 0.002s
I20260709 13:16:46.558391  9039 tablet_bootstrap.cc:492] T ed4d847e589942fcbf6dadbb578327f2 P 7d3072f2af0b481d94ed70632b90e8c6: Bootstrap starting.
I20260709 13:16:46.563099  9160 raft_consensus.cc:697] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243 [term 1 LEADER]: Becoming Leader. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Running, Role: LEADER
I20260709 13:16:46.567108  8990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab679ea0af724bd39f753eb407c73264" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:46.561594  8736 leader_election.cc:304] T f80d602267cf421690d5fe6d3922e0cb P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6
I20260709 13:16:46.577513  9144 raft_consensus.cc:493] T 8a25176ebf484df29f67908cfa6e2b48 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.585732  9144 raft_consensus.cc:515] T 8a25176ebf484df29f67908cfa6e2b48 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:46.587985  9116 consensus_queue.cc:1048] T d46902173b5c4283b315c6def6f13c31 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:46.589442  9144 leader_election.cc:290] T 8a25176ebf484df29f67908cfa6e2b48 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:46.589915  9115 raft_consensus.cc:2749] T f80d602267cf421690d5fe6d3922e0cb P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:46.590859  8917 raft_consensus.cc:2468] T 197670bf2e8f4301b060ed8ef6862b22 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 1.
I20260709 13:16:46.575922  9160 consensus_queue.cc:237] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:46.596589  8991 raft_consensus.cc:2468] T 197670bf2e8f4301b060ed8ef6862b22 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 1.
I20260709 13:16:46.585119  8990 raft_consensus.cc:2468] T ab679ea0af724bd39f753eb407c73264 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 0.
I20260709 13:16:46.613247  8811 leader_election.cc:304] T 197670bf2e8f4301b060ed8ef6862b22 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6; no voters: 
I20260709 13:16:46.614465  9179 raft_consensus.cc:2804] T 197670bf2e8f4301b060ed8ef6862b22 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:46.614419  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a25176ebf484df29f67908cfa6e2b48" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:46.615242  9179 raft_consensus.cc:697] T 197670bf2e8f4301b060ed8ef6862b22 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 LEADER]: Becoming Leader. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Running, Role: LEADER
I20260709 13:16:46.615839  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a25176ebf484df29f67908cfa6e2b48" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:46.616587  8769 raft_consensus.cc:2468] T 8a25176ebf484df29f67908cfa6e2b48 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 0.
I20260709 13:16:46.616288  9179 consensus_queue.cc:237] T 197670bf2e8f4301b060ed8ef6862b22 P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:46.618264  8958 leader_election.cc:304] T 8a25176ebf484df29f67908cfa6e2b48 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:16:46.619592  9144 raft_consensus.cc:2804] T 8a25176ebf484df29f67908cfa6e2b48 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:46.628345  9144 raft_consensus.cc:493] T 8a25176ebf484df29f67908cfa6e2b48 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.628855  9144 raft_consensus.cc:3060] T 8a25176ebf484df29f67908cfa6e2b48 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:46.632153  8957 leader_election.cc:343] T 8a25176ebf484df29f67908cfa6e2b48 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:46.638276  9040 tablet_bootstrap.cc:492] T 448f6ffb482841a3b489476becf2f851 P e8bb7e1240f44fda8b83e4c124852032: No bootstrap required, opened a new log
I20260709 13:16:46.639086  9040 ts_tablet_manager.cc:1403] T 448f6ffb482841a3b489476becf2f851 P e8bb7e1240f44fda8b83e4c124852032: Time spent bootstrapping tablet: real 0.213s	user 0.026s	sys 0.035s
I20260709 13:16:46.638293  8668 catalog_manager.cc:5697] T 21893ae95aed4157a65823826a6badf0 P 7d3072f2af0b481d94ed70632b90e8c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194). New cstate: current_term: 1 leader_uuid: "7d3072f2af0b481d94ed70632b90e8c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:46.641407  8882 leader_election.cc:304] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032; no voters: 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:46.642403  9052 raft_consensus.cc:2804] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:46.642905  9052 raft_consensus.cc:493] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.643373  9052 raft_consensus.cc:3060] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.646912  9161 consensus_queue.cc:1048] T ae1fc430ae3d4315aad2c0eed2f026aa P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:46.649300  9040 raft_consensus.cc:359] T 448f6ffb482841a3b489476becf2f851 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:46.650112  9040 raft_consensus.cc:385] T 448f6ffb482841a3b489476becf2f851 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.650393  9040 raft_consensus.cc:740] T 448f6ffb482841a3b489476becf2f851 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.654521  9039 tablet_bootstrap.cc:654] T ed4d847e589942fcbf6dadbb578327f2 P 7d3072f2af0b481d94ed70632b90e8c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.655144  9040 consensus_queue.cc:260] T 448f6ffb482841a3b489476becf2f851 P e8bb7e1240f44fda8b83e4c124852032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:46.658484  9038 tablet_bootstrap.cc:654] T 825ea78cebec4b10a2f8d03b45d929fa P 895d3c58761f427c9c5b3cb41246c243: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.665999  9040 ts_tablet_manager.cc:1434] T 448f6ffb482841a3b489476becf2f851 P e8bb7e1240f44fda8b83e4c124852032: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:16:46.666968  9040 tablet_bootstrap.cc:492] T ae1fc430ae3d4315aad2c0eed2f026aa P e8bb7e1240f44fda8b83e4c124852032: Bootstrap starting.
I20260709 13:16:46.682914  9040 tablet_bootstrap.cc:654] T ae1fc430ae3d4315aad2c0eed2f026aa P e8bb7e1240f44fda8b83e4c124852032: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.690937  9179 consensus_queue.cc:1048] T 4e1e1e84d68946d682e0944fbd3c51a8 P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:46.689350  8668 catalog_manager.cc:5697] T 932e5cbccd33414f8b05280505fd8bc7 P 895d3c58761f427c9c5b3cb41246c243 reported cstate change: term changed from 0 to 1, leader changed from <none> to 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "895d3c58761f427c9c5b3cb41246c243" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:46.697134  8668 catalog_manager.cc:5697] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243 reported cstate change: term changed from 0 to 1, leader changed from <none> to 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "895d3c58761f427c9c5b3cb41246c243" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:46.699697  9183 log.cc:927] Time spent T 4e1e1e84d68946d682e0944fbd3c51a8 P 895d3c58761f427c9c5b3cb41246c243: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:16:46.704454  9052 raft_consensus.cc:515] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:46.724612  9042 tablet_bootstrap.cc:492] T 67ea3c8e514f41549c3a96b74a9b5be9 P 43c6faa9496d44dda6b6eaed09cdfd12: No bootstrap required, opened a new log
I20260709 13:16:46.725451  9042 ts_tablet_manager.cc:1403] T 67ea3c8e514f41549c3a96b74a9b5be9 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent bootstrapping tablet: real 0.291s	user 0.013s	sys 0.007s
I20260709 13:16:46.730309  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab679ea0af724bd39f753eb407c73264" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
I20260709 13:16:46.731003  8991 raft_consensus.cc:3060] T ab679ea0af724bd39f753eb407c73264 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.726370  9144 raft_consensus.cc:515] T 8a25176ebf484df29f67908cfa6e2b48 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:46.736480  9179 raft_consensus.cc:493] T 825ea78cebec4b10a2f8d03b45d929fa P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.737102  9179 raft_consensus.cc:515] T 825ea78cebec4b10a2f8d03b45d929fa P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:46.738715  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a25176ebf484df29f67908cfa6e2b48" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
I20260709 13:16:46.740253  9039 tablet_bootstrap.cc:492] T ed4d847e589942fcbf6dadbb578327f2 P 7d3072f2af0b481d94ed70632b90e8c6: No bootstrap required, opened a new log
I20260709 13:16:46.740170  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825ea78cebec4b10a2f8d03b45d929fa" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:46.742830  9039 ts_tablet_manager.cc:1403] T ed4d847e589942fcbf6dadbb578327f2 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent bootstrapping tablet: real 0.185s	user 0.022s	sys 0.017s
I20260709 13:16:46.745508  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a25176ebf484df29f67908cfa6e2b48" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243"
I20260709 13:16:46.746074  9144 leader_election.cc:290] T 8a25176ebf484df29f67908cfa6e2b48 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 election: Requested vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:46.747025  9039 raft_consensus.cc:359] T ed4d847e589942fcbf6dadbb578327f2 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
W20260709 13:16:46.747740  8808 leader_election.cc:343] T 825ea78cebec4b10a2f8d03b45d929fa P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:46.747895  9039 raft_consensus.cc:385] T ed4d847e589942fcbf6dadbb578327f2 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.747457  9116 raft_consensus.cc:493] T 4352fad232ab47588683e51cf4b62080 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.746173  8768 raft_consensus.cc:3060] T 8a25176ebf484df29f67908cfa6e2b48 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.748400  9039 raft_consensus.cc:740] T ed4d847e589942fcbf6dadbb578327f2 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.748543  9116 raft_consensus.cc:515] T 4352fad232ab47588683e51cf4b62080 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
W20260709 13:16:46.749083  8957 leader_election.cc:343] T 8a25176ebf484df29f67908cfa6e2b48 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:46.749614  9039 consensus_queue.cc:260] T ed4d847e589942fcbf6dadbb578327f2 P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:46.751260  9116 leader_election.cc:290] T 4352fad232ab47588683e51cf4b62080 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:46.751461  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825ea78cebec4b10a2f8d03b45d929fa" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:46.752375  9039 ts_tablet_manager.cc:1434] T ed4d847e589942fcbf6dadbb578327f2 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:16:46.752978  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4352fad232ab47588683e51cf4b62080" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:46.753587  9039 tablet_bootstrap.cc:492] T 8a25176ebf484df29f67908cfa6e2b48 P 7d3072f2af0b481d94ed70632b90e8c6: Bootstrap starting.
W20260709 13:16:46.754498  8736 leader_election.cc:343] T 4352fad232ab47588683e51cf4b62080 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:46.756845  8810 leader_election.cc:343] T 825ea78cebec4b10a2f8d03b45d929fa P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:46.757360  8810 leader_election.cc:304] T 825ea78cebec4b10a2f8d03b45d929fa P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6; no voters: 895d3c58761f427c9c5b3cb41246c243, e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:46.758381  9130 raft_consensus.cc:2749] T 825ea78cebec4b10a2f8d03b45d929fa P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:46.759630  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4352fad232ab47588683e51cf4b62080" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:46.760046  9042 raft_consensus.cc:359] T 67ea3c8e514f41549c3a96b74a9b5be9 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:46.760792  9042 raft_consensus.cc:385] T 67ea3c8e514f41549c3a96b74a9b5be9 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.761093  9042 raft_consensus.cc:740] T 67ea3c8e514f41549c3a96b74a9b5be9 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Initialized, Role: FOLLOWER
W20260709 13:16:46.761214  8733 leader_election.cc:343] T 4352fad232ab47588683e51cf4b62080 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:46.761694  9039 tablet_bootstrap.cc:654] T 8a25176ebf484df29f67908cfa6e2b48 P 7d3072f2af0b481d94ed70632b90e8c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.761806  8733 leader_election.cc:304] T 4352fad232ab47588683e51cf4b62080 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:46.761904  9042 consensus_queue.cc:260] T 67ea3c8e514f41549c3a96b74a9b5be9 P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:46.741861  9179 leader_election.cc:290] T 825ea78cebec4b10a2f8d03b45d929fa P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:46.763482  9050 raft_consensus.cc:2749] T 4352fad232ab47588683e51cf4b62080 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:46.764375  9042 ts_tablet_manager.cc:1434] T 67ea3c8e514f41549c3a96b74a9b5be9 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260709 13:16:46.765461  9042 tablet_bootstrap.cc:492] T 359d64d36e684763884c576f961f829d P 43c6faa9496d44dda6b6eaed09cdfd12: Bootstrap starting.
I20260709 13:16:46.767603  8991 raft_consensus.cc:2468] T ab679ea0af724bd39f753eb407c73264 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 1.
I20260709 13:16:46.769027  8882 leader_election.cc:304] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:16:46.769918  9100 raft_consensus.cc:2804] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:46.770423  9100 raft_consensus.cc:697] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Becoming Leader. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Running, Role: LEADER
I20260709 13:16:46.771363  9100 consensus_queue.cc:237] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:46.774545  9039 tablet_bootstrap.cc:492] T 8a25176ebf484df29f67908cfa6e2b48 P 7d3072f2af0b481d94ed70632b90e8c6: No bootstrap required, opened a new log
I20260709 13:16:46.775213  9039 ts_tablet_manager.cc:1403] T 8a25176ebf484df29f67908cfa6e2b48 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.004s
I20260709 13:16:46.775257  9042 tablet_bootstrap.cc:654] T 359d64d36e684763884c576f961f829d P 43c6faa9496d44dda6b6eaed09cdfd12: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.775611  8664 catalog_manager.cc:5697] T 197670bf2e8f4301b060ed8ef6862b22 P 7d3072f2af0b481d94ed70632b90e8c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194). New cstate: current_term: 1 leader_uuid: "7d3072f2af0b481d94ed70632b90e8c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:46.778662  9039 raft_consensus.cc:359] T 8a25176ebf484df29f67908cfa6e2b48 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:46.779590  9039 raft_consensus.cc:385] T 8a25176ebf484df29f67908cfa6e2b48 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.779937  9039 raft_consensus.cc:740] T 8a25176ebf484df29f67908cfa6e2b48 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.780862  9039 consensus_queue.cc:260] T 8a25176ebf484df29f67908cfa6e2b48 P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:46.783097  8768 raft_consensus.cc:2468] T 8a25176ebf484df29f67908cfa6e2b48 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 1.
I20260709 13:16:46.790943  8958 leader_election.cc:304] T 8a25176ebf484df29f67908cfa6e2b48 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243, e8bb7e1240f44fda8b83e4c124852032; no voters: 7d3072f2af0b481d94ed70632b90e8c6
I20260709 13:16:46.791836  9144 raft_consensus.cc:2804] T 8a25176ebf484df29f67908cfa6e2b48 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:46.792358  9144 raft_consensus.cc:697] T 8a25176ebf484df29f67908cfa6e2b48 P e8bb7e1240f44fda8b83e4c124852032 [term 1 LEADER]: Becoming Leader. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Running, Role: LEADER
I20260709 13:16:46.793458  9144 consensus_queue.cc:237] T 8a25176ebf484df29f67908cfa6e2b48 P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:46.801748  9172 raft_consensus.cc:493] T ed4d847e589942fcbf6dadbb578327f2 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.783818  9039 ts_tablet_manager.cc:1434] T 8a25176ebf484df29f67908cfa6e2b48 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:16:46.802280  9172 raft_consensus.cc:515] T ed4d847e589942fcbf6dadbb578327f2 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:46.784549  9040 tablet_bootstrap.cc:492] T ae1fc430ae3d4315aad2c0eed2f026aa P e8bb7e1240f44fda8b83e4c124852032: No bootstrap required, opened a new log
I20260709 13:16:46.787971  9052 leader_election.cc:290] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Requested vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:46.789139  8770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab679ea0af724bd39f753eb407c73264" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243"
I20260709 13:16:46.804162  9040 ts_tablet_manager.cc:1403] T ae1fc430ae3d4315aad2c0eed2f026aa P e8bb7e1240f44fda8b83e4c124852032: Time spent bootstrapping tablet: real 0.137s	user 0.012s	sys 0.003s
W20260709 13:16:46.805611  8884 leader_election.cc:343] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:46.804555  9039 tablet_bootstrap.cc:492] T 2c3f7327ddfa499ab1e3f0996a560618 P 7d3072f2af0b481d94ed70632b90e8c6: Bootstrap starting.
I20260709 13:16:46.807088  8990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4d847e589942fcbf6dadbb578327f2" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:46.808269  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4d847e589942fcbf6dadbb578327f2" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:46.805701  9172 leader_election.cc:290] T ed4d847e589942fcbf6dadbb578327f2 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:46.809685  8810 leader_election.cc:304] T ed4d847e589942fcbf6dadbb578327f2 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6; no voters: 895d3c58761f427c9c5b3cb41246c243, e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:46.811154  9172 raft_consensus.cc:2749] T ed4d847e589942fcbf6dadbb578327f2 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:46.812091  9040 raft_consensus.cc:359] T ae1fc430ae3d4315aad2c0eed2f026aa P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:46.812911  9040 raft_consensus.cc:385] T ae1fc430ae3d4315aad2c0eed2f026aa P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.817642  9040 raft_consensus.cc:740] T ae1fc430ae3d4315aad2c0eed2f026aa P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.818332  9039 tablet_bootstrap.cc:654] T 2c3f7327ddfa499ab1e3f0996a560618 P 7d3072f2af0b481d94ed70632b90e8c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.818804  9040 consensus_queue.cc:260] T ae1fc430ae3d4315aad2c0eed2f026aa P e8bb7e1240f44fda8b83e4c124852032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:46.822661  9042 tablet_bootstrap.cc:492] T 359d64d36e684763884c576f961f829d P 43c6faa9496d44dda6b6eaed09cdfd12: No bootstrap required, opened a new log
I20260709 13:16:46.823292  9042 ts_tablet_manager.cc:1403] T 359d64d36e684763884c576f961f829d P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent bootstrapping tablet: real 0.058s	user 0.014s	sys 0.007s
I20260709 13:16:46.824605  9082 raft_consensus.cc:493] T 448f6ffb482841a3b489476becf2f851 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.824733  9040 ts_tablet_manager.cc:1434] T ae1fc430ae3d4315aad2c0eed2f026aa P e8bb7e1240f44fda8b83e4c124852032: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 13:16:46.825165  9082 raft_consensus.cc:515] T 448f6ffb482841a3b489476becf2f851 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:46.825918  9040 tablet_bootstrap.cc:492] T 825ea78cebec4b10a2f8d03b45d929fa P e8bb7e1240f44fda8b83e4c124852032: Bootstrap starting.
I20260709 13:16:46.826918  9042 raft_consensus.cc:359] T 359d64d36e684763884c576f961f829d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:46.826923  8668 catalog_manager.cc:5697] T 8a25176ebf484df29f67908cfa6e2b48 P e8bb7e1240f44fda8b83e4c124852032 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196). New cstate: current_term: 1 leader_uuid: "e8bb7e1240f44fda8b83e4c124852032" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:46.827968  9042 raft_consensus.cc:385] T 359d64d36e684763884c576f961f829d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.828442  9042 raft_consensus.cc:740] T 359d64d36e684763884c576f961f829d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.828941  9082 leader_election.cc:290] T 448f6ffb482841a3b489476becf2f851 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:46.829193  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448f6ffb482841a3b489476becf2f851" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:46.829581  9042 consensus_queue.cc:260] T 359d64d36e684763884c576f961f829d P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
W20260709 13:16:46.830749  8957 leader_election.cc:343] T 448f6ffb482841a3b489476becf2f851 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:46.831864  9042 ts_tablet_manager.cc:1434] T 359d64d36e684763884c576f961f829d P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:16:46.833244  9042 tablet_bootstrap.cc:492] T 9f7eec107ecc40f38d14871d9227b25f P 43c6faa9496d44dda6b6eaed09cdfd12: Bootstrap starting.
I20260709 13:16:46.835299  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448f6ffb482841a3b489476becf2f851" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:46.836040  8768 raft_consensus.cc:2468] T 448f6ffb482841a3b489476becf2f851 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 0.
I20260709 13:16:46.837792  9038 tablet_bootstrap.cc:492] T 825ea78cebec4b10a2f8d03b45d929fa P 895d3c58761f427c9c5b3cb41246c243: No bootstrap required, opened a new log
I20260709 13:16:46.838378  9038 ts_tablet_manager.cc:1403] T 825ea78cebec4b10a2f8d03b45d929fa P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.308s	user 0.023s	sys 0.005s
I20260709 13:16:46.841395  9038 raft_consensus.cc:359] T 825ea78cebec4b10a2f8d03b45d929fa P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:46.840967  8666 catalog_manager.cc:5697] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195). New cstate: current_term: 1 leader_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:46.842278  9042 tablet_bootstrap.cc:654] T 9f7eec107ecc40f38d14871d9227b25f P 43c6faa9496d44dda6b6eaed09cdfd12: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.842098  9038 raft_consensus.cc:385] T 825ea78cebec4b10a2f8d03b45d929fa P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.846107  9038 raft_consensus.cc:740] T 825ea78cebec4b10a2f8d03b45d929fa P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.846971  9038 consensus_queue.cc:260] T 825ea78cebec4b10a2f8d03b45d929fa P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:46.849483  9038 ts_tablet_manager.cc:1434] T 825ea78cebec4b10a2f8d03b45d929fa P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:16:46.852861  9038 tablet_bootstrap.cc:492] T 390c483b2a1c42b897e166b1a381851c P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:46.854029  9042 tablet_bootstrap.cc:492] T 9f7eec107ecc40f38d14871d9227b25f P 43c6faa9496d44dda6b6eaed09cdfd12: No bootstrap required, opened a new log
I20260709 13:16:46.854570  9042 ts_tablet_manager.cc:1403] T 9f7eec107ecc40f38d14871d9227b25f P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.007s
I20260709 13:16:46.857496  9040 tablet_bootstrap.cc:654] T 825ea78cebec4b10a2f8d03b45d929fa P e8bb7e1240f44fda8b83e4c124852032: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.857887  8958 leader_election.cc:304] T 448f6ffb482841a3b489476becf2f851 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243, e8bb7e1240f44fda8b83e4c124852032; no voters: 7d3072f2af0b481d94ed70632b90e8c6
I20260709 13:16:46.857609  9042 raft_consensus.cc:359] T 9f7eec107ecc40f38d14871d9227b25f P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:46.858537  9042 raft_consensus.cc:385] T 9f7eec107ecc40f38d14871d9227b25f P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.858806  9042 raft_consensus.cc:740] T 9f7eec107ecc40f38d14871d9227b25f P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.859155  9082 raft_consensus.cc:2804] T 448f6ffb482841a3b489476becf2f851 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:46.859650  9082 raft_consensus.cc:493] T 448f6ffb482841a3b489476becf2f851 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.860092  9082 raft_consensus.cc:3060] T 448f6ffb482841a3b489476becf2f851 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.859148  9038 tablet_bootstrap.cc:654] T 390c483b2a1c42b897e166b1a381851c P 895d3c58761f427c9c5b3cb41246c243: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.862587  9172 consensus_queue.cc:1048] T 21893ae95aed4157a65823826a6badf0 P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:46.862962  9039 tablet_bootstrap.cc:492] T 2c3f7327ddfa499ab1e3f0996a560618 P 7d3072f2af0b481d94ed70632b90e8c6: No bootstrap required, opened a new log
I20260709 13:16:46.863525  9039 ts_tablet_manager.cc:1403] T 2c3f7327ddfa499ab1e3f0996a560618 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent bootstrapping tablet: real 0.060s	user 0.012s	sys 0.000s
I20260709 13:16:46.859645  9042 consensus_queue.cc:260] T 9f7eec107ecc40f38d14871d9227b25f P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:46.868129  9039 raft_consensus.cc:359] T 2c3f7327ddfa499ab1e3f0996a560618 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:46.868850  9039 raft_consensus.cc:385] T 2c3f7327ddfa499ab1e3f0996a560618 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.869113  9039 raft_consensus.cc:740] T 2c3f7327ddfa499ab1e3f0996a560618 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.869342  9082 raft_consensus.cc:515] T 448f6ffb482841a3b489476becf2f851 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:46.869906  9039 consensus_queue.cc:260] T 2c3f7327ddfa499ab1e3f0996a560618 P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:46.876996  9042 ts_tablet_manager.cc:1434] T 9f7eec107ecc40f38d14871d9227b25f P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 13:16:46.883672  9040 tablet_bootstrap.cc:492] T 825ea78cebec4b10a2f8d03b45d929fa P e8bb7e1240f44fda8b83e4c124852032: No bootstrap required, opened a new log
I20260709 13:16:46.884274  9040 ts_tablet_manager.cc:1403] T 825ea78cebec4b10a2f8d03b45d929fa P e8bb7e1240f44fda8b83e4c124852032: Time spent bootstrapping tablet: real 0.059s	user 0.013s	sys 0.000s
I20260709 13:16:46.883953  9100 raft_consensus.cc:493] T 7bcde3fdb9314ca4b3422d395a673be5 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.889627  9082 leader_election.cc:290] T 448f6ffb482841a3b489476becf2f851 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 election: Requested vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:46.890305  9100 raft_consensus.cc:515] T 7bcde3fdb9314ca4b3422d395a673be5 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:46.892838  9100 leader_election.cc:290] T 7bcde3fdb9314ca4b3422d395a673be5 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:46.894227  9042 tablet_bootstrap.cc:492] T 2c3f7327ddfa499ab1e3f0996a560618 P 43c6faa9496d44dda6b6eaed09cdfd12: Bootstrap starting.
I20260709 13:16:46.894078  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bcde3fdb9314ca4b3422d395a673be5" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:46.897080  9040 raft_consensus.cc:359] T 825ea78cebec4b10a2f8d03b45d929fa P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:46.897500  8843 raft_consensus.cc:2468] T 7bcde3fdb9314ca4b3422d395a673be5 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 0.
I20260709 13:16:46.895351  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448f6ffb482841a3b489476becf2f851" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243"
I20260709 13:16:46.898970  8768 raft_consensus.cc:3060] T 448f6ffb482841a3b489476becf2f851 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.899176  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bcde3fdb9314ca4b3422d395a673be5" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:46.899442  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448f6ffb482841a3b489476becf2f851" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
I20260709 13:16:46.899127  9039 ts_tablet_manager.cc:1434] T 2c3f7327ddfa499ab1e3f0996a560618 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:16:46.901610  9039 tablet_bootstrap.cc:492] T 359d64d36e684763884c576f961f829d P 7d3072f2af0b481d94ed70632b90e8c6: Bootstrap starting.
I20260709 13:16:46.903519  9038 tablet_bootstrap.cc:492] T 390c483b2a1c42b897e166b1a381851c P 895d3c58761f427c9c5b3cb41246c243: No bootstrap required, opened a new log
I20260709 13:16:46.904124  9038 ts_tablet_manager.cc:1403] T 390c483b2a1c42b897e166b1a381851c P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.012s
W20260709 13:16:46.903986  8884 leader_election.cc:343] T 7bcde3fdb9314ca4b3422d395a673be5 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:46.906486  9039 tablet_bootstrap.cc:654] T 359d64d36e684763884c576f961f829d P 7d3072f2af0b481d94ed70632b90e8c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.898078  9040 raft_consensus.cc:385] T 825ea78cebec4b10a2f8d03b45d929fa P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.906895  9040 raft_consensus.cc:740] T 825ea78cebec4b10a2f8d03b45d929fa P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.907482  9172 consensus_queue.cc:1048] T 21893ae95aed4157a65823826a6badf0 P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:16:46.907793  8957 leader_election.cc:343] T 448f6ffb482841a3b489476becf2f851 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:46.907088  9038 raft_consensus.cc:359] T 390c483b2a1c42b897e166b1a381851c P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:46.908322  8883 leader_election.cc:304] T 7bcde3fdb9314ca4b3422d395a673be5 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6; no voters: 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:46.908915  9179 raft_consensus.cc:493] T 8a25176ebf484df29f67908cfa6e2b48 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.912217  9179 raft_consensus.cc:515] T 8a25176ebf484df29f67908cfa6e2b48 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:46.913935  9042 tablet_bootstrap.cc:654] T 2c3f7327ddfa499ab1e3f0996a560618 P 43c6faa9496d44dda6b6eaed09cdfd12: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.915040  9179 leader_election.cc:290] T 8a25176ebf484df29f67908cfa6e2b48 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:46.911178  9038 raft_consensus.cc:385] T 390c483b2a1c42b897e166b1a381851c P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.915922  9038 raft_consensus.cc:740] T 390c483b2a1c42b897e166b1a381851c P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.922787  9100 raft_consensus.cc:493] T 9f7eec107ecc40f38d14871d9227b25f P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.923010  9038 consensus_queue.cc:260] T 390c483b2a1c42b897e166b1a381851c P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:46.923569  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a25176ebf484df29f67908cfa6e2b48" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:46.923410  9100 raft_consensus.cc:515] T 9f7eec107ecc40f38d14871d9227b25f P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:46.924480  8769 raft_consensus.cc:2393] T 8a25176ebf484df29f67908cfa6e2b48 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3072f2af0b481d94ed70632b90e8c6 in current term 1: Already voted for candidate e8bb7e1240f44fda8b83e4c124852032 in this term.
I20260709 13:16:46.925408  9038 ts_tablet_manager.cc:1434] T 390c483b2a1c42b897e166b1a381851c P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:16:46.924989  9040 consensus_queue.cc:260] T 825ea78cebec4b10a2f8d03b45d929fa P e8bb7e1240f44fda8b83e4c124852032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:46.925966  9100 leader_election.cc:290] T 9f7eec107ecc40f38d14871d9227b25f P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:46.926445  9038 tablet_bootstrap.cc:492] T ab679ea0af724bd39f753eb407c73264 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:46.927524  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7eec107ecc40f38d14871d9227b25f" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:46.927908  9040 ts_tablet_manager.cc:1434] T 825ea78cebec4b10a2f8d03b45d929fa P e8bb7e1240f44fda8b83e4c124852032: Time spent starting tablet: real 0.043s	user 0.009s	sys 0.000s
W20260709 13:16:46.928840  8884 leader_election.cc:343] T 9f7eec107ecc40f38d14871d9227b25f P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:46.929838  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7eec107ecc40f38d14871d9227b25f" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:46.928979  9040 tablet_bootstrap.cc:492] T 2c3f7327ddfa499ab1e3f0996a560618 P e8bb7e1240f44fda8b83e4c124852032: Bootstrap starting.
W20260709 13:16:46.931819  8883 leader_election.cc:343] T 9f7eec107ecc40f38d14871d9227b25f P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:46.932312  8883 leader_election.cc:304] T 9f7eec107ecc40f38d14871d9227b25f P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12; no voters: 7d3072f2af0b481d94ed70632b90e8c6, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:46.933153  9052 raft_consensus.cc:2749] T 9f7eec107ecc40f38d14871d9227b25f P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:46.929055  9100 raft_consensus.cc:2804] T 7bcde3fdb9314ca4b3422d395a673be5 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:46.937071  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a25176ebf484df29f67908cfa6e2b48" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:46.939879  8808 leader_election.cc:304] T 8a25176ebf484df29f67908cfa6e2b48 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6; no voters: 895d3c58761f427c9c5b3cb41246c243, e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:46.941140  9179 raft_consensus.cc:3060] T 8a25176ebf484df29f67908cfa6e2b48 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.943658  9100 raft_consensus.cc:493] T 7bcde3fdb9314ca4b3422d395a673be5 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.944324  9100 raft_consensus.cc:3060] T 7bcde3fdb9314ca4b3422d395a673be5 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.951504  8991 raft_consensus.cc:3060] T ae1fc430ae3d4315aad2c0eed2f026aa P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.969588  9040 tablet_bootstrap.cc:654] T 2c3f7327ddfa499ab1e3f0996a560618 P e8bb7e1240f44fda8b83e4c124852032: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.968003  8768 raft_consensus.cc:2468] T 448f6ffb482841a3b489476becf2f851 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 1.
I20260709 13:16:46.979641  9038 tablet_bootstrap.cc:654] T ab679ea0af724bd39f753eb407c73264 P 895d3c58761f427c9c5b3cb41246c243: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.983028  8958 leader_election.cc:304] T 448f6ffb482841a3b489476becf2f851 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243, e8bb7e1240f44fda8b83e4c124852032; no voters: 7d3072f2af0b481d94ed70632b90e8c6
I20260709 13:16:46.986706  9082 raft_consensus.cc:2804] T 448f6ffb482841a3b489476becf2f851 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:46.990589  9082 raft_consensus.cc:697] T 448f6ffb482841a3b489476becf2f851 P e8bb7e1240f44fda8b83e4c124852032 [term 1 LEADER]: Becoming Leader. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Running, Role: LEADER
I20260709 13:16:46.991860  9082 consensus_queue.cc:237] T 448f6ffb482841a3b489476becf2f851 P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:46.995908  9100 raft_consensus.cc:515] T 7bcde3fdb9314ca4b3422d395a673be5 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:46.996321  9052 raft_consensus.cc:493] T 359d64d36e684763884c576f961f829d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.997006  9052 raft_consensus.cc:515] T 359d64d36e684763884c576f961f829d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:46.999217  9052 leader_election.cc:290] T 359d64d36e684763884c576f961f829d P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:47.000854  9050 consensus_queue.cc:1048] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:47.001385  9039 tablet_bootstrap.cc:492] T 359d64d36e684763884c576f961f829d P 7d3072f2af0b481d94ed70632b90e8c6: No bootstrap required, opened a new log
I20260709 13:16:47.002012  9039 ts_tablet_manager.cc:1403] T 359d64d36e684763884c576f961f829d P 7d3072f2af0b481d94ed70632b90e8c6: Time spent bootstrapping tablet: real 0.101s	user 0.014s	sys 0.030s
I20260709 13:16:47.003826  9100 leader_election.cc:290] T 7bcde3fdb9314ca4b3422d395a673be5 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Requested vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:47.005028  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bcde3fdb9314ca4b3422d395a673be5" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243"
I20260709 13:16:47.007320  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359d64d36e684763884c576f961f829d" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:47.011831  8841 raft_consensus.cc:3060] T ed4d847e589942fcbf6dadbb578327f2 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:47.012144  8883 leader_election.cc:343] T 359d64d36e684763884c576f961f829d P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:47.011843  8990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359d64d36e684763884c576f961f829d" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:47.012878  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bcde3fdb9314ca4b3422d395a673be5" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
I20260709 13:16:47.013799  8843 raft_consensus.cc:3060] T 7bcde3fdb9314ca4b3422d395a673be5 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.019871  9050 raft_consensus.cc:493] T 825ea78cebec4b10a2f8d03b45d929fa P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.020428  9050 raft_consensus.cc:515] T 825ea78cebec4b10a2f8d03b45d929fa P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:47.022521  9050 leader_election.cc:290] T 825ea78cebec4b10a2f8d03b45d929fa P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
W20260709 13:16:47.023372  8882 leader_election.cc:343] T 359d64d36e684763884c576f961f829d P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:47.023952  8882 leader_election.cc:304] T 359d64d36e684763884c576f961f829d P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12; no voters: 7d3072f2af0b481d94ed70632b90e8c6, e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:47.025193  9100 raft_consensus.cc:2749] T 359d64d36e684763884c576f961f829d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:47.025404  8990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825ea78cebec4b10a2f8d03b45d929fa" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:47.026134  8990 raft_consensus.cc:2468] T 825ea78cebec4b10a2f8d03b45d929fa P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 0.
I20260709 13:16:47.028790  8733 leader_election.cc:304] T 825ea78cebec4b10a2f8d03b45d929fa P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:16:47.029085  8845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825ea78cebec4b10a2f8d03b45d929fa" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:47.029824  8845 raft_consensus.cc:2468] T 825ea78cebec4b10a2f8d03b45d929fa P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 0.
W20260709 13:16:47.030256  8884 leader_election.cc:343] T 7bcde3fdb9314ca4b3422d395a673be5 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:47.030392  9050 raft_consensus.cc:2804] T 825ea78cebec4b10a2f8d03b45d929fa P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:47.029866  9179 raft_consensus.cc:2749] T 8a25176ebf484df29f67908cfa6e2b48 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:47.031805  9050 raft_consensus.cc:493] T 825ea78cebec4b10a2f8d03b45d929fa P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.043776  9039 raft_consensus.cc:359] T 359d64d36e684763884c576f961f829d P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:47.044952  9039 raft_consensus.cc:385] T 359d64d36e684763884c576f961f829d P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.045436  9039 raft_consensus.cc:740] T 359d64d36e684763884c576f961f829d P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.048180  9179 consensus_queue.cc:1048] T 197670bf2e8f4301b060ed8ef6862b22 P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:47.049240  9042 tablet_bootstrap.cc:492] T 2c3f7327ddfa499ab1e3f0996a560618 P 43c6faa9496d44dda6b6eaed09cdfd12: No bootstrap required, opened a new log
I20260709 13:16:47.049793  9042 ts_tablet_manager.cc:1403] T 2c3f7327ddfa499ab1e3f0996a560618 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent bootstrapping tablet: real 0.156s	user 0.008s	sys 0.014s
I20260709 13:16:47.046761  9039 consensus_queue.cc:260] T 359d64d36e684763884c576f961f829d P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:47.043318  9050 raft_consensus.cc:3060] T 825ea78cebec4b10a2f8d03b45d929fa P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.057655  8843 raft_consensus.cc:2468] T 7bcde3fdb9314ca4b3422d395a673be5 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 1.
I20260709 13:16:47.061609  8883 leader_election.cc:304] T 7bcde3fdb9314ca4b3422d395a673be5 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6; no voters: 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:47.062765  9100 raft_consensus.cc:2804] T 7bcde3fdb9314ca4b3422d395a673be5 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:47.063354  9100 raft_consensus.cc:697] T 7bcde3fdb9314ca4b3422d395a673be5 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Becoming Leader. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Running, Role: LEADER
I20260709 13:16:47.062786  9050 raft_consensus.cc:515] T 825ea78cebec4b10a2f8d03b45d929fa P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:47.064349  9040 tablet_bootstrap.cc:492] T 2c3f7327ddfa499ab1e3f0996a560618 P e8bb7e1240f44fda8b83e4c124852032: No bootstrap required, opened a new log
I20260709 13:16:47.064989  9040 ts_tablet_manager.cc:1403] T 2c3f7327ddfa499ab1e3f0996a560618 P e8bb7e1240f44fda8b83e4c124852032: Time spent bootstrapping tablet: real 0.136s	user 0.013s	sys 0.005s
I20260709 13:16:47.064284  9100 consensus_queue.cc:237] T 7bcde3fdb9314ca4b3422d395a673be5 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:47.066847  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825ea78cebec4b10a2f8d03b45d929fa" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
I20260709 13:16:47.068130  8993 raft_consensus.cc:3060] T 825ea78cebec4b10a2f8d03b45d929fa P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.071715  9038 tablet_bootstrap.cc:492] T ab679ea0af724bd39f753eb407c73264 P 895d3c58761f427c9c5b3cb41246c243: No bootstrap required, opened a new log
I20260709 13:16:47.072309  9038 ts_tablet_manager.cc:1403] T ab679ea0af724bd39f753eb407c73264 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.146s	user 0.025s	sys 0.020s
I20260709 13:16:47.072415  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825ea78cebec4b10a2f8d03b45d929fa" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
I20260709 13:16:47.074406  8843 raft_consensus.cc:3060] T 825ea78cebec4b10a2f8d03b45d929fa P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.075834  9040 raft_consensus.cc:359] T 2c3f7327ddfa499ab1e3f0996a560618 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:47.076614  9040 raft_consensus.cc:385] T 2c3f7327ddfa499ab1e3f0996a560618 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.076979  9040 raft_consensus.cc:740] T 2c3f7327ddfa499ab1e3f0996a560618 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.075066  9039 ts_tablet_manager.cc:1434] T 359d64d36e684763884c576f961f829d P 7d3072f2af0b481d94ed70632b90e8c6: Time spent starting tablet: real 0.073s	user 0.009s	sys 0.000s
I20260709 13:16:47.077684  8993 raft_consensus.cc:2468] T 825ea78cebec4b10a2f8d03b45d929fa P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 1.
I20260709 13:16:47.078864  9039 tablet_bootstrap.cc:492] T 17e47826fe4e4662baba1d095c341c1b P 7d3072f2af0b481d94ed70632b90e8c6: Bootstrap starting.
I20260709 13:16:47.079862  9040 consensus_queue.cc:260] T 2c3f7327ddfa499ab1e3f0996a560618 P e8bb7e1240f44fda8b83e4c124852032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:47.068183  9050 leader_election.cc:290] T 825ea78cebec4b10a2f8d03b45d929fa P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 election: Requested vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:47.086410  9042 raft_consensus.cc:359] T 2c3f7327ddfa499ab1e3f0996a560618 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:47.087939  9042 raft_consensus.cc:385] T 2c3f7327ddfa499ab1e3f0996a560618 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.088366  9042 raft_consensus.cc:740] T 2c3f7327ddfa499ab1e3f0996a560618 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.089984  9042 consensus_queue.cc:260] T 2c3f7327ddfa499ab1e3f0996a560618 P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:47.087607  8733 leader_election.cc:304] T 825ea78cebec4b10a2f8d03b45d929fa P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:16:47.092398  9179 raft_consensus.cc:493] T 359d64d36e684763884c576f961f829d P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.096781  9042 ts_tablet_manager.cc:1434] T 2c3f7327ddfa499ab1e3f0996a560618 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.003s
I20260709 13:16:47.096840  8845 raft_consensus.cc:3060] T 1d5284f5b067413e9fc2a383cc318735 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.099452  9050 raft_consensus.cc:2804] T 825ea78cebec4b10a2f8d03b45d929fa P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:47.101588  9040 ts_tablet_manager.cc:1434] T 2c3f7327ddfa499ab1e3f0996a560618 P e8bb7e1240f44fda8b83e4c124852032: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:16:47.102411  9040 tablet_bootstrap.cc:492] T 390c483b2a1c42b897e166b1a381851c P e8bb7e1240f44fda8b83e4c124852032: Bootstrap starting.
I20260709 13:16:47.101279  9179 raft_consensus.cc:515] T 359d64d36e684763884c576f961f829d P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:47.106930  9042 tablet_bootstrap.cc:492] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12: Bootstrap starting.
I20260709 13:16:47.108069  9179 leader_election.cc:290] T 359d64d36e684763884c576f961f829d P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:47.109593  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359d64d36e684763884c576f961f829d" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:47.110348  8919 raft_consensus.cc:2468] T 359d64d36e684763884c576f961f829d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 0.
I20260709 13:16:47.113497  8811 leader_election.cc:304] T 359d64d36e684763884c576f961f829d P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6; no voters: 
I20260709 13:16:47.113536  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359d64d36e684763884c576f961f829d" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:47.114042  9042 tablet_bootstrap.cc:654] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.100731  9050 raft_consensus.cc:697] T 825ea78cebec4b10a2f8d03b45d929fa P 895d3c58761f427c9c5b3cb41246c243 [term 1 LEADER]: Becoming Leader. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Running, Role: LEADER
I20260709 13:16:47.116499  9116 consensus_queue.cc:1048] T 932e5cbccd33414f8b05280505fd8bc7 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:16:47.117224  8808 leader_election.cc:343] T 359d64d36e684763884c576f961f829d P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:47.117280  9179 raft_consensus.cc:2804] T 359d64d36e684763884c576f961f829d P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:47.118294  9179 raft_consensus.cc:493] T 359d64d36e684763884c576f961f829d P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.116700  9050 consensus_queue.cc:237] T 825ea78cebec4b10a2f8d03b45d929fa P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:47.122733  9038 raft_consensus.cc:359] T ab679ea0af724bd39f753eb407c73264 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:47.123911  9038 raft_consensus.cc:385] T ab679ea0af724bd39f753eb407c73264 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.124279  9038 raft_consensus.cc:740] T ab679ea0af724bd39f753eb407c73264 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.125187  9038 consensus_queue.cc:260] T ab679ea0af724bd39f753eb407c73264 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:47.128616  9038 ts_tablet_manager.cc:1434] T ab679ea0af724bd39f753eb407c73264 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.000s
I20260709 13:16:47.129914  9038 tablet_bootstrap.cc:492] T 9f7eec107ecc40f38d14871d9227b25f P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:47.124907  8668 catalog_manager.cc:5697] T 448f6ffb482841a3b489476becf2f851 P e8bb7e1240f44fda8b83e4c124852032 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196). New cstate: current_term: 1 leader_uuid: "e8bb7e1240f44fda8b83e4c124852032" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:47.137734  9038 tablet_bootstrap.cc:654] T 9f7eec107ecc40f38d14871d9227b25f P 895d3c58761f427c9c5b3cb41246c243: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.141713  9039 tablet_bootstrap.cc:654] T 17e47826fe4e4662baba1d095c341c1b P 7d3072f2af0b481d94ed70632b90e8c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.143086  9130 consensus_queue.cc:1048] T 197670bf2e8f4301b060ed8ef6862b22 P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:47.147291  9040 tablet_bootstrap.cc:654] T 390c483b2a1c42b897e166b1a381851c P e8bb7e1240f44fda8b83e4c124852032: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.121532  9179 raft_consensus.cc:3060] T 359d64d36e684763884c576f961f829d P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.164793  9115 raft_consensus.cc:493] T 390c483b2a1c42b897e166b1a381851c P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.168944  9115 raft_consensus.cc:515] T 390c483b2a1c42b897e166b1a381851c P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:47.171232  9115 leader_election.cc:290] T 390c483b2a1c42b897e166b1a381851c P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:47.177597  8843 raft_consensus.cc:2468] T 825ea78cebec4b10a2f8d03b45d929fa P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 1.
I20260709 13:16:47.175832  8990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c483b2a1c42b897e166b1a381851c" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:47.178716  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c483b2a1c42b897e166b1a381851c" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:47.179873  9116 consensus_queue.cc:1048] T 932e5cbccd33414f8b05280505fd8bc7 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:16:47.181000  8733 leader_election.cc:343] T 390c483b2a1c42b897e166b1a381851c P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:47.184788  9042 tablet_bootstrap.cc:492] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12: No bootstrap required, opened a new log
I20260709 13:16:47.185437  9042 ts_tablet_manager.cc:1403] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent bootstrapping tablet: real 0.080s	user 0.021s	sys 0.028s
I20260709 13:16:47.187283  8667 catalog_manager.cc:5697] T 7bcde3fdb9314ca4b3422d395a673be5 P 43c6faa9496d44dda6b6eaed09cdfd12 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195). New cstate: current_term: 1 leader_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:47.188246  8734 leader_election.cc:343] T 390c483b2a1c42b897e166b1a381851c P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:47.188792  8734 leader_election.cc:304] T 390c483b2a1c42b897e166b1a381851c P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243; no voters: 7d3072f2af0b481d94ed70632b90e8c6, e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:47.188607  9179 raft_consensus.cc:515] T 359d64d36e684763884c576f961f829d P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:47.199662  9179 leader_election.cc:290] T 359d64d36e684763884c576f961f829d P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 election: Requested vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:47.201078  9039 tablet_bootstrap.cc:492] T 17e47826fe4e4662baba1d095c341c1b P 7d3072f2af0b481d94ed70632b90e8c6: No bootstrap required, opened a new log
I20260709 13:16:47.201750  9039 ts_tablet_manager.cc:1403] T 17e47826fe4e4662baba1d095c341c1b P 7d3072f2af0b481d94ed70632b90e8c6: Time spent bootstrapping tablet: real 0.123s	user 0.014s	sys 0.007s
I20260709 13:16:47.193252  9115 raft_consensus.cc:2749] T 390c483b2a1c42b897e166b1a381851c P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:47.204556  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359d64d36e684763884c576f961f829d" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:16:47.204907  9039 raft_consensus.cc:359] T 17e47826fe4e4662baba1d095c341c1b P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:47.205286  8917 raft_consensus.cc:3060] T 359d64d36e684763884c576f961f829d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.205426  9042 raft_consensus.cc:359] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:47.206244  9042 raft_consensus.cc:385] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.206385  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359d64d36e684763884c576f961f829d" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
I20260709 13:16:47.206586  9042 raft_consensus.cc:740] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.206640  9038 tablet_bootstrap.cc:492] T 9f7eec107ecc40f38d14871d9227b25f P 895d3c58761f427c9c5b3cb41246c243: No bootstrap required, opened a new log
I20260709 13:16:47.207420  9038 ts_tablet_manager.cc:1403] T 9f7eec107ecc40f38d14871d9227b25f P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.078s	user 0.015s	sys 0.003s
I20260709 13:16:47.207948  9042 consensus_queue.cc:260] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
W20260709 13:16:47.213939  8808 leader_election.cc:343] T 359d64d36e684763884c576f961f829d P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:47.207481  9160 consensus_queue.cc:1048] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:16:47.219771  9179 raft_consensus.cc:493] T 2c3f7327ddfa499ab1e3f0996a560618 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.221566  8917 raft_consensus.cc:2468] T 359d64d36e684763884c576f961f829d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 1.
I20260709 13:16:47.221202  9179 raft_consensus.cc:515] T 2c3f7327ddfa499ab1e3f0996a560618 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:47.223742  9039 raft_consensus.cc:385] T 17e47826fe4e4662baba1d095c341c1b P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.224094  9039 raft_consensus.cc:740] T 17e47826fe4e4662baba1d095c341c1b P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.219128  9038 raft_consensus.cc:359] T 9f7eec107ecc40f38d14871d9227b25f P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:47.223356  9100 raft_consensus.cc:493] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.228901  9100 raft_consensus.cc:515] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:47.231649  9038 raft_consensus.cc:385] T 9f7eec107ecc40f38d14871d9227b25f P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.232677  9038 raft_consensus.cc:740] T 9f7eec107ecc40f38d14871d9227b25f P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.233173  9042 ts_tablet_manager.cc:1434] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent starting tablet: real 0.047s	user 0.005s	sys 0.002s
I20260709 13:16:47.233544  9038 consensus_queue.cc:260] T 9f7eec107ecc40f38d14871d9227b25f P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:47.240578  9042 tablet_bootstrap.cc:492] T f80d602267cf421690d5fe6d3922e0cb P 43c6faa9496d44dda6b6eaed09cdfd12: Bootstrap starting.
I20260709 13:16:47.240578  9039 consensus_queue.cc:260] T 17e47826fe4e4662baba1d095c341c1b P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:47.228418  8811 leader_election.cc:304] T 359d64d36e684763884c576f961f829d P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6; no voters: e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:47.237824  9100 leader_election.cc:290] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:47.253145  8768 raft_consensus.cc:3060] T ab679ea0af724bd39f753eb407c73264 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.254061  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4352fad232ab47588683e51cf4b62080" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:47.254133  9180 raft_consensus.cc:2804] T 359d64d36e684763884c576f961f829d P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:47.254802  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c3f7327ddfa499ab1e3f0996a560618" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:47.255257  9180 raft_consensus.cc:697] T 359d64d36e684763884c576f961f829d P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 LEADER]: Becoming Leader. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Running, Role: LEADER
I20260709 13:16:47.255646  8991 raft_consensus.cc:2468] T 2c3f7327ddfa499ab1e3f0996a560618 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 0.
I20260709 13:16:47.256263  9180 consensus_queue.cc:237] T 359d64d36e684763884c576f961f829d P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:47.264060  9039 ts_tablet_manager.cc:1434] T 17e47826fe4e4662baba1d095c341c1b P 7d3072f2af0b481d94ed70632b90e8c6: Time spent starting tablet: real 0.062s	user 0.009s	sys 0.000s
I20260709 13:16:47.265849  9039 tablet_bootstrap.cc:492] T 390c483b2a1c42b897e166b1a381851c P 7d3072f2af0b481d94ed70632b90e8c6: Bootstrap starting.
I20260709 13:16:47.271586  9038 ts_tablet_manager.cc:1434] T 9f7eec107ecc40f38d14871d9227b25f P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.064s	user 0.009s	sys 0.001s
I20260709 13:16:47.265594  9179 leader_election.cc:290] T 2c3f7327ddfa499ab1e3f0996a560618 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:47.274696  9038 tablet_bootstrap.cc:492] T 7bcde3fdb9314ca4b3422d395a673be5 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:47.264850  9100 raft_consensus.cc:493] T 67ea3c8e514f41549c3a96b74a9b5be9 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.276890  9100 raft_consensus.cc:515] T 67ea3c8e514f41549c3a96b74a9b5be9 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:47.275915  8808 leader_election.cc:304] T 2c3f7327ddfa499ab1e3f0996a560618 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:16:47.254923  8769 raft_consensus.cc:2468] T 4352fad232ab47588683e51cf4b62080 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 0.
I20260709 13:16:47.268775  9052 raft_consensus.cc:493] T 2c3f7327ddfa499ab1e3f0996a560618 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.285090  8845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ea3c8e514f41549c3a96b74a9b5be9" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:47.285912  8845 raft_consensus.cc:2468] T 67ea3c8e514f41549c3a96b74a9b5be9 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 0.
I20260709 13:16:47.287240  8883 leader_election.cc:304] T 67ea3c8e514f41549c3a96b74a9b5be9 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6; no voters: 
I20260709 13:16:47.288682  9152 raft_consensus.cc:2804] T 67ea3c8e514f41549c3a96b74a9b5be9 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:47.289084  9152 raft_consensus.cc:493] T 67ea3c8e514f41549c3a96b74a9b5be9 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.288970  9052 raft_consensus.cc:515] T 2c3f7327ddfa499ab1e3f0996a560618 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:47.289515  9152 raft_consensus.cc:3060] T 67ea3c8e514f41549c3a96b74a9b5be9 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.280097  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4352fad232ab47588683e51cf4b62080" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:47.295040  8884 leader_election.cc:304] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243; no voters: 
I20260709 13:16:47.295616  9100 leader_election.cc:290] T 67ea3c8e514f41549c3a96b74a9b5be9 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:47.295920  8845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c3f7327ddfa499ab1e3f0996a560618" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:47.296357  9082 consensus_queue.cc:1048] T 8a25176ebf484df29f67908cfa6e2b48 P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:47.299718  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c3f7327ddfa499ab1e3f0996a560618" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:47.300534  8919 raft_consensus.cc:2468] T 2c3f7327ddfa499ab1e3f0996a560618 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 0.
I20260709 13:16:47.305790  9040 tablet_bootstrap.cc:492] T 390c483b2a1c42b897e166b1a381851c P e8bb7e1240f44fda8b83e4c124852032: No bootstrap required, opened a new log
I20260709 13:16:47.291397  9052 leader_election.cc:290] T 2c3f7327ddfa499ab1e3f0996a560618 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:47.306401  9040 ts_tablet_manager.cc:1403] T 390c483b2a1c42b897e166b1a381851c P e8bb7e1240f44fda8b83e4c124852032: Time spent bootstrapping tablet: real 0.204s	user 0.022s	sys 0.004s
I20260709 13:16:47.306955  9052 raft_consensus.cc:2804] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:47.307366  9052 raft_consensus.cc:493] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.307775  9052 raft_consensus.cc:3060] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.294945  8664 catalog_manager.cc:5697] T 825ea78cebec4b10a2f8d03b45d929fa P 895d3c58761f427c9c5b3cb41246c243 reported cstate change: term changed from 0 to 1, leader changed from <none> to 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "895d3c58761f427c9c5b3cb41246c243" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:47.306360  9042 tablet_bootstrap.cc:654] T f80d602267cf421690d5fe6d3922e0cb P 43c6faa9496d44dda6b6eaed09cdfd12: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.322557  9040 raft_consensus.cc:359] T 390c483b2a1c42b897e166b1a381851c P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:47.323676  9040 raft_consensus.cc:385] T 390c483b2a1c42b897e166b1a381851c P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.326011  9152 raft_consensus.cc:515] T 67ea3c8e514f41549c3a96b74a9b5be9 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:47.324036  9040 raft_consensus.cc:740] T 390c483b2a1c42b897e166b1a381851c P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.281687  9179 raft_consensus.cc:2804] T 2c3f7327ddfa499ab1e3f0996a560618 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:47.328457  9040 consensus_queue.cc:260] T 390c483b2a1c42b897e166b1a381851c P e8bb7e1240f44fda8b83e4c124852032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:47.330046  9226 consensus_queue.cc:1048] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:47.338954  9040 ts_tablet_manager.cc:1434] T 390c483b2a1c42b897e166b1a381851c P e8bb7e1240f44fda8b83e4c124852032: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.002s
I20260709 13:16:47.340523  9040 tablet_bootstrap.cc:492] T 67ea3c8e514f41549c3a96b74a9b5be9 P e8bb7e1240f44fda8b83e4c124852032: Bootstrap starting.
I20260709 13:16:47.332135  9179 raft_consensus.cc:493] T 2c3f7327ddfa499ab1e3f0996a560618 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.353389  9179 raft_consensus.cc:3060] T 2c3f7327ddfa499ab1e3f0996a560618 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.357573  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ea3c8e514f41549c3a96b74a9b5be9" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
I20260709 13:16:47.358268  9039 tablet_bootstrap.cc:654] T 390c483b2a1c42b897e166b1a381851c P 7d3072f2af0b481d94ed70632b90e8c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.358388  8841 raft_consensus.cc:3060] T 67ea3c8e514f41549c3a96b74a9b5be9 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.360389  9050 raft_consensus.cc:493] T ab679ea0af724bd39f753eb407c73264 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.358280  9040 tablet_bootstrap.cc:654] T 67ea3c8e514f41549c3a96b74a9b5be9 P e8bb7e1240f44fda8b83e4c124852032: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.365619  9038 tablet_bootstrap.cc:654] T 7bcde3fdb9314ca4b3422d395a673be5 P 895d3c58761f427c9c5b3cb41246c243: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.360927  9050 raft_consensus.cc:515] T ab679ea0af724bd39f753eb407c73264 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
W20260709 13:16:47.347141  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:46105, user_credentials={real_user=slave}} blocked reactor thread for 55839.3us
I20260709 13:16:47.380538  9050 leader_election.cc:290] T ab679ea0af724bd39f753eb407c73264 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:47.383332  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab679ea0af724bd39f753eb407c73264" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:47.391816  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab679ea0af724bd39f753eb407c73264" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:47.392524  8993 raft_consensus.cc:2468] T ab679ea0af724bd39f753eb407c73264 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 1.
I20260709 13:16:47.384065  9152 leader_election.cc:290] T 67ea3c8e514f41549c3a96b74a9b5be9 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Requested vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:47.396194  8733 leader_election.cc:304] T ab679ea0af724bd39f753eb407c73264 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243, e8bb7e1240f44fda8b83e4c124852032; no voters: 43c6faa9496d44dda6b6eaed09cdfd12
I20260709 13:16:47.400704  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c3f7327ddfa499ab1e3f0996a560618" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:47.401460  8993 raft_consensus.cc:2468] T 2c3f7327ddfa499ab1e3f0996a560618 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 0.
I20260709 13:16:47.402477  9082 consensus_queue.cc:1048] T 8a25176ebf484df29f67908cfa6e2b48 P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:16:47.404387  8882 leader_election.cc:343] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:47.421892  8716 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:47.424028  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ea3c8e514f41549c3a96b74a9b5be9" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:47.420563  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ea3c8e514f41549c3a96b74a9b5be9" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
I20260709 13:16:47.432649  9052 raft_consensus.cc:515] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:47.437320  9042 tablet_bootstrap.cc:492] T f80d602267cf421690d5fe6d3922e0cb P 43c6faa9496d44dda6b6eaed09cdfd12: No bootstrap required, opened a new log
I20260709 13:16:47.437925  9042 ts_tablet_manager.cc:1403] T f80d602267cf421690d5fe6d3922e0cb P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent bootstrapping tablet: real 0.198s	user 0.017s	sys 0.005s
I20260709 13:16:47.438589  8664 catalog_manager.cc:5697] T 359d64d36e684763884c576f961f829d P 7d3072f2af0b481d94ed70632b90e8c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194). New cstate: current_term: 1 leader_uuid: "7d3072f2af0b481d94ed70632b90e8c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:47.445814  9050 raft_consensus.cc:2804] T ab679ea0af724bd39f753eb407c73264 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:47.446162  9042 raft_consensus.cc:359] T f80d602267cf421690d5fe6d3922e0cb P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:47.447173  9042 raft_consensus.cc:385] T f80d602267cf421690d5fe6d3922e0cb P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.447523  9042 raft_consensus.cc:740] T f80d602267cf421690d5fe6d3922e0cb P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.448444  9042 consensus_queue.cc:260] T f80d602267cf421690d5fe6d3922e0cb P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:47.448747  9050 raft_consensus.cc:493] T ab679ea0af724bd39f753eb407c73264 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 43c6faa9496d44dda6b6eaed09cdfd12)
I20260709 13:16:47.449467  9050 raft_consensus.cc:3060] T ab679ea0af724bd39f753eb407c73264 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:47.451087  9042 ts_tablet_manager.cc:1434] T f80d602267cf421690d5fe6d3922e0cb P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent starting tablet: real 0.013s	user 0.001s	sys 0.005s
I20260709 13:16:47.458247  8841 raft_consensus.cc:2468] T 67ea3c8e514f41549c3a96b74a9b5be9 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 1.
I20260709 13:16:47.459824  8883 leader_election.cc:304] T 67ea3c8e514f41549c3a96b74a9b5be9 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6; no voters: 
I20260709 13:16:47.458467  9039 tablet_bootstrap.cc:492] T 390c483b2a1c42b897e166b1a381851c P 7d3072f2af0b481d94ed70632b90e8c6: No bootstrap required, opened a new log
I20260709 13:16:47.461251  9039 ts_tablet_manager.cc:1403] T 390c483b2a1c42b897e166b1a381851c P 7d3072f2af0b481d94ed70632b90e8c6: Time spent bootstrapping tablet: real 0.196s	user 0.017s	sys 0.005s
I20260709 13:16:47.461853  9042 tablet_bootstrap.cc:492] T d64af92885f944f9b1ecf193ede281b3 P 43c6faa9496d44dda6b6eaed09cdfd12: Bootstrap starting.
I20260709 13:16:47.469511  9052 leader_election.cc:290] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Requested vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:47.417043  8882 leader_election.cc:304] T 2c3f7327ddfa499ab1e3f0996a560618 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032; no voters: 
W20260709 13:16:47.470610  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:46105, user_credentials={real_user=slave}} blocked reactor thread for 53707.2us
I20260709 13:16:47.475286  8990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4352fad232ab47588683e51cf4b62080" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
W20260709 13:16:47.478513  8882 leader_election.cc:343] T 67ea3c8e514f41549c3a96b74a9b5be9 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:47.478639  8770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4352fad232ab47588683e51cf4b62080" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243"
I20260709 13:16:47.459641  9179 raft_consensus.cc:515] T 2c3f7327ddfa499ab1e3f0996a560618 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:47.482400  8845 raft_consensus.cc:2393] T 2c3f7327ddfa499ab1e3f0996a560618 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43c6faa9496d44dda6b6eaed09cdfd12 in current term 1: Already voted for candidate 7d3072f2af0b481d94ed70632b90e8c6 in this term.
I20260709 13:16:47.463073  9231 raft_consensus.cc:2804] T 67ea3c8e514f41549c3a96b74a9b5be9 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:47.483665  9179 leader_election.cc:290] T 2c3f7327ddfa499ab1e3f0996a560618 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 election: Requested vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:47.483774  9231 raft_consensus.cc:697] T 67ea3c8e514f41549c3a96b74a9b5be9 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Becoming Leader. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Running, Role: LEADER
I20260709 13:16:47.485198  9231 consensus_queue.cc:237] T 67ea3c8e514f41549c3a96b74a9b5be9 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:47.487963  8770 raft_consensus.cc:3060] T 4352fad232ab47588683e51cf4b62080 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.488214  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c3f7327ddfa499ab1e3f0996a560618" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
W20260709 13:16:47.489435  8882 leader_election.cc:343] T 67ea3c8e514f41549c3a96b74a9b5be9 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:47.496990  9082 consensus_queue.cc:1048] T 448f6ffb482841a3b489476becf2f851 P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:47.489907  9052 raft_consensus.cc:2804] T 2c3f7327ddfa499ab1e3f0996a560618 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:47.497937  9052 raft_consensus.cc:493] T 2c3f7327ddfa499ab1e3f0996a560618 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.498535  9052 raft_consensus.cc:3060] T 2c3f7327ddfa499ab1e3f0996a560618 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:47.500069  8957 consensus_peers.cc:597] T 448f6ffb482841a3b489476becf2f851 P e8bb7e1240f44fda8b83e4c124852032 -> Peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Couldn't send request to peer 7d3072f2af0b481d94ed70632b90e8c6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:47.495980  9039 raft_consensus.cc:359] T 390c483b2a1c42b897e166b1a381851c P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:47.500967  9039 raft_consensus.cc:385] T 390c483b2a1c42b897e166b1a381851c P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.501441  9039 raft_consensus.cc:740] T 390c483b2a1c42b897e166b1a381851c P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.502180  8990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c3f7327ddfa499ab1e3f0996a560618" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
I20260709 13:16:47.503120  8990 raft_consensus.cc:3060] T 2c3f7327ddfa499ab1e3f0996a560618 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.507966  9115 raft_consensus.cc:493] T 9f7eec107ecc40f38d14871d9227b25f P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.503201  9039 consensus_queue.cc:260] T 390c483b2a1c42b897e166b1a381851c P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:47.508540  9115 raft_consensus.cc:515] T 9f7eec107ecc40f38d14871d9227b25f P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:47.510843  9115 leader_election.cc:290] T 9f7eec107ecc40f38d14871d9227b25f P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:47.512880  9042 tablet_bootstrap.cc:654] T d64af92885f944f9b1ecf193ede281b3 P 43c6faa9496d44dda6b6eaed09cdfd12: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.513196  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7eec107ecc40f38d14871d9227b25f" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:47.514210  8919 raft_consensus.cc:2468] T 9f7eec107ecc40f38d14871d9227b25f P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 0.
I20260709 13:16:47.515864  8736 leader_election.cc:304] T 9f7eec107ecc40f38d14871d9227b25f P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243; no voters: 
I20260709 13:16:47.516707  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7eec107ecc40f38d14871d9227b25f" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:47.516973  9160 raft_consensus.cc:2804] T 9f7eec107ecc40f38d14871d9227b25f P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:47.517393  9160 raft_consensus.cc:493] T 9f7eec107ecc40f38d14871d9227b25f P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.517724  9160 raft_consensus.cc:3060] T 9f7eec107ecc40f38d14871d9227b25f P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.510845  9039 ts_tablet_manager.cc:1434] T 390c483b2a1c42b897e166b1a381851c P 7d3072f2af0b481d94ed70632b90e8c6: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.001s
I20260709 13:16:47.520255  9225 consensus_queue.cc:1048] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:16:47.520886  8734 leader_election.cc:343] T 9f7eec107ecc40f38d14871d9227b25f P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:47.528198  9050 raft_consensus.cc:515] T ab679ea0af724bd39f753eb407c73264 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:47.533212  8990 raft_consensus.cc:2468] T 2c3f7327ddfa499ab1e3f0996a560618 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 1.
I20260709 13:16:47.534884  8808 leader_election.cc:304] T 2c3f7327ddfa499ab1e3f0996a560618 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:16:47.536008  9229 raft_consensus.cc:2804] T 2c3f7327ddfa499ab1e3f0996a560618 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:47.536674  9229 raft_consensus.cc:697] T 2c3f7327ddfa499ab1e3f0996a560618 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 LEADER]: Becoming Leader. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Running, Role: LEADER
I20260709 13:16:47.538059  9229 consensus_queue.cc:237] T 2c3f7327ddfa499ab1e3f0996a560618 P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:47.539806  8769 raft_consensus.cc:1240] T ab679ea0af724bd39f753eb407c73264 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Rejecting Update request from peer 43c6faa9496d44dda6b6eaed09cdfd12 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:47.547410  9039 tablet_bootstrap.cc:492] T 448f6ffb482841a3b489476becf2f851 P 7d3072f2af0b481d94ed70632b90e8c6: Bootstrap starting.
I20260709 13:16:47.557389  9050 leader_election.cc:290] T ab679ea0af724bd39f753eb407c73264 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 election: Requested vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:47.525805  8770 raft_consensus.cc:2468] T 4352fad232ab47588683e51cf4b62080 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 1.
I20260709 13:16:47.560689  9040 tablet_bootstrap.cc:492] T 67ea3c8e514f41549c3a96b74a9b5be9 P e8bb7e1240f44fda8b83e4c124852032: No bootstrap required, opened a new log
I20260709 13:16:47.562568  9038 tablet_bootstrap.cc:492] T 7bcde3fdb9314ca4b3422d395a673be5 P 895d3c58761f427c9c5b3cb41246c243: No bootstrap required, opened a new log
I20260709 13:16:47.563136  9040 ts_tablet_manager.cc:1403] T 67ea3c8e514f41549c3a96b74a9b5be9 P e8bb7e1240f44fda8b83e4c124852032: Time spent bootstrapping tablet: real 0.223s	user 0.034s	sys 0.017s
I20260709 13:16:47.563261  9038 ts_tablet_manager.cc:1403] T 7bcde3fdb9314ca4b3422d395a673be5 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.291s	user 0.022s	sys 0.011s
W20260709 13:16:47.544215  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:46105, user_credentials={real_user=slave}} blocked reactor thread for 46724.8us
I20260709 13:16:47.566917  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab679ea0af724bd39f753eb407c73264" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:16:47.571954  8990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab679ea0af724bd39f753eb407c73264" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
I20260709 13:16:47.572816  8990 raft_consensus.cc:3060] T ab679ea0af724bd39f753eb407c73264 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:47.576017  9227 raft_consensus.cc:493] T 390c483b2a1c42b897e166b1a381851c P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.576911  9227 raft_consensus.cc:515] T 390c483b2a1c42b897e166b1a381851c P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:47.582059  9038 raft_consensus.cc:359] T 7bcde3fdb9314ca4b3422d395a673be5 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:47.583119  9038 raft_consensus.cc:385] T 7bcde3fdb9314ca4b3422d395a673be5 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.583654  9038 raft_consensus.cc:740] T 7bcde3fdb9314ca4b3422d395a673be5 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.584649  9038 consensus_queue.cc:260] T 7bcde3fdb9314ca4b3422d395a673be5 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:47.583685  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c483b2a1c42b897e166b1a381851c" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
W20260709 13:16:47.587344  8882 leader_election.cc:343] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:47.616402  9038 ts_tablet_manager.cc:1434] T 7bcde3fdb9314ca4b3422d395a673be5 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.053s	user 0.009s	sys 0.000s
I20260709 13:16:47.618386  9038 tablet_bootstrap.cc:492] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:47.604019  8991 raft_consensus.cc:2468] T 390c483b2a1c42b897e166b1a381851c P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 0.
I20260709 13:16:47.629370  8808 leader_election.cc:304] T 390c483b2a1c42b897e166b1a381851c P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:16:47.630586  9227 leader_election.cc:290] T 390c483b2a1c42b897e166b1a381851c P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:47.630759  9180 raft_consensus.cc:2804] T 390c483b2a1c42b897e166b1a381851c P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:47.631071  9039 tablet_bootstrap.cc:654] T 448f6ffb482841a3b489476becf2f851 P 7d3072f2af0b481d94ed70632b90e8c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.633777  8770 raft_consensus.cc:3060] T 7bcde3fdb9314ca4b3422d395a673be5 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.633986  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c483b2a1c42b897e166b1a381851c" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:47.635126  8766 raft_consensus.cc:2468] T 390c483b2a1c42b897e166b1a381851c P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 0.
I20260709 13:16:47.621088  8884 leader_election.cc:304] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243; no voters: e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:47.641229  9231 raft_consensus.cc:2804] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:47.641741  9231 raft_consensus.cc:697] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Becoming Leader. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Running, Role: LEADER
I20260709 13:16:47.641882  9226 raft_consensus.cc:493] T f80d602267cf421690d5fe6d3922e0cb P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.634343  9116 consensus_queue.cc:1048] T 825ea78cebec4b10a2f8d03b45d929fa P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:47.642812  9100 consensus_queue.cc:1059] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:16:47.631420  9180 raft_consensus.cc:493] T 390c483b2a1c42b897e166b1a381851c P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.642616  9226 raft_consensus.cc:515] T f80d602267cf421690d5fe6d3922e0cb P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
W20260709 13:16:47.658226  9237 log.cc:927] Time spent T 8a25176ebf484df29f67908cfa6e2b48 P 895d3c58761f427c9c5b3cb41246c243: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:16:47.660804  9100 raft_consensus.cc:3055] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:47.661247  9100 raft_consensus.cc:740] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Running, Role: LEADER
I20260709 13:16:47.662119  9100 consensus_queue.cc:260] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:47.642645  9231 consensus_queue.cc:237] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:47.649573  9038 tablet_bootstrap.cc:654] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.662766  9160 raft_consensus.cc:515] T 9f7eec107ecc40f38d14871d9227b25f P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:47.665725  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80d602267cf421690d5fe6d3922e0cb" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:47.650794  9180 raft_consensus.cc:3060] T 390c483b2a1c42b897e166b1a381851c P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.654866  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80d602267cf421690d5fe6d3922e0cb" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:47.669790  8769 raft_consensus.cc:2468] T f80d602267cf421690d5fe6d3922e0cb P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 0.
W20260709 13:16:47.671653  8883 leader_election.cc:343] T f80d602267cf421690d5fe6d3922e0cb P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:47.650558  9227 raft_consensus.cc:493] T 17e47826fe4e4662baba1d095c341c1b P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.674458  9227 raft_consensus.cc:515] T 17e47826fe4e4662baba1d095c341c1b P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:47.675500  9048 consensus_queue.cc:1048] T 825ea78cebec4b10a2f8d03b45d929fa P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:47.676620  8884 leader_election.cc:304] T f80d602267cf421690d5fe6d3922e0cb P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243; no voters: 7d3072f2af0b481d94ed70632b90e8c6
I20260709 13:16:47.663374  9100 raft_consensus.cc:3060] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:47.686916  9042 tablet_bootstrap.cc:492] T d64af92885f944f9b1ecf193ede281b3 P 43c6faa9496d44dda6b6eaed09cdfd12: No bootstrap required, opened a new log
I20260709 13:16:47.687597  9042 ts_tablet_manager.cc:1403] T d64af92885f944f9b1ecf193ede281b3 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent bootstrapping tablet: real 0.226s	user 0.023s	sys 0.006s
I20260709 13:16:47.649580  9040 raft_consensus.cc:359] T 67ea3c8e514f41549c3a96b74a9b5be9 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:47.689563  9040 raft_consensus.cc:385] T 67ea3c8e514f41549c3a96b74a9b5be9 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.690729  9040 raft_consensus.cc:740] T 67ea3c8e514f41549c3a96b74a9b5be9 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.692515  9040 consensus_queue.cc:260] T 67ea3c8e514f41549c3a96b74a9b5be9 P e8bb7e1240f44fda8b83e4c124852032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:47.653019  9226 leader_election.cc:290] T f80d602267cf421690d5fe6d3922e0cb P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:47.694730  9052 raft_consensus.cc:515] T 2c3f7327ddfa499ab1e3f0996a560618 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:47.686012  9225 raft_consensus.cc:2804] T f80d602267cf421690d5fe6d3922e0cb P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:47.713964  9225 raft_consensus.cc:493] T f80d602267cf421690d5fe6d3922e0cb P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.733052  9225 raft_consensus.cc:3060] T f80d602267cf421690d5fe6d3922e0cb P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.744696  9042 raft_consensus.cc:359] T d64af92885f944f9b1ecf193ede281b3 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:47.748162  9052 leader_election.cc:290] T 2c3f7327ddfa499ab1e3f0996a560618 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Requested vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:47.749284  8845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c3f7327ddfa499ab1e3f0996a560618" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
I20260709 13:16:47.751801  9042 raft_consensus.cc:385] T d64af92885f944f9b1ecf193ede281b3 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.739060  8917 raft_consensus.cc:2393] T 2c3f7327ddfa499ab1e3f0996a560618 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3072f2af0b481d94ed70632b90e8c6 in current term 1: Already voted for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in this term.
I20260709 13:16:47.747182  9160 leader_election.cc:290] T 9f7eec107ecc40f38d14871d9227b25f P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 election: Requested vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:47.754513  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7eec107ecc40f38d14871d9227b25f" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
I20260709 13:16:47.756758  9042 raft_consensus.cc:740] T d64af92885f944f9b1ecf193ede281b3 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.765290  9040 ts_tablet_manager.cc:1434] T 67ea3c8e514f41549c3a96b74a9b5be9 P e8bb7e1240f44fda8b83e4c124852032: Time spent starting tablet: real 0.202s	user 0.015s	sys 0.008s
I20260709 13:16:47.767237  9040 tablet_bootstrap.cc:492] T d64af92885f944f9b1ecf193ede281b3 P e8bb7e1240f44fda8b83e4c124852032: Bootstrap starting.
I20260709 13:16:47.767890  9042 consensus_queue.cc:260] T d64af92885f944f9b1ecf193ede281b3 P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:47.752027  8990 raft_consensus.cc:2468] T ab679ea0af724bd39f753eb407c73264 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 2.
I20260709 13:16:47.776062  9052 consensus_queue.cc:1048] T 7bcde3fdb9314ca4b3422d395a673be5 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:47.776326  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7eec107ecc40f38d14871d9227b25f" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:16:47.776988  8918 raft_consensus.cc:3060] T 9f7eec107ecc40f38d14871d9227b25f P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.778136  9227 leader_election.cc:290] T 17e47826fe4e4662baba1d095c341c1b P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:47.781638  9180 raft_consensus.cc:515] T 390c483b2a1c42b897e166b1a381851c P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:47.789412  8991 raft_consensus.cc:1240] T ab679ea0af724bd39f753eb407c73264 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Rejecting Update request from peer 43c6faa9496d44dda6b6eaed09cdfd12 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:16:47.794832  9039 tablet_bootstrap.cc:492] T 448f6ffb482841a3b489476becf2f851 P 7d3072f2af0b481d94ed70632b90e8c6: No bootstrap required, opened a new log
I20260709 13:16:47.796293  9039 ts_tablet_manager.cc:1403] T 448f6ffb482841a3b489476becf2f851 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent bootstrapping tablet: real 0.253s	user 0.024s	sys 0.019s
I20260709 13:16:47.800249  9042 ts_tablet_manager.cc:1434] T d64af92885f944f9b1ecf193ede281b3 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent starting tablet: real 0.112s	user 0.008s	sys 0.000s
I20260709 13:16:47.802299  9042 tablet_bootstrap.cc:492] T 1c9bb56a39d44b71b44c334e0bea59a5 P 43c6faa9496d44dda6b6eaed09cdfd12: Bootstrap starting.
I20260709 13:16:47.799304  8990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c3f7327ddfa499ab1e3f0996a560618" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
I20260709 13:16:47.804111  8990 raft_consensus.cc:2393] T 2c3f7327ddfa499ab1e3f0996a560618 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 43c6faa9496d44dda6b6eaed09cdfd12 in current term 1: Already voted for candidate 7d3072f2af0b481d94ed70632b90e8c6 in this term.
I20260709 13:16:47.808169  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e47826fe4e4662baba1d095c341c1b" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
W20260709 13:16:47.820628  8734 leader_election.cc:343] T 9f7eec107ecc40f38d14871d9227b25f P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:47.822417  8733 leader_election.cc:304] T ab679ea0af724bd39f753eb407c73264 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243, e8bb7e1240f44fda8b83e4c124852032; no voters: 43c6faa9496d44dda6b6eaed09cdfd12
I20260709 13:16:47.823954  9050 raft_consensus.cc:2804] T ab679ea0af724bd39f753eb407c73264 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:47.810150  8770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e47826fe4e4662baba1d095c341c1b" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:47.824474  9050 raft_consensus.cc:697] T ab679ea0af724bd39f753eb407c73264 P 895d3c58761f427c9c5b3cb41246c243 [term 2 LEADER]: Becoming Leader. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Running, Role: LEADER
I20260709 13:16:47.825443  9050 consensus_queue.cc:237] T ab679ea0af724bd39f753eb407c73264 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:47.817754  8882 leader_election.cc:304] T 2c3f7327ddfa499ab1e3f0996a560618 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12; no voters: 7d3072f2af0b481d94ed70632b90e8c6, e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:47.829567  9052 raft_consensus.cc:2749] T 2c3f7327ddfa499ab1e3f0996a560618 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:16:47.832355  8810 leader_election.cc:343] T 17e47826fe4e4662baba1d095c341c1b P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:47.840634  8990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c483b2a1c42b897e166b1a381851c" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
I20260709 13:16:47.841387  8990 raft_consensus.cc:3060] T 390c483b2a1c42b897e166b1a381851c P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.845497  9130 consensus_queue.cc:1048] T 359d64d36e684763884c576f961f829d P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:47.847100  9180 leader_election.cc:290] T 390c483b2a1c42b897e166b1a381851c P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 election: Requested vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
W20260709 13:16:47.847677  8811 leader_election.cc:343] T 17e47826fe4e4662baba1d095c341c1b P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:47.848076  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c483b2a1c42b897e166b1a381851c" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243"
I20260709 13:16:47.848839  8768 raft_consensus.cc:3060] T 390c483b2a1c42b897e166b1a381851c P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.852228  8811 leader_election.cc:304] T 17e47826fe4e4662baba1d095c341c1b P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:47.853317  9229 raft_consensus.cc:2749] T 17e47826fe4e4662baba1d095c341c1b P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:47.858608  9039 raft_consensus.cc:359] T 448f6ffb482841a3b489476becf2f851 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:47.859615  9039 raft_consensus.cc:385] T 448f6ffb482841a3b489476becf2f851 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.859859  9039 raft_consensus.cc:740] T 448f6ffb482841a3b489476becf2f851 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.867151  8918 raft_consensus.cc:2468] T 9f7eec107ecc40f38d14871d9227b25f P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 1.
I20260709 13:16:47.865813  8664 catalog_manager.cc:5697] T 2c3f7327ddfa499ab1e3f0996a560618 P 7d3072f2af0b481d94ed70632b90e8c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194). New cstate: current_term: 1 leader_uuid: "7d3072f2af0b481d94ed70632b90e8c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:47.852018  9225 raft_consensus.cc:515] T f80d602267cf421690d5fe6d3922e0cb P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:47.869663  9100 consensus_queue.cc:1048] T 7bcde3fdb9314ca4b3422d395a673be5 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:16:47.870688  9246 log.cc:927] Time spent T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:16:47.876179  8808 consensus_peers.cc:597] T 359d64d36e684763884c576f961f829d P 7d3072f2af0b481d94ed70632b90e8c6 -> Peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Couldn't send request to peer e8bb7e1240f44fda8b83e4c124852032. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:47.868929  9039 consensus_queue.cc:260] T 448f6ffb482841a3b489476becf2f851 P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:47.913646  9039 ts_tablet_manager.cc:1434] T 448f6ffb482841a3b489476becf2f851 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent starting tablet: real 0.117s	user 0.007s	sys 0.000s
I20260709 13:16:47.914785  9039 tablet_bootstrap.cc:492] T f80d602267cf421690d5fe6d3922e0cb P 7d3072f2af0b481d94ed70632b90e8c6: Bootstrap starting.
I20260709 13:16:47.915416  8768 raft_consensus.cc:2468] T 390c483b2a1c42b897e166b1a381851c P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 1.
I20260709 13:16:47.916734  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80d602267cf421690d5fe6d3922e0cb" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
I20260709 13:16:47.917191  9247 raft_consensus.cc:493] T 67ea3c8e514f41549c3a96b74a9b5be9 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.917723  9247 raft_consensus.cc:515] T 67ea3c8e514f41549c3a96b74a9b5be9 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
W20260709 13:16:47.918365  8883 leader_election.cc:343] T f80d602267cf421690d5fe6d3922e0cb P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:47.920102  8810 leader_election.cc:304] T 390c483b2a1c42b897e166b1a381851c P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6, 895d3c58761f427c9c5b3cb41246c243; no voters: 
I20260709 13:16:47.920766  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80d602267cf421690d5fe6d3922e0cb" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243"
I20260709 13:16:47.921372  9229 raft_consensus.cc:2804] T 390c483b2a1c42b897e166b1a381851c P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:47.921468  8768 raft_consensus.cc:3060] T f80d602267cf421690d5fe6d3922e0cb P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.921880  9038 tablet_bootstrap.cc:492] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243: No bootstrap required, opened a new log
I20260709 13:16:47.922554  9038 ts_tablet_manager.cc:1403] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.304s	user 0.017s	sys 0.021s
I20260709 13:16:47.923010  9247 leader_election.cc:290] T 67ea3c8e514f41549c3a96b74a9b5be9 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:47.923332  8990 raft_consensus.cc:2468] T 390c483b2a1c42b897e166b1a381851c P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 1.
I20260709 13:16:47.924376  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ea3c8e514f41549c3a96b74a9b5be9" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:47.924641  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ea3c8e514f41549c3a96b74a9b5be9" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:47.925469  8841 raft_consensus.cc:2393] T 67ea3c8e514f41549c3a96b74a9b5be9 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bb7e1240f44fda8b83e4c124852032 in current term 1: Already voted for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in this term.
I20260709 13:16:47.925789  9038 raft_consensus.cc:359] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:47.926532  9038 raft_consensus.cc:385] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.902060  9042 tablet_bootstrap.cc:654] T 1c9bb56a39d44b71b44c334e0bea59a5 P 43c6faa9496d44dda6b6eaed09cdfd12: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.899585  9225 leader_election.cc:290] T f80d602267cf421690d5fe6d3922e0cb P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Requested vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:47.885676  9040 tablet_bootstrap.cc:654] T d64af92885f944f9b1ecf193ede281b3 P e8bb7e1240f44fda8b83e4c124852032: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.926914  9038 raft_consensus.cc:740] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.922040  9229 raft_consensus.cc:697] T 390c483b2a1c42b897e166b1a381851c P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 LEADER]: Becoming Leader. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Running, Role: LEADER
I20260709 13:16:47.928791  9229 consensus_queue.cc:237] T 390c483b2a1c42b897e166b1a381851c P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:47.927443  8957 leader_election.cc:304] T 67ea3c8e514f41549c3a96b74a9b5be9 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bb7e1240f44fda8b83e4c124852032; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6
I20260709 13:16:47.940167  9038 consensus_queue.cc:260] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:47.940747  9247 raft_consensus.cc:3060] T 67ea3c8e514f41549c3a96b74a9b5be9 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.940235  8736 leader_election.cc:304] T 9f7eec107ecc40f38d14871d9227b25f P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243; no voters: 7d3072f2af0b481d94ed70632b90e8c6
I20260709 13:16:47.942683  9038 ts_tablet_manager.cc:1434] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.002s
I20260709 13:16:47.943840  9115 raft_consensus.cc:2804] T 9f7eec107ecc40f38d14871d9227b25f P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:47.943995  9038 tablet_bootstrap.cc:492] T 1c9bb56a39d44b71b44c334e0bea59a5 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:47.944419  9115 raft_consensus.cc:697] T 9f7eec107ecc40f38d14871d9227b25f P 895d3c58761f427c9c5b3cb41246c243 [term 1 LEADER]: Becoming Leader. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Running, Role: LEADER
I20260709 13:16:47.945358  9115 consensus_queue.cc:237] T 9f7eec107ecc40f38d14871d9227b25f P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:47.947678  8841 raft_consensus.cc:3060] T 448f6ffb482841a3b489476becf2f851 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.962623  9039 tablet_bootstrap.cc:654] T f80d602267cf421690d5fe6d3922e0cb P 7d3072f2af0b481d94ed70632b90e8c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.998764  8768 raft_consensus.cc:2468] T f80d602267cf421690d5fe6d3922e0cb P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 1.
I20260709 13:16:48.007296  8884 leader_election.cc:304] T f80d602267cf421690d5fe6d3922e0cb P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243; no voters: 7d3072f2af0b481d94ed70632b90e8c6
I20260709 13:16:48.009078  9247 raft_consensus.cc:2749] T 67ea3c8e514f41549c3a96b74a9b5be9 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:48.010414  9231 raft_consensus.cc:2804] T f80d602267cf421690d5fe6d3922e0cb P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:48.011026  9231 raft_consensus.cc:697] T f80d602267cf421690d5fe6d3922e0cb P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Becoming Leader. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Running, Role: LEADER
I20260709 13:16:48.011641  9227 consensus_queue.cc:1048] T 2c3f7327ddfa499ab1e3f0996a560618 P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:48.013867  9231 consensus_queue.cc:237] T f80d602267cf421690d5fe6d3922e0cb P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:48.002349  9040 tablet_bootstrap.cc:492] T d64af92885f944f9b1ecf193ede281b3 P e8bb7e1240f44fda8b83e4c124852032: No bootstrap required, opened a new log
I20260709 13:16:48.020426  9042 tablet_bootstrap.cc:492] T 1c9bb56a39d44b71b44c334e0bea59a5 P 43c6faa9496d44dda6b6eaed09cdfd12: No bootstrap required, opened a new log
I20260709 13:16:48.020946  9042 ts_tablet_manager.cc:1403] T 1c9bb56a39d44b71b44c334e0bea59a5 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent bootstrapping tablet: real 0.219s	user 0.018s	sys 0.000s
I20260709 13:16:48.033013  9038 tablet_bootstrap.cc:654] T 1c9bb56a39d44b71b44c334e0bea59a5 P 895d3c58761f427c9c5b3cb41246c243: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.033537  9040 ts_tablet_manager.cc:1403] T d64af92885f944f9b1ecf193ede281b3 P e8bb7e1240f44fda8b83e4c124852032: Time spent bootstrapping tablet: real 0.267s	user 0.006s	sys 0.031s
I20260709 13:16:48.037119  9040 raft_consensus.cc:359] T d64af92885f944f9b1ecf193ede281b3 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:48.038091  9040 raft_consensus.cc:385] T d64af92885f944f9b1ecf193ede281b3 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.038393  9040 raft_consensus.cc:740] T d64af92885f944f9b1ecf193ede281b3 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.039156  9040 consensus_queue.cc:260] T d64af92885f944f9b1ecf193ede281b3 P e8bb7e1240f44fda8b83e4c124852032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:48.039958  9042 raft_consensus.cc:359] T 1c9bb56a39d44b71b44c334e0bea59a5 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:48.040815  9042 raft_consensus.cc:385] T 1c9bb56a39d44b71b44c334e0bea59a5 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.041136  9042 raft_consensus.cc:740] T 1c9bb56a39d44b71b44c334e0bea59a5 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.042302  9042 consensus_queue.cc:260] T 1c9bb56a39d44b71b44c334e0bea59a5 P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:48.044346  9040 ts_tablet_manager.cc:1434] T d64af92885f944f9b1ecf193ede281b3 P e8bb7e1240f44fda8b83e4c124852032: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:16:48.032073  8664 catalog_manager.cc:5697] T ab679ea0af724bd39f753eb407c73264 P 895d3c58761f427c9c5b3cb41246c243 reported cstate change: term changed from 1 to 2, leader changed from 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195) to 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193). New cstate: current_term: 2 leader_uuid: "895d3c58761f427c9c5b3cb41246c243" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:48.044651  9042 ts_tablet_manager.cc:1434] T 1c9bb56a39d44b71b44c334e0bea59a5 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:16:48.045544  9040 tablet_bootstrap.cc:492] T 65900ac9e06944639fe557200317fe05 P e8bb7e1240f44fda8b83e4c124852032: Bootstrap starting.
I20260709 13:16:48.052515  9042 tablet_bootstrap.cc:492] T 17e47826fe4e4662baba1d095c341c1b P 43c6faa9496d44dda6b6eaed09cdfd12: Bootstrap starting.
I20260709 13:16:48.061224  9040 tablet_bootstrap.cc:654] T 65900ac9e06944639fe557200317fe05 P e8bb7e1240f44fda8b83e4c124852032: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.064313  9038 tablet_bootstrap.cc:492] T 1c9bb56a39d44b71b44c334e0bea59a5 P 895d3c58761f427c9c5b3cb41246c243: No bootstrap required, opened a new log
I20260709 13:16:48.066365  8668 catalog_manager.cc:5697] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195). New cstate: current_term: 1 leader_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:48.068293  9042 tablet_bootstrap.cc:654] T 17e47826fe4e4662baba1d095c341c1b P 43c6faa9496d44dda6b6eaed09cdfd12: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.069226  9038 ts_tablet_manager.cc:1403] T 1c9bb56a39d44b71b44c334e0bea59a5 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.125s	user 0.010s	sys 0.006s
I20260709 13:16:48.070420  8668 catalog_manager.cc:5697] T 67ea3c8e514f41549c3a96b74a9b5be9 P 43c6faa9496d44dda6b6eaed09cdfd12 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195). New cstate: current_term: 1 leader_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:48.077646  9038 raft_consensus.cc:359] T 1c9bb56a39d44b71b44c334e0bea59a5 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:48.078356  9038 raft_consensus.cc:385] T 1c9bb56a39d44b71b44c334e0bea59a5 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.078617  9038 raft_consensus.cc:740] T 1c9bb56a39d44b71b44c334e0bea59a5 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.079334  9038 consensus_queue.cc:260] T 1c9bb56a39d44b71b44c334e0bea59a5 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:48.082347  9038 ts_tablet_manager.cc:1434] T 1c9bb56a39d44b71b44c334e0bea59a5 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:16:48.085616  9039 tablet_bootstrap.cc:492] T f80d602267cf421690d5fe6d3922e0cb P 7d3072f2af0b481d94ed70632b90e8c6: No bootstrap required, opened a new log
I20260709 13:16:48.085850  9038 tablet_bootstrap.cc:492] T 17e47826fe4e4662baba1d095c341c1b P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:48.086426  9039 ts_tablet_manager.cc:1403] T f80d602267cf421690d5fe6d3922e0cb P 7d3072f2af0b481d94ed70632b90e8c6: Time spent bootstrapping tablet: real 0.172s	user 0.013s	sys 0.010s
I20260709 13:16:48.092075  9130 consensus_queue.cc:1048] T 2c3f7327ddfa499ab1e3f0996a560618 P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:48.093091  9038 tablet_bootstrap.cc:654] T 17e47826fe4e4662baba1d095c341c1b P 895d3c58761f427c9c5b3cb41246c243: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.098739  9231 raft_consensus.cc:493] T d64af92885f944f9b1ecf193ede281b3 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.099560  9231 raft_consensus.cc:515] T d64af92885f944f9b1ecf193ede281b3 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:48.109579  8990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64af92885f944f9b1ecf193ede281b3" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:48.110327  8990 raft_consensus.cc:2468] T d64af92885f944f9b1ecf193ede281b3 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 0.
I20260709 13:16:48.112022  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64af92885f944f9b1ecf193ede281b3" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:48.113099  8882 leader_election.cc:304] T d64af92885f944f9b1ecf193ede281b3 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:16:48.114166  9225 raft_consensus.cc:2804] T d64af92885f944f9b1ecf193ede281b3 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:48.114627  9225 raft_consensus.cc:493] T d64af92885f944f9b1ecf193ede281b3 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.115056  9225 raft_consensus.cc:3060] T d64af92885f944f9b1ecf193ede281b3 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.116707  9231 leader_election.cc:290] T d64af92885f944f9b1ecf193ede281b3 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
W20260709 13:16:48.118376  8883 leader_election.cc:343] T d64af92885f944f9b1ecf193ede281b3 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:48.119196  9039 raft_consensus.cc:359] T f80d602267cf421690d5fe6d3922e0cb P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:48.119988  9039 raft_consensus.cc:385] T f80d602267cf421690d5fe6d3922e0cb P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.120358  9039 raft_consensus.cc:740] T f80d602267cf421690d5fe6d3922e0cb P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.120781  9038 tablet_bootstrap.cc:492] T 17e47826fe4e4662baba1d095c341c1b P 895d3c58761f427c9c5b3cb41246c243: No bootstrap required, opened a new log
I20260709 13:16:48.121284  9038 ts_tablet_manager.cc:1403] T 17e47826fe4e4662baba1d095c341c1b P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.001s
I20260709 13:16:48.126763  9039 consensus_queue.cc:260] T f80d602267cf421690d5fe6d3922e0cb P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:48.128592  9052 consensus_queue.cc:1048] T 67ea3c8e514f41549c3a96b74a9b5be9 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:48.129496  9039 ts_tablet_manager.cc:1434] T f80d602267cf421690d5fe6d3922e0cb P 7d3072f2af0b481d94ed70632b90e8c6: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 13:16:48.130499  9130 raft_consensus.cc:493] T f80d602267cf421690d5fe6d3922e0cb P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.131016  9130 raft_consensus.cc:515] T f80d602267cf421690d5fe6d3922e0cb P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:48.129117  9038 raft_consensus.cc:359] T 17e47826fe4e4662baba1d095c341c1b P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:48.131840  9038 raft_consensus.cc:385] T 17e47826fe4e4662baba1d095c341c1b P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.132138  9038 raft_consensus.cc:740] T 17e47826fe4e4662baba1d095c341c1b P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.133920  9038 consensus_queue.cc:260] T 17e47826fe4e4662baba1d095c341c1b P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:48.136401  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80d602267cf421690d5fe6d3922e0cb" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:48.137624  8769 raft_consensus.cc:2393] T f80d602267cf421690d5fe6d3922e0cb P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3072f2af0b481d94ed70632b90e8c6 in current term 1: Already voted for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in this term.
I20260709 13:16:48.137867  9038 ts_tablet_manager.cc:1434] T 17e47826fe4e4662baba1d095c341c1b P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:16:48.138988  9038 tablet_bootstrap.cc:492] T 80fde6a0b6334446923248a50e223397 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:48.139865  8668 catalog_manager.cc:5697] T f80d602267cf421690d5fe6d3922e0cb P 43c6faa9496d44dda6b6eaed09cdfd12 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195). New cstate: current_term: 1 leader_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:48.141377  9130 leader_election.cc:290] T f80d602267cf421690d5fe6d3922e0cb P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:48.141552  9052 consensus_queue.cc:1048] T 67ea3c8e514f41549c3a96b74a9b5be9 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:48.142531  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80d602267cf421690d5fe6d3922e0cb" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:48.133957  8666 catalog_manager.cc:5697] T 390c483b2a1c42b897e166b1a381851c P 7d3072f2af0b481d94ed70632b90e8c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194). New cstate: current_term: 1 leader_uuid: "7d3072f2af0b481d94ed70632b90e8c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:48.144081  8811 leader_election.cc:304] T f80d602267cf421690d5fe6d3922e0cb P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:48.144989  9130 raft_consensus.cc:3060] T f80d602267cf421690d5fe6d3922e0cb P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.154321  9038 tablet_bootstrap.cc:654] T 80fde6a0b6334446923248a50e223397 P 895d3c58761f427c9c5b3cb41246c243: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.168520  9040 tablet_bootstrap.cc:492] T 65900ac9e06944639fe557200317fe05 P e8bb7e1240f44fda8b83e4c124852032: No bootstrap required, opened a new log
I20260709 13:16:48.169391  9040 ts_tablet_manager.cc:1403] T 65900ac9e06944639fe557200317fe05 P e8bb7e1240f44fda8b83e4c124852032: Time spent bootstrapping tablet: real 0.124s	user 0.032s	sys 0.017s
I20260709 13:16:48.169687  9039 tablet_bootstrap.cc:492] T d64af92885f944f9b1ecf193ede281b3 P 7d3072f2af0b481d94ed70632b90e8c6: Bootstrap starting.
I20260709 13:16:48.176980  9225 raft_consensus.cc:515] T d64af92885f944f9b1ecf193ede281b3 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:48.182842  9038 tablet_bootstrap.cc:492] T 80fde6a0b6334446923248a50e223397 P 895d3c58761f427c9c5b3cb41246c243: No bootstrap required, opened a new log
I20260709 13:16:48.180536  9040 raft_consensus.cc:359] T 65900ac9e06944639fe557200317fe05 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:48.186115  9040 raft_consensus.cc:385] T 65900ac9e06944639fe557200317fe05 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.186461  9040 raft_consensus.cc:740] T 65900ac9e06944639fe557200317fe05 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.187161  9040 consensus_queue.cc:260] T 65900ac9e06944639fe557200317fe05 P e8bb7e1240f44fda8b83e4c124852032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:48.189278  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64af92885f944f9b1ecf193ede281b3" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
I20260709 13:16:48.190790  9040 ts_tablet_manager.cc:1434] T 65900ac9e06944639fe557200317fe05 P e8bb7e1240f44fda8b83e4c124852032: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
W20260709 13:16:48.190979  8883 leader_election.cc:343] T d64af92885f944f9b1ecf193ede281b3 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:48.190395  8664 catalog_manager.cc:5697] T 9f7eec107ecc40f38d14871d9227b25f P 895d3c58761f427c9c5b3cb41246c243 reported cstate change: term changed from 0 to 1, leader changed from <none> to 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "895d3c58761f427c9c5b3cb41246c243" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:48.191900  9040 tablet_bootstrap.cc:492] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032: Bootstrap starting.
I20260709 13:16:48.196449  9130 raft_consensus.cc:2749] T f80d602267cf421690d5fe6d3922e0cb P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:48.198807  9038 ts_tablet_manager.cc:1403] T 80fde6a0b6334446923248a50e223397 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.060s	user 0.013s	sys 0.000s
I20260709 13:16:48.202010  9038 raft_consensus.cc:359] T 80fde6a0b6334446923248a50e223397 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:48.202715  9038 raft_consensus.cc:385] T 80fde6a0b6334446923248a50e223397 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.203037  9038 raft_consensus.cc:740] T 80fde6a0b6334446923248a50e223397 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.206079  9040 tablet_bootstrap.cc:654] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.212903  9039 tablet_bootstrap.cc:654] T d64af92885f944f9b1ecf193ede281b3 P 7d3072f2af0b481d94ed70632b90e8c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.213949  9038 consensus_queue.cc:260] T 80fde6a0b6334446923248a50e223397 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
W20260709 13:16:48.215364  8882 consensus_peers.cc:597] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Couldn't send request to peer e8bb7e1240f44fda8b83e4c124852032. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:48.216445  9038 ts_tablet_manager.cc:1434] T 80fde6a0b6334446923248a50e223397 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:16:48.217456  9038 tablet_bootstrap.cc:492] T f3ea64f4f4c54500a95692118660d9b4 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:48.225595  9040 tablet_bootstrap.cc:492] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032: No bootstrap required, opened a new log
I20260709 13:16:48.226172  9040 ts_tablet_manager.cc:1403] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032: Time spent bootstrapping tablet: real 0.034s	user 0.008s	sys 0.003s
I20260709 13:16:48.232810  9040 raft_consensus.cc:359] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:48.233605  9040 raft_consensus.cc:385] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.233902  9040 raft_consensus.cc:740] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.241200  9040 consensus_queue.cc:260] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:48.244484  9038 tablet_bootstrap.cc:654] T f3ea64f4f4c54500a95692118660d9b4 P 895d3c58761f427c9c5b3cb41246c243: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.245219  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64af92885f944f9b1ecf193ede281b3" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
I20260709 13:16:48.246109  8992 raft_consensus.cc:3060] T d64af92885f944f9b1ecf193ede281b3 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.250039  9040 ts_tablet_manager.cc:1434] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:16:48.253063  9040 tablet_bootstrap.cc:492] T 359d64d36e684763884c576f961f829d P e8bb7e1240f44fda8b83e4c124852032: Bootstrap starting.
I20260709 13:16:48.253456  9225 leader_election.cc:290] T d64af92885f944f9b1ecf193ede281b3 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Requested vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:48.260010  9247 raft_consensus.cc:493] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.260643  9247 raft_consensus.cc:515] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:48.262928  9247 leader_election.cc:290] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:48.265527  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9bb56a39d44b71b44c334e0bea59a5" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:48.266486  8918 raft_consensus.cc:2468] T 1c9bb56a39d44b71b44c334e0bea59a5 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 0.
I20260709 13:16:48.265729  8992 raft_consensus.cc:2468] T d64af92885f944f9b1ecf193ede281b3 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 1.
I20260709 13:16:48.265636  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9bb56a39d44b71b44c334e0bea59a5" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:48.267863  8959 leader_election.cc:304] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:16:48.268594  8769 raft_consensus.cc:2468] T 1c9bb56a39d44b71b44c334e0bea59a5 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 0.
I20260709 13:16:48.269734  9247 raft_consensus.cc:2804] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:48.270187  9247 raft_consensus.cc:493] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.270533  9247 raft_consensus.cc:3060] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.275496  9042 tablet_bootstrap.cc:492] T 17e47826fe4e4662baba1d095c341c1b P 43c6faa9496d44dda6b6eaed09cdfd12: No bootstrap required, opened a new log
I20260709 13:16:48.276132  9042 ts_tablet_manager.cc:1403] T 17e47826fe4e4662baba1d095c341c1b P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent bootstrapping tablet: real 0.224s	user 0.027s	sys 0.044s
I20260709 13:16:48.276531  9225 consensus_queue.cc:1048] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:48.278671  9247 raft_consensus.cc:515] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:48.280869  9247 leader_election.cc:290] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 election: Requested vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:48.283140  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9bb56a39d44b71b44c334e0bea59a5" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:16:48.284039  8918 raft_consensus.cc:3060] T 1c9bb56a39d44b71b44c334e0bea59a5 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.283847  9042 raft_consensus.cc:359] T 17e47826fe4e4662baba1d095c341c1b P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:48.284658  9042 raft_consensus.cc:385] T 17e47826fe4e4662baba1d095c341c1b P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.284955  9042 raft_consensus.cc:740] T 17e47826fe4e4662baba1d095c341c1b P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.285768  9042 consensus_queue.cc:260] T 17e47826fe4e4662baba1d095c341c1b P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:48.286499  9040 tablet_bootstrap.cc:654] T 359d64d36e684763884c576f961f829d P e8bb7e1240f44fda8b83e4c124852032: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.280778  8882 leader_election.cc:304] T d64af92885f944f9b1ecf193ede281b3 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032; no voters: 7d3072f2af0b481d94ed70632b90e8c6
I20260709 13:16:48.292315  9042 ts_tablet_manager.cc:1434] T 17e47826fe4e4662baba1d095c341c1b P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.001s
I20260709 13:16:48.293116  9225 raft_consensus.cc:2804] T d64af92885f944f9b1ecf193ede281b3 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:48.293552  9042 tablet_bootstrap.cc:492] T 80fde6a0b6334446923248a50e223397 P 43c6faa9496d44dda6b6eaed09cdfd12: Bootstrap starting.
I20260709 13:16:48.293659  9225 raft_consensus.cc:697] T d64af92885f944f9b1ecf193ede281b3 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Becoming Leader. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Running, Role: LEADER
I20260709 13:16:48.294654  9225 consensus_queue.cc:237] T d64af92885f944f9b1ecf193ede281b3 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:48.301612  9042 tablet_bootstrap.cc:654] T 80fde6a0b6334446923248a50e223397 P 43c6faa9496d44dda6b6eaed09cdfd12: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.302887  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9bb56a39d44b71b44c334e0bea59a5" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243"
I20260709 13:16:48.305405  9040 tablet_bootstrap.cc:492] T 359d64d36e684763884c576f961f829d P e8bb7e1240f44fda8b83e4c124852032: No bootstrap required, opened a new log
I20260709 13:16:48.305943  9040 ts_tablet_manager.cc:1403] T 359d64d36e684763884c576f961f829d P e8bb7e1240f44fda8b83e4c124852032: Time spent bootstrapping tablet: real 0.053s	user 0.005s	sys 0.012s
I20260709 13:16:48.303596  8769 raft_consensus.cc:3060] T 1c9bb56a39d44b71b44c334e0bea59a5 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.309295  9040 raft_consensus.cc:359] T 359d64d36e684763884c576f961f829d P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:48.310017  9040 raft_consensus.cc:385] T 359d64d36e684763884c576f961f829d P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.310303  9040 raft_consensus.cc:740] T 359d64d36e684763884c576f961f829d P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.310865  8918 raft_consensus.cc:2468] T 1c9bb56a39d44b71b44c334e0bea59a5 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 1.
I20260709 13:16:48.311019  9040 consensus_queue.cc:260] T 359d64d36e684763884c576f961f829d P e8bb7e1240f44fda8b83e4c124852032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:48.313746  9040 ts_tablet_manager.cc:1434] T 359d64d36e684763884c576f961f829d P e8bb7e1240f44fda8b83e4c124852032: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:16:48.313948  9039 tablet_bootstrap.cc:492] T d64af92885f944f9b1ecf193ede281b3 P 7d3072f2af0b481d94ed70632b90e8c6: No bootstrap required, opened a new log
I20260709 13:16:48.314487  9039 ts_tablet_manager.cc:1403] T d64af92885f944f9b1ecf193ede281b3 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent bootstrapping tablet: real 0.170s	user 0.021s	sys 0.025s
I20260709 13:16:48.314762  9040 tablet_bootstrap.cc:492] T 4352fad232ab47588683e51cf4b62080 P e8bb7e1240f44fda8b83e4c124852032: Bootstrap starting.
I20260709 13:16:48.319193  9038 tablet_bootstrap.cc:492] T f3ea64f4f4c54500a95692118660d9b4 P 895d3c58761f427c9c5b3cb41246c243: No bootstrap required, opened a new log
I20260709 13:16:48.319773  9038 ts_tablet_manager.cc:1403] T f3ea64f4f4c54500a95692118660d9b4 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.103s	user 0.012s	sys 0.000s
I20260709 13:16:48.322639  9038 raft_consensus.cc:359] T f3ea64f4f4c54500a95692118660d9b4 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:48.323348  9038 raft_consensus.cc:385] T f3ea64f4f4c54500a95692118660d9b4 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.323436  8992 raft_consensus.cc:1275] T ab679ea0af724bd39f753eb407c73264 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Refusing update from remote peer 895d3c58761f427c9c5b3cb41246c243: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:48.323685  9038 raft_consensus.cc:740] T f3ea64f4f4c54500a95692118660d9b4 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.324626  9038 consensus_queue.cc:260] T f3ea64f4f4c54500a95692118660d9b4 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:48.325032  9115 consensus_queue.cc:1048] T ab679ea0af724bd39f753eb407c73264 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:48.327334  9038 ts_tablet_manager.cc:1434] T f3ea64f4f4c54500a95692118660d9b4 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:16:48.328701  9039 raft_consensus.cc:359] T d64af92885f944f9b1ecf193ede281b3 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:48.333086  9038 tablet_bootstrap.cc:492] T 2945a5b174e14a5a9052897942f876c2 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:48.333495  9039 raft_consensus.cc:385] T d64af92885f944f9b1ecf193ede281b3 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.333796  9039 raft_consensus.cc:740] T d64af92885f944f9b1ecf193ede281b3 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.334460  9039 consensus_queue.cc:260] T d64af92885f944f9b1ecf193ede281b3 P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:48.340188  9039 ts_tablet_manager.cc:1434] T d64af92885f944f9b1ecf193ede281b3 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 13:16:48.345649  9115 raft_consensus.cc:493] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.346200  9039 tablet_bootstrap.cc:492] T 9f7eec107ecc40f38d14871d9227b25f P 7d3072f2af0b481d94ed70632b90e8c6: Bootstrap starting.
I20260709 13:16:48.346239  9115 raft_consensus.cc:515] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:48.337990  8959 leader_election.cc:304] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:16:48.348788  9115 leader_election.cc:290] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:48.350788  9279 raft_consensus.cc:2804] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:48.351457  9279 raft_consensus.cc:697] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 [term 1 LEADER]: Becoming Leader. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Running, Role: LEADER
I20260709 13:16:48.352880  9279 consensus_queue.cc:237] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:48.364286  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65900ac9e06944639fe557200317fe05" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:48.365064  8992 raft_consensus.cc:2468] T 65900ac9e06944639fe557200317fe05 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 0.
I20260709 13:16:48.365971  9229 consensus_queue.cc:1048] T 390c483b2a1c42b897e166b1a381851c P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:48.369063  8733 leader_election.cc:304] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:16:48.370064  9048 raft_consensus.cc:2804] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:48.370492  9048 raft_consensus.cc:493] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.370870  9048 raft_consensus.cc:3060] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.371066  8769 raft_consensus.cc:2468] T 1c9bb56a39d44b71b44c334e0bea59a5 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 1.
I20260709 13:16:48.360174  9115 raft_consensus.cc:493] T 17e47826fe4e4662baba1d095c341c1b P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.371960  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65900ac9e06944639fe557200317fe05" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:48.372107  9115 raft_consensus.cc:515] T 17e47826fe4e4662baba1d095c341c1b P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:48.361677  9040 tablet_bootstrap.cc:654] T 4352fad232ab47588683e51cf4b62080 P e8bb7e1240f44fda8b83e4c124852032: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.376957  8990 raft_consensus.cc:3060] T 359d64d36e684763884c576f961f829d P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.370013  8666 catalog_manager.cc:5697] T d64af92885f944f9b1ecf193ede281b3 P 43c6faa9496d44dda6b6eaed09cdfd12 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195). New cstate: current_term: 1 leader_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:48.374425  9115 leader_election.cc:290] T 17e47826fe4e4662baba1d095c341c1b P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:48.383833  9160 consensus_queue.cc:1048] T 9f7eec107ecc40f38d14871d9227b25f P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:16:48.399026  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e47826fe4e4662baba1d095c341c1b" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:48.410276  9115 raft_consensus.cc:493] T 80fde6a0b6334446923248a50e223397 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.415973  9115 raft_consensus.cc:515] T 80fde6a0b6334446923248a50e223397 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:48.418392  9115 leader_election.cc:290] T 80fde6a0b6334446923248a50e223397 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:48.414137  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e47826fe4e4662baba1d095c341c1b" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:48.419111  8841 raft_consensus.cc:2468] T 17e47826fe4e4662baba1d095c341c1b P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 0.
I20260709 13:16:48.413084  9229 consensus_queue.cc:1048] T 390c483b2a1c42b897e166b1a381851c P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:48.416365  9039 tablet_bootstrap.cc:654] T 9f7eec107ecc40f38d14871d9227b25f P 7d3072f2af0b481d94ed70632b90e8c6: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:48.398490  8734 leader_election.cc:343] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:48.422330  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80fde6a0b6334446923248a50e223397" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
W20260709 13:16:48.423949  8736 leader_election.cc:343] T 80fde6a0b6334446923248a50e223397 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:48.422873  8734 leader_election.cc:304] T 17e47826fe4e4662baba1d095c341c1b P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6, 895d3c58761f427c9c5b3cb41246c243; no voters: 
I20260709 13:16:48.425505  9160 raft_consensus.cc:2804] T 17e47826fe4e4662baba1d095c341c1b P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:48.425904  9160 raft_consensus.cc:493] T 17e47826fe4e4662baba1d095c341c1b P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.426241  9160 raft_consensus.cc:3060] T 17e47826fe4e4662baba1d095c341c1b P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.437484  9042 tablet_bootstrap.cc:492] T 80fde6a0b6334446923248a50e223397 P 43c6faa9496d44dda6b6eaed09cdfd12: No bootstrap required, opened a new log
I20260709 13:16:48.438143  8918 raft_consensus.cc:2468] T 17e47826fe4e4662baba1d095c341c1b P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 0.
I20260709 13:16:48.438735  8989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80fde6a0b6334446923248a50e223397" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:48.438143  9042 ts_tablet_manager.cc:1403] T 80fde6a0b6334446923248a50e223397 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent bootstrapping tablet: real 0.145s	user 0.048s	sys 0.018s
I20260709 13:16:48.442318  9042 raft_consensus.cc:359] T 80fde6a0b6334446923248a50e223397 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:48.443140  9042 raft_consensus.cc:385] T 80fde6a0b6334446923248a50e223397 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.448066  9042 raft_consensus.cc:740] T 80fde6a0b6334446923248a50e223397 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Initialized, Role: FOLLOWER
W20260709 13:16:48.442277  8733 leader_election.cc:343] T 80fde6a0b6334446923248a50e223397 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:48.449049  8733 leader_election.cc:304] T 80fde6a0b6334446923248a50e223397 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:48.449230  9042 consensus_queue.cc:260] T 80fde6a0b6334446923248a50e223397 P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:48.450518  9050 raft_consensus.cc:2749] T 80fde6a0b6334446923248a50e223397 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:48.454710  8919 raft_consensus.cc:1275] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Refusing update from remote peer 895d3c58761f427c9c5b3cb41246c243: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:48.457401  9115 consensus_queue.cc:1048] T ab679ea0af724bd39f753eb407c73264 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:48.459636  9042 ts_tablet_manager.cc:1434] T 80fde6a0b6334446923248a50e223397 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
I20260709 13:16:48.461122  9042 tablet_bootstrap.cc:492] T e3ee8f06068449de90c7fb0479f504ca P 43c6faa9496d44dda6b6eaed09cdfd12: Bootstrap starting.
W20260709 13:16:48.469151  9281 log.cc:927] Time spent T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:16:48.477823  9052 consensus_queue.cc:1048] T f80d602267cf421690d5fe6d3922e0cb P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:48.481416  9048 raft_consensus.cc:515] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
W20260709 13:16:48.483693  8734 consensus_peers.cc:597] T 9f7eec107ecc40f38d14871d9227b25f P 895d3c58761f427c9c5b3cb41246c243 -> Peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Couldn't send request to peer 7d3072f2af0b481d94ed70632b90e8c6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:48.484622  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65900ac9e06944639fe557200317fe05" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
I20260709 13:16:48.485807  9038 tablet_bootstrap.cc:654] T 2945a5b174e14a5a9052897942f876c2 P 895d3c58761f427c9c5b3cb41246c243: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.490626  8993 raft_consensus.cc:3060] T 65900ac9e06944639fe557200317fe05 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.500114  9160 raft_consensus.cc:515] T 17e47826fe4e4662baba1d095c341c1b P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:48.511605  9048 leader_election.cc:290] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 election: Requested vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:48.529076  9042 tablet_bootstrap.cc:654] T e3ee8f06068449de90c7fb0479f504ca P 43c6faa9496d44dda6b6eaed09cdfd12: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.545979  9160 leader_election.cc:290] T 17e47826fe4e4662baba1d095c341c1b P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 election: Requested vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:48.555092  9229 raft_consensus.cc:493] T d64af92885f944f9b1ecf193ede281b3 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.555841  9229 raft_consensus.cc:515] T d64af92885f944f9b1ecf193ede281b3 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:48.557777  9040 tablet_bootstrap.cc:492] T 4352fad232ab47588683e51cf4b62080 P e8bb7e1240f44fda8b83e4c124852032: No bootstrap required, opened a new log
I20260709 13:16:48.558387  9040 ts_tablet_manager.cc:1403] T 4352fad232ab47588683e51cf4b62080 P e8bb7e1240f44fda8b83e4c124852032: Time spent bootstrapping tablet: real 0.244s	user 0.024s	sys 0.046s
I20260709 13:16:48.558442  9229 leader_election.cc:290] T d64af92885f944f9b1ecf193ede281b3 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:48.562064  9040 raft_consensus.cc:359] T 4352fad232ab47588683e51cf4b62080 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:48.563519  9040 raft_consensus.cc:385] T 4352fad232ab47588683e51cf4b62080 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.563840  9040 raft_consensus.cc:740] T 4352fad232ab47588683e51cf4b62080 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.564700  9040 consensus_queue.cc:260] T 4352fad232ab47588683e51cf4b62080 P e8bb7e1240f44fda8b83e4c124852032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:48.571142  9040 ts_tablet_manager.cc:1434] T 4352fad232ab47588683e51cf4b62080 P e8bb7e1240f44fda8b83e4c124852032: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
W20260709 13:16:48.574568  8736 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37671, user_credentials={real_user=slave}} blocked reactor thread for 54308.9us
I20260709 13:16:48.575621  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65900ac9e06944639fe557200317fe05" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
I20260709 13:16:48.581843  8990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64af92885f944f9b1ecf193ede281b3" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:48.583138  9040 tablet_bootstrap.cc:492] T 80fde6a0b6334446923248a50e223397 P e8bb7e1240f44fda8b83e4c124852032: Bootstrap starting.
I20260709 13:16:48.590951  8664 catalog_manager.cc:5697] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196). New cstate: current_term: 1 leader_uuid: "e8bb7e1240f44fda8b83e4c124852032" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:48.595474  9039 tablet_bootstrap.cc:492] T 9f7eec107ecc40f38d14871d9227b25f P 7d3072f2af0b481d94ed70632b90e8c6: No bootstrap required, opened a new log
I20260709 13:16:48.597064  8993 raft_consensus.cc:2468] T 65900ac9e06944639fe557200317fe05 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 1.
W20260709 13:16:48.598048  8716 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:48.600553  9039 ts_tablet_manager.cc:1403] T 9f7eec107ecc40f38d14871d9227b25f P 7d3072f2af0b481d94ed70632b90e8c6: Time spent bootstrapping tablet: real 0.255s	user 0.019s	sys 0.008s
W20260709 13:16:48.602029  8734 leader_election.cc:343] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:48.603260  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e47826fe4e4662baba1d095c341c1b" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
I20260709 13:16:48.616341  8842 raft_consensus.cc:3060] T 17e47826fe4e4662baba1d095c341c1b P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.618765  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64af92885f944f9b1ecf193ede281b3" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:48.619398  8733 leader_election.cc:304] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243, e8bb7e1240f44fda8b83e4c124852032; no voters: 7d3072f2af0b481d94ed70632b90e8c6
I20260709 13:16:48.606642  8990 raft_consensus.cc:2393] T d64af92885f944f9b1ecf193ede281b3 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3072f2af0b481d94ed70632b90e8c6 in current term 1: Already voted for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in this term.
I20260709 13:16:48.620640  9160 raft_consensus.cc:2804] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:48.609441  9038 tablet_bootstrap.cc:492] T 2945a5b174e14a5a9052897942f876c2 P 895d3c58761f427c9c5b3cb41246c243: No bootstrap required, opened a new log
I20260709 13:16:48.621927  9038 ts_tablet_manager.cc:1403] T 2945a5b174e14a5a9052897942f876c2 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.289s	user 0.021s	sys 0.023s
I20260709 13:16:48.621754  8808 leader_election.cc:304] T d64af92885f944f9b1ecf193ede281b3 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:48.622953  9179 raft_consensus.cc:3060] T d64af92885f944f9b1ecf193ede281b3 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.629940  9160 raft_consensus.cc:697] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243 [term 1 LEADER]: Becoming Leader. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Running, Role: LEADER
I20260709 13:16:48.629606  9038 raft_consensus.cc:359] T 2945a5b174e14a5a9052897942f876c2 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:48.632611  9038 raft_consensus.cc:385] T 2945a5b174e14a5a9052897942f876c2 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.632261  9160 consensus_queue.cc:237] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:48.612157  9042 tablet_bootstrap.cc:492] T e3ee8f06068449de90c7fb0479f504ca P 43c6faa9496d44dda6b6eaed09cdfd12: No bootstrap required, opened a new log
I20260709 13:16:48.641671  9042 ts_tablet_manager.cc:1403] T e3ee8f06068449de90c7fb0479f504ca P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent bootstrapping tablet: real 0.181s	user 0.015s	sys 0.014s
I20260709 13:16:48.611708  9039 raft_consensus.cc:359] T 9f7eec107ecc40f38d14871d9227b25f P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:48.614295  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e47826fe4e4662baba1d095c341c1b" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:16:48.632936  9038 raft_consensus.cc:740] T 2945a5b174e14a5a9052897942f876c2 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.646421  8918 raft_consensus.cc:3060] T 17e47826fe4e4662baba1d095c341c1b P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.646773  9038 consensus_queue.cc:260] T 2945a5b174e14a5a9052897942f876c2 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:48.649317  9038 ts_tablet_manager.cc:1434] T 2945a5b174e14a5a9052897942f876c2 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:16:48.649606  9179 raft_consensus.cc:2749] T d64af92885f944f9b1ecf193ede281b3 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:48.650350  9038 tablet_bootstrap.cc:492] T d09ffcae84334482a706af1e812c7c9d P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:48.655339  9039 raft_consensus.cc:385] T 9f7eec107ecc40f38d14871d9227b25f P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.657904  9038 tablet_bootstrap.cc:654] T d09ffcae84334482a706af1e812c7c9d P 895d3c58761f427c9c5b3cb41246c243: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.657860  9039 raft_consensus.cc:740] T 9f7eec107ecc40f38d14871d9227b25f P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.659516  9039 consensus_queue.cc:260] T 9f7eec107ecc40f38d14871d9227b25f P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:48.662146  8918 raft_consensus.cc:2468] T 17e47826fe4e4662baba1d095c341c1b P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 1.
I20260709 13:16:48.663417  8736 leader_election.cc:304] T 17e47826fe4e4662baba1d095c341c1b P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243; no voters: 
I20260709 13:16:48.664323  9048 raft_consensus.cc:2804] T 17e47826fe4e4662baba1d095c341c1b P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:48.664822  9048 raft_consensus.cc:697] T 17e47826fe4e4662baba1d095c341c1b P 895d3c58761f427c9c5b3cb41246c243 [term 1 LEADER]: Becoming Leader. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Running, Role: LEADER
I20260709 13:16:48.665136  9226 raft_consensus.cc:493] T 80fde6a0b6334446923248a50e223397 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.665675  9226 raft_consensus.cc:515] T 80fde6a0b6334446923248a50e223397 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:48.668016  9226 leader_election.cc:290] T 80fde6a0b6334446923248a50e223397 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:48.635627  8842 raft_consensus.cc:2468] T 17e47826fe4e4662baba1d095c341c1b P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 1.
I20260709 13:16:48.669616  9039 ts_tablet_manager.cc:1434] T 9f7eec107ecc40f38d14871d9227b25f P 7d3072f2af0b481d94ed70632b90e8c6: Time spent starting tablet: real 0.069s	user 0.004s	sys 0.003s
I20260709 13:16:48.665692  9048 consensus_queue.cc:237] T 17e47826fe4e4662baba1d095c341c1b P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:48.670778  9039 tablet_bootstrap.cc:492] T 65900ac9e06944639fe557200317fe05 P 7d3072f2af0b481d94ed70632b90e8c6: Bootstrap starting.
I20260709 13:16:48.610026  9040 tablet_bootstrap.cc:654] T 80fde6a0b6334446923248a50e223397 P e8bb7e1240f44fda8b83e4c124852032: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.645051  9231 consensus_queue.cc:1048] T f80d602267cf421690d5fe6d3922e0cb P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:48.673032  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80fde6a0b6334446923248a50e223397" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:48.673821  8768 raft_consensus.cc:2468] T 80fde6a0b6334446923248a50e223397 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 0.
I20260709 13:16:48.674597  8990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80fde6a0b6334446923248a50e223397" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:48.675112  8884 leader_election.cc:304] T 80fde6a0b6334446923248a50e223397 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243; no voters: 
I20260709 13:16:48.677821  9231 raft_consensus.cc:2804] T 80fde6a0b6334446923248a50e223397 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:48.678318  9231 raft_consensus.cc:493] T 80fde6a0b6334446923248a50e223397 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.678684  9231 raft_consensus.cc:3060] T 80fde6a0b6334446923248a50e223397 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:48.679664  8882 leader_election.cc:343] T 80fde6a0b6334446923248a50e223397 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:48.681713  9038 tablet_bootstrap.cc:492] T d09ffcae84334482a706af1e812c7c9d P 895d3c58761f427c9c5b3cb41246c243: No bootstrap required, opened a new log
I20260709 13:16:48.682267  9038 ts_tablet_manager.cc:1403] T d09ffcae84334482a706af1e812c7c9d P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.005s
I20260709 13:16:48.688740  9231 raft_consensus.cc:515] T 80fde6a0b6334446923248a50e223397 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:48.690668  9042 raft_consensus.cc:359] T e3ee8f06068449de90c7fb0479f504ca P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:48.691673  9042 raft_consensus.cc:385] T e3ee8f06068449de90c7fb0479f504ca P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.691799  8990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80fde6a0b6334446923248a50e223397" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
W20260709 13:16:48.693390  8882 leader_election.cc:343] T 80fde6a0b6334446923248a50e223397 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:48.693297  9038 raft_consensus.cc:359] T d09ffcae84334482a706af1e812c7c9d P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:48.694130  9038 raft_consensus.cc:385] T d09ffcae84334482a706af1e812c7c9d P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.694442  9038 raft_consensus.cc:740] T d09ffcae84334482a706af1e812c7c9d P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.694978  9231 leader_election.cc:290] T 80fde6a0b6334446923248a50e223397 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Requested vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:48.691995  9042 raft_consensus.cc:740] T e3ee8f06068449de90c7fb0479f504ca P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.696106  9042 consensus_queue.cc:260] T e3ee8f06068449de90c7fb0479f504ca P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:48.702415  9038 consensus_queue.cc:260] T d09ffcae84334482a706af1e812c7c9d P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:48.702872  9179 raft_consensus.cc:493] T 9f7eec107ecc40f38d14871d9227b25f P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.703496  9179 raft_consensus.cc:515] T 9f7eec107ecc40f38d14871d9227b25f P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:48.704857  9038 ts_tablet_manager.cc:1434] T d09ffcae84334482a706af1e812c7c9d P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:16:48.705667  9179 leader_election.cc:290] T 9f7eec107ecc40f38d14871d9227b25f P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:48.706037  9038 tablet_bootstrap.cc:492] T 1521cafcc31b47c58829494618fc0cd8 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:48.707343  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7eec107ecc40f38d14871d9227b25f" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:48.698472  9042 ts_tablet_manager.cc:1434] T e3ee8f06068449de90c7fb0479f504ca P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent starting tablet: real 0.056s	user 0.001s	sys 0.005s
I20260709 13:16:48.709283  9042 tablet_bootstrap.cc:492] T dc5cf20be8db404dbda7f0b4a676ab31 P 43c6faa9496d44dda6b6eaed09cdfd12: Bootstrap starting.
I20260709 13:16:48.712968  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7eec107ecc40f38d14871d9227b25f" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:48.714429  8810 leader_election.cc:304] T 9f7eec107ecc40f38d14871d9227b25f P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:48.714640  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80fde6a0b6334446923248a50e223397" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243"
I20260709 13:16:48.715242  8768 raft_consensus.cc:3060] T 80fde6a0b6334446923248a50e223397 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.715267  9179 raft_consensus.cc:2749] T 9f7eec107ecc40f38d14871d9227b25f P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:48.719440  8990 raft_consensus.cc:3060] T 4352fad232ab47588683e51cf4b62080 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.727713  9038 tablet_bootstrap.cc:654] T 1521cafcc31b47c58829494618fc0cd8 P 895d3c58761f427c9c5b3cb41246c243: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.729926  8664 catalog_manager.cc:5697] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243 reported cstate change: term changed from 0 to 1, leader changed from <none> to 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "895d3c58761f427c9c5b3cb41246c243" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:48.750000  9042 tablet_bootstrap.cc:654] T dc5cf20be8db404dbda7f0b4a676ab31 P 43c6faa9496d44dda6b6eaed09cdfd12: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.752709  9040 tablet_bootstrap.cc:492] T 80fde6a0b6334446923248a50e223397 P e8bb7e1240f44fda8b83e4c124852032: No bootstrap required, opened a new log
I20260709 13:16:48.753258  9040 ts_tablet_manager.cc:1403] T 80fde6a0b6334446923248a50e223397 P e8bb7e1240f44fda8b83e4c124852032: Time spent bootstrapping tablet: real 0.170s	user 0.010s	sys 0.017s
I20260709 13:16:48.715299  9039 tablet_bootstrap.cc:654] T 65900ac9e06944639fe557200317fe05 P 7d3072f2af0b481d94ed70632b90e8c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.757735  8768 raft_consensus.cc:2468] T 80fde6a0b6334446923248a50e223397 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 1.
I20260709 13:16:48.759128  9040 raft_consensus.cc:359] T 80fde6a0b6334446923248a50e223397 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:48.760067  9040 raft_consensus.cc:385] T 80fde6a0b6334446923248a50e223397 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.760392  9040 raft_consensus.cc:740] T 80fde6a0b6334446923248a50e223397 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.761215  8884 leader_election.cc:304] T 80fde6a0b6334446923248a50e223397 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243; no voters: e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:48.761133  9040 consensus_queue.cc:260] T 80fde6a0b6334446923248a50e223397 P e8bb7e1240f44fda8b83e4c124852032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:48.762707  9226 raft_consensus.cc:2804] T 80fde6a0b6334446923248a50e223397 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:48.763223  9226 raft_consensus.cc:697] T 80fde6a0b6334446923248a50e223397 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Becoming Leader. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Running, Role: LEADER
I20260709 13:16:48.763504  9040 ts_tablet_manager.cc:1434] T 80fde6a0b6334446923248a50e223397 P e8bb7e1240f44fda8b83e4c124852032: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.002s
I20260709 13:16:48.764560  9040 tablet_bootstrap.cc:492] T e3ee8f06068449de90c7fb0479f504ca P e8bb7e1240f44fda8b83e4c124852032: Bootstrap starting.
I20260709 13:16:48.765329  9226 consensus_queue.cc:237] T 80fde6a0b6334446923248a50e223397 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:48.767627  8664 catalog_manager.cc:5697] T 17e47826fe4e4662baba1d095c341c1b P 895d3c58761f427c9c5b3cb41246c243 reported cstate change: term changed from 0 to 1, leader changed from <none> to 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "895d3c58761f427c9c5b3cb41246c243" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:48.768946  9038 tablet_bootstrap.cc:492] T 1521cafcc31b47c58829494618fc0cd8 P 895d3c58761f427c9c5b3cb41246c243: No bootstrap required, opened a new log
I20260709 13:16:48.769498  9038 ts_tablet_manager.cc:1403] T 1521cafcc31b47c58829494618fc0cd8 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.064s	user 0.015s	sys 0.000s
I20260709 13:16:48.770921  9040 tablet_bootstrap.cc:654] T e3ee8f06068449de90c7fb0479f504ca P e8bb7e1240f44fda8b83e4c124852032: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.772502  9038 raft_consensus.cc:359] T 1521cafcc31b47c58829494618fc0cd8 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:48.773272  9038 raft_consensus.cc:385] T 1521cafcc31b47c58829494618fc0cd8 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.773649  9038 raft_consensus.cc:740] T 1521cafcc31b47c58829494618fc0cd8 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.774931  9038 consensus_queue.cc:260] T 1521cafcc31b47c58829494618fc0cd8 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:48.777467  9038 ts_tablet_manager.cc:1434] T 1521cafcc31b47c58829494618fc0cd8 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.001s
I20260709 13:16:48.778477  9038 tablet_bootstrap.cc:492] T 574915613e8a4d3481aef27d3a977caa P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:48.782671  9040 tablet_bootstrap.cc:492] T e3ee8f06068449de90c7fb0479f504ca P e8bb7e1240f44fda8b83e4c124852032: No bootstrap required, opened a new log
I20260709 13:16:48.783231  9040 ts_tablet_manager.cc:1403] T e3ee8f06068449de90c7fb0479f504ca P e8bb7e1240f44fda8b83e4c124852032: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.008s
I20260709 13:16:48.786655  9040 raft_consensus.cc:359] T e3ee8f06068449de90c7fb0479f504ca P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:48.787389  9040 raft_consensus.cc:385] T e3ee8f06068449de90c7fb0479f504ca P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.787767  9040 raft_consensus.cc:740] T e3ee8f06068449de90c7fb0479f504ca P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.788559  9040 consensus_queue.cc:260] T e3ee8f06068449de90c7fb0479f504ca P e8bb7e1240f44fda8b83e4c124852032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:48.789150  9160 raft_consensus.cc:493] T f3ea64f4f4c54500a95692118660d9b4 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.789747  9160 raft_consensus.cc:515] T f3ea64f4f4c54500a95692118660d9b4 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:48.790931  9040 ts_tablet_manager.cc:1434] T e3ee8f06068449de90c7fb0479f504ca P e8bb7e1240f44fda8b83e4c124852032: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:16:48.791999  9040 tablet_bootstrap.cc:492] T 2945a5b174e14a5a9052897942f876c2 P e8bb7e1240f44fda8b83e4c124852032: Bootstrap starting.
I20260709 13:16:48.792379  9038 tablet_bootstrap.cc:654] T 574915613e8a4d3481aef27d3a977caa P 895d3c58761f427c9c5b3cb41246c243: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.798952  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea64f4f4c54500a95692118660d9b4" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:48.799517  9040 tablet_bootstrap.cc:654] T 2945a5b174e14a5a9052897942f876c2 P e8bb7e1240f44fda8b83e4c124852032: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.807192  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea64f4f4c54500a95692118660d9b4" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
W20260709 13:16:48.809314  8736 leader_election.cc:343] T f3ea64f4f4c54500a95692118660d9b4 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:48.810271  8734 leader_election.cc:343] T f3ea64f4f4c54500a95692118660d9b4 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:48.795043  8667 catalog_manager.cc:5697] T 80fde6a0b6334446923248a50e223397 P 43c6faa9496d44dda6b6eaed09cdfd12 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195). New cstate: current_term: 1 leader_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:48.812817  8734 leader_election.cc:304] T f3ea64f4f4c54500a95692118660d9b4 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6
I20260709 13:16:48.813743  9291 raft_consensus.cc:2749] T f3ea64f4f4c54500a95692118660d9b4 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:48.792052  9160 leader_election.cc:290] T f3ea64f4f4c54500a95692118660d9b4 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:48.820340  9038 tablet_bootstrap.cc:492] T 574915613e8a4d3481aef27d3a977caa P 895d3c58761f427c9c5b3cb41246c243: No bootstrap required, opened a new log
I20260709 13:16:48.821014  9038 ts_tablet_manager.cc:1403] T 574915613e8a4d3481aef27d3a977caa P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.043s	user 0.010s	sys 0.023s
I20260709 13:16:48.822995  9247 raft_consensus.cc:493] T e3ee8f06068449de90c7fb0479f504ca P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.823622  9247 raft_consensus.cc:515] T e3ee8f06068449de90c7fb0479f504ca P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:48.824292  9038 raft_consensus.cc:359] T 574915613e8a4d3481aef27d3a977caa P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:48.825645  9038 raft_consensus.cc:385] T 574915613e8a4d3481aef27d3a977caa P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.825887  9247 leader_election.cc:290] T e3ee8f06068449de90c7fb0479f504ca P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:48.825978  9038 raft_consensus.cc:740] T 574915613e8a4d3481aef27d3a977caa P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.827076  9038 consensus_queue.cc:260] T 574915613e8a4d3481aef27d3a977caa P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:48.828500  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ee8f06068449de90c7fb0479f504ca" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:48.829264  8918 raft_consensus.cc:2468] T e3ee8f06068449de90c7fb0479f504ca P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 0.
I20260709 13:16:48.830247  9038 ts_tablet_manager.cc:1434] T 574915613e8a4d3481aef27d3a977caa P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:16:48.830714  8959 leader_election.cc:304] T e3ee8f06068449de90c7fb0479f504ca P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:16:48.831632  9247 raft_consensus.cc:2804] T e3ee8f06068449de90c7fb0479f504ca P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:48.831990  9247 raft_consensus.cc:493] T e3ee8f06068449de90c7fb0479f504ca P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.831921  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ee8f06068449de90c7fb0479f504ca" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:48.832572  9247 raft_consensus.cc:3060] T e3ee8f06068449de90c7fb0479f504ca P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.832985  9038 tablet_bootstrap.cc:492] T c17f01b356e04590838cc6e6bb27bf64 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
W20260709 13:16:48.834573  8957 leader_election.cc:343] T e3ee8f06068449de90c7fb0479f504ca P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:48.831908  9042 tablet_bootstrap.cc:492] T dc5cf20be8db404dbda7f0b4a676ab31 P 43c6faa9496d44dda6b6eaed09cdfd12: No bootstrap required, opened a new log
I20260709 13:16:48.836726  9042 ts_tablet_manager.cc:1403] T dc5cf20be8db404dbda7f0b4a676ab31 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent bootstrapping tablet: real 0.128s	user 0.014s	sys 0.004s
I20260709 13:16:48.844053  9039 tablet_bootstrap.cc:492] T 65900ac9e06944639fe557200317fe05 P 7d3072f2af0b481d94ed70632b90e8c6: No bootstrap required, opened a new log
I20260709 13:16:48.840747  9247 raft_consensus.cc:515] T e3ee8f06068449de90c7fb0479f504ca P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:48.844744  9039 ts_tablet_manager.cc:1403] T 65900ac9e06944639fe557200317fe05 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent bootstrapping tablet: real 0.174s	user 0.014s	sys 0.004s
I20260709 13:16:48.845242  9160 raft_consensus.cc:493] T 2945a5b174e14a5a9052897942f876c2 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.846096  9160 raft_consensus.cc:515] T 2945a5b174e14a5a9052897942f876c2 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:48.846753  9226 consensus_queue.cc:1048] T d64af92885f944f9b1ecf193ede281b3 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:48.848627  9039 raft_consensus.cc:359] T 65900ac9e06944639fe557200317fe05 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:48.849380  9039 raft_consensus.cc:385] T 65900ac9e06944639fe557200317fe05 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.863134  9039 raft_consensus.cc:740] T 65900ac9e06944639fe557200317fe05 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.849272  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2945a5b174e14a5a9052897942f876c2" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:48.864125  9039 consensus_queue.cc:260] T 65900ac9e06944639fe557200317fe05 P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
W20260709 13:16:48.865823  8736 leader_election.cc:343] T 2945a5b174e14a5a9052897942f876c2 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:48.866835  9039 ts_tablet_manager.cc:1434] T 65900ac9e06944639fe557200317fe05 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:16:48.866590  9279 consensus_queue.cc:1048] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:48.850591  9040 tablet_bootstrap.cc:492] T 2945a5b174e14a5a9052897942f876c2 P e8bb7e1240f44fda8b83e4c124852032: No bootstrap required, opened a new log
I20260709 13:16:48.851672  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2945a5b174e14a5a9052897942f876c2" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:48.867774  9040 ts_tablet_manager.cc:1403] T 2945a5b174e14a5a9052897942f876c2 P e8bb7e1240f44fda8b83e4c124852032: Time spent bootstrapping tablet: real 0.076s	user 0.010s	sys 0.005s
I20260709 13:16:48.870455  9040 raft_consensus.cc:359] T 2945a5b174e14a5a9052897942f876c2 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:48.873071  9040 raft_consensus.cc:385] T 2945a5b174e14a5a9052897942f876c2 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.873420  9040 raft_consensus.cc:740] T 2945a5b174e14a5a9052897942f876c2 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.853768  9038 tablet_bootstrap.cc:654] T c17f01b356e04590838cc6e6bb27bf64 P 895d3c58761f427c9c5b3cb41246c243: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.874157  9040 consensus_queue.cc:260] T 2945a5b174e14a5a9052897942f876c2 P e8bb7e1240f44fda8b83e4c124852032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:48.855368  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ee8f06068449de90c7fb0479f504ca" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
I20260709 13:16:48.860376  9042 raft_consensus.cc:359] T dc5cf20be8db404dbda7f0b4a676ab31 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:48.875325  9042 raft_consensus.cc:385] T dc5cf20be8db404dbda7f0b4a676ab31 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.875669  9042 raft_consensus.cc:740] T dc5cf20be8db404dbda7f0b4a676ab31 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.876756  9040 ts_tablet_manager.cc:1434] T 2945a5b174e14a5a9052897942f876c2 P e8bb7e1240f44fda8b83e4c124852032: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 13:16:48.872740  9039 tablet_bootstrap.cc:492] T e3ee8f06068449de90c7fb0479f504ca P 7d3072f2af0b481d94ed70632b90e8c6: Bootstrap starting.
I20260709 13:16:48.881246  9042 consensus_queue.cc:260] T dc5cf20be8db404dbda7f0b4a676ab31 P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
W20260709 13:16:48.876989  8733 leader_election.cc:343] T 2945a5b174e14a5a9052897942f876c2 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:48.883222  8733 leader_election.cc:304] T 2945a5b174e14a5a9052897942f876c2 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:48.884240  9048 raft_consensus.cc:2749] T 2945a5b174e14a5a9052897942f876c2 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:16:48.878468  8957 leader_election.cc:343] T e3ee8f06068449de90c7fb0479f504ca P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:48.885757  9040 tablet_bootstrap.cc:492] T dc5cf20be8db404dbda7f0b4a676ab31 P e8bb7e1240f44fda8b83e4c124852032: Bootstrap starting.
I20260709 13:16:48.896339  8843 raft_consensus.cc:3060] T 9f7eec107ecc40f38d14871d9227b25f P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.900002  9040 tablet_bootstrap.cc:654] T dc5cf20be8db404dbda7f0b4a676ab31 P e8bb7e1240f44fda8b83e4c124852032: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.871627  9247 leader_election.cc:290] T e3ee8f06068449de90c7fb0479f504ca P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 election: Requested vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:48.887524  9042 ts_tablet_manager.cc:1434] T dc5cf20be8db404dbda7f0b4a676ab31 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.000s
I20260709 13:16:48.880146  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ee8f06068449de90c7fb0479f504ca" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:16:48.890848  9039 tablet_bootstrap.cc:654] T e3ee8f06068449de90c7fb0479f504ca P 7d3072f2af0b481d94ed70632b90e8c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.911818  8917 raft_consensus.cc:3060] T e3ee8f06068449de90c7fb0479f504ca P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.914996  9179 raft_consensus.cc:493] T 65900ac9e06944639fe557200317fe05 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.915522  9179 raft_consensus.cc:515] T 65900ac9e06944639fe557200317fe05 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:48.919080  9179 leader_election.cc:290] T 65900ac9e06944639fe557200317fe05 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:48.910570  9226 consensus_queue.cc:1048] T d64af92885f944f9b1ecf193ede281b3 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:48.920488  9042 tablet_bootstrap.cc:492] T d09ffcae84334482a706af1e812c7c9d P 43c6faa9496d44dda6b6eaed09cdfd12: Bootstrap starting.
I20260709 13:16:48.923970  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65900ac9e06944639fe557200317fe05" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:48.925139  8917 raft_consensus.cc:2468] T e3ee8f06068449de90c7fb0479f504ca P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 1.
I20260709 13:16:48.927134  8990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65900ac9e06944639fe557200317fe05" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:48.928121  8990 raft_consensus.cc:2393] T 65900ac9e06944639fe557200317fe05 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3072f2af0b481d94ed70632b90e8c6 in current term 1: Already voted for candidate 895d3c58761f427c9c5b3cb41246c243 in this term.
I20260709 13:16:48.930203  8810 leader_election.cc:304] T 65900ac9e06944639fe557200317fe05 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6; no voters: 895d3c58761f427c9c5b3cb41246c243, e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:48.933540  9179 raft_consensus.cc:3060] T 65900ac9e06944639fe557200317fe05 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.934967  8959 leader_election.cc:304] T e3ee8f06068449de90c7fb0479f504ca P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032; no voters: 7d3072f2af0b481d94ed70632b90e8c6
I20260709 13:16:48.945406  9247 raft_consensus.cc:2804] T e3ee8f06068449de90c7fb0479f504ca P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:48.946002  9247 raft_consensus.cc:697] T e3ee8f06068449de90c7fb0479f504ca P e8bb7e1240f44fda8b83e4c124852032 [term 1 LEADER]: Becoming Leader. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Running, Role: LEADER
I20260709 13:16:48.946888  9247 consensus_queue.cc:237] T e3ee8f06068449de90c7fb0479f504ca P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:48.950775  9291 raft_consensus.cc:493] T 1521cafcc31b47c58829494618fc0cd8 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.951347  9291 raft_consensus.cc:515] T 1521cafcc31b47c58829494618fc0cd8 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:48.953454  9039 tablet_bootstrap.cc:492] T e3ee8f06068449de90c7fb0479f504ca P 7d3072f2af0b481d94ed70632b90e8c6: No bootstrap required, opened a new log
I20260709 13:16:48.954311  9039 ts_tablet_manager.cc:1403] T e3ee8f06068449de90c7fb0479f504ca P 7d3072f2af0b481d94ed70632b90e8c6: Time spent bootstrapping tablet: real 0.082s	user 0.014s	sys 0.007s
I20260709 13:16:48.957013  8990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1521cafcc31b47c58829494618fc0cd8" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
W20260709 13:16:48.958395  8733 leader_election.cc:343] T 1521cafcc31b47c58829494618fc0cd8 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:48.852344  9160 leader_election.cc:290] T 2945a5b174e14a5a9052897942f876c2 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:48.960279  9039 raft_consensus.cc:359] T e3ee8f06068449de90c7fb0479f504ca P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:48.962826  9039 raft_consensus.cc:385] T e3ee8f06068449de90c7fb0479f504ca P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.963245  9039 raft_consensus.cc:740] T e3ee8f06068449de90c7fb0479f504ca P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.964083  9039 consensus_queue.cc:260] T e3ee8f06068449de90c7fb0479f504ca P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:48.966266  9039 ts_tablet_manager.cc:1434] T e3ee8f06068449de90c7fb0479f504ca P 7d3072f2af0b481d94ed70632b90e8c6: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:16:48.967228  9039 tablet_bootstrap.cc:492] T f3ea64f4f4c54500a95692118660d9b4 P 7d3072f2af0b481d94ed70632b90e8c6: Bootstrap starting.
I20260709 13:16:48.962246  9291 leader_election.cc:290] T 1521cafcc31b47c58829494618fc0cd8 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:48.977203  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1521cafcc31b47c58829494618fc0cd8" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
W20260709 13:16:48.982277  8734 leader_election.cc:343] T 1521cafcc31b47c58829494618fc0cd8 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:48.984391  9042 tablet_bootstrap.cc:654] T d09ffcae84334482a706af1e812c7c9d P 43c6faa9496d44dda6b6eaed09cdfd12: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.982844  8734 leader_election.cc:304] T 1521cafcc31b47c58829494618fc0cd8 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243; no voters: 7d3072f2af0b481d94ed70632b90e8c6, e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:48.986303  9291 raft_consensus.cc:2749] T 1521cafcc31b47c58829494618fc0cd8 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:48.991360  9040 tablet_bootstrap.cc:492] T dc5cf20be8db404dbda7f0b4a676ab31 P e8bb7e1240f44fda8b83e4c124852032: No bootstrap required, opened a new log
I20260709 13:16:48.991884  9040 ts_tablet_manager.cc:1403] T dc5cf20be8db404dbda7f0b4a676ab31 P e8bb7e1240f44fda8b83e4c124852032: Time spent bootstrapping tablet: real 0.107s	user 0.012s	sys 0.016s
I20260709 13:16:48.978504  9179 raft_consensus.cc:2749] T 65900ac9e06944639fe557200317fe05 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:48.994495  8664 catalog_manager.cc:5697] T e3ee8f06068449de90c7fb0479f504ca P e8bb7e1240f44fda8b83e4c124852032 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196). New cstate: current_term: 1 leader_uuid: "e8bb7e1240f44fda8b83e4c124852032" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:48.995957  9038 tablet_bootstrap.cc:492] T c17f01b356e04590838cc6e6bb27bf64 P 895d3c58761f427c9c5b3cb41246c243: No bootstrap required, opened a new log
I20260709 13:16:49.001094  9038 ts_tablet_manager.cc:1403] T c17f01b356e04590838cc6e6bb27bf64 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.168s	user 0.044s	sys 0.065s
I20260709 13:16:49.003461  9040 raft_consensus.cc:359] T dc5cf20be8db404dbda7f0b4a676ab31 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:49.004124  9040 raft_consensus.cc:385] T dc5cf20be8db404dbda7f0b4a676ab31 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.983207  9247 consensus_queue.cc:1048] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 13:16:49.004310  9040 raft_consensus.cc:740] T dc5cf20be8db404dbda7f0b4a676ab31 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.006285  9040 consensus_queue.cc:260] T dc5cf20be8db404dbda7f0b4a676ab31 P e8bb7e1240f44fda8b83e4c124852032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:49.010298  9040 ts_tablet_manager.cc:1434] T dc5cf20be8db404dbda7f0b4a676ab31 P e8bb7e1240f44fda8b83e4c124852032: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:16:49.010813  9039 tablet_bootstrap.cc:654] T f3ea64f4f4c54500a95692118660d9b4 P 7d3072f2af0b481d94ed70632b90e8c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.011338  9040 tablet_bootstrap.cc:492] T 852f0ef4508245e2812b76665a70bbf8 P e8bb7e1240f44fda8b83e4c124852032: Bootstrap starting.
I20260709 13:16:49.008713  9038 raft_consensus.cc:359] T c17f01b356e04590838cc6e6bb27bf64 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:49.019865  9160 raft_consensus.cc:493] T 574915613e8a4d3481aef27d3a977caa P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.020399  9160 raft_consensus.cc:515] T 574915613e8a4d3481aef27d3a977caa P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:49.025348  8990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574915613e8a4d3481aef27d3a977caa" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
W20260709 13:16:49.028429  8733 leader_election.cc:343] T 574915613e8a4d3481aef27d3a977caa P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.029858  9160 leader_election.cc:290] T 574915613e8a4d3481aef27d3a977caa P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:49.032083  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574915613e8a4d3481aef27d3a977caa" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
W20260709 13:16:49.040405  8736 leader_election.cc:343] T 574915613e8a4d3481aef27d3a977caa P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.041054  8736 leader_election.cc:304] T 574915613e8a4d3481aef27d3a977caa P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:49.042590  9291 raft_consensus.cc:2749] T 574915613e8a4d3481aef27d3a977caa P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:49.019629  9038 raft_consensus.cc:385] T c17f01b356e04590838cc6e6bb27bf64 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.045010  9038 raft_consensus.cc:740] T c17f01b356e04590838cc6e6bb27bf64 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.047267  9291 raft_consensus.cc:493] T d09ffcae84334482a706af1e812c7c9d P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.048275  9291 raft_consensus.cc:515] T d09ffcae84334482a706af1e812c7c9d P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:49.051092  9291 leader_election.cc:290] T d09ffcae84334482a706af1e812c7c9d P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:49.051869  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ffcae84334482a706af1e812c7c9d" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:49.057516  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ffcae84334482a706af1e812c7c9d" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:49.060348  9048 consensus_queue.cc:1048] T 17e47826fe4e4662baba1d095c341c1b P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:16:49.079432  8734 leader_election.cc:343] T d09ffcae84334482a706af1e812c7c9d P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.067799  9042 tablet_bootstrap.cc:492] T d09ffcae84334482a706af1e812c7c9d P 43c6faa9496d44dda6b6eaed09cdfd12: No bootstrap required, opened a new log
I20260709 13:16:49.070943  9039 tablet_bootstrap.cc:492] T f3ea64f4f4c54500a95692118660d9b4 P 7d3072f2af0b481d94ed70632b90e8c6: No bootstrap required, opened a new log
I20260709 13:16:49.074647  9040 tablet_bootstrap.cc:654] T 852f0ef4508245e2812b76665a70bbf8 P e8bb7e1240f44fda8b83e4c124852032: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.081004  9042 ts_tablet_manager.cc:1403] T d09ffcae84334482a706af1e812c7c9d P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent bootstrapping tablet: real 0.161s	user 0.009s	sys 0.007s
I20260709 13:16:49.082427  9038 consensus_queue.cc:260] T c17f01b356e04590838cc6e6bb27bf64 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:49.084306  9316 raft_consensus.cc:493] T 80fde6a0b6334446923248a50e223397 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.084818  9316 raft_consensus.cc:515] T 80fde6a0b6334446923248a50e223397 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:49.085041  9038 ts_tablet_manager.cc:1434] T c17f01b356e04590838cc6e6bb27bf64 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.084s	user 0.007s	sys 0.000s
I20260709 13:16:49.085216  9039 ts_tablet_manager.cc:1403] T f3ea64f4f4c54500a95692118660d9b4 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent bootstrapping tablet: real 0.118s	user 0.043s	sys 0.016s
I20260709 13:16:49.084964  9042 raft_consensus.cc:359] T d09ffcae84334482a706af1e812c7c9d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:49.085783  9042 raft_consensus.cc:385] T d09ffcae84334482a706af1e812c7c9d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.086058  9042 raft_consensus.cc:740] T d09ffcae84334482a706af1e812c7c9d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.086423  9038 tablet_bootstrap.cc:492] T 852f0ef4508245e2812b76665a70bbf8 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:49.086746  9042 consensus_queue.cc:260] T d09ffcae84334482a706af1e812c7c9d P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:49.087617  9316 leader_election.cc:290] T 80fde6a0b6334446923248a50e223397 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:49.088392  9039 raft_consensus.cc:359] T f3ea64f4f4c54500a95692118660d9b4 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:49.089222  9039 raft_consensus.cc:385] T f3ea64f4f4c54500a95692118660d9b4 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.090258  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80fde6a0b6334446923248a50e223397" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
W20260709 13:16:49.088641  8736 leader_election.cc:343] T d09ffcae84334482a706af1e812c7c9d P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.091085  8769 raft_consensus.cc:2393] T 80fde6a0b6334446923248a50e223397 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bb7e1240f44fda8b83e4c124852032 in current term 1: Already voted for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in this term.
I20260709 13:16:49.091181  8736 leader_election.cc:304] T d09ffcae84334482a706af1e812c7c9d P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6
I20260709 13:16:49.093050  9048 raft_consensus.cc:2749] T d09ffcae84334482a706af1e812c7c9d P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:49.089555  9039 raft_consensus.cc:740] T f3ea64f4f4c54500a95692118660d9b4 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.094228  9039 consensus_queue.cc:260] T f3ea64f4f4c54500a95692118660d9b4 P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:49.096665  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80fde6a0b6334446923248a50e223397" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:49.098872  9039 ts_tablet_manager.cc:1434] T f3ea64f4f4c54500a95692118660d9b4 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:16:49.100821  8959 leader_election.cc:304] T 80fde6a0b6334446923248a50e223397 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bb7e1240f44fda8b83e4c124852032; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:49.102586  9316 raft_consensus.cc:3060] T 80fde6a0b6334446923248a50e223397 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:49.096632  9038 tablet_bootstrap.cc:654] T 852f0ef4508245e2812b76665a70bbf8 P 895d3c58761f427c9c5b3cb41246c243: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.107432  9226 raft_consensus.cc:493] T d09ffcae84334482a706af1e812c7c9d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.108279  9226 raft_consensus.cc:515] T d09ffcae84334482a706af1e812c7c9d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:49.111904  9226 leader_election.cc:290] T d09ffcae84334482a706af1e812c7c9d P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:49.114070  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ffcae84334482a706af1e812c7c9d" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:49.114874  8769 raft_consensus.cc:2468] T d09ffcae84334482a706af1e812c7c9d P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 0.
I20260709 13:16:49.115698  9039 tablet_bootstrap.cc:492] T dc5cf20be8db404dbda7f0b4a676ab31 P 7d3072f2af0b481d94ed70632b90e8c6: Bootstrap starting.
I20260709 13:16:49.115873  9160 consensus_queue.cc:1048] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:49.121037  9042 ts_tablet_manager.cc:1434] T d09ffcae84334482a706af1e812c7c9d P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.000s
I20260709 13:16:49.122225  9042 tablet_bootstrap.cc:492] T 2945a5b174e14a5a9052897942f876c2 P 43c6faa9496d44dda6b6eaed09cdfd12: Bootstrap starting.
I20260709 13:16:49.130491  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ffcae84334482a706af1e812c7c9d" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:49.132501  8884 leader_election.cc:304] T d09ffcae84334482a706af1e812c7c9d P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243; no voters: 
I20260709 13:16:49.134234  9052 raft_consensus.cc:2804] T d09ffcae84334482a706af1e812c7c9d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:49.134668  9052 raft_consensus.cc:493] T d09ffcae84334482a706af1e812c7c9d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.135118  9052 raft_consensus.cc:3060] T d09ffcae84334482a706af1e812c7c9d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:49.138773  9042 tablet_bootstrap.cc:654] T 2945a5b174e14a5a9052897942f876c2 P 43c6faa9496d44dda6b6eaed09cdfd12: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:49.147619  8883 leader_election.cc:343] T d09ffcae84334482a706af1e812c7c9d P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.150213  9247 raft_consensus.cc:493] T 2945a5b174e14a5a9052897942f876c2 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.150976  9247 raft_consensus.cc:515] T 2945a5b174e14a5a9052897942f876c2 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:49.154567  9247 leader_election.cc:290] T 2945a5b174e14a5a9052897942f876c2 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:49.156065  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2945a5b174e14a5a9052897942f876c2" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
W20260709 13:16:49.157840  8959 leader_election.cc:343] T 2945a5b174e14a5a9052897942f876c2 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.159076  9052 raft_consensus.cc:515] T d09ffcae84334482a706af1e812c7c9d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:49.159374  9291 consensus_queue.cc:1048] T 17e47826fe4e4662baba1d095c341c1b P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:49.163314  9042 tablet_bootstrap.cc:492] T 2945a5b174e14a5a9052897942f876c2 P 43c6faa9496d44dda6b6eaed09cdfd12: No bootstrap required, opened a new log
I20260709 13:16:49.164026  9042 ts_tablet_manager.cc:1403] T 2945a5b174e14a5a9052897942f876c2 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent bootstrapping tablet: real 0.042s	user 0.010s	sys 0.014s
I20260709 13:16:49.164891  9039 tablet_bootstrap.cc:654] T dc5cf20be8db404dbda7f0b4a676ab31 P 7d3072f2af0b481d94ed70632b90e8c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.166213  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ffcae84334482a706af1e812c7c9d" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
W20260709 13:16:49.169081  8883 leader_election.cc:343] T d09ffcae84334482a706af1e812c7c9d P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.167115  9042 raft_consensus.cc:359] T 2945a5b174e14a5a9052897942f876c2 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:49.171845  9042 raft_consensus.cc:385] T 2945a5b174e14a5a9052897942f876c2 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.172950  9042 raft_consensus.cc:740] T 2945a5b174e14a5a9052897942f876c2 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.174417  9042 consensus_queue.cc:260] T 2945a5b174e14a5a9052897942f876c2 P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:49.179239  9042 ts_tablet_manager.cc:1434] T 2945a5b174e14a5a9052897942f876c2 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.001s
I20260709 13:16:49.184100  9042 tablet_bootstrap.cc:492] T f3ea64f4f4c54500a95692118660d9b4 P 43c6faa9496d44dda6b6eaed09cdfd12: Bootstrap starting.
I20260709 13:16:49.188500  9247 raft_consensus.cc:493] T dc5cf20be8db404dbda7f0b4a676ab31 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.185158  9052 leader_election.cc:290] T d09ffcae84334482a706af1e812c7c9d P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Requested vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:49.189167  9247 raft_consensus.cc:515] T dc5cf20be8db404dbda7f0b4a676ab31 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:49.194451  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ffcae84334482a706af1e812c7c9d" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243"
I20260709 13:16:49.195182  8768 raft_consensus.cc:3060] T d09ffcae84334482a706af1e812c7c9d P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:49.200263  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5cf20be8db404dbda7f0b4a676ab31" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
W20260709 13:16:49.202198  8957 leader_election.cc:343] T dc5cf20be8db404dbda7f0b4a676ab31 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.204365  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2945a5b174e14a5a9052897942f876c2" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:49.205318  8769 raft_consensus.cc:2468] T 2945a5b174e14a5a9052897942f876c2 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 0.
I20260709 13:16:49.206620  9130 raft_consensus.cc:493] T f3ea64f4f4c54500a95692118660d9b4 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.207190  9130 raft_consensus.cc:515] T f3ea64f4f4c54500a95692118660d9b4 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:49.208603  9042 tablet_bootstrap.cc:654] T f3ea64f4f4c54500a95692118660d9b4 P 43c6faa9496d44dda6b6eaed09cdfd12: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.209848  9130 leader_election.cc:290] T f3ea64f4f4c54500a95692118660d9b4 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:49.211858  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea64f4f4c54500a95692118660d9b4" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
W20260709 13:16:49.213485  8811 leader_election.cc:343] T f3ea64f4f4c54500a95692118660d9b4 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.221341  9042 tablet_bootstrap.cc:492] T f3ea64f4f4c54500a95692118660d9b4 P 43c6faa9496d44dda6b6eaed09cdfd12: No bootstrap required, opened a new log
I20260709 13:16:49.221341  9039 tablet_bootstrap.cc:492] T dc5cf20be8db404dbda7f0b4a676ab31 P 7d3072f2af0b481d94ed70632b90e8c6: No bootstrap required, opened a new log
I20260709 13:16:49.222029  9039 ts_tablet_manager.cc:1403] T dc5cf20be8db404dbda7f0b4a676ab31 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent bootstrapping tablet: real 0.107s	user 0.019s	sys 0.043s
I20260709 13:16:49.222029  9042 ts_tablet_manager.cc:1403] T f3ea64f4f4c54500a95692118660d9b4 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.002s
I20260709 13:16:49.225184  9042 raft_consensus.cc:359] T f3ea64f4f4c54500a95692118660d9b4 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:49.225950  9042 raft_consensus.cc:385] T f3ea64f4f4c54500a95692118660d9b4 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.226248  9042 raft_consensus.cc:740] T f3ea64f4f4c54500a95692118660d9b4 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.226935  9042 consensus_queue.cc:260] T f3ea64f4f4c54500a95692118660d9b4 P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:49.229244  9042 ts_tablet_manager.cc:1434] T f3ea64f4f4c54500a95692118660d9b4 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:16:49.230167  9042 tablet_bootstrap.cc:492] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12: Bootstrap starting.
I20260709 13:16:49.230927  9039 raft_consensus.cc:359] T dc5cf20be8db404dbda7f0b4a676ab31 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:49.231953  9039 raft_consensus.cc:385] T dc5cf20be8db404dbda7f0b4a676ab31 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.232221  9039 raft_consensus.cc:740] T dc5cf20be8db404dbda7f0b4a676ab31 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.232918  9039 consensus_queue.cc:260] T dc5cf20be8db404dbda7f0b4a676ab31 P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:49.236306  9039 ts_tablet_manager.cc:1434] T dc5cf20be8db404dbda7f0b4a676ab31 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.002s
I20260709 13:16:49.236627  9247 leader_election.cc:290] T dc5cf20be8db404dbda7f0b4a676ab31 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:49.237337  9039 tablet_bootstrap.cc:492] T 852f0ef4508245e2812b76665a70bbf8 P 7d3072f2af0b481d94ed70632b90e8c6: Bootstrap starting.
I20260709 13:16:49.237624  9042 tablet_bootstrap.cc:654] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.237800  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5cf20be8db404dbda7f0b4a676ab31" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:49.241894  8918 raft_consensus.cc:2468] T dc5cf20be8db404dbda7f0b4a676ab31 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 0.
I20260709 13:16:49.243494  8959 leader_election.cc:304] T dc5cf20be8db404dbda7f0b4a676ab31 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032; no voters: 7d3072f2af0b481d94ed70632b90e8c6
I20260709 13:16:49.245816  8958 leader_election.cc:304] T 2945a5b174e14a5a9052897942f876c2 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243, e8bb7e1240f44fda8b83e4c124852032; no voters: 43c6faa9496d44dda6b6eaed09cdfd12
I20260709 13:16:49.247112  9039 tablet_bootstrap.cc:654] T 852f0ef4508245e2812b76665a70bbf8 P 7d3072f2af0b481d94ed70632b90e8c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.247370  9279 raft_consensus.cc:2804] T dc5cf20be8db404dbda7f0b4a676ab31 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:49.247862  9279 raft_consensus.cc:493] T dc5cf20be8db404dbda7f0b4a676ab31 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.248193  9279 raft_consensus.cc:3060] T dc5cf20be8db404dbda7f0b4a676ab31 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:49.272078  9316 raft_consensus.cc:2749] T 80fde6a0b6334446923248a50e223397 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:49.273175  9316 raft_consensus.cc:2804] T 2945a5b174e14a5a9052897942f876c2 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:49.273636  9316 raft_consensus.cc:493] T 2945a5b174e14a5a9052897942f876c2 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.274042  9316 raft_consensus.cc:3060] T 2945a5b174e14a5a9052897942f876c2 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:49.281982  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea64f4f4c54500a95692118660d9b4" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:49.283396  8769 raft_consensus.cc:2468] T f3ea64f4f4c54500a95692118660d9b4 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 0.
I20260709 13:16:49.284948  9279 raft_consensus.cc:515] T dc5cf20be8db404dbda7f0b4a676ab31 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:49.288659  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5cf20be8db404dbda7f0b4a676ab31" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
I20260709 13:16:49.289502  8841 raft_consensus.cc:3060] T dc5cf20be8db404dbda7f0b4a676ab31 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:49.304648  8841 raft_consensus.cc:2468] T dc5cf20be8db404dbda7f0b4a676ab31 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 1.
I20260709 13:16:49.307017  8957 leader_election.cc:304] T dc5cf20be8db404dbda7f0b4a676ab31 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:16:49.309113  9251 consensus_queue.cc:1048] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:49.310237  9040 tablet_bootstrap.cc:492] T 852f0ef4508245e2812b76665a70bbf8 P e8bb7e1240f44fda8b83e4c124852032: No bootstrap required, opened a new log
I20260709 13:16:49.310750  9247 raft_consensus.cc:2804] T dc5cf20be8db404dbda7f0b4a676ab31 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:49.312150  9247 raft_consensus.cc:697] T dc5cf20be8db404dbda7f0b4a676ab31 P e8bb7e1240f44fda8b83e4c124852032 [term 1 LEADER]: Becoming Leader. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Running, Role: LEADER
I20260709 13:16:49.313162  9247 consensus_queue.cc:237] T dc5cf20be8db404dbda7f0b4a676ab31 P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:49.311439  9040 ts_tablet_manager.cc:1403] T 852f0ef4508245e2812b76665a70bbf8 P e8bb7e1240f44fda8b83e4c124852032: Time spent bootstrapping tablet: real 0.300s	user 0.039s	sys 0.047s
I20260709 13:16:49.321633  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5cf20be8db404dbda7f0b4a676ab31" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:16:49.322382  8918 raft_consensus.cc:3060] T dc5cf20be8db404dbda7f0b4a676ab31 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:49.323567  9279 leader_election.cc:290] T dc5cf20be8db404dbda7f0b4a676ab31 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 election: Requested vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:49.318408  9040 raft_consensus.cc:359] T 852f0ef4508245e2812b76665a70bbf8 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:49.330183  9040 raft_consensus.cc:385] T 852f0ef4508245e2812b76665a70bbf8 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.331120  9040 raft_consensus.cc:740] T 852f0ef4508245e2812b76665a70bbf8 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.330798  9038 tablet_bootstrap.cc:492] T 852f0ef4508245e2812b76665a70bbf8 P 895d3c58761f427c9c5b3cb41246c243: No bootstrap required, opened a new log
I20260709 13:16:49.332269  9038 ts_tablet_manager.cc:1403] T 852f0ef4508245e2812b76665a70bbf8 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.246s	user 0.052s	sys 0.027s
I20260709 13:16:49.332075  8810 leader_election.cc:304] T f3ea64f4f4c54500a95692118660d9b4 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6, 895d3c58761f427c9c5b3cb41246c243; no voters: 43c6faa9496d44dda6b6eaed09cdfd12
I20260709 13:16:49.336128  9130 raft_consensus.cc:2804] T f3ea64f4f4c54500a95692118660d9b4 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:49.336524  9130 raft_consensus.cc:493] T f3ea64f4f4c54500a95692118660d9b4 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.336899  9130 raft_consensus.cc:3060] T f3ea64f4f4c54500a95692118660d9b4 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:49.339324  9038 raft_consensus.cc:359] T 852f0ef4508245e2812b76665a70bbf8 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:49.341904  9038 raft_consensus.cc:385] T 852f0ef4508245e2812b76665a70bbf8 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.342263  9038 raft_consensus.cc:740] T 852f0ef4508245e2812b76665a70bbf8 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.343051  9038 consensus_queue.cc:260] T 852f0ef4508245e2812b76665a70bbf8 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:49.346112  9038 ts_tablet_manager.cc:1434] T 852f0ef4508245e2812b76665a70bbf8 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:16:49.347240  9038 tablet_bootstrap.cc:492] T dde08046aca642488918d1f2b978c126 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:49.347688  9052 consensus_queue.cc:1048] T 80fde6a0b6334446923248a50e223397 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:49.365646  9038 tablet_bootstrap.cc:654] T dde08046aca642488918d1f2b978c126 P 895d3c58761f427c9c5b3cb41246c243: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.377257  8666 catalog_manager.cc:5697] T dc5cf20be8db404dbda7f0b4a676ab31 P e8bb7e1240f44fda8b83e4c124852032 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196). New cstate: current_term: 1 leader_uuid: "e8bb7e1240f44fda8b83e4c124852032" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:49.379096  9038 tablet_bootstrap.cc:492] T dde08046aca642488918d1f2b978c126 P 895d3c58761f427c9c5b3cb41246c243: No bootstrap required, opened a new log
I20260709 13:16:49.379802  9038 ts_tablet_manager.cc:1403] T dde08046aca642488918d1f2b978c126 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.008s
I20260709 13:16:49.398959  9052 consensus_queue.cc:1048] T 80fde6a0b6334446923248a50e223397 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:49.333457  8768 raft_consensus.cc:2468] T d09ffcae84334482a706af1e812c7c9d P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 1.
I20260709 13:16:49.334089  9040 consensus_queue.cc:260] T 852f0ef4508245e2812b76665a70bbf8 P e8bb7e1240f44fda8b83e4c124852032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:49.399200  9038 raft_consensus.cc:359] T dde08046aca642488918d1f2b978c126 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:49.402729  9038 raft_consensus.cc:385] T dde08046aca642488918d1f2b978c126 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.402870  9040 ts_tablet_manager.cc:1434] T 852f0ef4508245e2812b76665a70bbf8 P e8bb7e1240f44fda8b83e4c124852032: Time spent starting tablet: real 0.087s	user 0.005s	sys 0.002s
I20260709 13:16:49.403020  9038 raft_consensus.cc:740] T dde08046aca642488918d1f2b978c126 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.404492  9040 tablet_bootstrap.cc:492] T 1521cafcc31b47c58829494618fc0cd8 P e8bb7e1240f44fda8b83e4c124852032: Bootstrap starting.
I20260709 13:16:49.406572  9038 consensus_queue.cc:260] T dde08046aca642488918d1f2b978c126 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:49.411654  9227 raft_consensus.cc:493] T e3ee8f06068449de90c7fb0479f504ca P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.412185  9227 raft_consensus.cc:515] T e3ee8f06068449de90c7fb0479f504ca P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:49.416054  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ee8f06068449de90c7fb0479f504ca" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:49.416450  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ee8f06068449de90c7fb0479f504ca" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:49.417292  8917 raft_consensus.cc:2393] T e3ee8f06068449de90c7fb0479f504ca P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3072f2af0b481d94ed70632b90e8c6 in current term 1: Already voted for candidate e8bb7e1240f44fda8b83e4c124852032 in this term.
I20260709 13:16:49.417987  9227 leader_election.cc:290] T e3ee8f06068449de90c7fb0479f504ca P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:49.419356  8811 leader_election.cc:304] T e3ee8f06068449de90c7fb0479f504ca P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:49.421289  9227 raft_consensus.cc:3060] T e3ee8f06068449de90c7fb0479f504ca P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:49.421729  9247 consensus_queue.cc:1048] T e3ee8f06068449de90c7fb0479f504ca P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:49.347007  9130 raft_consensus.cc:515] T f3ea64f4f4c54500a95692118660d9b4 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:49.433146  9130 leader_election.cc:290] T f3ea64f4f4c54500a95692118660d9b4 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 election: Requested vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:49.433043  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea64f4f4c54500a95692118660d9b4" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:16:49.433688  9042 tablet_bootstrap.cc:492] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12: No bootstrap required, opened a new log
I20260709 13:16:49.434108  8919 raft_consensus.cc:3060] T f3ea64f4f4c54500a95692118660d9b4 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:49.433040  9038 ts_tablet_manager.cc:1434] T dde08046aca642488918d1f2b978c126 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.000s
I20260709 13:16:49.436751  9038 tablet_bootstrap.cc:492] T 5a26acd2175646e3a53b493571852af4 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:49.434300  9042 ts_tablet_manager.cc:1403] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent bootstrapping tablet: real 0.204s	user 0.030s	sys 0.033s
I20260709 13:16:49.447395  8884 leader_election.cc:304] T d09ffcae84334482a706af1e812c7c9d P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243; no voters: 7d3072f2af0b481d94ed70632b90e8c6
I20260709 13:16:49.448800  9231 raft_consensus.cc:2804] T d09ffcae84334482a706af1e812c7c9d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:49.448232  9042 raft_consensus.cc:359] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:49.449345  9231 raft_consensus.cc:697] T d09ffcae84334482a706af1e812c7c9d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Becoming Leader. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Running, Role: LEADER
I20260709 13:16:49.449394  9042 raft_consensus.cc:385] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.449935  9042 raft_consensus.cc:740] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.444060  9040 tablet_bootstrap.cc:654] T 1521cafcc31b47c58829494618fc0cd8 P e8bb7e1240f44fda8b83e4c124852032: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.450292  9231 consensus_queue.cc:237] T d09ffcae84334482a706af1e812c7c9d P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:49.466593  9042 consensus_queue.cc:260] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:49.482048  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea64f4f4c54500a95692118660d9b4" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243"
I20260709 13:16:49.484921  8768 raft_consensus.cc:3060] T f3ea64f4f4c54500a95692118660d9b4 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:49.485819  8667 catalog_manager.cc:5697] T d09ffcae84334482a706af1e812c7c9d P 43c6faa9496d44dda6b6eaed09cdfd12 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195). New cstate: current_term: 1 leader_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:49.489480  9038 tablet_bootstrap.cc:654] T 5a26acd2175646e3a53b493571852af4 P 895d3c58761f427c9c5b3cb41246c243: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.443425  8919 raft_consensus.cc:2468] T f3ea64f4f4c54500a95692118660d9b4 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 1.
I20260709 13:16:49.491622  9042 ts_tablet_manager.cc:1434] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent starting tablet: real 0.047s	user 0.009s	sys 0.000s
I20260709 13:16:49.492879  9042 tablet_bootstrap.cc:492] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12: Bootstrap starting.
I20260709 13:16:49.498543  8811 leader_election.cc:304] T f3ea64f4f4c54500a95692118660d9b4 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6; no voters: 
I20260709 13:16:49.501153  9229 raft_consensus.cc:2804] T f3ea64f4f4c54500a95692118660d9b4 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:49.501888  9229 raft_consensus.cc:697] T f3ea64f4f4c54500a95692118660d9b4 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 LEADER]: Becoming Leader. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Running, Role: LEADER
I20260709 13:16:49.506306  9039 tablet_bootstrap.cc:492] T 852f0ef4508245e2812b76665a70bbf8 P 7d3072f2af0b481d94ed70632b90e8c6: No bootstrap required, opened a new log
I20260709 13:16:49.507102  9039 ts_tablet_manager.cc:1403] T 852f0ef4508245e2812b76665a70bbf8 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent bootstrapping tablet: real 0.270s	user 0.096s	sys 0.091s
I20260709 13:16:49.506546  9042 tablet_bootstrap.cc:654] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.503078  9229 consensus_queue.cc:237] T f3ea64f4f4c54500a95692118660d9b4 P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:49.518484  9039 raft_consensus.cc:359] T 852f0ef4508245e2812b76665a70bbf8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:49.520458  9039 raft_consensus.cc:385] T 852f0ef4508245e2812b76665a70bbf8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.520787  9039 raft_consensus.cc:740] T 852f0ef4508245e2812b76665a70bbf8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.521471  9039 consensus_queue.cc:260] T 852f0ef4508245e2812b76665a70bbf8 P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:49.526396  9279 raft_consensus.cc:493] T 852f0ef4508245e2812b76665a70bbf8 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.531606  9279 raft_consensus.cc:515] T 852f0ef4508245e2812b76665a70bbf8 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:49.533882  9279 leader_election.cc:290] T 852f0ef4508245e2812b76665a70bbf8 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:49.535676  8770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852f0ef4508245e2812b76665a70bbf8" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:49.536705  8770 raft_consensus.cc:2468] T 852f0ef4508245e2812b76665a70bbf8 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 0.
I20260709 13:16:49.540081  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852f0ef4508245e2812b76665a70bbf8" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:49.540876  8842 raft_consensus.cc:2468] T 852f0ef4508245e2812b76665a70bbf8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 0.
I20260709 13:16:49.541585  9039 ts_tablet_manager.cc:1434] T 852f0ef4508245e2812b76665a70bbf8 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent starting tablet: real 0.034s	user 0.010s	sys 0.001s
I20260709 13:16:49.542676  9039 tablet_bootstrap.cc:492] T d09ffcae84334482a706af1e812c7c9d P 7d3072f2af0b481d94ed70632b90e8c6: Bootstrap starting.
I20260709 13:16:49.545076  8957 leader_election.cc:304] T 852f0ef4508245e2812b76665a70bbf8 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:16:49.546968  8666 catalog_manager.cc:5697] T f3ea64f4f4c54500a95692118660d9b4 P 7d3072f2af0b481d94ed70632b90e8c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194). New cstate: current_term: 1 leader_uuid: "7d3072f2af0b481d94ed70632b90e8c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:49.550185  9160 raft_consensus.cc:493] T dde08046aca642488918d1f2b978c126 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.550720  9160 raft_consensus.cc:515] T dde08046aca642488918d1f2b978c126 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:49.552057  9039 tablet_bootstrap.cc:654] T d09ffcae84334482a706af1e812c7c9d P 7d3072f2af0b481d94ed70632b90e8c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.553053  9160 leader_election.cc:290] T dde08046aca642488918d1f2b978c126 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:49.535807  9231 raft_consensus.cc:493] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.554855  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde08046aca642488918d1f2b978c126" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:49.555356  9231 raft_consensus.cc:515] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
W20260709 13:16:49.556674  8736 leader_election.cc:343] T dde08046aca642488918d1f2b978c126 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.557688  9231 leader_election.cc:290] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:49.523581  8918 raft_consensus.cc:2468] T dc5cf20be8db404dbda7f0b4a676ab31 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 1.
I20260709 13:16:49.562347  8770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574915613e8a4d3481aef27d3a977caa" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:49.562744  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574915613e8a4d3481aef27d3a977caa" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:49.565747  9040 tablet_bootstrap.cc:492] T 1521cafcc31b47c58829494618fc0cd8 P e8bb7e1240f44fda8b83e4c124852032: No bootstrap required, opened a new log
I20260709 13:16:49.570163  9040 ts_tablet_manager.cc:1403] T 1521cafcc31b47c58829494618fc0cd8 P e8bb7e1240f44fda8b83e4c124852032: Time spent bootstrapping tablet: real 0.166s	user 0.016s	sys 0.013s
I20260709 13:16:49.561067  9279 raft_consensus.cc:2804] T 852f0ef4508245e2812b76665a70bbf8 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:49.574307  9279 raft_consensus.cc:493] T 852f0ef4508245e2812b76665a70bbf8 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.571194  9225 raft_consensus.cc:493] T 2945a5b174e14a5a9052897942f876c2 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.571873  8770 raft_consensus.cc:2468] T 574915613e8a4d3481aef27d3a977caa P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 0.
I20260709 13:16:49.582906  9160 raft_consensus.cc:493] T c17f01b356e04590838cc6e6bb27bf64 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.583473  9160 raft_consensus.cc:515] T c17f01b356e04590838cc6e6bb27bf64 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:49.584446  9040 raft_consensus.cc:359] T 1521cafcc31b47c58829494618fc0cd8 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:49.584923  8768 raft_consensus.cc:2468] T f3ea64f4f4c54500a95692118660d9b4 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 1.
I20260709 13:16:49.585227  9040 raft_consensus.cc:385] T 1521cafcc31b47c58829494618fc0cd8 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.585875  9160 leader_election.cc:290] T c17f01b356e04590838cc6e6bb27bf64 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:49.588548  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17f01b356e04590838cc6e6bb27bf64" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:49.580657  9225 raft_consensus.cc:515] T 2945a5b174e14a5a9052897942f876c2 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:49.589787  9040 raft_consensus.cc:740] T 1521cafcc31b47c58829494618fc0cd8 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.577699  9227 raft_consensus.cc:2749] T e3ee8f06068449de90c7fb0479f504ca P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:49.578879  9279 raft_consensus.cc:3060] T 852f0ef4508245e2812b76665a70bbf8 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:49.578570  8990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde08046aca642488918d1f2b978c126" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:49.592700  9038 tablet_bootstrap.cc:492] T 5a26acd2175646e3a53b493571852af4 P 895d3c58761f427c9c5b3cb41246c243: No bootstrap required, opened a new log
I20260709 13:16:49.593225  9038 ts_tablet_manager.cc:1403] T 5a26acd2175646e3a53b493571852af4 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.158s	user 0.023s	sys 0.032s
I20260709 13:16:49.593770  9042 tablet_bootstrap.cc:492] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12: No bootstrap required, opened a new log
I20260709 13:16:49.594290  9042 ts_tablet_manager.cc:1403] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent bootstrapping tablet: real 0.102s	user 0.006s	sys 0.025s
I20260709 13:16:49.596194  9038 raft_consensus.cc:359] T 5a26acd2175646e3a53b493571852af4 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:49.597046  9038 raft_consensus.cc:385] T 5a26acd2175646e3a53b493571852af4 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.597334  9038 raft_consensus.cc:740] T 5a26acd2175646e3a53b493571852af4 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.598244  9040 consensus_queue.cc:260] T 1521cafcc31b47c58829494618fc0cd8 P e8bb7e1240f44fda8b83e4c124852032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
W20260709 13:16:49.600178  8733 leader_election.cc:343] T dde08046aca642488918d1f2b978c126 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.600672  8733 leader_election.cc:304] T dde08046aca642488918d1f2b978c126 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:49.602988  9160 raft_consensus.cc:2749] T dde08046aca642488918d1f2b978c126 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:16:49.604346  8736 leader_election.cc:343] T c17f01b356e04590838cc6e6bb27bf64 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.608884  9040 ts_tablet_manager.cc:1434] T 1521cafcc31b47c58829494618fc0cd8 P e8bb7e1240f44fda8b83e4c124852032: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.001s
I20260709 13:16:49.610714  9040 tablet_bootstrap.cc:492] T 574915613e8a4d3481aef27d3a977caa P e8bb7e1240f44fda8b83e4c124852032: Bootstrap starting.
I20260709 13:16:49.611333  9038 consensus_queue.cc:260] T 5a26acd2175646e3a53b493571852af4 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
W20260709 13:16:49.591037  8882 leader_election.cc:343] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.608352  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17f01b356e04590838cc6e6bb27bf64" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:49.620780  8884 leader_election.cc:304] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243; no voters: e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:49.631378  9039 tablet_bootstrap.cc:492] T d09ffcae84334482a706af1e812c7c9d P 7d3072f2af0b481d94ed70632b90e8c6: No bootstrap required, opened a new log
I20260709 13:16:49.632105  9039 ts_tablet_manager.cc:1403] T d09ffcae84334482a706af1e812c7c9d P 7d3072f2af0b481d94ed70632b90e8c6: Time spent bootstrapping tablet: real 0.090s	user 0.015s	sys 0.006s
I20260709 13:16:49.634424  9042 raft_consensus.cc:359] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:49.635136  9042 raft_consensus.cc:385] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.635429  9042 raft_consensus.cc:740] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.637100  9042 consensus_queue.cc:260] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:49.641773  9038 ts_tablet_manager.cc:1434] T 5a26acd2175646e3a53b493571852af4 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.048s	user 0.009s	sys 0.000s
I20260709 13:16:49.644055  9038 tablet_bootstrap.cc:492] T f3abbeb71eba411bb6dfec800d3bd9c0 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:49.641546  9052 raft_consensus.cc:2804] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:49.647836  9052 raft_consensus.cc:493] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.648175  9052 raft_consensus.cc:3060] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:49.652455  9225 leader_election.cc:290] T 2945a5b174e14a5a9052897942f876c2 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
W20260709 13:16:49.653371  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:39173, user_credentials={real_user=slave}} blocked reactor thread for 61818.8us
W20260709 13:16:49.655257  8734 leader_election.cc:343] T c17f01b356e04590838cc6e6bb27bf64 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.655777  8734 leader_election.cc:304] T c17f01b356e04590838cc6e6bb27bf64 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6
I20260709 13:16:49.656935  9048 raft_consensus.cc:2749] T c17f01b356e04590838cc6e6bb27bf64 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:49.661079  9247 consensus_queue.cc:1048] T e3ee8f06068449de90c7fb0479f504ca P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:49.662549  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2945a5b174e14a5a9052897942f876c2" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:49.663245  8769 raft_consensus.cc:2468] T 2945a5b174e14a5a9052897942f876c2 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 0.
I20260709 13:16:49.671281  9042 ts_tablet_manager.cc:1434] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent starting tablet: real 0.077s	user 0.008s	sys 0.001s
I20260709 13:16:49.672024  9040 tablet_bootstrap.cc:654] T 574915613e8a4d3481aef27d3a977caa P e8bb7e1240f44fda8b83e4c124852032: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.672284  9042 tablet_bootstrap.cc:492] T b8ded21dd9a54bc8b9cd260808162d0d P 43c6faa9496d44dda6b6eaed09cdfd12: Bootstrap starting.
I20260709 13:16:49.674505  8990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2945a5b174e14a5a9052897942f876c2" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:49.675748  9038 tablet_bootstrap.cc:654] T f3abbeb71eba411bb6dfec800d3bd9c0 P 895d3c58761f427c9c5b3cb41246c243: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.681954  9247 raft_consensus.cc:493] T 1521cafcc31b47c58829494618fc0cd8 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.682543  9247 raft_consensus.cc:515] T 1521cafcc31b47c58829494618fc0cd8 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:49.686956  9247 leader_election.cc:290] T 1521cafcc31b47c58829494618fc0cd8 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:49.687701  8884 leader_election.cc:304] T 2945a5b174e14a5a9052897942f876c2 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243; no voters: 
I20260709 13:16:49.688858  9225 raft_consensus.cc:2804] T 2945a5b174e14a5a9052897942f876c2 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:49.689260  9225 raft_consensus.cc:493] T 2945a5b174e14a5a9052897942f876c2 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.689605  9225 raft_consensus.cc:3060] T 2945a5b174e14a5a9052897942f876c2 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:49.642640  9316 raft_consensus.cc:515] T 2945a5b174e14a5a9052897942f876c2 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:49.693501  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1521cafcc31b47c58829494618fc0cd8" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:49.694921  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1521cafcc31b47c58829494618fc0cd8" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:49.701059  8768 raft_consensus.cc:2468] T 1521cafcc31b47c58829494618fc0cd8 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 0.
I20260709 13:16:49.703863  8958 leader_election.cc:304] T 1521cafcc31b47c58829494618fc0cd8 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:16:49.708304  9247 raft_consensus.cc:2804] T 1521cafcc31b47c58829494618fc0cd8 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:49.708907  9247 raft_consensus.cc:493] T 1521cafcc31b47c58829494618fc0cd8 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.709398  9247 raft_consensus.cc:3060] T 1521cafcc31b47c58829494618fc0cd8 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:49.711035  8716 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:49.712213  9042 tablet_bootstrap.cc:654] T b8ded21dd9a54bc8b9cd260808162d0d P 43c6faa9496d44dda6b6eaed09cdfd12: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.723918  8990 raft_consensus.cc:2393] T 2945a5b174e14a5a9052897942f876c2 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43c6faa9496d44dda6b6eaed09cdfd12 in current term 1: Already voted for candidate e8bb7e1240f44fda8b83e4c124852032 in this term.
W20260709 13:16:49.725984  8957 leader_election.cc:343] T 1521cafcc31b47c58829494618fc0cd8 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.746831  9279 raft_consensus.cc:515] T 852f0ef4508245e2812b76665a70bbf8 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:49.756111  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852f0ef4508245e2812b76665a70bbf8" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243"
I20260709 13:16:49.756913  8768 raft_consensus.cc:3060] T 852f0ef4508245e2812b76665a70bbf8 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:49.757405  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2945a5b174e14a5a9052897942f876c2" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:16:49.759222  9039 raft_consensus.cc:359] T d09ffcae84334482a706af1e812c7c9d P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:49.760607  9039 raft_consensus.cc:385] T d09ffcae84334482a706af1e812c7c9d P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.755887  9225 raft_consensus.cc:515] T 2945a5b174e14a5a9052897942f876c2 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:49.760854  9039 raft_consensus.cc:740] T d09ffcae84334482a706af1e812c7c9d P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.762120  9039 consensus_queue.cc:260] T d09ffcae84334482a706af1e812c7c9d P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:49.766897  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852f0ef4508245e2812b76665a70bbf8" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
I20260709 13:16:49.767688  8841 raft_consensus.cc:3060] T 852f0ef4508245e2812b76665a70bbf8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:49.769280  8770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2945a5b174e14a5a9052897942f876c2" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243"
I20260709 13:16:49.769960  8770 raft_consensus.cc:3060] T 2945a5b174e14a5a9052897942f876c2 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:49.761365  9279 leader_election.cc:290] T 852f0ef4508245e2812b76665a70bbf8 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 election: Requested vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:49.771377  9052 raft_consensus.cc:515] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:49.775046  9316 leader_election.cc:290] T 2945a5b174e14a5a9052897942f876c2 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 election: Requested vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:49.779532  8990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574915613e8a4d3481aef27d3a977caa" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
I20260709 13:16:49.780812  9038 tablet_bootstrap.cc:492] T f3abbeb71eba411bb6dfec800d3bd9c0 P 895d3c58761f427c9c5b3cb41246c243: No bootstrap required, opened a new log
I20260709 13:16:49.781543  9038 ts_tablet_manager.cc:1403] T f3abbeb71eba411bb6dfec800d3bd9c0 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.139s	user 0.011s	sys 0.014s
I20260709 13:16:49.781834  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574915613e8a4d3481aef27d3a977caa" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243"
W20260709 13:16:49.782444  8882 leader_election.cc:343] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.783958  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2945a5b174e14a5a9052897942f876c2" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243"
I20260709 13:16:49.784530  9225 leader_election.cc:290] T 2945a5b174e14a5a9052897942f876c2 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Requested vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:49.782544  8769 raft_consensus.cc:3060] T 574915613e8a4d3481aef27d3a977caa P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:49.792454  8770 raft_consensus.cc:2468] T 2945a5b174e14a5a9052897942f876c2 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 1.
I20260709 13:16:49.793773  8958 leader_election.cc:304] T 2945a5b174e14a5a9052897942f876c2 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:16:49.794642  9316 raft_consensus.cc:2804] T 2945a5b174e14a5a9052897942f876c2 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:49.795149  9316 raft_consensus.cc:697] T 2945a5b174e14a5a9052897942f876c2 P e8bb7e1240f44fda8b83e4c124852032 [term 1 LEADER]: Becoming Leader. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Running, Role: LEADER
I20260709 13:16:49.785533  8990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2945a5b174e14a5a9052897942f876c2" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
I20260709 13:16:49.779592  8919 raft_consensus.cc:2393] T 2945a5b174e14a5a9052897942f876c2 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e8bb7e1240f44fda8b83e4c124852032 in current term 1: Already voted for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in this term.
I20260709 13:16:49.796048  9316 consensus_queue.cc:237] T 2945a5b174e14a5a9052897942f876c2 P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:49.797152  9038 raft_consensus.cc:359] T f3abbeb71eba411bb6dfec800d3bd9c0 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:49.797919  9038 raft_consensus.cc:385] T f3abbeb71eba411bb6dfec800d3bd9c0 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.798183  9038 raft_consensus.cc:740] T f3abbeb71eba411bb6dfec800d3bd9c0 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.798620  8882 leader_election.cc:304] T 2945a5b174e14a5a9052897942f876c2 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12; no voters: 895d3c58761f427c9c5b3cb41246c243, e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:49.801257  9226 raft_consensus.cc:2749] T 2945a5b174e14a5a9052897942f876c2 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:16:49.784161  9052 leader_election.cc:290] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Requested vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:49.803232  8769 raft_consensus.cc:2468] T 574915613e8a4d3481aef27d3a977caa P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 1.
I20260709 13:16:49.789965  9039 ts_tablet_manager.cc:1434] T d09ffcae84334482a706af1e812c7c9d P 7d3072f2af0b481d94ed70632b90e8c6: Time spent starting tablet: real 0.158s	user 0.007s	sys 0.000s
I20260709 13:16:49.805701  9042 tablet_bootstrap.cc:492] T b8ded21dd9a54bc8b9cd260808162d0d P 43c6faa9496d44dda6b6eaed09cdfd12: No bootstrap required, opened a new log
I20260709 13:16:49.798928  9038 consensus_queue.cc:260] T f3abbeb71eba411bb6dfec800d3bd9c0 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:49.807394  9040 tablet_bootstrap.cc:492] T 574915613e8a4d3481aef27d3a977caa P e8bb7e1240f44fda8b83e4c124852032: No bootstrap required, opened a new log
I20260709 13:16:49.809940  9040 ts_tablet_manager.cc:1403] T 574915613e8a4d3481aef27d3a977caa P e8bb7e1240f44fda8b83e4c124852032: Time spent bootstrapping tablet: real 0.200s	user 0.015s	sys 0.011s
I20260709 13:16:49.809986  9039 tablet_bootstrap.cc:492] T 1521cafcc31b47c58829494618fc0cd8 P 7d3072f2af0b481d94ed70632b90e8c6: Bootstrap starting.
I20260709 13:16:49.810874  9038 ts_tablet_manager.cc:1434] T f3abbeb71eba411bb6dfec800d3bd9c0 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.004s
I20260709 13:16:49.809362  9042 ts_tablet_manager.cc:1403] T b8ded21dd9a54bc8b9cd260808162d0d P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent bootstrapping tablet: real 0.137s	user 0.024s	sys 0.017s
I20260709 13:16:49.817315  9038 tablet_bootstrap.cc:492] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:49.819478  8841 raft_consensus.cc:2468] T 852f0ef4508245e2812b76665a70bbf8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 1.
I20260709 13:16:49.808287  8884 leader_election.cc:304] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243; no voters: e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:49.824599  9042 raft_consensus.cc:359] T b8ded21dd9a54bc8b9cd260808162d0d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:49.824843  9052 raft_consensus.cc:2804] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:49.825357  9042 raft_consensus.cc:385] T b8ded21dd9a54bc8b9cd260808162d0d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.825822  9052 raft_consensus.cc:697] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Becoming Leader. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Running, Role: LEADER
I20260709 13:16:49.828143  9052 consensus_queue.cc:237] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:49.828384  9040 raft_consensus.cc:359] T 574915613e8a4d3481aef27d3a977caa P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:49.830446  9130 raft_consensus.cc:493] T d09ffcae84334482a706af1e812c7c9d P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.831435  9245 consensus_queue.cc:1048] T dc5cf20be8db404dbda7f0b4a676ab31 P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:49.833681  8957 leader_election.cc:304] T 852f0ef4508245e2812b76665a70bbf8 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:16:49.837011  9245 raft_consensus.cc:2804] T 852f0ef4508245e2812b76665a70bbf8 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:49.830458  9040 raft_consensus.cc:385] T 574915613e8a4d3481aef27d3a977caa P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.840811  9040 raft_consensus.cc:740] T 574915613e8a4d3481aef27d3a977caa P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.806603  8768 raft_consensus.cc:2468] T 852f0ef4508245e2812b76665a70bbf8 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 1.
I20260709 13:16:49.831173  9130 raft_consensus.cc:515] T d09ffcae84334482a706af1e812c7c9d P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:49.843357  9130 leader_election.cc:290] T d09ffcae84334482a706af1e812c7c9d P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:49.825724  9042 raft_consensus.cc:740] T b8ded21dd9a54bc8b9cd260808162d0d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.823128  9039 tablet_bootstrap.cc:654] T 1521cafcc31b47c58829494618fc0cd8 P 7d3072f2af0b481d94ed70632b90e8c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.844719  9042 consensus_queue.cc:260] T b8ded21dd9a54bc8b9cd260808162d0d P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:49.819181  9247 raft_consensus.cc:515] T 1521cafcc31b47c58829494618fc0cd8 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:49.847375  9042 ts_tablet_manager.cc:1434] T b8ded21dd9a54bc8b9cd260808162d0d P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent starting tablet: real 0.035s	user 0.003s	sys 0.002s
I20260709 13:16:49.845965  9040 consensus_queue.cc:260] T 574915613e8a4d3481aef27d3a977caa P e8bb7e1240f44fda8b83e4c124852032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:49.848448  9042 tablet_bootstrap.cc:492] T dde08046aca642488918d1f2b978c126 P 43c6faa9496d44dda6b6eaed09cdfd12: Bootstrap starting.
I20260709 13:16:49.850042  9040 ts_tablet_manager.cc:1434] T 574915613e8a4d3481aef27d3a977caa P e8bb7e1240f44fda8b83e4c124852032: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 13:16:49.851841  9040 tablet_bootstrap.cc:492] T dde08046aca642488918d1f2b978c126 P e8bb7e1240f44fda8b83e4c124852032: Bootstrap starting.
I20260709 13:16:49.849572  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ffcae84334482a706af1e812c7c9d" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:49.857353  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1521cafcc31b47c58829494618fc0cd8" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
W20260709 13:16:49.858577  8957 leader_election.cc:343] T 1521cafcc31b47c58829494618fc0cd8 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.858901  9038 tablet_bootstrap.cc:654] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 895d3c58761f427c9c5b3cb41246c243: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.853367  9247 leader_election.cc:290] T 1521cafcc31b47c58829494618fc0cd8 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 election: Requested vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:49.865744  8770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1521cafcc31b47c58829494618fc0cd8" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243"
I20260709 13:16:49.866452  8770 raft_consensus.cc:3060] T 1521cafcc31b47c58829494618fc0cd8 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:49.871007  9042 tablet_bootstrap.cc:654] T dde08046aca642488918d1f2b978c126 P 43c6faa9496d44dda6b6eaed09cdfd12: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.874073  8667 catalog_manager.cc:5697] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195). New cstate: current_term: 1 leader_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:49.881732  9052 raft_consensus.cc:493] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.884584  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ffcae84334482a706af1e812c7c9d" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:49.893077  8768 raft_consensus.cc:2393] T d09ffcae84334482a706af1e812c7c9d P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3072f2af0b481d94ed70632b90e8c6 in current term 1: Already voted for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in this term.
I20260709 13:16:49.893371  9039 tablet_bootstrap.cc:492] T 1521cafcc31b47c58829494618fc0cd8 P 7d3072f2af0b481d94ed70632b90e8c6: No bootstrap required, opened a new log
I20260709 13:16:49.893955  9039 ts_tablet_manager.cc:1403] T 1521cafcc31b47c58829494618fc0cd8 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent bootstrapping tablet: real 0.084s	user 0.009s	sys 0.010s
I20260709 13:16:49.894695  8770 raft_consensus.cc:2468] T 1521cafcc31b47c58829494618fc0cd8 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 1.
I20260709 13:16:49.895701  8810 leader_election.cc:304] T d09ffcae84334482a706af1e812c7c9d P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:49.897450  8958 leader_election.cc:304] T 1521cafcc31b47c58829494618fc0cd8 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243, e8bb7e1240f44fda8b83e4c124852032; no voters: 7d3072f2af0b481d94ed70632b90e8c6
I20260709 13:16:49.898162  9130 raft_consensus.cc:3060] T d09ffcae84334482a706af1e812c7c9d P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:49.902731  9160 raft_consensus.cc:493] T 5a26acd2175646e3a53b493571852af4 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.903474  9160 raft_consensus.cc:515] T 5a26acd2175646e3a53b493571852af4 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:49.910604  9039 raft_consensus.cc:359] T 1521cafcc31b47c58829494618fc0cd8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:49.911397  9039 raft_consensus.cc:385] T 1521cafcc31b47c58829494618fc0cd8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.911716  9039 raft_consensus.cc:740] T 1521cafcc31b47c58829494618fc0cd8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.912070  9130 raft_consensus.cc:2749] T d09ffcae84334482a706af1e812c7c9d P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:49.912456  9039 consensus_queue.cc:260] T 1521cafcc31b47c58829494618fc0cd8 P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:49.914131  9347 raft_consensus.cc:493] T f3abbeb71eba411bb6dfec800d3bd9c0 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.914649  9347 raft_consensus.cc:515] T f3abbeb71eba411bb6dfec800d3bd9c0 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:49.890466  9245 raft_consensus.cc:697] T 852f0ef4508245e2812b76665a70bbf8 P e8bb7e1240f44fda8b83e4c124852032 [term 1 LEADER]: Becoming Leader. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Running, Role: LEADER
I20260709 13:16:49.916875  9039 ts_tablet_manager.cc:1434] T 1521cafcc31b47c58829494618fc0cd8 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.003s
I20260709 13:16:49.919269  9039 tablet_bootstrap.cc:492] T b8ded21dd9a54bc8b9cd260808162d0d P 7d3072f2af0b481d94ed70632b90e8c6: Bootstrap starting.
I20260709 13:16:49.916970  9347 leader_election.cc:290] T f3abbeb71eba411bb6dfec800d3bd9c0 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:49.917754  9245 consensus_queue.cc:237] T 852f0ef4508245e2812b76665a70bbf8 P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:49.921938  9040 tablet_bootstrap.cc:654] T dde08046aca642488918d1f2b978c126 P e8bb7e1240f44fda8b83e4c124852032: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.918135  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3abbeb71eba411bb6dfec800d3bd9c0" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
W20260709 13:16:49.930347  8734 leader_election.cc:343] T f3abbeb71eba411bb6dfec800d3bd9c0 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.931427  9160 leader_election.cc:290] T 5a26acd2175646e3a53b493571852af4 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:49.889799  9052 raft_consensus.cc:515] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:49.933108  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a26acd2175646e3a53b493571852af4" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:49.941104  8667 catalog_manager.cc:5697] T 2945a5b174e14a5a9052897942f876c2 P e8bb7e1240f44fda8b83e4c124852032 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196). New cstate: current_term: 1 leader_uuid: "e8bb7e1240f44fda8b83e4c124852032" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:49.955971  8734 leader_election.cc:343] T 5a26acd2175646e3a53b493571852af4 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.958546  9225 raft_consensus.cc:493] T b8ded21dd9a54bc8b9cd260808162d0d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.959358  9225 raft_consensus.cc:515] T b8ded21dd9a54bc8b9cd260808162d0d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:49.962546  9039 tablet_bootstrap.cc:654] T b8ded21dd9a54bc8b9cd260808162d0d P 7d3072f2af0b481d94ed70632b90e8c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.936026  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a26acd2175646e3a53b493571852af4" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:49.940243  9349 raft_consensus.cc:493] T 574915613e8a4d3481aef27d3a977caa P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.939719  9316 raft_consensus.cc:2804] T 1521cafcc31b47c58829494618fc0cd8 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:16:49.936678  8957 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:35315, user_credentials={real_user=slave}} blocked reactor thread for 44976.4us
I20260709 13:16:49.962441  9225 leader_election.cc:290] T b8ded21dd9a54bc8b9cd260808162d0d P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:49.978262  9042 tablet_bootstrap.cc:492] T dde08046aca642488918d1f2b978c126 P 43c6faa9496d44dda6b6eaed09cdfd12: No bootstrap required, opened a new log
I20260709 13:16:49.978849  9042 ts_tablet_manager.cc:1403] T dde08046aca642488918d1f2b978c126 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent bootstrapping tablet: real 0.131s	user 0.010s	sys 0.017s
I20260709 13:16:49.982412  9052 leader_election.cc:290] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:49.983323  9227 raft_consensus.cc:493] T 1521cafcc31b47c58829494618fc0cd8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.983492  8990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3abbeb71eba411bb6dfec800d3bd9c0" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:49.984076  9227 raft_consensus.cc:515] T 1521cafcc31b47c58829494618fc0cd8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:49.971148  9349 raft_consensus.cc:515] T 574915613e8a4d3481aef27d3a977caa P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
W20260709 13:16:49.987920  8733 leader_election.cc:343] T 5a26acd2175646e3a53b493571852af4 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.988463  8733 leader_election.cc:304] T 5a26acd2175646e3a53b493571852af4 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243; no voters: 7d3072f2af0b481d94ed70632b90e8c6, e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:49.989456  9349 leader_election.cc:290] T 574915613e8a4d3481aef27d3a977caa P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:49.990477  9160 raft_consensus.cc:2749] T 5a26acd2175646e3a53b493571852af4 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:49.995759  9247 consensus_queue.cc:1048] T dc5cf20be8db404dbda7f0b4a676ab31 P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:49.999801  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17f01b356e04590838cc6e6bb27bf64" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:50.000075  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8ded21dd9a54bc8b9cd260808162d0d" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:49.999840  8770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17f01b356e04590838cc6e6bb27bf64" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:50.001513  8770 raft_consensus.cc:2468] T c17f01b356e04590838cc6e6bb27bf64 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 0.
W20260709 13:16:50.002790  8883 leader_election.cc:343] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:50.003602  8883 leader_election.cc:343] T b8ded21dd9a54bc8b9cd260808162d0d P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:49.989907  8733 leader_election.cc:343] T f3abbeb71eba411bb6dfec800d3bd9c0 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.013633  8733 leader_election.cc:304] T f3abbeb71eba411bb6dfec800d3bd9c0 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243; no voters: 7d3072f2af0b481d94ed70632b90e8c6, e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:50.022070  9160 raft_consensus.cc:2749] T f3abbeb71eba411bb6dfec800d3bd9c0 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:50.029072  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574915613e8a4d3481aef27d3a977caa" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:50.029433  9316 raft_consensus.cc:697] T 1521cafcc31b47c58829494618fc0cd8 P e8bb7e1240f44fda8b83e4c124852032 [term 1 LEADER]: Becoming Leader. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Running, Role: LEADER
I20260709 13:16:50.031936  8884 leader_election.cc:304] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243; no voters: 7d3072f2af0b481d94ed70632b90e8c6
I20260709 13:16:50.048280  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1521cafcc31b47c58829494618fc0cd8" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:50.049031  9052 raft_consensus.cc:2804] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:50.049481  9052 raft_consensus.cc:493] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.049863  9052 raft_consensus.cc:3060] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:50.051141  9042 raft_consensus.cc:359] T dde08046aca642488918d1f2b978c126 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:50.051944  9042 raft_consensus.cc:385] T dde08046aca642488918d1f2b978c126 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:50.052193  9042 raft_consensus.cc:740] T dde08046aca642488918d1f2b978c126 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Initialized, Role: FOLLOWER
I20260709 13:16:50.052843  9042 consensus_queue.cc:260] T dde08046aca642488918d1f2b978c126 P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:50.055408  9042 ts_tablet_manager.cc:1434] T dde08046aca642488918d1f2b978c126 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent starting tablet: real 0.076s	user 0.006s	sys 0.000s
I20260709 13:16:50.056499  9042 tablet_bootstrap.cc:492] T 68650af2b1894208a4cc0a1c6ddf880b P 43c6faa9496d44dda6b6eaed09cdfd12: Bootstrap starting.
I20260709 13:16:50.061875  9052 raft_consensus.cc:515] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:50.062414  9227 leader_election.cc:290] T 1521cafcc31b47c58829494618fc0cd8 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:50.064569  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574915613e8a4d3481aef27d3a977caa" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:50.064803  9226 consensus_queue.cc:1048] T d09ffcae84334482a706af1e812c7c9d P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:50.065549  9038 tablet_bootstrap.cc:492] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 895d3c58761f427c9c5b3cb41246c243: No bootstrap required, opened a new log
I20260709 13:16:50.066708  9038 ts_tablet_manager.cc:1403] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.250s	user 0.026s	sys 0.084s
I20260709 13:16:50.069505  8768 raft_consensus.cc:2393] T 574915613e8a4d3481aef27d3a977caa P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bb7e1240f44fda8b83e4c124852032 in current term 1: Already voted for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in this term.
I20260709 13:16:50.072938  9038 raft_consensus.cc:359] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:50.073776  9038 raft_consensus.cc:385] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:50.073498  9316 consensus_queue.cc:237] T 1521cafcc31b47c58829494618fc0cd8 P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:50.076931  8770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1521cafcc31b47c58829494618fc0cd8" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:50.077836  8770 raft_consensus.cc:2393] T 1521cafcc31b47c58829494618fc0cd8 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3072f2af0b481d94ed70632b90e8c6 in current term 1: Already voted for candidate e8bb7e1240f44fda8b83e4c124852032 in this term.
I20260709 13:16:50.074091  9038 raft_consensus.cc:740] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:50.081537  9038 consensus_queue.cc:260] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:50.085204  9038 ts_tablet_manager.cc:1434] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:16:50.086194  9038 tablet_bootstrap.cc:492] T 68650af2b1894208a4cc0a1c6ddf880b P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:50.086064  9225 consensus_queue.cc:1048] T d09ffcae84334482a706af1e812c7c9d P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:50.090608  9227 consensus_queue.cc:1048] T f3ea64f4f4c54500a95692118660d9b4 P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:50.095323  8990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8ded21dd9a54bc8b9cd260808162d0d" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
W20260709 13:16:50.139820  8882 leader_election.cc:343] T b8ded21dd9a54bc8b9cd260808162d0d P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.145840  9347 raft_consensus.cc:493] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.154986  8958 leader_election.cc:304] T 574915613e8a4d3481aef27d3a977caa P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bb7e1240f44fda8b83e4c124852032; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:50.160212  9039 tablet_bootstrap.cc:492] T b8ded21dd9a54bc8b9cd260808162d0d P 7d3072f2af0b481d94ed70632b90e8c6: No bootstrap required, opened a new log
I20260709 13:16:50.160810  9039 ts_tablet_manager.cc:1403] T b8ded21dd9a54bc8b9cd260808162d0d P 7d3072f2af0b481d94ed70632b90e8c6: Time spent bootstrapping tablet: real 0.242s	user 0.011s	sys 0.027s
I20260709 13:16:50.161062  9356 raft_consensus.cc:3060] T 574915613e8a4d3481aef27d3a977caa P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:50.161162  8808 leader_election.cc:304] T 1521cafcc31b47c58829494618fc0cd8 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6; no voters: 895d3c58761f427c9c5b3cb41246c243, e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:50.166335  9039 raft_consensus.cc:359] T b8ded21dd9a54bc8b9cd260808162d0d P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:50.173866  9039 raft_consensus.cc:385] T b8ded21dd9a54bc8b9cd260808162d0d P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:50.174206  9039 raft_consensus.cc:740] T b8ded21dd9a54bc8b9cd260808162d0d P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Initialized, Role: FOLLOWER
I20260709 13:16:50.174877  9040 tablet_bootstrap.cc:492] T dde08046aca642488918d1f2b978c126 P e8bb7e1240f44fda8b83e4c124852032: No bootstrap required, opened a new log
I20260709 13:16:50.171299  9130 raft_consensus.cc:3060] T 1521cafcc31b47c58829494618fc0cd8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:50.175472  9040 ts_tablet_manager.cc:1403] T dde08046aca642488918d1f2b978c126 P e8bb7e1240f44fda8b83e4c124852032: Time spent bootstrapping tablet: real 0.324s	user 0.011s	sys 0.015s
I20260709 13:16:50.176095  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17f01b356e04590838cc6e6bb27bf64" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243"
I20260709 13:16:50.180163  8767 raft_consensus.cc:3060] T c17f01b356e04590838cc6e6bb27bf64 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:50.149477  9347 raft_consensus.cc:515] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:50.182351  9347 leader_election.cc:290] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:50.149047  8882 leader_election.cc:304] T b8ded21dd9a54bc8b9cd260808162d0d P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12; no voters: 7d3072f2af0b481d94ed70632b90e8c6, e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:50.179944  9229 consensus_queue.cc:1048] T f3ea64f4f4c54500a95692118660d9b4 P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:16:50.183408  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.196:46105, user_credentials={real_user=slave}} blocked reactor thread for 46507.6us
I20260709 13:16:50.184684  9226 raft_consensus.cc:2749] T b8ded21dd9a54bc8b9cd260808162d0d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:50.184742  8845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fa028ad690c4f3c94ec7c6443a3f1d3" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
W20260709 13:16:50.187443  8734 leader_election.cc:343] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.188328  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fa028ad690c4f3c94ec7c6443a3f1d3" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:50.188089  8667 catalog_manager.cc:5697] T 852f0ef4508245e2812b76665a70bbf8 P e8bb7e1240f44fda8b83e4c124852032 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196). New cstate: current_term: 1 leader_uuid: "e8bb7e1240f44fda8b83e4c124852032" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:50.190066  8667 catalog_manager.cc:5697] T 1521cafcc31b47c58829494618fc0cd8 P e8bb7e1240f44fda8b83e4c124852032 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196). New cstate: current_term: 1 leader_uuid: "e8bb7e1240f44fda8b83e4c124852032" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:50.192147  8736 leader_election.cc:343] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.192715  8736 leader_election.cc:304] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6
I20260709 13:16:50.200834  9251 raft_consensus.cc:2749] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:50.196254  9040 raft_consensus.cc:359] T dde08046aca642488918d1f2b978c126 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:50.203954  9040 raft_consensus.cc:385] T dde08046aca642488918d1f2b978c126 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:50.199399  9038 tablet_bootstrap.cc:654] T 68650af2b1894208a4cc0a1c6ddf880b P 895d3c58761f427c9c5b3cb41246c243: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:50.207406  8845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17f01b356e04590838cc6e6bb27bf64" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
I20260709 13:16:50.209551  9040 raft_consensus.cc:740] T dde08046aca642488918d1f2b978c126 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Initialized, Role: FOLLOWER
W20260709 13:16:50.213811  8883 leader_election.cc:343] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.174925  9039 consensus_queue.cc:260] T b8ded21dd9a54bc8b9cd260808162d0d P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:50.213438  9040 consensus_queue.cc:260] T dde08046aca642488918d1f2b978c126 P e8bb7e1240f44fda8b83e4c124852032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:50.218353  9052 leader_election.cc:290] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Requested vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:50.225446  9040 ts_tablet_manager.cc:1434] T dde08046aca642488918d1f2b978c126 P e8bb7e1240f44fda8b83e4c124852032: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.000s
I20260709 13:16:50.228227  9040 tablet_bootstrap.cc:492] T 5a26acd2175646e3a53b493571852af4 P e8bb7e1240f44fda8b83e4c124852032: Bootstrap starting.
I20260709 13:16:50.230990  9039 ts_tablet_manager.cc:1434] T b8ded21dd9a54bc8b9cd260808162d0d P 7d3072f2af0b481d94ed70632b90e8c6: Time spent starting tablet: real 0.070s	user 0.009s	sys 0.001s
I20260709 13:16:50.234416  9039 tablet_bootstrap.cc:492] T c17f01b356e04590838cc6e6bb27bf64 P 7d3072f2af0b481d94ed70632b90e8c6: Bootstrap starting.
I20260709 13:16:50.238214  9356 raft_consensus.cc:2749] T 574915613e8a4d3481aef27d3a977caa P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:50.233547  8767 raft_consensus.cc:2468] T c17f01b356e04590838cc6e6bb27bf64 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 1.
I20260709 13:16:50.258574  9039 tablet_bootstrap.cc:654] T c17f01b356e04590838cc6e6bb27bf64 P 7d3072f2af0b481d94ed70632b90e8c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:50.265727  9130 raft_consensus.cc:2749] T 1521cafcc31b47c58829494618fc0cd8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:50.250063  9227 raft_consensus.cc:493] T b8ded21dd9a54bc8b9cd260808162d0d P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.274350  9042 tablet_bootstrap.cc:654] T 68650af2b1894208a4cc0a1c6ddf880b P 43c6faa9496d44dda6b6eaed09cdfd12: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:50.273826  9227 raft_consensus.cc:515] T b8ded21dd9a54bc8b9cd260808162d0d P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:50.279377  9227 leader_election.cc:290] T b8ded21dd9a54bc8b9cd260808162d0d P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:50.279799  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8ded21dd9a54bc8b9cd260808162d0d" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:50.280543  8917 raft_consensus.cc:2468] T b8ded21dd9a54bc8b9cd260808162d0d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 0.
I20260709 13:16:50.282111  8811 leader_election.cc:304] T b8ded21dd9a54bc8b9cd260808162d0d P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6; no voters: 
I20260709 13:16:50.283056  9227 raft_consensus.cc:2804] T b8ded21dd9a54bc8b9cd260808162d0d P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:50.283597  9227 raft_consensus.cc:493] T b8ded21dd9a54bc8b9cd260808162d0d P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.284772  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8ded21dd9a54bc8b9cd260808162d0d" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
W20260709 13:16:50.286345  8808 leader_election.cc:343] T b8ded21dd9a54bc8b9cd260808162d0d P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.294026  8884 leader_election.cc:304] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243; no voters: 7d3072f2af0b481d94ed70632b90e8c6
I20260709 13:16:50.296324  9038 tablet_bootstrap.cc:492] T 68650af2b1894208a4cc0a1c6ddf880b P 895d3c58761f427c9c5b3cb41246c243: No bootstrap required, opened a new log
I20260709 13:16:50.296958  9038 ts_tablet_manager.cc:1403] T 68650af2b1894208a4cc0a1c6ddf880b P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.211s	user 0.019s	sys 0.005s
I20260709 13:16:50.298857  9052 raft_consensus.cc:2804] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:50.286433  9227 raft_consensus.cc:3060] T b8ded21dd9a54bc8b9cd260808162d0d P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:50.309355  9042 tablet_bootstrap.cc:492] T 68650af2b1894208a4cc0a1c6ddf880b P 43c6faa9496d44dda6b6eaed09cdfd12: No bootstrap required, opened a new log
I20260709 13:16:50.310030  9042 ts_tablet_manager.cc:1403] T 68650af2b1894208a4cc0a1c6ddf880b P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent bootstrapping tablet: real 0.254s	user 0.007s	sys 0.012s
I20260709 13:16:50.313094  9042 raft_consensus.cc:359] T 68650af2b1894208a4cc0a1c6ddf880b P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:50.313848  9042 raft_consensus.cc:385] T 68650af2b1894208a4cc0a1c6ddf880b P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:50.314150  9042 raft_consensus.cc:740] T 68650af2b1894208a4cc0a1c6ddf880b P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Initialized, Role: FOLLOWER
I20260709 13:16:50.314854  9042 consensus_queue.cc:260] T 68650af2b1894208a4cc0a1c6ddf880b P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:50.317551  9042 ts_tablet_manager.cc:1434] T 68650af2b1894208a4cc0a1c6ddf880b P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:16:50.318625  9042 tablet_bootstrap.cc:492] T 51992816e23f4cf99d31cec60fa429b9 P 43c6faa9496d44dda6b6eaed09cdfd12: Bootstrap starting.
I20260709 13:16:50.322203  9225 raft_consensus.cc:493] T dde08046aca642488918d1f2b978c126 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.322805  9225 raft_consensus.cc:515] T dde08046aca642488918d1f2b978c126 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:50.325129  9225 leader_election.cc:290] T dde08046aca642488918d1f2b978c126 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:50.328959  9042 tablet_bootstrap.cc:654] T 51992816e23f4cf99d31cec60fa429b9 P 43c6faa9496d44dda6b6eaed09cdfd12: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:50.330196  9040 tablet_bootstrap.cc:654] T 5a26acd2175646e3a53b493571852af4 P e8bb7e1240f44fda8b83e4c124852032: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:50.333933  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde08046aca642488918d1f2b978c126" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:50.334816  9038 raft_consensus.cc:359] T 68650af2b1894208a4cc0a1c6ddf880b P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:50.335076  8993 raft_consensus.cc:2468] T dde08046aca642488918d1f2b978c126 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 0.
I20260709 13:16:50.338649  8882 leader_election.cc:304] T dde08046aca642488918d1f2b978c126 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:16:50.339741  9279 consensus_queue.cc:1048] T 2945a5b174e14a5a9052897942f876c2 P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:50.340785  9227 raft_consensus.cc:515] T b8ded21dd9a54bc8b9cd260808162d0d P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:50.347257  9374 raft_consensus.cc:2804] T dde08046aca642488918d1f2b978c126 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:50.347889  9374 raft_consensus.cc:493] T dde08046aca642488918d1f2b978c126 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.348328  9374 raft_consensus.cc:3060] T dde08046aca642488918d1f2b978c126 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:50.349236  9039 tablet_bootstrap.cc:492] T c17f01b356e04590838cc6e6bb27bf64 P 7d3072f2af0b481d94ed70632b90e8c6: No bootstrap required, opened a new log
I20260709 13:16:50.349411  9038 raft_consensus.cc:385] T 68650af2b1894208a4cc0a1c6ddf880b P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:50.349758  9038 raft_consensus.cc:740] T 68650af2b1894208a4cc0a1c6ddf880b P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:50.350250  9039 ts_tablet_manager.cc:1403] T c17f01b356e04590838cc6e6bb27bf64 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent bootstrapping tablet: real 0.118s	user 0.016s	sys 0.000s
I20260709 13:16:50.352743  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8ded21dd9a54bc8b9cd260808162d0d" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:16:50.353116  9052 raft_consensus.cc:697] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Becoming Leader. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Running, Role: LEADER
I20260709 13:16:50.353528  8918 raft_consensus.cc:3060] T b8ded21dd9a54bc8b9cd260808162d0d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:50.354938  9042 tablet_bootstrap.cc:492] T 51992816e23f4cf99d31cec60fa429b9 P 43c6faa9496d44dda6b6eaed09cdfd12: No bootstrap required, opened a new log
I20260709 13:16:50.359217  9042 ts_tablet_manager.cc:1403] T 51992816e23f4cf99d31cec60fa429b9 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent bootstrapping tablet: real 0.041s	user 0.009s	sys 0.004s
I20260709 13:16:50.367132  9227 leader_election.cc:290] T b8ded21dd9a54bc8b9cd260808162d0d P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 election: Requested vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:50.357199  9039 raft_consensus.cc:359] T c17f01b356e04590838cc6e6bb27bf64 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:50.367825  9039 raft_consensus.cc:385] T c17f01b356e04590838cc6e6bb27bf64 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:50.362161  9038 consensus_queue.cc:260] T 68650af2b1894208a4cc0a1c6ddf880b P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:50.365233  8990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8ded21dd9a54bc8b9cd260808162d0d" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
I20260709 13:16:50.368201  9039 raft_consensus.cc:740] T c17f01b356e04590838cc6e6bb27bf64 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Initialized, Role: FOLLOWER
W20260709 13:16:50.369367  8808 leader_election.cc:343] T b8ded21dd9a54bc8b9cd260808162d0d P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.369367  9039 consensus_queue.cc:260] T c17f01b356e04590838cc6e6bb27bf64 P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:50.371838  9038 ts_tablet_manager.cc:1434] T 68650af2b1894208a4cc0a1c6ddf880b P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.075s	user 0.007s	sys 0.001s
I20260709 13:16:50.374394  8918 raft_consensus.cc:2468] T b8ded21dd9a54bc8b9cd260808162d0d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 1.
I20260709 13:16:50.354657  9052 consensus_queue.cc:237] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:50.375586  9038 tablet_bootstrap.cc:492] T 69e5f8bfdb5a46808e713e051a38866d P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:50.371464  9042 raft_consensus.cc:359] T 51992816e23f4cf99d31cec60fa429b9 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:50.378086  9042 raft_consensus.cc:385] T 51992816e23f4cf99d31cec60fa429b9 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:50.378424  9042 raft_consensus.cc:740] T 51992816e23f4cf99d31cec60fa429b9 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Initialized, Role: FOLLOWER
I20260709 13:16:50.374434  9039 ts_tablet_manager.cc:1434] T c17f01b356e04590838cc6e6bb27bf64 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260709 13:16:50.380270  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde08046aca642488918d1f2b978c126" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:50.381006  8768 raft_consensus.cc:2468] T dde08046aca642488918d1f2b978c126 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 0.
I20260709 13:16:50.382632  9042 consensus_queue.cc:260] T 51992816e23f4cf99d31cec60fa429b9 P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:50.383384  9038 tablet_bootstrap.cc:654] T 69e5f8bfdb5a46808e713e051a38866d P 895d3c58761f427c9c5b3cb41246c243: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:50.385174  9042 ts_tablet_manager.cc:1434] T 51992816e23f4cf99d31cec60fa429b9 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:16:50.386229  9042 tablet_bootstrap.cc:492] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 43c6faa9496d44dda6b6eaed09cdfd12: Bootstrap starting.
I20260709 13:16:50.387377  9040 tablet_bootstrap.cc:492] T 5a26acd2175646e3a53b493571852af4 P e8bb7e1240f44fda8b83e4c124852032: No bootstrap required, opened a new log
I20260709 13:16:50.387905  9040 ts_tablet_manager.cc:1403] T 5a26acd2175646e3a53b493571852af4 P e8bb7e1240f44fda8b83e4c124852032: Time spent bootstrapping tablet: real 0.160s	user 0.029s	sys 0.013s
I20260709 13:16:50.388453  8811 leader_election.cc:304] T b8ded21dd9a54bc8b9cd260808162d0d P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6; no voters: e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:50.390202  9227 raft_consensus.cc:2804] T b8ded21dd9a54bc8b9cd260808162d0d P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:50.390841  9227 raft_consensus.cc:697] T b8ded21dd9a54bc8b9cd260808162d0d P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 LEADER]: Becoming Leader. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Running, Role: LEADER
I20260709 13:16:50.391036  9040 raft_consensus.cc:359] T 5a26acd2175646e3a53b493571852af4 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:50.391803  9040 raft_consensus.cc:385] T 5a26acd2175646e3a53b493571852af4 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:50.392062  9227 consensus_queue.cc:237] T b8ded21dd9a54bc8b9cd260808162d0d P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:50.395993  9316 consensus_queue.cc:1048] T 2945a5b174e14a5a9052897942f876c2 P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:50.397902  9039 tablet_bootstrap.cc:492] T f3abbeb71eba411bb6dfec800d3bd9c0 P 7d3072f2af0b481d94ed70632b90e8c6: Bootstrap starting.
I20260709 13:16:50.392129  9040 raft_consensus.cc:740] T 5a26acd2175646e3a53b493571852af4 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Initialized, Role: FOLLOWER
I20260709 13:16:50.404345  9040 consensus_queue.cc:260] T 5a26acd2175646e3a53b493571852af4 P e8bb7e1240f44fda8b83e4c124852032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:50.406926  9040 ts_tablet_manager.cc:1434] T 5a26acd2175646e3a53b493571852af4 P e8bb7e1240f44fda8b83e4c124852032: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:16:50.407984  9040 tablet_bootstrap.cc:492] T 68650af2b1894208a4cc0a1c6ddf880b P e8bb7e1240f44fda8b83e4c124852032: Bootstrap starting.
I20260709 13:16:50.415019  9316 consensus_queue.cc:1048] T 852f0ef4508245e2812b76665a70bbf8 P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:50.423063  9040 tablet_bootstrap.cc:654] T 68650af2b1894208a4cc0a1c6ddf880b P e8bb7e1240f44fda8b83e4c124852032: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:50.420951  9039 tablet_bootstrap.cc:654] T f3abbeb71eba411bb6dfec800d3bd9c0 P 7d3072f2af0b481d94ed70632b90e8c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:50.445047  9279 consensus_queue.cc:1048] T 852f0ef4508245e2812b76665a70bbf8 P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:50.471433  9042 tablet_bootstrap.cc:654] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 43c6faa9496d44dda6b6eaed09cdfd12: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:50.473177  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:39173, user_credentials={real_user=slave}} blocked reactor thread for 46101.1us
I20260709 13:16:50.481421  9374 raft_consensus.cc:515] T dde08046aca642488918d1f2b978c126 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:50.490362  9251 raft_consensus.cc:493] T 68650af2b1894208a4cc0a1c6ddf880b P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.490794  8664 catalog_manager.cc:5697] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195). New cstate: current_term: 1 leader_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:50.491201  9251 raft_consensus.cc:515] T 68650af2b1894208a4cc0a1c6ddf880b P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:50.496793  9251 leader_election.cc:290] T 68650af2b1894208a4cc0a1c6ddf880b P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:50.497190  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68650af2b1894208a4cc0a1c6ddf880b" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:50.497494  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68650af2b1894208a4cc0a1c6ddf880b" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:50.498099  8917 raft_consensus.cc:2468] T 68650af2b1894208a4cc0a1c6ddf880b P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 0.
I20260709 13:16:50.498399  9373 consensus_queue.cc:1048] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:16:50.499094  8733 leader_election.cc:343] T 68650af2b1894208a4cc0a1c6ddf880b P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.499872  8736 leader_election.cc:304] T 68650af2b1894208a4cc0a1c6ddf880b P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243; no voters: e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:50.502905  9347 raft_consensus.cc:2804] T 68650af2b1894208a4cc0a1c6ddf880b P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:50.503245  9347 raft_consensus.cc:493] T 68650af2b1894208a4cc0a1c6ddf880b P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.503572  9347 raft_consensus.cc:3060] T 68650af2b1894208a4cc0a1c6ddf880b P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:50.506435  9052 consensus_queue.cc:1048] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:50.515530  9347 raft_consensus.cc:515] T 68650af2b1894208a4cc0a1c6ddf880b P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:50.520654  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68650af2b1894208a4cc0a1c6ddf880b" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:16:50.521560  8918 raft_consensus.cc:3060] T 68650af2b1894208a4cc0a1c6ddf880b P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:50.551023  8666 catalog_manager.cc:5697] T b8ded21dd9a54bc8b9cd260808162d0d P 7d3072f2af0b481d94ed70632b90e8c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194). New cstate: current_term: 1 leader_uuid: "7d3072f2af0b481d94ed70632b90e8c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:50.552917  9347 leader_election.cc:290] T 68650af2b1894208a4cc0a1c6ddf880b P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 election: Requested vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:50.552995  8990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68650af2b1894208a4cc0a1c6ddf880b" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
W20260709 13:16:50.555394  8733 leader_election.cc:343] T 68650af2b1894208a4cc0a1c6ddf880b P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.575049  8918 raft_consensus.cc:2468] T 68650af2b1894208a4cc0a1c6ddf880b P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 1.
I20260709 13:16:50.577729  9039 tablet_bootstrap.cc:492] T f3abbeb71eba411bb6dfec800d3bd9c0 P 7d3072f2af0b481d94ed70632b90e8c6: No bootstrap required, opened a new log
I20260709 13:16:50.581349  9039 ts_tablet_manager.cc:1403] T f3abbeb71eba411bb6dfec800d3bd9c0 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent bootstrapping tablet: real 0.201s	user 0.019s	sys 0.001s
I20260709 13:16:50.582552  8736 leader_election.cc:304] T 68650af2b1894208a4cc0a1c6ddf880b P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243; no voters: e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:50.584515  9347 raft_consensus.cc:2804] T 68650af2b1894208a4cc0a1c6ddf880b P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:50.580015  9042 tablet_bootstrap.cc:492] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 43c6faa9496d44dda6b6eaed09cdfd12: No bootstrap required, opened a new log
I20260709 13:16:50.585073  9347 raft_consensus.cc:697] T 68650af2b1894208a4cc0a1c6ddf880b P 895d3c58761f427c9c5b3cb41246c243 [term 1 LEADER]: Becoming Leader. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Running, Role: LEADER
I20260709 13:16:50.585807  9042 ts_tablet_manager.cc:1403] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent bootstrapping tablet: real 0.200s	user 0.019s	sys 0.000s
I20260709 13:16:50.586141  9347 consensus_queue.cc:237] T 68650af2b1894208a4cc0a1c6ddf880b P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:50.589931  9039 raft_consensus.cc:359] T f3abbeb71eba411bb6dfec800d3bd9c0 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:50.593958  9039 raft_consensus.cc:385] T f3abbeb71eba411bb6dfec800d3bd9c0 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:50.596048  9039 raft_consensus.cc:740] T f3abbeb71eba411bb6dfec800d3bd9c0 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Initialized, Role: FOLLOWER
I20260709 13:16:50.597323  8990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde08046aca642488918d1f2b978c126" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
I20260709 13:16:50.598054  8990 raft_consensus.cc:3060] T dde08046aca642488918d1f2b978c126 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:50.592929  9042 raft_consensus.cc:359] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:50.599210  9042 raft_consensus.cc:385] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:50.600790  9042 raft_consensus.cc:740] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Initialized, Role: FOLLOWER
I20260709 13:16:50.597575  9039 consensus_queue.cc:260] T f3abbeb71eba411bb6dfec800d3bd9c0 P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:50.604105  9042 consensus_queue.cc:260] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:50.607527  9042 ts_tablet_manager.cc:1434] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.002s
I20260709 13:16:50.606127  9039 ts_tablet_manager.cc:1434] T f3abbeb71eba411bb6dfec800d3bd9c0 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 13:16:50.609951  9039 tablet_bootstrap.cc:492] T 51992816e23f4cf99d31cec60fa429b9 P 7d3072f2af0b481d94ed70632b90e8c6: Bootstrap starting.
I20260709 13:16:50.634181  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde08046aca642488918d1f2b978c126" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243"
I20260709 13:16:50.636718  8765 raft_consensus.cc:3060] T dde08046aca642488918d1f2b978c126 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:50.637005  9039 tablet_bootstrap.cc:654] T 51992816e23f4cf99d31cec60fa429b9 P 7d3072f2af0b481d94ed70632b90e8c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:50.631668  9042 tablet_bootstrap.cc:492] T 55bac44fd5a3462593ab47f6b6f44c6e P 43c6faa9496d44dda6b6eaed09cdfd12: Bootstrap starting.
I20260709 13:16:50.626700  8668 catalog_manager.cc:5697] T 68650af2b1894208a4cc0a1c6ddf880b P 895d3c58761f427c9c5b3cb41246c243 reported cstate change: term changed from 0 to 1, leader changed from <none> to 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "895d3c58761f427c9c5b3cb41246c243" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:50.658414  8765 raft_consensus.cc:2468] T dde08046aca642488918d1f2b978c126 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 1.
I20260709 13:16:50.675302  9042 tablet_bootstrap.cc:654] T 55bac44fd5a3462593ab47f6b6f44c6e P 43c6faa9496d44dda6b6eaed09cdfd12: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:50.676982  8884 leader_election.cc:304] T dde08046aca642488918d1f2b978c126 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243; no voters: 
I20260709 13:16:50.678426  9370 raft_consensus.cc:2804] T dde08046aca642488918d1f2b978c126 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:50.679093  9370 raft_consensus.cc:697] T dde08046aca642488918d1f2b978c126 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Becoming Leader. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Running, Role: LEADER
I20260709 13:16:50.680258  9370 consensus_queue.cc:237] T dde08046aca642488918d1f2b978c126 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:50.691443  9042 tablet_bootstrap.cc:492] T 55bac44fd5a3462593ab47f6b6f44c6e P 43c6faa9496d44dda6b6eaed09cdfd12: No bootstrap required, opened a new log
I20260709 13:16:50.692600  9042 ts_tablet_manager.cc:1403] T 55bac44fd5a3462593ab47f6b6f44c6e P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent bootstrapping tablet: real 0.061s	user 0.014s	sys 0.006s
I20260709 13:16:50.693490  9245 consensus_queue.cc:1048] T 1521cafcc31b47c58829494618fc0cd8 P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:50.696305  9225 raft_consensus.cc:493] T 51992816e23f4cf99d31cec60fa429b9 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.696503  9042 raft_consensus.cc:359] T 55bac44fd5a3462593ab47f6b6f44c6e P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:50.696910  9225 raft_consensus.cc:515] T 51992816e23f4cf99d31cec60fa429b9 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:50.697351  9042 raft_consensus.cc:385] T 55bac44fd5a3462593ab47f6b6f44c6e P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:50.697773  9042 raft_consensus.cc:740] T 55bac44fd5a3462593ab47f6b6f44c6e P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Initialized, Role: FOLLOWER
I20260709 13:16:50.698686  9042 consensus_queue.cc:260] T 55bac44fd5a3462593ab47f6b6f44c6e P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:50.699162  9225 leader_election.cc:290] T 51992816e23f4cf99d31cec60fa429b9 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:50.701303  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51992816e23f4cf99d31cec60fa429b9" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:50.701644  9042 ts_tablet_manager.cc:1434] T 55bac44fd5a3462593ab47f6b6f44c6e P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:16:50.702646  9358 raft_consensus.cc:493] T 5a26acd2175646e3a53b493571852af4 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.702790  9042 tablet_bootstrap.cc:492] T cc6e2639db63487cae6a125c8d5fe1d8 P 43c6faa9496d44dda6b6eaed09cdfd12: Bootstrap starting.
I20260709 13:16:50.703161  9358 raft_consensus.cc:515] T 5a26acd2175646e3a53b493571852af4 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
W20260709 13:16:50.703751  8882 leader_election.cc:343] T 51992816e23f4cf99d31cec60fa429b9 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.705750  9358 leader_election.cc:290] T 5a26acd2175646e3a53b493571852af4 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:50.706709  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a26acd2175646e3a53b493571852af4" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:50.708042  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a26acd2175646e3a53b493571852af4" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
W20260709 13:16:50.709668  8957 leader_election.cc:343] T 5a26acd2175646e3a53b493571852af4 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.709928  9245 consensus_queue.cc:1048] T 1521cafcc31b47c58829494618fc0cd8 P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:50.718370  8769 raft_consensus.cc:2468] T 5a26acd2175646e3a53b493571852af4 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 0.
I20260709 13:16:50.721618  8958 leader_election.cc:304] T 5a26acd2175646e3a53b493571852af4 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243, e8bb7e1240f44fda8b83e4c124852032; no voters: 7d3072f2af0b481d94ed70632b90e8c6
I20260709 13:16:50.725046  9356 raft_consensus.cc:2804] T 5a26acd2175646e3a53b493571852af4 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:50.725605  9356 raft_consensus.cc:493] T 5a26acd2175646e3a53b493571852af4 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.726229  9356 raft_consensus.cc:3060] T 5a26acd2175646e3a53b493571852af4 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:50.727991  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51992816e23f4cf99d31cec60fa429b9" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
W20260709 13:16:50.729655  8883 leader_election.cc:343] T 51992816e23f4cf99d31cec60fa429b9 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.730309  8883 leader_election.cc:304] T 51992816e23f4cf99d31cec60fa429b9 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12; no voters: 7d3072f2af0b481d94ed70632b90e8c6, e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:50.731520  9225 raft_consensus.cc:2749] T 51992816e23f4cf99d31cec60fa429b9 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:16:50.731794  9387 log.cc:927] Time spent T 574915613e8a4d3481aef27d3a977caa P e8bb7e1240f44fda8b83e4c124852032: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:16:50.665575  9374 leader_election.cc:290] T dde08046aca642488918d1f2b978c126 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Requested vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:50.740927  9356 raft_consensus.cc:515] T 5a26acd2175646e3a53b493571852af4 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:50.744555  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a26acd2175646e3a53b493571852af4" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243"
I20260709 13:16:50.745327  8769 raft_consensus.cc:3060] T 5a26acd2175646e3a53b493571852af4 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:50.748487  8990 raft_consensus.cc:2468] T dde08046aca642488918d1f2b978c126 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 1.
I20260709 13:16:50.752878  9042 tablet_bootstrap.cc:654] T cc6e2639db63487cae6a125c8d5fe1d8 P 43c6faa9496d44dda6b6eaed09cdfd12: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:50.763145  9356 leader_election.cc:290] T 5a26acd2175646e3a53b493571852af4 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 election: Requested vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:50.763372  8845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a26acd2175646e3a53b493571852af4" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
W20260709 13:16:50.765964  8957 leader_election.cc:343] T 5a26acd2175646e3a53b493571852af4 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.767663  9040 tablet_bootstrap.cc:492] T 68650af2b1894208a4cc0a1c6ddf880b P e8bb7e1240f44fda8b83e4c124852032: No bootstrap required, opened a new log
I20260709 13:16:50.763501  8842 raft_consensus.cc:3060] T c17f01b356e04590838cc6e6bb27bf64 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:50.768457  9040 ts_tablet_manager.cc:1403] T 68650af2b1894208a4cc0a1c6ddf880b P e8bb7e1240f44fda8b83e4c124852032: Time spent bootstrapping tablet: real 0.361s	user 0.094s	sys 0.110s
I20260709 13:16:50.769027  9038 tablet_bootstrap.cc:492] T 69e5f8bfdb5a46808e713e051a38866d P 895d3c58761f427c9c5b3cb41246c243: No bootstrap required, opened a new log
I20260709 13:16:50.769560  9038 ts_tablet_manager.cc:1403] T 69e5f8bfdb5a46808e713e051a38866d P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.394s	user 0.047s	sys 0.104s
I20260709 13:16:50.771713  9040 raft_consensus.cc:359] T 68650af2b1894208a4cc0a1c6ddf880b P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:50.785228  9040 raft_consensus.cc:385] T 68650af2b1894208a4cc0a1c6ddf880b P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:50.785719  9040 raft_consensus.cc:740] T 68650af2b1894208a4cc0a1c6ddf880b P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Initialized, Role: FOLLOWER
I20260709 13:16:50.786584  9040 consensus_queue.cc:260] T 68650af2b1894208a4cc0a1c6ddf880b P e8bb7e1240f44fda8b83e4c124852032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:50.789108  9040 ts_tablet_manager.cc:1434] T 68650af2b1894208a4cc0a1c6ddf880b P e8bb7e1240f44fda8b83e4c124852032: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:16:50.795130  9130 raft_consensus.cc:493] T c17f01b356e04590838cc6e6bb27bf64 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.804350  9130 raft_consensus.cc:515] T c17f01b356e04590838cc6e6bb27bf64 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:50.800321  9225 consensus_queue.cc:1048] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:50.811583  9130 leader_election.cc:290] T c17f01b356e04590838cc6e6bb27bf64 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:50.812096  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17f01b356e04590838cc6e6bb27bf64" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:50.812879  8768 raft_consensus.cc:2468] T c17f01b356e04590838cc6e6bb27bf64 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 1.
I20260709 13:16:50.812175  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17f01b356e04590838cc6e6bb27bf64" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:50.813047  9040 tablet_bootstrap.cc:492] T b8ded21dd9a54bc8b9cd260808162d0d P e8bb7e1240f44fda8b83e4c124852032: Bootstrap starting.
I20260709 13:16:50.814901  8769 raft_consensus.cc:2468] T 5a26acd2175646e3a53b493571852af4 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 1.
I20260709 13:16:50.831466  9042 tablet_bootstrap.cc:492] T cc6e2639db63487cae6a125c8d5fe1d8 P 43c6faa9496d44dda6b6eaed09cdfd12: No bootstrap required, opened a new log
I20260709 13:16:50.776114  9038 raft_consensus.cc:359] T 69e5f8bfdb5a46808e713e051a38866d P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:50.836169  9038 raft_consensus.cc:385] T 69e5f8bfdb5a46808e713e051a38866d P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:50.836231  9042 ts_tablet_manager.cc:1403] T cc6e2639db63487cae6a125c8d5fe1d8 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent bootstrapping tablet: real 0.134s	user 0.013s	sys 0.008s
I20260709 13:16:50.836591  9038 raft_consensus.cc:740] T 69e5f8bfdb5a46808e713e051a38866d P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:50.838295  9040 tablet_bootstrap.cc:654] T b8ded21dd9a54bc8b9cd260808162d0d P e8bb7e1240f44fda8b83e4c124852032: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:50.840900  8958 leader_election.cc:304] T 5a26acd2175646e3a53b493571852af4 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243, e8bb7e1240f44fda8b83e4c124852032; no voters: 7d3072f2af0b481d94ed70632b90e8c6
I20260709 13:16:50.840960  8810 leader_election.cc:304] T c17f01b356e04590838cc6e6bb27bf64 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6, 895d3c58761f427c9c5b3cb41246c243; no voters: 43c6faa9496d44dda6b6eaed09cdfd12
I20260709 13:16:50.842157  9130 raft_consensus.cc:2804] T c17f01b356e04590838cc6e6bb27bf64 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:50.842583  9130 raft_consensus.cc:493] T c17f01b356e04590838cc6e6bb27bf64 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 43c6faa9496d44dda6b6eaed09cdfd12)
I20260709 13:16:50.843030  9130 raft_consensus.cc:3060] T c17f01b356e04590838cc6e6bb27bf64 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:50.842645  9038 consensus_queue.cc:260] T 69e5f8bfdb5a46808e713e051a38866d P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:50.841811  9042 raft_consensus.cc:359] T cc6e2639db63487cae6a125c8d5fe1d8 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:50.843406  9358 raft_consensus.cc:2804] T 5a26acd2175646e3a53b493571852af4 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:50.843866  9042 raft_consensus.cc:385] T cc6e2639db63487cae6a125c8d5fe1d8 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:50.844199  9042 raft_consensus.cc:740] T cc6e2639db63487cae6a125c8d5fe1d8 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Initialized, Role: FOLLOWER
I20260709 13:16:50.844375  9358 raft_consensus.cc:697] T 5a26acd2175646e3a53b493571852af4 P e8bb7e1240f44fda8b83e4c124852032 [term 1 LEADER]: Becoming Leader. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Running, Role: LEADER
I20260709 13:16:50.845759  9042 consensus_queue.cc:260] T cc6e2639db63487cae6a125c8d5fe1d8 P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:50.845896  9358 consensus_queue.cc:237] T 5a26acd2175646e3a53b493571852af4 P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:50.838630  8664 catalog_manager.cc:5697] T dde08046aca642488918d1f2b978c126 P 43c6faa9496d44dda6b6eaed09cdfd12 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195). New cstate: current_term: 1 leader_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:50.848265  9042 ts_tablet_manager.cc:1434] T cc6e2639db63487cae6a125c8d5fe1d8 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:16:50.849339  9042 tablet_bootstrap.cc:492] T 9fdcbb0a74a64826ab0665c349b16200 P 43c6faa9496d44dda6b6eaed09cdfd12: Bootstrap starting.
W20260709 13:16:50.849449  8808 consensus_peers.cc:597] T b8ded21dd9a54bc8b9cd260808162d0d P 7d3072f2af0b481d94ed70632b90e8c6 -> Peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Couldn't send request to peer e8bb7e1240f44fda8b83e4c124852032. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:50.855149  9038 ts_tablet_manager.cc:1434] T 69e5f8bfdb5a46808e713e051a38866d P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.085s	user 0.008s	sys 0.000s
I20260709 13:16:50.856289  9038 tablet_bootstrap.cc:492] T cc6e2639db63487cae6a125c8d5fe1d8 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:50.865402  9130 raft_consensus.cc:515] T c17f01b356e04590838cc6e6bb27bf64 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:50.867488  9374 consensus_queue.cc:1048] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:50.879007  9039 tablet_bootstrap.cc:492] T 51992816e23f4cf99d31cec60fa429b9 P 7d3072f2af0b481d94ed70632b90e8c6: No bootstrap required, opened a new log
I20260709 13:16:50.879680  9039 ts_tablet_manager.cc:1403] T 51992816e23f4cf99d31cec60fa429b9 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent bootstrapping tablet: real 0.270s	user 0.031s	sys 0.015s
I20260709 13:16:50.886205  9039 raft_consensus.cc:359] T 51992816e23f4cf99d31cec60fa429b9 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:50.893116  9039 raft_consensus.cc:385] T 51992816e23f4cf99d31cec60fa429b9 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:50.893563  9039 raft_consensus.cc:740] T 51992816e23f4cf99d31cec60fa429b9 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Initialized, Role: FOLLOWER
I20260709 13:16:50.897536  9039 consensus_queue.cc:260] T 51992816e23f4cf99d31cec60fa429b9 P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:50.903499  9374 raft_consensus.cc:493] T 55bac44fd5a3462593ab47f6b6f44c6e P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.906567  9374 raft_consensus.cc:515] T 55bac44fd5a3462593ab47f6b6f44c6e P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:50.919704  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17f01b356e04590838cc6e6bb27bf64" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243"
I20260709 13:16:50.921888  9042 tablet_bootstrap.cc:654] T 9fdcbb0a74a64826ab0665c349b16200 P 43c6faa9496d44dda6b6eaed09cdfd12: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:50.923419  8716 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:50.933692  9374 leader_election.cc:290] T 55bac44fd5a3462593ab47f6b6f44c6e P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:50.954263  9039 ts_tablet_manager.cc:1434] T 51992816e23f4cf99d31cec60fa429b9 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent starting tablet: real 0.074s	user 0.008s	sys 0.001s
I20260709 13:16:50.955272  9039 tablet_bootstrap.cc:492] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 7d3072f2af0b481d94ed70632b90e8c6: Bootstrap starting.
I20260709 13:16:50.956269  8845 raft_consensus.cc:1240] T c17f01b356e04590838cc6e6bb27bf64 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Rejecting Update request from peer 43c6faa9496d44dda6b6eaed09cdfd12 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:50.958091  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bac44fd5a3462593ab47f6b6f44c6e" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:50.960772  9038 tablet_bootstrap.cc:654] T cc6e2639db63487cae6a125c8d5fe1d8 P 895d3c58761f427c9c5b3cb41246c243: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:50.956384  9370 raft_consensus.cc:493] T cc6e2639db63487cae6a125c8d5fe1d8 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.962985  9370 raft_consensus.cc:515] T cc6e2639db63487cae6a125c8d5fe1d8 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:50.964283  8990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bac44fd5a3462593ab47f6b6f44c6e" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
W20260709 13:16:50.970844  8882 leader_election.cc:343] T 55bac44fd5a3462593ab47f6b6f44c6e P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.972172  9130 leader_election.cc:290] T c17f01b356e04590838cc6e6bb27bf64 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 election: Requested vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:50.977713  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc6e2639db63487cae6a125c8d5fe1d8" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:51.026587  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17f01b356e04590838cc6e6bb27bf64" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:16:51.028249  9040 tablet_bootstrap.cc:492] T b8ded21dd9a54bc8b9cd260808162d0d P e8bb7e1240f44fda8b83e4c124852032: No bootstrap required, opened a new log
I20260709 13:16:51.028391  8811 leader_election.cc:304] T c17f01b356e04590838cc6e6bb27bf64 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:51.030139  9040 ts_tablet_manager.cc:1403] T b8ded21dd9a54bc8b9cd260808162d0d P e8bb7e1240f44fda8b83e4c124852032: Time spent bootstrapping tablet: real 0.217s	user 0.037s	sys 0.030s
I20260709 13:16:51.030725  9227 raft_consensus.cc:2749] T c17f01b356e04590838cc6e6bb27bf64 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:50.982774  9373 consensus_queue.cc:1059] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.049s
I20260709 13:16:51.034391  9130 consensus_queue.cc:1048] T b8ded21dd9a54bc8b9cd260808162d0d P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:51.011768  9229 raft_consensus.cc:493] T 51992816e23f4cf99d31cec60fa429b9 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.036019  9229 raft_consensus.cc:515] T 51992816e23f4cf99d31cec60fa429b9 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
W20260709 13:16:50.981959  8883 leader_election.cc:343] T 55bac44fd5a3462593ab47f6b6f44c6e P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.037313  8883 leader_election.cc:304] T 55bac44fd5a3462593ab47f6b6f44c6e P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12; no voters: 7d3072f2af0b481d94ed70632b90e8c6, e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:51.038583  9225 raft_consensus.cc:493] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.039224  9225 raft_consensus.cc:515] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:51.041731  9225 leader_election.cc:290] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:51.042755  9229 leader_election.cc:290] T 51992816e23f4cf99d31cec60fa429b9 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:51.043906  9038 tablet_bootstrap.cc:492] T cc6e2639db63487cae6a125c8d5fe1d8 P 895d3c58761f427c9c5b3cb41246c243: No bootstrap required, opened a new log
I20260709 13:16:51.044487  9038 ts_tablet_manager.cc:1403] T cc6e2639db63487cae6a125c8d5fe1d8 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.188s	user 0.011s	sys 0.004s
I20260709 13:16:51.045992  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51992816e23f4cf99d31cec60fa429b9" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:51.048686  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fa028ad690c4f3c94ec7c6443a3f1d3" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
W20260709 13:16:51.048866  8808 leader_election.cc:343] T 51992816e23f4cf99d31cec60fa429b9 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.049465  8765 raft_consensus.cc:2468] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 0.
I20260709 13:16:51.031911  9042 tablet_bootstrap.cc:492] T 9fdcbb0a74a64826ab0665c349b16200 P 43c6faa9496d44dda6b6eaed09cdfd12: No bootstrap required, opened a new log
I20260709 13:16:51.052567  9042 ts_tablet_manager.cc:1403] T 9fdcbb0a74a64826ab0665c349b16200 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent bootstrapping tablet: real 0.203s	user 0.012s	sys 0.009s
I20260709 13:16:51.054780  9038 raft_consensus.cc:359] T cc6e2639db63487cae6a125c8d5fe1d8 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:51.061043  9052 raft_consensus.cc:3055] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:51.061481  9052 raft_consensus.cc:740] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Running, Role: LEADER
I20260709 13:16:51.062381  9052 consensus_queue.cc:260] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:51.062975  9042 raft_consensus.cc:359] T 9fdcbb0a74a64826ab0665c349b16200 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:51.063917  9042 raft_consensus.cc:385] T 9fdcbb0a74a64826ab0665c349b16200 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.064208  9042 raft_consensus.cc:740] T 9fdcbb0a74a64826ab0665c349b16200 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.064330  8884 leader_election.cc:304] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243; no voters: 
I20260709 13:16:51.064909  9042 consensus_queue.cc:260] T 9fdcbb0a74a64826ab0665c349b16200 P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:51.068293  9225 raft_consensus.cc:2804] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:51.068850  9225 raft_consensus.cc:493] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.069339  9225 raft_consensus.cc:3060] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:51.071466  8884 leader_election.cc:343] T cc6e2639db63487cae6a125c8d5fe1d8 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.072512  9052 raft_consensus.cc:3060] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:51.075033  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:35315, user_credentials={real_user=slave}} blocked reactor thread for 93113.3us
I20260709 13:16:51.076090  9370 leader_election.cc:290] T cc6e2639db63487cae6a125c8d5fe1d8 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:51.077184  9370 raft_consensus.cc:2749] T 55bac44fd5a3462593ab47f6b6f44c6e P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:51.080058  9038 raft_consensus.cc:385] T cc6e2639db63487cae6a125c8d5fe1d8 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.057068  9229 raft_consensus.cc:493] T f3abbeb71eba411bb6dfec800d3bd9c0 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.081246  9229 raft_consensus.cc:515] T f3abbeb71eba411bb6dfec800d3bd9c0 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:51.081698  8664 catalog_manager.cc:5697] T 5a26acd2175646e3a53b493571852af4 P e8bb7e1240f44fda8b83e4c124852032 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196). New cstate: current_term: 1 leader_uuid: "e8bb7e1240f44fda8b83e4c124852032" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:51.084444  9229 leader_election.cc:290] T f3abbeb71eba411bb6dfec800d3bd9c0 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:51.084573  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3abbeb71eba411bb6dfec800d3bd9c0" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:51.085028  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3abbeb71eba411bb6dfec800d3bd9c0" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:51.058285  9369 raft_consensus.cc:493] T 69e5f8bfdb5a46808e713e051a38866d P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.085821  8765 raft_consensus.cc:2468] T f3abbeb71eba411bb6dfec800d3bd9c0 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 0.
I20260709 13:16:51.087684  8810 leader_election.cc:304] T f3abbeb71eba411bb6dfec800d3bd9c0 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6, 895d3c58761f427c9c5b3cb41246c243; no voters: 
I20260709 13:16:51.088713  9229 raft_consensus.cc:2804] T f3abbeb71eba411bb6dfec800d3bd9c0 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:51.089246  9229 raft_consensus.cc:493] T f3abbeb71eba411bb6dfec800d3bd9c0 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.086743  9369 raft_consensus.cc:515] T 69e5f8bfdb5a46808e713e051a38866d P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
W20260709 13:16:51.089884  8808 leader_election.cc:343] T f3abbeb71eba411bb6dfec800d3bd9c0 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.080318  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc6e2639db63487cae6a125c8d5fe1d8" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:51.091305  9369 leader_election.cc:290] T 69e5f8bfdb5a46808e713e051a38866d P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:51.092017  9229 raft_consensus.cc:3060] T f3abbeb71eba411bb6dfec800d3bd9c0 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.092073  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e5f8bfdb5a46808e713e051a38866d" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
W20260709 13:16:51.094084  8733 leader_election.cc:343] T 69e5f8bfdb5a46808e713e051a38866d P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.080441  9038 raft_consensus.cc:740] T cc6e2639db63487cae6a125c8d5fe1d8 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.096853  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fa028ad690c4f3c94ec7c6443a3f1d3" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:51.055634  9040 raft_consensus.cc:359] T b8ded21dd9a54bc8b9cd260808162d0d P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:51.100064  9040 raft_consensus.cc:385] T b8ded21dd9a54bc8b9cd260808162d0d P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.100447  9040 raft_consensus.cc:740] T b8ded21dd9a54bc8b9cd260808162d0d P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.092898  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e5f8bfdb5a46808e713e051a38866d" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:51.101301  9040 consensus_queue.cc:260] T b8ded21dd9a54bc8b9cd260808162d0d P e8bb7e1240f44fda8b83e4c124852032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:51.057560  9039 tablet_bootstrap.cc:654] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 7d3072f2af0b481d94ed70632b90e8c6: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:51.101770  8734 leader_election.cc:343] T 69e5f8bfdb5a46808e713e051a38866d P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.127801  8734 leader_election.cc:304] T 69e5f8bfdb5a46808e713e051a38866d P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243; no voters: 7d3072f2af0b481d94ed70632b90e8c6, e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:51.129155  9369 raft_consensus.cc:2749] T 69e5f8bfdb5a46808e713e051a38866d P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:51.131008  9040 ts_tablet_manager.cc:1434] T b8ded21dd9a54bc8b9cd260808162d0d P e8bb7e1240f44fda8b83e4c124852032: Time spent starting tablet: real 0.099s	user 0.001s	sys 0.006s
W20260709 13:16:51.104050  8883 leader_election.cc:343] T cc6e2639db63487cae6a125c8d5fe1d8 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.116806  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51992816e23f4cf99d31cec60fa429b9" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:51.143086  8883 leader_election.cc:304] T cc6e2639db63487cae6a125c8d5fe1d8 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12; no voters: 7d3072f2af0b481d94ed70632b90e8c6, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:51.143414  8917 raft_consensus.cc:2468] T 51992816e23f4cf99d31cec60fa429b9 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 0.
I20260709 13:16:51.116506  9229 raft_consensus.cc:515] T f3abbeb71eba411bb6dfec800d3bd9c0 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
W20260709 13:16:51.144760  8883 leader_election.cc:343] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.146406  9229 leader_election.cc:290] T f3abbeb71eba411bb6dfec800d3bd9c0 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 election: Requested vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:51.118441  9042 ts_tablet_manager.cc:1434] T 9fdcbb0a74a64826ab0665c349b16200 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent starting tablet: real 0.065s	user 0.017s	sys 0.017s
I20260709 13:16:51.146740  9374 raft_consensus.cc:2749] T cc6e2639db63487cae6a125c8d5fe1d8 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:51.133181  9369 consensus_queue.cc:1048] T 68650af2b1894208a4cc0a1c6ddf880b P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:51.147866  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3abbeb71eba411bb6dfec800d3bd9c0" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243"
I20260709 13:16:51.148593  8765 raft_consensus.cc:3060] T f3abbeb71eba411bb6dfec800d3bd9c0 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.141029  9245 raft_consensus.cc:493] T b8ded21dd9a54bc8b9cd260808162d0d P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.149353  8811 leader_election.cc:304] T 51992816e23f4cf99d31cec60fa429b9 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6; no voters: e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:51.149444  9245 raft_consensus.cc:515] T b8ded21dd9a54bc8b9cd260808162d0d P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:51.150872  9229 raft_consensus.cc:2804] T 51992816e23f4cf99d31cec60fa429b9 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:51.151348  9229 raft_consensus.cc:493] T 51992816e23f4cf99d31cec60fa429b9 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.151870  9245 leader_election.cc:290] T b8ded21dd9a54bc8b9cd260808162d0d P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:51.097312  9038 consensus_queue.cc:260] T cc6e2639db63487cae6a125c8d5fe1d8 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:51.153003  8845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8ded21dd9a54bc8b9cd260808162d0d" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:51.153003  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3abbeb71eba411bb6dfec800d3bd9c0" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
I20260709 13:16:51.154026  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8ded21dd9a54bc8b9cd260808162d0d" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:51.152390  9229 raft_consensus.cc:3060] T 51992816e23f4cf99d31cec60fa429b9 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.154886  9038 ts_tablet_manager.cc:1434] T cc6e2639db63487cae6a125c8d5fe1d8 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.110s	user 0.005s	sys 0.002s
I20260709 13:16:51.157523  9039 tablet_bootstrap.cc:492] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 7d3072f2af0b481d94ed70632b90e8c6: No bootstrap required, opened a new log
I20260709 13:16:51.158046  9039 ts_tablet_manager.cc:1403] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent bootstrapping tablet: real 0.203s	user 0.010s	sys 0.006s
I20260709 13:16:51.160019  9038 tablet_bootstrap.cc:492] T 9fdcbb0a74a64826ab0665c349b16200 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:51.162546  8957 leader_election.cc:304] T b8ded21dd9a54bc8b9cd260808162d0d P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bb7e1240f44fda8b83e4c124852032; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6
W20260709 13:16:51.166391  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:46105, user_credentials={real_user=slave}} blocked reactor thread for 110381us
I20260709 13:16:51.184250  8993 raft_consensus.cc:3060] T 68650af2b1894208a4cc0a1c6ddf880b P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.186620  8765 raft_consensus.cc:2468] T f3abbeb71eba411bb6dfec800d3bd9c0 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 1.
W20260709 13:16:51.167764  8808 leader_election.cc:343] T f3abbeb71eba411bb6dfec800d3bd9c0 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.191339  9405 consensus_queue.cc:1048] T dde08046aca642488918d1f2b978c126 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:51.193363  8810 leader_election.cc:304] T f3abbeb71eba411bb6dfec800d3bd9c0 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6, 895d3c58761f427c9c5b3cb41246c243; no voters: e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:51.195008  9227 raft_consensus.cc:2804] T f3abbeb71eba411bb6dfec800d3bd9c0 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:51.195509  9227 raft_consensus.cc:697] T f3abbeb71eba411bb6dfec800d3bd9c0 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 LEADER]: Becoming Leader. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Running, Role: LEADER
I20260709 13:16:51.181931  9229 raft_consensus.cc:515] T 51992816e23f4cf99d31cec60fa429b9 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:51.196449  9227 consensus_queue.cc:237] T f3abbeb71eba411bb6dfec800d3bd9c0 P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:51.198436  9245 raft_consensus.cc:2749] T b8ded21dd9a54bc8b9cd260808162d0d P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:51.200424  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51992816e23f4cf99d31cec60fa429b9" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:16:51.201035  8918 raft_consensus.cc:3060] T 51992816e23f4cf99d31cec60fa429b9 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.147907  9042 tablet_bootstrap.cc:492] T 278f12b812a8473f8e3fddc73feabb62 P 43c6faa9496d44dda6b6eaed09cdfd12: Bootstrap starting.
I20260709 13:16:51.210045  8918 raft_consensus.cc:2468] T 51992816e23f4cf99d31cec60fa429b9 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 1.
I20260709 13:16:51.163465  9040 tablet_bootstrap.cc:492] T f3abbeb71eba411bb6dfec800d3bd9c0 P e8bb7e1240f44fda8b83e4c124852032: Bootstrap starting.
I20260709 13:16:51.196171  9039 raft_consensus.cc:359] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:51.137639  9225 raft_consensus.cc:515] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:51.213670  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51992816e23f4cf99d31cec60fa429b9" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
I20260709 13:16:51.217725  9225 leader_election.cc:290] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Requested vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:51.214321  9229 leader_election.cc:290] T 51992816e23f4cf99d31cec60fa429b9 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 election: Requested vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:51.218529  9358 raft_consensus.cc:493] T 68650af2b1894208a4cc0a1c6ddf880b P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.219084  9358 raft_consensus.cc:515] T 68650af2b1894208a4cc0a1c6ddf880b P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:51.219437  9039 raft_consensus.cc:385] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.219813  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fa028ad690c4f3c94ec7c6443a3f1d3" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
I20260709 13:16:51.220311  9039 raft_consensus.cc:740] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.221163  9039 consensus_queue.cc:260] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:51.221943  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fa028ad690c4f3c94ec7c6443a3f1d3" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243"
I20260709 13:16:51.222563  8841 raft_consensus.cc:3060] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.225291  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68650af2b1894208a4cc0a1c6ddf880b" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:51.228255  9358 leader_election.cc:290] T 68650af2b1894208a4cc0a1c6ddf880b P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:51.230050  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68650af2b1894208a4cc0a1c6ddf880b" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:51.222615  8766 raft_consensus.cc:3060] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.231575  8958 leader_election.cc:304] T 68650af2b1894208a4cc0a1c6ddf880b P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bb7e1240f44fda8b83e4c124852032; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:51.233191  9358 raft_consensus.cc:2749] T 68650af2b1894208a4cc0a1c6ddf880b P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:51.234792  9039 ts_tablet_manager.cc:1434] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent starting tablet: real 0.076s	user 0.005s	sys 0.004s
I20260709 13:16:51.237812  9040 tablet_bootstrap.cc:654] T f3abbeb71eba411bb6dfec800d3bd9c0 P e8bb7e1240f44fda8b83e4c124852032: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.170557  9038 tablet_bootstrap.cc:654] T 9fdcbb0a74a64826ab0665c349b16200 P 895d3c58761f427c9c5b3cb41246c243: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:51.241207  8808 leader_election.cc:343] T 51992816e23f4cf99d31cec60fa429b9 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.252682  8841 raft_consensus.cc:2468] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 1.
I20260709 13:16:51.238999  9039 tablet_bootstrap.cc:492] T 5a26acd2175646e3a53b493571852af4 P 7d3072f2af0b481d94ed70632b90e8c6: Bootstrap starting.
I20260709 13:16:51.256851  8811 leader_election.cc:304] T 51992816e23f4cf99d31cec60fa429b9 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6; no voters: e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:51.258327  9130 raft_consensus.cc:2804] T 51992816e23f4cf99d31cec60fa429b9 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:51.258853  9130 raft_consensus.cc:697] T 51992816e23f4cf99d31cec60fa429b9 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 LEADER]: Becoming Leader. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Running, Role: LEADER
I20260709 13:16:51.259739  9130 consensus_queue.cc:237] T 51992816e23f4cf99d31cec60fa429b9 P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:51.253436  9251 consensus_queue.cc:1048] T 68650af2b1894208a4cc0a1c6ddf880b P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:16:51.266947  8766 raft_consensus.cc:2468] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 1.
I20260709 13:16:51.271708  9369 raft_consensus.cc:493] T cc6e2639db63487cae6a125c8d5fe1d8 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.275804  9038 tablet_bootstrap.cc:492] T 9fdcbb0a74a64826ab0665c349b16200 P 895d3c58761f427c9c5b3cb41246c243: No bootstrap required, opened a new log
I20260709 13:16:51.278682  8883 leader_election.cc:304] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6; no voters: 
I20260709 13:16:51.285501  8993 raft_consensus.cc:3060] T b8ded21dd9a54bc8b9cd260808162d0d P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.295349  9038 ts_tablet_manager.cc:1403] T 9fdcbb0a74a64826ab0665c349b16200 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.136s	user 0.006s	sys 0.010s
I20260709 13:16:51.310508  9373 consensus_queue.cc:1048] T dde08046aca642488918d1f2b978c126 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:51.297142  9369 raft_consensus.cc:515] T cc6e2639db63487cae6a125c8d5fe1d8 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:51.315816  9038 raft_consensus.cc:359] T 9fdcbb0a74a64826ab0665c349b16200 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:51.317363  9038 raft_consensus.cc:385] T 9fdcbb0a74a64826ab0665c349b16200 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.318102  9038 raft_consensus.cc:740] T 9fdcbb0a74a64826ab0665c349b16200 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.318759  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc6e2639db63487cae6a125c8d5fe1d8" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:51.319695  9039 tablet_bootstrap.cc:654] T 5a26acd2175646e3a53b493571852af4 P 7d3072f2af0b481d94ed70632b90e8c6: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:51.320242  8734 leader_election.cc:343] T cc6e2639db63487cae6a125c8d5fe1d8 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.320717  9245 consensus_queue.cc:1048] T 5a26acd2175646e3a53b493571852af4 P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:16:51.322476  9038 consensus_queue.cc:260] T 9fdcbb0a74a64826ab0665c349b16200 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:51.318776  9403 raft_consensus.cc:2804] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:51.323952  9052 raft_consensus.cc:493] T 9fdcbb0a74a64826ab0665c349b16200 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.324366  9052 raft_consensus.cc:515] T 9fdcbb0a74a64826ab0665c349b16200 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:51.345198  9038 ts_tablet_manager.cc:1434] T 9fdcbb0a74a64826ab0665c349b16200 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
W20260709 13:16:51.339010  8810 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:39173, user_credentials={real_user=slave}} blocked reactor thread for 137395us
I20260709 13:16:51.318122  9369 leader_election.cc:290] T cc6e2639db63487cae6a125c8d5fe1d8 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:51.325837  9403 raft_consensus.cc:697] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Becoming Leader. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Running, Role: LEADER
I20260709 13:16:51.353271  9052 leader_election.cc:290] T 9fdcbb0a74a64826ab0665c349b16200 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:51.357872  9038 tablet_bootstrap.cc:492] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:51.363533  9040 tablet_bootstrap.cc:492] T f3abbeb71eba411bb6dfec800d3bd9c0 P e8bb7e1240f44fda8b83e4c124852032: No bootstrap required, opened a new log
I20260709 13:16:51.365025  9040 ts_tablet_manager.cc:1403] T f3abbeb71eba411bb6dfec800d3bd9c0 P e8bb7e1240f44fda8b83e4c124852032: Time spent bootstrapping tablet: real 0.203s	user 0.014s	sys 0.011s
I20260709 13:16:51.370359  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc6e2639db63487cae6a125c8d5fe1d8" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:51.370750  8990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fdcbb0a74a64826ab0665c349b16200" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:51.371131  8917 raft_consensus.cc:2468] T cc6e2639db63487cae6a125c8d5fe1d8 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 0.
I20260709 13:16:51.370410  9403 consensus_queue.cc:237] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
W20260709 13:16:51.374266  8882 leader_election.cc:343] T 9fdcbb0a74a64826ab0665c349b16200 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.374760  8666 catalog_manager.cc:5697] T f3abbeb71eba411bb6dfec800d3bd9c0 P 7d3072f2af0b481d94ed70632b90e8c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194). New cstate: current_term: 1 leader_uuid: "7d3072f2af0b481d94ed70632b90e8c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:51.377079  8770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fdcbb0a74a64826ab0665c349b16200" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:51.377708  9042 tablet_bootstrap.cc:654] T 278f12b812a8473f8e3fddc73feabb62 P 43c6faa9496d44dda6b6eaed09cdfd12: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.396214  9040 raft_consensus.cc:359] T f3abbeb71eba411bb6dfec800d3bd9c0 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:51.398212  9040 raft_consensus.cc:385] T f3abbeb71eba411bb6dfec800d3bd9c0 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.398504  9040 raft_consensus.cc:740] T f3abbeb71eba411bb6dfec800d3bd9c0 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.399245  9040 consensus_queue.cc:260] T f3abbeb71eba411bb6dfec800d3bd9c0 P e8bb7e1240f44fda8b83e4c124852032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:51.380064  8770 raft_consensus.cc:2468] T 9fdcbb0a74a64826ab0665c349b16200 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 0.
I20260709 13:16:51.402441  9038 tablet_bootstrap.cc:654] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 895d3c58761f427c9c5b3cb41246c243: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.405599  8736 leader_election.cc:304] T cc6e2639db63487cae6a125c8d5fe1d8 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243; no voters: 7d3072f2af0b481d94ed70632b90e8c6
I20260709 13:16:51.411984  9413 raft_consensus.cc:2804] T cc6e2639db63487cae6a125c8d5fe1d8 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:51.412395  9413 raft_consensus.cc:493] T cc6e2639db63487cae6a125c8d5fe1d8 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.412743  9413 raft_consensus.cc:3060] T cc6e2639db63487cae6a125c8d5fe1d8 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.418560  9040 ts_tablet_manager.cc:1434] T f3abbeb71eba411bb6dfec800d3bd9c0 P e8bb7e1240f44fda8b83e4c124852032: Time spent starting tablet: real 0.053s	user 0.009s	sys 0.000s
I20260709 13:16:51.419683  9040 tablet_bootstrap.cc:492] T 51992816e23f4cf99d31cec60fa429b9 P e8bb7e1240f44fda8b83e4c124852032: Bootstrap starting.
I20260709 13:16:51.448756  8884 leader_election.cc:304] T 9fdcbb0a74a64826ab0665c349b16200 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243; no voters: e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:51.449796  9039 tablet_bootstrap.cc:492] T 5a26acd2175646e3a53b493571852af4 P 7d3072f2af0b481d94ed70632b90e8c6: No bootstrap required, opened a new log
I20260709 13:16:51.450428  9039 ts_tablet_manager.cc:1403] T 5a26acd2175646e3a53b493571852af4 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent bootstrapping tablet: real 0.212s	user 0.015s	sys 0.005s
I20260709 13:16:51.450834  9405 raft_consensus.cc:2804] T 9fdcbb0a74a64826ab0665c349b16200 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:51.451318  9405 raft_consensus.cc:493] T 9fdcbb0a74a64826ab0665c349b16200 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.460248  9039 raft_consensus.cc:359] T 5a26acd2175646e3a53b493571852af4 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:51.461344  9039 raft_consensus.cc:385] T 5a26acd2175646e3a53b493571852af4 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.458995  9405 raft_consensus.cc:3060] T 9fdcbb0a74a64826ab0665c349b16200 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.461707  9039 raft_consensus.cc:740] T 5a26acd2175646e3a53b493571852af4 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.470783  9039 consensus_queue.cc:260] T 5a26acd2175646e3a53b493571852af4 P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:51.491394  8664 catalog_manager.cc:5697] T 51992816e23f4cf99d31cec60fa429b9 P 7d3072f2af0b481d94ed70632b90e8c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194). New cstate: current_term: 1 leader_uuid: "7d3072f2af0b481d94ed70632b90e8c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:51.496250  9039 ts_tablet_manager.cc:1434] T 5a26acd2175646e3a53b493571852af4 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent starting tablet: real 0.046s	user 0.010s	sys 0.000s
I20260709 13:16:51.504782  9039 tablet_bootstrap.cc:492] T 55bac44fd5a3462593ab47f6b6f44c6e P 7d3072f2af0b481d94ed70632b90e8c6: Bootstrap starting.
I20260709 13:16:51.515992  9413 raft_consensus.cc:515] T cc6e2639db63487cae6a125c8d5fe1d8 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:51.521557  8841 raft_consensus.cc:3060] T 5a26acd2175646e3a53b493571852af4 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.531141  8845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc6e2639db63487cae6a125c8d5fe1d8" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
I20260709 13:16:51.520231  9413 leader_election.cc:290] T cc6e2639db63487cae6a125c8d5fe1d8 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 election: Requested vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:51.544384  9405 raft_consensus.cc:515] T 9fdcbb0a74a64826ab0665c349b16200 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:51.546803  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc6e2639db63487cae6a125c8d5fe1d8" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
W20260709 13:16:51.551998  8734 leader_election.cc:343] T cc6e2639db63487cae6a125c8d5fe1d8 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.552695  9040 tablet_bootstrap.cc:654] T 51992816e23f4cf99d31cec60fa429b9 P e8bb7e1240f44fda8b83e4c124852032: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.555334  8667 catalog_manager.cc:5697] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 43c6faa9496d44dda6b6eaed09cdfd12 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195). New cstate: current_term: 1 leader_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:51.555505  8917 raft_consensus.cc:3060] T cc6e2639db63487cae6a125c8d5fe1d8 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.565086  9245 consensus_queue.cc:1048] T 5a26acd2175646e3a53b493571852af4 P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:16:51.560005  8959 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37671, user_credentials={real_user=slave}} blocked reactor thread for 91971.9us
I20260709 13:16:51.570163  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fdcbb0a74a64826ab0665c349b16200" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243"
I20260709 13:16:51.570411  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fdcbb0a74a64826ab0665c349b16200" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
I20260709 13:16:51.570855  8768 raft_consensus.cc:3060] T 9fdcbb0a74a64826ab0665c349b16200 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:51.571709  8882 leader_election.cc:343] T 9fdcbb0a74a64826ab0665c349b16200 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.583670  9405 leader_election.cc:290] T 9fdcbb0a74a64826ab0665c349b16200 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Requested vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:51.596913  9042 tablet_bootstrap.cc:492] T 278f12b812a8473f8e3fddc73feabb62 P 43c6faa9496d44dda6b6eaed09cdfd12: No bootstrap required, opened a new log
I20260709 13:16:51.597584  9042 ts_tablet_manager.cc:1403] T 278f12b812a8473f8e3fddc73feabb62 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent bootstrapping tablet: real 0.450s	user 0.016s	sys 0.016s
I20260709 13:16:51.604267  9038 tablet_bootstrap.cc:492] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 895d3c58761f427c9c5b3cb41246c243: No bootstrap required, opened a new log
I20260709 13:16:51.605527  9038 ts_tablet_manager.cc:1403] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.248s	user 0.021s	sys 0.023s
I20260709 13:16:51.648221  9038 raft_consensus.cc:359] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:51.649816  9038 raft_consensus.cc:385] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.651474  9038 raft_consensus.cc:740] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.652685  9038 consensus_queue.cc:260] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:51.649323  9428 raft_consensus.cc:493] T f3abbeb71eba411bb6dfec800d3bd9c0 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.650887  8917 raft_consensus.cc:2468] T cc6e2639db63487cae6a125c8d5fe1d8 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 1.
I20260709 13:16:51.656448  9042 raft_consensus.cc:359] T 278f12b812a8473f8e3fddc73feabb62 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:51.657769  9042 raft_consensus.cc:385] T 278f12b812a8473f8e3fddc73feabb62 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.658064  9428 raft_consensus.cc:515] T f3abbeb71eba411bb6dfec800d3bd9c0 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:51.674423  9428 leader_election.cc:290] T f3abbeb71eba411bb6dfec800d3bd9c0 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:51.675887  9040 tablet_bootstrap.cc:492] T 51992816e23f4cf99d31cec60fa429b9 P e8bb7e1240f44fda8b83e4c124852032: No bootstrap required, opened a new log
I20260709 13:16:51.676482  9040 ts_tablet_manager.cc:1403] T 51992816e23f4cf99d31cec60fa429b9 P e8bb7e1240f44fda8b83e4c124852032: Time spent bootstrapping tablet: real 0.257s	user 0.018s	sys 0.026s
I20260709 13:16:51.658054  9042 raft_consensus.cc:740] T 278f12b812a8473f8e3fddc73feabb62 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.678020  9042 consensus_queue.cc:260] T 278f12b812a8473f8e3fddc73feabb62 P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:51.678455  8993 raft_consensus.cc:3060] T f3abbeb71eba411bb6dfec800d3bd9c0 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.680389  9042 ts_tablet_manager.cc:1434] T 278f12b812a8473f8e3fddc73feabb62 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent starting tablet: real 0.082s	user 0.008s	sys 0.000s
I20260709 13:16:51.681375  9042 tablet_bootstrap.cc:492] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12: Bootstrap starting.
I20260709 13:16:51.681586  9038 ts_tablet_manager.cc:1434] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.075s	user 0.014s	sys 0.005s
I20260709 13:16:51.682790  9038 tablet_bootstrap.cc:492] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:51.683599  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3abbeb71eba411bb6dfec800d3bd9c0" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:51.684044  9039 tablet_bootstrap.cc:654] T 55bac44fd5a3462593ab47f6b6f44c6e P 7d3072f2af0b481d94ed70632b90e8c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.695837  9038 tablet_bootstrap.cc:654] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.698010  9042 tablet_bootstrap.cc:654] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.699860  9039 tablet_bootstrap.cc:492] T 55bac44fd5a3462593ab47f6b6f44c6e P 7d3072f2af0b481d94ed70632b90e8c6: No bootstrap required, opened a new log
I20260709 13:16:51.699448  9040 raft_consensus.cc:359] T 51992816e23f4cf99d31cec60fa429b9 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:51.700404  9040 raft_consensus.cc:385] T 51992816e23f4cf99d31cec60fa429b9 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.700598  9039 ts_tablet_manager.cc:1403] T 55bac44fd5a3462593ab47f6b6f44c6e P 7d3072f2af0b481d94ed70632b90e8c6: Time spent bootstrapping tablet: real 0.202s	user 0.014s	sys 0.004s
I20260709 13:16:51.700752  9040 raft_consensus.cc:740] T 51992816e23f4cf99d31cec60fa429b9 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.701898  9040 consensus_queue.cc:260] T 51992816e23f4cf99d31cec60fa429b9 P e8bb7e1240f44fda8b83e4c124852032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:51.704772  9040 ts_tablet_manager.cc:1434] T 51992816e23f4cf99d31cec60fa429b9 P e8bb7e1240f44fda8b83e4c124852032: Time spent starting tablet: real 0.028s	user 0.012s	sys 0.000s
I20260709 13:16:51.705848  9040 tablet_bootstrap.cc:492] T 55bac44fd5a3462593ab47f6b6f44c6e P e8bb7e1240f44fda8b83e4c124852032: Bootstrap starting.
I20260709 13:16:51.706478  9039 raft_consensus.cc:359] T 55bac44fd5a3462593ab47f6b6f44c6e P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:51.707306  9039 raft_consensus.cc:385] T 55bac44fd5a3462593ab47f6b6f44c6e P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.707979  9039 raft_consensus.cc:740] T 55bac44fd5a3462593ab47f6b6f44c6e P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.708823  9039 consensus_queue.cc:260] T 55bac44fd5a3462593ab47f6b6f44c6e P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:51.711830  9039 ts_tablet_manager.cc:1434] T 55bac44fd5a3462593ab47f6b6f44c6e P 7d3072f2af0b481d94ed70632b90e8c6: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:16:51.712962  9039 tablet_bootstrap.cc:492] T cc6e2639db63487cae6a125c8d5fe1d8 P 7d3072f2af0b481d94ed70632b90e8c6: Bootstrap starting.
I20260709 13:16:51.715952  9038 tablet_bootstrap.cc:492] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243: No bootstrap required, opened a new log
I20260709 13:16:51.773522  9038 ts_tablet_manager.cc:1403] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.091s	user 0.010s	sys 0.004s
I20260709 13:16:51.774493  8736 leader_election.cc:304] T cc6e2639db63487cae6a125c8d5fe1d8 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243; no voters: 7d3072f2af0b481d94ed70632b90e8c6
I20260709 13:16:51.795033  9245 raft_consensus.cc:493] T 51992816e23f4cf99d31cec60fa429b9 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.796337  9245 raft_consensus.cc:515] T 51992816e23f4cf99d31cec60fa429b9 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:51.789633  9042 tablet_bootstrap.cc:492] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12: No bootstrap required, opened a new log
I20260709 13:16:51.814388  9408 consensus_queue.cc:1048] T f3abbeb71eba411bb6dfec800d3bd9c0 P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:51.816359  9412 raft_consensus.cc:493] T 55bac44fd5a3462593ab47f6b6f44c6e P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.817534  9412 raft_consensus.cc:515] T 55bac44fd5a3462593ab47f6b6f44c6e P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:51.818337  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3abbeb71eba411bb6dfec800d3bd9c0" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:51.819772  8769 raft_consensus.cc:2393] T f3abbeb71eba411bb6dfec800d3bd9c0 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bb7e1240f44fda8b83e4c124852032 in current term 1: Already voted for candidate 7d3072f2af0b481d94ed70632b90e8c6 in this term.
I20260709 13:16:51.828892  9040 tablet_bootstrap.cc:654] T 55bac44fd5a3462593ab47f6b6f44c6e P e8bb7e1240f44fda8b83e4c124852032: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.832362  9418 raft_consensus.cc:2804] T cc6e2639db63487cae6a125c8d5fe1d8 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:51.833269  9418 raft_consensus.cc:697] T cc6e2639db63487cae6a125c8d5fe1d8 P 895d3c58761f427c9c5b3cb41246c243 [term 1 LEADER]: Becoming Leader. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Running, Role: LEADER
I20260709 13:16:51.837742  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51992816e23f4cf99d31cec60fa429b9" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:51.839115  8917 raft_consensus.cc:2393] T 51992816e23f4cf99d31cec60fa429b9 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bb7e1240f44fda8b83e4c124852032 in current term 1: Already voted for candidate 7d3072f2af0b481d94ed70632b90e8c6 in this term.
I20260709 13:16:51.850278  8993 raft_consensus.cc:3060] T 51992816e23f4cf99d31cec60fa429b9 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.835294  9418 consensus_queue.cc:237] T cc6e2639db63487cae6a125c8d5fe1d8 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:51.868098  9408 consensus_queue.cc:1048] T 51992816e23f4cf99d31cec60fa429b9 P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:51.868566  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51992816e23f4cf99d31cec60fa429b9" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
W20260709 13:16:51.870235  8733 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:46105, user_credentials={real_user=slave}} blocked reactor thread for 48241.3us
I20260709 13:16:51.876211  9412 leader_election.cc:290] T 55bac44fd5a3462593ab47f6b6f44c6e P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:51.803004  9245 leader_election.cc:290] T 51992816e23f4cf99d31cec60fa429b9 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:51.783011  9038 raft_consensus.cc:359] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:51.897938  9038 raft_consensus.cc:385] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.904290  9038 raft_consensus.cc:740] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.911116  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bac44fd5a3462593ab47f6b6f44c6e" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:51.912400  8914 raft_consensus.cc:2468] T 55bac44fd5a3462593ab47f6b6f44c6e P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 0.
I20260709 13:16:51.917282  8811 leader_election.cc:304] T 55bac44fd5a3462593ab47f6b6f44c6e P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6; no voters: 
I20260709 13:16:51.919180  9042 ts_tablet_manager.cc:1403] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent bootstrapping tablet: real 0.238s	user 0.017s	sys 0.013s
I20260709 13:16:51.920147  9438 raft_consensus.cc:2804] T 55bac44fd5a3462593ab47f6b6f44c6e P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:51.920818  9438 raft_consensus.cc:493] T 55bac44fd5a3462593ab47f6b6f44c6e P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.921283  9438 raft_consensus.cc:3060] T 55bac44fd5a3462593ab47f6b6f44c6e P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.931558  9225 consensus_queue.cc:1048] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:16:51.937737  8958 leader_election.cc:304] T f3abbeb71eba411bb6dfec800d3bd9c0 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bb7e1240f44fda8b83e4c124852032; no voters: 7d3072f2af0b481d94ed70632b90e8c6, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:51.937492  9042 raft_consensus.cc:359] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:51.938578  9042 raft_consensus.cc:385] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.938943  9358 raft_consensus.cc:2749] T f3abbeb71eba411bb6dfec800d3bd9c0 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:51.938946  9042 raft_consensus.cc:740] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.941184  9042 consensus_queue.cc:260] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:51.957500  9369 raft_consensus.cc:493] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.963847  9369 raft_consensus.cc:515] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:51.968287  9038 consensus_queue.cc:260] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:51.981304  9042 ts_tablet_manager.cc:1434] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent starting tablet: real 0.062s	user 0.004s	sys 0.005s
I20260709 13:16:51.967154  9369 leader_election.cc:290] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:51.989503  8768 raft_consensus.cc:2468] T 9fdcbb0a74a64826ab0665c349b16200 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 1.
I20260709 13:16:51.998347  9038 ts_tablet_manager.cc:1434] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.223s	user 0.004s	sys 0.009s
I20260709 13:16:52.002307  8990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bac44fd5a3462593ab47f6b6f44c6e" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:51.967757  8957 leader_election.cc:304] T 51992816e23f4cf99d31cec60fa429b9 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bb7e1240f44fda8b83e4c124852032; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6
I20260709 13:16:52.009078  9042 tablet_bootstrap.cc:492] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12: Bootstrap starting.
W20260709 13:16:52.013971  8733 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:46105, user_credentials={real_user=slave}} blocked reactor thread for 82977.1us
I20260709 13:16:52.035267  9440 raft_consensus.cc:2749] T 51992816e23f4cf99d31cec60fa429b9 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:52.037887  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44c5aa220814dfd9fc9bb07cd5b1cf7" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
W20260709 13:16:52.050036  8808 leader_election.cc:343] T 55bac44fd5a3462593ab47f6b6f44c6e P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:52.056955  9052 raft_consensus.cc:493] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.058967  9052 raft_consensus.cc:515] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:52.066547  9052 leader_election.cc:290] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
W20260709 13:16:52.067119  8734 leader_election.cc:343] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:52.076546  9038 tablet_bootstrap.cc:492] T 097c705b65de4abe884afdb1fcaaa054 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:52.081944  9039 tablet_bootstrap.cc:654] T cc6e2639db63487cae6a125c8d5fe1d8 P 7d3072f2af0b481d94ed70632b90e8c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:52.094610  9436 raft_consensus.cc:493] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.095443  9436 raft_consensus.cc:515] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:52.094830  9373 raft_consensus.cc:493] T 278f12b812a8473f8e3fddc73feabb62 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.097146  9373 raft_consensus.cc:515] T 278f12b812a8473f8e3fddc73feabb62 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:52.097941  9436 leader_election.cc:290] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:52.104835  9040 tablet_bootstrap.cc:492] T 55bac44fd5a3462593ab47f6b6f44c6e P e8bb7e1240f44fda8b83e4c124852032: No bootstrap required, opened a new log
I20260709 13:16:52.107105  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45613c5d357b40b8af0ced6c8725c559" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:52.109115  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45613c5d357b40b8af0ced6c8725c559" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:52.111169  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278f12b812a8473f8e3fddc73feabb62" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
W20260709 13:16:52.113404  8883 leader_election.cc:343] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:52.114459  8883 leader_election.cc:343] T 278f12b812a8473f8e3fddc73feabb62 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:52.119465  8734 leader_election.cc:343] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:52.101258  9373 leader_election.cc:290] T 278f12b812a8473f8e3fddc73feabb62 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:52.122140  9227 consensus_queue.cc:1048] T f3abbeb71eba411bb6dfec800d3bd9c0 P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:52.119850  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44c5aa220814dfd9fc9bb07cd5b1cf7" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:52.124352  9227 consensus_queue.cc:1048] T 51992816e23f4cf99d31cec60fa429b9 P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:52.133669  8990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278f12b812a8473f8e3fddc73feabb62" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
W20260709 13:16:52.135435  8882 leader_election.cc:343] T 278f12b812a8473f8e3fddc73feabb62 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:52.135953  8882 leader_election.cc:304] T 278f12b812a8473f8e3fddc73feabb62 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12; no voters: 7d3072f2af0b481d94ed70632b90e8c6, e8bb7e1240f44fda8b83e4c124852032
W20260709 13:16:52.137279  9445 log.cc:927] Time spent T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 7d3072f2af0b481d94ed70632b90e8c6: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:16:52.145696  8884 leader_election.cc:304] T 9fdcbb0a74a64826ab0665c349b16200 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243; no voters: e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:52.147837  9403 consensus_queue.cc:1048] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:52.105815  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45613c5d357b40b8af0ced6c8725c559" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:52.148850  8768 raft_consensus.cc:2468] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 0.
I20260709 13:16:52.149431  9403 raft_consensus.cc:2804] T 9fdcbb0a74a64826ab0665c349b16200 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:52.149997  9403 raft_consensus.cc:697] T 9fdcbb0a74a64826ab0665c349b16200 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Becoming Leader. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Running, Role: LEADER
I20260709 13:16:52.151067  9040 ts_tablet_manager.cc:1403] T 55bac44fd5a3462593ab47f6b6f44c6e P e8bb7e1240f44fda8b83e4c124852032: Time spent bootstrapping tablet: real 0.445s	user 0.020s	sys 0.004s
I20260709 13:16:52.151248  9403 consensus_queue.cc:237] T 9fdcbb0a74a64826ab0665c349b16200 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:52.156001  9052 raft_consensus.cc:2749] T 278f12b812a8473f8e3fddc73feabb62 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:52.159765  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45613c5d357b40b8af0ced6c8725c559" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:52.160756  8918 raft_consensus.cc:2468] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 0.
W20260709 13:16:52.166769  8733 leader_election.cc:343] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:52.167306  8733 leader_election.cc:304] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243; no voters: 7d3072f2af0b481d94ed70632b90e8c6, e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:52.175858  9438 raft_consensus.cc:515] T 55bac44fd5a3462593ab47f6b6f44c6e P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:52.170035  9369 raft_consensus.cc:2749] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:52.180467  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bac44fd5a3462593ab47f6b6f44c6e" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:16:52.181244  8918 raft_consensus.cc:3060] T 55bac44fd5a3462593ab47f6b6f44c6e P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.180992  8667 catalog_manager.cc:5697] T cc6e2639db63487cae6a125c8d5fe1d8 P 895d3c58761f427c9c5b3cb41246c243 reported cstate change: term changed from 0 to 1, leader changed from <none> to 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "895d3c58761f427c9c5b3cb41246c243" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:52.205972  8918 raft_consensus.cc:2468] T 55bac44fd5a3462593ab47f6b6f44c6e P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 1.
I20260709 13:16:52.213840  8811 leader_election.cc:304] T 55bac44fd5a3462593ab47f6b6f44c6e P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6; no voters: 
I20260709 13:16:52.218978  9229 raft_consensus.cc:2804] T 55bac44fd5a3462593ab47f6b6f44c6e P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:16:52.209350  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:39173, user_credentials={real_user=slave}} blocked reactor thread for 61554.1us
I20260709 13:16:52.219697  9229 raft_consensus.cc:697] T 55bac44fd5a3462593ab47f6b6f44c6e P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 LEADER]: Becoming Leader. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Running, Role: LEADER
I20260709 13:16:52.222756  9229 consensus_queue.cc:237] T 55bac44fd5a3462593ab47f6b6f44c6e P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:52.198032  8736 leader_election.cc:304] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243; no voters: 7d3072f2af0b481d94ed70632b90e8c6
I20260709 13:16:52.220451  9438 leader_election.cc:290] T 55bac44fd5a3462593ab47f6b6f44c6e P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 election: Requested vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:52.240550  9347 raft_consensus.cc:2804] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:52.241067  9347 raft_consensus.cc:493] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.244233  9039 tablet_bootstrap.cc:492] T cc6e2639db63487cae6a125c8d5fe1d8 P 7d3072f2af0b481d94ed70632b90e8c6: No bootstrap required, opened a new log
I20260709 13:16:52.245122  9039 ts_tablet_manager.cc:1403] T cc6e2639db63487cae6a125c8d5fe1d8 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent bootstrapping tablet: real 0.532s	user 0.015s	sys 0.005s
I20260709 13:16:52.241456  9347 raft_consensus.cc:3060] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:52.252734  8736 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37671, user_credentials={real_user=slave}} blocked reactor thread for 75405.2us
I20260709 13:16:52.260500  8884 leader_election.cc:304] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243; no voters: 7d3072f2af0b481d94ed70632b90e8c6
I20260709 13:16:52.264751  9039 raft_consensus.cc:359] T cc6e2639db63487cae6a125c8d5fe1d8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:52.265615  9039 raft_consensus.cc:385] T cc6e2639db63487cae6a125c8d5fe1d8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:52.265872  9039 raft_consensus.cc:740] T cc6e2639db63487cae6a125c8d5fe1d8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.268929  9042 tablet_bootstrap.cc:654] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:52.260349  9040 raft_consensus.cc:359] T 55bac44fd5a3462593ab47f6b6f44c6e P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:52.272104  9040 raft_consensus.cc:385] T 55bac44fd5a3462593ab47f6b6f44c6e P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:52.272406  9040 raft_consensus.cc:740] T 55bac44fd5a3462593ab47f6b6f44c6e P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.275478  9040 consensus_queue.cc:260] T 55bac44fd5a3462593ab47f6b6f44c6e P e8bb7e1240f44fda8b83e4c124852032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:52.278776  9039 consensus_queue.cc:260] T cc6e2639db63487cae6a125c8d5fe1d8 P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:52.281620  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bac44fd5a3462593ab47f6b6f44c6e" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
I20260709 13:16:52.282275  8993 raft_consensus.cc:3060] T 55bac44fd5a3462593ab47f6b6f44c6e P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.284966  9039 ts_tablet_manager.cc:1434] T cc6e2639db63487cae6a125c8d5fe1d8 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 13:16:52.288576  9039 tablet_bootstrap.cc:492] T 45613c5d357b40b8af0ced6c8725c559 P 7d3072f2af0b481d94ed70632b90e8c6: Bootstrap starting.
I20260709 13:16:52.297153  9040 ts_tablet_manager.cc:1434] T 55bac44fd5a3462593ab47f6b6f44c6e P e8bb7e1240f44fda8b83e4c124852032: Time spent starting tablet: real 0.145s	user 0.009s	sys 0.000s
I20260709 13:16:52.301759  9042 tablet_bootstrap.cc:492] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12: No bootstrap required, opened a new log
I20260709 13:16:52.302578  9042 ts_tablet_manager.cc:1403] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent bootstrapping tablet: real 0.320s	user 0.019s	sys 0.000s
I20260709 13:16:52.330941  9449 raft_consensus.cc:2804] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:52.332085  9449 raft_consensus.cc:493] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.332558  9449 raft_consensus.cc:3060] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.348147  8843 raft_consensus.cc:3060] T cc6e2639db63487cae6a125c8d5fe1d8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.334496  8666 catalog_manager.cc:5697] T 55bac44fd5a3462593ab47f6b6f44c6e P 7d3072f2af0b481d94ed70632b90e8c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194). New cstate: current_term: 1 leader_uuid: "7d3072f2af0b481d94ed70632b90e8c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:52.340148  9039 tablet_bootstrap.cc:654] T 45613c5d357b40b8af0ced6c8725c559 P 7d3072f2af0b481d94ed70632b90e8c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:52.365222  9347 raft_consensus.cc:515] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:52.377104  9038 tablet_bootstrap.cc:654] T 097c705b65de4abe884afdb1fcaaa054 P 895d3c58761f427c9c5b3cb41246c243: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:52.382681  9040 tablet_bootstrap.cc:492] T 9fdcbb0a74a64826ab0665c349b16200 P e8bb7e1240f44fda8b83e4c124852032: Bootstrap starting.
W20260709 13:16:52.395479  8716 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:52.408722  9042 raft_consensus.cc:359] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:52.409854  9042 raft_consensus.cc:385] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:52.410211  9042 raft_consensus.cc:740] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.411154  9373 raft_consensus.cc:493] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.412119  9373 raft_consensus.cc:515] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:52.411094  9042 consensus_queue.cc:260] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:52.432348  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17f01b356e04590838cc6e6bb27bf64" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:52.433249  8841 raft_consensus.cc:2468] T c17f01b356e04590838cc6e6bb27bf64 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 2.
I20260709 13:16:52.434821  9447 raft_consensus.cc:493] T c17f01b356e04590838cc6e6bb27bf64 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 43c6faa9496d44dda6b6eaed09cdfd12)
I20260709 13:16:52.435499  9447 raft_consensus.cc:515] T c17f01b356e04590838cc6e6bb27bf64 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:52.436276  9042 ts_tablet_manager.cc:1434] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent starting tablet: real 0.133s	user 0.007s	sys 0.003s
I20260709 13:16:52.436631  8883 leader_election.cc:304] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6; no voters: 
I20260709 13:16:52.435573  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45613c5d357b40b8af0ced6c8725c559" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
I20260709 13:16:52.437621  9225 raft_consensus.cc:2804] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:52.438010  9225 raft_consensus.cc:493] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.438373  9225 raft_consensus.cc:3060] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:52.438961  9447 leader_election.cc:290] T c17f01b356e04590838cc6e6bb27bf64 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:52.440243  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17f01b356e04590838cc6e6bb27bf64" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:52.440793  9042 tablet_bootstrap.cc:492] T 2accf622ad6243e3b7b496fb979fe9d4 P 43c6faa9496d44dda6b6eaed09cdfd12: Bootstrap starting.
W20260709 13:16:52.440960  8734 leader_election.cc:343] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:52.443821  9413 consensus_queue.cc:1048] T cc6e2639db63487cae6a125c8d5fe1d8 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:52.420967  9373 leader_election.cc:290] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:52.444921  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17f01b356e04590838cc6e6bb27bf64" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:52.446748  8843 raft_consensus.cc:2393] T c17f01b356e04590838cc6e6bb27bf64 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 895d3c58761f427c9c5b3cb41246c243 in current term 2: Already voted for candidate 7d3072f2af0b481d94ed70632b90e8c6 in this term.
I20260709 13:16:52.448490  9042 tablet_bootstrap.cc:654] T 2accf622ad6243e3b7b496fb979fe9d4 P 43c6faa9496d44dda6b6eaed09cdfd12: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:52.453707  8993 raft_consensus.cc:2468] T 55bac44fd5a3462593ab47f6b6f44c6e P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 1.
I20260709 13:16:52.456274  9347 leader_election.cc:290] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 election: Requested vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:52.466238  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17f01b356e04590838cc6e6bb27bf64" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:52.467212  8768 raft_consensus.cc:2468] T c17f01b356e04590838cc6e6bb27bf64 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 1.
I20260709 13:16:52.479241  9038 tablet_bootstrap.cc:492] T 097c705b65de4abe884afdb1fcaaa054 P 895d3c58761f427c9c5b3cb41246c243: No bootstrap required, opened a new log
I20260709 13:16:52.480159  9038 ts_tablet_manager.cc:1403] T 097c705b65de4abe884afdb1fcaaa054 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.458s	user 0.014s	sys 0.010s
I20260709 13:16:52.484597  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45613c5d357b40b8af0ced6c8725c559" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:16:52.502562  9449 raft_consensus.cc:515] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:52.504237  8918 raft_consensus.cc:2393] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 895d3c58761f427c9c5b3cb41246c243 in current term 1: Already voted for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in this term.
I20260709 13:16:52.505203  9449 leader_election.cc:290] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Requested vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:52.508555  9040 tablet_bootstrap.cc:654] T 9fdcbb0a74a64826ab0665c349b16200 P e8bb7e1240f44fda8b83e4c124852032: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:52.508939  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45613c5d357b40b8af0ced6c8725c559" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
I20260709 13:16:52.510848  8770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45613c5d357b40b8af0ced6c8725c559" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243"
I20260709 13:16:52.511933  8770 raft_consensus.cc:2393] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 43c6faa9496d44dda6b6eaed09cdfd12 in current term 1: Already voted for candidate 895d3c58761f427c9c5b3cb41246c243 in this term.
I20260709 13:16:52.519348  9038 raft_consensus.cc:359] T 097c705b65de4abe884afdb1fcaaa054 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:52.520246  9038 raft_consensus.cc:385] T 097c705b65de4abe884afdb1fcaaa054 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:52.520548  9038 raft_consensus.cc:740] T 097c705b65de4abe884afdb1fcaaa054 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
W20260709 13:16:52.520751  8883 leader_election.cc:343] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:52.521225  9038 consensus_queue.cc:260] T 097c705b65de4abe884afdb1fcaaa054 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:52.523478  8884 leader_election.cc:304] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12; no voters: 7d3072f2af0b481d94ed70632b90e8c6, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:52.524731  9403 raft_consensus.cc:2749] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:16:52.526924  9038 ts_tablet_manager.cc:1434] T 097c705b65de4abe884afdb1fcaaa054 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.000s
I20260709 13:16:52.527216  8736 leader_election.cc:304] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6
I20260709 13:16:52.528163  9038 tablet_bootstrap.cc:492] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:52.529102  9347 raft_consensus.cc:2749] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:16:52.529929  9347 consensus_queue.cc:1048] T cc6e2639db63487cae6a125c8d5fe1d8 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:52.548288  9038 tablet_bootstrap.cc:654] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:52.603121  9039 tablet_bootstrap.cc:492] T 45613c5d357b40b8af0ced6c8725c559 P 7d3072f2af0b481d94ed70632b90e8c6: No bootstrap required, opened a new log
I20260709 13:16:52.603760  9039 ts_tablet_manager.cc:1403] T 45613c5d357b40b8af0ced6c8725c559 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent bootstrapping tablet: real 0.315s	user 0.023s	sys 0.016s
I20260709 13:16:52.611995  9039 raft_consensus.cc:359] T 45613c5d357b40b8af0ced6c8725c559 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:52.612406  9130 consensus_queue.cc:1048] T 55bac44fd5a3462593ab47f6b6f44c6e P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:52.612819  9039 raft_consensus.cc:385] T 45613c5d357b40b8af0ced6c8725c559 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:52.613188  9039 raft_consensus.cc:740] T 45613c5d357b40b8af0ced6c8725c559 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.614929  9039 consensus_queue.cc:260] T 45613c5d357b40b8af0ced6c8725c559 P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:52.619062  9039 ts_tablet_manager.cc:1434] T 45613c5d357b40b8af0ced6c8725c559 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.003s
I20260709 13:16:52.620378  9039 tablet_bootstrap.cc:492] T 278f12b812a8473f8e3fddc73feabb62 P 7d3072f2af0b481d94ed70632b90e8c6: Bootstrap starting.
I20260709 13:16:52.624032  9225 raft_consensus.cc:515] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:52.626816  8914 raft_consensus.cc:2368] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 895d3c58761f427c9c5b3cb41246c243 for earlier term 2. Current term is 3.
I20260709 13:16:52.629812  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17f01b356e04590838cc6e6bb27bf64" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243"
I20260709 13:16:52.632495  8766 raft_consensus.cc:3060] T c17f01b356e04590838cc6e6bb27bf64 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:16:52.634629  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17f01b356e04590838cc6e6bb27bf64" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
I20260709 13:16:52.635640  8840 raft_consensus.cc:3060] T c17f01b356e04590838cc6e6bb27bf64 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:52.638672  9039 tablet_bootstrap.cc:654] T 278f12b812a8473f8e3fddc73feabb62 P 7d3072f2af0b481d94ed70632b90e8c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:52.656579  8736 leader_election.cc:400] T c17f01b356e04590838cc6e6bb27bf64 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671) with higher term. Message: Invalid argument: T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 895d3c58761f427c9c5b3cb41246c243 for earlier term 2. Current term is 3.
I20260709 13:16:52.657197  8736 leader_election.cc:403] T c17f01b356e04590838cc6e6bb27bf64 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:52.717528  8840 raft_consensus.cc:2468] T c17f01b356e04590838cc6e6bb27bf64 P 7d3072f2af0b481d94ed70632b90e8c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 3.
I20260709 13:16:52.717630  9039 tablet_bootstrap.cc:492] T 278f12b812a8473f8e3fddc73feabb62 P 7d3072f2af0b481d94ed70632b90e8c6: No bootstrap required, opened a new log
I20260709 13:16:52.718976  9039 ts_tablet_manager.cc:1403] T 278f12b812a8473f8e3fddc73feabb62 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent bootstrapping tablet: real 0.099s	user 0.030s	sys 0.015s
I20260709 13:16:52.719730  8883 leader_election.cc:304] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6; no voters: 
I20260709 13:16:52.721231  9405 raft_consensus.cc:2804] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:52.721913  9405 raft_consensus.cc:697] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 LEADER]: Becoming Leader. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Running, Role: LEADER
I20260709 13:16:52.712806  8667 catalog_manager.cc:5697] T 9fdcbb0a74a64826ab0665c349b16200 P 43c6faa9496d44dda6b6eaed09cdfd12 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195). New cstate: current_term: 1 leader_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:52.636317  9225 leader_election.cc:290] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 election: Requested vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:52.722908  9405 consensus_queue.cc:237] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
W20260709 13:16:52.700071  8736 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37671, user_credentials={real_user=slave}} blocked reactor thread for 43804.1us
W20260709 13:16:52.781410  8882 consensus_peers.cc:597] T 9fdcbb0a74a64826ab0665c349b16200 P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Couldn't send request to peer e8bb7e1240f44fda8b83e4c124852032. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:52.784895  9038 tablet_bootstrap.cc:492] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243: No bootstrap required, opened a new log
I20260709 13:16:52.785553  9038 ts_tablet_manager.cc:1403] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.258s	user 0.020s	sys 0.008s
I20260709 13:16:52.767969  9039 raft_consensus.cc:359] T 278f12b812a8473f8e3fddc73feabb62 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:52.788959  9039 raft_consensus.cc:385] T 278f12b812a8473f8e3fddc73feabb62 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:52.789259  9039 raft_consensus.cc:740] T 278f12b812a8473f8e3fddc73feabb62 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.789997  9039 consensus_queue.cc:260] T 278f12b812a8473f8e3fddc73feabb62 P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:52.772475  8766 raft_consensus.cc:2468] T c17f01b356e04590838cc6e6bb27bf64 P 895d3c58761f427c9c5b3cb41246c243 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 3.
I20260709 13:16:52.806197  9347 raft_consensus.cc:2749] T c17f01b356e04590838cc6e6bb27bf64 P 895d3c58761f427c9c5b3cb41246c243 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671) with higher term. Message: Invalid argument: T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 895d3c58761f427c9c5b3cb41246c243 for earlier term 2. Current term is 3.
I20260709 13:16:52.808857  9403 consensus_queue.cc:1048] T 9fdcbb0a74a64826ab0665c349b16200 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:52.816967  9038 raft_consensus.cc:359] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:52.819916  9038 raft_consensus.cc:385] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:52.820333  9038 raft_consensus.cc:740] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.819065  9347 raft_consensus.cc:493] T 69e5f8bfdb5a46808e713e051a38866d P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.823179  9347 raft_consensus.cc:515] T 69e5f8bfdb5a46808e713e051a38866d P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:52.825632  9347 leader_election.cc:290] T 69e5f8bfdb5a46808e713e051a38866d P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:52.832540  9038 consensus_queue.cc:260] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:52.857522  9130 consensus_queue.cc:1048] T 55bac44fd5a3462593ab47f6b6f44c6e P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:52.871424  8990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e5f8bfdb5a46808e713e051a38866d" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:52.865453  9373 raft_consensus.cc:493] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.880074  9039 ts_tablet_manager.cc:1434] T 278f12b812a8473f8e3fddc73feabb62 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent starting tablet: real 0.161s	user 0.008s	sys 0.004s
I20260709 13:16:52.890981  9040 tablet_bootstrap.cc:492] T 9fdcbb0a74a64826ab0665c349b16200 P e8bb7e1240f44fda8b83e4c124852032: No bootstrap required, opened a new log
I20260709 13:16:52.891659  9040 ts_tablet_manager.cc:1403] T 9fdcbb0a74a64826ab0665c349b16200 P e8bb7e1240f44fda8b83e4c124852032: Time spent bootstrapping tablet: real 0.514s	user 0.043s	sys 0.055s
W20260709 13:16:52.903993  8733 leader_election.cc:343] T 69e5f8bfdb5a46808e713e051a38866d P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:52.913863  9038 ts_tablet_manager.cc:1434] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.128s	user 0.008s	sys 0.001s
I20260709 13:16:52.915508  9040 raft_consensus.cc:359] T 9fdcbb0a74a64826ab0665c349b16200 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:52.916195  9040 raft_consensus.cc:385] T 9fdcbb0a74a64826ab0665c349b16200 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:52.916451  9040 raft_consensus.cc:740] T 9fdcbb0a74a64826ab0665c349b16200 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.934839  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e5f8bfdb5a46808e713e051a38866d" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
W20260709 13:16:52.944068  8734 leader_election.cc:343] T 69e5f8bfdb5a46808e713e051a38866d P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:52.944717  8734 leader_election.cc:304] T 69e5f8bfdb5a46808e713e051a38866d P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243; no voters: 7d3072f2af0b481d94ed70632b90e8c6, e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:52.946204  9447 raft_consensus.cc:2749] T 69e5f8bfdb5a46808e713e051a38866d P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:52.883937  9373 raft_consensus.cc:515] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:52.949429  9373 leader_election.cc:290] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:52.950639  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c705b65de4abe884afdb1fcaaa054" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:52.955765  9042 tablet_bootstrap.cc:492] T 2accf622ad6243e3b7b496fb979fe9d4 P 43c6faa9496d44dda6b6eaed09cdfd12: No bootstrap required, opened a new log
I20260709 13:16:52.971984  9042 ts_tablet_manager.cc:1403] T 2accf622ad6243e3b7b496fb979fe9d4 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent bootstrapping tablet: real 0.532s	user 0.055s	sys 0.080s
I20260709 13:16:52.959018  9039 tablet_bootstrap.cc:492] T 69e5f8bfdb5a46808e713e051a38866d P 7d3072f2af0b481d94ed70632b90e8c6: Bootstrap starting.
I20260709 13:16:52.961118  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c705b65de4abe884afdb1fcaaa054" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:52.976660  8768 raft_consensus.cc:2468] T 097c705b65de4abe884afdb1fcaaa054 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 0.
W20260709 13:16:52.978492  8882 leader_election.cc:343] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:52.981907  9039 tablet_bootstrap.cc:654] T 69e5f8bfdb5a46808e713e051a38866d P 7d3072f2af0b481d94ed70632b90e8c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:52.984666  8884 leader_election.cc:304] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243; no voters: e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:52.981775  9042 raft_consensus.cc:359] T 2accf622ad6243e3b7b496fb979fe9d4 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:52.985446  9042 raft_consensus.cc:385] T 2accf622ad6243e3b7b496fb979fe9d4 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:52.985574  9450 raft_consensus.cc:2804] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:52.986042  9450 raft_consensus.cc:493] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.986271  9042 raft_consensus.cc:740] T 2accf622ad6243e3b7b496fb979fe9d4 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.986387  9450 raft_consensus.cc:3060] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.988957  9042 consensus_queue.cc:260] T 2accf622ad6243e3b7b496fb979fe9d4 P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:52.921363  9040 consensus_queue.cc:260] T 9fdcbb0a74a64826ab0665c349b16200 P e8bb7e1240f44fda8b83e4c124852032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:53.012293  9130 raft_consensus.cc:493] T 45613c5d357b40b8af0ced6c8725c559 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.014528  9130 raft_consensus.cc:515] T 45613c5d357b40b8af0ced6c8725c559 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:52.947209  9038 tablet_bootstrap.cc:492] T 675795627b9b4542805157dd7ec531cd P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:53.018908  9316 raft_consensus.cc:493] T 9fdcbb0a74a64826ab0665c349b16200 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.019418  9316 raft_consensus.cc:515] T 9fdcbb0a74a64826ab0665c349b16200 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:53.020229  9130 leader_election.cc:290] T 45613c5d357b40b8af0ced6c8725c559 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:53.024786  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45613c5d357b40b8af0ced6c8725c559" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:53.025818  8919 raft_consensus.cc:2393] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3072f2af0b481d94ed70632b90e8c6 in current term 1: Already voted for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in this term.
I20260709 13:16:53.027470  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45613c5d357b40b8af0ced6c8725c559" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:53.028358  8768 raft_consensus.cc:2393] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3072f2af0b481d94ed70632b90e8c6 in current term 1: Already voted for candidate 895d3c58761f427c9c5b3cb41246c243 in this term.
I20260709 13:16:53.029330  9040 ts_tablet_manager.cc:1434] T 9fdcbb0a74a64826ab0665c349b16200 P e8bb7e1240f44fda8b83e4c124852032: Time spent starting tablet: real 0.137s	user 0.007s	sys 0.000s
I20260709 13:16:53.029731  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fdcbb0a74a64826ab0665c349b16200" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:53.029826  9316 leader_election.cc:290] T 9fdcbb0a74a64826ab0665c349b16200 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:53.030633  9040 tablet_bootstrap.cc:492] T 69e5f8bfdb5a46808e713e051a38866d P e8bb7e1240f44fda8b83e4c124852032: Bootstrap starting.
I20260709 13:16:53.034583  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fdcbb0a74a64826ab0665c349b16200" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:53.036947  8666 catalog_manager.cc:5697] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:53.046625  9042 ts_tablet_manager.cc:1434] T 2accf622ad6243e3b7b496fb979fe9d4 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent starting tablet: real 0.074s	user 0.007s	sys 0.001s
I20260709 13:16:53.048174  9042 tablet_bootstrap.cc:492] T 4fd6605b785643deac78902ee4fc6896 P 43c6faa9496d44dda6b6eaed09cdfd12: Bootstrap starting.
I20260709 13:16:53.048647  8959 leader_election.cc:304] T 9fdcbb0a74a64826ab0665c349b16200 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bb7e1240f44fda8b83e4c124852032; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:53.056905  9316 raft_consensus.cc:2749] T 9fdcbb0a74a64826ab0665c349b16200 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:53.009719  9450 raft_consensus.cc:515] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:53.052145  8811 leader_election.cc:304] T 45613c5d357b40b8af0ced6c8725c559 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:53.059074  9438 raft_consensus.cc:3060] T 45613c5d357b40b8af0ced6c8725c559 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.060384  8990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c705b65de4abe884afdb1fcaaa054" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
W20260709 13:16:53.062023  8882 leader_election.cc:343] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:53.062438  9039 tablet_bootstrap.cc:492] T 69e5f8bfdb5a46808e713e051a38866d P 7d3072f2af0b481d94ed70632b90e8c6: No bootstrap required, opened a new log
I20260709 13:16:53.063052  9039 ts_tablet_manager.cc:1403] T 69e5f8bfdb5a46808e713e051a38866d P 7d3072f2af0b481d94ed70632b90e8c6: Time spent bootstrapping tablet: real 0.104s	user 0.011s	sys 0.016s
I20260709 13:16:53.066298  9039 raft_consensus.cc:359] T 69e5f8bfdb5a46808e713e051a38866d P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:53.067220  9039 raft_consensus.cc:385] T 69e5f8bfdb5a46808e713e051a38866d P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:53.067531  9039 raft_consensus.cc:740] T 69e5f8bfdb5a46808e713e051a38866d P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.068358  9039 consensus_queue.cc:260] T 69e5f8bfdb5a46808e713e051a38866d P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:53.069100  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c705b65de4abe884afdb1fcaaa054" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243"
I20260709 13:16:53.069802  8768 raft_consensus.cc:3060] T 097c705b65de4abe884afdb1fcaaa054 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.072819  9038 tablet_bootstrap.cc:654] T 675795627b9b4542805157dd7ec531cd P 895d3c58761f427c9c5b3cb41246c243: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:53.068243  9450 leader_election.cc:290] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Requested vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:53.077690  9039 ts_tablet_manager.cc:1434] T 69e5f8bfdb5a46808e713e051a38866d P 7d3072f2af0b481d94ed70632b90e8c6: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:16:53.078967  9039 tablet_bootstrap.cc:492] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 7d3072f2af0b481d94ed70632b90e8c6: Bootstrap starting.
I20260709 13:16:53.090003  9039 tablet_bootstrap.cc:654] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 7d3072f2af0b481d94ed70632b90e8c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:53.091113  9040 tablet_bootstrap.cc:654] T 69e5f8bfdb5a46808e713e051a38866d P e8bb7e1240f44fda8b83e4c124852032: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:53.094766  9042 tablet_bootstrap.cc:654] T 4fd6605b785643deac78902ee4fc6896 P 43c6faa9496d44dda6b6eaed09cdfd12: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:53.094863  8768 raft_consensus.cc:2468] T 097c705b65de4abe884afdb1fcaaa054 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 1.
I20260709 13:16:53.105908  9438 raft_consensus.cc:2749] T 45613c5d357b40b8af0ced6c8725c559 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:53.106776  9038 tablet_bootstrap.cc:492] T 675795627b9b4542805157dd7ec531cd P 895d3c58761f427c9c5b3cb41246c243: No bootstrap required, opened a new log
I20260709 13:16:53.113306  9038 ts_tablet_manager.cc:1403] T 675795627b9b4542805157dd7ec531cd P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.166s	user 0.011s	sys 0.002s
I20260709 13:16:53.115640  8884 leader_election.cc:304] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243; no voters: e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:53.116412  9038 raft_consensus.cc:359] T 675795627b9b4542805157dd7ec531cd P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:53.117038  9373 raft_consensus.cc:2804] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:53.117230  9038 raft_consensus.cc:385] T 675795627b9b4542805157dd7ec531cd P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:53.108842  9042 tablet_bootstrap.cc:492] T 4fd6605b785643deac78902ee4fc6896 P 43c6faa9496d44dda6b6eaed09cdfd12: No bootstrap required, opened a new log
I20260709 13:16:53.117619  9373 raft_consensus.cc:697] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Becoming Leader. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Running, Role: LEADER
I20260709 13:16:53.118095  9042 ts_tablet_manager.cc:1403] T 4fd6605b785643deac78902ee4fc6896 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent bootstrapping tablet: real 0.070s	user 0.010s	sys 0.002s
I20260709 13:16:53.111171  9040 tablet_bootstrap.cc:492] T 69e5f8bfdb5a46808e713e051a38866d P e8bb7e1240f44fda8b83e4c124852032: No bootstrap required, opened a new log
I20260709 13:16:53.119920  9040 ts_tablet_manager.cc:1403] T 69e5f8bfdb5a46808e713e051a38866d P e8bb7e1240f44fda8b83e4c124852032: Time spent bootstrapping tablet: real 0.090s	user 0.011s	sys 0.003s
I20260709 13:16:53.122853  9040 raft_consensus.cc:359] T 69e5f8bfdb5a46808e713e051a38866d P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:53.118834  9373 consensus_queue.cc:237] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:53.117560  9038 raft_consensus.cc:740] T 675795627b9b4542805157dd7ec531cd P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.127103  9038 consensus_queue.cc:260] T 675795627b9b4542805157dd7ec531cd P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:53.130121  9042 raft_consensus.cc:359] T 4fd6605b785643deac78902ee4fc6896 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:53.130803  9042 raft_consensus.cc:385] T 4fd6605b785643deac78902ee4fc6896 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:53.131111  9042 raft_consensus.cc:740] T 4fd6605b785643deac78902ee4fc6896 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.136122  9039 tablet_bootstrap.cc:492] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 7d3072f2af0b481d94ed70632b90e8c6: No bootstrap required, opened a new log
I20260709 13:16:53.137377  9039 ts_tablet_manager.cc:1403] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent bootstrapping tablet: real 0.059s	user 0.008s	sys 0.004s
I20260709 13:16:53.140286  9038 ts_tablet_manager.cc:1434] T 675795627b9b4542805157dd7ec531cd P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:16:53.140697  9040 raft_consensus.cc:385] T 69e5f8bfdb5a46808e713e051a38866d P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:53.141072  9040 raft_consensus.cc:740] T 69e5f8bfdb5a46808e713e051a38866d P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.141821  9040 consensus_queue.cc:260] T 69e5f8bfdb5a46808e713e051a38866d P e8bb7e1240f44fda8b83e4c124852032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:53.137693  9042 consensus_queue.cc:260] T 4fd6605b785643deac78902ee4fc6896 P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:53.146626  9040 ts_tablet_manager.cc:1434] T 69e5f8bfdb5a46808e713e051a38866d P e8bb7e1240f44fda8b83e4c124852032: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.001s
I20260709 13:16:53.147897  9040 tablet_bootstrap.cc:492] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P e8bb7e1240f44fda8b83e4c124852032: Bootstrap starting.
I20260709 13:16:53.150741  9039 raft_consensus.cc:359] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:53.151727  9039 raft_consensus.cc:385] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:53.152092  9039 raft_consensus.cc:740] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.153069  9039 consensus_queue.cc:260] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:53.154768  9038 tablet_bootstrap.cc:492] T 45d9eb22dee8411b82eb768686e34604 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:53.156783  9042 ts_tablet_manager.cc:1434] T 4fd6605b785643deac78902ee4fc6896 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.003s
I20260709 13:16:53.157984  9042 tablet_bootstrap.cc:492] T 45d9eb22dee8411b82eb768686e34604 P 43c6faa9496d44dda6b6eaed09cdfd12: Bootstrap starting.
I20260709 13:16:53.159159  9438 raft_consensus.cc:493] T 278f12b812a8473f8e3fddc73feabb62 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.159776  9438 raft_consensus.cc:515] T 278f12b812a8473f8e3fddc73feabb62 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:53.161594  9039 ts_tablet_manager.cc:1434] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.001s
I20260709 13:16:53.164738  9039 tablet_bootstrap.cc:492] T 2accf622ad6243e3b7b496fb979fe9d4 P 7d3072f2af0b481d94ed70632b90e8c6: Bootstrap starting.
I20260709 13:16:53.163229  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278f12b812a8473f8e3fddc73feabb62" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:53.165334  8919 raft_consensus.cc:2468] T 278f12b812a8473f8e3fddc73feabb62 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 0.
I20260709 13:16:53.166750  8811 leader_election.cc:304] T 278f12b812a8473f8e3fddc73feabb62 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6; no voters: 
I20260709 13:16:53.167621  9130 raft_consensus.cc:2804] T 278f12b812a8473f8e3fddc73feabb62 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:53.167994  9130 raft_consensus.cc:493] T 278f12b812a8473f8e3fddc73feabb62 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.168295  9130 raft_consensus.cc:3060] T 278f12b812a8473f8e3fddc73feabb62 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.174132  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278f12b812a8473f8e3fddc73feabb62" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:53.162431  9438 leader_election.cc:290] T 278f12b812a8473f8e3fddc73feabb62 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
W20260709 13:16:53.176057  8808 leader_election.cc:343] T 278f12b812a8473f8e3fddc73feabb62 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:53.178354  9038 tablet_bootstrap.cc:654] T 45d9eb22dee8411b82eb768686e34604 P 895d3c58761f427c9c5b3cb41246c243: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:53.182364  9042 tablet_bootstrap.cc:654] T 45d9eb22dee8411b82eb768686e34604 P 43c6faa9496d44dda6b6eaed09cdfd12: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:53.183531  9130 raft_consensus.cc:515] T 278f12b812a8473f8e3fddc73feabb62 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:53.173436  9040 tablet_bootstrap.cc:654] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P e8bb7e1240f44fda8b83e4c124852032: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:53.192095  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278f12b812a8473f8e3fddc73feabb62" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:16:53.192752  8919 raft_consensus.cc:3060] T 278f12b812a8473f8e3fddc73feabb62 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.202443  9040 tablet_bootstrap.cc:492] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P e8bb7e1240f44fda8b83e4c124852032: No bootstrap required, opened a new log
I20260709 13:16:53.203104  9040 ts_tablet_manager.cc:1403] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P e8bb7e1240f44fda8b83e4c124852032: Time spent bootstrapping tablet: real 0.055s	user 0.004s	sys 0.010s
I20260709 13:16:53.206388  9040 raft_consensus.cc:359] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:53.207106  9040 raft_consensus.cc:385] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:53.207384  9040 raft_consensus.cc:740] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.208057  9040 consensus_queue.cc:260] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P e8bb7e1240f44fda8b83e4c124852032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:53.210443  9040 ts_tablet_manager.cc:1434] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P e8bb7e1240f44fda8b83e4c124852032: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:16:53.210711  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278f12b812a8473f8e3fddc73feabb62" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
I20260709 13:16:53.210795  9130 leader_election.cc:290] T 278f12b812a8473f8e3fddc73feabb62 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 election: Requested vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
W20260709 13:16:53.212308  8808 leader_election.cc:343] T 278f12b812a8473f8e3fddc73feabb62 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:53.210928  8919 raft_consensus.cc:2468] T 278f12b812a8473f8e3fddc73feabb62 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 1.
I20260709 13:16:53.213780  8811 leader_election.cc:304] T 278f12b812a8473f8e3fddc73feabb62 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6; no voters: e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:53.215267  9130 raft_consensus.cc:2804] T 278f12b812a8473f8e3fddc73feabb62 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:53.215852  9130 raft_consensus.cc:697] T 278f12b812a8473f8e3fddc73feabb62 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 LEADER]: Becoming Leader. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Running, Role: LEADER
I20260709 13:16:53.218551  9130 consensus_queue.cc:237] T 278f12b812a8473f8e3fddc73feabb62 P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:53.224270  9040 tablet_bootstrap.cc:492] T 278f12b812a8473f8e3fddc73feabb62 P e8bb7e1240f44fda8b83e4c124852032: Bootstrap starting.
I20260709 13:16:53.232271  9039 tablet_bootstrap.cc:654] T 2accf622ad6243e3b7b496fb979fe9d4 P 7d3072f2af0b481d94ed70632b90e8c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:53.264089  8992 raft_consensus.cc:3060] T 9fdcbb0a74a64826ab0665c349b16200 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.264379  9040 tablet_bootstrap.cc:654] T 278f12b812a8473f8e3fddc73feabb62 P e8bb7e1240f44fda8b83e4c124852032: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:53.267350  8668 catalog_manager.cc:5697] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195). New cstate: current_term: 1 leader_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:53.271929  9347 raft_consensus.cc:493] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.272548  9347 raft_consensus.cc:515] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:53.278168  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd6605b785643deac78902ee4fc6896" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:53.280717  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd6605b785643deac78902ee4fc6896" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
W20260709 13:16:53.281049  8734 leader_election.cc:343] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:53.281482  8919 raft_consensus.cc:2468] T 4fd6605b785643deac78902ee4fc6896 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 0.
I20260709 13:16:53.284057  9042 tablet_bootstrap.cc:492] T 45d9eb22dee8411b82eb768686e34604 P 43c6faa9496d44dda6b6eaed09cdfd12: No bootstrap required, opened a new log
I20260709 13:16:53.284667  9042 ts_tablet_manager.cc:1403] T 45d9eb22dee8411b82eb768686e34604 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent bootstrapping tablet: real 0.127s	user 0.011s	sys 0.018s
I20260709 13:16:53.285320  8736 leader_election.cc:304] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243; no voters: 7d3072f2af0b481d94ed70632b90e8c6
I20260709 13:16:53.286552  9413 raft_consensus.cc:2804] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:53.287076  9413 raft_consensus.cc:493] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.287505  9413 raft_consensus.cc:3060] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.290414  9042 raft_consensus.cc:359] T 45d9eb22dee8411b82eb768686e34604 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:53.291177  9042 raft_consensus.cc:385] T 45d9eb22dee8411b82eb768686e34604 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:53.291427  9042 raft_consensus.cc:740] T 45d9eb22dee8411b82eb768686e34604 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.292189  9042 consensus_queue.cc:260] T 45d9eb22dee8411b82eb768686e34604 P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:53.279412  9347 leader_election.cc:290] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:53.296458  8664 catalog_manager.cc:5697] T 278f12b812a8473f8e3fddc73feabb62 P 7d3072f2af0b481d94ed70632b90e8c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194). New cstate: current_term: 1 leader_uuid: "7d3072f2af0b481d94ed70632b90e8c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:53.303131  9413 raft_consensus.cc:515] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:53.306591  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd6605b785643deac78902ee4fc6896" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
W20260709 13:16:53.308156  8734 leader_election.cc:343] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:53.313702  9039 tablet_bootstrap.cc:492] T 2accf622ad6243e3b7b496fb979fe9d4 P 7d3072f2af0b481d94ed70632b90e8c6: No bootstrap required, opened a new log
I20260709 13:16:53.314301  9039 ts_tablet_manager.cc:1403] T 2accf622ad6243e3b7b496fb979fe9d4 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent bootstrapping tablet: real 0.150s	user 0.023s	sys 0.009s
I20260709 13:16:53.315837  9038 tablet_bootstrap.cc:492] T 45d9eb22dee8411b82eb768686e34604 P 895d3c58761f427c9c5b3cb41246c243: No bootstrap required, opened a new log
I20260709 13:16:53.316484  9038 ts_tablet_manager.cc:1403] T 45d9eb22dee8411b82eb768686e34604 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.162s	user 0.029s	sys 0.014s
I20260709 13:16:53.317068  8770 raft_consensus.cc:1275] T c17f01b356e04590838cc6e6bb27bf64 P 895d3c58761f427c9c5b3cb41246c243 [term 3 FOLLOWER]: Refusing update from remote peer 43c6faa9496d44dda6b6eaed09cdfd12: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:53.317593  9039 raft_consensus.cc:359] T 2accf622ad6243e3b7b496fb979fe9d4 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:53.318408  9039 raft_consensus.cc:385] T 2accf622ad6243e3b7b496fb979fe9d4 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:53.318687  9039 raft_consensus.cc:740] T 2accf622ad6243e3b7b496fb979fe9d4 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.318962  9373 consensus_queue.cc:1048] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:53.319448  9039 consensus_queue.cc:260] T 2accf622ad6243e3b7b496fb979fe9d4 P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:53.321417  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd6605b785643deac78902ee4fc6896" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:16:53.325605  8919 raft_consensus.cc:3060] T 4fd6605b785643deac78902ee4fc6896 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.321508  9413 leader_election.cc:290] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 election: Requested vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:53.319533  9038 raft_consensus.cc:359] T 45d9eb22dee8411b82eb768686e34604 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:53.333878  9038 raft_consensus.cc:385] T 45d9eb22dee8411b82eb768686e34604 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:53.334188  9038 raft_consensus.cc:740] T 45d9eb22dee8411b82eb768686e34604 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.337502  8919 raft_consensus.cc:2468] T 4fd6605b785643deac78902ee4fc6896 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 1.
I20260709 13:16:53.338857  8736 leader_election.cc:304] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243; no voters: 7d3072f2af0b481d94ed70632b90e8c6
I20260709 13:16:53.340061  9413 raft_consensus.cc:2804] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:53.340596  9413 raft_consensus.cc:697] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243 [term 1 LEADER]: Becoming Leader. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Running, Role: LEADER
I20260709 13:16:53.341706  8840 raft_consensus.cc:1275] T c17f01b356e04590838cc6e6bb27bf64 P 7d3072f2af0b481d94ed70632b90e8c6 [term 3 FOLLOWER]: Refusing update from remote peer 43c6faa9496d44dda6b6eaed09cdfd12: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:53.341487  9413 consensus_queue.cc:237] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:53.343578  9038 consensus_queue.cc:260] T 45d9eb22dee8411b82eb768686e34604 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:53.344031  9373 consensus_queue.cc:1048] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:53.346401  9038 ts_tablet_manager.cc:1434] T 45d9eb22dee8411b82eb768686e34604 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:16:53.347764  9039 ts_tablet_manager.cc:1434] T 2accf622ad6243e3b7b496fb979fe9d4 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.000s
I20260709 13:16:53.350780  9042 ts_tablet_manager.cc:1434] T 45d9eb22dee8411b82eb768686e34604 P 43c6faa9496d44dda6b6eaed09cdfd12: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.000s
I20260709 13:16:53.353788  9040 tablet_bootstrap.cc:492] T 278f12b812a8473f8e3fddc73feabb62 P e8bb7e1240f44fda8b83e4c124852032: No bootstrap required, opened a new log
I20260709 13:16:53.354439  9040 ts_tablet_manager.cc:1403] T 278f12b812a8473f8e3fddc73feabb62 P e8bb7e1240f44fda8b83e4c124852032: Time spent bootstrapping tablet: real 0.143s	user 0.013s	sys 0.001s
I20260709 13:16:53.358168  9040 raft_consensus.cc:359] T 278f12b812a8473f8e3fddc73feabb62 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:53.358923  9040 raft_consensus.cc:385] T 278f12b812a8473f8e3fddc73feabb62 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:53.359239  9040 raft_consensus.cc:740] T 278f12b812a8473f8e3fddc73feabb62 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.361918  9039 tablet_bootstrap.cc:492] T 4fd6605b785643deac78902ee4fc6896 P 7d3072f2af0b481d94ed70632b90e8c6: Bootstrap starting.
I20260709 13:16:53.369220  9039 tablet_bootstrap.cc:654] T 4fd6605b785643deac78902ee4fc6896 P 7d3072f2af0b481d94ed70632b90e8c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:53.360066  9040 consensus_queue.cc:260] T 278f12b812a8473f8e3fddc73feabb62 P e8bb7e1240f44fda8b83e4c124852032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:53.382715  9040 ts_tablet_manager.cc:1434] T 278f12b812a8473f8e3fddc73feabb62 P e8bb7e1240f44fda8b83e4c124852032: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.001s
I20260709 13:16:53.400771  9040 tablet_bootstrap.cc:492] T 2accf622ad6243e3b7b496fb979fe9d4 P e8bb7e1240f44fda8b83e4c124852032: Bootstrap starting.
I20260709 13:16:53.421818  9436 raft_consensus.cc:493] T 675795627b9b4542805157dd7ec531cd P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.422537  9436 raft_consensus.cc:515] T 675795627b9b4542805157dd7ec531cd P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:53.424764  9039 tablet_bootstrap.cc:492] T 4fd6605b785643deac78902ee4fc6896 P 7d3072f2af0b481d94ed70632b90e8c6: No bootstrap required, opened a new log
I20260709 13:16:53.429775  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675795627b9b4542805157dd7ec531cd" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:53.435809  9039 ts_tablet_manager.cc:1403] T 4fd6605b785643deac78902ee4fc6896 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent bootstrapping tablet: real 0.074s	user 0.010s	sys 0.004s
W20260709 13:16:53.436625  8733 leader_election.cc:343] T 675795627b9b4542805157dd7ec531cd P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:53.430128  9436 leader_election.cc:290] T 675795627b9b4542805157dd7ec531cd P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:53.445890  9039 raft_consensus.cc:359] T 4fd6605b785643deac78902ee4fc6896 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:53.447415  8667 catalog_manager.cc:5697] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243 reported cstate change: term changed from 0 to 1, leader changed from <none> to 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "895d3c58761f427c9c5b3cb41246c243" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:53.449052  9428 raft_consensus.cc:493] T 69e5f8bfdb5a46808e713e051a38866d P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.458854  9428 raft_consensus.cc:515] T 69e5f8bfdb5a46808e713e051a38866d P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:53.460448  9039 raft_consensus.cc:385] T 4fd6605b785643deac78902ee4fc6896 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:53.460851  9039 raft_consensus.cc:740] T 4fd6605b785643deac78902ee4fc6896 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.461128  9428 leader_election.cc:290] T 69e5f8bfdb5a46808e713e051a38866d P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:53.458423  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675795627b9b4542805157dd7ec531cd" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:53.465579  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e5f8bfdb5a46808e713e051a38866d" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:53.463287  9039 consensus_queue.cc:260] T 4fd6605b785643deac78902ee4fc6896 P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:53.466416  8768 raft_consensus.cc:2468] T 69e5f8bfdb5a46808e713e051a38866d P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 0.
W20260709 13:16:53.467229  8734 leader_election.cc:343] T 675795627b9b4542805157dd7ec531cd P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:53.467780  8734 leader_election.cc:304] T 675795627b9b4542805157dd7ec531cd P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243; no voters: 7d3072f2af0b481d94ed70632b90e8c6, e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:53.468040  8958 leader_election.cc:304] T 69e5f8bfdb5a46808e713e051a38866d P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:16:53.468621  9436 raft_consensus.cc:2749] T 675795627b9b4542805157dd7ec531cd P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:53.468833  9039 ts_tablet_manager.cc:1434] T 4fd6605b785643deac78902ee4fc6896 P 7d3072f2af0b481d94ed70632b90e8c6: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.003s
I20260709 13:16:53.451218  9475 raft_consensus.cc:493] T 278f12b812a8473f8e3fddc73feabb62 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.475674  9475 raft_consensus.cc:515] T 278f12b812a8473f8e3fddc73feabb62 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:53.471709  9373 raft_consensus.cc:493] T 2accf622ad6243e3b7b496fb979fe9d4 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.477895  9373 raft_consensus.cc:515] T 2accf622ad6243e3b7b496fb979fe9d4 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:53.449572  9040 tablet_bootstrap.cc:654] T 2accf622ad6243e3b7b496fb979fe9d4 P e8bb7e1240f44fda8b83e4c124852032: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:53.480922  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2accf622ad6243e3b7b496fb979fe9d4" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:53.481586  8843 raft_consensus.cc:2468] T 2accf622ad6243e3b7b496fb979fe9d4 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 0.
I20260709 13:16:53.483132  8883 leader_election.cc:304] T 2accf622ad6243e3b7b496fb979fe9d4 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6; no voters: 
I20260709 13:16:53.469640  9316 raft_consensus.cc:2804] T 69e5f8bfdb5a46808e713e051a38866d P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:53.484031  9450 raft_consensus.cc:2804] T 2accf622ad6243e3b7b496fb979fe9d4 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:53.484596  9450 raft_consensus.cc:493] T 2accf622ad6243e3b7b496fb979fe9d4 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.485127  9450 raft_consensus.cc:3060] T 2accf622ad6243e3b7b496fb979fe9d4 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.485435  9475 leader_election.cc:290] T 278f12b812a8473f8e3fddc73feabb62 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:53.486208  9316 raft_consensus.cc:493] T 69e5f8bfdb5a46808e713e051a38866d P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.486688  9316 raft_consensus.cc:3060] T 69e5f8bfdb5a46808e713e051a38866d P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.493963  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278f12b812a8473f8e3fddc73feabb62" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:53.496188  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278f12b812a8473f8e3fddc73feabb62" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:53.497498  8919 raft_consensus.cc:2393] T 278f12b812a8473f8e3fddc73feabb62 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bb7e1240f44fda8b83e4c124852032 in current term 1: Already voted for candidate 7d3072f2af0b481d94ed70632b90e8c6 in this term.
I20260709 13:16:53.498749  8959 leader_election.cc:304] T 278f12b812a8473f8e3fddc73feabb62 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bb7e1240f44fda8b83e4c124852032; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6
I20260709 13:16:53.499413  9039 tablet_bootstrap.cc:492] T 675795627b9b4542805157dd7ec531cd P 7d3072f2af0b481d94ed70632b90e8c6: Bootstrap starting.
I20260709 13:16:53.499691  9475 raft_consensus.cc:3060] T 278f12b812a8473f8e3fddc73feabb62 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.502635  9373 leader_election.cc:290] T 2accf622ad6243e3b7b496fb979fe9d4 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:53.513983  9450 raft_consensus.cc:515] T 2accf622ad6243e3b7b496fb979fe9d4 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:53.516088  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e5f8bfdb5a46808e713e051a38866d" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:53.516359  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2accf622ad6243e3b7b496fb979fe9d4" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:53.517091  8840 raft_consensus.cc:2468] T 69e5f8bfdb5a46808e713e051a38866d P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 0.
I20260709 13:16:53.519038  9450 leader_election.cc:290] T 2accf622ad6243e3b7b496fb979fe9d4 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Requested vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:53.516531  9316 raft_consensus.cc:515] T 69e5f8bfdb5a46808e713e051a38866d P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:53.520534  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2accf622ad6243e3b7b496fb979fe9d4" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
W20260709 13:16:53.523029  8882 leader_election.cc:343] T 2accf622ad6243e3b7b496fb979fe9d4 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:53.524549  8882 leader_election.cc:343] T 2accf622ad6243e3b7b496fb979fe9d4 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:53.527988  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2accf622ad6243e3b7b496fb979fe9d4" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
I20260709 13:16:53.528668  8841 raft_consensus.cc:3060] T 2accf622ad6243e3b7b496fb979fe9d4 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.531252  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e5f8bfdb5a46808e713e051a38866d" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243"
I20260709 13:16:53.532022  8765 raft_consensus.cc:3060] T 69e5f8bfdb5a46808e713e051a38866d P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.535122  9039 tablet_bootstrap.cc:654] T 675795627b9b4542805157dd7ec531cd P 7d3072f2af0b481d94ed70632b90e8c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:53.539610  9316 leader_election.cc:290] T 69e5f8bfdb5a46808e713e051a38866d P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 election: Requested vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:53.540105  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e5f8bfdb5a46808e713e051a38866d" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
I20260709 13:16:53.540791  8843 raft_consensus.cc:3060] T 69e5f8bfdb5a46808e713e051a38866d P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.553761  9040 tablet_bootstrap.cc:492] T 2accf622ad6243e3b7b496fb979fe9d4 P e8bb7e1240f44fda8b83e4c124852032: No bootstrap required, opened a new log
I20260709 13:16:53.554370  9040 ts_tablet_manager.cc:1403] T 2accf622ad6243e3b7b496fb979fe9d4 P e8bb7e1240f44fda8b83e4c124852032: Time spent bootstrapping tablet: real 0.154s	user 0.016s	sys 0.008s
I20260709 13:16:53.557087  9040 raft_consensus.cc:359] T 2accf622ad6243e3b7b496fb979fe9d4 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:53.558728  9040 raft_consensus.cc:385] T 2accf622ad6243e3b7b496fb979fe9d4 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:53.559005  9040 raft_consensus.cc:740] T 2accf622ad6243e3b7b496fb979fe9d4 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.560134  9436 raft_consensus.cc:493] T 45d9eb22dee8411b82eb768686e34604 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.560019  9040 consensus_queue.cc:260] T 2accf622ad6243e3b7b496fb979fe9d4 P e8bb7e1240f44fda8b83e4c124852032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:53.560746  9436 raft_consensus.cc:515] T 45d9eb22dee8411b82eb768686e34604 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:53.562341  9130 raft_consensus.cc:493] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.562862  9130 raft_consensus.cc:515] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:53.564667  9436 leader_election.cc:290] T 45d9eb22dee8411b82eb768686e34604 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:53.566114  9130 leader_election.cc:290] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:53.567240  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44c5aa220814dfd9fc9bb07cd5b1cf7" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:53.568055  8992 raft_consensus.cc:2468] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 0.
I20260709 13:16:53.567509  8841 raft_consensus.cc:2468] T 2accf622ad6243e3b7b496fb979fe9d4 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 1.
I20260709 13:16:53.572520  8808 leader_election.cc:304] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:16:53.573365  8883 leader_election.cc:304] T 2accf622ad6243e3b7b496fb979fe9d4 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6; no voters: e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:53.568418  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d9eb22dee8411b82eb768686e34604" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:53.574399  9450 raft_consensus.cc:2804] T 2accf622ad6243e3b7b496fb979fe9d4 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:53.568986  8770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44c5aa220814dfd9fc9bb07cd5b1cf7" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:53.575055  9450 raft_consensus.cc:697] T 2accf622ad6243e3b7b496fb979fe9d4 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Becoming Leader. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Running, Role: LEADER
I20260709 13:16:53.576085  8919 raft_consensus.cc:2468] T 45d9eb22dee8411b82eb768686e34604 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 0.
I20260709 13:16:53.575479  8770 raft_consensus.cc:2468] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 0.
I20260709 13:16:53.577003  9450 consensus_queue.cc:237] T 2accf622ad6243e3b7b496fb979fe9d4 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:53.577608  8736 leader_election.cc:304] T 45d9eb22dee8411b82eb768686e34604 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243; no voters: 
I20260709 13:16:53.569797  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d9eb22dee8411b82eb768686e34604" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:53.580097  8765 raft_consensus.cc:2468] T 69e5f8bfdb5a46808e713e051a38866d P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 1.
W20260709 13:16:53.580577  8733 leader_election.cc:343] T 45d9eb22dee8411b82eb768686e34604 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:53.585647  8843 raft_consensus.cc:2468] T 69e5f8bfdb5a46808e713e051a38866d P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 1.
I20260709 13:16:53.581058  9436 raft_consensus.cc:2804] T 45d9eb22dee8411b82eb768686e34604 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:53.570403  9040 ts_tablet_manager.cc:1434] T 2accf622ad6243e3b7b496fb979fe9d4 P e8bb7e1240f44fda8b83e4c124852032: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.002s
I20260709 13:16:53.587031  9436 raft_consensus.cc:493] T 45d9eb22dee8411b82eb768686e34604 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.587601  9436 raft_consensus.cc:3060] T 45d9eb22dee8411b82eb768686e34604 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.580983  9130 raft_consensus.cc:2804] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:53.585896  8958 leader_election.cc:304] T 69e5f8bfdb5a46808e713e051a38866d P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:16:53.588357  9040 tablet_bootstrap.cc:492] T 097c705b65de4abe884afdb1fcaaa054 P e8bb7e1240f44fda8b83e4c124852032: Bootstrap starting.
I20260709 13:16:53.593181  9316 raft_consensus.cc:2804] T 69e5f8bfdb5a46808e713e051a38866d P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:53.610452  9316 raft_consensus.cc:697] T 69e5f8bfdb5a46808e713e051a38866d P e8bb7e1240f44fda8b83e4c124852032 [term 1 LEADER]: Becoming Leader. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Running, Role: LEADER
I20260709 13:16:53.611382  9316 consensus_queue.cc:237] T 69e5f8bfdb5a46808e713e051a38866d P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
W20260709 13:16:53.594385  8716 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:16:53.602236  8882 consensus_peers.cc:597] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Couldn't send request to peer e8bb7e1240f44fda8b83e4c124852032. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:53.592104  9130 raft_consensus.cc:493] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.616500  9130 raft_consensus.cc:3060] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.616936  9040 tablet_bootstrap.cc:654] T 097c705b65de4abe884afdb1fcaaa054 P e8bb7e1240f44fda8b83e4c124852032: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:53.601320  9436 raft_consensus.cc:515] T 45d9eb22dee8411b82eb768686e34604 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:53.639269  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d9eb22dee8411b82eb768686e34604" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:16:53.639987  8919 raft_consensus.cc:3060] T 45d9eb22dee8411b82eb768686e34604 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.640276  8668 catalog_manager.cc:5697] T 2accf622ad6243e3b7b496fb979fe9d4 P 43c6faa9496d44dda6b6eaed09cdfd12 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195). New cstate: current_term: 1 leader_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:53.583523  9475 raft_consensus.cc:2749] T 278f12b812a8473f8e3fddc73feabb62 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:53.643293  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d9eb22dee8411b82eb768686e34604" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
W20260709 13:16:53.645664  8733 leader_election.cc:343] T 45d9eb22dee8411b82eb768686e34604 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:53.650030  9405 consensus_queue.cc:1048] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:53.655939  8919 raft_consensus.cc:2468] T 45d9eb22dee8411b82eb768686e34604 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 1.
I20260709 13:16:53.643319  9436 leader_election.cc:290] T 45d9eb22dee8411b82eb768686e34604 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 election: Requested vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:53.661442  8736 leader_election.cc:304] T 45d9eb22dee8411b82eb768686e34604 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243; no voters: e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:53.662506  9447 raft_consensus.cc:2804] T 45d9eb22dee8411b82eb768686e34604 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:53.663189  9447 raft_consensus.cc:697] T 45d9eb22dee8411b82eb768686e34604 P 895d3c58761f427c9c5b3cb41246c243 [term 1 LEADER]: Becoming Leader. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Running, Role: LEADER
I20260709 13:16:53.664201  9447 consensus_queue.cc:237] T 45d9eb22dee8411b82eb768686e34604 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:53.661340  9039 tablet_bootstrap.cc:492] T 675795627b9b4542805157dd7ec531cd P 7d3072f2af0b481d94ed70632b90e8c6: No bootstrap required, opened a new log
I20260709 13:16:53.669180  9039 ts_tablet_manager.cc:1403] T 675795627b9b4542805157dd7ec531cd P 7d3072f2af0b481d94ed70632b90e8c6: Time spent bootstrapping tablet: real 0.170s	user 0.011s	sys 0.009s
I20260709 13:16:53.670691  9130 raft_consensus.cc:515] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:53.674124  9130 leader_election.cc:290] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 election: Requested vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:53.674557  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44c5aa220814dfd9fc9bb07cd5b1cf7" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
I20260709 13:16:53.675302  8992 raft_consensus.cc:3060] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.680131  9040 tablet_bootstrap.cc:492] T 097c705b65de4abe884afdb1fcaaa054 P e8bb7e1240f44fda8b83e4c124852032: No bootstrap required, opened a new log
I20260709 13:16:53.679978  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44c5aa220814dfd9fc9bb07cd5b1cf7" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243"
I20260709 13:16:53.680716  9040 ts_tablet_manager.cc:1403] T 097c705b65de4abe884afdb1fcaaa054 P e8bb7e1240f44fda8b83e4c124852032: Time spent bootstrapping tablet: real 0.093s	user 0.010s	sys 0.017s
I20260709 13:16:53.679673  8668 catalog_manager.cc:5697] T 69e5f8bfdb5a46808e713e051a38866d P e8bb7e1240f44fda8b83e4c124852032 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196). New cstate: current_term: 1 leader_uuid: "e8bb7e1240f44fda8b83e4c124852032" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:53.680724  8765 raft_consensus.cc:3060] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.685204  9039 raft_consensus.cc:359] T 675795627b9b4542805157dd7ec531cd P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:53.685658  8992 raft_consensus.cc:2468] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 1.
I20260709 13:16:53.686021  9039 raft_consensus.cc:385] T 675795627b9b4542805157dd7ec531cd P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:53.686395  9039 raft_consensus.cc:740] T 675795627b9b4542805157dd7ec531cd P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.687445  8808 leader_election.cc:304] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:16:53.688777  9130 raft_consensus.cc:2804] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:53.690514  9130 raft_consensus.cc:697] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 LEADER]: Becoming Leader. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Running, Role: LEADER
I20260709 13:16:53.691665  9130 consensus_queue.cc:237] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:53.690374  9040 raft_consensus.cc:359] T 097c705b65de4abe884afdb1fcaaa054 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:53.687047  9039 consensus_queue.cc:260] T 675795627b9b4542805157dd7ec531cd P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:53.696065  9040 raft_consensus.cc:385] T 097c705b65de4abe884afdb1fcaaa054 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:53.696547  9438 raft_consensus.cc:493] T 675795627b9b4542805157dd7ec531cd P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.697183  9438 raft_consensus.cc:515] T 675795627b9b4542805157dd7ec531cd P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:53.696668  9040 raft_consensus.cc:740] T 097c705b65de4abe884afdb1fcaaa054 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.699065  9039 ts_tablet_manager.cc:1434] T 675795627b9b4542805157dd7ec531cd P 7d3072f2af0b481d94ed70632b90e8c6: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.001s
I20260709 13:16:53.703100  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675795627b9b4542805157dd7ec531cd" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:53.721939  8768 raft_consensus.cc:2468] T 675795627b9b4542805157dd7ec531cd P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 0.
I20260709 13:16:53.722757  8664 catalog_manager.cc:5697] T 45d9eb22dee8411b82eb768686e34604 P 895d3c58761f427c9c5b3cb41246c243 reported cstate change: term changed from 0 to 1, leader changed from <none> to 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "895d3c58761f427c9c5b3cb41246c243" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:53.725181  8765 raft_consensus.cc:2468] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 1.
I20260709 13:16:53.722049  9040 consensus_queue.cc:260] T 097c705b65de4abe884afdb1fcaaa054 P e8bb7e1240f44fda8b83e4c124852032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:53.726287  8810 leader_election.cc:304] T 675795627b9b4542805157dd7ec531cd P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6, 895d3c58761f427c9c5b3cb41246c243; no voters: 
I20260709 13:16:53.730167  9040 ts_tablet_manager.cc:1434] T 097c705b65de4abe884afdb1fcaaa054 P e8bb7e1240f44fda8b83e4c124852032: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.003s
I20260709 13:16:53.731236  9040 tablet_bootstrap.cc:492] T 675795627b9b4542805157dd7ec531cd P e8bb7e1240f44fda8b83e4c124852032: Bootstrap starting.
I20260709 13:16:53.730168  9227 raft_consensus.cc:2804] T 675795627b9b4542805157dd7ec531cd P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:53.731770  9227 raft_consensus.cc:493] T 675795627b9b4542805157dd7ec531cd P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.732115  9227 raft_consensus.cc:3060] T 675795627b9b4542805157dd7ec531cd P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.701301  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675795627b9b4542805157dd7ec531cd" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
W20260709 13:16:53.737617  8808 leader_election.cc:343] T 675795627b9b4542805157dd7ec531cd P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:53.703294  9438 leader_election.cc:290] T 675795627b9b4542805157dd7ec531cd P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:53.750006  9040 tablet_bootstrap.cc:654] T 675795627b9b4542805157dd7ec531cd P e8bb7e1240f44fda8b83e4c124852032: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:53.757485  9227 raft_consensus.cc:515] T 675795627b9b4542805157dd7ec531cd P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:53.762153  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675795627b9b4542805157dd7ec531cd" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
W20260709 13:16:53.763615  8808 leader_election.cc:343] T 675795627b9b4542805157dd7ec531cd P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:53.764396  9040 tablet_bootstrap.cc:492] T 675795627b9b4542805157dd7ec531cd P e8bb7e1240f44fda8b83e4c124852032: No bootstrap required, opened a new log
I20260709 13:16:53.765007  9040 ts_tablet_manager.cc:1403] T 675795627b9b4542805157dd7ec531cd P e8bb7e1240f44fda8b83e4c124852032: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.004s
I20260709 13:16:53.766055  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675795627b9b4542805157dd7ec531cd" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243"
I20260709 13:16:53.766784  8765 raft_consensus.cc:3060] T 675795627b9b4542805157dd7ec531cd P 895d3c58761f427c9c5b3cb41246c243 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.768926  9040 raft_consensus.cc:359] T 675795627b9b4542805157dd7ec531cd P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:53.769727  9040 raft_consensus.cc:385] T 675795627b9b4542805157dd7ec531cd P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:53.770601  9040 raft_consensus.cc:740] T 675795627b9b4542805157dd7ec531cd P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.771420  9040 consensus_queue.cc:260] T 675795627b9b4542805157dd7ec531cd P e8bb7e1240f44fda8b83e4c124852032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:53.769969  9227 leader_election.cc:290] T 675795627b9b4542805157dd7ec531cd P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 election: Requested vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:53.769387  8667 catalog_manager.cc:5697] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 7d3072f2af0b481d94ed70632b90e8c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194). New cstate: current_term: 1 leader_uuid: "7d3072f2af0b481d94ed70632b90e8c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:53.778519  8765 raft_consensus.cc:2468] T 675795627b9b4542805157dd7ec531cd P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 1.
I20260709 13:16:53.779233  9040 ts_tablet_manager.cc:1434] T 675795627b9b4542805157dd7ec531cd P e8bb7e1240f44fda8b83e4c124852032: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:16:53.780520  9040 tablet_bootstrap.cc:492] T 45d9eb22dee8411b82eb768686e34604 P e8bb7e1240f44fda8b83e4c124852032: Bootstrap starting.
I20260709 13:16:53.782724  8810 leader_election.cc:304] T 675795627b9b4542805157dd7ec531cd P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6, 895d3c58761f427c9c5b3cb41246c243; no voters: e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:53.784461  9130 raft_consensus.cc:2804] T 675795627b9b4542805157dd7ec531cd P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:53.784920  9130 raft_consensus.cc:697] T 675795627b9b4542805157dd7ec531cd P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 LEADER]: Becoming Leader. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Running, Role: LEADER
I20260709 13:16:53.785708  9130 consensus_queue.cc:237] T 675795627b9b4542805157dd7ec531cd P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:53.787238  9040 tablet_bootstrap.cc:654] T 45d9eb22dee8411b82eb768686e34604 P e8bb7e1240f44fda8b83e4c124852032: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:53.787431  9506 consensus_queue.cc:1048] T 278f12b812a8473f8e3fddc73feabb62 P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:53.790607  9316 raft_consensus.cc:493] T 097c705b65de4abe884afdb1fcaaa054 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.791147  9316 raft_consensus.cc:515] T 097c705b65de4abe884afdb1fcaaa054 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:53.793344  9316 leader_election.cc:290] T 097c705b65de4abe884afdb1fcaaa054 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:53.799988  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c705b65de4abe884afdb1fcaaa054" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:53.805030  9040 tablet_bootstrap.cc:492] T 45d9eb22dee8411b82eb768686e34604 P e8bb7e1240f44fda8b83e4c124852032: No bootstrap required, opened a new log
I20260709 13:16:53.805629  9040 ts_tablet_manager.cc:1403] T 45d9eb22dee8411b82eb768686e34604 P e8bb7e1240f44fda8b83e4c124852032: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.003s
I20260709 13:16:53.808514  9040 raft_consensus.cc:359] T 45d9eb22dee8411b82eb768686e34604 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:53.809208  9040 raft_consensus.cc:385] T 45d9eb22dee8411b82eb768686e34604 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:53.809510  9040 raft_consensus.cc:740] T 45d9eb22dee8411b82eb768686e34604 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.810276  9040 consensus_queue.cc:260] T 45d9eb22dee8411b82eb768686e34604 P e8bb7e1240f44fda8b83e4c124852032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:53.811960  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c705b65de4abe884afdb1fcaaa054" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:53.813033  9040 ts_tablet_manager.cc:1434] T 45d9eb22dee8411b82eb768686e34604 P e8bb7e1240f44fda8b83e4c124852032: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:16:53.818293  8958 leader_election.cc:304] T 097c705b65de4abe884afdb1fcaaa054 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bb7e1240f44fda8b83e4c124852032; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:53.819221  9316 raft_consensus.cc:2749] T 097c705b65de4abe884afdb1fcaaa054 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:53.832182  9227 consensus_queue.cc:1048] T 278f12b812a8473f8e3fddc73feabb62 P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:53.848044  8664 catalog_manager.cc:5697] T 675795627b9b4542805157dd7ec531cd P 7d3072f2af0b481d94ed70632b90e8c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194). New cstate: current_term: 1 leader_uuid: "7d3072f2af0b481d94ed70632b90e8c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:53.855225  9316 raft_consensus.cc:493] T 675795627b9b4542805157dd7ec531cd P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.860554  9316 raft_consensus.cc:515] T 675795627b9b4542805157dd7ec531cd P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:53.876515  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675795627b9b4542805157dd7ec531cd" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:53.876773  9316 leader_election.cc:290] T 675795627b9b4542805157dd7ec531cd P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:53.877445  8765 raft_consensus.cc:2393] T 675795627b9b4542805157dd7ec531cd P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bb7e1240f44fda8b83e4c124852032 in current term 1: Already voted for candidate 7d3072f2af0b481d94ed70632b90e8c6 in this term.
I20260709 13:16:53.878703  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675795627b9b4542805157dd7ec531cd" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:53.878935  9316 raft_consensus.cc:493] T 2accf622ad6243e3b7b496fb979fe9d4 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.879503  9316 raft_consensus.cc:515] T 2accf622ad6243e3b7b496fb979fe9d4 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:16:53.880298  8957 leader_election.cc:304] T 675795627b9b4542805157dd7ec531cd P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bb7e1240f44fda8b83e4c124852032; no voters: 7d3072f2af0b481d94ed70632b90e8c6, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:53.881129  9475 raft_consensus.cc:3060] T 675795627b9b4542805157dd7ec531cd P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.886611  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2accf622ad6243e3b7b496fb979fe9d4" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:53.886684  9316 leader_election.cc:290] T 2accf622ad6243e3b7b496fb979fe9d4 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:53.886932  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2accf622ad6243e3b7b496fb979fe9d4" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:53.887738  8841 raft_consensus.cc:2393] T 2accf622ad6243e3b7b496fb979fe9d4 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8bb7e1240f44fda8b83e4c124852032 in current term 1: Already voted for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in this term.
I20260709 13:16:53.888803  8957 leader_election.cc:304] T 2accf622ad6243e3b7b496fb979fe9d4 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bb7e1240f44fda8b83e4c124852032; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6
I20260709 13:16:53.890205  9316 raft_consensus.cc:3060] T 2accf622ad6243e3b7b496fb979fe9d4 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.896513  9475 raft_consensus.cc:2749] T 675795627b9b4542805157dd7ec531cd P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:53.898329  9316 raft_consensus.cc:2749] T 2accf622ad6243e3b7b496fb979fe9d4 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:53.903996  9447 consensus_queue.cc:1048] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:53.916124  8841 raft_consensus.cc:3060] T 4fd6605b785643deac78902ee4fc6896 P 7d3072f2af0b481d94ed70632b90e8c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.925685  9436 consensus_queue.cc:1048] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:53.927211  9130 raft_consensus.cc:493] T 4fd6605b785643deac78902ee4fc6896 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.927762  9130 raft_consensus.cc:515] T 4fd6605b785643deac78902ee4fc6896 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:53.929745  9130 leader_election.cc:290] T 4fd6605b785643deac78902ee4fc6896 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:53.933007  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd6605b785643deac78902ee4fc6896" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:53.936249  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd6605b785643deac78902ee4fc6896" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "895d3c58761f427c9c5b3cb41246c243" is_pre_election: true
I20260709 13:16:53.939000  8810 leader_election.cc:304] T 4fd6605b785643deac78902ee4fc6896 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:53.944993  9130 raft_consensus.cc:2749] T 4fd6605b785643deac78902ee4fc6896 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:54.011188  9373 consensus_queue.cc:1048] T 2accf622ad6243e3b7b496fb979fe9d4 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:54.022217  8992 raft_consensus.cc:3060] T 097c705b65de4abe884afdb1fcaaa054 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:54.027529  9225 consensus_queue.cc:1048] T 2accf622ad6243e3b7b496fb979fe9d4 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:54.065200  9428 consensus_queue.cc:1048] T 69e5f8bfdb5a46808e713e051a38866d P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:54.076943  9475 consensus_queue.cc:1048] T 69e5f8bfdb5a46808e713e051a38866d P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:54.110074  8992 raft_consensus.cc:3060] T 45d9eb22dee8411b82eb768686e34604 P e8bb7e1240f44fda8b83e4c124852032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:54.116420  9436 consensus_queue.cc:1048] T 45d9eb22dee8411b82eb768686e34604 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:54.128626  9447 consensus_queue.cc:1048] T 45d9eb22dee8411b82eb768686e34604 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:54.171164  9506 consensus_queue.cc:1048] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:54.184497  9438 consensus_queue.cc:1048] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:54.219689  9438 consensus_queue.cc:1048] T 675795627b9b4542805157dd7ec531cd P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:54.231077  9438 consensus_queue.cc:1048] T 675795627b9b4542805157dd7ec531cd P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:54.259855  9347 raft_consensus.cc:493] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.260401  9347 raft_consensus.cc:515] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:54.262274  9347 leader_election.cc:290] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:54.262884  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45613c5d357b40b8af0ced6c8725c559" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:54.263283  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45613c5d357b40b8af0ced6c8725c559" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:54.263583  8841 raft_consensus.cc:2468] T 45613c5d357b40b8af0ced6c8725c559 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 1.
I20260709 13:16:54.263969  8915 raft_consensus.cc:2468] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 1.
I20260709 13:16:54.264603  8734 leader_election.cc:304] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6, 895d3c58761f427c9c5b3cb41246c243; no voters: 
I20260709 13:16:54.265379  9347 raft_consensus.cc:2804] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:54.265784  9347 raft_consensus.cc:493] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.266072  9347 raft_consensus.cc:3060] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:54.273838  9347 raft_consensus.cc:515] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:54.276533  9347 leader_election.cc:290] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 election: Requested vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:54.276836  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45613c5d357b40b8af0ced6c8725c559" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
I20260709 13:16:54.276932  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45613c5d357b40b8af0ced6c8725c559" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:16:54.277433  8841 raft_consensus.cc:3060] T 45613c5d357b40b8af0ced6c8725c559 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:54.277603  8915 raft_consensus.cc:3060] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:54.289659  8915 raft_consensus.cc:2468] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 2.
I20260709 13:16:54.292233  8736 leader_election.cc:304] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243; no voters: 
I20260709 13:16:54.293054  9347 raft_consensus.cc:2804] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:54.293524  9347 raft_consensus.cc:697] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243 [term 2 LEADER]: Becoming Leader. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Running, Role: LEADER
I20260709 13:16:54.294353  9347 consensus_queue.cc:237] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:54.295954  8841 raft_consensus.cc:2468] T 45613c5d357b40b8af0ced6c8725c559 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 2.
I20260709 13:16:54.304075  8668 catalog_manager.cc:5697] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243 reported cstate change: term changed from 0 to 2, leader changed from <none> to 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193). New cstate: current_term: 2 leader_uuid: "895d3c58761f427c9c5b3cb41246c243" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:54.767668  8915 raft_consensus.cc:1275] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Refusing update from remote peer 895d3c58761f427c9c5b3cb41246c243: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:16:54.769084  9447 consensus_queue.cc:1048] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:54.785916  8840 raft_consensus.cc:1275] T 45613c5d357b40b8af0ced6c8725c559 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Refusing update from remote peer 895d3c58761f427c9c5b3cb41246c243: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:16:54.787262  9347 consensus_queue.cc:1048] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:55.031894  2843 tablet_server.cc:179] TabletServer@127.2.198.193:0 shutting down...
W20260709 13:16:55.035627  8958 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20260709 13:16:55.046844  8958 consensus_peers.cc:597] T 448f6ffb482841a3b489476becf2f851 P e8bb7e1240f44fda8b83e4c124852032 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:55.059772  8958 consensus_peers.cc:597] T 8a25176ebf484df29f67908cfa6e2b48 P e8bb7e1240f44fda8b83e4c124852032 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:55.065938  8958 consensus_peers.cc:597] T 1521cafcc31b47c58829494618fc0cd8 P e8bb7e1240f44fda8b83e4c124852032 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:55.079687  8958 consensus_peers.cc:597] T 5a26acd2175646e3a53b493571852af4 P e8bb7e1240f44fda8b83e4c124852032 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:55.103008  8810 consensus_peers.cc:597] T 675795627b9b4542805157dd7ec531cd P 7d3072f2af0b481d94ed70632b90e8c6 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:55.103672  8810 consensus_peers.cc:597] T 4e1e1e84d68946d682e0944fbd3c51a8 P 7d3072f2af0b481d94ed70632b90e8c6 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:55.104192  8884 consensus_peers.cc:597] T d09ffcae84334482a706af1e812c7c9d P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:55.104911  8884 consensus_peers.cc:597] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:55.108994  8884 consensus_peers.cc:597] T 7bcde3fdb9314ca4b3422d395a673be5 P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:55.117690  2843 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:55.118557  2843 tablet_replica.cc:333] T 45d9eb22dee8411b82eb768686e34604 P 895d3c58761f427c9c5b3cb41246c243: stopping tablet replica
I20260709 13:16:55.119253  2843 raft_consensus.cc:2243] T 45d9eb22dee8411b82eb768686e34604 P 895d3c58761f427c9c5b3cb41246c243 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:55.120168  2843 raft_consensus.cc:2272] T 45d9eb22dee8411b82eb768686e34604 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.123044  2843 tablet_replica.cc:333] T 675795627b9b4542805157dd7ec531cd P 895d3c58761f427c9c5b3cb41246c243: stopping tablet replica
I20260709 13:16:55.123824  2843 raft_consensus.cc:2243] T 675795627b9b4542805157dd7ec531cd P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.124303  2843 raft_consensus.cc:2272] T 675795627b9b4542805157dd7ec531cd P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.127136  2843 tablet_replica.cc:333] T 9fdcbb0a74a64826ab0665c349b16200 P 895d3c58761f427c9c5b3cb41246c243: stopping tablet replica
I20260709 13:16:55.127923  2843 raft_consensus.cc:2243] T 9fdcbb0a74a64826ab0665c349b16200 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.128404  2843 raft_consensus.cc:2272] T 9fdcbb0a74a64826ab0665c349b16200 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.130750  2843 tablet_replica.cc:333] T cc6e2639db63487cae6a125c8d5fe1d8 P 895d3c58761f427c9c5b3cb41246c243: stopping tablet replica
I20260709 13:16:55.131435  2843 raft_consensus.cc:2243] T cc6e2639db63487cae6a125c8d5fe1d8 P 895d3c58761f427c9c5b3cb41246c243 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:55.132359  2843 raft_consensus.cc:2272] T cc6e2639db63487cae6a125c8d5fe1d8 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.134733  2843 tablet_replica.cc:333] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 895d3c58761f427c9c5b3cb41246c243: stopping tablet replica
I20260709 13:16:55.135643  2843 raft_consensus.cc:2243] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.136091  2843 raft_consensus.cc:2272] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.138693  2843 tablet_replica.cc:333] T 852f0ef4508245e2812b76665a70bbf8 P 895d3c58761f427c9c5b3cb41246c243: stopping tablet replica
I20260709 13:16:55.139581  2843 raft_consensus.cc:2243] T 852f0ef4508245e2812b76665a70bbf8 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.140168  2843 raft_consensus.cc:2272] T 852f0ef4508245e2812b76665a70bbf8 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.143599  2843 tablet_replica.cc:333] T d09ffcae84334482a706af1e812c7c9d P 895d3c58761f427c9c5b3cb41246c243: stopping tablet replica
I20260709 13:16:55.144635  2843 raft_consensus.cc:2243] T d09ffcae84334482a706af1e812c7c9d P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.145112  2843 raft_consensus.cc:2272] T d09ffcae84334482a706af1e812c7c9d P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:55.146297  8958 consensus_peers.cc:597] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:55.147825  2843 tablet_replica.cc:333] T 2945a5b174e14a5a9052897942f876c2 P 895d3c58761f427c9c5b3cb41246c243: stopping tablet replica
I20260709 13:16:55.148687  2843 raft_consensus.cc:2243] T 2945a5b174e14a5a9052897942f876c2 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.149281  2843 raft_consensus.cc:2272] T 2945a5b174e14a5a9052897942f876c2 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.152189  2843 tablet_replica.cc:333] T f3ea64f4f4c54500a95692118660d9b4 P 895d3c58761f427c9c5b3cb41246c243: stopping tablet replica
I20260709 13:16:55.152858  2843 raft_consensus.cc:2243] T f3ea64f4f4c54500a95692118660d9b4 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.153301  2843 raft_consensus.cc:2272] T f3ea64f4f4c54500a95692118660d9b4 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.156232  2843 tablet_replica.cc:333] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 895d3c58761f427c9c5b3cb41246c243: stopping tablet replica
I20260709 13:16:55.156951  2843 raft_consensus.cc:2243] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.157388  2843 raft_consensus.cc:2272] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.160112  2843 tablet_replica.cc:333] T 1521cafcc31b47c58829494618fc0cd8 P 895d3c58761f427c9c5b3cb41246c243: stopping tablet replica
I20260709 13:16:55.160748  2843 raft_consensus.cc:2243] T 1521cafcc31b47c58829494618fc0cd8 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.161336  2843 raft_consensus.cc:2272] T 1521cafcc31b47c58829494618fc0cd8 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.164214  2843 tablet_replica.cc:333] T 80fde6a0b6334446923248a50e223397 P 895d3c58761f427c9c5b3cb41246c243: stopping tablet replica
I20260709 13:16:55.164851  2843 raft_consensus.cc:2243] T 80fde6a0b6334446923248a50e223397 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.165331  2843 raft_consensus.cc:2272] T 80fde6a0b6334446923248a50e223397 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.167464  2843 tablet_replica.cc:333] T 097c705b65de4abe884afdb1fcaaa054 P 895d3c58761f427c9c5b3cb41246c243: stopping tablet replica
I20260709 13:16:55.168113  2843 raft_consensus.cc:2243] T 097c705b65de4abe884afdb1fcaaa054 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.168720  2843 raft_consensus.cc:2272] T 097c705b65de4abe884afdb1fcaaa054 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.172613  2843 tablet_replica.cc:333] T dde08046aca642488918d1f2b978c126 P 895d3c58761f427c9c5b3cb41246c243: stopping tablet replica
I20260709 13:16:55.173408  2843 raft_consensus.cc:2243] T dde08046aca642488918d1f2b978c126 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.173846  2843 raft_consensus.cc:2272] T dde08046aca642488918d1f2b978c126 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.176118  2843 tablet_replica.cc:333] T 9f7eec107ecc40f38d14871d9227b25f P 895d3c58761f427c9c5b3cb41246c243: stopping tablet replica
I20260709 13:16:55.176703  2843 raft_consensus.cc:2243] T 9f7eec107ecc40f38d14871d9227b25f P 895d3c58761f427c9c5b3cb41246c243 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:55.177480  2843 raft_consensus.cc:2272] T 9f7eec107ecc40f38d14871d9227b25f P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.179529  2843 tablet_replica.cc:333] T ab679ea0af724bd39f753eb407c73264 P 895d3c58761f427c9c5b3cb41246c243: stopping tablet replica
I20260709 13:16:55.180258  2843 raft_consensus.cc:2243] T ab679ea0af724bd39f753eb407c73264 P 895d3c58761f427c9c5b3cb41246c243 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:55.181330  2843 raft_consensus.cc:2272] T ab679ea0af724bd39f753eb407c73264 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.183282  2843 tablet_replica.cc:333] T 4352fad232ab47588683e51cf4b62080 P 895d3c58761f427c9c5b3cb41246c243: stopping tablet replica
I20260709 13:16:55.183930  2843 raft_consensus.cc:2243] T 4352fad232ab47588683e51cf4b62080 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.184346  2843 raft_consensus.cc:2272] T 4352fad232ab47588683e51cf4b62080 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.186582  2843 tablet_replica.cc:333] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243: stopping tablet replica
I20260709 13:16:55.187175  2843 raft_consensus.cc:2243] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:55.187985  2843 raft_consensus.cc:2272] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.189718  2843 tablet_replica.cc:333] T 5a26acd2175646e3a53b493571852af4 P 895d3c58761f427c9c5b3cb41246c243: stopping tablet replica
I20260709 13:16:55.190263  2843 raft_consensus.cc:2243] T 5a26acd2175646e3a53b493571852af4 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.190629  2843 raft_consensus.cc:2272] T 5a26acd2175646e3a53b493571852af4 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.193037  2843 tablet_replica.cc:333] T ed4d847e589942fcbf6dadbb578327f2 P 895d3c58761f427c9c5b3cb41246c243: stopping tablet replica
I20260709 13:16:55.193837  2843 raft_consensus.cc:2243] T ed4d847e589942fcbf6dadbb578327f2 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.194459  2843 raft_consensus.cc:2272] T ed4d847e589942fcbf6dadbb578327f2 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.197160  2843 tablet_replica.cc:333] T f80d602267cf421690d5fe6d3922e0cb P 895d3c58761f427c9c5b3cb41246c243: stopping tablet replica
I20260709 13:16:55.197933  2843 raft_consensus.cc:2243] T f80d602267cf421690d5fe6d3922e0cb P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.198515  2843 raft_consensus.cc:2272] T f80d602267cf421690d5fe6d3922e0cb P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:55.199549  8884 consensus_peers.cc:597] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:55.201025  2843 tablet_replica.cc:333] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243: stopping tablet replica
I20260709 13:16:55.201766  2843 raft_consensus.cc:2243] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:55.202677  2843 raft_consensus.cc:2272] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.205054  2843 tablet_replica.cc:333] T 8a25176ebf484df29f67908cfa6e2b48 P 895d3c58761f427c9c5b3cb41246c243: stopping tablet replica
I20260709 13:16:55.205660  2843 raft_consensus.cc:2243] T 8a25176ebf484df29f67908cfa6e2b48 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.206286  2843 raft_consensus.cc:2272] T 8a25176ebf484df29f67908cfa6e2b48 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.209019  2843 tablet_replica.cc:333] T f3abbeb71eba411bb6dfec800d3bd9c0 P 895d3c58761f427c9c5b3cb41246c243: stopping tablet replica
I20260709 13:16:55.209903  2843 raft_consensus.cc:2243] T f3abbeb71eba411bb6dfec800d3bd9c0 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:16:55.209915  8958 consensus_peers.cc:597] T 852f0ef4508245e2812b76665a70bbf8 P e8bb7e1240f44fda8b83e4c124852032 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:55.210537  2843 raft_consensus.cc:2272] T f3abbeb71eba411bb6dfec800d3bd9c0 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.213289  2843 tablet_replica.cc:333] T 390c483b2a1c42b897e166b1a381851c P 895d3c58761f427c9c5b3cb41246c243: stopping tablet replica
I20260709 13:16:55.214183  2843 raft_consensus.cc:2243] T 390c483b2a1c42b897e166b1a381851c P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.214701  2843 raft_consensus.cc:2272] T 390c483b2a1c42b897e166b1a381851c P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:55.214756  8884 consensus_peers.cc:597] T 80fde6a0b6334446923248a50e223397 P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:55.217131  2843 tablet_replica.cc:333] T 932e5cbccd33414f8b05280505fd8bc7 P 895d3c58761f427c9c5b3cb41246c243: stopping tablet replica
I20260709 13:16:55.217782  2843 raft_consensus.cc:2243] T 932e5cbccd33414f8b05280505fd8bc7 P 895d3c58761f427c9c5b3cb41246c243 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:55.218719  2843 raft_consensus.cc:2272] T 932e5cbccd33414f8b05280505fd8bc7 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.221402  2843 tablet_replica.cc:333] T 448f6ffb482841a3b489476becf2f851 P 895d3c58761f427c9c5b3cb41246c243: stopping tablet replica
I20260709 13:16:55.222388  2843 raft_consensus.cc:2243] T 448f6ffb482841a3b489476becf2f851 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.222832  2843 raft_consensus.cc:2272] T 448f6ffb482841a3b489476becf2f851 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.225060  2843 tablet_replica.cc:333] T d46902173b5c4283b315c6def6f13c31 P 895d3c58761f427c9c5b3cb41246c243: stopping tablet replica
I20260709 13:16:55.225675  2843 raft_consensus.cc:2243] T d46902173b5c4283b315c6def6f13c31 P 895d3c58761f427c9c5b3cb41246c243 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:55.226600  2843 raft_consensus.cc:2272] T d46902173b5c4283b315c6def6f13c31 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.228883  2843 tablet_replica.cc:333] T 68650af2b1894208a4cc0a1c6ddf880b P 895d3c58761f427c9c5b3cb41246c243: stopping tablet replica
I20260709 13:16:55.229578  2843 raft_consensus.cc:2243] T 68650af2b1894208a4cc0a1c6ddf880b P 895d3c58761f427c9c5b3cb41246c243 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:55.230389  2843 raft_consensus.cc:2272] T 68650af2b1894208a4cc0a1c6ddf880b P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.232609  2843 tablet_replica.cc:333] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243: stopping tablet replica
I20260709 13:16:55.233263  2843 raft_consensus.cc:2243] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:55.234222  2843 raft_consensus.cc:2272] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.237000  2843 tablet_replica.cc:333] T 7bcde3fdb9314ca4b3422d395a673be5 P 895d3c58761f427c9c5b3cb41246c243: stopping tablet replica
I20260709 13:16:55.237813  2843 raft_consensus.cc:2243] T 7bcde3fdb9314ca4b3422d395a673be5 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.238329  2843 raft_consensus.cc:2272] T 7bcde3fdb9314ca4b3422d395a673be5 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.240972  2843 tablet_replica.cc:333] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243: stopping tablet replica
I20260709 13:16:55.241860  2843 raft_consensus.cc:2243] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:55.242921  2843 raft_consensus.cc:2272] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.245750  2843 tablet_replica.cc:333] T 4e1e1e84d68946d682e0944fbd3c51a8 P 895d3c58761f427c9c5b3cb41246c243: stopping tablet replica
I20260709 13:16:55.246371  2843 raft_consensus.cc:2243] T 4e1e1e84d68946d682e0944fbd3c51a8 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.246838  2843 raft_consensus.cc:2272] T 4e1e1e84d68946d682e0944fbd3c51a8 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.249545  2843 tablet_replica.cc:333] T 17e47826fe4e4662baba1d095c341c1b P 895d3c58761f427c9c5b3cb41246c243: stopping tablet replica
I20260709 13:16:55.250106  2843 raft_consensus.cc:2243] T 17e47826fe4e4662baba1d095c341c1b P 895d3c58761f427c9c5b3cb41246c243 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:55.250931  2843 raft_consensus.cc:2272] T 17e47826fe4e4662baba1d095c341c1b P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.252954  2843 tablet_replica.cc:333] T c17f01b356e04590838cc6e6bb27bf64 P 895d3c58761f427c9c5b3cb41246c243: stopping tablet replica
I20260709 13:16:55.253530  2843 raft_consensus.cc:2243] T c17f01b356e04590838cc6e6bb27bf64 P 895d3c58761f427c9c5b3cb41246c243 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.253968  2843 raft_consensus.cc:2272] T c17f01b356e04590838cc6e6bb27bf64 P 895d3c58761f427c9c5b3cb41246c243 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.256353  2843 tablet_replica.cc:333] T 825ea78cebec4b10a2f8d03b45d929fa P 895d3c58761f427c9c5b3cb41246c243: stopping tablet replica
I20260709 13:16:55.257104  2843 raft_consensus.cc:2243] T 825ea78cebec4b10a2f8d03b45d929fa P 895d3c58761f427c9c5b3cb41246c243 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:55.258263  2843 raft_consensus.cc:2272] T 825ea78cebec4b10a2f8d03b45d929fa P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:55.259320  8884 consensus_peers.cc:597] T 9fdcbb0a74a64826ab0665c349b16200 P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:55.261163  2843 tablet_replica.cc:333] T 69e5f8bfdb5a46808e713e051a38866d P 895d3c58761f427c9c5b3cb41246c243: stopping tablet replica
I20260709 13:16:55.261960  2843 raft_consensus.cc:2243] T 69e5f8bfdb5a46808e713e051a38866d P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.262465  2843 raft_consensus.cc:2272] T 69e5f8bfdb5a46808e713e051a38866d P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.265199  2843 tablet_replica.cc:333] T f46053ed2641458a87c97152e4979c35 P 895d3c58761f427c9c5b3cb41246c243: stopping tablet replica
I20260709 13:16:55.265957  2843 raft_consensus.cc:2243] T f46053ed2641458a87c97152e4979c35 P 895d3c58761f427c9c5b3cb41246c243 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:55.267037  2843 raft_consensus.cc:2272] T f46053ed2641458a87c97152e4979c35 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.270273  2843 tablet_replica.cc:333] T 3f0c32d9abf04206a6f08210b3a30794 P 895d3c58761f427c9c5b3cb41246c243: stopping tablet replica
I20260709 13:16:55.271039  2843 raft_consensus.cc:2243] T 3f0c32d9abf04206a6f08210b3a30794 P 895d3c58761f427c9c5b3cb41246c243 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:55.272204  2843 raft_consensus.cc:2272] T 3f0c32d9abf04206a6f08210b3a30794 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.275341  2843 tablet_replica.cc:333] T 1c9bb56a39d44b71b44c334e0bea59a5 P 895d3c58761f427c9c5b3cb41246c243: stopping tablet replica
I20260709 13:16:55.276120  2843 raft_consensus.cc:2243] T 1c9bb56a39d44b71b44c334e0bea59a5 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.276664  2843 raft_consensus.cc:2272] T 1c9bb56a39d44b71b44c334e0bea59a5 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.279489  2843 tablet_replica.cc:333] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 895d3c58761f427c9c5b3cb41246c243: stopping tablet replica
I20260709 13:16:55.280267  2843 raft_consensus.cc:2243] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.280808  2843 raft_consensus.cc:2272] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.283149  2843 tablet_replica.cc:333] T ef723f9c640849d3890c61c07ffd0378 P 895d3c58761f427c9c5b3cb41246c243: stopping tablet replica
I20260709 13:16:55.283811  2843 raft_consensus.cc:2243] T ef723f9c640849d3890c61c07ffd0378 P 895d3c58761f427c9c5b3cb41246c243 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:55.284950  2843 raft_consensus.cc:2272] T ef723f9c640849d3890c61c07ffd0378 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.287447  2843 tablet_replica.cc:333] T ae1fc430ae3d4315aad2c0eed2f026aa P 895d3c58761f427c9c5b3cb41246c243: stopping tablet replica
W20260709 13:16:55.287783  8810 consensus_peers.cc:597] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 7d3072f2af0b481d94ed70632b90e8c6 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:55.288163  2843 raft_consensus.cc:2243] T ae1fc430ae3d4315aad2c0eed2f026aa P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.288836  2843 raft_consensus.cc:2272] T ae1fc430ae3d4315aad2c0eed2f026aa P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:55.291983  2843 tablet_replica.cc:333] T 574915613e8a4d3481aef27d3a977caa P 895d3c58761f427c9c5b3cb41246c243: stopping tablet replica
I20260709 13:16:55.292660  2843 raft_consensus.cc:2243] T 574915613e8a4d3481aef27d3a977caa P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:55.293262  2843 raft_consensus.cc:2272] T 574915613e8a4d3481aef27d3a977caa P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:55.293972  8884 consensus_peers.cc:597] T ae1fc430ae3d4315aad2c0eed2f026aa P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:55.296226  2843 tablet_replica.cc:333] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243: stopping tablet replica
I20260709 13:16:55.297047  2843 raft_consensus.cc:2243] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:55.298166  2843 raft_consensus.cc:2272] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:55.298420  8810 consensus_peers.cc:597] T f3ea64f4f4c54500a95692118660d9b4 P 7d3072f2af0b481d94ed70632b90e8c6 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:55.302771  8884 consensus_peers.cc:597] T dde08046aca642488918d1f2b978c126 P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:55.304381  8884 consensus_peers.cc:597] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:55.327459  8884 consensus_peers.cc:597] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:55.352159  8810 consensus_peers.cc:597] T 390c483b2a1c42b897e166b1a381851c P 7d3072f2af0b481d94ed70632b90e8c6 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:55.376261  2843 tablet_server.cc:196] TabletServer@127.2.198.193:0 shutdown complete.
W20260709 13:16:55.413537  8884 consensus_peers.cc:597] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:55.426268  8884 consensus_peers.cc:597] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:55.435218  8958 consensus_peers.cc:597] T ed4d847e589942fcbf6dadbb578327f2 P e8bb7e1240f44fda8b83e4c124852032 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:55.467641  8958 consensus_peers.cc:597] T 2945a5b174e14a5a9052897942f876c2 P e8bb7e1240f44fda8b83e4c124852032 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:55.468828  2843 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:55.479077  8810 consensus_peers.cc:597] T f3abbeb71eba411bb6dfec800d3bd9c0 P 7d3072f2af0b481d94ed70632b90e8c6 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:55.480445  9540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:55.480475  9539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:55.484493  9542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:55.486960  2843 server_base.cc:1061] running on GCE node
W20260709 13:16:55.492545  8884 consensus_peers.cc:597] T f80d602267cf421690d5fe6d3922e0cb P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:55.493175  2843 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:55.493535  2843 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:55.493750  2843 hybrid_clock.cc:648] HybridClock initialized: now 1783603015493732 us; error 0 us; skew 500 ppm
I20260709 13:16:55.494392  2843 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:55.497373  2843 webserver.cc:533] Webserver started at http://127.2.198.193:33957/ using document root <none> and password file <none>
I20260709 13:16:55.497923  2843 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:55.498143  2843 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:16:55.512425  2843 fs_manager.cc:714] Time spent opening directory manager: real 0.013s	user 0.006s	sys 0.008s
I20260709 13:16:55.525138  9551 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:55.526206  2843 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.005s	sys 0.000s
I20260709 13:16:55.526643  2843 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602804652623-2843-0/minicluster-data/ts-0-root
uuid: "895d3c58761f427c9c5b3cb41246c243"
format_stamp: "Formatted at 2026-07-09 13:16:42 on dist-test-slave-fc6v"
I20260709 13:16:55.527166  2843 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602804652623-2843-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602804652623-2843-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602804652623-2843-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:55.555881  2843 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
W20260709 13:16:55.556020  8958 consensus_peers.cc:597] T 69e5f8bfdb5a46808e713e051a38866d P e8bb7e1240f44fda8b83e4c124852032 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:55.557936  2843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:55.560491  2843 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:55.567018  9558 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 13:16:55.887449  2843 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:16:55.887943  2843 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.322s	user 0.010s	sys 0.001s
I20260709 13:16:55.888278  2843 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:16:55.894513  9558 tablet_bootstrap.cc:492] T c17f01b356e04590838cc6e6bb27bf64 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:55.932384  9558 tablet_bootstrap.cc:492] T c17f01b356e04590838cc6e6bb27bf64 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:55.933529  9558 tablet_bootstrap.cc:492] T c17f01b356e04590838cc6e6bb27bf64 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap complete.
I20260709 13:16:55.934216  9558 ts_tablet_manager.cc:1403] T c17f01b356e04590838cc6e6bb27bf64 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.040s	user 0.024s	sys 0.004s
I20260709 13:16:55.937047  9558 raft_consensus.cc:359] T c17f01b356e04590838cc6e6bb27bf64 P 895d3c58761f427c9c5b3cb41246c243 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:55.937736  9558 raft_consensus.cc:740] T c17f01b356e04590838cc6e6bb27bf64 P 895d3c58761f427c9c5b3cb41246c243 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.938563  9558 consensus_queue.cc:260] T c17f01b356e04590838cc6e6bb27bf64 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:55.943210  9558 ts_tablet_manager.cc:1434] T c17f01b356e04590838cc6e6bb27bf64 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 13:16:55.944958  9558 tablet_bootstrap.cc:492] T 852f0ef4508245e2812b76665a70bbf8 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:55.959313  9558 tablet_bootstrap.cc:492] T 852f0ef4508245e2812b76665a70bbf8 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:55.960193  9558 tablet_bootstrap.cc:492] T 852f0ef4508245e2812b76665a70bbf8 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap complete.
I20260709 13:16:55.960855  9558 ts_tablet_manager.cc:1403] T 852f0ef4508245e2812b76665a70bbf8 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.016s	user 0.006s	sys 0.007s
I20260709 13:16:55.963294  9558 raft_consensus.cc:359] T 852f0ef4508245e2812b76665a70bbf8 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:55.964068  9558 raft_consensus.cc:740] T 852f0ef4508245e2812b76665a70bbf8 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.964815  9558 consensus_queue.cc:260] T 852f0ef4508245e2812b76665a70bbf8 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:55.966812  9558 ts_tablet_manager.cc:1434] T 852f0ef4508245e2812b76665a70bbf8 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:16:55.967701  9558 tablet_bootstrap.cc:492] T 80fde6a0b6334446923248a50e223397 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:55.985826  9558 tablet_bootstrap.cc:492] T 80fde6a0b6334446923248a50e223397 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:55.986879  9558 tablet_bootstrap.cc:492] T 80fde6a0b6334446923248a50e223397 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap complete.
I20260709 13:16:55.987560  9558 ts_tablet_manager.cc:1403] T 80fde6a0b6334446923248a50e223397 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.004s
I20260709 13:16:55.990278  9558 raft_consensus.cc:359] T 80fde6a0b6334446923248a50e223397 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:55.991022  9558 raft_consensus.cc:740] T 80fde6a0b6334446923248a50e223397 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.991720  9558 consensus_queue.cc:260] T 80fde6a0b6334446923248a50e223397 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:55.993727  9558 ts_tablet_manager.cc:1434] T 80fde6a0b6334446923248a50e223397 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:16:55.996557  9558 tablet_bootstrap.cc:492] T cc6e2639db63487cae6a125c8d5fe1d8 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:56.020977  9558 tablet_bootstrap.cc:492] T cc6e2639db63487cae6a125c8d5fe1d8 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:56.021798  9558 tablet_bootstrap.cc:492] T cc6e2639db63487cae6a125c8d5fe1d8 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap complete.
I20260709 13:16:56.022468  9558 ts_tablet_manager.cc:1403] T cc6e2639db63487cae6a125c8d5fe1d8 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.004s
I20260709 13:16:56.025285  9558 raft_consensus.cc:359] T cc6e2639db63487cae6a125c8d5fe1d8 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:56.025842  9558 raft_consensus.cc:740] T cc6e2639db63487cae6a125c8d5fe1d8 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.026448  9558 consensus_queue.cc:260] T cc6e2639db63487cae6a125c8d5fe1d8 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:56.027984  9558 ts_tablet_manager.cc:1434] T cc6e2639db63487cae6a125c8d5fe1d8 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:16:56.028764  9558 tablet_bootstrap.cc:492] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:56.043128  9558 tablet_bootstrap.cc:492] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:56.044142  9558 tablet_bootstrap.cc:492] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap complete.
I20260709 13:16:56.044886  9558 ts_tablet_manager.cc:1403] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 13:16:56.047489  9558 raft_consensus.cc:359] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:56.048213  9558 raft_consensus.cc:740] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.048840  9558 consensus_queue.cc:260] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:56.050743  9558 ts_tablet_manager.cc:1434] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:16:56.051529  9558 tablet_bootstrap.cc:492] T 932e5cbccd33414f8b05280505fd8bc7 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:56.077646  9558 tablet_bootstrap.cc:492] T 932e5cbccd33414f8b05280505fd8bc7 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:56.078799  9558 tablet_bootstrap.cc:492] T 932e5cbccd33414f8b05280505fd8bc7 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap complete.
I20260709 13:16:56.079566  9558 ts_tablet_manager.cc:1403] T 932e5cbccd33414f8b05280505fd8bc7 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.004s
I20260709 13:16:56.082325  9558 raft_consensus.cc:359] T 932e5cbccd33414f8b05280505fd8bc7 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:56.083060  9558 raft_consensus.cc:740] T 932e5cbccd33414f8b05280505fd8bc7 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.083796  9558 consensus_queue.cc:260] T 932e5cbccd33414f8b05280505fd8bc7 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:56.085954  9558 ts_tablet_manager.cc:1434] T 932e5cbccd33414f8b05280505fd8bc7 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.004s
I20260709 13:16:56.086804  9558 tablet_bootstrap.cc:492] T ae1fc430ae3d4315aad2c0eed2f026aa P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:56.101872  9558 tablet_bootstrap.cc:492] T ae1fc430ae3d4315aad2c0eed2f026aa P 895d3c58761f427c9c5b3cb41246c243: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:56.102679  9558 tablet_bootstrap.cc:492] T ae1fc430ae3d4315aad2c0eed2f026aa P 895d3c58761f427c9c5b3cb41246c243: Bootstrap complete.
I20260709 13:16:56.103219  9558 ts_tablet_manager.cc:1403] T ae1fc430ae3d4315aad2c0eed2f026aa P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.000s
I20260709 13:16:56.105208  9558 raft_consensus.cc:359] T ae1fc430ae3d4315aad2c0eed2f026aa P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:56.105858  9558 raft_consensus.cc:740] T ae1fc430ae3d4315aad2c0eed2f026aa P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.106470  9558 consensus_queue.cc:260] T ae1fc430ae3d4315aad2c0eed2f026aa P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:56.107990  9558 ts_tablet_manager.cc:1434] T ae1fc430ae3d4315aad2c0eed2f026aa P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:16:56.108614  9558 tablet_bootstrap.cc:492] T 9f7eec107ecc40f38d14871d9227b25f P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:56.120821  9558 tablet_bootstrap.cc:492] T 9f7eec107ecc40f38d14871d9227b25f P 895d3c58761f427c9c5b3cb41246c243: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:56.121605  9558 tablet_bootstrap.cc:492] T 9f7eec107ecc40f38d14871d9227b25f P 895d3c58761f427c9c5b3cb41246c243: Bootstrap complete.
I20260709 13:16:56.122170  9558 ts_tablet_manager.cc:1403] T 9f7eec107ecc40f38d14871d9227b25f P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.014s	user 0.007s	sys 0.004s
I20260709 13:16:56.124490  9558 raft_consensus.cc:359] T 9f7eec107ecc40f38d14871d9227b25f P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:56.125118  9558 raft_consensus.cc:740] T 9f7eec107ecc40f38d14871d9227b25f P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.125790  9558 consensus_queue.cc:260] T 9f7eec107ecc40f38d14871d9227b25f P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:56.127447  9558 ts_tablet_manager.cc:1434] T 9f7eec107ecc40f38d14871d9227b25f P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:16:56.128162  9558 tablet_bootstrap.cc:492] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:56.140331  9558 tablet_bootstrap.cc:492] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:56.140870  2843 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:16:56.141261  9558 tablet_bootstrap.cc:492] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap complete.
I20260709 13:16:56.141284  2843 ts_tablet_manager.cc:595] Time spent register tablets: real 0.253s	user 0.230s	sys 0.003s
I20260709 13:16:56.142107  9558 ts_tablet_manager.cc:1403] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 13:16:56.145349  9558 raft_consensus.cc:359] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:56.146104  9558 raft_consensus.cc:740] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.146929  9558 consensus_queue.cc:260] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:56.149377  9558 ts_tablet_manager.cc:1434] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:16:56.150244  9558 tablet_bootstrap.cc:492] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:56.161181  9225 raft_consensus.cc:493] T cc6e2639db63487cae6a125c8d5fe1d8 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:16:56.161834  9225 raft_consensus.cc:515] T cc6e2639db63487cae6a125c8d5fe1d8 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:56.163833  9225 leader_election.cc:290] T cc6e2639db63487cae6a125c8d5fe1d8 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:56.168196  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc6e2639db63487cae6a125c8d5fe1d8" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
W20260709 13:16:56.171064  8884 leader_election.cc:336] T cc6e2639db63487cae6a125c8d5fe1d8 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:16:56.171563  8884 leader_election.cc:304] T cc6e2639db63487cae6a125c8d5fe1d8 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12; no voters: 7d3072f2af0b481d94ed70632b90e8c6, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:56.172930  9225 raft_consensus.cc:2749] T cc6e2639db63487cae6a125c8d5fe1d8 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:56.180544  9558 tablet_bootstrap.cc:492] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:56.181703  9558 tablet_bootstrap.cc:492] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap complete.
I20260709 13:16:56.182449  9558 ts_tablet_manager.cc:1403] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.011s
I20260709 13:16:56.185367  9558 raft_consensus.cc:359] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:56.186069  9558 raft_consensus.cc:740] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.186746  9558 consensus_queue.cc:260] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:56.189023  9558 ts_tablet_manager.cc:1434] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:16:56.190114  9558 tablet_bootstrap.cc:492] T f80d602267cf421690d5fe6d3922e0cb P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:56.205349  9227 raft_consensus.cc:493] T 1d5284f5b067413e9fc2a383cc318735 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:16:56.206223  9227 raft_consensus.cc:515] T 1d5284f5b067413e9fc2a383cc318735 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:56.210012  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5284f5b067413e9fc2a383cc318735" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:56.214154  9558 tablet_bootstrap.cc:492] T f80d602267cf421690d5fe6d3922e0cb P 895d3c58761f427c9c5b3cb41246c243: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:56.215397  9558 tablet_bootstrap.cc:492] T f80d602267cf421690d5fe6d3922e0cb P 895d3c58761f427c9c5b3cb41246c243: Bootstrap complete.
I20260709 13:16:56.216200  9558 ts_tablet_manager.cc:1403] T f80d602267cf421690d5fe6d3922e0cb P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.026s	user 0.020s	sys 0.004s
I20260709 13:16:56.217576  9559 raft_consensus.cc:493] T 45d9eb22dee8411b82eb768686e34604 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:16:56.218178  9559 raft_consensus.cc:515] T 45d9eb22dee8411b82eb768686e34604 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:56.219269  9558 raft_consensus.cc:359] T f80d602267cf421690d5fe6d3922e0cb P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:56.220118  9558 raft_consensus.cc:740] T f80d602267cf421690d5fe6d3922e0cb P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.221236  9559 leader_election.cc:290] T 45d9eb22dee8411b82eb768686e34604 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:56.221026  9558 consensus_queue.cc:260] T f80d602267cf421690d5fe6d3922e0cb P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:56.223102  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d9eb22dee8411b82eb768686e34604" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:56.223574  9558 ts_tablet_manager.cc:1434] T f80d602267cf421690d5fe6d3922e0cb P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:16:56.224639  9558 tablet_bootstrap.cc:492] T 9fdcbb0a74a64826ab0665c349b16200 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
W20260709 13:16:56.230343  8810 leader_election.cc:336] T 1d5284f5b067413e9fc2a383cc318735 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:16:56.230865  8810 leader_election.cc:304] T 1d5284f5b067413e9fc2a383cc318735 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:56.232448  9438 raft_consensus.cc:2749] T 1d5284f5b067413e9fc2a383cc318735 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:56.234236  9227 leader_election.cc:290] T 1d5284f5b067413e9fc2a383cc318735 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:56.246883  9428 raft_consensus.cc:493] T 825ea78cebec4b10a2f8d03b45d929fa P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:16:56.265023  9428 raft_consensus.cc:515] T 825ea78cebec4b10a2f8d03b45d929fa P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:56.267635  9558 tablet_bootstrap.cc:492] T 9fdcbb0a74a64826ab0665c349b16200 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:56.268711  9558 tablet_bootstrap.cc:492] T 9fdcbb0a74a64826ab0665c349b16200 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap complete.
I20260709 13:16:56.269506  9558 ts_tablet_manager.cc:1403] T 9fdcbb0a74a64826ab0665c349b16200 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.045s	user 0.029s	sys 0.012s
I20260709 13:16:56.258098  9225 raft_consensus.cc:493] T 932e5cbccd33414f8b05280505fd8bc7 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:16:56.271672  9225 raft_consensus.cc:515] T 932e5cbccd33414f8b05280505fd8bc7 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:56.272518  9558 raft_consensus.cc:359] T 9fdcbb0a74a64826ab0665c349b16200 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
W20260709 13:16:56.273006  8958 leader_election.cc:336] T 825ea78cebec4b10a2f8d03b45d929fa P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:16:56.273322  9558 raft_consensus.cc:740] T 9fdcbb0a74a64826ab0665c349b16200 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.274266  9225 leader_election.cc:290] T 932e5cbccd33414f8b05280505fd8bc7 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:56.274112  9558 consensus_queue.cc:260] T 9fdcbb0a74a64826ab0665c349b16200 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:56.275497  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932e5cbccd33414f8b05280505fd8bc7" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:56.276186  9428 leader_election.cc:290] T 825ea78cebec4b10a2f8d03b45d929fa P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
W20260709 13:16:56.243759  8884 leader_election.cc:336] T 45d9eb22dee8411b82eb768686e34604 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:16:56.276798  9558 ts_tablet_manager.cc:1434] T 9fdcbb0a74a64826ab0665c349b16200 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:16:56.274161  9547 raft_consensus.cc:493] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:16:56.277112  8884 leader_election.cc:304] T 45d9eb22dee8411b82eb768686e34604 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12; no voters: 895d3c58761f427c9c5b3cb41246c243, e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:56.277699  9558 tablet_bootstrap.cc:492] T f3ea64f4f4c54500a95692118660d9b4 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:56.277842  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825ea78cebec4b10a2f8d03b45d929fa" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:56.278019  9547 raft_consensus.cc:515] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:56.281091  8957 leader_election.cc:304] T 825ea78cebec4b10a2f8d03b45d929fa P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bb7e1240f44fda8b83e4c124852032; no voters: 7d3072f2af0b481d94ed70632b90e8c6, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:56.283411  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1c593726564ba7ae9e8b66d1989f69" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:56.284049  8919 raft_consensus.cc:2468] T be1c593726564ba7ae9e8b66d1989f69 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 1.
I20260709 13:16:56.284662  9428 raft_consensus.cc:2749] T 825ea78cebec4b10a2f8d03b45d929fa P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:56.285331  8959 leader_election.cc:304] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:16:56.286614  9547 leader_election.cc:290] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:56.287307  9546 raft_consensus.cc:2804] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:56.294243  9225 raft_consensus.cc:2749] T 45d9eb22dee8411b82eb768686e34604 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:56.294625  9546 raft_consensus.cc:493] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:16:56.294914  9225 raft_consensus.cc:493] T be1c593726564ba7ae9e8b66d1989f69 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:16:56.295073  9546 raft_consensus.cc:3060] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:56.295418  9225 raft_consensus.cc:515] T be1c593726564ba7ae9e8b66d1989f69 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:56.300988  9225 leader_election.cc:290] T be1c593726564ba7ae9e8b66d1989f69 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:56.290457  9560 raft_consensus.cc:493] T 45613c5d357b40b8af0ced6c8725c559 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
W20260709 13:16:56.301831  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:39173, user_credentials={real_user=slave}} blocked reactor thread for 58137us
I20260709 13:16:56.302208  9560 raft_consensus.cc:515] T 45613c5d357b40b8af0ced6c8725c559 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:56.304580  9560 leader_election.cc:290] T 45613c5d357b40b8af0ced6c8725c559 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:56.305619  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45613c5d357b40b8af0ced6c8725c559" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
W20260709 13:16:56.307626  8958 leader_election.cc:336] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:16:56.312604  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1c593726564ba7ae9e8b66d1989f69" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:56.313699  9428 raft_consensus.cc:493] T ab679ea0af724bd39f753eb407c73264 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:16:56.314338  9428 raft_consensus.cc:515] T ab679ea0af724bd39f753eb407c73264 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:56.319276  9438 raft_consensus.cc:493] T ef723f9c640849d3890c61c07ffd0378 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:16:56.319964  9438 raft_consensus.cc:515] T ef723f9c640849d3890c61c07ffd0378 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:56.322257  9438 leader_election.cc:290] T ef723f9c640849d3890c61c07ffd0378 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:56.320695  9428 leader_election.cc:290] T ab679ea0af724bd39f753eb407c73264 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:56.324906  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef723f9c640849d3890c61c07ffd0378" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:56.325768  9225 raft_consensus.cc:493] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:16:56.326252  9225 raft_consensus.cc:515] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
W20260709 13:16:56.329653  8958 leader_election.cc:336] T ab679ea0af724bd39f753eb407c73264 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:16:56.329846  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5284f5b067413e9fc2a383cc318735" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:56.332743  8840 raft_consensus.cc:2468] T 1d5284f5b067413e9fc2a383cc318735 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 1.
I20260709 13:16:56.331473  9546 raft_consensus.cc:515] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:56.334434  8883 leader_election.cc:304] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6; no voters: 
I20260709 13:16:56.335505  8993 raft_consensus.cc:2393] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43c6faa9496d44dda6b6eaed09cdfd12 in current term 2: Already voted for candidate e8bb7e1240f44fda8b83e4c124852032 in this term.
I20260709 13:16:56.339743  9559 raft_consensus.cc:2804] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:56.340242  9559 raft_consensus.cc:493] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:16:56.340756  9559 raft_consensus.cc:3060] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:56.341686  9546 leader_election.cc:290] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 election: Requested vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:56.343981  9373 raft_consensus.cc:493] T 4fd6605b785643deac78902ee4fc6896 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:16:56.348984  9373 raft_consensus.cc:515] T 4fd6605b785643deac78902ee4fc6896 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:56.351258  9373 leader_election.cc:290] T 4fd6605b785643deac78902ee4fc6896 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:56.351660  9225 leader_election.cc:290] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:56.353308  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd6605b785643deac78902ee4fc6896" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
W20260709 13:16:56.347972  8958 leader_election.cc:336] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:16:56.359445  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab679ea0af724bd39f753eb407c73264" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:56.360052  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1c593726564ba7ae9e8b66d1989f69" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:16:56.360714  8918 raft_consensus.cc:3060] T be1c593726564ba7ae9e8b66d1989f69 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:56.361277  8810 leader_election.cc:336] T 45613c5d357b40b8af0ced6c8725c559 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:16:56.361799  8810 leader_election.cc:304] T 45613c5d357b40b8af0ced6c8725c559 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243
W20260709 13:16:56.363196  8884 leader_election.cc:336] T 932e5cbccd33414f8b05280505fd8bc7 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:16:56.363720  8884 leader_election.cc:304] T 932e5cbccd33414f8b05280505fd8bc7 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12; no voters: 7d3072f2af0b481d94ed70632b90e8c6, 895d3c58761f427c9c5b3cb41246c243
W20260709 13:16:56.364666  8884 leader_election.cc:336] T be1c593726564ba7ae9e8b66d1989f69 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:16:56.365059  8884 leader_election.cc:304] T be1c593726564ba7ae9e8b66d1989f69 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12; no voters: 895d3c58761f427c9c5b3cb41246c243, e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:56.365767  9560 raft_consensus.cc:2749] T 45613c5d357b40b8af0ced6c8725c559 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:16:56.369403  8810 leader_election.cc:336] T ef723f9c640849d3890c61c07ffd0378 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:16:56.369837  8810 leader_election.cc:304] T ef723f9c640849d3890c61c07ffd0378 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:56.370601  9560 raft_consensus.cc:2749] T ef723f9c640849d3890c61c07ffd0378 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:56.370286  8918 raft_consensus.cc:2468] T be1c593726564ba7ae9e8b66d1989f69 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 2.
I20260709 13:16:56.372313  8959 leader_election.cc:304] T ab679ea0af724bd39f753eb407c73264 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bb7e1240f44fda8b83e4c124852032; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:56.373595  9599 raft_consensus.cc:2749] T ab679ea0af724bd39f753eb407c73264 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:56.376565  9373 raft_consensus.cc:2749] T 932e5cbccd33414f8b05280505fd8bc7 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:56.377245  9373 raft_consensus.cc:2749] T be1c593726564ba7ae9e8b66d1989f69 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:56.378803  9559 raft_consensus.cc:515] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:56.382185  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5284f5b067413e9fc2a383cc318735" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
I20260709 13:16:56.380215  8959 leader_election.cc:304] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032; no voters: 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:56.383245  8840 raft_consensus.cc:3060] T 1d5284f5b067413e9fc2a383cc318735 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:56.384168  9546 raft_consensus.cc:2804] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:56.384871  9546 raft_consensus.cc:697] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [term 2 LEADER]: Becoming Leader. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Running, Role: LEADER
I20260709 13:16:56.386426  9373 raft_consensus.cc:493] T 17e47826fe4e4662baba1d095c341c1b P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:16:56.386981  9373 raft_consensus.cc:515] T 17e47826fe4e4662baba1d095c341c1b P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:56.387998  9428 raft_consensus.cc:493] T 65900ac9e06944639fe557200317fe05 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:16:56.388522  9428 raft_consensus.cc:515] T 65900ac9e06944639fe557200317fe05 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:56.388993  9546 consensus_queue.cc:237] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:56.390695  9428 leader_election.cc:290] T 65900ac9e06944639fe557200317fe05 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:56.391201  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e47826fe4e4662baba1d095c341c1b" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:56.391749  9373 leader_election.cc:290] T 17e47826fe4e4662baba1d095c341c1b P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:56.391976  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65900ac9e06944639fe557200317fe05" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
W20260709 13:16:56.392971  8884 leader_election.cc:336] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:16:56.381150  9559 leader_election.cc:290] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 election: Requested vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:56.394059  9558 tablet_bootstrap.cc:492] T f3ea64f4f4c54500a95692118660d9b4 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:56.395114  9558 tablet_bootstrap.cc:492] T f3ea64f4f4c54500a95692118660d9b4 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap complete.
I20260709 13:16:56.395895  9558 ts_tablet_manager.cc:1403] T f3ea64f4f4c54500a95692118660d9b4 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.118s	user 0.044s	sys 0.035s
W20260709 13:16:56.398909  8884 leader_election.cc:336] T 4fd6605b785643deac78902ee4fc6896 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:16:56.399447  8884 leader_election.cc:304] T 4fd6605b785643deac78902ee4fc6896 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12; no voters: 7d3072f2af0b481d94ed70632b90e8c6, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:56.400243  9559 raft_consensus.cc:2749] T 4fd6605b785643deac78902ee4fc6896 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:16:56.402782  8958 leader_election.cc:336] T 65900ac9e06944639fe557200317fe05 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
W20260709 13:16:56.405722  8884 leader_election.cc:336] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
W20260709 13:16:56.407604  8884 leader_election.cc:336] T 17e47826fe4e4662baba1d095c341c1b P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:16:56.408010  8884 leader_election.cc:304] T 17e47826fe4e4662baba1d095c341c1b P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12; no voters: 7d3072f2af0b481d94ed70632b90e8c6, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:56.408737  9559 raft_consensus.cc:2749] T 17e47826fe4e4662baba1d095c341c1b P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:56.409157  9558 raft_consensus.cc:359] T f3ea64f4f4c54500a95692118660d9b4 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:56.409430  8664 catalog_manager.cc:5697] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 reported cstate change: term changed from 1 to 2, leader changed from 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193) to e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196). New cstate: current_term: 2 leader_uuid: "e8bb7e1240f44fda8b83e4c124852032" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:56.410334  9558 raft_consensus.cc:740] T f3ea64f4f4c54500a95692118660d9b4 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.406670  9560 raft_consensus.cc:493] T 17e47826fe4e4662baba1d095c341c1b P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:16:56.411837  9560 raft_consensus.cc:515] T 17e47826fe4e4662baba1d095c341c1b P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:56.412298  9558 consensus_queue.cc:260] T f3ea64f4f4c54500a95692118660d9b4 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:56.415386  9558 ts_tablet_manager.cc:1434] T f3ea64f4f4c54500a95692118660d9b4 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.001s
I20260709 13:16:56.415680  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e47826fe4e4662baba1d095c341c1b" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:56.416642  9558 tablet_bootstrap.cc:492] T 390c483b2a1c42b897e166b1a381851c P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:56.416565  8918 raft_consensus.cc:2468] T 17e47826fe4e4662baba1d095c341c1b P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 1.
I20260709 13:16:56.418224  8811 leader_election.cc:304] T 17e47826fe4e4662baba1d095c341c1b P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6; no voters: 
I20260709 13:16:56.419075  9438 raft_consensus.cc:2804] T 17e47826fe4e4662baba1d095c341c1b P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:56.419216  9560 leader_election.cc:290] T 17e47826fe4e4662baba1d095c341c1b P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:56.419636  9438 raft_consensus.cc:493] T 17e47826fe4e4662baba1d095c341c1b P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:16:56.420230  9438 raft_consensus.cc:3060] T 17e47826fe4e4662baba1d095c341c1b P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:56.426350  9560 raft_consensus.cc:493] T 4fd6605b785643deac78902ee4fc6896 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:16:56.426913  9560 raft_consensus.cc:515] T 4fd6605b785643deac78902ee4fc6896 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:56.428499  8958 leader_election.cc:304] T 65900ac9e06944639fe557200317fe05 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bb7e1240f44fda8b83e4c124852032; no voters: 7d3072f2af0b481d94ed70632b90e8c6, 895d3c58761f427c9c5b3cb41246c243
W20260709 13:16:56.439280  8810 leader_election.cc:336] T 17e47826fe4e4662baba1d095c341c1b P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:16:56.442327  9560 leader_election.cc:290] T 4fd6605b785643deac78902ee4fc6896 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:56.444911  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd6605b785643deac78902ee4fc6896" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:56.445796  8918 raft_consensus.cc:2468] T 4fd6605b785643deac78902ee4fc6896 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 1.
I20260709 13:16:56.447389  8811 leader_election.cc:304] T 4fd6605b785643deac78902ee4fc6896 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6; no voters: 
I20260709 13:16:56.438897  9438 raft_consensus.cc:515] T 17e47826fe4e4662baba1d095c341c1b P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:56.448547  9560 raft_consensus.cc:2804] T 4fd6605b785643deac78902ee4fc6896 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:56.449071  9560 raft_consensus.cc:493] T 4fd6605b785643deac78902ee4fc6896 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:16:56.449563  9560 raft_consensus.cc:3060] T 4fd6605b785643deac78902ee4fc6896 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:56.450423  9559 raft_consensus.cc:493] T ef723f9c640849d3890c61c07ffd0378 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:16:56.450995  9559 raft_consensus.cc:515] T ef723f9c640849d3890c61c07ffd0378 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:56.453199  9559 leader_election.cc:290] T ef723f9c640849d3890c61c07ffd0378 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:56.453714  9227 raft_consensus.cc:493] T 3f0c32d9abf04206a6f08210b3a30794 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:16:56.454212  9227 raft_consensus.cc:515] T 3f0c32d9abf04206a6f08210b3a30794 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:56.454672  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef723f9c640849d3890c61c07ffd0378" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:56.455300  8841 raft_consensus.cc:2468] T ef723f9c640849d3890c61c07ffd0378 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 1.
I20260709 13:16:56.456314  9227 leader_election.cc:290] T 3f0c32d9abf04206a6f08210b3a30794 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:56.456437  8883 leader_election.cc:304] T ef723f9c640849d3890c61c07ffd0378 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6; no voters: 
I20260709 13:16:56.456990  9559 raft_consensus.cc:493] T d46902173b5c4283b315c6def6f13c31 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:16:56.457605  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f0c32d9abf04206a6f08210b3a30794" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:56.457523  9559 raft_consensus.cc:515] T d46902173b5c4283b315c6def6f13c31 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:56.458108  9373 raft_consensus.cc:2804] T ef723f9c640849d3890c61c07ffd0378 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:56.458560  9373 raft_consensus.cc:493] T ef723f9c640849d3890c61c07ffd0378 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:16:56.458953  9373 raft_consensus.cc:3060] T ef723f9c640849d3890c61c07ffd0378 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:56.460317  9559 leader_election.cc:290] T d46902173b5c4283b315c6def6f13c31 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:56.461514  9438 leader_election.cc:290] T 17e47826fe4e4662baba1d095c341c1b P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 election: Requested vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:56.463112  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e47826fe4e4662baba1d095c341c1b" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:16:56.463855  8918 raft_consensus.cc:3060] T 17e47826fe4e4662baba1d095c341c1b P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:56.465559  8884 leader_election.cc:336] T ef723f9c640849d3890c61c07ffd0378 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
W20260709 13:16:56.471299  8884 leader_election.cc:336] T d46902173b5c4283b315c6def6f13c31 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:16:56.472553  9559 raft_consensus.cc:493] T 9f7eec107ecc40f38d14871d9227b25f P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:16:56.473299  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46902173b5c4283b315c6def6f13c31" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:56.473583  9559 raft_consensus.cc:515] T 9f7eec107ecc40f38d14871d9227b25f P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:56.476241  9559 leader_election.cc:290] T 9f7eec107ecc40f38d14871d9227b25f P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:56.479925  8883 leader_election.cc:304] T d46902173b5c4283b315c6def6f13c31 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12; no voters: 7d3072f2af0b481d94ed70632b90e8c6, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:56.481791  9549 raft_consensus.cc:2749] T d46902173b5c4283b315c6def6f13c31 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:56.486183  9546 raft_consensus.cc:2749] T 65900ac9e06944639fe557200317fe05 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:56.486393  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7eec107ecc40f38d14871d9227b25f" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
W20260709 13:16:56.490598  8958 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:39173, user_credentials={real_user=slave}} blocked reactor thread for 87838.7us
I20260709 13:16:56.497571  8918 raft_consensus.cc:2468] T 17e47826fe4e4662baba1d095c341c1b P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 2.
I20260709 13:16:56.499923  9599 raft_consensus.cc:493] T f46053ed2641458a87c97152e4979c35 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:16:56.502569  9599 raft_consensus.cc:515] T f46053ed2641458a87c97152e4979c35 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:56.505667  9599 leader_election.cc:290] T f46053ed2641458a87c97152e4979c35 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
W20260709 13:16:56.506804  8810 leader_election.cc:336] T 4fd6605b785643deac78902ee4fc6896 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:16:56.507979  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46053ed2641458a87c97152e4979c35" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:56.510516  8811 leader_election.cc:304] T 17e47826fe4e4662baba1d095c341c1b P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6; no voters: 
I20260709 13:16:56.511662  9438 raft_consensus.cc:2804] T 17e47826fe4e4662baba1d095c341c1b P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:56.512265  9438 raft_consensus.cc:697] T 17e47826fe4e4662baba1d095c341c1b P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 LEADER]: Becoming Leader. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Running, Role: LEADER
I20260709 13:16:56.513319  9438 consensus_queue.cc:237] T 17e47826fe4e4662baba1d095c341c1b P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:56.516438  8840 raft_consensus.cc:2468] T 1d5284f5b067413e9fc2a383cc318735 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 2.
I20260709 13:16:56.519289  9549 raft_consensus.cc:493] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:16:56.520141  9549 raft_consensus.cc:515] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:56.523138  9549 leader_election.cc:290] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:56.531056  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab679ea0af724bd39f753eb407c73264" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:56.533721  8993 raft_consensus.cc:2468] T ab679ea0af724bd39f753eb407c73264 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 2.
W20260709 13:16:56.536252  8884 leader_election.cc:336] T 9f7eec107ecc40f38d14871d9227b25f P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:16:56.542578  8883 leader_election.cc:304] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6; no voters: 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:56.543762  9559 raft_consensus.cc:2804] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:56.544333  9559 raft_consensus.cc:697] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 LEADER]: Becoming Leader. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Running, Role: LEADER
I20260709 13:16:56.545264  9559 consensus_queue.cc:237] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:56.536953  8884 leader_election.cc:304] T 9f7eec107ecc40f38d14871d9227b25f P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12; no voters: 7d3072f2af0b481d94ed70632b90e8c6, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:56.554941  9549 raft_consensus.cc:2749] T 9f7eec107ecc40f38d14871d9227b25f P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:16:56.558501  8884 leader_election.cc:336] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:16:56.561609  9546 raft_consensus.cc:493] T 45d9eb22dee8411b82eb768686e34604 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:16:56.562193  9546 raft_consensus.cc:515] T 45d9eb22dee8411b82eb768686e34604 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:56.564591  9546 leader_election.cc:290] T 45d9eb22dee8411b82eb768686e34604 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:56.568611  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d9eb22dee8411b82eb768686e34604" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:56.569316  8919 raft_consensus.cc:2468] T 45d9eb22dee8411b82eb768686e34604 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 1.
I20260709 13:16:56.571830  8959 leader_election.cc:304] T 45d9eb22dee8411b82eb768686e34604 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:16:56.572611  9546 raft_consensus.cc:2804] T 45d9eb22dee8411b82eb768686e34604 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:56.572278  8667 catalog_manager.cc:5697] T 17e47826fe4e4662baba1d095c341c1b P 7d3072f2af0b481d94ed70632b90e8c6 reported cstate change: term changed from 1 to 2, leader changed from 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193) to 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194). New cstate: current_term: 2 leader_uuid: "7d3072f2af0b481d94ed70632b90e8c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:56.573012  9546 raft_consensus.cc:493] T 45d9eb22dee8411b82eb768686e34604 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:16:56.575748  9546 raft_consensus.cc:3060] T 45d9eb22dee8411b82eb768686e34604 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:56.576848  9609 raft_consensus.cc:493] T cc6e2639db63487cae6a125c8d5fe1d8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:16:56.577399  9609 raft_consensus.cc:515] T cc6e2639db63487cae6a125c8d5fe1d8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:56.501219  9373 raft_consensus.cc:515] T ef723f9c640849d3890c61c07ffd0378 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:56.579825  9609 leader_election.cc:290] T cc6e2639db63487cae6a125c8d5fe1d8 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:56.582218  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef723f9c640849d3890c61c07ffd0378" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
I20260709 13:16:56.582841  8840 raft_consensus.cc:3060] T ef723f9c640849d3890c61c07ffd0378 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:56.584919  8882 leader_election.cc:304] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032; no voters: 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:56.585843  9225 raft_consensus.cc:2804] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:56.586195  9225 raft_consensus.cc:493] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:16:56.586776  9225 raft_consensus.cc:3060] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:56.592198  8810 leader_election.cc:336] T 17e47826fe4e4662baba1d095c341c1b P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:16:56.595181  9546 raft_consensus.cc:515] T 45d9eb22dee8411b82eb768686e34604 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:56.598621  9609 raft_consensus.cc:493] T 9f7eec107ecc40f38d14871d9227b25f P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:16:56.600212  9438 raft_consensus.cc:493] T 932e5cbccd33414f8b05280505fd8bc7 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:16:56.602662  9438 raft_consensus.cc:515] T 932e5cbccd33414f8b05280505fd8bc7 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:56.604851  9438 leader_election.cc:290] T 932e5cbccd33414f8b05280505fd8bc7 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:56.601667  9609 raft_consensus.cc:515] T 9f7eec107ecc40f38d14871d9227b25f P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:56.605819  8668 catalog_manager.cc:5697] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12 reported cstate change: term changed from 1 to 2, leader changed from 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193) to 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195). New cstate: current_term: 2 leader_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:56.608762  9609 leader_election.cc:290] T 9f7eec107ecc40f38d14871d9227b25f P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
W20260709 13:16:56.601665  8810 leader_election.cc:336] T 3f0c32d9abf04206a6f08210b3a30794 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:16:56.609503  8810 leader_election.cc:304] T 3f0c32d9abf04206a6f08210b3a30794 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6; no voters: 895d3c58761f427c9c5b3cb41246c243, e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:56.611259  9438 raft_consensus.cc:2749] T 3f0c32d9abf04206a6f08210b3a30794 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:56.606676  9546 leader_election.cc:290] T 45d9eb22dee8411b82eb768686e34604 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 election: Requested vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:56.612411  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d9eb22dee8411b82eb768686e34604" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:16:56.613237  8919 raft_consensus.cc:3060] T 45d9eb22dee8411b82eb768686e34604 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:56.614064  8884 leader_election.cc:336] T ef723f9c640849d3890c61c07ffd0378 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
W20260709 13:16:56.615002  8958 leader_election.cc:336] T f46053ed2641458a87c97152e4979c35 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
W20260709 13:16:56.616235  8810 leader_election.cc:336] T cc6e2639db63487cae6a125c8d5fe1d8 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:16:56.616657  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932e5cbccd33414f8b05280505fd8bc7" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:56.617539  8915 raft_consensus.cc:2468] T 932e5cbccd33414f8b05280505fd8bc7 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 1.
I20260709 13:16:56.620203  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7eec107ecc40f38d14871d9227b25f" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:56.621218  8915 raft_consensus.cc:2468] T 9f7eec107ecc40f38d14871d9227b25f P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 1.
I20260709 13:16:56.615535  8958 leader_election.cc:304] T f46053ed2641458a87c97152e4979c35 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bb7e1240f44fda8b83e4c124852032; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243
W20260709 13:16:56.634639  8810 leader_election.cc:336] T 932e5cbccd33414f8b05280505fd8bc7 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
W20260709 13:16:56.635244  8810 leader_election.cc:336] T 9f7eec107ecc40f38d14871d9227b25f P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:16:56.639496  9438 raft_consensus.cc:493] T d46902173b5c4283b315c6def6f13c31 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:16:56.639384  8811 leader_election.cc:304] T 932e5cbccd33414f8b05280505fd8bc7 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6; no voters: 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:56.640090  9438 raft_consensus.cc:515] T d46902173b5c4283b315c6def6f13c31 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:56.640407  9227 raft_consensus.cc:2804] T 932e5cbccd33414f8b05280505fd8bc7 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:56.640857  8811 leader_election.cc:304] T 9f7eec107ecc40f38d14871d9227b25f P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6; no voters: 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:56.640981  9227 raft_consensus.cc:493] T 932e5cbccd33414f8b05280505fd8bc7 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:16:56.641554  9227 raft_consensus.cc:3060] T 932e5cbccd33414f8b05280505fd8bc7 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:56.642086  9438 leader_election.cc:290] T d46902173b5c4283b315c6def6f13c31 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:56.642481  8840 raft_consensus.cc:2468] T ef723f9c640849d3890c61c07ffd0378 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 2.
I20260709 13:16:56.642635  9438 raft_consensus.cc:2804] T 9f7eec107ecc40f38d14871d9227b25f P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:56.642979  9438 raft_consensus.cc:493] T 9f7eec107ecc40f38d14871d9227b25f P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:16:56.643342  9438 raft_consensus.cc:3060] T 9f7eec107ecc40f38d14871d9227b25f P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:56.586154  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc6e2639db63487cae6a125c8d5fe1d8" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:56.659014  8918 raft_consensus.cc:2468] T cc6e2639db63487cae6a125c8d5fe1d8 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 1.
I20260709 13:16:56.668689  9373 leader_election.cc:290] T ef723f9c640849d3890c61c07ffd0378 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 election: Requested vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:56.662593  9546 raft_consensus.cc:2749] T f46053ed2641458a87c97152e4979c35 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:56.684748  8919 raft_consensus.cc:2468] T 45d9eb22dee8411b82eb768686e34604 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 2.
I20260709 13:16:56.685313  9558 tablet_bootstrap.cc:492] T 390c483b2a1c42b897e166b1a381851c P 895d3c58761f427c9c5b3cb41246c243: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:56.686452  9558 tablet_bootstrap.cc:492] T 390c483b2a1c42b897e166b1a381851c P 895d3c58761f427c9c5b3cb41246c243: Bootstrap complete.
I20260709 13:16:56.687199  9558 ts_tablet_manager.cc:1403] T 390c483b2a1c42b897e166b1a381851c P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.271s	user 0.077s	sys 0.114s
I20260709 13:16:56.688237  8959 leader_election.cc:304] T 45d9eb22dee8411b82eb768686e34604 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:16:56.660175  9560 raft_consensus.cc:515] T 4fd6605b785643deac78902ee4fc6896 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
W20260709 13:16:56.689805  8958 leader_election.cc:336] T 45d9eb22dee8411b82eb768686e34604 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:16:56.691263  9560 leader_election.cc:290] T 4fd6605b785643deac78902ee4fc6896 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 election: Requested vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:56.696609  9227 raft_consensus.cc:515] T 932e5cbccd33414f8b05280505fd8bc7 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:56.702664  8883 leader_election.cc:304] T ef723f9c640849d3890c61c07ffd0378 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6; no voters: 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:56.708674  9225 raft_consensus.cc:515] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:56.716616  9558 raft_consensus.cc:359] T 390c483b2a1c42b897e166b1a381851c P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:56.717564  9558 raft_consensus.cc:740] T 390c483b2a1c42b897e166b1a381851c P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.719717  9558 consensus_queue.cc:260] T 390c483b2a1c42b897e166b1a381851c P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:56.722448  9438 raft_consensus.cc:515] T 9f7eec107ecc40f38d14871d9227b25f P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:56.736883  9227 leader_election.cc:290] T 932e5cbccd33414f8b05280505fd8bc7 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 election: Requested vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:56.737532  9558 ts_tablet_manager.cc:1434] T 390c483b2a1c42b897e166b1a381851c P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.050s	user 0.009s	sys 0.000s
I20260709 13:16:56.711329  9549 raft_consensus.cc:2804] T ef723f9c640849d3890c61c07ffd0378 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:56.711262  9546 raft_consensus.cc:2804] T 45d9eb22dee8411b82eb768686e34604 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:56.752846  8811 leader_election.cc:304] T cc6e2639db63487cae6a125c8d5fe1d8 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6; no voters: 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:56.736171  9560 raft_consensus.cc:493] T 65900ac9e06944639fe557200317fe05 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:16:56.756258  9225 leader_election.cc:290] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 election: Requested vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:56.716607  9617 raft_consensus.cc:493] T 825ea78cebec4b10a2f8d03b45d929fa P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:16:56.755901  9599 raft_consensus.cc:493] T 68650af2b1894208a4cc0a1c6ddf880b P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:16:56.776073  9558 tablet_bootstrap.cc:492] T ef723f9c640849d3890c61c07ffd0378 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:56.756780  9609 raft_consensus.cc:2804] T cc6e2639db63487cae6a125c8d5fe1d8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:56.766819  9546 raft_consensus.cc:697] T 45d9eb22dee8411b82eb768686e34604 P e8bb7e1240f44fda8b83e4c124852032 [term 2 LEADER]: Becoming Leader. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Running, Role: LEADER
I20260709 13:16:56.789762  9438 leader_election.cc:290] T 9f7eec107ecc40f38d14871d9227b25f P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 election: Requested vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:56.770226  9620 raft_consensus.cc:493] T 68650af2b1894208a4cc0a1c6ddf880b P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:16:56.798779  9620 raft_consensus.cc:515] T 68650af2b1894208a4cc0a1c6ddf880b P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:56.801780  9620 leader_election.cc:290] T 68650af2b1894208a4cc0a1c6ddf880b P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:56.802994  9373 raft_consensus.cc:493] T f46053ed2641458a87c97152e4979c35 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:16:56.772719  9617 raft_consensus.cc:515] T 825ea78cebec4b10a2f8d03b45d929fa P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
W20260709 13:16:56.804877  8958 leader_election.cc:336] T 45d9eb22dee8411b82eb768686e34604 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:16:56.806357  9617 leader_election.cc:290] T 825ea78cebec4b10a2f8d03b45d929fa P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:56.807489  9619 raft_consensus.cc:493] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:16:56.808357  9619 raft_consensus.cc:515] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:56.810204  8919 raft_consensus.cc:1275] T be1c593726564ba7ae9e8b66d1989f69 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Refusing update from remote peer e8bb7e1240f44fda8b83e4c124852032: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:56.810712  9619 leader_election.cc:290] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:56.781723  9599 raft_consensus.cc:515] T 68650af2b1894208a4cc0a1c6ddf880b P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:56.813916  9599 leader_election.cc:290] T 68650af2b1894208a4cc0a1c6ddf880b P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:56.815471  9546 consensus_queue.cc:237] T 45d9eb22dee8411b82eb768686e34604 P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:56.818032  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68650af2b1894208a4cc0a1c6ddf880b" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:56.818966  8918 raft_consensus.cc:2468] T 68650af2b1894208a4cc0a1c6ddf880b P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 1.
I20260709 13:16:56.781383  9609 raft_consensus.cc:493] T cc6e2639db63487cae6a125c8d5fe1d8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:16:56.819496  9609 raft_consensus.cc:3060] T cc6e2639db63487cae6a125c8d5fe1d8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:56.819824  8958 leader_election.cc:336] T 68650af2b1894208a4cc0a1c6ddf880b P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:16:56.820510  9547 consensus_queue.cc:1048] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:56.821403  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45613c5d357b40b8af0ced6c8725c559" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:56.822074  8841 raft_consensus.cc:2468] T 45613c5d357b40b8af0ced6c8725c559 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 2.
I20260709 13:16:56.770097  9560 raft_consensus.cc:515] T 65900ac9e06944639fe557200317fe05 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:56.823529  8959 leader_election.cc:304] T 68650af2b1894208a4cc0a1c6ddf880b P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032; no voters: 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:56.823810  8883 leader_election.cc:304] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6; no voters: 
I20260709 13:16:56.824564  9547 raft_consensus.cc:2804] T 68650af2b1894208a4cc0a1c6ddf880b P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:56.825013  9547 raft_consensus.cc:493] T 68650af2b1894208a4cc0a1c6ddf880b P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:16:56.825419  9547 raft_consensus.cc:3060] T 68650af2b1894208a4cc0a1c6ddf880b P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:56.825779  9612 raft_consensus.cc:2804] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:56.826226  9612 raft_consensus.cc:493] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:16:56.826547  9612 raft_consensus.cc:3060] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:56.825435  9560 leader_election.cc:290] T 65900ac9e06944639fe557200317fe05 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
W20260709 13:16:56.840654  8810 leader_election.cc:336] T d46902173b5c4283b315c6def6f13c31 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:16:56.810240  9373 raft_consensus.cc:515] T f46053ed2641458a87c97152e4979c35 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:56.857908  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46902173b5c4283b315c6def6f13c31" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:56.858496  9373 leader_election.cc:290] T f46053ed2641458a87c97152e4979c35 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:56.858810  8919 raft_consensus.cc:2468] T d46902173b5c4283b315c6def6f13c31 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 1.
I20260709 13:16:56.865170  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825ea78cebec4b10a2f8d03b45d929fa" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:56.866158  8993 raft_consensus.cc:2468] T 825ea78cebec4b10a2f8d03b45d929fa P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 1.
I20260709 13:16:56.847764  9549 raft_consensus.cc:697] T ef723f9c640849d3890c61c07ffd0378 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 LEADER]: Becoming Leader. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Running, Role: LEADER
I20260709 13:16:56.871099  8989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65900ac9e06944639fe557200317fe05" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:56.872021  8989 raft_consensus.cc:2468] T 65900ac9e06944639fe557200317fe05 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 1.
I20260709 13:16:56.871515  9549 consensus_queue.cc:237] T ef723f9c640849d3890c61c07ffd0378 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:56.875320  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd6605b785643deac78902ee4fc6896" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:16:56.876240  8919 raft_consensus.cc:3060] T 4fd6605b785643deac78902ee4fc6896 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:56.881214  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:46105, user_credentials={real_user=slave}} blocked reactor thread for 113229us
W20260709 13:16:56.884580  8810 leader_election.cc:336] T 4fd6605b785643deac78902ee4fc6896 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
W20260709 13:16:56.885502  8810 leader_election.cc:336] T 932e5cbccd33414f8b05280505fd8bc7 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
W20260709 13:16:56.886324  8810 leader_election.cc:336] T 9f7eec107ecc40f38d14871d9227b25f P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:16:56.887779  8990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab679ea0af724bd39f753eb407c73264" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
I20260709 13:16:56.888507  8990 raft_consensus.cc:3060] T ab679ea0af724bd39f753eb407c73264 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:56.854497  9599 raft_consensus.cc:493] T 3f0c32d9abf04206a6f08210b3a30794 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:16:56.891455  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68650af2b1894208a4cc0a1c6ddf880b" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:56.888618  8808 leader_election.cc:304] T 825ea78cebec4b10a2f8d03b45d929fa P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:16:56.893006  9227 raft_consensus.cc:2804] T 825ea78cebec4b10a2f8d03b45d929fa P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:56.893095  8808 leader_election.cc:304] T 65900ac9e06944639fe557200317fe05 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:16:56.893488  9227 raft_consensus.cc:493] T 825ea78cebec4b10a2f8d03b45d929fa P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:16:56.894069  9227 raft_consensus.cc:3060] T 825ea78cebec4b10a2f8d03b45d929fa P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:56.901780  8919 raft_consensus.cc:2468] T 4fd6605b785643deac78902ee4fc6896 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 2.
I20260709 13:16:56.906744  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46053ed2641458a87c97152e4979c35" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:56.907610  8992 raft_consensus.cc:2468] T f46053ed2641458a87c97152e4979c35 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 1.
I20260709 13:16:56.909439  8882 leader_election.cc:304] T f46053ed2641458a87c97152e4979c35 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:16:56.905432  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932e5cbccd33414f8b05280505fd8bc7" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:16:56.913628  8811 leader_election.cc:304] T d46902173b5c4283b315c6def6f13c31 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6; no voters: 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:56.914898  8811 leader_election.cc:304] T 4fd6605b785643deac78902ee4fc6896 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6; no voters: 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:56.915732  9624 raft_consensus.cc:2804] T d46902173b5c4283b315c6def6f13c31 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:56.916152  9624 raft_consensus.cc:493] T d46902173b5c4283b315c6def6f13c31 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:16:56.916595  9624 raft_consensus.cc:3060] T d46902173b5c4283b315c6def6f13c31 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:56.919760  8914 raft_consensus.cc:3060] T 932e5cbccd33414f8b05280505fd8bc7 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:56.915728  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7eec107ecc40f38d14871d9227b25f" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:16:56.924386  8917 raft_consensus.cc:3060] T 9f7eec107ecc40f38d14871d9227b25f P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:56.899950  9622 raft_consensus.cc:2804] T 65900ac9e06944639fe557200317fe05 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:56.938392  9227 raft_consensus.cc:515] T 825ea78cebec4b10a2f8d03b45d929fa P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:56.895509  9599 raft_consensus.cc:515] T 3f0c32d9abf04206a6f08210b3a30794 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:56.940621  9633 raft_consensus.cc:2804] T f46053ed2641458a87c97152e4979c35 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:16:56.949898  8810 leader_election.cc:336] T 825ea78cebec4b10a2f8d03b45d929fa P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:16:56.940388  9622 raft_consensus.cc:493] T 65900ac9e06944639fe557200317fe05 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
W20260709 13:16:56.952442  8810 leader_election.cc:336] T 65900ac9e06944639fe557200317fe05 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:16:56.952570  9227 leader_election.cc:290] T 825ea78cebec4b10a2f8d03b45d929fa P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 election: Requested vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:56.958593  8914 raft_consensus.cc:2468] T 932e5cbccd33414f8b05280505fd8bc7 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 2.
I20260709 13:16:56.954581  9622 raft_consensus.cc:3060] T 65900ac9e06944639fe557200317fe05 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:56.951936  9633 raft_consensus.cc:493] T f46053ed2641458a87c97152e4979c35 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:16:56.966276  9633 raft_consensus.cc:3060] T f46053ed2641458a87c97152e4979c35 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:56.953173  9623 raft_consensus.cc:2804] T 4fd6605b785643deac78902ee4fc6896 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:56.958946  9609 raft_consensus.cc:515] T cc6e2639db63487cae6a125c8d5fe1d8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:56.967909  9623 raft_consensus.cc:697] T 4fd6605b785643deac78902ee4fc6896 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 LEADER]: Becoming Leader. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Running, Role: LEADER
I20260709 13:16:56.969272  9609 leader_election.cc:290] T cc6e2639db63487cae6a125c8d5fe1d8 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 election: Requested vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:56.969000  9623 consensus_queue.cc:237] T 4fd6605b785643deac78902ee4fc6896 P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:56.962944  9599 leader_election.cc:290] T 3f0c32d9abf04206a6f08210b3a30794 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
W20260709 13:16:56.970289  8958 leader_election.cc:336] T 3f0c32d9abf04206a6f08210b3a30794 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:16:56.973320  9547 raft_consensus.cc:515] T 68650af2b1894208a4cc0a1c6ddf880b P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:56.975065  8993 raft_consensus.cc:2393] T 68650af2b1894208a4cc0a1c6ddf880b P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43c6faa9496d44dda6b6eaed09cdfd12 in current term 2: Already voted for candidate e8bb7e1240f44fda8b83e4c124852032 in this term.
I20260709 13:16:56.979298  8667 catalog_manager.cc:5697] T 45d9eb22dee8411b82eb768686e34604 P e8bb7e1240f44fda8b83e4c124852032 reported cstate change: term changed from 1 to 2, leader changed from 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193) to e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196). New cstate: current_term: 2 leader_uuid: "e8bb7e1240f44fda8b83e4c124852032" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:56.981514  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:39173, user_credentials={real_user=slave}} blocked reactor thread for 53602.2us
W20260709 13:16:56.982170  8884 leader_election.cc:336] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
W20260709 13:16:56.990694  8810 leader_election.cc:336] T 825ea78cebec4b10a2f8d03b45d929fa P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
W20260709 13:16:56.991559  8810 leader_election.cc:336] T cc6e2639db63487cae6a125c8d5fe1d8 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:16:56.994338  8990 raft_consensus.cc:2468] T ab679ea0af724bd39f753eb407c73264 P e8bb7e1240f44fda8b83e4c124852032 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 3.
W20260709 13:16:56.997148  8884 leader_election.cc:336] T 68650af2b1894208a4cc0a1c6ddf880b P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:16:56.997654  8884 leader_election.cc:304] T 68650af2b1894208a4cc0a1c6ddf880b P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12; no voters: 895d3c58761f427c9c5b3cb41246c243, e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:56.941517  9612 raft_consensus.cc:515] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:57.020609  8882 leader_election.cc:304] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032; no voters: 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:57.013254  9619 raft_consensus.cc:3060] T 68650af2b1894208a4cc0a1c6ddf880b P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:57.035835  9547 leader_election.cc:290] T 68650af2b1894208a4cc0a1c6ddf880b P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 election: Requested vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
W20260709 13:16:57.039916  8958 consensus_peers.cc:597] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:57.040315  9612 leader_election.cc:290] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 election: Requested vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
W20260709 13:16:57.041778  8811 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37671, user_credentials={real_user=slave}} blocked reactor thread for 110880us
W20260709 13:16:57.048808  8884 leader_election.cc:336] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:16:57.049154  8917 raft_consensus.cc:2468] T 9f7eec107ecc40f38d14871d9227b25f P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 2.
W20260709 13:16:57.050055  8884 leader_election.cc:336] T f46053ed2641458a87c97152e4979c35 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:16:57.059795  9628 raft_consensus.cc:2804] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:57.060459  9628 raft_consensus.cc:697] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 LEADER]: Becoming Leader. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Running, Role: LEADER
I20260709 13:16:57.060524  9622 raft_consensus.cc:515] T 65900ac9e06944639fe557200317fe05 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:57.061396  9628 consensus_queue.cc:237] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:57.047032  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68650af2b1894208a4cc0a1c6ddf880b" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:16:57.064603  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc6e2639db63487cae6a125c8d5fe1d8" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:16:57.065303  8916 raft_consensus.cc:3060] T cc6e2639db63487cae6a125c8d5fe1d8 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:57.065950  8958 leader_election.cc:336] T 68650af2b1894208a4cc0a1c6ddf880b P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:16:57.066629  9622 leader_election.cc:290] T 65900ac9e06944639fe557200317fe05 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 election: Requested vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
W20260709 13:16:57.070709  8810 leader_election.cc:336] T 65900ac9e06944639fe557200317fe05 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
W20260709 13:16:57.071067  8884 consensus_peers.cc:597] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:57.073112  8884 leader_election.cc:336] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:16:57.075670  8668 catalog_manager.cc:5697] T ef723f9c640849d3890c61c07ffd0378 P 43c6faa9496d44dda6b6eaed09cdfd12 reported cstate change: term changed from 1 to 2, leader changed from 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193) to 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195). New cstate: current_term: 2 leader_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:57.093266  8916 raft_consensus.cc:2468] T cc6e2639db63487cae6a125c8d5fe1d8 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 2.
I20260709 13:16:57.104674  8843 raft_consensus.cc:1275] T 1d5284f5b067413e9fc2a383cc318735 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Refusing update from remote peer 43c6faa9496d44dda6b6eaed09cdfd12: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:57.104831  8811 leader_election.cc:304] T 932e5cbccd33414f8b05280505fd8bc7 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6; no voters: 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:57.097693  9619 raft_consensus.cc:2749] T 68650af2b1894208a4cc0a1c6ddf880b P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:57.106074  8811 leader_election.cc:304] T 9f7eec107ecc40f38d14871d9227b25f P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6; no voters: 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:57.113937  9438 raft_consensus.cc:2804] T 9f7eec107ecc40f38d14871d9227b25f P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:57.114400  8811 leader_election.cc:304] T cc6e2639db63487cae6a125c8d5fe1d8 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6; no voters: 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:57.114606  9438 raft_consensus.cc:697] T 9f7eec107ecc40f38d14871d9227b25f P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 LEADER]: Becoming Leader. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Running, Role: LEADER
I20260709 13:16:57.092464  9624 raft_consensus.cc:515] T d46902173b5c4283b315c6def6f13c31 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:57.124738  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45613c5d357b40b8af0ced6c8725c559" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
I20260709 13:16:57.125438  8840 raft_consensus.cc:3060] T 45613c5d357b40b8af0ced6c8725c559 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:57.120118  9438 consensus_queue.cc:237] T 9f7eec107ecc40f38d14871d9227b25f P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:57.135120  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65900ac9e06944639fe557200317fe05" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
I20260709 13:16:57.136092  8992 raft_consensus.cc:3060] T 65900ac9e06944639fe557200317fe05 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:57.137324  8988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825ea78cebec4b10a2f8d03b45d929fa" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
I20260709 13:16:57.138124  8988 raft_consensus.cc:3060] T 825ea78cebec4b10a2f8d03b45d929fa P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:57.125617  9617 raft_consensus.cc:2804] T cc6e2639db63487cae6a125c8d5fe1d8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:57.141001  9624 leader_election.cc:290] T d46902173b5c4283b315c6def6f13c31 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 election: Requested vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:57.142175  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f0c32d9abf04206a6f08210b3a30794" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:57.142966  8844 raft_consensus.cc:2468] T 3f0c32d9abf04206a6f08210b3a30794 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 1.
I20260709 13:16:57.145025  9633 raft_consensus.cc:515] T f46053ed2641458a87c97152e4979c35 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:57.151086  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46902173b5c4283b315c6def6f13c31" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:16:57.152006  8919 raft_consensus.cc:3060] T d46902173b5c4283b315c6def6f13c31 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:57.152061  9563 raft_consensus.cc:493] T 852f0ef4508245e2812b76665a70bbf8 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.152768  9563 raft_consensus.cc:515] T 852f0ef4508245e2812b76665a70bbf8 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:57.115445  9642 raft_consensus.cc:2804] T 932e5cbccd33414f8b05280505fd8bc7 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:57.155946  9642 raft_consensus.cc:697] T 932e5cbccd33414f8b05280505fd8bc7 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 LEADER]: Becoming Leader. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Running, Role: LEADER
I20260709 13:16:57.158793  8840 raft_consensus.cc:2468] T 45613c5d357b40b8af0ced6c8725c559 P 7d3072f2af0b481d94ed70632b90e8c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 3.
I20260709 13:16:57.168553  8919 raft_consensus.cc:2468] T d46902173b5c4283b315c6def6f13c31 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 2.
I20260709 13:16:57.169533  8957 leader_election.cc:304] T 3f0c32d9abf04206a6f08210b3a30794 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6, e8bb7e1240f44fda8b83e4c124852032; no voters: 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:57.173267  9558 tablet_bootstrap.cc:492] T ef723f9c640849d3890c61c07ffd0378 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:57.178318  8990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46053ed2641458a87c97152e4979c35" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
I20260709 13:16:57.179004  8990 raft_consensus.cc:3060] T f46053ed2641458a87c97152e4979c35 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:57.126358  9612 consensus_queue.cc:1048] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:16:57.175830  9547 raft_consensus.cc:2804] T 3f0c32d9abf04206a6f08210b3a30794 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:57.184202  8883 leader_election.cc:304] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6; no voters: 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:57.186031  9633 leader_election.cc:290] T f46053ed2641458a87c97152e4979c35 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 election: Requested vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:16:57.191107  9620 raft_consensus.cc:2804] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:57.191650  9620 raft_consensus.cc:697] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 LEADER]: Becoming Leader. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Running, Role: LEADER
I20260709 13:16:57.192552  9620 consensus_queue.cc:237] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:57.164745  9617 raft_consensus.cc:697] T cc6e2639db63487cae6a125c8d5fe1d8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 LEADER]: Becoming Leader. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Running, Role: LEADER
I20260709 13:16:57.194305  8914 raft_consensus.cc:2468] T 68650af2b1894208a4cc0a1c6ddf880b P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 2.
I20260709 13:16:57.194087  9617 consensus_queue.cc:237] T cc6e2639db63487cae6a125c8d5fe1d8 P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
W20260709 13:16:57.183231  8810 leader_election.cc:336] T d46902173b5c4283b315c6def6f13c31 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:16:57.184267  9547 raft_consensus.cc:493] T 3f0c32d9abf04206a6f08210b3a30794 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:16:57.196269  9547 raft_consensus.cc:3060] T 3f0c32d9abf04206a6f08210b3a30794 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:57.196316  8810 consensus_peers.cc:597] T 17e47826fe4e4662baba1d095c341c1b P 7d3072f2af0b481d94ed70632b90e8c6 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:57.182192  8992 raft_consensus.cc:2468] T 65900ac9e06944639fe557200317fe05 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 2.
I20260709 13:16:57.206081  8811 leader_election.cc:304] T d46902173b5c4283b315c6def6f13c31 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6; no voters: 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:57.216466  8990 raft_consensus.cc:2468] T f46053ed2641458a87c97152e4979c35 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 2.
I20260709 13:16:57.217211  9558 tablet_bootstrap.cc:492] T ef723f9c640849d3890c61c07ffd0378 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap complete.
I20260709 13:16:57.218289  8882 leader_election.cc:304] T f46053ed2641458a87c97152e4979c35 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:16:57.218351  9558 ts_tablet_manager.cc:1403] T ef723f9c640849d3890c61c07ffd0378 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.444s	user 0.029s	sys 0.010s
I20260709 13:16:57.221235  8919 raft_consensus.cc:1275] T 17e47826fe4e4662baba1d095c341c1b P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Refusing update from remote peer 7d3072f2af0b481d94ed70632b90e8c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:57.219111  9624 raft_consensus.cc:2804] T d46902173b5c4283b315c6def6f13c31 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:57.222864  9549 raft_consensus.cc:2804] T f46053ed2641458a87c97152e4979c35 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:57.225466  9563 leader_election.cc:290] T 852f0ef4508245e2812b76665a70bbf8 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:57.254570  9624 raft_consensus.cc:697] T d46902173b5c4283b315c6def6f13c31 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 LEADER]: Becoming Leader. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Running, Role: LEADER
I20260709 13:16:57.265192  9549 raft_consensus.cc:697] T f46053ed2641458a87c97152e4979c35 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 LEADER]: Becoming Leader. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Running, Role: LEADER
I20260709 13:16:57.285233  9647 consensus_queue.cc:1048] T 17e47826fe4e4662baba1d095c341c1b P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:16:57.226887  9642 consensus_queue.cc:237] T 932e5cbccd33414f8b05280505fd8bc7 P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:57.297155  9558 raft_consensus.cc:359] T ef723f9c640849d3890c61c07ffd0378 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
W20260709 13:16:57.298626  8884 leader_election.cc:336] T f46053ed2641458a87c97152e4979c35 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:16:57.300252  9558 raft_consensus.cc:740] T ef723f9c640849d3890c61c07ffd0378 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.285703  9549 consensus_queue.cc:237] T f46053ed2641458a87c97152e4979c35 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:57.301189  9558 consensus_queue.cc:260] T ef723f9c640849d3890c61c07ffd0378 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:57.306245  8959 leader_election.cc:304] T 68650af2b1894208a4cc0a1c6ddf880b P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032; no voters: 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:57.290445  9563 raft_consensus.cc:493] T 80fde6a0b6334446923248a50e223397 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.333017  8667 catalog_manager.cc:5697] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12 reported cstate change: term changed from 2 to 3, leader changed from 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193) to 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195). New cstate: current_term: 3 leader_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:57.313063  9599 raft_consensus.cc:2804] T 68650af2b1894208a4cc0a1c6ddf880b P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:57.336520  9599 raft_consensus.cc:697] T 68650af2b1894208a4cc0a1c6ddf880b P e8bb7e1240f44fda8b83e4c124852032 [term 2 LEADER]: Becoming Leader. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Running, Role: LEADER
I20260709 13:16:57.338335  8668 catalog_manager.cc:5697] T 4fd6605b785643deac78902ee4fc6896 P 7d3072f2af0b481d94ed70632b90e8c6 reported cstate change: term changed from 1 to 2, leader changed from 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193) to 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194). New cstate: current_term: 2 leader_uuid: "7d3072f2af0b481d94ed70632b90e8c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:57.296787  9624 consensus_queue.cc:237] T d46902173b5c4283b315c6def6f13c31 P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:57.337800  9599 consensus_queue.cc:237] T 68650af2b1894208a4cc0a1c6ddf880b P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:57.377871  8808 leader_election.cc:304] T 65900ac9e06944639fe557200317fe05 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6, e8bb7e1240f44fda8b83e4c124852032; no voters: 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:57.379201  9647 raft_consensus.cc:2804] T 65900ac9e06944639fe557200317fe05 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:57.379761  9647 raft_consensus.cc:697] T 65900ac9e06944639fe557200317fe05 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 LEADER]: Becoming Leader. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Running, Role: LEADER
I20260709 13:16:57.380705  9647 consensus_queue.cc:237] T 65900ac9e06944639fe557200317fe05 P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:57.322180  9563 raft_consensus.cc:515] T 80fde6a0b6334446923248a50e223397 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
W20260709 13:16:57.395777  8810 consensus_peers.cc:597] T 4e1e1e84d68946d682e0944fbd3c51a8 P 7d3072f2af0b481d94ed70632b90e8c6 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:57.434892  8919 raft_consensus.cc:1275] T 45d9eb22dee8411b82eb768686e34604 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Refusing update from remote peer e8bb7e1240f44fda8b83e4c124852032: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:57.440727  9626 consensus_queue.cc:1048] T 45d9eb22dee8411b82eb768686e34604 P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:57.454213  8988 raft_consensus.cc:2468] T 825ea78cebec4b10a2f8d03b45d929fa P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 2.
I20260709 13:16:57.456225  9547 raft_consensus.cc:515] T 3f0c32d9abf04206a6f08210b3a30794 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:57.458875  9547 leader_election.cc:290] T 3f0c32d9abf04206a6f08210b3a30794 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 election: Requested vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
W20260709 13:16:57.475399  8958 consensus_peers.cc:597] T 45d9eb22dee8411b82eb768686e34604 P e8bb7e1240f44fda8b83e4c124852032 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:57.485774  9558 ts_tablet_manager.cc:1434] T ef723f9c640849d3890c61c07ffd0378 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.266s	user 0.010s	sys 0.009s
I20260709 13:16:57.487294  9558 tablet_bootstrap.cc:492] T 5a26acd2175646e3a53b493571852af4 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:57.488446  8919 raft_consensus.cc:1275] T 4fd6605b785643deac78902ee4fc6896 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Refusing update from remote peer 7d3072f2af0b481d94ed70632b90e8c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:57.493172  9622 consensus_queue.cc:1048] T 4fd6605b785643deac78902ee4fc6896 P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:57.514621  8844 raft_consensus.cc:1275] T ef723f9c640849d3890c61c07ffd0378 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Refusing update from remote peer 43c6faa9496d44dda6b6eaed09cdfd12: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:57.534227  9619 consensus_queue.cc:1048] T ef723f9c640849d3890c61c07ffd0378 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:57.537636  9665 raft_consensus.cc:493] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.538578  9665 raft_consensus.cc:515] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
W20260709 13:16:57.542779  8810 consensus_peers.cc:597] T 4fd6605b785643deac78902ee4fc6896 P 7d3072f2af0b481d94ed70632b90e8c6 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:57.544212  8958 leader_election.cc:336] T 3f0c32d9abf04206a6f08210b3a30794 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
W20260709 13:16:57.549588  8884 consensus_peers.cc:597] T d09ffcae84334482a706af1e812c7c9d P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:57.590940  8957 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:35315, user_credentials={real_user=slave}} blocked reactor thread for 208809us
I20260709 13:16:57.620765  8990 raft_consensus.cc:1275] T ab679ea0af724bd39f753eb407c73264 P e8bb7e1240f44fda8b83e4c124852032 [term 3 FOLLOWER]: Refusing update from remote peer 43c6faa9496d44dda6b6eaed09cdfd12: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:57.658309  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852f0ef4508245e2812b76665a70bbf8" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:57.660883  9563 leader_election.cc:290] T 80fde6a0b6334446923248a50e223397 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
W20260709 13:16:57.682467  9667 log.cc:927] Time spent T 45d9eb22dee8411b82eb768686e34604 P 43c6faa9496d44dda6b6eaed09cdfd12: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:16:57.683187  8845 raft_consensus.cc:1275] T 45613c5d357b40b8af0ced6c8725c559 P 7d3072f2af0b481d94ed70632b90e8c6 [term 3 FOLLOWER]: Refusing update from remote peer 43c6faa9496d44dda6b6eaed09cdfd12: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:57.686096  9620 consensus_queue.cc:1048] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:57.691404  8990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1c593726564ba7ae9e8b66d1989f69" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:57.695853  8808 leader_election.cc:304] T 825ea78cebec4b10a2f8d03b45d929fa P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6, e8bb7e1240f44fda8b83e4c124852032; no voters: 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:57.697687  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80fde6a0b6334446923248a50e223397" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
W20260709 13:16:57.714694  8884 consensus_peers.cc:597] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:57.715834  9630 raft_consensus.cc:2804] T 825ea78cebec4b10a2f8d03b45d929fa P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:16:57.723280  9664 log.cc:927] Time spent T 17e47826fe4e4662baba1d095c341c1b P 43c6faa9496d44dda6b6eaed09cdfd12: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
W20260709 13:16:57.750749  8810 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:39173, user_credentials={real_user=slave}} blocked reactor thread for 60218.7us
I20260709 13:16:57.716462  9630 raft_consensus.cc:697] T 825ea78cebec4b10a2f8d03b45d929fa P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 LEADER]: Becoming Leader. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Running, Role: LEADER
I20260709 13:16:57.752934  9630 consensus_queue.cc:237] T 825ea78cebec4b10a2f8d03b45d929fa P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
W20260709 13:16:57.754827  9671 log.cc:927] Time spent T 68650af2b1894208a4cc0a1c6ddf880b P e8bb7e1240f44fda8b83e4c124852032: Append to log took a long time: real 0.149s	user 0.000s	sys 0.002s
I20260709 13:16:57.733197  9563 raft_consensus.cc:493] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:57.768428  8810 consensus_peers.cc:597] T 675795627b9b4542805157dd7ec531cd P 7d3072f2af0b481d94ed70632b90e8c6 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:57.769214  8810 consensus_peers.cc:597] T 9f7eec107ecc40f38d14871d9227b25f P 7d3072f2af0b481d94ed70632b90e8c6 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:57.654798  9665 leader_election.cc:290] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:57.780488  9665 raft_consensus.cc:493] T f3ea64f4f4c54500a95692118660d9b4 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:57.801191  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:39173, user_credentials={real_user=slave}} blocked reactor thread for 76743.3us
I20260709 13:16:57.765944  9563 raft_consensus.cc:515] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:57.822077  9678 raft_consensus.cc:493] T c17f01b356e04590838cc6e6bb27bf64 P 895d3c58761f427c9c5b3cb41246c243 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.806656  9665 raft_consensus.cc:515] T f3ea64f4f4c54500a95692118660d9b4 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:57.841423  8667 catalog_manager.cc:5697] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12 reported cstate change: term changed from 2 to 3, leader changed from 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193) to 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195). New cstate: current_term: 3 leader_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:57.853777  8667 catalog_manager.cc:5697] T f46053ed2641458a87c97152e4979c35 P 43c6faa9496d44dda6b6eaed09cdfd12 reported cstate change: term changed from 1 to 2, leader changed from 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193) to 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195). New cstate: current_term: 2 leader_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:57.924399  8884 consensus_peers.cc:597] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:57.925269  8884 consensus_peers.cc:597] T 80fde6a0b6334446923248a50e223397 P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:57.925716  8884 consensus_peers.cc:597] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:57.926011  9563 leader_election.cc:290] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
W20260709 13:16:57.926148  8884 consensus_peers.cc:597] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:57.935693  9558 tablet_bootstrap.cc:492] T 5a26acd2175646e3a53b493571852af4 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:57.937319  9563 raft_consensus.cc:493] T 932e5cbccd33414f8b05280505fd8bc7 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.950867  9558 tablet_bootstrap.cc:492] T 5a26acd2175646e3a53b493571852af4 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap complete.
I20260709 13:16:57.859912  9678 raft_consensus.cc:515] T c17f01b356e04590838cc6e6bb27bf64 P 895d3c58761f427c9c5b3cb41246c243 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:58.015028  9563 raft_consensus.cc:515] T 932e5cbccd33414f8b05280505fd8bc7 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:58.016258  8916 raft_consensus.cc:1275] T cc6e2639db63487cae6a125c8d5fe1d8 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Refusing update from remote peer 7d3072f2af0b481d94ed70632b90e8c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:16:58.016700  8957 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:35315, user_credentials={real_user=slave}} blocked reactor thread for 57382.3us
I20260709 13:16:58.018769  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852f0ef4508245e2812b76665a70bbf8" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:58.019611  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd6605b785643deac78902ee4fc6896" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:57.959256  9685 raft_consensus.cc:493] T ae1fc430ae3d4315aad2c0eed2f026aa P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.948843  8915 raft_consensus.cc:1275] T 9f7eec107ecc40f38d14871d9227b25f P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Refusing update from remote peer 7d3072f2af0b481d94ed70632b90e8c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:16:58.025681  8884 consensus_peers.cc:597] T ef723f9c640849d3890c61c07ffd0378 P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:58.027614  9665 leader_election.cc:290] T f3ea64f4f4c54500a95692118660d9b4 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:58.031463  8668 catalog_manager.cc:5697] T 68650af2b1894208a4cc0a1c6ddf880b P e8bb7e1240f44fda8b83e4c124852032 reported cstate change: term changed from 1 to 2, leader changed from 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193) to e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196). New cstate: current_term: 2 leader_uuid: "e8bb7e1240f44fda8b83e4c124852032" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:58.034056  8917 raft_consensus.cc:1275] T 932e5cbccd33414f8b05280505fd8bc7 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Refusing update from remote peer 7d3072f2af0b481d94ed70632b90e8c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:16:58.034765  8810 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:39173, user_credentials={real_user=slave}} blocked reactor thread for 180592us
I20260709 13:16:58.036716  8845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f0c32d9abf04206a6f08210b3a30794" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
W20260709 13:16:58.039505  8958 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:39173, user_credentials={real_user=slave}} blocked reactor thread for 206286us
I20260709 13:16:58.040472  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea64f4f4c54500a95692118660d9b4" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:58.046074  9558 ts_tablet_manager.cc:1403] T 5a26acd2175646e3a53b493571852af4 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.559s	user 0.021s	sys 0.007s
I20260709 13:16:58.054131  9678 leader_election.cc:290] T c17f01b356e04590838cc6e6bb27bf64 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:58.054733  9688 raft_consensus.cc:493] T cc6e2639db63487cae6a125c8d5fe1d8 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.051646  8913 raft_consensus.cc:1275] T d46902173b5c4283b315c6def6f13c31 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Refusing update from remote peer 7d3072f2af0b481d94ed70632b90e8c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:58.064168  9685 raft_consensus.cc:515] T ae1fc430ae3d4315aad2c0eed2f026aa P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:58.081660  9227 consensus_queue.cc:1048] T 9f7eec107ecc40f38d14871d9227b25f P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:58.105469  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17f01b356e04590838cc6e6bb27bf64" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
W20260709 13:16:58.107738  8884 consensus_peers.cc:597] T f80d602267cf421690d5fe6d3922e0cb P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:58.079979  9665 raft_consensus.cc:493] T 9f7eec107ecc40f38d14871d9227b25f P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.116300  9665 raft_consensus.cc:515] T 9f7eec107ecc40f38d14871d9227b25f P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:58.082273  8845 raft_consensus.cc:3060] T 3f0c32d9abf04206a6f08210b3a30794 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:58.118741  9665 leader_election.cc:290] T 9f7eec107ecc40f38d14871d9227b25f P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:58.112955  9553 leader_election.cc:304] T 852f0ef4508245e2812b76665a70bbf8 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243; no voters: 7d3072f2af0b481d94ed70632b90e8c6, e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:58.113457  8991 raft_consensus.cc:1275] T 65900ac9e06944639fe557200317fe05 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Refusing update from remote peer 7d3072f2af0b481d94ed70632b90e8c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:58.114890  9685 leader_election.cc:290] T ae1fc430ae3d4315aad2c0eed2f026aa P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:58.088657  9678 raft_consensus.cc:493] T 390c483b2a1c42b897e166b1a381851c P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.088967  9612 consensus_queue.cc:1048] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
W20260709 13:16:58.164618  8959 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37671, user_credentials={real_user=slave}} blocked reactor thread for 57859.4us
I20260709 13:16:58.092176  9688 raft_consensus.cc:515] T cc6e2639db63487cae6a125c8d5fe1d8 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:58.168347  9694 raft_consensus.cc:493] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.169064  9694 raft_consensus.cc:515] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:58.156510  9689 raft_consensus.cc:2749] T 852f0ef4508245e2812b76665a70bbf8 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:58.142540  9678 raft_consensus.cc:515] T 390c483b2a1c42b897e166b1a381851c P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:58.183007  9558 raft_consensus.cc:359] T 5a26acd2175646e3a53b493571852af4 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:58.188876  9558 raft_consensus.cc:740] T 5a26acd2175646e3a53b493571852af4 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
W20260709 13:16:58.163038  9553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:35315, user_credentials={real_user=slave}} blocked reactor thread for 69812.6us
I20260709 13:16:58.177580  9685 raft_consensus.cc:493] T 9fdcbb0a74a64826ab0665c349b16200 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.185010  9665 raft_consensus.cc:493] T f80d602267cf421690d5fe6d3922e0cb P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.177119  9694 leader_election.cc:290] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:58.176043  8987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1fc430ae3d4315aad2c0eed2f026aa" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:58.185412  9642 consensus_queue.cc:1048] T 65900ac9e06944639fe557200317fe05 P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:16:58.217005  8845 raft_consensus.cc:2468] T 3f0c32d9abf04206a6f08210b3a30794 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 2.
I20260709 13:16:58.200047  9665 raft_consensus.cc:515] T f80d602267cf421690d5fe6d3922e0cb P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:16:58.220250  9665 leader_election.cc:290] T f80d602267cf421690d5fe6d3922e0cb P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:58.222534  9678 leader_election.cc:290] T 390c483b2a1c42b897e166b1a381851c P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:58.224066  9688 leader_election.cc:290] T cc6e2639db63487cae6a125c8d5fe1d8 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
W20260709 13:16:58.224274  8958 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:39173, user_credentials={real_user=slave}} blocked reactor thread for 148873us
I20260709 13:16:58.200572  9563 leader_election.cc:290] T 932e5cbccd33414f8b05280505fd8bc7 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:16:58.241489  8957 leader_election.cc:304] T 3f0c32d9abf04206a6f08210b3a30794 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6, e8bb7e1240f44fda8b83e4c124852032; no voters: 895d3c58761f427c9c5b3cb41246c243
I20260709 13:16:58.197566  9685 raft_consensus.cc:515] T 9fdcbb0a74a64826ab0665c349b16200 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:58.255930  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c483b2a1c42b897e166b1a381851c" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:58.261518  8989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c483b2a1c42b897e166b1a381851c" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:58.263499  8990 raft_consensus.cc:1275] T f46053ed2641458a87c97152e4979c35 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Refusing update from remote peer 43c6faa9496d44dda6b6eaed09cdfd12: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:16:58.265239  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:39173, user_credentials={real_user=slave}} blocked reactor thread for 155424us
W20260709 13:16:58.266403  8810 consensus_peers.cc:597] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 7d3072f2af0b481d94ed70632b90e8c6 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:58.266845  8810 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:39173, user_credentials={real_user=slave}} blocked reactor thread for 128824us
I20260709 13:16:58.267655  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45613c5d357b40b8af0ced6c8725c559" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
W20260709 13:16:58.267588  8810 consensus_peers.cc:597] T f3ea64f4f4c54500a95692118660d9b4 P 7d3072f2af0b481d94ed70632b90e8c6 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:58.272477  9553 leader_election.cc:304] T 390c483b2a1c42b897e166b1a381851c P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243; no voters: 7d3072f2af0b481d94ed70632b90e8c6, e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:58.273809  9563 raft_consensus.cc:2749] T 390c483b2a1c42b897e166b1a381851c P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:58.248570  9547 raft_consensus.cc:2804] T 3f0c32d9abf04206a6f08210b3a30794 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:58.246169  9647 consensus_queue.cc:1048] T d46902173b5c4283b315c6def6f13c31 P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
W20260709 13:16:58.277532  8884 consensus_peers.cc:597] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:58.281570  8884 consensus_peers.cc:597] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:58.282050  8884 consensus_peers.cc:597] T ae1fc430ae3d4315aad2c0eed2f026aa P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:58.282394  8884 consensus_peers.cc:597] T 7bcde3fdb9314ca4b3422d395a673be5 P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:58.282788  8884 consensus_peers.cc:597] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:58.286193  9547 raft_consensus.cc:697] T 3f0c32d9abf04206a6f08210b3a30794 P e8bb7e1240f44fda8b83e4c124852032 [term 2 LEADER]: Becoming Leader. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Running, Role: LEADER
W20260709 13:16:58.294304  8884 consensus_peers.cc:597] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:58.238602  9642 consensus_queue.cc:1048] T cc6e2639db63487cae6a125c8d5fe1d8 P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
W20260709 13:16:58.296137  8884 consensus_peers.cc:597] T dde08046aca642488918d1f2b978c126 P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:58.297191  8884 consensus_peers.cc:597] T 9fdcbb0a74a64826ab0665c349b16200 P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:58.243091  9639 consensus_queue.cc:1048] T 932e5cbccd33414f8b05280505fd8bc7 P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
W20260709 13:16:58.299206  8884 consensus_peers.cc:597] T f46053ed2641458a87c97152e4979c35 P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:58.301525  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc6e2639db63487cae6a125c8d5fe1d8" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:58.287361  9547 consensus_queue.cc:237] T 3f0c32d9abf04206a6f08210b3a30794 P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
W20260709 13:16:58.353168  9684 log.cc:927] Time spent T ab679ea0af724bd39f753eb407c73264 P e8bb7e1240f44fda8b83e4c124852032: Append to log took a long time: real 0.250s	user 0.003s	sys 0.000s
I20260709 13:16:58.354103  8991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fdcbb0a74a64826ab0665c349b16200" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:16:58.312984  9685 leader_election.cc:290] T 9fdcbb0a74a64826ab0665c349b16200 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:16:58.362144  9558 consensus_queue.cc:260] T 5a26acd2175646e3a53b493571852af4 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:58.372897  9558 ts_tablet_manager.cc:1434] T 5a26acd2175646e3a53b493571852af4 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.297s	user 0.008s	sys 0.001s
I20260709 13:16:58.374650  9558 tablet_bootstrap.cc:492] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:58.448508  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1c593726564ba7ae9e8b66d1989f69" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:58.449033  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932e5cbccd33414f8b05280505fd8bc7" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:58.449826  8986 raft_consensus.cc:1275] T 825ea78cebec4b10a2f8d03b45d929fa P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Refusing update from remote peer 7d3072f2af0b481d94ed70632b90e8c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:58.453888  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17f01b356e04590838cc6e6bb27bf64" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:58.455235  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd6605b785643deac78902ee4fc6896" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:58.456669  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea64f4f4c54500a95692118660d9b4" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:58.458549  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7eec107ecc40f38d14871d9227b25f" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:58.461696  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45613c5d357b40b8af0ced6c8725c559" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:58.465304  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932e5cbccd33414f8b05280505fd8bc7" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:58.465904  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1fc430ae3d4315aad2c0eed2f026aa" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:58.466173  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80d602267cf421690d5fe6d3922e0cb" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:58.467664  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80fde6a0b6334446923248a50e223397" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:58.473527  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80d602267cf421690d5fe6d3922e0cb" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:58.475485  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc6e2639db63487cae6a125c8d5fe1d8" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
W20260709 13:16:58.477645  8810 consensus_peers.cc:597] T cc6e2639db63487cae6a125c8d5fe1d8 P 7d3072f2af0b481d94ed70632b90e8c6 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:58.478149  8810 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:39173, user_credentials={real_user=slave}} blocked reactor thread for 208157us
I20260709 13:16:58.480480  8916 raft_consensus.cc:1275] T 68650af2b1894208a4cc0a1c6ddf880b P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Refusing update from remote peer e8bb7e1240f44fda8b83e4c124852032: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:58.481957  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7eec107ecc40f38d14871d9227b25f" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:58.482528  9624 consensus_queue.cc:1048] T 825ea78cebec4b10a2f8d03b45d929fa P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:58.486200  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fdcbb0a74a64826ab0665c349b16200" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:58.490852  9555 leader_election.cc:304] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032
W20260709 13:16:58.491699  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:46105, user_credentials={real_user=slave}} blocked reactor thread for 105254us
I20260709 13:16:58.492394  9555 leader_election.cc:304] T c17f01b356e04590838cc6e6bb27bf64 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6
I20260709 13:16:58.495457  9685 raft_consensus.cc:2749] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:58.497890  9555 leader_election.cc:304] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6
I20260709 13:16:58.499440  9563 raft_consensus.cc:2749] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:58.498581  9685 raft_consensus.cc:2749] T c17f01b356e04590838cc6e6bb27bf64 P 895d3c58761f427c9c5b3cb41246c243 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:58.501694  9555 leader_election.cc:304] T 9f7eec107ecc40f38d14871d9227b25f P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6
I20260709 13:16:58.502923  9685 raft_consensus.cc:2749] T 9f7eec107ecc40f38d14871d9227b25f P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:58.505355  9555 leader_election.cc:304] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6
I20260709 13:16:58.506224  9685 raft_consensus.cc:2749] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:58.515913  9612 consensus_queue.cc:1048] T f46053ed2641458a87c97152e4979c35 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:16:58.520932  9547 consensus_queue.cc:1048] T 68650af2b1894208a4cc0a1c6ddf880b P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:16:58.534811  8958 consensus_peers.cc:597] T 852f0ef4508245e2812b76665a70bbf8 P e8bb7e1240f44fda8b83e4c124852032 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:58.535969  8958 consensus_peers.cc:597] T 8a25176ebf484df29f67908cfa6e2b48 P e8bb7e1240f44fda8b83e4c124852032 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:58.530036  8664 catalog_manager.cc:5697] T 9f7eec107ecc40f38d14871d9227b25f P 7d3072f2af0b481d94ed70632b90e8c6 reported cstate change: term changed from 1 to 2, leader changed from 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193) to 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194). New cstate: current_term: 2 leader_uuid: "7d3072f2af0b481d94ed70632b90e8c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:58.548700  9555 leader_election.cc:304] T f3ea64f4f4c54500a95692118660d9b4 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6
I20260709 13:16:58.553903  9555 leader_election.cc:304] T 932e5cbccd33414f8b05280505fd8bc7 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6
I20260709 13:16:58.554644  9685 raft_consensus.cc:2749] T f3ea64f4f4c54500a95692118660d9b4 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:58.555418  9685 raft_consensus.cc:2749] T 932e5cbccd33414f8b05280505fd8bc7 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:58.555485  9555 leader_election.cc:304] T ae1fc430ae3d4315aad2c0eed2f026aa P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:58.556841  8664 catalog_manager.cc:5697] T 932e5cbccd33414f8b05280505fd8bc7 P 7d3072f2af0b481d94ed70632b90e8c6 reported cstate change: term changed from 1 to 2, leader changed from 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193) to 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194). New cstate: current_term: 2 leader_uuid: "7d3072f2af0b481d94ed70632b90e8c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:58.567883  8664 catalog_manager.cc:5697] T cc6e2639db63487cae6a125c8d5fe1d8 P 7d3072f2af0b481d94ed70632b90e8c6 reported cstate change: term changed from 1 to 2, leader changed from 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193) to 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194). New cstate: current_term: 2 leader_uuid: "7d3072f2af0b481d94ed70632b90e8c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:58.569909  9555 leader_election.cc:304] T 80fde6a0b6334446923248a50e223397 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:58.570767  9685 raft_consensus.cc:2749] T 80fde6a0b6334446923248a50e223397 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:58.560020  9563 raft_consensus.cc:2749] T ae1fc430ae3d4315aad2c0eed2f026aa P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:16:58.578873  8958 consensus_peers.cc:597] T 448f6ffb482841a3b489476becf2f851 P e8bb7e1240f44fda8b83e4c124852032 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:58.571324  9555 leader_election.cc:304] T f80d602267cf421690d5fe6d3922e0cb P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6
I20260709 13:16:58.574460  8664 catalog_manager.cc:5697] T d46902173b5c4283b315c6def6f13c31 P 7d3072f2af0b481d94ed70632b90e8c6 reported cstate change: term changed from 1 to 2, leader changed from 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193) to 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194). New cstate: current_term: 2 leader_uuid: "7d3072f2af0b481d94ed70632b90e8c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:58.624246  8810 consensus_peers.cc:597] T 65900ac9e06944639fe557200317fe05 P 7d3072f2af0b481d94ed70632b90e8c6 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:58.649894  8810 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:39173, user_credentials={real_user=slave}} blocked reactor thread for 91711.4us
W20260709 13:16:58.650404  8810 consensus_peers.cc:597] T f3abbeb71eba411bb6dfec800d3bd9c0 P 7d3072f2af0b481d94ed70632b90e8c6 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:58.650969  8810 consensus_peers.cc:597] T 825ea78cebec4b10a2f8d03b45d929fa P 7d3072f2af0b481d94ed70632b90e8c6 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:58.652076  8810 consensus_peers.cc:597] T 932e5cbccd33414f8b05280505fd8bc7 P 7d3072f2af0b481d94ed70632b90e8c6 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:58.626291  9563 raft_consensus.cc:2749] T f80d602267cf421690d5fe6d3922e0cb P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:58.661013  8664 catalog_manager.cc:5697] T 825ea78cebec4b10a2f8d03b45d929fa P 7d3072f2af0b481d94ed70632b90e8c6 reported cstate change: term changed from 1 to 2, leader changed from 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193) to 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194). New cstate: current_term: 2 leader_uuid: "7d3072f2af0b481d94ed70632b90e8c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:58.647423  8958 consensus_peers.cc:597] T 69e5f8bfdb5a46808e713e051a38866d P e8bb7e1240f44fda8b83e4c124852032 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:58.665539  8958 consensus_peers.cc:597] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:58.634590  9558 tablet_bootstrap.cc:492] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:16:58.651610  9555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.195:37671, user_credentials={real_user=slave}} blocked reactor thread for 77963.6us
I20260709 13:16:58.665768  8664 catalog_manager.cc:5697] T 65900ac9e06944639fe557200317fe05 P 7d3072f2af0b481d94ed70632b90e8c6 reported cstate change: term changed from 1 to 2, leader changed from 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193) to 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194). New cstate: current_term: 2 leader_uuid: "7d3072f2af0b481d94ed70632b90e8c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:58.692943  9558 tablet_bootstrap.cc:492] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap complete.
I20260709 13:16:58.694308  9558 ts_tablet_manager.cc:1403] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.320s	user 0.035s	sys 0.017s
W20260709 13:16:58.688081  8958 consensus_peers.cc:597] T 1521cafcc31b47c58829494618fc0cd8 P e8bb7e1240f44fda8b83e4c124852032 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:58.697412  8958 consensus_peers.cc:597] T ed4d847e589942fcbf6dadbb578327f2 P e8bb7e1240f44fda8b83e4c124852032 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:58.699983  8958 consensus_peers.cc:597] T 68650af2b1894208a4cc0a1c6ddf880b P e8bb7e1240f44fda8b83e4c124852032 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:58.719086  8810 consensus_peers.cc:597] T 390c483b2a1c42b897e166b1a381851c P 7d3072f2af0b481d94ed70632b90e8c6 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:58.706689  9555 leader_election.cc:304] T cc6e2639db63487cae6a125c8d5fe1d8 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6
I20260709 13:16:58.722790  9665 raft_consensus.cc:2749] T cc6e2639db63487cae6a125c8d5fe1d8 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:16:58.740530  8810 consensus_peers.cc:597] T d46902173b5c4283b315c6def6f13c31 P 7d3072f2af0b481d94ed70632b90e8c6 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:58.753151  9555 leader_election.cc:304] T 9fdcbb0a74a64826ab0665c349b16200 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032
I20260709 13:16:58.754567  9665 raft_consensus.cc:2749] T 9fdcbb0a74a64826ab0665c349b16200 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:58.755028  8839 raft_consensus.cc:1275] T 3f0c32d9abf04206a6f08210b3a30794 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Refusing update from remote peer e8bb7e1240f44fda8b83e4c124852032: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:58.767925  9696 consensus_queue.cc:1048] T 3f0c32d9abf04206a6f08210b3a30794 P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:16:58.780360  9558 raft_consensus.cc:359] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:58.781214  9558 raft_consensus.cc:740] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.796307  9558 consensus_queue.cc:260] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:58.803200  9558 ts_tablet_manager.cc:1434] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.109s	user 0.006s	sys 0.002s
I20260709 13:16:58.806581  9558 tablet_bootstrap.cc:492] T ab679ea0af724bd39f753eb407c73264 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:58.796842  9665 raft_consensus.cc:493] T ef723f9c640849d3890c61c07ffd0378 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.820873  9665 raft_consensus.cc:515] T ef723f9c640849d3890c61c07ffd0378 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:16:58.834257  9665 leader_election.cc:290] T ef723f9c640849d3890c61c07ffd0378 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:16:58.843693  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef723f9c640849d3890c61c07ffd0378" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6" is_pre_election: true
I20260709 13:16:58.845459  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef723f9c640849d3890c61c07ffd0378" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:16:58.850121  9553 leader_election.cc:304] T ef723f9c640849d3890c61c07ffd0378 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6
I20260709 13:16:58.851497  9665 raft_consensus.cc:2749] T ef723f9c640849d3890c61c07ffd0378 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:16:58.908033  8958 consensus_peers.cc:597] T 2945a5b174e14a5a9052897942f876c2 P e8bb7e1240f44fda8b83e4c124852032 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:58.912674  8667 catalog_manager.cc:5697] T 3f0c32d9abf04206a6f08210b3a30794 P e8bb7e1240f44fda8b83e4c124852032 reported cstate change: term changed from 1 to 2, leader changed from 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193) to e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196). New cstate: current_term: 2 leader_uuid: "e8bb7e1240f44fda8b83e4c124852032" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:58.920014  8958 consensus_peers.cc:597] T 3f0c32d9abf04206a6f08210b3a30794 P e8bb7e1240f44fda8b83e4c124852032 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:58.926940  8959 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37671, user_credentials={real_user=slave}} blocked reactor thread for 86417.5us
I20260709 13:16:58.960662  9558 tablet_bootstrap.cc:492] T ab679ea0af724bd39f753eb407c73264 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:58.961912  9558 tablet_bootstrap.cc:492] T ab679ea0af724bd39f753eb407c73264 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap complete.
I20260709 13:16:58.962692  9558 ts_tablet_manager.cc:1403] T ab679ea0af724bd39f753eb407c73264 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.156s	user 0.014s	sys 0.004s
I20260709 13:16:58.969169  9558 raft_consensus.cc:359] T ab679ea0af724bd39f753eb407c73264 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:58.970057  9558 raft_consensus.cc:740] T ab679ea0af724bd39f753eb407c73264 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.973457  9558 consensus_queue.cc:260] T ab679ea0af724bd39f753eb407c73264 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:58.979967  9558 ts_tablet_manager.cc:1434] T ab679ea0af724bd39f753eb407c73264 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.001s
I20260709 13:16:58.980902  9558 tablet_bootstrap.cc:492] T 2945a5b174e14a5a9052897942f876c2 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:58.999281  9737 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.198.193:39173 every 8 connection(s)
I20260709 13:16:59.086627  2843 rpc_server.cc:307] RPC server started. Bound to: 127.2.198.193:39173
I20260709 13:16:59.213527  9558 tablet_bootstrap.cc:492] T 2945a5b174e14a5a9052897942f876c2 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:59.214807  9558 tablet_bootstrap.cc:492] T 2945a5b174e14a5a9052897942f876c2 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap complete.
I20260709 13:16:59.215610  9558 ts_tablet_manager.cc:1403] T 2945a5b174e14a5a9052897942f876c2 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.235s	user 0.024s	sys 0.015s
I20260709 13:16:59.218899  9558 raft_consensus.cc:359] T 2945a5b174e14a5a9052897942f876c2 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:59.219933  9558 raft_consensus.cc:740] T 2945a5b174e14a5a9052897942f876c2 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:16:59.220937  9558 consensus_queue.cc:260] T 2945a5b174e14a5a9052897942f876c2 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:59.224632  9558 ts_tablet_manager.cc:1434] T 2945a5b174e14a5a9052897942f876c2 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:16:59.225937  9558 tablet_bootstrap.cc:492] T dde08046aca642488918d1f2b978c126 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:16:59.255828  9625 raft_consensus.cc:3060] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:59.285097  9629 raft_consensus.cc:3060] T cc6e2639db63487cae6a125c8d5fe1d8 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:59.301476  9615 raft_consensus.cc:3060] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:59.364481  9614 raft_consensus.cc:3060] T 9f7eec107ecc40f38d14871d9227b25f P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:59.421679  9615 raft_consensus.cc:3060] T 932e5cbccd33414f8b05280505fd8bc7 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:59.629858  9558 tablet_bootstrap.cc:492] T dde08046aca642488918d1f2b978c126 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:59.638136  9558 tablet_bootstrap.cc:492] T dde08046aca642488918d1f2b978c126 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap complete.
I20260709 13:16:59.660444  9558 ts_tablet_manager.cc:1403] T dde08046aca642488918d1f2b978c126 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.435s	user 0.094s	sys 0.092s
W20260709 13:16:59.689129  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:46105, user_credentials={real_user=slave}} blocked reactor thread for 81471.6us
I20260709 13:16:59.723160  9558 raft_consensus.cc:359] T dde08046aca642488918d1f2b978c126 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:59.724282  9558 raft_consensus.cc:740] T dde08046aca642488918d1f2b978c126 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
W20260709 13:16:59.727922  8957 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:35315, user_credentials={real_user=slave}} blocked reactor thread for 99749.4us
W20260709 13:16:59.729038  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:46105, user_credentials={real_user=slave}} blocked reactor thread for 121082us
I20260709 13:16:59.729815  9558 consensus_queue.cc:260] T dde08046aca642488918d1f2b978c126 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:16:59.742038  9558 ts_tablet_manager.cc:1434] T dde08046aca642488918d1f2b978c126 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.081s	user 0.008s	sys 0.000s
I20260709 13:16:59.761940  9615 raft_consensus.cc:3060] T ab679ea0af724bd39f753eb407c73264 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:59.776103  9629 raft_consensus.cc:3060] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:59.817519  8884 consensus_peers.cc:597] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:59.865760  9602 raft_consensus.cc:3060] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:59.966109  9606 raft_consensus.cc:3060] T ef723f9c640849d3890c61c07ffd0378 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:00.041579  9740 heartbeater.cc:344] Connected to a master server at 127.2.198.254:33107
I20260709 13:17:00.042282  9740 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:00.043305  9740 heartbeater.cc:507] Master 127.2.198.254:33107 requested a full tablet report, sending...
I20260709 13:17:00.052579  9558 tablet_bootstrap.cc:492] T 17e47826fe4e4662baba1d095c341c1b P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
W20260709 13:17:00.058830  8810 consensus_peers.cc:597] T 675795627b9b4542805157dd7ec531cd P 7d3072f2af0b481d94ed70632b90e8c6 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:17:00.090444  8668 ts_manager.cc:194] Re-registered known tserver with Master: 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
W20260709 13:17:00.150189  8884 consensus_peers.cc:597] T d09ffcae84334482a706af1e812c7c9d P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:17:00.161734  9558 tablet_bootstrap.cc:492] T 17e47826fe4e4662baba1d095c341c1b P 895d3c58761f427c9c5b3cb41246c243: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:00.163069  9558 tablet_bootstrap.cc:492] T 17e47826fe4e4662baba1d095c341c1b P 895d3c58761f427c9c5b3cb41246c243: Bootstrap complete.
I20260709 13:17:00.163931  9558 ts_tablet_manager.cc:1403] T 17e47826fe4e4662baba1d095c341c1b P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.112s	user 0.016s	sys 0.008s
I20260709 13:17:00.167595  9558 raft_consensus.cc:359] T 17e47826fe4e4662baba1d095c341c1b P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:17:00.168363  9558 raft_consensus.cc:740] T 17e47826fe4e4662baba1d095c341c1b P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:17:00.169478  9558 consensus_queue.cc:260] T 17e47826fe4e4662baba1d095c341c1b P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:17:00.176363  9558 ts_tablet_manager.cc:1434] T 17e47826fe4e4662baba1d095c341c1b P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:17:00.177299  9558 tablet_bootstrap.cc:492] T 448f6ffb482841a3b489476becf2f851 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:17:00.185705  8668 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48074
I20260709 13:17:00.192005  9740 heartbeater.cc:499] Master 127.2.198.254:33107 was elected leader, sending a full tablet report...
I20260709 13:17:00.193666  9558 tablet_bootstrap.cc:492] T 448f6ffb482841a3b489476becf2f851 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:00.194661  9558 tablet_bootstrap.cc:492] T 448f6ffb482841a3b489476becf2f851 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap complete.
I20260709 13:17:00.195421  9558 ts_tablet_manager.cc:1403] T 448f6ffb482841a3b489476becf2f851 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.001s
I20260709 13:17:00.198408  9558 raft_consensus.cc:359] T 448f6ffb482841a3b489476becf2f851 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:17:00.199141  9558 raft_consensus.cc:740] T 448f6ffb482841a3b489476becf2f851 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:17:00.199963  9558 consensus_queue.cc:260] T 448f6ffb482841a3b489476becf2f851 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:17:00.202207  9558 ts_tablet_manager.cc:1434] T 448f6ffb482841a3b489476becf2f851 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:17:00.205482  9558 tablet_bootstrap.cc:492] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:17:00.220736  9558 tablet_bootstrap.cc:492] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:00.221724  9558 tablet_bootstrap.cc:492] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap complete.
I20260709 13:17:00.222942  9558 ts_tablet_manager.cc:1403] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.017s	user 0.016s	sys 0.000s
I20260709 13:17:00.225760  9558 raft_consensus.cc:359] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:17:00.226490  9558 raft_consensus.cc:740] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:17:00.227185  9558 consensus_queue.cc:260] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:17:00.229421  9558 ts_tablet_manager.cc:1434] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:17:00.230284  9558 tablet_bootstrap.cc:492] T 4e1e1e84d68946d682e0944fbd3c51a8 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:17:00.246670  9558 tablet_bootstrap.cc:492] T 4e1e1e84d68946d682e0944fbd3c51a8 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:00.247642  9558 tablet_bootstrap.cc:492] T 4e1e1e84d68946d682e0944fbd3c51a8 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap complete.
I20260709 13:17:00.248402  9558 ts_tablet_manager.cc:1403] T 4e1e1e84d68946d682e0944fbd3c51a8 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.018s	user 0.017s	sys 0.000s
I20260709 13:17:00.252734  9558 raft_consensus.cc:359] T 4e1e1e84d68946d682e0944fbd3c51a8 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:17:00.253535  9558 raft_consensus.cc:740] T 4e1e1e84d68946d682e0944fbd3c51a8 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:17:00.254262  9558 consensus_queue.cc:260] T 4e1e1e84d68946d682e0944fbd3c51a8 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:17:00.256634  9558 ts_tablet_manager.cc:1434] T 4e1e1e84d68946d682e0944fbd3c51a8 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:17:00.257556  9558 tablet_bootstrap.cc:492] T 1c9bb56a39d44b71b44c334e0bea59a5 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:17:00.274333  9558 tablet_bootstrap.cc:492] T 1c9bb56a39d44b71b44c334e0bea59a5 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:00.275460  9558 tablet_bootstrap.cc:492] T 1c9bb56a39d44b71b44c334e0bea59a5 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap complete.
I20260709 13:17:00.276314  9558 ts_tablet_manager.cc:1403] T 1c9bb56a39d44b71b44c334e0bea59a5 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.019s	user 0.018s	sys 0.000s
I20260709 13:17:00.279021  9558 raft_consensus.cc:359] T 1c9bb56a39d44b71b44c334e0bea59a5 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:00.279762  9558 raft_consensus.cc:740] T 1c9bb56a39d44b71b44c334e0bea59a5 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:17:00.280565  9558 consensus_queue.cc:260] T 1c9bb56a39d44b71b44c334e0bea59a5 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:00.282800  9558 ts_tablet_manager.cc:1434] T 1c9bb56a39d44b71b44c334e0bea59a5 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:17:00.283722  9558 tablet_bootstrap.cc:492] T f46053ed2641458a87c97152e4979c35 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:17:00.312932  9558 tablet_bootstrap.cc:492] T f46053ed2641458a87c97152e4979c35 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:00.314059  9558 tablet_bootstrap.cc:492] T f46053ed2641458a87c97152e4979c35 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap complete.
I20260709 13:17:00.314834  9558 ts_tablet_manager.cc:1403] T f46053ed2641458a87c97152e4979c35 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.031s	user 0.022s	sys 0.004s
I20260709 13:17:00.317539  9558 raft_consensus.cc:359] T f46053ed2641458a87c97152e4979c35 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:00.318229  9558 raft_consensus.cc:740] T f46053ed2641458a87c97152e4979c35 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:17:00.319013  9558 consensus_queue.cc:260] T f46053ed2641458a87c97152e4979c35 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:00.321398  9558 ts_tablet_manager.cc:1434] T f46053ed2641458a87c97152e4979c35 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:17:00.322877  9558 tablet_bootstrap.cc:492] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:17:00.338398  9558 tablet_bootstrap.cc:492] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 895d3c58761f427c9c5b3cb41246c243: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:00.339468  9558 tablet_bootstrap.cc:492] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 895d3c58761f427c9c5b3cb41246c243: Bootstrap complete.
I20260709 13:17:00.340235  9558 ts_tablet_manager.cc:1403] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 13:17:00.342911  9558 raft_consensus.cc:359] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:00.343462  9558 raft_consensus.cc:740] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:17:00.344377  9558 consensus_queue.cc:260] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:00.346717  9558 ts_tablet_manager.cc:1434] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:17:00.348289  9558 tablet_bootstrap.cc:492] T 3f0c32d9abf04206a6f08210b3a30794 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:17:00.364049  9558 tablet_bootstrap.cc:492] T 3f0c32d9abf04206a6f08210b3a30794 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:00.365151  9558 tablet_bootstrap.cc:492] T 3f0c32d9abf04206a6f08210b3a30794 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap complete.
I20260709 13:17:00.365949  9558 ts_tablet_manager.cc:1403] T 3f0c32d9abf04206a6f08210b3a30794 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.004s
I20260709 13:17:00.368573  9558 raft_consensus.cc:359] T 3f0c32d9abf04206a6f08210b3a30794 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:17:00.369163  9558 raft_consensus.cc:740] T 3f0c32d9abf04206a6f08210b3a30794 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:17:00.369838  9558 consensus_queue.cc:260] T 3f0c32d9abf04206a6f08210b3a30794 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:17:00.371526  9558 ts_tablet_manager.cc:1434] T 3f0c32d9abf04206a6f08210b3a30794 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.000s
I20260709 13:17:00.372283  9558 tablet_bootstrap.cc:492] T 825ea78cebec4b10a2f8d03b45d929fa P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:17:00.407235  9558 tablet_bootstrap.cc:492] T 825ea78cebec4b10a2f8d03b45d929fa P 895d3c58761f427c9c5b3cb41246c243: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:00.408157  9558 tablet_bootstrap.cc:492] T 825ea78cebec4b10a2f8d03b45d929fa P 895d3c58761f427c9c5b3cb41246c243: Bootstrap complete.
I20260709 13:17:00.408890  9558 ts_tablet_manager.cc:1403] T 825ea78cebec4b10a2f8d03b45d929fa P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.037s	user 0.023s	sys 0.003s
I20260709 13:17:00.410921  9558 raft_consensus.cc:359] T 825ea78cebec4b10a2f8d03b45d929fa P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:17:00.411456  9558 raft_consensus.cc:740] T 825ea78cebec4b10a2f8d03b45d929fa P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:17:00.412110  9558 consensus_queue.cc:260] T 825ea78cebec4b10a2f8d03b45d929fa P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:17:00.413743  9558 ts_tablet_manager.cc:1434] T 825ea78cebec4b10a2f8d03b45d929fa P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:17:00.414714  9558 tablet_bootstrap.cc:492] T 68650af2b1894208a4cc0a1c6ddf880b P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:17:00.429157  9558 tablet_bootstrap.cc:492] T 68650af2b1894208a4cc0a1c6ddf880b P 895d3c58761f427c9c5b3cb41246c243: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:00.430369  9558 tablet_bootstrap.cc:492] T 68650af2b1894208a4cc0a1c6ddf880b P 895d3c58761f427c9c5b3cb41246c243: Bootstrap complete.
I20260709 13:17:00.431149  9558 ts_tablet_manager.cc:1403] T 68650af2b1894208a4cc0a1c6ddf880b P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 13:17:00.433830  9558 raft_consensus.cc:359] T 68650af2b1894208a4cc0a1c6ddf880b P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:00.434648  9558 raft_consensus.cc:740] T 68650af2b1894208a4cc0a1c6ddf880b P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:17:00.441629  9558 consensus_queue.cc:260] T 68650af2b1894208a4cc0a1c6ddf880b P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:00.443447  9558 ts_tablet_manager.cc:1434] T 68650af2b1894208a4cc0a1c6ddf880b P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.003s
I20260709 13:17:00.444628  9558 tablet_bootstrap.cc:492] T 69e5f8bfdb5a46808e713e051a38866d P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:17:00.463999  9558 tablet_bootstrap.cc:492] T 69e5f8bfdb5a46808e713e051a38866d P 895d3c58761f427c9c5b3cb41246c243: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:00.465147  9558 tablet_bootstrap.cc:492] T 69e5f8bfdb5a46808e713e051a38866d P 895d3c58761f427c9c5b3cb41246c243: Bootstrap complete.
I20260709 13:17:00.465926  9558 ts_tablet_manager.cc:1403] T 69e5f8bfdb5a46808e713e051a38866d P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.004s
I20260709 13:17:00.468779  9558 raft_consensus.cc:359] T 69e5f8bfdb5a46808e713e051a38866d P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:17:00.469828  9558 raft_consensus.cc:740] T 69e5f8bfdb5a46808e713e051a38866d P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:17:00.471766  9558 consensus_queue.cc:260] T 69e5f8bfdb5a46808e713e051a38866d P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:17:00.472249  9606 raft_consensus.cc:3060] T f46053ed2641458a87c97152e4979c35 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:00.474364  9558 ts_tablet_manager.cc:1434] T 69e5f8bfdb5a46808e713e051a38866d P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:17:00.475485  9558 tablet_bootstrap.cc:492] T 45d9eb22dee8411b82eb768686e34604 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:17:00.498903  9558 tablet_bootstrap.cc:492] T 45d9eb22dee8411b82eb768686e34604 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:00.499989  9558 tablet_bootstrap.cc:492] T 45d9eb22dee8411b82eb768686e34604 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap complete.
I20260709 13:17:00.500727  9558 ts_tablet_manager.cc:1403] T 45d9eb22dee8411b82eb768686e34604 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.025s	user 0.020s	sys 0.002s
I20260709 13:17:00.503453  9558 raft_consensus.cc:359] T 45d9eb22dee8411b82eb768686e34604 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:00.504168  9558 raft_consensus.cc:740] T 45d9eb22dee8411b82eb768686e34604 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:17:00.504914  9558 consensus_queue.cc:260] T 45d9eb22dee8411b82eb768686e34604 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:00.507263  9558 ts_tablet_manager.cc:1434] T 45d9eb22dee8411b82eb768686e34604 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.005s
I20260709 13:17:00.508123  9558 tablet_bootstrap.cc:492] T 097c705b65de4abe884afdb1fcaaa054 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:17:00.519776  9606 raft_consensus.cc:3060] T 17e47826fe4e4662baba1d095c341c1b P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:00.524113  9558 tablet_bootstrap.cc:492] T 097c705b65de4abe884afdb1fcaaa054 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:00.525115  9558 tablet_bootstrap.cc:492] T 097c705b65de4abe884afdb1fcaaa054 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap complete.
I20260709 13:17:00.525811  9558 ts_tablet_manager.cc:1403] T 097c705b65de4abe884afdb1fcaaa054 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.005s
I20260709 13:17:00.528227  9558 raft_consensus.cc:359] T 097c705b65de4abe884afdb1fcaaa054 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:00.528787  9558 raft_consensus.cc:740] T 097c705b65de4abe884afdb1fcaaa054 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:17:00.529436  9558 consensus_queue.cc:260] T 097c705b65de4abe884afdb1fcaaa054 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:00.531745  9558 ts_tablet_manager.cc:1434] T 097c705b65de4abe884afdb1fcaaa054 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:17:00.532653  9558 tablet_bootstrap.cc:492] T d46902173b5c4283b315c6def6f13c31 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:17:00.543314  9606 raft_consensus.cc:3060] T 3f0c32d9abf04206a6f08210b3a30794 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:00.549583  9558 tablet_bootstrap.cc:492] T d46902173b5c4283b315c6def6f13c31 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:00.550683  9558 tablet_bootstrap.cc:492] T d46902173b5c4283b315c6def6f13c31 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap complete.
I20260709 13:17:00.551381  9558 ts_tablet_manager.cc:1403] T d46902173b5c4283b315c6def6f13c31 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.000s
I20260709 13:17:00.554183  9558 raft_consensus.cc:359] T d46902173b5c4283b315c6def6f13c31 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:17:00.554899  9558 raft_consensus.cc:740] T d46902173b5c4283b315c6def6f13c31 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:17:00.555693  9558 consensus_queue.cc:260] T d46902173b5c4283b315c6def6f13c31 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:17:00.558004  9558 ts_tablet_manager.cc:1434] T d46902173b5c4283b315c6def6f13c31 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:17:00.558833  9558 tablet_bootstrap.cc:492] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
W20260709 13:17:00.559185  9014 debug-util.cc:398] Leaking SignalData structure 0x7b080017bfe0 after lost signal to thread 2846
W20260709 13:17:00.560606  8884 consensus_peers.cc:597] T 7bcde3fdb9314ca4b3422d395a673be5 P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:00.561937  9014 debug-util.cc:398] Leaking SignalData structure 0x7b08000cab80 after lost signal to thread 8869
W20260709 13:17:00.565259  9014 debug-util.cc:398] Leaking SignalData structure 0x7b0800323fc0 after lost signal to thread 8943
I20260709 13:17:00.567342  9606 raft_consensus.cc:3060] T d46902173b5c4283b315c6def6f13c31 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:00.573676  9014 debug-util.cc:398] Leaking SignalData structure 0x7b08000f2320 after lost signal to thread 9017
I20260709 13:17:00.615087  9558 tablet_bootstrap.cc:492] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:00.616206  9558 tablet_bootstrap.cc:492] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap complete.
I20260709 13:17:00.617018  9558 ts_tablet_manager.cc:1403] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.058s	user 0.036s	sys 0.020s
I20260709 13:17:00.619547  9558 raft_consensus.cc:359] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:17:00.620285  9558 raft_consensus.cc:740] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
W20260709 13:17:00.620398  8884 consensus_peers.cc:597] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:17:00.621065  9558 consensus_queue.cc:260] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:17:00.623603  9558 ts_tablet_manager.cc:1434] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 13:17:00.624538  9558 tablet_bootstrap.cc:492] T 1521cafcc31b47c58829494618fc0cd8 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:17:00.653402  9558 tablet_bootstrap.cc:492] T 1521cafcc31b47c58829494618fc0cd8 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:00.654551  9558 tablet_bootstrap.cc:492] T 1521cafcc31b47c58829494618fc0cd8 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap complete.
I20260709 13:17:00.655308  9558 ts_tablet_manager.cc:1403] T 1521cafcc31b47c58829494618fc0cd8 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.031s	user 0.022s	sys 0.005s
I20260709 13:17:00.658224  9558 raft_consensus.cc:359] T 1521cafcc31b47c58829494618fc0cd8 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:17:00.658788  9558 raft_consensus.cc:740] T 1521cafcc31b47c58829494618fc0cd8 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:17:00.659430  9558 consensus_queue.cc:260] T 1521cafcc31b47c58829494618fc0cd8 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:17:00.661252  9558 ts_tablet_manager.cc:1434] T 1521cafcc31b47c58829494618fc0cd8 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:17:00.663380  9558 tablet_bootstrap.cc:492] T 574915613e8a4d3481aef27d3a977caa P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:17:00.682703  9629 raft_consensus.cc:3060] T 45d9eb22dee8411b82eb768686e34604 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:00.684953  9558 tablet_bootstrap.cc:492] T 574915613e8a4d3481aef27d3a977caa P 895d3c58761f427c9c5b3cb41246c243: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:00.686434  9558 tablet_bootstrap.cc:492] T 574915613e8a4d3481aef27d3a977caa P 895d3c58761f427c9c5b3cb41246c243: Bootstrap complete.
I20260709 13:17:00.687237  9558 ts_tablet_manager.cc:1403] T 574915613e8a4d3481aef27d3a977caa P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.004s
I20260709 13:17:00.690104  9558 raft_consensus.cc:359] T 574915613e8a4d3481aef27d3a977caa P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:00.690864  9558 raft_consensus.cc:740] T 574915613e8a4d3481aef27d3a977caa P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:17:00.691738  9558 consensus_queue.cc:260] T 574915613e8a4d3481aef27d3a977caa P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:00.693921  9558 ts_tablet_manager.cc:1434] T 574915613e8a4d3481aef27d3a977caa P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:17:00.695283  9558 tablet_bootstrap.cc:492] T 4352fad232ab47588683e51cf4b62080 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:17:00.716715  9629 raft_consensus.cc:3060] T 825ea78cebec4b10a2f8d03b45d929fa P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:00.765622  9558 tablet_bootstrap.cc:492] T 4352fad232ab47588683e51cf4b62080 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:00.767252  9558 tablet_bootstrap.cc:492] T 4352fad232ab47588683e51cf4b62080 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap complete.
I20260709 13:17:00.769430  9558 ts_tablet_manager.cc:1403] T 4352fad232ab47588683e51cf4b62080 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.074s	user 0.031s	sys 0.038s
I20260709 13:17:00.772521  9558 raft_consensus.cc:359] T 4352fad232ab47588683e51cf4b62080 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:00.773360  9558 raft_consensus.cc:740] T 4352fad232ab47588683e51cf4b62080 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:17:00.774190  9558 consensus_queue.cc:260] T 4352fad232ab47588683e51cf4b62080 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:00.775907  9558 ts_tablet_manager.cc:1434] T 4352fad232ab47588683e51cf4b62080 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:17:00.776832  9558 tablet_bootstrap.cc:492] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:17:00.781999  9629 raft_consensus.cc:3060] T 68650af2b1894208a4cc0a1c6ddf880b P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:00.792573  8810 consensus_peers.cc:597] T f3abbeb71eba411bb6dfec800d3bd9c0 P 7d3072f2af0b481d94ed70632b90e8c6 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:17:00.809535  9558 tablet_bootstrap.cc:492] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:00.810762  9558 tablet_bootstrap.cc:492] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap complete.
I20260709 13:17:00.811647  9558 ts_tablet_manager.cc:1403] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.035s	user 0.023s	sys 0.007s
I20260709 13:17:00.816313  9558 raft_consensus.cc:359] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:17:00.817775  9558 raft_consensus.cc:740] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:17:00.818676  9558 consensus_queue.cc:260] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:17:00.821266  9558 ts_tablet_manager.cc:1434] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:17:00.822165  9558 tablet_bootstrap.cc:492] T 7bcde3fdb9314ca4b3422d395a673be5 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:17:00.857075  9558 tablet_bootstrap.cc:492] T 7bcde3fdb9314ca4b3422d395a673be5 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:00.858316  9558 tablet_bootstrap.cc:492] T 7bcde3fdb9314ca4b3422d395a673be5 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap complete.
I20260709 13:17:00.859145  9558 ts_tablet_manager.cc:1403] T 7bcde3fdb9314ca4b3422d395a673be5 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.037s	user 0.019s	sys 0.012s
I20260709 13:17:00.863595  9558 raft_consensus.cc:359] T 7bcde3fdb9314ca4b3422d395a673be5 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:17:00.864451  9558 raft_consensus.cc:740] T 7bcde3fdb9314ca4b3422d395a673be5 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:17:00.865612  9558 consensus_queue.cc:260] T 7bcde3fdb9314ca4b3422d395a673be5 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:17:00.868227  9558 ts_tablet_manager.cc:1434] T 7bcde3fdb9314ca4b3422d395a673be5 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:17:00.869191  9558 tablet_bootstrap.cc:492] T d09ffcae84334482a706af1e812c7c9d P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:17:00.898471  9558 tablet_bootstrap.cc:492] T d09ffcae84334482a706af1e812c7c9d P 895d3c58761f427c9c5b3cb41246c243: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:00.899966  9558 tablet_bootstrap.cc:492] T d09ffcae84334482a706af1e812c7c9d P 895d3c58761f427c9c5b3cb41246c243: Bootstrap complete.
I20260709 13:17:00.900831  9558 ts_tablet_manager.cc:1403] T d09ffcae84334482a706af1e812c7c9d P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.008s
I20260709 13:17:00.910787  9558 raft_consensus.cc:359] T d09ffcae84334482a706af1e812c7c9d P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:17:00.911623  9558 raft_consensus.cc:740] T d09ffcae84334482a706af1e812c7c9d P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:17:00.912385  9558 consensus_queue.cc:260] T d09ffcae84334482a706af1e812c7c9d P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:17:00.915123  9558 ts_tablet_manager.cc:1434] T d09ffcae84334482a706af1e812c7c9d P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:17:00.925400  9558 tablet_bootstrap.cc:492] T ed4d847e589942fcbf6dadbb578327f2 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:17:00.990113  9558 tablet_bootstrap.cc:492] T ed4d847e589942fcbf6dadbb578327f2 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:00.991458  9558 tablet_bootstrap.cc:492] T ed4d847e589942fcbf6dadbb578327f2 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap complete.
I20260709 13:17:00.992391  9558 ts_tablet_manager.cc:1403] T ed4d847e589942fcbf6dadbb578327f2 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.067s	user 0.015s	sys 0.023s
I20260709 13:17:00.995935  9558 raft_consensus.cc:359] T ed4d847e589942fcbf6dadbb578327f2 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:17:00.996731  9558 raft_consensus.cc:740] T ed4d847e589942fcbf6dadbb578327f2 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:17:00.997537  9558 consensus_queue.cc:260] T ed4d847e589942fcbf6dadbb578327f2 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:17:01.019110  9558 ts_tablet_manager.cc:1434] T ed4d847e589942fcbf6dadbb578327f2 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:17:01.020218  9558 tablet_bootstrap.cc:492] T 675795627b9b4542805157dd7ec531cd P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:17:01.052209  9606 raft_consensus.cc:3060] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:01.065624  9558 tablet_bootstrap.cc:492] T 675795627b9b4542805157dd7ec531cd P 895d3c58761f427c9c5b3cb41246c243: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:01.067150  9558 tablet_bootstrap.cc:492] T 675795627b9b4542805157dd7ec531cd P 895d3c58761f427c9c5b3cb41246c243: Bootstrap complete.
I20260709 13:17:01.067962  9558 ts_tablet_manager.cc:1403] T 675795627b9b4542805157dd7ec531cd P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.048s	user 0.024s	sys 0.000s
I20260709 13:17:01.071007  9558 raft_consensus.cc:359] T 675795627b9b4542805157dd7ec531cd P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:17:01.071894  9558 raft_consensus.cc:740] T 675795627b9b4542805157dd7ec531cd P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:17:01.072772  9558 consensus_queue.cc:260] T 675795627b9b4542805157dd7ec531cd P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:17:01.075527  9558 ts_tablet_manager.cc:1434] T 675795627b9b4542805157dd7ec531cd P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:17:01.076447  9558 tablet_bootstrap.cc:492] T f3abbeb71eba411bb6dfec800d3bd9c0 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:17:01.104657  9558 tablet_bootstrap.cc:492] T f3abbeb71eba411bb6dfec800d3bd9c0 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:01.106122  9558 tablet_bootstrap.cc:492] T f3abbeb71eba411bb6dfec800d3bd9c0 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap complete.
I20260709 13:17:01.107012  9558 ts_tablet_manager.cc:1403] T f3abbeb71eba411bb6dfec800d3bd9c0 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.009s
I20260709 13:17:01.109833  9558 raft_consensus.cc:359] T f3abbeb71eba411bb6dfec800d3bd9c0 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:17:01.110643  9558 raft_consensus.cc:740] T f3abbeb71eba411bb6dfec800d3bd9c0 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:17:01.111420  9558 consensus_queue.cc:260] T f3abbeb71eba411bb6dfec800d3bd9c0 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:17:01.113097  9558 ts_tablet_manager.cc:1434] T f3abbeb71eba411bb6dfec800d3bd9c0 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:17:01.114004  9558 tablet_bootstrap.cc:492] T 8a25176ebf484df29f67908cfa6e2b48 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap starting.
I20260709 13:17:01.137746  9558 tablet_bootstrap.cc:492] T 8a25176ebf484df29f67908cfa6e2b48 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:01.139124  9558 tablet_bootstrap.cc:492] T 8a25176ebf484df29f67908cfa6e2b48 P 895d3c58761f427c9c5b3cb41246c243: Bootstrap complete.
I20260709 13:17:01.140023  9558 ts_tablet_manager.cc:1403] T 8a25176ebf484df29f67908cfa6e2b48 P 895d3c58761f427c9c5b3cb41246c243: Time spent bootstrapping tablet: real 0.026s	user 0.019s	sys 0.004s
I20260709 13:17:01.142794  9558 raft_consensus.cc:359] T 8a25176ebf484df29f67908cfa6e2b48 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:17:01.143771  9558 raft_consensus.cc:740] T 8a25176ebf484df29f67908cfa6e2b48 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Initialized, Role: FOLLOWER
I20260709 13:17:01.144680  9558 consensus_queue.cc:260] T 8a25176ebf484df29f67908cfa6e2b48 P 895d3c58761f427c9c5b3cb41246c243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:17:01.164024  9558 ts_tablet_manager.cc:1434] T 8a25176ebf484df29f67908cfa6e2b48 P 895d3c58761f427c9c5b3cb41246c243: Time spent starting tablet: real 0.024s	user 0.014s	sys 0.009s
W20260709 13:17:02.006609  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:39173, user_credentials={real_user=slave}} blocked reactor thread for 46997.4us
I20260709 13:17:09.146348  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:09.203480  8913 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d5284f5b067413e9fc2a383cc318735"
dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
mode: GRACEFUL
new_leader_uuid: "895d3c58761f427c9c5b3cb41246c243"
 from {username='slave'} at 127.0.0.1:37268
I20260709 13:17:09.204303  8913 raft_consensus.cc:606] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 LEADER]: Received request to transfer leadership to TS 895d3c58761f427c9c5b3cb41246c243
I20260709 13:17:09.217046  8839 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "359d64d36e684763884c576f961f829d"
dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
mode: GRACEFUL
new_leader_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
 from {username='slave'} at 127.0.0.1:53176
I20260709 13:17:09.217588  8839 raft_consensus.cc:606] T 359d64d36e684763884c576f961f829d P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 LEADER]: Received request to transfer leadership to TS 43c6faa9496d44dda6b6eaed09cdfd12
I20260709 13:17:09.220201  8913 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "485b2d9b05744b4f9a22e8f0e8b66e0d"
dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
mode: GRACEFUL
new_leader_uuid: "895d3c58761f427c9c5b3cb41246c243"
 from {username='slave'} at 127.0.0.1:37268
I20260709 13:17:09.220702  8913 raft_consensus.cc:606] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Received request to transfer leadership to TS 895d3c58761f427c9c5b3cb41246c243
I20260709 13:17:09.223148  8913 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "574915613e8a4d3481aef27d3a977caa"
dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
mode: GRACEFUL
new_leader_uuid: "895d3c58761f427c9c5b3cb41246c243"
 from {username='slave'} at 127.0.0.1:37268
I20260709 13:17:09.223666  8913 raft_consensus.cc:606] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Received request to transfer leadership to TS 895d3c58761f427c9c5b3cb41246c243
I20260709 13:17:09.225917  8913 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67ea3c8e514f41549c3a96b74a9b5be9"
dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
mode: GRACEFUL
new_leader_uuid: "e8bb7e1240f44fda8b83e4c124852032"
 from {username='slave'} at 127.0.0.1:37268
I20260709 13:17:09.226377  8913 raft_consensus.cc:606] T 67ea3c8e514f41549c3a96b74a9b5be9 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Received request to transfer leadership to TS e8bb7e1240f44fda8b83e4c124852032
I20260709 13:17:09.228653  8913 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9fdcbb0a74a64826ab0665c349b16200"
dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
mode: GRACEFUL
new_leader_uuid: "895d3c58761f427c9c5b3cb41246c243"
 from {username='slave'} at 127.0.0.1:37268
I20260709 13:17:09.229166  8913 raft_consensus.cc:606] T 9fdcbb0a74a64826ab0665c349b16200 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Received request to transfer leadership to TS 895d3c58761f427c9c5b3cb41246c243
I20260709 13:17:09.230654  2843 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:17:09.232486  2843 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:09.327903  9826 raft_consensus.cc:993] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12: : Instructing follower 895d3c58761f427c9c5b3cb41246c243 to start an election
I20260709 13:17:09.328616  9834 raft_consensus.cc:1081] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Signalling peer 895d3c58761f427c9c5b3cb41246c243 to start an election
I20260709 13:17:09.330333  9615 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "574915613e8a4d3481aef27d3a977caa"
dest_uuid: "895d3c58761f427c9c5b3cb41246c243"
 from {username='slave'} at 127.0.0.1:37414
I20260709 13:17:09.330850  9615 raft_consensus.cc:493] T 574915613e8a4d3481aef27d3a977caa P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:09.331192  9615 raft_consensus.cc:3060] T 574915613e8a4d3481aef27d3a977caa P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:09.338503  9615 raft_consensus.cc:515] T 574915613e8a4d3481aef27d3a977caa P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:09.341027  9615 leader_election.cc:290] T 574915613e8a4d3481aef27d3a977caa P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 election: Requested vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:17:09.342238  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574915613e8a4d3481aef27d3a977caa" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
I20260709 13:17:09.342489  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574915613e8a4d3481aef27d3a977caa" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:17:09.343250  8992 raft_consensus.cc:3060] T 574915613e8a4d3481aef27d3a977caa P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:09.343298  8913 raft_consensus.cc:3055] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:09.343822  8913 raft_consensus.cc:740] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Running, Role: LEADER
I20260709 13:17:09.344635  8913 consensus_queue.cc:260] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:09.345754  8913 raft_consensus.cc:3060] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:09.349386  8992 raft_consensus.cc:2468] T 574915613e8a4d3481aef27d3a977caa P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 2.
I20260709 13:17:09.354235  9552 leader_election.cc:304] T 574915613e8a4d3481aef27d3a977caa P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:17:09.354007  8913 raft_consensus.cc:2468] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 2.
I20260709 13:17:09.360239  9835 raft_consensus.cc:2804] T 574915613e8a4d3481aef27d3a977caa P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:09.363874  9835 raft_consensus.cc:697] T 574915613e8a4d3481aef27d3a977caa P 895d3c58761f427c9c5b3cb41246c243 [term 2 LEADER]: Becoming Leader. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Running, Role: LEADER
I20260709 13:17:09.365041  9835 consensus_queue.cc:237] T 574915613e8a4d3481aef27d3a977caa P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:09.367246  9834 raft_consensus.cc:993] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12: : Instructing follower 895d3c58761f427c9c5b3cb41246c243 to start an election
I20260709 13:17:09.368039  9823 raft_consensus.cc:1081] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 LEADER]: Signalling peer 895d3c58761f427c9c5b3cb41246c243 to start an election
I20260709 13:17:09.371749  9629 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d5284f5b067413e9fc2a383cc318735"
dest_uuid: "895d3c58761f427c9c5b3cb41246c243"
 from {username='slave'} at 127.0.0.1:37414
I20260709 13:17:09.372385  9629 raft_consensus.cc:493] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:09.372825  9629 raft_consensus.cc:3060] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:09.380270  9629 raft_consensus.cc:515] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:17:09.383095  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5284f5b067413e9fc2a383cc318735" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
I20260709 13:17:09.383778  8839 raft_consensus.cc:3060] T 1d5284f5b067413e9fc2a383cc318735 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:09.384799  9629 leader_election.cc:290] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 3 election: Requested vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:17:09.389010  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5284f5b067413e9fc2a383cc318735" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:17:09.389779  8913 raft_consensus.cc:3055] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:09.388873  8667 catalog_manager.cc:5697] T 574915613e8a4d3481aef27d3a977caa P 895d3c58761f427c9c5b3cb41246c243 reported cstate change: term changed from 1 to 2, leader changed from 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195) to 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193). New cstate: current_term: 2 leader_uuid: "895d3c58761f427c9c5b3cb41246c243" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:09.390142  8913 raft_consensus.cc:740] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Running, Role: LEADER
I20260709 13:17:09.391279  8913 consensus_queue.cc:260] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:17:09.392768  8913 raft_consensus.cc:3060] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:09.392859  8839 raft_consensus.cc:2468] T 1d5284f5b067413e9fc2a383cc318735 P 7d3072f2af0b481d94ed70632b90e8c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 3.
I20260709 13:17:09.394467  9553 leader_election.cc:304] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6, 895d3c58761f427c9c5b3cb41246c243; no voters: 
I20260709 13:17:09.395489  9835 raft_consensus.cc:2804] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:09.396034  9835 raft_consensus.cc:697] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243 [term 3 LEADER]: Becoming Leader. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Running, Role: LEADER
I20260709 13:17:09.397018  9835 consensus_queue.cc:237] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:17:09.403038  8913 raft_consensus.cc:2468] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 3.
I20260709 13:17:09.418066  8667 catalog_manager.cc:5697] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243 reported cstate change: term changed from 2 to 3, leader changed from 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195) to 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193). New cstate: current_term: 3 leader_uuid: "895d3c58761f427c9c5b3cb41246c243" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:09.469197  9823 raft_consensus.cc:993] T 9fdcbb0a74a64826ab0665c349b16200 P 43c6faa9496d44dda6b6eaed09cdfd12: : Instructing follower 895d3c58761f427c9c5b3cb41246c243 to start an election
I20260709 13:17:09.469808  9834 raft_consensus.cc:1081] T 9fdcbb0a74a64826ab0665c349b16200 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Signalling peer 895d3c58761f427c9c5b3cb41246c243 to start an election
I20260709 13:17:09.471644  9629 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9fdcbb0a74a64826ab0665c349b16200"
dest_uuid: "895d3c58761f427c9c5b3cb41246c243"
 from {username='slave'} at 127.0.0.1:37414
I20260709 13:17:09.472241  9629 raft_consensus.cc:493] T 9fdcbb0a74a64826ab0665c349b16200 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:09.472615  9629 raft_consensus.cc:3060] T 9fdcbb0a74a64826ab0665c349b16200 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:09.480432  9629 raft_consensus.cc:515] T 9fdcbb0a74a64826ab0665c349b16200 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:09.482667  9629 leader_election.cc:290] T 9fdcbb0a74a64826ab0665c349b16200 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 election: Requested vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:17:09.483093  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fdcbb0a74a64826ab0665c349b16200" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:17:09.483722  8917 raft_consensus.cc:3055] T 9fdcbb0a74a64826ab0665c349b16200 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:09.484069  8917 raft_consensus.cc:740] T 9fdcbb0a74a64826ab0665c349b16200 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Running, Role: LEADER
I20260709 13:17:09.484589  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fdcbb0a74a64826ab0665c349b16200" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
I20260709 13:17:09.485278  8992 raft_consensus.cc:3060] T 9fdcbb0a74a64826ab0665c349b16200 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:09.484954  8917 consensus_queue.cc:260] T 9fdcbb0a74a64826ab0665c349b16200 P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:09.486583  8917 raft_consensus.cc:3060] T 9fdcbb0a74a64826ab0665c349b16200 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:09.492553  8992 raft_consensus.cc:2468] T 9fdcbb0a74a64826ab0665c349b16200 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 2.
I20260709 13:17:09.493897  9552 leader_election.cc:304] T 9fdcbb0a74a64826ab0665c349b16200 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:17:09.494695  9835 raft_consensus.cc:2804] T 9fdcbb0a74a64826ab0665c349b16200 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:09.494918  8917 raft_consensus.cc:2468] T 9fdcbb0a74a64826ab0665c349b16200 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 2.
I20260709 13:17:09.495172  9835 raft_consensus.cc:697] T 9fdcbb0a74a64826ab0665c349b16200 P 895d3c58761f427c9c5b3cb41246c243 [term 2 LEADER]: Becoming Leader. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Running, Role: LEADER
I20260709 13:17:09.496665  9835 consensus_queue.cc:237] T 9fdcbb0a74a64826ab0665c349b16200 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:09.507175  8667 catalog_manager.cc:5697] T 9fdcbb0a74a64826ab0665c349b16200 P 895d3c58761f427c9c5b3cb41246c243 reported cstate change: term changed from 1 to 2, leader changed from 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195) to 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193). New cstate: current_term: 2 leader_uuid: "895d3c58761f427c9c5b3cb41246c243" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:09.571337  9823 raft_consensus.cc:993] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12: : Instructing follower 895d3c58761f427c9c5b3cb41246c243 to start an election
I20260709 13:17:09.571928  9826 raft_consensus.cc:1081] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Signalling peer 895d3c58761f427c9c5b3cb41246c243 to start an election
I20260709 13:17:09.573679  9629 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "485b2d9b05744b4f9a22e8f0e8b66e0d"
dest_uuid: "895d3c58761f427c9c5b3cb41246c243"
 from {username='slave'} at 127.0.0.1:37414
I20260709 13:17:09.574822  9629 raft_consensus.cc:493] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:09.575213  9629 raft_consensus.cc:3060] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:09.582517  9622 raft_consensus.cc:993] T 359d64d36e684763884c576f961f829d P 7d3072f2af0b481d94ed70632b90e8c6: : Instructing follower 43c6faa9496d44dda6b6eaed09cdfd12 to start an election
I20260709 13:17:09.583320  9762 raft_consensus.cc:1081] T 359d64d36e684763884c576f961f829d P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 LEADER]: Signalling peer 43c6faa9496d44dda6b6eaed09cdfd12 to start an election
I20260709 13:17:09.583288  9629 raft_consensus.cc:515] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:09.585530  9629 leader_election.cc:290] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 election: Requested vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:17:09.585757  8917 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "359d64d36e684763884c576f961f829d"
dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
 from {username='slave'} at 127.0.0.1:51280
I20260709 13:17:09.586675  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "485b2d9b05744b4f9a22e8f0e8b66e0d" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:17:09.586990  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "485b2d9b05744b4f9a22e8f0e8b66e0d" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
I20260709 13:17:09.587388  8913 raft_consensus.cc:3055] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:09.587592  8992 raft_consensus.cc:3060] T 485b2d9b05744b4f9a22e8f0e8b66e0d P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:09.587839  8913 raft_consensus.cc:740] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Running, Role: LEADER
I20260709 13:17:09.588546  8913 consensus_queue.cc:260] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:09.589463  8913 raft_consensus.cc:3060] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:09.586493  8917 raft_consensus.cc:493] T 359d64d36e684763884c576f961f829d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:09.590505  8917 raft_consensus.cc:3060] T 359d64d36e684763884c576f961f829d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:09.594707  8992 raft_consensus.cc:2468] T 485b2d9b05744b4f9a22e8f0e8b66e0d P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 2.
I20260709 13:17:09.595687  9552 leader_election.cc:304] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:17:09.596421  9835 raft_consensus.cc:2804] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:09.598115  8917 raft_consensus.cc:515] T 359d64d36e684763884c576f961f829d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:17:09.597039  9835 raft_consensus.cc:697] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 895d3c58761f427c9c5b3cb41246c243 [term 2 LEADER]: Becoming Leader. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Running, Role: LEADER
I20260709 13:17:09.599999  8913 raft_consensus.cc:2468] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 2.
I20260709 13:17:09.600061  9835 consensus_queue.cc:237] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:09.601796  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359d64d36e684763884c576f961f829d" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
I20260709 13:17:09.602533  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359d64d36e684763884c576f961f829d" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
I20260709 13:17:09.603152  8839 raft_consensus.cc:3055] T 359d64d36e684763884c576f961f829d P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:09.603494  8839 raft_consensus.cc:740] T 359d64d36e684763884c576f961f829d P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Running, Role: LEADER
I20260709 13:17:09.602438  8992 raft_consensus.cc:3060] T 359d64d36e684763884c576f961f829d P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:09.604339  8839 consensus_queue.cc:260] T 359d64d36e684763884c576f961f829d P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:17:09.605507  8839 raft_consensus.cc:3060] T 359d64d36e684763884c576f961f829d P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:09.615103  8839 raft_consensus.cc:2468] T 359d64d36e684763884c576f961f829d P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 2.
I20260709 13:17:09.603152  8917 leader_election.cc:290] T 359d64d36e684763884c576f961f829d P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 election: Requested vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:17:09.618256  8992 raft_consensus.cc:2468] T 359d64d36e684763884c576f961f829d P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 2.
I20260709 13:17:09.622228  8883 leader_election.cc:304] T 359d64d36e684763884c576f961f829d P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6; no voters: 
I20260709 13:17:09.623117  9823 raft_consensus.cc:2804] T 359d64d36e684763884c576f961f829d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:09.624500  9823 raft_consensus.cc:697] T 359d64d36e684763884c576f961f829d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 LEADER]: Becoming Leader. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Running, Role: LEADER
I20260709 13:17:09.625478  9823 consensus_queue.cc:237] T 359d64d36e684763884c576f961f829d P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:17:09.638238  8667 catalog_manager.cc:5697] T 359d64d36e684763884c576f961f829d P 43c6faa9496d44dda6b6eaed09cdfd12 reported cstate change: term changed from 1 to 2, leader changed from 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194) to 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195). New cstate: current_term: 2 leader_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:09.639776  8668 catalog_manager.cc:5697] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 895d3c58761f427c9c5b3cb41246c243 reported cstate change: term changed from 1 to 2, leader changed from 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195) to 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193). New cstate: current_term: 2 leader_uuid: "895d3c58761f427c9c5b3cb41246c243" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:09.751256  9834 raft_consensus.cc:993] T 67ea3c8e514f41549c3a96b74a9b5be9 P 43c6faa9496d44dda6b6eaed09cdfd12: : Instructing follower e8bb7e1240f44fda8b83e4c124852032 to start an election
I20260709 13:17:09.751796  9823 raft_consensus.cc:1081] T 67ea3c8e514f41549c3a96b74a9b5be9 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Signalling peer e8bb7e1240f44fda8b83e4c124852032 to start an election
I20260709 13:17:09.753546  8988 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67ea3c8e514f41549c3a96b74a9b5be9"
dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
 from {username='slave'} at 127.0.0.1:50842
I20260709 13:17:09.754146  8988 raft_consensus.cc:493] T 67ea3c8e514f41549c3a96b74a9b5be9 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:09.754545  8988 raft_consensus.cc:3060] T 67ea3c8e514f41549c3a96b74a9b5be9 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:09.763236  8988 raft_consensus.cc:515] T 67ea3c8e514f41549c3a96b74a9b5be9 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:17:09.767060  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ea3c8e514f41549c3a96b74a9b5be9" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
I20260709 13:17:09.767163  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ea3c8e514f41549c3a96b74a9b5be9" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:17:09.767753  8839 raft_consensus.cc:3060] T 67ea3c8e514f41549c3a96b74a9b5be9 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:09.767864  8917 raft_consensus.cc:3055] T 67ea3c8e514f41549c3a96b74a9b5be9 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:09.768308  8917 raft_consensus.cc:740] T 67ea3c8e514f41549c3a96b74a9b5be9 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Running, Role: LEADER
I20260709 13:17:09.769052  8917 consensus_queue.cc:260] T 67ea3c8e514f41549c3a96b74a9b5be9 P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:17:09.771168  8917 raft_consensus.cc:3060] T 67ea3c8e514f41549c3a96b74a9b5be9 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:09.775064  8839 raft_consensus.cc:2468] T 67ea3c8e514f41549c3a96b74a9b5be9 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 2.
I20260709 13:17:09.777403  8957 leader_election.cc:304] T 67ea3c8e514f41549c3a96b74a9b5be9 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:17:09.778486  9846 raft_consensus.cc:2804] T 67ea3c8e514f41549c3a96b74a9b5be9 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:09.778995  8917 raft_consensus.cc:2468] T 67ea3c8e514f41549c3a96b74a9b5be9 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 2.
I20260709 13:17:09.779224  9846 raft_consensus.cc:697] T 67ea3c8e514f41549c3a96b74a9b5be9 P e8bb7e1240f44fda8b83e4c124852032 [term 2 LEADER]: Becoming Leader. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Running, Role: LEADER
I20260709 13:17:09.779649  8988 leader_election.cc:290] T 67ea3c8e514f41549c3a96b74a9b5be9 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 election: Requested vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:17:09.780830  9846 consensus_queue.cc:237] T 67ea3c8e514f41549c3a96b74a9b5be9 P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:17:09.783725  8839 raft_consensus.cc:1275] T 1d5284f5b067413e9fc2a383cc318735 P 7d3072f2af0b481d94ed70632b90e8c6 [term 3 FOLLOWER]: Refusing update from remote peer 895d3c58761f427c9c5b3cb41246c243: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:09.785131  9835 consensus_queue.cc:1048] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:09.796810  8668 catalog_manager.cc:5697] T 67ea3c8e514f41549c3a96b74a9b5be9 P e8bb7e1240f44fda8b83e4c124852032 reported cstate change: term changed from 1 to 2, leader changed from 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195) to e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196). New cstate: current_term: 2 leader_uuid: "e8bb7e1240f44fda8b83e4c124852032" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:09.819765  8917 raft_consensus.cc:1275] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Refusing update from remote peer 895d3c58761f427c9c5b3cb41246c243: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:09.823802  9835 consensus_queue.cc:1048] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:09.912554  8988 raft_consensus.cc:1275] T 574915613e8a4d3481aef27d3a977caa P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Refusing update from remote peer 895d3c58761f427c9c5b3cb41246c243: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:09.914018  9836 consensus_queue.cc:1048] T 574915613e8a4d3481aef27d3a977caa P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:09.924103  8917 raft_consensus.cc:1275] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Refusing update from remote peer 895d3c58761f427c9c5b3cb41246c243: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:09.930399  9854 consensus_queue.cc:1048] T 574915613e8a4d3481aef27d3a977caa P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:09.965798  8988 raft_consensus.cc:1275] T 9fdcbb0a74a64826ab0665c349b16200 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Refusing update from remote peer 895d3c58761f427c9c5b3cb41246c243: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:09.967459  9854 consensus_queue.cc:1048] T 9fdcbb0a74a64826ab0665c349b16200 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:09.980720  8915 raft_consensus.cc:1275] T 9fdcbb0a74a64826ab0665c349b16200 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Refusing update from remote peer 895d3c58761f427c9c5b3cb41246c243: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:09.986084  9836 consensus_queue.cc:1048] T 9fdcbb0a74a64826ab0665c349b16200 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:10.050482  8988 raft_consensus.cc:1275] T 359d64d36e684763884c576f961f829d P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Refusing update from remote peer 43c6faa9496d44dda6b6eaed09cdfd12: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:10.051954  9823 consensus_queue.cc:1048] T 359d64d36e684763884c576f961f829d P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:10.054749  8992 raft_consensus.cc:1275] T 485b2d9b05744b4f9a22e8f0e8b66e0d P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Refusing update from remote peer 895d3c58761f427c9c5b3cb41246c243: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:10.056347  9836 consensus_queue.cc:1048] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:10.066200  8839 raft_consensus.cc:1275] T 359d64d36e684763884c576f961f829d P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Refusing update from remote peer 43c6faa9496d44dda6b6eaed09cdfd12: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:10.067833  9823 consensus_queue.cc:1048] T 359d64d36e684763884c576f961f829d P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:10.073064  8915 raft_consensus.cc:1275] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Refusing update from remote peer 895d3c58761f427c9c5b3cb41246c243: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:10.074710  9835 consensus_queue.cc:1048] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:10.233778  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:10.274055  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:10.312165  8917 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "097c705b65de4abe884afdb1fcaaa054"
dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
mode: GRACEFUL
new_leader_uuid: "895d3c58761f427c9c5b3cb41246c243"
 from {username='slave'} at 127.0.0.1:37268
I20260709 13:17:10.312856  8917 raft_consensus.cc:606] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Received request to transfer leadership to TS 895d3c58761f427c9c5b3cb41246c243
I20260709 13:17:10.316946  8917 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4352fad232ab47588683e51cf4b62080"
dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
mode: GRACEFUL
new_leader_uuid: "895d3c58761f427c9c5b3cb41246c243"
 from {username='slave'} at 127.0.0.1:37268
I20260709 13:17:10.317535  8917 raft_consensus.cc:606] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Received request to transfer leadership to TS 895d3c58761f427c9c5b3cb41246c243
I20260709 13:17:10.320966  8839 raft_consensus.cc:1275] T 67ea3c8e514f41549c3a96b74a9b5be9 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Refusing update from remote peer e8bb7e1240f44fda8b83e4c124852032: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:10.322291  9618 consensus_queue.cc:1048] T 67ea3c8e514f41549c3a96b74a9b5be9 P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:10.322392  8839 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4fd6605b785643deac78902ee4fc6896"
dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
mode: GRACEFUL
new_leader_uuid: "895d3c58761f427c9c5b3cb41246c243"
 from {username='slave'} at 127.0.0.1:53176
I20260709 13:17:10.323021  8839 raft_consensus.cc:606] T 4fd6605b785643deac78902ee4fc6896 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 LEADER]: Received request to transfer leadership to TS 895d3c58761f427c9c5b3cb41246c243
I20260709 13:17:10.325917  8838 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55bac44fd5a3462593ab47f6b6f44c6e"
dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
mode: GRACEFUL
new_leader_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
 from {username='slave'} at 127.0.0.1:53176
I20260709 13:17:10.326684  8838 raft_consensus.cc:606] T 55bac44fd5a3462593ab47f6b6f44c6e P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 LEADER]: Received request to transfer leadership to TS 43c6faa9496d44dda6b6eaed09cdfd12
I20260709 13:17:10.350487  8917 raft_consensus.cc:1275] T 67ea3c8e514f41549c3a96b74a9b5be9 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Refusing update from remote peer e8bb7e1240f44fda8b83e4c124852032: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:10.360719  9830 consensus_queue.cc:1048] T 67ea3c8e514f41549c3a96b74a9b5be9 P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:17:10.369220  8992 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "852f0ef4508245e2812b76665a70bbf8"
dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
mode: GRACEFUL
new_leader_uuid: "895d3c58761f427c9c5b3cb41246c243"
 from {username='slave'} at 127.0.0.1:57756
I20260709 13:17:10.369895  8992 raft_consensus.cc:606] T 852f0ef4508245e2812b76665a70bbf8 P e8bb7e1240f44fda8b83e4c124852032 [term 1 LEADER]: Received request to transfer leadership to TS 895d3c58761f427c9c5b3cb41246c243
I20260709 13:17:10.379037  8838 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8ded21dd9a54bc8b9cd260808162d0d"
dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
mode: GRACEFUL
new_leader_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
 from {username='slave'} at 127.0.0.1:53176
I20260709 13:17:10.380052  8838 raft_consensus.cc:606] T b8ded21dd9a54bc8b9cd260808162d0d P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 LEADER]: Received request to transfer leadership to TS 43c6faa9496d44dda6b6eaed09cdfd12
I20260709 13:17:10.384146  2843 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:17:10.386093  2843 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:10.393110  9826 raft_consensus.cc:993] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12: : Instructing follower 895d3c58761f427c9c5b3cb41246c243 to start an election
I20260709 13:17:10.393839  9823 raft_consensus.cc:1081] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Signalling peer 895d3c58761f427c9c5b3cb41246c243 to start an election
I20260709 13:17:10.395951  9629 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4352fad232ab47588683e51cf4b62080"
dest_uuid: "895d3c58761f427c9c5b3cb41246c243"
 from {username='slave'} at 127.0.0.1:37414
I20260709 13:17:10.396502  9629 raft_consensus.cc:493] T 4352fad232ab47588683e51cf4b62080 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:10.396915  9629 raft_consensus.cc:3060] T 4352fad232ab47588683e51cf4b62080 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:10.410720  9629 raft_consensus.cc:515] T 4352fad232ab47588683e51cf4b62080 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:10.412868  9629 leader_election.cc:290] T 4352fad232ab47588683e51cf4b62080 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 election: Requested vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:17:10.413892  8992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4352fad232ab47588683e51cf4b62080" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
I20260709 13:17:10.413889  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4352fad232ab47588683e51cf4b62080" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:17:10.414608  8992 raft_consensus.cc:3060] T 4352fad232ab47588683e51cf4b62080 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:10.414685  8917 raft_consensus.cc:3055] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:10.415138  8917 raft_consensus.cc:740] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Running, Role: LEADER
I20260709 13:17:10.415997  8917 consensus_queue.cc:260] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:10.417204  8917 raft_consensus.cc:3060] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:10.421298  8992 raft_consensus.cc:2468] T 4352fad232ab47588683e51cf4b62080 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 2.
I20260709 13:17:10.423306  9552 leader_election.cc:304] T 4352fad232ab47588683e51cf4b62080 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:17:10.425088  9861 raft_consensus.cc:2804] T 4352fad232ab47588683e51cf4b62080 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:10.425383  8917 raft_consensus.cc:2468] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 2.
I20260709 13:17:10.425603  9861 raft_consensus.cc:697] T 4352fad232ab47588683e51cf4b62080 P 895d3c58761f427c9c5b3cb41246c243 [term 2 LEADER]: Becoming Leader. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Running, Role: LEADER
I20260709 13:17:10.426708  9861 consensus_queue.cc:237] T 4352fad232ab47588683e51cf4b62080 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:10.437505  8667 catalog_manager.cc:5697] T 4352fad232ab47588683e51cf4b62080 P 895d3c58761f427c9c5b3cb41246c243 reported cstate change: term changed from 1 to 2, leader changed from 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195) to 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193). New cstate: current_term: 2 leader_uuid: "895d3c58761f427c9c5b3cb41246c243" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:10.852532  9875 raft_consensus.cc:993] T 55bac44fd5a3462593ab47f6b6f44c6e P 7d3072f2af0b481d94ed70632b90e8c6: : Instructing follower 43c6faa9496d44dda6b6eaed09cdfd12 to start an election
I20260709 13:17:10.853096  9875 raft_consensus.cc:1081] T 55bac44fd5a3462593ab47f6b6f44c6e P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 LEADER]: Signalling peer 43c6faa9496d44dda6b6eaed09cdfd12 to start an election
I20260709 13:17:10.854749  8913 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55bac44fd5a3462593ab47f6b6f44c6e"
dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
 from {username='slave'} at 127.0.0.1:51280
I20260709 13:17:10.855418  8913 raft_consensus.cc:493] T 55bac44fd5a3462593ab47f6b6f44c6e P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:10.855806  8913 raft_consensus.cc:3060] T 55bac44fd5a3462593ab47f6b6f44c6e P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:10.859701  9622 raft_consensus.cc:993] T b8ded21dd9a54bc8b9cd260808162d0d P 7d3072f2af0b481d94ed70632b90e8c6: : Instructing follower 43c6faa9496d44dda6b6eaed09cdfd12 to start an election
I20260709 13:17:10.860308  9875 raft_consensus.cc:1081] T b8ded21dd9a54bc8b9cd260808162d0d P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 LEADER]: Signalling peer 43c6faa9496d44dda6b6eaed09cdfd12 to start an election
I20260709 13:17:10.862169  8918 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8ded21dd9a54bc8b9cd260808162d0d"
dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
 from {username='slave'} at 127.0.0.1:51280
I20260709 13:17:10.862706  8918 raft_consensus.cc:493] T b8ded21dd9a54bc8b9cd260808162d0d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:10.863014  8918 raft_consensus.cc:3060] T b8ded21dd9a54bc8b9cd260808162d0d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:10.864831  8913 raft_consensus.cc:515] T 55bac44fd5a3462593ab47f6b6f44c6e P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:17:10.867915  8913 leader_election.cc:290] T 55bac44fd5a3462593ab47f6b6f44c6e P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 election: Requested vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:17:10.870713  8918 raft_consensus.cc:515] T b8ded21dd9a54bc8b9cd260808162d0d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:17:10.872444  8918 leader_election.cc:290] T b8ded21dd9a54bc8b9cd260808162d0d P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 election: Requested vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:17:10.882012  9819 raft_consensus.cc:993] T 4fd6605b785643deac78902ee4fc6896 P 7d3072f2af0b481d94ed70632b90e8c6: : Instructing follower 895d3c58761f427c9c5b3cb41246c243 to start an election
I20260709 13:17:10.882493  9819 raft_consensus.cc:1081] T 4fd6605b785643deac78902ee4fc6896 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 LEADER]: Signalling peer 895d3c58761f427c9c5b3cb41246c243 to start an election
I20260709 13:17:10.895525  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8ded21dd9a54bc8b9cd260808162d0d" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
I20260709 13:17:10.896196  8993 raft_consensus.cc:3060] T b8ded21dd9a54bc8b9cd260808162d0d P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:10.904739  8989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bac44fd5a3462593ab47f6b6f44c6e" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
I20260709 13:17:10.905556  8989 raft_consensus.cc:3060] T 55bac44fd5a3462593ab47f6b6f44c6e P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:10.942685  9598 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4fd6605b785643deac78902ee4fc6896"
dest_uuid: "895d3c58761f427c9c5b3cb41246c243"
 from {username='slave'} at 127.0.0.1:37400
I20260709 13:17:10.944298  9598 raft_consensus.cc:493] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:10.944703  9598 raft_consensus.cc:3060] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:10.950490  8989 raft_consensus.cc:2468] T 55bac44fd5a3462593ab47f6b6f44c6e P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 2.
I20260709 13:17:10.952122  8882 leader_election.cc:304] T 55bac44fd5a3462593ab47f6b6f44c6e P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:17:10.953027  9826 raft_consensus.cc:2804] T 55bac44fd5a3462593ab47f6b6f44c6e P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:10.953537  9826 raft_consensus.cc:697] T 55bac44fd5a3462593ab47f6b6f44c6e P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 LEADER]: Becoming Leader. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Running, Role: LEADER
I20260709 13:17:10.954393  9826 consensus_queue.cc:237] T 55bac44fd5a3462593ab47f6b6f44c6e P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:17:10.959055  8985 raft_consensus.cc:1240] T 55bac44fd5a3462593ab47f6b6f44c6e P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Rejecting Update request from peer 7d3072f2af0b481d94ed70632b90e8c6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:10.935226  8993 raft_consensus.cc:2468] T b8ded21dd9a54bc8b9cd260808162d0d P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 2.
I20260709 13:17:10.960850  8992 raft_consensus.cc:1240] T b8ded21dd9a54bc8b9cd260808162d0d P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Rejecting Update request from peer 7d3072f2af0b481d94ed70632b90e8c6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:10.961282  8882 leader_election.cc:304] T b8ded21dd9a54bc8b9cd260808162d0d P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:17:10.962296  9873 raft_consensus.cc:2804] T b8ded21dd9a54bc8b9cd260808162d0d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:10.962806  9873 raft_consensus.cc:697] T b8ded21dd9a54bc8b9cd260808162d0d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 LEADER]: Becoming Leader. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Running, Role: LEADER
I20260709 13:17:10.963497  8988 raft_consensus.cc:1275] T 4352fad232ab47588683e51cf4b62080 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Refusing update from remote peer 895d3c58761f427c9c5b3cb41246c243: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:10.963884  9873 consensus_queue.cc:237] T b8ded21dd9a54bc8b9cd260808162d0d P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:17:10.965938  9826 raft_consensus.cc:993] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12: : Instructing follower 895d3c58761f427c9c5b3cb41246c243 to start an election
I20260709 13:17:10.966463  9826 raft_consensus.cc:1081] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Signalling peer 895d3c58761f427c9c5b3cb41246c243 to start an election
I20260709 13:17:10.973181  8667 catalog_manager.cc:5697] T 55bac44fd5a3462593ab47f6b6f44c6e P 43c6faa9496d44dda6b6eaed09cdfd12 reported cstate change: term changed from 1 to 2, leader changed from 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194) to 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195). New cstate: current_term: 2 leader_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:10.959125  9598 raft_consensus.cc:515] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:17:10.991714  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd6605b785643deac78902ee4fc6896" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
I20260709 13:17:10.992506  8839 raft_consensus.cc:3055] T 4fd6605b785643deac78902ee4fc6896 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:10.992870  8839 raft_consensus.cc:740] T 4fd6605b785643deac78902ee4fc6896 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Running, Role: LEADER
I20260709 13:17:10.994863  8839 consensus_queue.cc:260] T 4fd6605b785643deac78902ee4fc6896 P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:17:10.996039  8839 raft_consensus.cc:3060] T 4fd6605b785643deac78902ee4fc6896 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:11.000054  9598 leader_election.cc:290] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 3 election: Requested vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:17:11.003793  9875 consensus_queue.cc:1059] T 55bac44fd5a3462593ab47f6b6f44c6e P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:11.005206  9622 raft_consensus.cc:3055] T 55bac44fd5a3462593ab47f6b6f44c6e P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:11.005553  9622 raft_consensus.cc:740] T 55bac44fd5a3462593ab47f6b6f44c6e P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Running, Role: LEADER
I20260709 13:17:11.006526  9622 consensus_queue.cc:260] T 55bac44fd5a3462593ab47f6b6f44c6e P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:17:11.012120  9867 raft_consensus.cc:993] T 852f0ef4508245e2812b76665a70bbf8 P e8bb7e1240f44fda8b83e4c124852032: : Instructing follower 895d3c58761f427c9c5b3cb41246c243 to start an election
I20260709 13:17:11.012648  9867 raft_consensus.cc:1081] T 852f0ef4508245e2812b76665a70bbf8 P e8bb7e1240f44fda8b83e4c124852032 [term 1 LEADER]: Signalling peer 895d3c58761f427c9c5b3cb41246c243 to start an election
I20260709 13:17:11.027201  9819 consensus_queue.cc:1059] T b8ded21dd9a54bc8b9cd260808162d0d P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:11.029284  9819 raft_consensus.cc:3055] T b8ded21dd9a54bc8b9cd260808162d0d P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:11.029649  9819 raft_consensus.cc:740] T b8ded21dd9a54bc8b9cd260808162d0d P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Running, Role: LEADER
I20260709 13:17:11.030035  9622 raft_consensus.cc:3060] T 55bac44fd5a3462593ab47f6b6f44c6e P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:11.030431  9819 consensus_queue.cc:260] T b8ded21dd9a54bc8b9cd260808162d0d P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:17:11.032387  9819 raft_consensus.cc:3060] T b8ded21dd9a54bc8b9cd260808162d0d P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:11.048492  9598 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "097c705b65de4abe884afdb1fcaaa054"
dest_uuid: "895d3c58761f427c9c5b3cb41246c243"
 from {username='slave'} at 127.0.0.1:37414
I20260709 13:17:11.049301  9598 raft_consensus.cc:493] T 097c705b65de4abe884afdb1fcaaa054 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:11.049719  9598 raft_consensus.cc:3060] T 097c705b65de4abe884afdb1fcaaa054 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:11.049722  9629 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "852f0ef4508245e2812b76665a70bbf8"
dest_uuid: "895d3c58761f427c9c5b3cb41246c243"
 from {username='slave'} at 127.0.0.1:37430
I20260709 13:17:11.050379  9629 raft_consensus.cc:493] T 852f0ef4508245e2812b76665a70bbf8 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:11.050736  9629 raft_consensus.cc:3060] T 852f0ef4508245e2812b76665a70bbf8 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:11.052348  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bac44fd5a3462593ab47f6b6f44c6e" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
I20260709 13:17:11.054914  8845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8ded21dd9a54bc8b9cd260808162d0d" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
I20260709 13:17:11.056030  8839 raft_consensus.cc:2468] T 4fd6605b785643deac78902ee4fc6896 P 7d3072f2af0b481d94ed70632b90e8c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 3.
I20260709 13:17:11.061537  9629 raft_consensus.cc:515] T 852f0ef4508245e2812b76665a70bbf8 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:17:11.063570  8918 raft_consensus.cc:1275] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Refusing update from remote peer 895d3c58761f427c9c5b3cb41246c243: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:11.070698  9836 consensus_queue.cc:1048] T 4352fad232ab47588683e51cf4b62080 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:11.074079  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd6605b785643deac78902ee4fc6896" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:17:11.074757  8913 raft_consensus.cc:3060] T 4fd6605b785643deac78902ee4fc6896 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:11.077323  9553 leader_election.cc:304] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6, 895d3c58761f427c9c5b3cb41246c243; no voters: 
I20260709 13:17:11.078701  9835 raft_consensus.cc:2804] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:11.079193  9835 raft_consensus.cc:697] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243 [term 3 LEADER]: Becoming Leader. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Running, Role: LEADER
I20260709 13:17:11.080200  9835 consensus_queue.cc:237] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:17:11.085716  9629 leader_election.cc:290] T 852f0ef4508245e2812b76665a70bbf8 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 election: Requested vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:17:11.086710  8845 raft_consensus.cc:2468] T b8ded21dd9a54bc8b9cd260808162d0d P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 2.
I20260709 13:17:11.082499  9598 raft_consensus.cc:515] T 097c705b65de4abe884afdb1fcaaa054 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:11.088804  8993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852f0ef4508245e2812b76665a70bbf8" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
I20260709 13:17:11.089439  8993 raft_consensus.cc:3055] T 852f0ef4508245e2812b76665a70bbf8 P e8bb7e1240f44fda8b83e4c124852032 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:11.089728  8993 raft_consensus.cc:740] T 852f0ef4508245e2812b76665a70bbf8 P e8bb7e1240f44fda8b83e4c124852032 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Running, Role: LEADER
I20260709 13:17:11.091331  9598 leader_election.cc:290] T 097c705b65de4abe884afdb1fcaaa054 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 election: Requested vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:17:11.092203  8842 raft_consensus.cc:2468] T 55bac44fd5a3462593ab47f6b6f44c6e P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 2.
I20260709 13:17:11.091899  8993 consensus_queue.cc:260] T 852f0ef4508245e2812b76665a70bbf8 P e8bb7e1240f44fda8b83e4c124852032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:17:11.093529  8993 raft_consensus.cc:3060] T 852f0ef4508245e2812b76665a70bbf8 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:11.094939  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "852f0ef4508245e2812b76665a70bbf8" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
I20260709 13:17:11.095520  8839 raft_consensus.cc:3060] T 852f0ef4508245e2812b76665a70bbf8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:11.106576  8993 raft_consensus.cc:2468] T 852f0ef4508245e2812b76665a70bbf8 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 2.
I20260709 13:17:11.109578  8989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c705b65de4abe884afdb1fcaaa054" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
I20260709 13:17:11.110311  8989 raft_consensus.cc:3060] T 097c705b65de4abe884afdb1fcaaa054 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:11.109156  8839 raft_consensus.cc:2468] T 852f0ef4508245e2812b76665a70bbf8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 2.
I20260709 13:17:11.112191  8913 raft_consensus.cc:2468] T 4fd6605b785643deac78902ee4fc6896 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 3.
I20260709 13:17:11.108424  9552 leader_election.cc:304] T 852f0ef4508245e2812b76665a70bbf8 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:17:11.113667  9861 raft_consensus.cc:2804] T 852f0ef4508245e2812b76665a70bbf8 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:11.125075  9861 raft_consensus.cc:697] T 852f0ef4508245e2812b76665a70bbf8 P 895d3c58761f427c9c5b3cb41246c243 [term 2 LEADER]: Becoming Leader. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Running, Role: LEADER
I20260709 13:17:11.136940  8989 raft_consensus.cc:2468] T 097c705b65de4abe884afdb1fcaaa054 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 2.
I20260709 13:17:11.158432  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c705b65de4abe884afdb1fcaaa054" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:17:11.158629  9552 leader_election.cc:304] T 097c705b65de4abe884afdb1fcaaa054 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:17:11.159323  8914 raft_consensus.cc:3055] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:11.159840  8914 raft_consensus.cc:740] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Running, Role: LEADER
I20260709 13:17:11.162985  9887 consensus_queue.cc:1048] T 4352fad232ab47588683e51cf4b62080 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:11.160730  9836 raft_consensus.cc:2804] T 097c705b65de4abe884afdb1fcaaa054 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:11.164556  9836 raft_consensus.cc:697] T 097c705b65de4abe884afdb1fcaaa054 P 895d3c58761f427c9c5b3cb41246c243 [term 2 LEADER]: Becoming Leader. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Running, Role: LEADER
I20260709 13:17:11.165431  9836 consensus_queue.cc:237] T 097c705b65de4abe884afdb1fcaaa054 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:11.160825  8914 consensus_queue.cc:260] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:11.168015  8914 raft_consensus.cc:3060] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:11.146901  9861 consensus_queue.cc:237] T 852f0ef4508245e2812b76665a70bbf8 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:17:11.171207  8667 catalog_manager.cc:5697] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243 reported cstate change: term changed from 2 to 3, leader changed from 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194) to 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193). New cstate: current_term: 3 leader_uuid: "895d3c58761f427c9c5b3cb41246c243" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:11.181555  8668 catalog_manager.cc:5697] T b8ded21dd9a54bc8b9cd260808162d0d P 43c6faa9496d44dda6b6eaed09cdfd12 reported cstate change: term changed from 1 to 2, leader changed from 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194) to 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195). New cstate: current_term: 2 leader_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:11.193490  8914 raft_consensus.cc:2468] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 2.
I20260709 13:17:11.275646  8668 catalog_manager.cc:5697] T 852f0ef4508245e2812b76665a70bbf8 P 895d3c58761f427c9c5b3cb41246c243 reported cstate change: term changed from 1 to 2, leader changed from e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196) to 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193). New cstate: current_term: 2 leader_uuid: "895d3c58761f427c9c5b3cb41246c243" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:11.277495  8668 catalog_manager.cc:5697] T 097c705b65de4abe884afdb1fcaaa054 P 895d3c58761f427c9c5b3cb41246c243 reported cstate change: term changed from 1 to 2, leader changed from 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195) to 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193). New cstate: current_term: 2 leader_uuid: "895d3c58761f427c9c5b3cb41246c243" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:11.372965  8842 raft_consensus.cc:1275] T 55bac44fd5a3462593ab47f6b6f44c6e P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Refusing update from remote peer 43c6faa9496d44dda6b6eaed09cdfd12: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:11.374737  9881 consensus_queue.cc:1048] T 55bac44fd5a3462593ab47f6b6f44c6e P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:11.391043  8989 raft_consensus.cc:1275] T 55bac44fd5a3462593ab47f6b6f44c6e P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Refusing update from remote peer 43c6faa9496d44dda6b6eaed09cdfd12: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:11.401043  9881 consensus_queue.cc:1048] T 55bac44fd5a3462593ab47f6b6f44c6e P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:11.418236  8839 raft_consensus.cc:1275] T b8ded21dd9a54bc8b9cd260808162d0d P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Refusing update from remote peer 43c6faa9496d44dda6b6eaed09cdfd12: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:11.419615  9873 consensus_queue.cc:1048] T b8ded21dd9a54bc8b9cd260808162d0d P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:11.444860  8989 raft_consensus.cc:1275] T b8ded21dd9a54bc8b9cd260808162d0d P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Refusing update from remote peer 43c6faa9496d44dda6b6eaed09cdfd12: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:11.446520  9826 consensus_queue.cc:1048] T b8ded21dd9a54bc8b9cd260808162d0d P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:11.477146  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:11.520711  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:11.571337  8914 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2accf622ad6243e3b7b496fb979fe9d4"
dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
mode: GRACEFUL
new_leader_uuid: "e8bb7e1240f44fda8b83e4c124852032"
 from {username='slave'} at 127.0.0.1:37268
I20260709 13:17:11.572216  8914 raft_consensus.cc:606] T 2accf622ad6243e3b7b496fb979fe9d4 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Received request to transfer leadership to TS e8bb7e1240f44fda8b83e4c124852032
I20260709 13:17:11.575103  8842 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "65900ac9e06944639fe557200317fe05"
dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
mode: GRACEFUL
new_leader_uuid: "895d3c58761f427c9c5b3cb41246c243"
 from {username='slave'} at 127.0.0.1:53176
I20260709 13:17:11.575683  8842 raft_consensus.cc:606] T 65900ac9e06944639fe557200317fe05 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 LEADER]: Received request to transfer leadership to TS 895d3c58761f427c9c5b3cb41246c243
I20260709 13:17:11.578394  8842 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "734d16820c5640729de24c6edf4c5ed8"
dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
mode: GRACEFUL
new_leader_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
 from {username='slave'} at 127.0.0.1:53176
I20260709 13:17:11.578979  8842 raft_consensus.cc:606] T 734d16820c5640729de24c6edf4c5ed8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 LEADER]: Received request to transfer leadership to TS 43c6faa9496d44dda6b6eaed09cdfd12
I20260709 13:17:11.581979  8914 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8ded21dd9a54bc8b9cd260808162d0d"
dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
mode: GRACEFUL
new_leader_uuid: "e8bb7e1240f44fda8b83e4c124852032"
 from {username='slave'} at 127.0.0.1:37268
I20260709 13:17:11.582609  8914 raft_consensus.cc:606] T b8ded21dd9a54bc8b9cd260808162d0d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 LEADER]: Received request to transfer leadership to TS e8bb7e1240f44fda8b83e4c124852032
I20260709 13:17:11.584013  8842 raft_consensus.cc:1275] T 4fd6605b785643deac78902ee4fc6896 P 7d3072f2af0b481d94ed70632b90e8c6 [term 3 FOLLOWER]: Refusing update from remote peer 895d3c58761f427c9c5b3cb41246c243: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:11.585649  8839 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d46902173b5c4283b315c6def6f13c31"
dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
mode: GRACEFUL
new_leader_uuid: "895d3c58761f427c9c5b3cb41246c243"
 from {username='slave'} at 127.0.0.1:53176
I20260709 13:17:11.586274  8839 raft_consensus.cc:606] T d46902173b5c4283b315c6def6f13c31 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 LEADER]: Received request to transfer leadership to TS 895d3c58761f427c9c5b3cb41246c243
I20260709 13:17:11.587610  2843 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:17:11.588691  9861 consensus_queue.cc:1048] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:11.590267  2843 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:11.602206  8914 raft_consensus.cc:1275] T 4fd6605b785643deac78902ee4fc6896 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Refusing update from remote peer 895d3c58761f427c9c5b3cb41246c243: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:11.608537  9861 consensus_queue.cc:1048] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:17:11.621066  8866 debug-util.cc:398] Leaking SignalData structure 0x7b08002f2460 after lost signal to thread 2846
W20260709 13:17:11.622550  8866 debug-util.cc:398] Leaking SignalData structure 0x7b08002f2b40 after lost signal to thread 8702
W20260709 13:17:11.623999  8866 debug-util.cc:398] Leaking SignalData structure 0x7b080033b360 after lost signal to thread 8869
W20260709 13:17:11.625191  8866 debug-util.cc:398] Leaking SignalData structure 0x7b0800289320 after lost signal to thread 8943
W20260709 13:17:11.626467  8866 debug-util.cc:398] Leaking SignalData structure 0x7b08001474a0 after lost signal to thread 9017
W20260709 13:17:11.627955  8866 debug-util.cc:398] Leaking SignalData structure 0x7b0800324180 after lost signal to thread 9737
I20260709 13:17:11.633181  8989 raft_consensus.cc:1275] T 097c705b65de4abe884afdb1fcaaa054 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Refusing update from remote peer 895d3c58761f427c9c5b3cb41246c243: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:11.642019  9861 consensus_queue.cc:1048] T 097c705b65de4abe884afdb1fcaaa054 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:11.647297  8914 raft_consensus.cc:1275] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Refusing update from remote peer 895d3c58761f427c9c5b3cb41246c243: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:11.649868  9892 consensus_queue.cc:1048] T 097c705b65de4abe884afdb1fcaaa054 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:11.680375  9875 raft_consensus.cc:993] T 65900ac9e06944639fe557200317fe05 P 7d3072f2af0b481d94ed70632b90e8c6: : Instructing follower 895d3c58761f427c9c5b3cb41246c243 to start an election
I20260709 13:17:11.680930  9875 raft_consensus.cc:1081] T 65900ac9e06944639fe557200317fe05 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 LEADER]: Signalling peer 895d3c58761f427c9c5b3cb41246c243 to start an election
I20260709 13:17:11.682607  9629 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "65900ac9e06944639fe557200317fe05"
dest_uuid: "895d3c58761f427c9c5b3cb41246c243"
 from {username='slave'} at 127.0.0.1:37400
I20260709 13:17:11.683161  9629 raft_consensus.cc:493] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:11.683501  9629 raft_consensus.cc:3060] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:11.690675  9629 raft_consensus.cc:515] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:17:11.696513  9629 leader_election.cc:290] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 3 election: Requested vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:17:11.697517  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65900ac9e06944639fe557200317fe05" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
I20260709 13:17:11.698251  8839 raft_consensus.cc:3055] T 65900ac9e06944639fe557200317fe05 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:11.698523  8839 raft_consensus.cc:740] T 65900ac9e06944639fe557200317fe05 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Running, Role: LEADER
I20260709 13:17:11.699287  8839 consensus_queue.cc:260] T 65900ac9e06944639fe557200317fe05 P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:17:11.700054  8989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65900ac9e06944639fe557200317fe05" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
I20260709 13:17:11.700544  8839 raft_consensus.cc:3060] T 65900ac9e06944639fe557200317fe05 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:11.700820  8989 raft_consensus.cc:3060] T 65900ac9e06944639fe557200317fe05 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:11.708963  8839 raft_consensus.cc:2468] T 65900ac9e06944639fe557200317fe05 P 7d3072f2af0b481d94ed70632b90e8c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 3.
I20260709 13:17:11.710034  9553 leader_election.cc:304] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6, 895d3c58761f427c9c5b3cb41246c243; no voters: 
I20260709 13:17:11.710546  8989 raft_consensus.cc:2468] T 65900ac9e06944639fe557200317fe05 P e8bb7e1240f44fda8b83e4c124852032 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 3.
I20260709 13:17:11.710888  9836 raft_consensus.cc:2804] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:11.711586  9836 raft_consensus.cc:697] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243 [term 3 LEADER]: Becoming Leader. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Running, Role: LEADER
I20260709 13:17:11.712725  9836 consensus_queue.cc:237] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:17:11.726642  8668 catalog_manager.cc:5697] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243 reported cstate change: term changed from 2 to 3, leader changed from 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194) to 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193). New cstate: current_term: 3 leader_uuid: "895d3c58761f427c9c5b3cb41246c243" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:11.750368  8839 raft_consensus.cc:1275] T 852f0ef4508245e2812b76665a70bbf8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Refusing update from remote peer 895d3c58761f427c9c5b3cb41246c243: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:11.751960  9836 consensus_queue.cc:1048] T 852f0ef4508245e2812b76665a70bbf8 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:11.767890  8989 raft_consensus.cc:1275] T 852f0ef4508245e2812b76665a70bbf8 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Refusing update from remote peer 895d3c58761f427c9c5b3cb41246c243: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:11.770186  9889 consensus_queue.cc:1048] T 852f0ef4508245e2812b76665a70bbf8 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:11.851850  9826 raft_consensus.cc:993] T b8ded21dd9a54bc8b9cd260808162d0d P 43c6faa9496d44dda6b6eaed09cdfd12: : Instructing follower e8bb7e1240f44fda8b83e4c124852032 to start an election
I20260709 13:17:11.852468  9826 raft_consensus.cc:1081] T b8ded21dd9a54bc8b9cd260808162d0d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 LEADER]: Signalling peer e8bb7e1240f44fda8b83e4c124852032 to start an election
I20260709 13:17:11.860168  8987 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8ded21dd9a54bc8b9cd260808162d0d"
dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
 from {username='slave'} at 127.0.0.1:50842
I20260709 13:17:11.860899  8987 raft_consensus.cc:493] T b8ded21dd9a54bc8b9cd260808162d0d P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:11.861271  8987 raft_consensus.cc:3060] T b8ded21dd9a54bc8b9cd260808162d0d P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:11.873890  8987 raft_consensus.cc:515] T b8ded21dd9a54bc8b9cd260808162d0d P e8bb7e1240f44fda8b83e4c124852032 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:17:11.877164  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8ded21dd9a54bc8b9cd260808162d0d" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:17:11.877627  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8ded21dd9a54bc8b9cd260808162d0d" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
I20260709 13:17:11.877993  8914 raft_consensus.cc:3055] T b8ded21dd9a54bc8b9cd260808162d0d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:11.878374  8987 leader_election.cc:290] T b8ded21dd9a54bc8b9cd260808162d0d P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 3 election: Requested vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:17:11.878404  8839 raft_consensus.cc:3060] T b8ded21dd9a54bc8b9cd260808162d0d P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:11.878917  8914 raft_consensus.cc:740] T b8ded21dd9a54bc8b9cd260808162d0d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Running, Role: LEADER
I20260709 13:17:11.881199  8914 consensus_queue.cc:260] T b8ded21dd9a54bc8b9cd260808162d0d P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:17:11.882874  8914 raft_consensus.cc:3060] T b8ded21dd9a54bc8b9cd260808162d0d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:11.888368  8839 raft_consensus.cc:2468] T b8ded21dd9a54bc8b9cd260808162d0d P 7d3072f2af0b481d94ed70632b90e8c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 3.
I20260709 13:17:11.890075  8957 leader_election.cc:304] T b8ded21dd9a54bc8b9cd260808162d0d P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:17:11.890856  9830 raft_consensus.cc:2804] T b8ded21dd9a54bc8b9cd260808162d0d P e8bb7e1240f44fda8b83e4c124852032 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:11.891657  9830 raft_consensus.cc:697] T b8ded21dd9a54bc8b9cd260808162d0d P e8bb7e1240f44fda8b83e4c124852032 [term 3 LEADER]: Becoming Leader. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Running, Role: LEADER
I20260709 13:17:11.892627  9830 consensus_queue.cc:237] T b8ded21dd9a54bc8b9cd260808162d0d P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:17:11.898005  9819 raft_consensus.cc:993] T d46902173b5c4283b315c6def6f13c31 P 7d3072f2af0b481d94ed70632b90e8c6: : Instructing follower 895d3c58761f427c9c5b3cb41246c243 to start an election
I20260709 13:17:11.898669  9819 raft_consensus.cc:1081] T d46902173b5c4283b315c6def6f13c31 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 LEADER]: Signalling peer 895d3c58761f427c9c5b3cb41246c243 to start an election
I20260709 13:17:11.900627  9629 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d46902173b5c4283b315c6def6f13c31"
dest_uuid: "895d3c58761f427c9c5b3cb41246c243"
 from {username='slave'} at 127.0.0.1:37400
I20260709 13:17:11.901259  9629 raft_consensus.cc:493] T d46902173b5c4283b315c6def6f13c31 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:11.901623  8914 raft_consensus.cc:2468] T b8ded21dd9a54bc8b9cd260808162d0d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 3.
I20260709 13:17:11.901654  9629 raft_consensus.cc:3060] T d46902173b5c4283b315c6def6f13c31 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:11.908455  9834 raft_consensus.cc:993] T 2accf622ad6243e3b7b496fb979fe9d4 P 43c6faa9496d44dda6b6eaed09cdfd12: : Instructing follower e8bb7e1240f44fda8b83e4c124852032 to start an election
I20260709 13:17:11.909051  9834 raft_consensus.cc:1081] T 2accf622ad6243e3b7b496fb979fe9d4 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Signalling peer e8bb7e1240f44fda8b83e4c124852032 to start an election
I20260709 13:17:11.910913  8989 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2accf622ad6243e3b7b496fb979fe9d4"
dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
 from {username='slave'} at 127.0.0.1:50842
I20260709 13:17:11.911602  9629 raft_consensus.cc:515] T d46902173b5c4283b315c6def6f13c31 P 895d3c58761f427c9c5b3cb41246c243 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:17:11.912335  8664 catalog_manager.cc:5697] T b8ded21dd9a54bc8b9cd260808162d0d P e8bb7e1240f44fda8b83e4c124852032 reported cstate change: term changed from 2 to 3, leader changed from 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195) to e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196). New cstate: current_term: 3 leader_uuid: "e8bb7e1240f44fda8b83e4c124852032" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:11.911533  8989 raft_consensus.cc:493] T 2accf622ad6243e3b7b496fb979fe9d4 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:11.914225  8989 raft_consensus.cc:3060] T 2accf622ad6243e3b7b496fb979fe9d4 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:11.914654  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46902173b5c4283b315c6def6f13c31" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
I20260709 13:17:11.915028  9629 leader_election.cc:290] T d46902173b5c4283b315c6def6f13c31 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 3 election: Requested vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:17:11.915325  8839 raft_consensus.cc:3055] T d46902173b5c4283b315c6def6f13c31 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:11.925959  8839 raft_consensus.cc:740] T d46902173b5c4283b315c6def6f13c31 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Running, Role: LEADER
I20260709 13:17:11.926972  8839 consensus_queue.cc:260] T d46902173b5c4283b315c6def6f13c31 P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:17:11.928345  8839 raft_consensus.cc:3060] T d46902173b5c4283b315c6def6f13c31 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:11.920615  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46902173b5c4283b315c6def6f13c31" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:17:11.931972  8913 raft_consensus.cc:3060] T d46902173b5c4283b315c6def6f13c31 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:11.933537  9874 raft_consensus.cc:993] T 734d16820c5640729de24c6edf4c5ed8 P 7d3072f2af0b481d94ed70632b90e8c6: : Instructing follower 43c6faa9496d44dda6b6eaed09cdfd12 to start an election
I20260709 13:17:11.934152  9874 raft_consensus.cc:1081] T 734d16820c5640729de24c6edf4c5ed8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 LEADER]: Signalling peer 43c6faa9496d44dda6b6eaed09cdfd12 to start an election
I20260709 13:17:11.935823  8914 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "734d16820c5640729de24c6edf4c5ed8"
dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
 from {username='slave'} at 127.0.0.1:51280
I20260709 13:17:11.936474  8914 raft_consensus.cc:493] T 734d16820c5640729de24c6edf4c5ed8 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:11.936903  8914 raft_consensus.cc:3060] T 734d16820c5640729de24c6edf4c5ed8 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:11.941776  8913 raft_consensus.cc:2468] T d46902173b5c4283b315c6def6f13c31 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 3.
I20260709 13:17:11.949333  9555 leader_election.cc:304] T d46902173b5c4283b315c6def6f13c31 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243; no voters: 
I20260709 13:17:11.950596  9889 raft_consensus.cc:2804] T d46902173b5c4283b315c6def6f13c31 P 895d3c58761f427c9c5b3cb41246c243 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:11.951150  9889 raft_consensus.cc:697] T d46902173b5c4283b315c6def6f13c31 P 895d3c58761f427c9c5b3cb41246c243 [term 3 LEADER]: Becoming Leader. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Running, Role: LEADER
I20260709 13:17:11.952210  9889 consensus_queue.cc:237] T d46902173b5c4283b315c6def6f13c31 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:17:11.967367  8839 raft_consensus.cc:2468] T d46902173b5c4283b315c6def6f13c31 P 7d3072f2af0b481d94ed70632b90e8c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 3.
I20260709 13:17:11.971704  8989 raft_consensus.cc:515] T 2accf622ad6243e3b7b496fb979fe9d4 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:17:11.986497  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2accf622ad6243e3b7b496fb979fe9d4" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
I20260709 13:17:11.987277  8842 raft_consensus.cc:3060] T 2accf622ad6243e3b7b496fb979fe9d4 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:11.985693  8664 catalog_manager.cc:5697] T d46902173b5c4283b315c6def6f13c31 P 895d3c58761f427c9c5b3cb41246c243 reported cstate change: term changed from 2 to 3, leader changed from 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194) to 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193). New cstate: current_term: 3 leader_uuid: "895d3c58761f427c9c5b3cb41246c243" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:11.994478  8989 leader_election.cc:290] T 2accf622ad6243e3b7b496fb979fe9d4 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 election: Requested vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:17:11.997195  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2accf622ad6243e3b7b496fb979fe9d4" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:17:11.997982  8913 raft_consensus.cc:3055] T 2accf622ad6243e3b7b496fb979fe9d4 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:11.998303  8913 raft_consensus.cc:740] T 2accf622ad6243e3b7b496fb979fe9d4 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Running, Role: LEADER
I20260709 13:17:11.998420  8914 raft_consensus.cc:515] T 734d16820c5640729de24c6edf4c5ed8 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:17:12.001803  8842 raft_consensus.cc:2468] T 2accf622ad6243e3b7b496fb979fe9d4 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 2.
I20260709 13:17:12.001636  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "734d16820c5640729de24c6edf4c5ed8" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
I20260709 13:17:12.002527  8839 raft_consensus.cc:3055] T 734d16820c5640729de24c6edf4c5ed8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:12.002803  8839 raft_consensus.cc:740] T 734d16820c5640729de24c6edf4c5ed8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Running, Role: LEADER
I20260709 13:17:12.003649  8839 consensus_queue.cc:260] T 734d16820c5640729de24c6edf4c5ed8 P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:17:12.004783  8839 raft_consensus.cc:3060] T 734d16820c5640729de24c6edf4c5ed8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:11.999223  8913 consensus_queue.cc:260] T 2accf622ad6243e3b7b496fb979fe9d4 P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:17:12.008301  8913 raft_consensus.cc:3060] T 2accf622ad6243e3b7b496fb979fe9d4 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:12.009860  8989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "734d16820c5640729de24c6edf4c5ed8" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
I20260709 13:17:12.010794  8989 raft_consensus.cc:3060] T 734d16820c5640729de24c6edf4c5ed8 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:12.007433  8914 leader_election.cc:290] T 734d16820c5640729de24c6edf4c5ed8 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 election: Requested vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:17:12.022542  8957 leader_election.cc:304] T 2accf622ad6243e3b7b496fb979fe9d4 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:17:12.023627  9830 raft_consensus.cc:2804] T 2accf622ad6243e3b7b496fb979fe9d4 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:12.024129  8989 raft_consensus.cc:2468] T 734d16820c5640729de24c6edf4c5ed8 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 2.
I20260709 13:17:12.024209  9830 raft_consensus.cc:697] T 2accf622ad6243e3b7b496fb979fe9d4 P e8bb7e1240f44fda8b83e4c124852032 [term 2 LEADER]: Becoming Leader. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Running, Role: LEADER
I20260709 13:17:12.025940  8913 raft_consensus.cc:2468] T 2accf622ad6243e3b7b496fb979fe9d4 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 2.
I20260709 13:17:12.026086  8882 leader_election.cc:304] T 734d16820c5640729de24c6edf4c5ed8 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:17:12.026223  9830 consensus_queue.cc:237] T 2accf622ad6243e3b7b496fb979fe9d4 P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:17:12.027623  9879 raft_consensus.cc:2804] T 734d16820c5640729de24c6edf4c5ed8 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:12.028188  9879 raft_consensus.cc:697] T 734d16820c5640729de24c6edf4c5ed8 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 LEADER]: Becoming Leader. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Running, Role: LEADER
I20260709 13:17:12.029349  9879 consensus_queue.cc:237] T 734d16820c5640729de24c6edf4c5ed8 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:17:12.114539  8668 catalog_manager.cc:5697] T 2accf622ad6243e3b7b496fb979fe9d4 P e8bb7e1240f44fda8b83e4c124852032 reported cstate change: term changed from 1 to 2, leader changed from 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195) to e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196). New cstate: current_term: 2 leader_uuid: "e8bb7e1240f44fda8b83e4c124852032" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:12.148491  8664 catalog_manager.cc:5697] T 734d16820c5640729de24c6edf4c5ed8 P 43c6faa9496d44dda6b6eaed09cdfd12 reported cstate change: term changed from 1 to 2, leader changed from 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194) to 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195). New cstate: current_term: 2 leader_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:12.229347  8839 raft_consensus.cc:2468] T 734d16820c5640729de24c6edf4c5ed8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 2.
I20260709 13:17:12.283252  8842 raft_consensus.cc:1275] T 65900ac9e06944639fe557200317fe05 P 7d3072f2af0b481d94ed70632b90e8c6 [term 3 FOLLOWER]: Refusing update from remote peer 895d3c58761f427c9c5b3cb41246c243: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:12.285661  9861 consensus_queue.cc:1048] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:17:12.296365  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.196:46105, user_credentials={real_user=slave}} blocked reactor thread for 49810.2us
I20260709 13:17:12.310249  8987 raft_consensus.cc:1275] T 65900ac9e06944639fe557200317fe05 P e8bb7e1240f44fda8b83e4c124852032 [term 3 FOLLOWER]: Refusing update from remote peer 895d3c58761f427c9c5b3cb41246c243: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:12.317179  9889 consensus_queue.cc:1048] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:12.422061  8913 raft_consensus.cc:1275] T b8ded21dd9a54bc8b9cd260808162d0d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Refusing update from remote peer e8bb7e1240f44fda8b83e4c124852032: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:12.431254  9830 consensus_queue.cc:1048] T b8ded21dd9a54bc8b9cd260808162d0d P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:12.441877  8987 raft_consensus.cc:1275] T 734d16820c5640729de24c6edf4c5ed8 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Refusing update from remote peer 43c6faa9496d44dda6b6eaed09cdfd12: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:12.447901  9881 consensus_queue.cc:1048] T 734d16820c5640729de24c6edf4c5ed8 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:12.490777  8918 raft_consensus.cc:1275] T d46902173b5c4283b315c6def6f13c31 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Refusing update from remote peer 895d3c58761f427c9c5b3cb41246c243: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:12.493786  9889 consensus_queue.cc:1048] T d46902173b5c4283b315c6def6f13c31 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:12.507253  8844 raft_consensus.cc:1275] T b8ded21dd9a54bc8b9cd260808162d0d P 7d3072f2af0b481d94ed70632b90e8c6 [term 3 FOLLOWER]: Refusing update from remote peer e8bb7e1240f44fda8b83e4c124852032: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:12.532896  8844 raft_consensus.cc:1275] T d46902173b5c4283b315c6def6f13c31 P 7d3072f2af0b481d94ed70632b90e8c6 [term 3 FOLLOWER]: Refusing update from remote peer 895d3c58761f427c9c5b3cb41246c243: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:12.542886  9889 consensus_queue.cc:1048] T d46902173b5c4283b315c6def6f13c31 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:12.592476  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:12.516059  9830 consensus_queue.cc:1048] T b8ded21dd9a54bc8b9cd260808162d0d P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.107s
I20260709 13:17:12.638901  8842 raft_consensus.cc:1275] T 734d16820c5640729de24c6edf4c5ed8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Refusing update from remote peer 43c6faa9496d44dda6b6eaed09cdfd12: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:17:12.641716  8959 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:37671, user_credentials={real_user=slave}} blocked reactor thread for 151814us
I20260709 13:17:12.647382  9879 consensus_queue.cc:1048] T 734d16820c5640729de24c6edf4c5ed8 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:12.686928  8918 raft_consensus.cc:1275] T 2accf622ad6243e3b7b496fb979fe9d4 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Refusing update from remote peer e8bb7e1240f44fda8b83e4c124852032: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:12.696884  8844 raft_consensus.cc:1275] T 2accf622ad6243e3b7b496fb979fe9d4 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Refusing update from remote peer e8bb7e1240f44fda8b83e4c124852032: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:12.705510  9922 consensus_queue.cc:1048] T 2accf622ad6243e3b7b496fb979fe9d4 P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:12.711651  9922 consensus_queue.cc:1048] T 2accf622ad6243e3b7b496fb979fe9d4 P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:12.871165  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:12.947971  8842 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "197670bf2e8f4301b060ed8ef6862b22"
dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
mode: GRACEFUL
new_leader_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
 from {username='slave'} at 127.0.0.1:53176
I20260709 13:17:12.948863  8842 raft_consensus.cc:606] T 197670bf2e8f4301b060ed8ef6862b22 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 LEADER]: Received request to transfer leadership to TS 43c6faa9496d44dda6b6eaed09cdfd12
I20260709 13:17:12.958930  8989 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c9bb56a39d44b71b44c334e0bea59a5"
dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
mode: GRACEFUL
new_leader_uuid: "895d3c58761f427c9c5b3cb41246c243"
 from {username='slave'} at 127.0.0.1:57756
I20260709 13:17:12.959791  8989 raft_consensus.cc:606] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 [term 1 LEADER]: Received request to transfer leadership to TS 895d3c58761f427c9c5b3cb41246c243
I20260709 13:17:12.963481  8989 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be1c593726564ba7ae9e8b66d1989f69"
dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
mode: GRACEFUL
new_leader_uuid: "895d3c58761f427c9c5b3cb41246c243"
 from {username='slave'} at 127.0.0.1:57756
I20260709 13:17:12.964203  8989 raft_consensus.cc:606] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [term 2 LEADER]: Received request to transfer leadership to TS 895d3c58761f427c9c5b3cb41246c243
I20260709 13:17:12.967581  8918 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d64af92885f944f9b1ecf193ede281b3"
dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
mode: GRACEFUL
new_leader_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
 from {username='slave'} at 127.0.0.1:37268
I20260709 13:17:12.968196  8918 raft_consensus.cc:606] T d64af92885f944f9b1ecf193ede281b3 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Received request to transfer leadership to TS 7d3072f2af0b481d94ed70632b90e8c6
I20260709 13:17:12.969573  2843 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:17:12.970960  2843 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:13.037633  9879 raft_consensus.cc:993] T d64af92885f944f9b1ecf193ede281b3 P 43c6faa9496d44dda6b6eaed09cdfd12: : Instructing follower 7d3072f2af0b481d94ed70632b90e8c6 to start an election
I20260709 13:17:13.038429  9834 raft_consensus.cc:1081] T d64af92885f944f9b1ecf193ede281b3 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Signalling peer 7d3072f2af0b481d94ed70632b90e8c6 to start an election
I20260709 13:17:13.040158  8844 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d64af92885f944f9b1ecf193ede281b3"
dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
 from {username='slave'} at 127.0.0.1:48416
I20260709 13:17:13.040908  8844 raft_consensus.cc:493] T d64af92885f944f9b1ecf193ede281b3 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:13.041462  8844 raft_consensus.cc:3060] T d64af92885f944f9b1ecf193ede281b3 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:13.050201  8844 raft_consensus.cc:515] T d64af92885f944f9b1ecf193ede281b3 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:17:13.053424  8844 leader_election.cc:290] T d64af92885f944f9b1ecf193ede281b3 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 election: Requested vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:17:13.054003  8987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64af92885f944f9b1ecf193ede281b3" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
I20260709 13:17:13.054809  8987 raft_consensus.cc:3060] T d64af92885f944f9b1ecf193ede281b3 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:13.054976  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64af92885f944f9b1ecf193ede281b3" candidate_uuid: "7d3072f2af0b481d94ed70632b90e8c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:17:13.056270  8918 raft_consensus.cc:3055] T d64af92885f944f9b1ecf193ede281b3 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:13.056618  8918 raft_consensus.cc:740] T d64af92885f944f9b1ecf193ede281b3 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Running, Role: LEADER
I20260709 13:17:13.057891  8918 consensus_queue.cc:260] T d64af92885f944f9b1ecf193ede281b3 P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:17:13.061100  8918 raft_consensus.cc:3060] T d64af92885f944f9b1ecf193ede281b3 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:13.069267  8987 raft_consensus.cc:2468] T d64af92885f944f9b1ecf193ede281b3 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 2.
I20260709 13:17:13.070210  8918 raft_consensus.cc:2468] T d64af92885f944f9b1ecf193ede281b3 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3072f2af0b481d94ed70632b90e8c6 in term 2.
I20260709 13:17:13.072901  8808 leader_election.cc:304] T d64af92885f944f9b1ecf193ede281b3 P 7d3072f2af0b481d94ed70632b90e8c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3072f2af0b481d94ed70632b90e8c6, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:17:13.074286  9874 raft_consensus.cc:2804] T d64af92885f944f9b1ecf193ede281b3 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:13.074813  9874 raft_consensus.cc:697] T d64af92885f944f9b1ecf193ede281b3 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 LEADER]: Becoming Leader. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Running, Role: LEADER
I20260709 13:17:13.075984  9874 consensus_queue.cc:237] T d64af92885f944f9b1ecf193ede281b3 P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:17:13.089093  8664 catalog_manager.cc:5697] T d64af92885f944f9b1ecf193ede281b3 P 7d3072f2af0b481d94ed70632b90e8c6 reported cstate change: term changed from 1 to 2, leader changed from 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195) to 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194). New cstate: current_term: 2 leader_uuid: "7d3072f2af0b481d94ed70632b90e8c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:13.139781  9618 raft_consensus.cc:993] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032: : Instructing follower 895d3c58761f427c9c5b3cb41246c243 to start an election
I20260709 13:17:13.140316  9922 raft_consensus.cc:1081] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 [term 1 LEADER]: Signalling peer 895d3c58761f427c9c5b3cb41246c243 to start an election
I20260709 13:17:13.141942  9629 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c9bb56a39d44b71b44c334e0bea59a5"
dest_uuid: "895d3c58761f427c9c5b3cb41246c243"
 from {username='slave'} at 127.0.0.1:37430
I20260709 13:17:13.142522  9629 raft_consensus.cc:493] T 1c9bb56a39d44b71b44c334e0bea59a5 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:13.142796  9629 raft_consensus.cc:3060] T 1c9bb56a39d44b71b44c334e0bea59a5 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:13.154830  9629 raft_consensus.cc:515] T 1c9bb56a39d44b71b44c334e0bea59a5 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:13.158931  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9bb56a39d44b71b44c334e0bea59a5" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:17:13.159688  8918 raft_consensus.cc:3060] T 1c9bb56a39d44b71b44c334e0bea59a5 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:13.170269  9629 leader_election.cc:290] T 1c9bb56a39d44b71b44c334e0bea59a5 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 election: Requested vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:17:13.171494  8989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9bb56a39d44b71b44c334e0bea59a5" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
I20260709 13:17:13.172309  8989 raft_consensus.cc:3055] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:13.172439  8918 raft_consensus.cc:2468] T 1c9bb56a39d44b71b44c334e0bea59a5 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 2.
I20260709 13:17:13.172803  8989 raft_consensus.cc:740] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Running, Role: LEADER
I20260709 13:17:13.173760  8989 consensus_queue.cc:260] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:13.174199  9555 leader_election.cc:304] T 1c9bb56a39d44b71b44c334e0bea59a5 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243; no voters: 
I20260709 13:17:13.175347  8989 raft_consensus.cc:3060] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:13.175500  9887 raft_consensus.cc:2804] T 1c9bb56a39d44b71b44c334e0bea59a5 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:13.176183  9887 raft_consensus.cc:697] T 1c9bb56a39d44b71b44c334e0bea59a5 P 895d3c58761f427c9c5b3cb41246c243 [term 2 LEADER]: Becoming Leader. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Running, Role: LEADER
I20260709 13:17:13.177225  9887 consensus_queue.cc:237] T 1c9bb56a39d44b71b44c334e0bea59a5 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:13.186381  8989 raft_consensus.cc:2468] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 2.
I20260709 13:17:13.223242  8664 catalog_manager.cc:5697] T 1c9bb56a39d44b71b44c334e0bea59a5 P 895d3c58761f427c9c5b3cb41246c243 reported cstate change: term changed from 1 to 2, leader changed from e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196) to 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193). New cstate: current_term: 2 leader_uuid: "895d3c58761f427c9c5b3cb41246c243" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:13.262961  9915 raft_consensus.cc:993] T 197670bf2e8f4301b060ed8ef6862b22 P 7d3072f2af0b481d94ed70632b90e8c6: : Instructing follower 43c6faa9496d44dda6b6eaed09cdfd12 to start an election
I20260709 13:17:13.263571  9915 raft_consensus.cc:1081] T 197670bf2e8f4301b060ed8ef6862b22 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 LEADER]: Signalling peer 43c6faa9496d44dda6b6eaed09cdfd12 to start an election
I20260709 13:17:13.265499  8918 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "197670bf2e8f4301b060ed8ef6862b22"
dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
 from {username='slave'} at 127.0.0.1:51280
I20260709 13:17:13.266348  8918 raft_consensus.cc:493] T 197670bf2e8f4301b060ed8ef6862b22 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:13.266762  8918 raft_consensus.cc:3060] T 197670bf2e8f4301b060ed8ef6862b22 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:13.274179  9618 raft_consensus.cc:993] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032: : Instructing follower 895d3c58761f427c9c5b3cb41246c243 to start an election
I20260709 13:17:13.274719  9618 raft_consensus.cc:1081] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [term 2 LEADER]: Signalling peer 895d3c58761f427c9c5b3cb41246c243 to start an election
I20260709 13:17:13.276363  9629 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be1c593726564ba7ae9e8b66d1989f69"
dest_uuid: "895d3c58761f427c9c5b3cb41246c243"
 from {username='slave'} at 127.0.0.1:37430
I20260709 13:17:13.276904  9629 raft_consensus.cc:493] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:13.277287  9629 raft_consensus.cc:3060] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:13.277835  8918 raft_consensus.cc:515] T 197670bf2e8f4301b060ed8ef6862b22 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:17:13.280157  8918 leader_election.cc:290] T 197670bf2e8f4301b060ed8ef6862b22 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 election: Requested vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:17:13.281220  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "197670bf2e8f4301b060ed8ef6862b22" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
I20260709 13:17:13.281939  8842 raft_consensus.cc:3055] T 197670bf2e8f4301b060ed8ef6862b22 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:13.282244  8842 raft_consensus.cc:740] T 197670bf2e8f4301b060ed8ef6862b22 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Running, Role: LEADER
I20260709 13:17:13.282298  8989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "197670bf2e8f4301b060ed8ef6862b22" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
I20260709 13:17:13.282958  8989 raft_consensus.cc:3060] T 197670bf2e8f4301b060ed8ef6862b22 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:13.283183  8842 consensus_queue.cc:260] T 197670bf2e8f4301b060ed8ef6862b22 P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:17:13.284469  8842 raft_consensus.cc:3060] T 197670bf2e8f4301b060ed8ef6862b22 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:13.294770  8989 raft_consensus.cc:2468] T 197670bf2e8f4301b060ed8ef6862b22 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 2.
I20260709 13:17:13.296494  8882 leader_election.cc:304] T 197670bf2e8f4301b060ed8ef6862b22 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:17:13.297572  9826 raft_consensus.cc:2804] T 197670bf2e8f4301b060ed8ef6862b22 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:13.298003  9826 raft_consensus.cc:697] T 197670bf2e8f4301b060ed8ef6862b22 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 LEADER]: Becoming Leader. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Running, Role: LEADER
I20260709 13:17:13.298930  9826 consensus_queue.cc:237] T 197670bf2e8f4301b060ed8ef6862b22 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:17:13.299409  9629 raft_consensus.cc:515] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:13.298018  8842 raft_consensus.cc:2468] T 197670bf2e8f4301b060ed8ef6862b22 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 2.
I20260709 13:17:13.303333  9629 leader_election.cc:290] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 3 election: Requested vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
I20260709 13:17:13.303614  8989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1c593726564ba7ae9e8b66d1989f69" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
I20260709 13:17:13.304203  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1c593726564ba7ae9e8b66d1989f69" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:17:13.304378  8989 raft_consensus.cc:3055] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:13.304921  8918 raft_consensus.cc:3060] T be1c593726564ba7ae9e8b66d1989f69 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:13.304888  8989 raft_consensus.cc:740] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Running, Role: LEADER
I20260709 13:17:13.306049  8989 consensus_queue.cc:260] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:13.307473  8989 raft_consensus.cc:3060] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:13.315933  8989 raft_consensus.cc:2468] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 3.
I20260709 13:17:13.320429  9552 leader_election.cc:304] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:17:13.322867  9889 raft_consensus.cc:2804] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:13.323377  9889 raft_consensus.cc:697] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243 [term 3 LEADER]: Becoming Leader. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Running, Role: LEADER
I20260709 13:17:13.323532  8918 raft_consensus.cc:2468] T be1c593726564ba7ae9e8b66d1989f69 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 3.
I20260709 13:17:13.324450  9889 consensus_queue.cc:237] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:13.332935  8664 catalog_manager.cc:5697] T 197670bf2e8f4301b060ed8ef6862b22 P 43c6faa9496d44dda6b6eaed09cdfd12 reported cstate change: term changed from 1 to 2, leader changed from 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194) to 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195). New cstate: current_term: 2 leader_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:13.350466  8664 catalog_manager.cc:5697] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243 reported cstate change: term changed from 2 to 3, leader changed from e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196) to 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193). New cstate: current_term: 3 leader_uuid: "895d3c58761f427c9c5b3cb41246c243" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:13.547308  8989 raft_consensus.cc:1275] T d64af92885f944f9b1ecf193ede281b3 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Refusing update from remote peer 7d3072f2af0b481d94ed70632b90e8c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:13.548964  9915 consensus_queue.cc:1048] T d64af92885f944f9b1ecf193ede281b3 P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:13.552989  8918 raft_consensus.cc:1275] T d64af92885f944f9b1ecf193ede281b3 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Refusing update from remote peer 7d3072f2af0b481d94ed70632b90e8c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:13.555315  9915 consensus_queue.cc:1048] T d64af92885f944f9b1ecf193ede281b3 P 7d3072f2af0b481d94ed70632b90e8c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:13.720038  8987 raft_consensus.cc:1275] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Refusing update from remote peer 895d3c58761f427c9c5b3cb41246c243: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:13.721478  9889 consensus_queue.cc:1048] T 1c9bb56a39d44b71b44c334e0bea59a5 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:13.736894  8918 raft_consensus.cc:1275] T 1c9bb56a39d44b71b44c334e0bea59a5 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Refusing update from remote peer 895d3c58761f427c9c5b3cb41246c243: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:13.738413  9861 consensus_queue.cc:1048] T 1c9bb56a39d44b71b44c334e0bea59a5 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:13.756631  8918 raft_consensus.cc:1275] T be1c593726564ba7ae9e8b66d1989f69 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Refusing update from remote peer 895d3c58761f427c9c5b3cb41246c243: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:13.759423  9887 consensus_queue.cc:1048] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:13.769867  8987 raft_consensus.cc:1275] T 197670bf2e8f4301b060ed8ef6862b22 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Refusing update from remote peer 43c6faa9496d44dda6b6eaed09cdfd12: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:13.773563  9879 consensus_queue.cc:1048] T 197670bf2e8f4301b060ed8ef6862b22 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:13.811118  8987 raft_consensus.cc:1275] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [term 3 FOLLOWER]: Refusing update from remote peer 895d3c58761f427c9c5b3cb41246c243: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:13.816396  9887 consensus_queue.cc:1048] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:13.819944  8844 raft_consensus.cc:1275] T 197670bf2e8f4301b060ed8ef6862b22 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Refusing update from remote peer 43c6faa9496d44dda6b6eaed09cdfd12: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:13.844729  9879 consensus_queue.cc:1048] T 197670bf2e8f4301b060ed8ef6862b22 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:13.972090  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:14.033919  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:14.081401  8918 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6fa028ad690c4f3c94ec7c6443a3f1d3"
dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
mode: GRACEFUL
new_leader_uuid: "895d3c58761f427c9c5b3cb41246c243"
 from {username='slave'} at 127.0.0.1:37268
I20260709 13:17:14.082072  8918 raft_consensus.cc:606] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Received request to transfer leadership to TS 895d3c58761f427c9c5b3cb41246c243
I20260709 13:17:14.085642  8844 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "825ea78cebec4b10a2f8d03b45d929fa"
dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
mode: GRACEFUL
new_leader_uuid: "895d3c58761f427c9c5b3cb41246c243"
 from {username='slave'} at 127.0.0.1:53176
I20260709 13:17:14.086311  8844 raft_consensus.cc:606] T 825ea78cebec4b10a2f8d03b45d929fa P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 LEADER]: Received request to transfer leadership to TS 895d3c58761f427c9c5b3cb41246c243
I20260709 13:17:14.088335  2843 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:17:14.090636  2843 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:14.278924  9933 raft_consensus.cc:993] T 825ea78cebec4b10a2f8d03b45d929fa P 7d3072f2af0b481d94ed70632b90e8c6: : Instructing follower 895d3c58761f427c9c5b3cb41246c243 to start an election
I20260709 13:17:14.279722  9915 raft_consensus.cc:1081] T 825ea78cebec4b10a2f8d03b45d929fa P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 LEADER]: Signalling peer 895d3c58761f427c9c5b3cb41246c243 to start an election
I20260709 13:17:14.282483  9598 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "825ea78cebec4b10a2f8d03b45d929fa"
dest_uuid: "895d3c58761f427c9c5b3cb41246c243"
 from {username='slave'} at 127.0.0.1:37400
I20260709 13:17:14.283138  9598 raft_consensus.cc:493] T 825ea78cebec4b10a2f8d03b45d929fa P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:14.283542  9598 raft_consensus.cc:3060] T 825ea78cebec4b10a2f8d03b45d929fa P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:14.290310  9598 raft_consensus.cc:515] T 825ea78cebec4b10a2f8d03b45d929fa P 895d3c58761f427c9c5b3cb41246c243 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:17:14.293038  9598 leader_election.cc:290] T 825ea78cebec4b10a2f8d03b45d929fa P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 3 election: Requested vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:17:14.293741  8989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825ea78cebec4b10a2f8d03b45d929fa" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
I20260709 13:17:14.293964  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825ea78cebec4b10a2f8d03b45d929fa" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
I20260709 13:17:14.294528  8989 raft_consensus.cc:3060] T 825ea78cebec4b10a2f8d03b45d929fa P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:14.294937  8844 raft_consensus.cc:3055] T 825ea78cebec4b10a2f8d03b45d929fa P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:14.295563  8844 raft_consensus.cc:740] T 825ea78cebec4b10a2f8d03b45d929fa P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7d3072f2af0b481d94ed70632b90e8c6, State: Running, Role: LEADER
I20260709 13:17:14.296567  8844 consensus_queue.cc:260] T 825ea78cebec4b10a2f8d03b45d929fa P 7d3072f2af0b481d94ed70632b90e8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:17:14.297871  8844 raft_consensus.cc:3060] T 825ea78cebec4b10a2f8d03b45d929fa P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:14.304638  8989 raft_consensus.cc:2468] T 825ea78cebec4b10a2f8d03b45d929fa P e8bb7e1240f44fda8b83e4c124852032 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 3.
I20260709 13:17:14.306128  9552 leader_election.cc:304] T 825ea78cebec4b10a2f8d03b45d929fa P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 895d3c58761f427c9c5b3cb41246c243, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:17:14.307304  9952 raft_consensus.cc:2804] T 825ea78cebec4b10a2f8d03b45d929fa P 895d3c58761f427c9c5b3cb41246c243 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:14.307814  9952 raft_consensus.cc:697] T 825ea78cebec4b10a2f8d03b45d929fa P 895d3c58761f427c9c5b3cb41246c243 [term 3 LEADER]: Becoming Leader. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Running, Role: LEADER
I20260709 13:17:14.308722  9952 consensus_queue.cc:237] T 825ea78cebec4b10a2f8d03b45d929fa P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:17:14.309456  8844 raft_consensus.cc:2468] T 825ea78cebec4b10a2f8d03b45d929fa P 7d3072f2af0b481d94ed70632b90e8c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 3.
I20260709 13:17:14.332235  8667 catalog_manager.cc:5697] T 825ea78cebec4b10a2f8d03b45d929fa P 895d3c58761f427c9c5b3cb41246c243 reported cstate change: term changed from 2 to 3, leader changed from 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194) to 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193). New cstate: current_term: 3 leader_uuid: "895d3c58761f427c9c5b3cb41246c243" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:14.411211  9826 raft_consensus.cc:993] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 43c6faa9496d44dda6b6eaed09cdfd12: : Instructing follower 895d3c58761f427c9c5b3cb41246c243 to start an election
I20260709 13:17:14.411726  9879 raft_consensus.cc:1081] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Signalling peer 895d3c58761f427c9c5b3cb41246c243 to start an election
I20260709 13:17:14.413426  9598 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6fa028ad690c4f3c94ec7c6443a3f1d3"
dest_uuid: "895d3c58761f427c9c5b3cb41246c243"
 from {username='slave'} at 127.0.0.1:37414
I20260709 13:17:14.413965  9598 raft_consensus.cc:493] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:14.414290  9598 raft_consensus.cc:3060] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:14.422011  9598 raft_consensus.cc:515] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:17:14.424558  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fa028ad690c4f3c94ec7c6443a3f1d3" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d3072f2af0b481d94ed70632b90e8c6"
I20260709 13:17:14.425182  8842 raft_consensus.cc:3060] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:14.426453  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fa028ad690c4f3c94ec7c6443a3f1d3" candidate_uuid: "895d3c58761f427c9c5b3cb41246c243" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:17:14.427096  8914 raft_consensus.cc:3055] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:14.427381  8914 raft_consensus.cc:740] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Running, Role: LEADER
I20260709 13:17:14.428850  8914 consensus_queue.cc:260] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 43c6faa9496d44dda6b6eaed09cdfd12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:17:14.430265  8914 raft_consensus.cc:3060] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:14.436654  9598 leader_election.cc:290] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 election: Requested vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:17:14.446249  8914 raft_consensus.cc:2468] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 2.
I20260709 13:17:14.447902  9555 leader_election.cc:304] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 895d3c58761f427c9c5b3cb41246c243 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243; no voters: 
I20260709 13:17:14.443167  8842 raft_consensus.cc:2468] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895d3c58761f427c9c5b3cb41246c243 in term 2.
I20260709 13:17:14.449329  9952 raft_consensus.cc:2804] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:14.449853  9952 raft_consensus.cc:697] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 895d3c58761f427c9c5b3cb41246c243 [term 2 LEADER]: Becoming Leader. State: Replica: 895d3c58761f427c9c5b3cb41246c243, State: Running, Role: LEADER
I20260709 13:17:14.450820  9952 consensus_queue.cc:237] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:17:14.466451  8667 catalog_manager.cc:5697] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 895d3c58761f427c9c5b3cb41246c243 reported cstate change: term changed from 1 to 2, leader changed from 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195) to 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193). New cstate: current_term: 2 leader_uuid: "895d3c58761f427c9c5b3cb41246c243" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:14.902520  8987 raft_consensus.cc:1275] T 825ea78cebec4b10a2f8d03b45d929fa P e8bb7e1240f44fda8b83e4c124852032 [term 3 FOLLOWER]: Refusing update from remote peer 895d3c58761f427c9c5b3cb41246c243: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:14.904068  9887 consensus_queue.cc:1048] T 825ea78cebec4b10a2f8d03b45d929fa P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:14.941501  8842 raft_consensus.cc:1275] T 825ea78cebec4b10a2f8d03b45d929fa P 7d3072f2af0b481d94ed70632b90e8c6 [term 3 FOLLOWER]: Refusing update from remote peer 895d3c58761f427c9c5b3cb41246c243: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:14.944558  9963 consensus_queue.cc:1048] T 825ea78cebec4b10a2f8d03b45d929fa P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:17:14.963732  8914 raft_consensus.cc:1275] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Refusing update from remote peer 895d3c58761f427c9c5b3cb41246c243: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:14.966264  9952 consensus_queue.cc:1048] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:14.996938  8842 raft_consensus.cc:1275] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Refusing update from remote peer 895d3c58761f427c9c5b3cb41246c243: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:14.999476  9969 consensus_queue.cc:1048] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 895d3c58761f427c9c5b3cb41246c243 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:17:15.092119  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:17:15.140031  8958 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.193:39173, user_credentials={real_user=slave}} blocked reactor thread for 150712us
I20260709 13:17:15.243515  2843 tablet_server.cc:179] TabletServer@127.2.198.193:39173 shutting down...
W20260709 13:17:15.264398  8884 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 294 similar messages]
W20260709 13:17:15.270643  8884 consensus_peers.cc:597] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:15.300240  2843 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:15.301903  2843 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:15.302757  2843 raft_consensus.cc:2243] T 8a25176ebf484df29f67908cfa6e2b48 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:15.303300  2843 raft_consensus.cc:2272] T 8a25176ebf484df29f67908cfa6e2b48 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.306638  2843 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:15.307715  2843 raft_consensus.cc:2243] T 675795627b9b4542805157dd7ec531cd P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:15.308667  2843 raft_consensus.cc:2272] T 675795627b9b4542805157dd7ec531cd P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.312395  2843 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:15.313367  2843 raft_consensus.cc:2243] T d09ffcae84334482a706af1e812c7c9d P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:15.313833  2843 raft_consensus.cc:2272] T d09ffcae84334482a706af1e812c7c9d P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.316355  2843 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:15.317155  2843 raft_consensus.cc:2243] T 7bcde3fdb9314ca4b3422d395a673be5 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:15.317719  2843 raft_consensus.cc:2272] T 7bcde3fdb9314ca4b3422d395a673be5 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.321127  2843 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:15.322289  2843 raft_consensus.cc:2243] T 4352fad232ab47588683e51cf4b62080 P 895d3c58761f427c9c5b3cb41246c243 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:15.323391  2843 raft_consensus.cc:2272] T 4352fad232ab47588683e51cf4b62080 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.326709  2843 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:15.327618  2843 raft_consensus.cc:2243] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 895d3c58761f427c9c5b3cb41246c243 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:15.328686  2843 raft_consensus.cc:2272] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.332151  2843 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:15.333127  2843 raft_consensus.cc:2243] T d46902173b5c4283b315c6def6f13c31 P 895d3c58761f427c9c5b3cb41246c243 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:15.334283  2843 raft_consensus.cc:2272] T d46902173b5c4283b315c6def6f13c31 P 895d3c58761f427c9c5b3cb41246c243 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.337621  2843 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:15.338624  2843 raft_consensus.cc:2243] T 45d9eb22dee8411b82eb768686e34604 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:17:15.338454  8810 consensus_peers.cc:597] T 9f7eec107ecc40f38d14871d9227b25f P 7d3072f2af0b481d94ed70632b90e8c6 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:15.339452  2843 raft_consensus.cc:2272] T 45d9eb22dee8411b82eb768686e34604 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:15.343156  8884 consensus_peers.cc:597] T f80d602267cf421690d5fe6d3922e0cb P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:15.344272  2843 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:15.345434  2843 raft_consensus.cc:2243] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:15.346684  2843 raft_consensus.cc:2272] T 1d5284f5b067413e9fc2a383cc318735 P 895d3c58761f427c9c5b3cb41246c243 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.351805  2843 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:15.352953  2843 raft_consensus.cc:2243] T 68650af2b1894208a4cc0a1c6ddf880b P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:15.353699  2843 raft_consensus.cc:2272] T 68650af2b1894208a4cc0a1c6ddf880b P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:15.355422  8810 consensus_peers.cc:597] T 675795627b9b4542805157dd7ec531cd P 7d3072f2af0b481d94ed70632b90e8c6 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:15.357352  2843 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:15.358426  2843 raft_consensus.cc:2243] T 3f0c32d9abf04206a6f08210b3a30794 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:15.359129  2843 raft_consensus.cc:2272] T 3f0c32d9abf04206a6f08210b3a30794 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.362663  2843 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:15.363613  2843 raft_consensus.cc:2243] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 895d3c58761f427c9c5b3cb41246c243 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:15.364828  2843 raft_consensus.cc:2272] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.368216  2843 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:15.369046  2843 raft_consensus.cc:2243] T 69e5f8bfdb5a46808e713e051a38866d P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:15.369644  2843 raft_consensus.cc:2272] T 69e5f8bfdb5a46808e713e051a38866d P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.372906  2843 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:15.373968  2843 raft_consensus.cc:2243] T f46053ed2641458a87c97152e4979c35 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:15.374632  2843 raft_consensus.cc:2272] T f46053ed2641458a87c97152e4979c35 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.377810  2843 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:15.379603  2843 raft_consensus.cc:2243] T 1c9bb56a39d44b71b44c334e0bea59a5 P 895d3c58761f427c9c5b3cb41246c243 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:17:15.380517  8884 consensus_peers.cc:597] T ef723f9c640849d3890c61c07ffd0378 P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:15.380707  2843 raft_consensus.cc:2272] T 1c9bb56a39d44b71b44c334e0bea59a5 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:15.382117  8884 consensus_peers.cc:597] T ae1fc430ae3d4315aad2c0eed2f026aa P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:15.383080  8958 consensus_peers.cc:597] T 8a25176ebf484df29f67908cfa6e2b48 P e8bb7e1240f44fda8b83e4c124852032 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:15.384249  2843 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:15.385293  2843 raft_consensus.cc:2243] T 448f6ffb482841a3b489476becf2f851 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:15.385891  2843 raft_consensus.cc:2272] T 448f6ffb482841a3b489476becf2f851 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:15.387200  8958 consensus_peers.cc:597] T 448f6ffb482841a3b489476becf2f851 P e8bb7e1240f44fda8b83e4c124852032 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:15.387351  8810 consensus_peers.cc:597] T 932e5cbccd33414f8b05280505fd8bc7 P 7d3072f2af0b481d94ed70632b90e8c6 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:15.389101  2843 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:15.390164  2843 raft_consensus.cc:2243] T 17e47826fe4e4662baba1d095c341c1b P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:15.390676  2843 raft_consensus.cc:2272] T 17e47826fe4e4662baba1d095c341c1b P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.393673  2843 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:15.394321  2843 raft_consensus.cc:2243] T 097c705b65de4abe884afdb1fcaaa054 P 895d3c58761f427c9c5b3cb41246c243 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:15.395521  2843 raft_consensus.cc:2272] T 097c705b65de4abe884afdb1fcaaa054 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.398813  2843 tablet_replica.cc:333] stopping tablet replica
W20260709 13:17:15.398823  8810 consensus_peers.cc:597] T 17e47826fe4e4662baba1d095c341c1b P 7d3072f2af0b481d94ed70632b90e8c6 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:15.399631  2843 raft_consensus.cc:2243] T 9f7eec107ecc40f38d14871d9227b25f P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:15.400141  2843 raft_consensus.cc:2272] T 9f7eec107ecc40f38d14871d9227b25f P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.402789  2843 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:15.403434  2843 raft_consensus.cc:2243] T dde08046aca642488918d1f2b978c126 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:15.403975  2843 raft_consensus.cc:2272] T dde08046aca642488918d1f2b978c126 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.406239  2843 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:15.406919  2843 raft_consensus.cc:2243] T ab679ea0af724bd39f753eb407c73264 P 895d3c58761f427c9c5b3cb41246c243 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:15.407584  2843 raft_consensus.cc:2272] T ab679ea0af724bd39f753eb407c73264 P 895d3c58761f427c9c5b3cb41246c243 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.410563  2843 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:15.411397  2843 raft_consensus.cc:2243] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:15.412266  2843 raft_consensus.cc:2272] T 65900ac9e06944639fe557200317fe05 P 895d3c58761f427c9c5b3cb41246c243 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.414685  2843 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:15.415745  2843 raft_consensus.cc:2243] T ed4d847e589942fcbf6dadbb578327f2 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:15.416270  2843 raft_consensus.cc:2272] T ed4d847e589942fcbf6dadbb578327f2 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.419407  2843 tablet_replica.cc:333] stopping tablet replica
W20260709 13:17:15.419901  8810 consensus_peers.cc:597] T 390c483b2a1c42b897e166b1a381851c P 7d3072f2af0b481d94ed70632b90e8c6 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:15.420279  2843 raft_consensus.cc:2243] T f80d602267cf421690d5fe6d3922e0cb P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:15.421038  2843 raft_consensus.cc:2272] T f80d602267cf421690d5fe6d3922e0cb P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.424080  2843 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:15.424801  2843 raft_consensus.cc:2243] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:15.425966  2843 raft_consensus.cc:2272] T 4fd6605b785643deac78902ee4fc6896 P 895d3c58761f427c9c5b3cb41246c243 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.429082  2843 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:15.429711  2843 raft_consensus.cc:2243] T 5a26acd2175646e3a53b493571852af4 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:15.430153  2843 raft_consensus.cc:2272] T 5a26acd2175646e3a53b493571852af4 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:15.431141  8884 consensus_peers.cc:597] T d09ffcae84334482a706af1e812c7c9d P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:15.432761  2843 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:15.433717  2843 raft_consensus.cc:2243] T ef723f9c640849d3890c61c07ffd0378 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:15.434353  2843 raft_consensus.cc:2272] T ef723f9c640849d3890c61c07ffd0378 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.437551  2843 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:15.438408  2843 raft_consensus.cc:2243] T 1521cafcc31b47c58829494618fc0cd8 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:15.438938  2843 raft_consensus.cc:2272] T 1521cafcc31b47c58829494618fc0cd8 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.442068  2843 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:15.442862  2843 raft_consensus.cc:2243] T 80fde6a0b6334446923248a50e223397 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:15.443439  2843 raft_consensus.cc:2272] T 80fde6a0b6334446923248a50e223397 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.446739  2843 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:15.447850  2843 raft_consensus.cc:2243] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:15.448582  2843 raft_consensus.cc:2272] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.451707  2843 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:15.452499  2843 raft_consensus.cc:2243] T 2945a5b174e14a5a9052897942f876c2 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:15.453066  2843 raft_consensus.cc:2272] T 2945a5b174e14a5a9052897942f876c2 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.456188  2843 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:15.457099  2843 raft_consensus.cc:2243] T 9fdcbb0a74a64826ab0665c349b16200 P 895d3c58761f427c9c5b3cb41246c243 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:15.458211  2843 raft_consensus.cc:2272] T 9fdcbb0a74a64826ab0665c349b16200 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.461203  2843 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:15.462025  2843 raft_consensus.cc:2243] T f3abbeb71eba411bb6dfec800d3bd9c0 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:15.462595  2843 raft_consensus.cc:2272] T f3abbeb71eba411bb6dfec800d3bd9c0 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.465646  2843 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:15.466473  2843 raft_consensus.cc:2243] T 390c483b2a1c42b897e166b1a381851c P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:17:15.466743  8884 consensus_peers.cc:597] T 80fde6a0b6334446923248a50e223397 P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:15.467022  2843 raft_consensus.cc:2272] T 390c483b2a1c42b897e166b1a381851c P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.470372  2843 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:15.471256  2843 raft_consensus.cc:2243] T 932e5cbccd33414f8b05280505fd8bc7 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:17:15.470429  8884 consensus_peers.cc:597] T dde08046aca642488918d1f2b978c126 P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:15.471907  2843 raft_consensus.cc:2272] T 932e5cbccd33414f8b05280505fd8bc7 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:15.475910  8958 consensus_peers.cc:597] T 69e5f8bfdb5a46808e713e051a38866d P e8bb7e1240f44fda8b83e4c124852032 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:15.476738  8810 consensus_peers.cc:597] T 4e1e1e84d68946d682e0944fbd3c51a8 P 7d3072f2af0b481d94ed70632b90e8c6 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:15.476965  2843 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:15.478003  2843 raft_consensus.cc:2243] T f3ea64f4f4c54500a95692118660d9b4 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:15.478547  2843 raft_consensus.cc:2272] T f3ea64f4f4c54500a95692118660d9b4 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.481738  2843 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:15.482628  2843 raft_consensus.cc:2243] T 574915613e8a4d3481aef27d3a977caa P 895d3c58761f427c9c5b3cb41246c243 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:15.484022  2843 raft_consensus.cc:2272] T 574915613e8a4d3481aef27d3a977caa P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.487587  2843 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:15.488559  2843 raft_consensus.cc:2243] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:15.489722  2843 raft_consensus.cc:2272] T be1c593726564ba7ae9e8b66d1989f69 P 895d3c58761f427c9c5b3cb41246c243 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.493079  2843 tablet_replica.cc:333] stopping tablet replica
W20260709 13:17:15.494458  8884 consensus_peers.cc:597] T 7bcde3fdb9314ca4b3422d395a673be5 P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:15.494529  2843 raft_consensus.cc:2243] T ae1fc430ae3d4315aad2c0eed2f026aa P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:15.495285  2843 raft_consensus.cc:2272] T ae1fc430ae3d4315aad2c0eed2f026aa P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.498560  2843 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:15.499418  2843 raft_consensus.cc:2243] T cc6e2639db63487cae6a125c8d5fe1d8 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:15.500074  2843 raft_consensus.cc:2272] T cc6e2639db63487cae6a125c8d5fe1d8 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.503121  2843 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:15.503952  2843 raft_consensus.cc:2243] T 852f0ef4508245e2812b76665a70bbf8 P 895d3c58761f427c9c5b3cb41246c243 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:15.505098  2843 raft_consensus.cc:2272] T 852f0ef4508245e2812b76665a70bbf8 P 895d3c58761f427c9c5b3cb41246c243 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.508303  2843 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:15.509065  2843 raft_consensus.cc:2243] T 4e1e1e84d68946d682e0944fbd3c51a8 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:15.509603  2843 raft_consensus.cc:2272] T 4e1e1e84d68946d682e0944fbd3c51a8 P 895d3c58761f427c9c5b3cb41246c243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.512601  2843 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:15.513391  2843 raft_consensus.cc:2243] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:15.513971  2843 raft_consensus.cc:2272] T 45613c5d357b40b8af0ced6c8725c559 P 895d3c58761f427c9c5b3cb41246c243 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.517236  2843 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:15.517908  2843 raft_consensus.cc:2243] T 825ea78cebec4b10a2f8d03b45d929fa P 895d3c58761f427c9c5b3cb41246c243 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:15.519093  2843 raft_consensus.cc:2272] T 825ea78cebec4b10a2f8d03b45d929fa P 895d3c58761f427c9c5b3cb41246c243 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.522683  2843 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:15.523430  2843 raft_consensus.cc:2243] T c17f01b356e04590838cc6e6bb27bf64 P 895d3c58761f427c9c5b3cb41246c243 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:15.523983  2843 raft_consensus.cc:2272] T c17f01b356e04590838cc6e6bb27bf64 P 895d3c58761f427c9c5b3cb41246c243 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:15.547421  8958 consensus_peers.cc:597] T 3f0c32d9abf04206a6f08210b3a30794 P e8bb7e1240f44fda8b83e4c124852032 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:15.570830  8884 consensus_peers.cc:597] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:15.576045  8958 consensus_peers.cc:597] T 45d9eb22dee8411b82eb768686e34604 P e8bb7e1240f44fda8b83e4c124852032 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:15.640681  2843 tablet_server.cc:196] TabletServer@127.2.198.193:39173 shutdown complete.
W20260709 13:17:15.641080  8884 consensus_peers.cc:597] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:15.643309  8958 consensus_peers.cc:597] T 5a26acd2175646e3a53b493571852af4 P e8bb7e1240f44fda8b83e4c124852032 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:15.643901  8958 consensus_peers.cc:597] T 1521cafcc31b47c58829494618fc0cd8 P e8bb7e1240f44fda8b83e4c124852032 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:15.659442  8884 consensus_peers.cc:597] T f46053ed2641458a87c97152e4979c35 P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:15.674350  8810 consensus_peers.cc:597] T cc6e2639db63487cae6a125c8d5fe1d8 P 7d3072f2af0b481d94ed70632b90e8c6 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:15.695355  8958 consensus_peers.cc:597] T 68650af2b1894208a4cc0a1c6ddf880b P e8bb7e1240f44fda8b83e4c124852032 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:15.709648  8958 consensus_peers.cc:597] T 2945a5b174e14a5a9052897942f876c2 P e8bb7e1240f44fda8b83e4c124852032 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:15.718669  8810 consensus_peers.cc:597] T f3ea64f4f4c54500a95692118660d9b4 P 7d3072f2af0b481d94ed70632b90e8c6 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:15.776546  8958 consensus_peers.cc:597] T ed4d847e589942fcbf6dadbb578327f2 P e8bb7e1240f44fda8b83e4c124852032 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:15.781239  2843 tablet_server.cc:179] TabletServer@127.2.198.194:0 shutting down...
W20260709 13:17:15.786514  8810 consensus_peers.cc:597] T f3abbeb71eba411bb6dfec800d3bd9c0 P 7d3072f2af0b481d94ed70632b90e8c6 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:15.812906  8957 consensus_peers.cc:597] T ed4d847e589942fcbf6dadbb578327f2 P e8bb7e1240f44fda8b83e4c124852032 -> Peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Couldn't send request to peer 7d3072f2af0b481d94ed70632b90e8c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:15.820900  8883 consensus_peers.cc:597] T 197670bf2e8f4301b060ed8ef6862b22 P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Couldn't send request to peer 7d3072f2af0b481d94ed70632b90e8c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:15.823357  8957 consensus_peers.cc:597] T 8a25176ebf484df29f67908cfa6e2b48 P e8bb7e1240f44fda8b83e4c124852032 -> Peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Couldn't send request to peer 7d3072f2af0b481d94ed70632b90e8c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:15.825335  8957 consensus_peers.cc:597] T 3f0c32d9abf04206a6f08210b3a30794 P e8bb7e1240f44fda8b83e4c124852032 -> Peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Couldn't send request to peer 7d3072f2af0b481d94ed70632b90e8c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:15.829831  8957 consensus_peers.cc:597] T 5a26acd2175646e3a53b493571852af4 P e8bb7e1240f44fda8b83e4c124852032 -> Peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Couldn't send request to peer 7d3072f2af0b481d94ed70632b90e8c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:15.871675  8957 consensus_peers.cc:597] T b8ded21dd9a54bc8b9cd260808162d0d P e8bb7e1240f44fda8b83e4c124852032 -> Peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Couldn't send request to peer 7d3072f2af0b481d94ed70632b90e8c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:15.873557  8810 consensus_peers.cc:597] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 7d3072f2af0b481d94ed70632b90e8c6 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:15.890991  8957 consensus_peers.cc:597] T dc5cf20be8db404dbda7f0b4a676ab31 P e8bb7e1240f44fda8b83e4c124852032 -> Peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Couldn't send request to peer 7d3072f2af0b481d94ed70632b90e8c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:15.894004  8883 consensus_peers.cc:597] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Couldn't send request to peer 7d3072f2af0b481d94ed70632b90e8c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:15.895462  8883 consensus_peers.cc:597] T d09ffcae84334482a706af1e812c7c9d P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Couldn't send request to peer 7d3072f2af0b481d94ed70632b90e8c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:15.910135  8883 consensus_peers.cc:597] T 7bcde3fdb9314ca4b3422d395a673be5 P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Couldn't send request to peer 7d3072f2af0b481d94ed70632b90e8c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:15.920794  2843 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:15.924328  2843 tablet_replica.cc:333] T 69e5f8bfdb5a46808e713e051a38866d P 7d3072f2af0b481d94ed70632b90e8c6: stopping tablet replica
I20260709 13:17:15.925407  2843 raft_consensus.cc:2243] T 69e5f8bfdb5a46808e713e051a38866d P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:15.926096  2843 raft_consensus.cc:2272] T 69e5f8bfdb5a46808e713e051a38866d P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.934638  2843 tablet_replica.cc:333] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 7d3072f2af0b481d94ed70632b90e8c6: stopping tablet replica
I20260709 13:17:15.935884  2843 raft_consensus.cc:2243] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:15.936638  2843 raft_consensus.cc:2272] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:15.937065  8883 consensus_peers.cc:597] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Couldn't send request to peer 7d3072f2af0b481d94ed70632b90e8c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:15.940374  2843 tablet_replica.cc:333] T 51992816e23f4cf99d31cec60fa429b9 P 7d3072f2af0b481d94ed70632b90e8c6: stopping tablet replica
I20260709 13:17:15.941716  2843 raft_consensus.cc:2243] T 51992816e23f4cf99d31cec60fa429b9 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:15.943367  2843 raft_consensus.cc:2272] T 51992816e23f4cf99d31cec60fa429b9 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.948654  2843 tablet_replica.cc:333] T b8ded21dd9a54bc8b9cd260808162d0d P 7d3072f2af0b481d94ed70632b90e8c6: stopping tablet replica
I20260709 13:17:15.949752  2843 raft_consensus.cc:2243] T b8ded21dd9a54bc8b9cd260808162d0d P 7d3072f2af0b481d94ed70632b90e8c6 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 13:17:15.950192  8957 consensus_peers.cc:597] T 2accf622ad6243e3b7b496fb979fe9d4 P e8bb7e1240f44fda8b83e4c124852032 -> Peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Couldn't send request to peer 7d3072f2af0b481d94ed70632b90e8c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:15.950459  2843 raft_consensus.cc:2272] T b8ded21dd9a54bc8b9cd260808162d0d P 7d3072f2af0b481d94ed70632b90e8c6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.967304  2843 tablet_replica.cc:333] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 7d3072f2af0b481d94ed70632b90e8c6: stopping tablet replica
I20260709 13:17:15.968448  2843 raft_consensus.cc:2243] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:15.972473  2843 raft_consensus.cc:2272] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.985194  2843 tablet_replica.cc:333] T 1521cafcc31b47c58829494618fc0cd8 P 7d3072f2af0b481d94ed70632b90e8c6: stopping tablet replica
I20260709 13:17:15.986317  2843 raft_consensus.cc:2243] T 1521cafcc31b47c58829494618fc0cd8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:15.987010  2843 raft_consensus.cc:2272] T 1521cafcc31b47c58829494618fc0cd8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.990876  2843 tablet_replica.cc:333] T 278f12b812a8473f8e3fddc73feabb62 P 7d3072f2af0b481d94ed70632b90e8c6: stopping tablet replica
I20260709 13:17:15.991941  2843 raft_consensus.cc:2243] T 278f12b812a8473f8e3fddc73feabb62 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:15.993165  2843 raft_consensus.cc:2272] T 278f12b812a8473f8e3fddc73feabb62 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:15.998556  8883 consensus_peers.cc:597] T 359d64d36e684763884c576f961f829d P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Couldn't send request to peer 7d3072f2af0b481d94ed70632b90e8c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:16.000100  2843 tablet_replica.cc:333] T 852f0ef4508245e2812b76665a70bbf8 P 7d3072f2af0b481d94ed70632b90e8c6: stopping tablet replica
I20260709 13:17:16.001327  2843 raft_consensus.cc:2243] T 852f0ef4508245e2812b76665a70bbf8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:16.002028  2843 raft_consensus.cc:2272] T 852f0ef4508245e2812b76665a70bbf8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:16.005401  2843 tablet_replica.cc:333] T 2accf622ad6243e3b7b496fb979fe9d4 P 7d3072f2af0b481d94ed70632b90e8c6: stopping tablet replica
I20260709 13:17:16.006451  2843 raft_consensus.cc:2243] T 2accf622ad6243e3b7b496fb979fe9d4 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:16.007084  2843 raft_consensus.cc:2272] T 2accf622ad6243e3b7b496fb979fe9d4 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:16.010470  2843 tablet_replica.cc:333] T f3ea64f4f4c54500a95692118660d9b4 P 7d3072f2af0b481d94ed70632b90e8c6: stopping tablet replica
I20260709 13:17:16.011462  2843 raft_consensus.cc:2243] T f3ea64f4f4c54500a95692118660d9b4 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:16.012845  2843 raft_consensus.cc:2272] T f3ea64f4f4c54500a95692118660d9b4 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:16.016113  2843 tablet_replica.cc:333] T d09ffcae84334482a706af1e812c7c9d P 7d3072f2af0b481d94ed70632b90e8c6: stopping tablet replica
I20260709 13:17:16.017086  2843 raft_consensus.cc:2243] T d09ffcae84334482a706af1e812c7c9d P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:16.017789  2843 raft_consensus.cc:2272] T d09ffcae84334482a706af1e812c7c9d P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:16.021165  2843 tablet_replica.cc:333] T e3ee8f06068449de90c7fb0479f504ca P 7d3072f2af0b481d94ed70632b90e8c6: stopping tablet replica
I20260709 13:17:16.022753  2843 raft_consensus.cc:2243] T e3ee8f06068449de90c7fb0479f504ca P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:16.023476  2843 raft_consensus.cc:2272] T e3ee8f06068449de90c7fb0479f504ca P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:16.026894  2843 tablet_replica.cc:333] T 9f7eec107ecc40f38d14871d9227b25f P 7d3072f2af0b481d94ed70632b90e8c6: stopping tablet replica
I20260709 13:17:16.027905  2843 raft_consensus.cc:2243] T 9f7eec107ecc40f38d14871d9227b25f P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:16.029086  2843 raft_consensus.cc:2272] T 9f7eec107ecc40f38d14871d9227b25f P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:16.032846  2843 tablet_replica.cc:333] T 4fd6605b785643deac78902ee4fc6896 P 7d3072f2af0b481d94ed70632b90e8c6: stopping tablet replica
W20260709 13:17:16.033473  8957 consensus_peers.cc:597] T 1521cafcc31b47c58829494618fc0cd8 P e8bb7e1240f44fda8b83e4c124852032 -> Peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Couldn't send request to peer 7d3072f2af0b481d94ed70632b90e8c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:16.033870  2843 raft_consensus.cc:2243] T 4fd6605b785643deac78902ee4fc6896 P 7d3072f2af0b481d94ed70632b90e8c6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:16.034672  2843 raft_consensus.cc:2272] T 4fd6605b785643deac78902ee4fc6896 P 7d3072f2af0b481d94ed70632b90e8c6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:16.037955  2843 tablet_replica.cc:333] T 5a26acd2175646e3a53b493571852af4 P 7d3072f2af0b481d94ed70632b90e8c6: stopping tablet replica
I20260709 13:17:16.038830  2843 raft_consensus.cc:2243] T 5a26acd2175646e3a53b493571852af4 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:16.039402  2843 raft_consensus.cc:2272] T 5a26acd2175646e3a53b493571852af4 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:16.042419  2843 tablet_replica.cc:333] T ed4d847e589942fcbf6dadbb578327f2 P 7d3072f2af0b481d94ed70632b90e8c6: stopping tablet replica
I20260709 13:17:16.043323  2843 raft_consensus.cc:2243] T ed4d847e589942fcbf6dadbb578327f2 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:16.043907  2843 raft_consensus.cc:2272] T ed4d847e589942fcbf6dadbb578327f2 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:16.046839  2843 tablet_replica.cc:333] T f80d602267cf421690d5fe6d3922e0cb P 7d3072f2af0b481d94ed70632b90e8c6: stopping tablet replica
I20260709 13:17:16.047694  2843 raft_consensus.cc:2243] T f80d602267cf421690d5fe6d3922e0cb P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:16.048254  2843 raft_consensus.cc:2272] T f80d602267cf421690d5fe6d3922e0cb P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:16.051591  2843 tablet_replica.cc:333] T cc6e2639db63487cae6a125c8d5fe1d8 P 7d3072f2af0b481d94ed70632b90e8c6: stopping tablet replica
I20260709 13:17:16.052516  2843 raft_consensus.cc:2243] T cc6e2639db63487cae6a125c8d5fe1d8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:16.053871  2843 raft_consensus.cc:2272] T cc6e2639db63487cae6a125c8d5fe1d8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:16.057343  2843 tablet_replica.cc:333] T 2c3f7327ddfa499ab1e3f0996a560618 P 7d3072f2af0b481d94ed70632b90e8c6: stopping tablet replica
I20260709 13:17:16.058233  2843 raft_consensus.cc:2243] T 2c3f7327ddfa499ab1e3f0996a560618 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:16.059558  2843 raft_consensus.cc:2272] T 2c3f7327ddfa499ab1e3f0996a560618 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:16.062758  2843 tablet_replica.cc:333] T 17e47826fe4e4662baba1d095c341c1b P 7d3072f2af0b481d94ed70632b90e8c6: stopping tablet replica
I20260709 13:17:16.063692  2843 raft_consensus.cc:2243] T 17e47826fe4e4662baba1d095c341c1b P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:16.064880  2843 raft_consensus.cc:2272] T 17e47826fe4e4662baba1d095c341c1b P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:16.067876  2843 tablet_replica.cc:333] T c17f01b356e04590838cc6e6bb27bf64 P 7d3072f2af0b481d94ed70632b90e8c6: stopping tablet replica
I20260709 13:17:16.068670  2843 raft_consensus.cc:2243] T c17f01b356e04590838cc6e6bb27bf64 P 7d3072f2af0b481d94ed70632b90e8c6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:16.069247  2843 raft_consensus.cc:2272] T c17f01b356e04590838cc6e6bb27bf64 P 7d3072f2af0b481d94ed70632b90e8c6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:16.074677  2843 tablet_replica.cc:333] T 825ea78cebec4b10a2f8d03b45d929fa P 7d3072f2af0b481d94ed70632b90e8c6: stopping tablet replica
I20260709 13:17:16.075600  2843 raft_consensus.cc:2243] T 825ea78cebec4b10a2f8d03b45d929fa P 7d3072f2af0b481d94ed70632b90e8c6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:16.076167  2843 raft_consensus.cc:2272] T 825ea78cebec4b10a2f8d03b45d929fa P 7d3072f2af0b481d94ed70632b90e8c6 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:16.077708  8883 consensus_peers.cc:597] T ef723f9c640849d3890c61c07ffd0378 P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Couldn't send request to peer 7d3072f2af0b481d94ed70632b90e8c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:16.079417  2843 tablet_replica.cc:333] T 359d64d36e684763884c576f961f829d P 7d3072f2af0b481d94ed70632b90e8c6: stopping tablet replica
W20260709 13:17:16.079607  8957 consensus_peers.cc:597] T 448f6ffb482841a3b489476becf2f851 P e8bb7e1240f44fda8b83e4c124852032 -> Peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Couldn't send request to peer 7d3072f2af0b481d94ed70632b90e8c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:16.080578  2843 raft_consensus.cc:2243] T 359d64d36e684763884c576f961f829d P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:16.081202  2843 raft_consensus.cc:2272] T 359d64d36e684763884c576f961f829d P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:16.082979  8883 consensus_peers.cc:597] T f80d602267cf421690d5fe6d3922e0cb P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Couldn't send request to peer 7d3072f2af0b481d94ed70632b90e8c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:16.084084  2843 tablet_replica.cc:333] T 197670bf2e8f4301b060ed8ef6862b22 P 7d3072f2af0b481d94ed70632b90e8c6: stopping tablet replica
I20260709 13:17:16.084831  2843 raft_consensus.cc:2243] T 197670bf2e8f4301b060ed8ef6862b22 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:16.085297  2843 raft_consensus.cc:2272] T 197670bf2e8f4301b060ed8ef6862b22 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:16.088894  2843 tablet_replica.cc:333] T f3abbeb71eba411bb6dfec800d3bd9c0 P 7d3072f2af0b481d94ed70632b90e8c6: stopping tablet replica
I20260709 13:17:16.089578  2843 raft_consensus.cc:2243] T f3abbeb71eba411bb6dfec800d3bd9c0 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:16.090569  2843 raft_consensus.cc:2272] T f3abbeb71eba411bb6dfec800d3bd9c0 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:16.093282  2843 tablet_replica.cc:333] T dc5cf20be8db404dbda7f0b4a676ab31 P 7d3072f2af0b481d94ed70632b90e8c6: stopping tablet replica
I20260709 13:17:16.094137  2843 raft_consensus.cc:2243] T dc5cf20be8db404dbda7f0b4a676ab31 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:16.094707  2843 raft_consensus.cc:2272] T dc5cf20be8db404dbda7f0b4a676ab31 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:16.097659  2843 tablet_replica.cc:333] T 390c483b2a1c42b897e166b1a381851c P 7d3072f2af0b481d94ed70632b90e8c6: stopping tablet replica
I20260709 13:17:16.098407  2843 raft_consensus.cc:2243] T 390c483b2a1c42b897e166b1a381851c P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:16.099272  2843 raft_consensus.cc:2272] T 390c483b2a1c42b897e166b1a381851c P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:16.101394  2843 tablet_replica.cc:333] T 932e5cbccd33414f8b05280505fd8bc7 P 7d3072f2af0b481d94ed70632b90e8c6: stopping tablet replica
I20260709 13:17:16.101976  2843 raft_consensus.cc:2243] T 932e5cbccd33414f8b05280505fd8bc7 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:16.102761  2843 raft_consensus.cc:2272] T 932e5cbccd33414f8b05280505fd8bc7 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:16.104878  2843 tablet_replica.cc:333] T 675795627b9b4542805157dd7ec531cd P 7d3072f2af0b481d94ed70632b90e8c6: stopping tablet replica
I20260709 13:17:16.105499  2843 raft_consensus.cc:2243] T 675795627b9b4542805157dd7ec531cd P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:16.106280  2843 raft_consensus.cc:2272] T 675795627b9b4542805157dd7ec531cd P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:16.109022  2843 tablet_replica.cc:333] T 67ea3c8e514f41549c3a96b74a9b5be9 P 7d3072f2af0b481d94ed70632b90e8c6: stopping tablet replica
I20260709 13:17:16.109607  2843 raft_consensus.cc:2243] T 67ea3c8e514f41549c3a96b74a9b5be9 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:16.110041  2843 raft_consensus.cc:2272] T 67ea3c8e514f41549c3a96b74a9b5be9 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:16.112262  2843 tablet_replica.cc:333] T 45613c5d357b40b8af0ced6c8725c559 P 7d3072f2af0b481d94ed70632b90e8c6: stopping tablet replica
I20260709 13:17:16.112810  2843 raft_consensus.cc:2243] T 45613c5d357b40b8af0ced6c8725c559 P 7d3072f2af0b481d94ed70632b90e8c6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:16.113241  2843 raft_consensus.cc:2272] T 45613c5d357b40b8af0ced6c8725c559 P 7d3072f2af0b481d94ed70632b90e8c6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:16.115435  2843 tablet_replica.cc:333] T 55bac44fd5a3462593ab47f6b6f44c6e P 7d3072f2af0b481d94ed70632b90e8c6: stopping tablet replica
I20260709 13:17:16.115978  2843 raft_consensus.cc:2243] T 55bac44fd5a3462593ab47f6b6f44c6e P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:16.116360  2843 raft_consensus.cc:2272] T 55bac44fd5a3462593ab47f6b6f44c6e P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:16.118929  2843 tablet_replica.cc:333] T 4e1e1e84d68946d682e0944fbd3c51a8 P 7d3072f2af0b481d94ed70632b90e8c6: stopping tablet replica
I20260709 13:17:16.119709  2843 raft_consensus.cc:2243] T 4e1e1e84d68946d682e0944fbd3c51a8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:17:16.120041  8883 consensus_peers.cc:597] T 734d16820c5640729de24c6edf4c5ed8 P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Couldn't send request to peer 7d3072f2af0b481d94ed70632b90e8c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:16.120829  2843 raft_consensus.cc:2272] T 4e1e1e84d68946d682e0944fbd3c51a8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:16.123405  8957 consensus_peers.cc:597] T 67ea3c8e514f41549c3a96b74a9b5be9 P e8bb7e1240f44fda8b83e4c124852032 -> Peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Couldn't send request to peer 7d3072f2af0b481d94ed70632b90e8c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:16.123749  2843 tablet_replica.cc:333] T 7bcde3fdb9314ca4b3422d395a673be5 P 7d3072f2af0b481d94ed70632b90e8c6: stopping tablet replica
I20260709 13:17:16.124485  2843 raft_consensus.cc:2243] T 7bcde3fdb9314ca4b3422d395a673be5 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:16.124888  2843 raft_consensus.cc:2272] T 7bcde3fdb9314ca4b3422d395a673be5 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:16.126950  2843 tablet_replica.cc:333] T 3f0c32d9abf04206a6f08210b3a30794 P 7d3072f2af0b481d94ed70632b90e8c6: stopping tablet replica
I20260709 13:17:16.127486  2843 raft_consensus.cc:2243] T 3f0c32d9abf04206a6f08210b3a30794 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:16.128053  2843 raft_consensus.cc:2272] T 3f0c32d9abf04206a6f08210b3a30794 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:16.130043  2843 tablet_replica.cc:333] T d64af92885f944f9b1ecf193ede281b3 P 7d3072f2af0b481d94ed70632b90e8c6: stopping tablet replica
I20260709 13:17:16.130738  2843 raft_consensus.cc:2243] T d64af92885f944f9b1ecf193ede281b3 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:16.131595  2843 raft_consensus.cc:2272] T d64af92885f944f9b1ecf193ede281b3 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:16.133704  2843 tablet_replica.cc:333] T 21893ae95aed4157a65823826a6badf0 P 7d3072f2af0b481d94ed70632b90e8c6: stopping tablet replica
I20260709 13:17:16.134244  2843 raft_consensus.cc:2243] T 21893ae95aed4157a65823826a6badf0 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:16.135047  2843 raft_consensus.cc:2272] T 21893ae95aed4157a65823826a6badf0 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:16.137061  2843 tablet_replica.cc:333] T 448f6ffb482841a3b489476becf2f851 P 7d3072f2af0b481d94ed70632b90e8c6: stopping tablet replica
I20260709 13:17:16.137598  2843 raft_consensus.cc:2243] T 448f6ffb482841a3b489476becf2f851 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:16.138033  2843 raft_consensus.cc:2272] T 448f6ffb482841a3b489476becf2f851 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:16.140239  2843 tablet_replica.cc:333] T 1d5284f5b067413e9fc2a383cc318735 P 7d3072f2af0b481d94ed70632b90e8c6: stopping tablet replica
I20260709 13:17:16.140730  2843 raft_consensus.cc:2243] T 1d5284f5b067413e9fc2a383cc318735 P 7d3072f2af0b481d94ed70632b90e8c6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:16.141139  2843 raft_consensus.cc:2272] T 1d5284f5b067413e9fc2a383cc318735 P 7d3072f2af0b481d94ed70632b90e8c6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:16.143281  2843 tablet_replica.cc:333] T d46902173b5c4283b315c6def6f13c31 P 7d3072f2af0b481d94ed70632b90e8c6: stopping tablet replica
I20260709 13:17:16.143936  2843 raft_consensus.cc:2243] T d46902173b5c4283b315c6def6f13c31 P 7d3072f2af0b481d94ed70632b90e8c6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:16.144383  2843 raft_consensus.cc:2272] T d46902173b5c4283b315c6def6f13c31 P 7d3072f2af0b481d94ed70632b90e8c6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:16.146450  2843 tablet_replica.cc:333] T ef723f9c640849d3890c61c07ffd0378 P 7d3072f2af0b481d94ed70632b90e8c6: stopping tablet replica
I20260709 13:17:16.146960  2843 raft_consensus.cc:2243] T ef723f9c640849d3890c61c07ffd0378 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:16.147444  2843 raft_consensus.cc:2272] T ef723f9c640849d3890c61c07ffd0378 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:16.150019  2843 tablet_replica.cc:333] T 65900ac9e06944639fe557200317fe05 P 7d3072f2af0b481d94ed70632b90e8c6: stopping tablet replica
I20260709 13:17:16.150684  2843 raft_consensus.cc:2243] T 65900ac9e06944639fe557200317fe05 P 7d3072f2af0b481d94ed70632b90e8c6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:16.151199  2843 raft_consensus.cc:2272] T 65900ac9e06944639fe557200317fe05 P 7d3072f2af0b481d94ed70632b90e8c6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:16.153877  2843 tablet_replica.cc:333] T 8a25176ebf484df29f67908cfa6e2b48 P 7d3072f2af0b481d94ed70632b90e8c6: stopping tablet replica
I20260709 13:17:16.154541  2843 raft_consensus.cc:2243] T 8a25176ebf484df29f67908cfa6e2b48 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:16.155066  2843 raft_consensus.cc:2272] T 8a25176ebf484df29f67908cfa6e2b48 P 7d3072f2af0b481d94ed70632b90e8c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:16.157788  2843 tablet_replica.cc:333] T 734d16820c5640729de24c6edf4c5ed8 P 7d3072f2af0b481d94ed70632b90e8c6: stopping tablet replica
I20260709 13:17:16.158454  2843 raft_consensus.cc:2243] T 734d16820c5640729de24c6edf4c5ed8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:16.159022  2843 raft_consensus.cc:2272] T 734d16820c5640729de24c6edf4c5ed8 P 7d3072f2af0b481d94ed70632b90e8c6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:16.212225  8957 consensus_peers.cc:597] T e3ee8f06068449de90c7fb0479f504ca P e8bb7e1240f44fda8b83e4c124852032 -> Peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Couldn't send request to peer 7d3072f2af0b481d94ed70632b90e8c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:16.213253  8883 consensus_peers.cc:597] T 55bac44fd5a3462593ab47f6b6f44c6e P 43c6faa9496d44dda6b6eaed09cdfd12 -> Peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Couldn't send request to peer 7d3072f2af0b481d94ed70632b90e8c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:16.230458  8957 consensus_peers.cc:597] T 69e5f8bfdb5a46808e713e051a38866d P e8bb7e1240f44fda8b83e4c124852032 -> Peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Couldn't send request to peer 7d3072f2af0b481d94ed70632b90e8c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:16.406366  9826 raft_consensus.cc:493] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:17:16.406848  9826 raft_consensus.cc:515] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:17:16.408564  9826 leader_election.cc:290] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
W20260709 13:17:16.412611  8884 leader_election.cc:336] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
W20260709 13:17:16.413182  8883 leader_election.cc:336] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Network error: Client connection negotiation failed: client connection to 127.2.198.194:35315: connect: Connection refused (error 111)
I20260709 13:17:16.413564  8883 leader_election.cc:304] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12; no voters: 7d3072f2af0b481d94ed70632b90e8c6, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:17:16.414135  9826 raft_consensus.cc:2749] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:16.435467  9826 raft_consensus.cc:493] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:17:16.436055  9826 raft_consensus.cc:515] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:16.438220  9826 leader_election.cc:290] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:17:16.438875  8989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c705b65de4abe884afdb1fcaaa054" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
W20260709 13:17:16.442678  8884 leader_election.cc:336] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:17:16.443166  8884 leader_election.cc:304] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12; no voters: 895d3c58761f427c9c5b3cb41246c243, e8bb7e1240f44fda8b83e4c124852032
I20260709 13:17:16.443969  9826 raft_consensus.cc:2749] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:16.483058  9922 raft_consensus.cc:493] T 097c705b65de4abe884afdb1fcaaa054 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:17:16.483770  9922 raft_consensus.cc:515] T 097c705b65de4abe884afdb1fcaaa054 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:16.486258  9922 leader_election.cc:290] T 097c705b65de4abe884afdb1fcaaa054 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:17:16.486938  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c705b65de4abe884afdb1fcaaa054" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:17:16.487761  8914 raft_consensus.cc:2468] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 2.
I20260709 13:17:16.489144  8959 leader_election.cc:304] T 097c705b65de4abe884afdb1fcaaa054 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:17:16.489957  9922 raft_consensus.cc:2804] T 097c705b65de4abe884afdb1fcaaa054 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:16.490365  9922 raft_consensus.cc:493] T 097c705b65de4abe884afdb1fcaaa054 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
W20260709 13:17:16.490612  8958 leader_election.cc:336] T 097c705b65de4abe884afdb1fcaaa054 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:17:16.490988  9922 raft_consensus.cc:3060] T 097c705b65de4abe884afdb1fcaaa054 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:16.498297  9922 raft_consensus.cc:515] T 097c705b65de4abe884afdb1fcaaa054 P e8bb7e1240f44fda8b83e4c124852032 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:16.500653  9922 leader_election.cc:290] T 097c705b65de4abe884afdb1fcaaa054 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 3 election: Requested vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:17:16.500901  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c705b65de4abe884afdb1fcaaa054" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:17:16.502128  8914 raft_consensus.cc:3060] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:16.506102  8958 leader_election.cc:336] T 097c705b65de4abe884afdb1fcaaa054 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:17:16.510088  8914 raft_consensus.cc:2468] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 3.
I20260709 13:17:16.511439  8959 leader_election.cc:304] T 097c705b65de4abe884afdb1fcaaa054 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032; no voters: 895d3c58761f427c9c5b3cb41246c243
I20260709 13:17:16.512251  9922 raft_consensus.cc:2804] T 097c705b65de4abe884afdb1fcaaa054 P e8bb7e1240f44fda8b83e4c124852032 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:16.512667  9922 raft_consensus.cc:697] T 097c705b65de4abe884afdb1fcaaa054 P e8bb7e1240f44fda8b83e4c124852032 [term 3 LEADER]: Becoming Leader. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Running, Role: LEADER
I20260709 13:17:16.513494  9922 consensus_queue.cc:237] T 097c705b65de4abe884afdb1fcaaa054 P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:16.518430  9826 raft_consensus.cc:493] T d46902173b5c4283b315c6def6f13c31 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:17:16.519078  9826 raft_consensus.cc:515] T d46902173b5c4283b315c6def6f13c31 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:17:16.521266  9826 leader_election.cc:290] T d46902173b5c4283b315c6def6f13c31 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:17:16.524219  8664 catalog_manager.cc:5697] T 097c705b65de4abe884afdb1fcaaa054 P e8bb7e1240f44fda8b83e4c124852032 reported cstate change: term changed from 2 to 3, leader changed from 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193) to e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196). New cstate: current_term: 3 leader_uuid: "e8bb7e1240f44fda8b83e4c124852032" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:16.525635  9826 raft_consensus.cc:493] T 9fdcbb0a74a64826ab0665c349b16200 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:17:16.526192  9826 raft_consensus.cc:515] T 9fdcbb0a74a64826ab0665c349b16200 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
W20260709 13:17:16.526486  8883 leader_election.cc:336] T d46902173b5c4283b315c6def6f13c31 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Network error: Client connection negotiation failed: client connection to 127.2.198.194:35315: connect: Connection refused (error 111)
I20260709 13:17:16.528888  8989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fdcbb0a74a64826ab0665c349b16200" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
W20260709 13:17:16.529683  8884 leader_election.cc:336] T d46902173b5c4283b315c6def6f13c31 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:17:16.530405  8884 leader_election.cc:304] T d46902173b5c4283b315c6def6f13c31 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12; no voters: 7d3072f2af0b481d94ed70632b90e8c6, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:17:16.531037  9826 leader_election.cc:290] T 9fdcbb0a74a64826ab0665c349b16200 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:17:16.531421  9834 raft_consensus.cc:2749] T d46902173b5c4283b315c6def6f13c31 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:17:16.537034  8884 leader_election.cc:336] T 9fdcbb0a74a64826ab0665c349b16200 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:17:16.537719  8884 leader_election.cc:304] T 9fdcbb0a74a64826ab0665c349b16200 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12; no voters: 895d3c58761f427c9c5b3cb41246c243, e8bb7e1240f44fda8b83e4c124852032
I20260709 13:17:16.538476  9834 raft_consensus.cc:2749] T 9fdcbb0a74a64826ab0665c349b16200 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:16.599647  9834 raft_consensus.cc:493] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:17:16.600157  9834 raft_consensus.cc:515] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:16.601157  9984 raft_consensus.cc:493] T be1c593726564ba7ae9e8b66d1989f69 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:17:16.601760  9984 raft_consensus.cc:515] T be1c593726564ba7ae9e8b66d1989f69 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:16.602264  9834 leader_election.cc:290] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:17:16.603283  8989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "485b2d9b05744b4f9a22e8f0e8b66e0d" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:17:16.605444  9984 leader_election.cc:290] T be1c593726564ba7ae9e8b66d1989f69 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:17:16.605469  8989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1c593726564ba7ae9e8b66d1989f69" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
W20260709 13:17:16.614490  8884 leader_election.cc:336] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:17:16.615057  8884 leader_election.cc:304] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12; no voters: 895d3c58761f427c9c5b3cb41246c243, e8bb7e1240f44fda8b83e4c124852032
I20260709 13:17:16.615975  9826 raft_consensus.cc:2749] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:17:16.616385  8884 leader_election.cc:336] T be1c593726564ba7ae9e8b66d1989f69 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:17:16.616914  8884 leader_election.cc:304] T be1c593726564ba7ae9e8b66d1989f69 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12; no voters: 895d3c58761f427c9c5b3cb41246c243, e8bb7e1240f44fda8b83e4c124852032
I20260709 13:17:16.618827  9826 raft_consensus.cc:2749] T be1c593726564ba7ae9e8b66d1989f69 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:16.633903  9990 raft_consensus.cc:493] T 65900ac9e06944639fe557200317fe05 P e8bb7e1240f44fda8b83e4c124852032 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:17:16.634594  9990 raft_consensus.cc:515] T 65900ac9e06944639fe557200317fe05 P e8bb7e1240f44fda8b83e4c124852032 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:17:16.635182  9922 raft_consensus.cc:493] T 485b2d9b05744b4f9a22e8f0e8b66e0d P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:17:16.635735  9922 raft_consensus.cc:515] T 485b2d9b05744b4f9a22e8f0e8b66e0d P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:16.637538  9922 leader_election.cc:290] T 485b2d9b05744b4f9a22e8f0e8b66e0d P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:17:16.639940  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "485b2d9b05744b4f9a22e8f0e8b66e0d" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:17:16.640599  8914 raft_consensus.cc:2468] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 2.
I20260709 13:17:16.641520  8959 leader_election.cc:304] T 485b2d9b05744b4f9a22e8f0e8b66e0d P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:17:16.641760  9922 raft_consensus.cc:493] T 4352fad232ab47588683e51cf4b62080 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:17:16.642257  9922 raft_consensus.cc:515] T 4352fad232ab47588683e51cf4b62080 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:16.642691  9989 raft_consensus.cc:2804] T 485b2d9b05744b4f9a22e8f0e8b66e0d P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:16.643088  9989 raft_consensus.cc:493] T 485b2d9b05744b4f9a22e8f0e8b66e0d P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:17:16.643436  9989 raft_consensus.cc:3060] T 485b2d9b05744b4f9a22e8f0e8b66e0d P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:16.644687  9922 leader_election.cc:290] T 4352fad232ab47588683e51cf4b62080 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
W20260709 13:17:16.644982  8957 leader_election.cc:336] T 65900ac9e06944639fe557200317fe05 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Network error: Client connection negotiation failed: client connection to 127.2.198.194:35315: connect: Connection refused (error 111)
I20260709 13:17:16.645475  9990 leader_election.cc:290] T 65900ac9e06944639fe557200317fe05 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:17:16.648950  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4352fad232ab47588683e51cf4b62080" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:17:16.656400  9997 raft_consensus.cc:493] T 1c9bb56a39d44b71b44c334e0bea59a5 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:17:16.657047  9997 raft_consensus.cc:515] T 1c9bb56a39d44b71b44c334e0bea59a5 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:16.668654  9997 leader_election.cc:290] T 1c9bb56a39d44b71b44c334e0bea59a5 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
W20260709 13:17:16.674199  8884 leader_election.cc:336] T 1c9bb56a39d44b71b44c334e0bea59a5 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
W20260709 13:17:16.677048  8958 leader_election.cc:336] T 65900ac9e06944639fe557200317fe05 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:17:16.679134  9922 raft_consensus.cc:493] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:17:16.679178  8958 leader_election.cc:304] T 65900ac9e06944639fe557200317fe05 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bb7e1240f44fda8b83e4c124852032; no voters: 7d3072f2af0b481d94ed70632b90e8c6, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:17:16.679787  9922 raft_consensus.cc:515] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:16.680487  9985 raft_consensus.cc:2749] T 65900ac9e06944639fe557200317fe05 P e8bb7e1240f44fda8b83e4c124852032 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:17:16.681584  8958 leader_election.cc:336] T 485b2d9b05744b4f9a22e8f0e8b66e0d P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:17:16.682096  9997 raft_consensus.cc:493] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:17:16.683455  9922 leader_election.cc:290] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:17:16.683292  9997 raft_consensus.cc:515] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:17:16.685568  9997 leader_election.cc:290] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:17:16.687114  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9bb56a39d44b71b44c334e0bea59a5" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:17:16.687813  8914 raft_consensus.cc:2468] T 1c9bb56a39d44b71b44c334e0bea59a5 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 2.
I20260709 13:17:16.687603  9989 raft_consensus.cc:515] T 485b2d9b05744b4f9a22e8f0e8b66e0d P e8bb7e1240f44fda8b83e4c124852032 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:16.690621  8959 leader_election.cc:304] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:17:16.691382  9922 raft_consensus.cc:2804] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:16.691759  9922 raft_consensus.cc:493] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:17:16.692102  9922 raft_consensus.cc:3060] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:16.693801  8884 leader_election.cc:336] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:17:16.697233  9989 leader_election.cc:290] T 485b2d9b05744b4f9a22e8f0e8b66e0d P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 3 election: Requested vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:17:16.698616  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "485b2d9b05744b4f9a22e8f0e8b66e0d" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:17:16.699254  8914 raft_consensus.cc:3060] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:16.702661  9989 raft_consensus.cc:493] T 574915613e8a4d3481aef27d3a977caa P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:17:16.701756  9922 raft_consensus.cc:515] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:16.703292  9989 raft_consensus.cc:515] T 574915613e8a4d3481aef27d3a977caa P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:16.705451  9989 leader_election.cc:290] T 574915613e8a4d3481aef27d3a977caa P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:17:16.705787  9922 leader_election.cc:290] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 3 election: Requested vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:17:16.708954  8989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9bb56a39d44b71b44c334e0bea59a5" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:17:16.709750  8989 raft_consensus.cc:2393] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43c6faa9496d44dda6b6eaed09cdfd12 in current term 3: Already voted for candidate e8bb7e1240f44fda8b83e4c124852032 in this term.
I20260709 13:17:16.711089  8914 raft_consensus.cc:2468] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 3.
I20260709 13:17:16.714275  8882 leader_election.cc:304] T 1c9bb56a39d44b71b44c334e0bea59a5 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12; no voters: 895d3c58761f427c9c5b3cb41246c243, e8bb7e1240f44fda8b83e4c124852032
I20260709 13:17:16.715149  9834 raft_consensus.cc:3060] T 1c9bb56a39d44b71b44c334e0bea59a5 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:16.716728  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574915613e8a4d3481aef27d3a977caa" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:17:16.717051  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c9bb56a39d44b71b44c334e0bea59a5" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:17:16.716743  8959 leader_election.cc:304] T 485b2d9b05744b4f9a22e8f0e8b66e0d P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:17:16.718776  9985 raft_consensus.cc:2804] T 485b2d9b05744b4f9a22e8f0e8b66e0d P e8bb7e1240f44fda8b83e4c124852032 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:16.719246  9985 raft_consensus.cc:697] T 485b2d9b05744b4f9a22e8f0e8b66e0d P e8bb7e1240f44fda8b83e4c124852032 [term 3 LEADER]: Becoming Leader. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Running, Role: LEADER
I20260709 13:17:16.721019  9985 consensus_queue.cc:237] T 485b2d9b05744b4f9a22e8f0e8b66e0d P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
W20260709 13:17:16.717751  8883 leader_election.cc:336] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Network error: Client connection negotiation failed: client connection to 127.2.198.194:35315: connect: Connection refused (error 111)
I20260709 13:17:16.722662  9997 raft_consensus.cc:493] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:17:16.723496  9997 raft_consensus.cc:515] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:16.722723  8883 leader_election.cc:304] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12; no voters: 7d3072f2af0b481d94ed70632b90e8c6, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:17:16.725373  9826 raft_consensus.cc:2749] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:16.726078  9997 leader_election.cc:290] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:17:16.732079  9834 raft_consensus.cc:2749] T 1c9bb56a39d44b71b44c334e0bea59a5 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:17:16.737336  8958 leader_election.cc:336] T 4352fad232ab47588683e51cf4b62080 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:17:16.737923  8958 leader_election.cc:304] T 4352fad232ab47588683e51cf4b62080 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bb7e1240f44fda8b83e4c124852032; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:17:16.738667  9989 raft_consensus.cc:2749] T 4352fad232ab47588683e51cf4b62080 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:16.740034  8664 catalog_manager.cc:5697] T 485b2d9b05744b4f9a22e8f0e8b66e0d P e8bb7e1240f44fda8b83e4c124852032 reported cstate change: term changed from 2 to 3, leader changed from 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193) to e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196). New cstate: current_term: 3 leader_uuid: "e8bb7e1240f44fda8b83e4c124852032" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:16.741799  8989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4352fad232ab47588683e51cf4b62080" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:17:16.742509  8989 raft_consensus.cc:2468] T 4352fad232ab47588683e51cf4b62080 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 2.
I20260709 13:17:16.745543  8882 leader_election.cc:304] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:17:16.746407  9826 raft_consensus.cc:2804] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:16.746767  9826 raft_consensus.cc:493] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:17:16.747097  9826 raft_consensus.cc:3060] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:16.747264  8884 leader_election.cc:336] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
W20260709 13:17:16.748041  8958 leader_election.cc:336] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
W20260709 13:17:16.749171  8958 leader_election.cc:336] T 485b2d9b05744b4f9a22e8f0e8b66e0d P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
W20260709 13:17:16.750165  8958 leader_election.cc:336] T 574915613e8a4d3481aef27d3a977caa P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:17:16.750698  8958 leader_election.cc:304] T 574915613e8a4d3481aef27d3a977caa P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bb7e1240f44fda8b83e4c124852032; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:17:16.751776  9989 raft_consensus.cc:2749] T 574915613e8a4d3481aef27d3a977caa P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:17:16.753364  8958 leader_election.cc:336] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:17:16.755672  8914 raft_consensus.cc:2468] T 1c9bb56a39d44b71b44c334e0bea59a5 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 3.
I20260709 13:17:16.761616  8959 leader_election.cc:304] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032; no voters: 895d3c58761f427c9c5b3cb41246c243
I20260709 13:17:16.762423  9834 raft_consensus.cc:493] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:17:16.762490  9989 raft_consensus.cc:2804] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:16.763224  9989 raft_consensus.cc:697] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 [term 3 LEADER]: Becoming Leader. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Running, Role: LEADER
I20260709 13:17:16.763084  9834 raft_consensus.cc:515] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:16.764241  9989 consensus_queue.cc:237] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:16.765089  9834 leader_election.cc:290] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:17:16.767519  9826 raft_consensus.cc:515] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:16.769518  9826 leader_election.cc:290] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 election: Requested vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:17:16.770972  8987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574915613e8a4d3481aef27d3a977caa" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:17:16.772198  8987 raft_consensus.cc:2468] T 574915613e8a4d3481aef27d3a977caa P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 2.
I20260709 13:17:16.773007  8989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4352fad232ab47588683e51cf4b62080" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
I20260709 13:17:16.773589  8989 raft_consensus.cc:3060] T 4352fad232ab47588683e51cf4b62080 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:16.770287  8884 leader_election.cc:336] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:17:16.776604  8882 leader_election.cc:304] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032; no voters: 895d3c58761f427c9c5b3cb41246c243
I20260709 13:17:16.777597  9834 raft_consensus.cc:2804] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:16.777951  9834 raft_consensus.cc:493] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:17:16.778290  9834 raft_consensus.cc:3060] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:16.779099  9997 raft_consensus.cc:493] T 4fd6605b785643deac78902ee4fc6896 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:17:16.779722  9997 raft_consensus.cc:515] T 4fd6605b785643deac78902ee4fc6896 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:17:16.781948  9997 leader_election.cc:290] T 4fd6605b785643deac78902ee4fc6896 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:17:16.792045  9834 raft_consensus.cc:515] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:16.796756  9834 leader_election.cc:290] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 election: Requested vote from peers e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:17:16.798087  8988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574915613e8a4d3481aef27d3a977caa" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032"
W20260709 13:17:16.798694  8883 leader_election.cc:336] T 4fd6605b785643deac78902ee4fc6896 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Network error: Client connection negotiation failed: client connection to 127.2.198.194:35315: connect: Connection refused (error 111)
I20260709 13:17:16.798789  8988 raft_consensus.cc:3060] T 574915613e8a4d3481aef27d3a977caa P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:16.799772  8884 leader_election.cc:336] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:17:16.800076  8989 raft_consensus.cc:2468] T 4352fad232ab47588683e51cf4b62080 P e8bb7e1240f44fda8b83e4c124852032 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 3.
W20260709 13:17:16.800428  8884 leader_election.cc:336] T 4fd6605b785643deac78902ee4fc6896 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:17:16.800839  8884 leader_election.cc:304] T 4fd6605b785643deac78902ee4fc6896 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12; no voters: 7d3072f2af0b481d94ed70632b90e8c6, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:17:16.801369  8882 leader_election.cc:304] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032; no voters: 895d3c58761f427c9c5b3cb41246c243
I20260709 13:17:16.801548  9834 raft_consensus.cc:2749] T 4fd6605b785643deac78902ee4fc6896 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:16.802208  9834 raft_consensus.cc:2804] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:16.802842  9834 raft_consensus.cc:697] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 LEADER]: Becoming Leader. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Running, Role: LEADER
I20260709 13:17:16.803689  9834 consensus_queue.cc:237] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:16.807720  8988 raft_consensus.cc:2468] T 574915613e8a4d3481aef27d3a977caa P e8bb7e1240f44fda8b83e4c124852032 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43c6faa9496d44dda6b6eaed09cdfd12 in term 3.
I20260709 13:17:16.808980  8882 leader_election.cc:304] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032; no voters: 
W20260709 13:17:16.809542  8884 leader_election.cc:336] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:17:16.809863  9826 raft_consensus.cc:2804] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:16.810443  9826 raft_consensus.cc:697] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 LEADER]: Becoming Leader. State: Replica: 43c6faa9496d44dda6b6eaed09cdfd12, State: Running, Role: LEADER
I20260709 13:17:16.811381  9826 consensus_queue.cc:237] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:16.812496  9985 raft_consensus.cc:493] T 9fdcbb0a74a64826ab0665c349b16200 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:17:16.813097  9985 raft_consensus.cc:515] T 9fdcbb0a74a64826ab0665c349b16200 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:16.818444  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fdcbb0a74a64826ab0665c349b16200" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:17:16.819097  8914 raft_consensus.cc:2468] T 9fdcbb0a74a64826ab0665c349b16200 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 2.
I20260709 13:17:16.821493  8959 leader_election.cc:304] T 9fdcbb0a74a64826ab0665c349b16200 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:17:16.822496  9976 raft_consensus.cc:2804] T 9fdcbb0a74a64826ab0665c349b16200 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:16.821575  8664 catalog_manager.cc:5697] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 reported cstate change: term changed from 2 to 3, leader changed from 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193) to 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195). New cstate: current_term: 3 leader_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:16.822880  9976 raft_consensus.cc:493] T 9fdcbb0a74a64826ab0665c349b16200 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:17:16.823345  9976 raft_consensus.cc:3060] T 9fdcbb0a74a64826ab0665c349b16200 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:16.827061  9985 leader_election.cc:290] T 9fdcbb0a74a64826ab0665c349b16200 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
W20260709 13:17:16.828994  8958 leader_election.cc:336] T 9fdcbb0a74a64826ab0665c349b16200 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:17:16.833648  9989 raft_consensus.cc:493] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:17:16.834417  9989 raft_consensus.cc:515] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:16.843348  8664 catalog_manager.cc:5697] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 reported cstate change: term changed from 2 to 3, leader changed from 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193) to e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196). New cstate: current_term: 3 leader_uuid: "e8bb7e1240f44fda8b83e4c124852032" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:16.845402  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1c593726564ba7ae9e8b66d1989f69" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
I20260709 13:17:16.846172  8914 raft_consensus.cc:2468] T be1c593726564ba7ae9e8b66d1989f69 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 3.
I20260709 13:17:16.847319  8959 leader_election.cc:304] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:17:16.848203  9985 raft_consensus.cc:2804] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:16.848560  9985 raft_consensus.cc:493] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:17:16.848675  9989 leader_election.cc:290] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:17:16.848977  9985 raft_consensus.cc:3060] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:16.851447  9976 raft_consensus.cc:515] T 9fdcbb0a74a64826ab0665c349b16200 P e8bb7e1240f44fda8b83e4c124852032 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:16.854619  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fdcbb0a74a64826ab0665c349b16200" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:17:16.855237  8914 raft_consensus.cc:3060] T 9fdcbb0a74a64826ab0665c349b16200 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:16.855306  9976 leader_election.cc:290] T 9fdcbb0a74a64826ab0665c349b16200 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 3 election: Requested vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
I20260709 13:17:16.855999  9976 raft_consensus.cc:493] T 852f0ef4508245e2812b76665a70bbf8 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:17:16.856460  9976 raft_consensus.cc:515] T 852f0ef4508245e2812b76665a70bbf8 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:17:16.858594  9976 leader_election.cc:290] T 852f0ef4508245e2812b76665a70bbf8 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:17:16.859908  8668 catalog_manager.cc:5697] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 reported cstate change: term changed from 2 to 3, leader changed from 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193) to 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195). New cstate: current_term: 3 leader_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:16.863181  8914 raft_consensus.cc:2468] T 9fdcbb0a74a64826ab0665c349b16200 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 3.
I20260709 13:17:16.864485  8959 leader_election.cc:304] T 9fdcbb0a74a64826ab0665c349b16200 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:17:16.865468  9976 raft_consensus.cc:2804] T 9fdcbb0a74a64826ab0665c349b16200 P e8bb7e1240f44fda8b83e4c124852032 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:16.876462  9985 raft_consensus.cc:515] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:16.878860  9985 leader_election.cc:290] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 4 election: Requested vote from peers 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671), 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173)
W20260709 13:17:16.885274  8957 leader_election.cc:336] T 852f0ef4508245e2812b76665a70bbf8 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Network error: Client connection negotiation failed: client connection to 127.2.198.194:35315: connect: Connection refused (error 111)
W20260709 13:17:16.886605  8958 leader_election.cc:336] T 9fdcbb0a74a64826ab0665c349b16200 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
W20260709 13:17:16.887516  8958 leader_election.cc:336] T 852f0ef4508245e2812b76665a70bbf8 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:17:16.887970  8958 leader_election.cc:304] T 852f0ef4508245e2812b76665a70bbf8 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bb7e1240f44fda8b83e4c124852032; no voters: 7d3072f2af0b481d94ed70632b90e8c6, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:17:16.893080  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1c593726564ba7ae9e8b66d1989f69" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12"
I20260709 13:17:16.893859  8914 raft_consensus.cc:3060] T be1c593726564ba7ae9e8b66d1989f69 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:16.895180  2843 tablet_server.cc:196] TabletServer@127.2.198.194:0 shutdown complete.
I20260709 13:17:16.900826  9976 raft_consensus.cc:697] T 9fdcbb0a74a64826ab0665c349b16200 P e8bb7e1240f44fda8b83e4c124852032 [term 3 LEADER]: Becoming Leader. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Running, Role: LEADER
I20260709 13:17:16.901928  9976 consensus_queue.cc:237] T 9fdcbb0a74a64826ab0665c349b16200 P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
I20260709 13:17:16.905596  9985 raft_consensus.cc:2749] T 852f0ef4508245e2812b76665a70bbf8 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:17:16.905827  8958 leader_election.cc:336] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:17:16.916910  9922 raft_consensus.cc:493] T 825ea78cebec4b10a2f8d03b45d929fa P e8bb7e1240f44fda8b83e4c124852032 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 895d3c58761f427c9c5b3cb41246c243)
I20260709 13:17:16.917531  9922 raft_consensus.cc:515] T 825ea78cebec4b10a2f8d03b45d929fa P e8bb7e1240f44fda8b83e4c124852032 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:17:16.919626  9922 leader_election.cc:290] T 825ea78cebec4b10a2f8d03b45d929fa P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:17:16.909263  8914 raft_consensus.cc:2468] T be1c593726564ba7ae9e8b66d1989f69 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bb7e1240f44fda8b83e4c124852032 in term 4.
I20260709 13:17:16.921602  8959 leader_election.cc:304] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12, e8bb7e1240f44fda8b83e4c124852032; no voters: 
I20260709 13:17:16.922444  9922 raft_consensus.cc:2804] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:16.923019  9922 raft_consensus.cc:697] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [term 4 LEADER]: Becoming Leader. State: Replica: e8bb7e1240f44fda8b83e4c124852032, State: Running, Role: LEADER
I20260709 13:17:16.923858  9922 consensus_queue.cc:237] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } }
W20260709 13:17:16.924947  8957 leader_election.cc:336] T 825ea78cebec4b10a2f8d03b45d929fa P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Network error: Client connection negotiation failed: client connection to 127.2.198.194:35315: connect: Connection refused (error 111)
W20260709 13:17:16.929286  8958 leader_election.cc:336] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
W20260709 13:17:16.933243  8958 leader_election.cc:336] T 825ea78cebec4b10a2f8d03b45d929fa P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:17:16.933699  8958 leader_election.cc:304] T 825ea78cebec4b10a2f8d03b45d929fa P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bb7e1240f44fda8b83e4c124852032; no voters: 7d3072f2af0b481d94ed70632b90e8c6, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:17:16.935751  9976 raft_consensus.cc:2749] T 825ea78cebec4b10a2f8d03b45d929fa P e8bb7e1240f44fda8b83e4c124852032 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:16.942770  8664 catalog_manager.cc:5697] T 9fdcbb0a74a64826ab0665c349b16200 P e8bb7e1240f44fda8b83e4c124852032 reported cstate change: term changed from 2 to 3, leader changed from 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193) to e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196). New cstate: current_term: 3 leader_uuid: "e8bb7e1240f44fda8b83e4c124852032" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:16.953500  8914 raft_consensus.cc:1275] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Refusing update from remote peer e8bb7e1240f44fda8b83e4c124852032: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:16.955276  9922 consensus_queue.cc:1048] T 097c705b65de4abe884afdb1fcaaa054 P e8bb7e1240f44fda8b83e4c124852032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:16.980479  8664 catalog_manager.cc:5697] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 reported cstate change: term changed from 3 to 4, leader changed from 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193) to e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196). New cstate: current_term: 4 leader_uuid: "e8bb7e1240f44fda8b83e4c124852032" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:16.987082  9834 raft_consensus.cc:493] T 51992816e23f4cf99d31cec60fa429b9 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d3072f2af0b481d94ed70632b90e8c6)
I20260709 13:17:16.987721  9834 raft_consensus.cc:515] T 51992816e23f4cf99d31cec60fa429b9 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:17:16.990039  9985 raft_consensus.cc:493] T 390c483b2a1c42b897e166b1a381851c P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d3072f2af0b481d94ed70632b90e8c6)
I20260709 13:17:16.990598  9985 raft_consensus.cc:515] T 390c483b2a1c42b897e166b1a381851c P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:17:16.992741  9985 leader_election.cc:290] T 390c483b2a1c42b897e166b1a381851c P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:17:16.993515  8988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51992816e23f4cf99d31cec60fa429b9" candidate_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8bb7e1240f44fda8b83e4c124852032" is_pre_election: true
I20260709 13:17:16.994673  9834 leader_election.cc:290] T 51992816e23f4cf99d31cec60fa429b9 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), e8bb7e1240f44fda8b83e4c124852032 (127.2.198.196:46105)
W20260709 13:17:16.995443  8883 leader_election.cc:336] T 51992816e23f4cf99d31cec60fa429b9 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Network error: Client connection negotiation failed: client connection to 127.2.198.194:35315: connect: Connection refused (error 111)
I20260709 13:17:16.997004  8882 leader_election.cc:304] T 51992816e23f4cf99d31cec60fa429b9 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12; no voters: 7d3072f2af0b481d94ed70632b90e8c6, e8bb7e1240f44fda8b83e4c124852032
I20260709 13:17:16.997987  9834 raft_consensus.cc:2749] T 51992816e23f4cf99d31cec60fa429b9 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:17:17.001874  8958 leader_election.cc:336] T 390c483b2a1c42b897e166b1a381851c P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
W20260709 13:17:17.006474  8957 leader_election.cc:336] T 390c483b2a1c42b897e166b1a381851c P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Network error: Client connection negotiation failed: client connection to 127.2.198.194:35315: connect: Connection refused (error 111)
I20260709 13:17:17.006902  8957 leader_election.cc:304] T 390c483b2a1c42b897e166b1a381851c P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bb7e1240f44fda8b83e4c124852032; no voters: 7d3072f2af0b481d94ed70632b90e8c6, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:17:17.010294  9985 raft_consensus.cc:2749] T 390c483b2a1c42b897e166b1a381851c P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:17.021450  9985 raft_consensus.cc:493] T 278f12b812a8473f8e3fddc73feabb62 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d3072f2af0b481d94ed70632b90e8c6)
I20260709 13:17:17.022080  9985 raft_consensus.cc:515] T 278f12b812a8473f8e3fddc73feabb62 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:17:17.025471  9985 leader_election.cc:290] T 278f12b812a8473f8e3fddc73feabb62 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:17:17.025606  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278f12b812a8473f8e3fddc73feabb62" candidate_uuid: "e8bb7e1240f44fda8b83e4c124852032" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" is_pre_election: true
W20260709 13:17:17.029549  8958 consensus_peers.cc:597] T 097c705b65de4abe884afdb1fcaaa054 P e8bb7e1240f44fda8b83e4c124852032 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:17.029727  8957 leader_election.cc:336] T 278f12b812a8473f8e3fddc73feabb62 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Network error: Client connection negotiation failed: client connection to 127.2.198.194:35315: connect: Connection refused (error 111)
I20260709 13:17:17.030258  8957 leader_election.cc:304] T 278f12b812a8473f8e3fddc73feabb62 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bb7e1240f44fda8b83e4c124852032; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6
I20260709 13:17:17.031081  9976 raft_consensus.cc:2749] T 278f12b812a8473f8e3fddc73feabb62 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:17.063207  9834 raft_consensus.cc:493] T cc6e2639db63487cae6a125c8d5fe1d8 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3072f2af0b481d94ed70632b90e8c6)
I20260709 13:17:17.063957  9834 raft_consensus.cc:515] T cc6e2639db63487cae6a125c8d5fe1d8 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:17:17.065857  9834 leader_election.cc:290] T cc6e2639db63487cae6a125c8d5fe1d8 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:17:17.068989  2843 tablet_server.cc:179] TabletServer@127.2.198.195:0 shutting down...
W20260709 13:17:17.072074  8884 leader_election.cc:336] T cc6e2639db63487cae6a125c8d5fe1d8 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
W20260709 13:17:17.072950  8883 leader_election.cc:336] T cc6e2639db63487cae6a125c8d5fe1d8 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Network error: Client connection negotiation failed: client connection to 127.2.198.194:35315: connect: Connection refused (error 111)
I20260709 13:17:17.073704  8883 leader_election.cc:304] T cc6e2639db63487cae6a125c8d5fe1d8 P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12; no voters: 7d3072f2af0b481d94ed70632b90e8c6, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:17:17.075433  9834 raft_consensus.cc:2749] T cc6e2639db63487cae6a125c8d5fe1d8 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:17:17.079344  8959 consensus_peers.cc:597] T 67ea3c8e514f41549c3a96b74a9b5be9 P e8bb7e1240f44fda8b83e4c124852032 -> Peer 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671): Couldn't send request to peer 43c6faa9496d44dda6b6eaed09cdfd12. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:17.092356  9976 raft_consensus.cc:493] T 51992816e23f4cf99d31cec60fa429b9 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d3072f2af0b481d94ed70632b90e8c6)
I20260709 13:17:17.093741  9976 raft_consensus.cc:515] T 51992816e23f4cf99d31cec60fa429b9 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:17:17.099431  9976 leader_election.cc:290] T 51992816e23f4cf99d31cec60fa429b9 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
W20260709 13:17:17.101148  8959 leader_election.cc:336] T 51992816e23f4cf99d31cec60fa429b9 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:17:17.103168  8957 leader_election.cc:336] T 51992816e23f4cf99d31cec60fa429b9 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Network error: Client connection negotiation failed: client connection to 127.2.198.194:35315: connect: Connection refused (error 111)
I20260709 13:17:17.103655  8957 leader_election.cc:304] T 51992816e23f4cf99d31cec60fa429b9 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bb7e1240f44fda8b83e4c124852032; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6
I20260709 13:17:17.104374  9985 raft_consensus.cc:2749] T 51992816e23f4cf99d31cec60fa429b9 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:17.124975  2843 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:17.126050  2843 tablet_replica.cc:333] T 45d9eb22dee8411b82eb768686e34604 P 43c6faa9496d44dda6b6eaed09cdfd12: stopping tablet replica
I20260709 13:17:17.127069  2843 raft_consensus.cc:2243] T 45d9eb22dee8411b82eb768686e34604 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.127750  2843 raft_consensus.cc:2272] T 45d9eb22dee8411b82eb768686e34604 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.130834  2843 tablet_replica.cc:333] T 278f12b812a8473f8e3fddc73feabb62 P 43c6faa9496d44dda6b6eaed09cdfd12: stopping tablet replica
I20260709 13:17:17.131524  2843 raft_consensus.cc:2243] T 278f12b812a8473f8e3fddc73feabb62 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.132054  2843 raft_consensus.cc:2272] T 278f12b812a8473f8e3fddc73feabb62 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.134160  2843 tablet_replica.cc:333] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12: stopping tablet replica
I20260709 13:17:17.134819  2843 raft_consensus.cc:2243] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:17.135738  2843 raft_consensus.cc:2272] T 45613c5d357b40b8af0ced6c8725c559 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.137669  2843 tablet_replica.cc:333] T 55bac44fd5a3462593ab47f6b6f44c6e P 43c6faa9496d44dda6b6eaed09cdfd12: stopping tablet replica
I20260709 13:17:17.138269  2843 raft_consensus.cc:2243] T 55bac44fd5a3462593ab47f6b6f44c6e P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:17.139070  2843 raft_consensus.cc:2272] T 55bac44fd5a3462593ab47f6b6f44c6e P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.141669  2843 tablet_replica.cc:333] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 43c6faa9496d44dda6b6eaed09cdfd12: stopping tablet replica
I20260709 13:17:17.142371  2843 raft_consensus.cc:2243] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.142894  2843 raft_consensus.cc:2272] T 6fa028ad690c4f3c94ec7c6443a3f1d3 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:17.143532  8959 consensus_peers.cc:597] T e3ee8f06068449de90c7fb0479f504ca P e8bb7e1240f44fda8b83e4c124852032 -> Peer 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671): Couldn't send request to peer 43c6faa9496d44dda6b6eaed09cdfd12. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:17.145262  2843 tablet_replica.cc:333] T 51992816e23f4cf99d31cec60fa429b9 P 43c6faa9496d44dda6b6eaed09cdfd12: stopping tablet replica
I20260709 13:17:17.145963  2843 raft_consensus.cc:2243] T 51992816e23f4cf99d31cec60fa429b9 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.146355  2843 raft_consensus.cc:2272] T 51992816e23f4cf99d31cec60fa429b9 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.148206  9976 raft_consensus.cc:493] T f3abbeb71eba411bb6dfec800d3bd9c0 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d3072f2af0b481d94ed70632b90e8c6)
I20260709 13:17:17.148451  2843 tablet_replica.cc:333] T b8ded21dd9a54bc8b9cd260808162d0d P 43c6faa9496d44dda6b6eaed09cdfd12: stopping tablet replica
I20260709 13:17:17.148855  9976 raft_consensus.cc:515] T f3abbeb71eba411bb6dfec800d3bd9c0 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:17:17.149176  2843 raft_consensus.cc:2243] T b8ded21dd9a54bc8b9cd260808162d0d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.149887  2843 raft_consensus.cc:2272] T b8ded21dd9a54bc8b9cd260808162d0d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.150971  9976 leader_election.cc:290] T f3abbeb71eba411bb6dfec800d3bd9c0 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:17:17.152608  2843 tablet_replica.cc:333] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12: stopping tablet replica
I20260709 13:17:17.153535  2843 raft_consensus.cc:2243] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:17.154556  2843 raft_consensus.cc:2272] T c17f01b356e04590838cc6e6bb27bf64 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:17.155197  8957 leader_election.cc:336] T f3abbeb71eba411bb6dfec800d3bd9c0 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Network error: Client connection negotiation failed: client connection to 127.2.198.194:35315: connect: Connection refused (error 111)
W20260709 13:17:17.156728  8958 leader_election.cc:336] T f3abbeb71eba411bb6dfec800d3bd9c0 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
I20260709 13:17:17.157160  8958 leader_election.cc:304] T f3abbeb71eba411bb6dfec800d3bd9c0 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bb7e1240f44fda8b83e4c124852032; no voters: 7d3072f2af0b481d94ed70632b90e8c6, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:17:17.157407  2843 tablet_replica.cc:333] T 2accf622ad6243e3b7b496fb979fe9d4 P 43c6faa9496d44dda6b6eaed09cdfd12: stopping tablet replica
I20260709 13:17:17.157917  9976 raft_consensus.cc:2749] T f3abbeb71eba411bb6dfec800d3bd9c0 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:17.158424  2843 raft_consensus.cc:2243] T 2accf622ad6243e3b7b496fb979fe9d4 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.159070  2843 raft_consensus.cc:2272] T 2accf622ad6243e3b7b496fb979fe9d4 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.161901  2843 tablet_replica.cc:333] T f3ea64f4f4c54500a95692118660d9b4 P 43c6faa9496d44dda6b6eaed09cdfd12: stopping tablet replica
W20260709 13:17:17.162590  8959 consensus_peers.cc:597] T dc5cf20be8db404dbda7f0b4a676ab31 P e8bb7e1240f44fda8b83e4c124852032 -> Peer 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671): Couldn't send request to peer 43c6faa9496d44dda6b6eaed09cdfd12. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:17.162827  2843 raft_consensus.cc:2243] T f3ea64f4f4c54500a95692118660d9b4 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.163497  2843 raft_consensus.cc:2272] T f3ea64f4f4c54500a95692118660d9b4 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.166601  2843 tablet_replica.cc:333] T 2945a5b174e14a5a9052897942f876c2 P 43c6faa9496d44dda6b6eaed09cdfd12: stopping tablet replica
I20260709 13:17:17.167402  2843 raft_consensus.cc:2243] T 2945a5b174e14a5a9052897942f876c2 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.168027  2843 raft_consensus.cc:2272] T 2945a5b174e14a5a9052897942f876c2 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.170156  2843 tablet_replica.cc:333] T dc5cf20be8db404dbda7f0b4a676ab31 P 43c6faa9496d44dda6b6eaed09cdfd12: stopping tablet replica
I20260709 13:17:17.170744  2843 raft_consensus.cc:2243] T dc5cf20be8db404dbda7f0b4a676ab31 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.171165  2843 raft_consensus.cc:2272] T dc5cf20be8db404dbda7f0b4a676ab31 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.173146  2843 tablet_replica.cc:333] T d09ffcae84334482a706af1e812c7c9d P 43c6faa9496d44dda6b6eaed09cdfd12: stopping tablet replica
I20260709 13:17:17.173758  2843 raft_consensus.cc:2243] T d09ffcae84334482a706af1e812c7c9d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:17.174547  2843 raft_consensus.cc:2272] T d09ffcae84334482a706af1e812c7c9d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.176497  2843 tablet_replica.cc:333] T e3ee8f06068449de90c7fb0479f504ca P 43c6faa9496d44dda6b6eaed09cdfd12: stopping tablet replica
I20260709 13:17:17.177084  2843 raft_consensus.cc:2243] T e3ee8f06068449de90c7fb0479f504ca P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.177544  2843 raft_consensus.cc:2272] T e3ee8f06068449de90c7fb0479f504ca P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.179391  2843 tablet_replica.cc:333] T 4fd6605b785643deac78902ee4fc6896 P 43c6faa9496d44dda6b6eaed09cdfd12: stopping tablet replica
I20260709 13:17:17.180006  2843 raft_consensus.cc:2243] T 4fd6605b785643deac78902ee4fc6896 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.180521  2843 raft_consensus.cc:2272] T 4fd6605b785643deac78902ee4fc6896 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.182845  2843 tablet_replica.cc:333] T f80d602267cf421690d5fe6d3922e0cb P 43c6faa9496d44dda6b6eaed09cdfd12: stopping tablet replica
I20260709 13:17:17.183651  2843 raft_consensus.cc:2243] T f80d602267cf421690d5fe6d3922e0cb P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:17.184165  9834 raft_consensus.cc:493] T 9f7eec107ecc40f38d14871d9227b25f P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3072f2af0b481d94ed70632b90e8c6)
I20260709 13:17:17.184749  2843 raft_consensus.cc:2272] T f80d602267cf421690d5fe6d3922e0cb P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.184715  9834 raft_consensus.cc:515] T 9f7eec107ecc40f38d14871d9227b25f P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } }
I20260709 13:17:17.186770  9834 leader_election.cc:290] T 9f7eec107ecc40f38d14871d9227b25f P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:17:17.187680  2843 tablet_replica.cc:333] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12: stopping tablet replica
I20260709 13:17:17.188568  2843 raft_consensus.cc:2243] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:17.189409  2843 pending_rounds.cc:70] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12: Trying to abort 1 pending ops.
I20260709 13:17:17.189653  2843 pending_rounds.cc:77] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305638038765682688 op_type: NO_OP noop_request { }
I20260709 13:17:17.190111  2843 raft_consensus.cc:2889] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:17:17.190433  2843 raft_consensus.cc:2272] T 4352fad232ab47588683e51cf4b62080 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:17.190496  8884 leader_election.cc:336] T 9f7eec107ecc40f38d14871d9227b25f P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
W20260709 13:17:17.191722  8883 leader_election.cc:336] T 9f7eec107ecc40f38d14871d9227b25f P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Network error: Client connection negotiation failed: client connection to 127.2.198.194:35315: connect: Connection refused (error 111)
I20260709 13:17:17.192126  8883 leader_election.cc:304] T 9f7eec107ecc40f38d14871d9227b25f P 43c6faa9496d44dda6b6eaed09cdfd12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43c6faa9496d44dda6b6eaed09cdfd12; no voters: 7d3072f2af0b481d94ed70632b90e8c6, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:17:17.192714  9834 raft_consensus.cc:2749] T 9f7eec107ecc40f38d14871d9227b25f P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:17.193421  2843 tablet_replica.cc:333] T cc6e2639db63487cae6a125c8d5fe1d8 P 43c6faa9496d44dda6b6eaed09cdfd12: stopping tablet replica
I20260709 13:17:17.194032  2843 raft_consensus.cc:2243] T cc6e2639db63487cae6a125c8d5fe1d8 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.194430  2843 raft_consensus.cc:2272] T cc6e2639db63487cae6a125c8d5fe1d8 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.196455  2843 tablet_replica.cc:333] T 2c3f7327ddfa499ab1e3f0996a560618 P 43c6faa9496d44dda6b6eaed09cdfd12: stopping tablet replica
I20260709 13:17:17.197050  2843 raft_consensus.cc:2243] T 2c3f7327ddfa499ab1e3f0996a560618 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.197554  2843 raft_consensus.cc:2272] T 2c3f7327ddfa499ab1e3f0996a560618 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.200263  2843 tablet_replica.cc:333] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12: stopping tablet replica
W20260709 13:17:17.200975  8959 consensus_peers.cc:597] T 485b2d9b05744b4f9a22e8f0e8b66e0d P e8bb7e1240f44fda8b83e4c124852032 -> Peer 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671): Couldn't send request to peer 43c6faa9496d44dda6b6eaed09cdfd12. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:17.201071  2843 raft_consensus.cc:2243] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.201900  2843 raft_consensus.cc:2272] T 097c705b65de4abe884afdb1fcaaa054 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.205550  2843 tablet_replica.cc:333] T dde08046aca642488918d1f2b978c126 P 43c6faa9496d44dda6b6eaed09cdfd12: stopping tablet replica
I20260709 13:17:17.206429  2843 raft_consensus.cc:2243] T dde08046aca642488918d1f2b978c126 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:17.207486  2843 raft_consensus.cc:2272] T dde08046aca642488918d1f2b978c126 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.210217  2843 tablet_replica.cc:333] T 9f7eec107ecc40f38d14871d9227b25f P 43c6faa9496d44dda6b6eaed09cdfd12: stopping tablet replica
I20260709 13:17:17.210968  2843 raft_consensus.cc:2243] T 9f7eec107ecc40f38d14871d9227b25f P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.211527  2843 raft_consensus.cc:2272] T 9f7eec107ecc40f38d14871d9227b25f P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.214067  2843 tablet_replica.cc:333] T 67ea3c8e514f41549c3a96b74a9b5be9 P 43c6faa9496d44dda6b6eaed09cdfd12: stopping tablet replica
I20260709 13:17:17.214787  2843 raft_consensus.cc:2243] T 67ea3c8e514f41549c3a96b74a9b5be9 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.215306  2843 raft_consensus.cc:2272] T 67ea3c8e514f41549c3a96b74a9b5be9 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.217734  2843 tablet_replica.cc:333] T 7bcde3fdb9314ca4b3422d395a673be5 P 43c6faa9496d44dda6b6eaed09cdfd12: stopping tablet replica
I20260709 13:17:17.218302  2843 raft_consensus.cc:2243] T 7bcde3fdb9314ca4b3422d395a673be5 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:17.219296  2843 raft_consensus.cc:2272] T 7bcde3fdb9314ca4b3422d395a673be5 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.221489  2843 tablet_replica.cc:333] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12: stopping tablet replica
I20260709 13:17:17.222205  2843 raft_consensus.cc:2243] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:17.223042  2843 raft_consensus.cc:2272] T ab679ea0af724bd39f753eb407c73264 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.225109  2843 tablet_replica.cc:333] T d46902173b5c4283b315c6def6f13c31 P 43c6faa9496d44dda6b6eaed09cdfd12: stopping tablet replica
I20260709 13:17:17.225674  2843 raft_consensus.cc:2243] T d46902173b5c4283b315c6def6f13c31 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.226187  2843 raft_consensus.cc:2272] T d46902173b5c4283b315c6def6f13c31 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.228166  2843 tablet_replica.cc:333] T 68650af2b1894208a4cc0a1c6ddf880b P 43c6faa9496d44dda6b6eaed09cdfd12: stopping tablet replica
I20260709 13:17:17.228739  2843 raft_consensus.cc:2243] T 68650af2b1894208a4cc0a1c6ddf880b P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.229162  2843 raft_consensus.cc:2272] T 68650af2b1894208a4cc0a1c6ddf880b P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.231081  2843 tablet_replica.cc:333] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12: stopping tablet replica
I20260709 13:17:17.231719  2843 raft_consensus.cc:2243] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.232175  2843 raft_consensus.cc:2272] T 1d5284f5b067413e9fc2a383cc318735 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.234488  2843 tablet_replica.cc:333] T d64af92885f944f9b1ecf193ede281b3 P 43c6faa9496d44dda6b6eaed09cdfd12: stopping tablet replica
I20260709 13:17:17.235143  2843 raft_consensus.cc:2243] T d64af92885f944f9b1ecf193ede281b3 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.235692  2843 raft_consensus.cc:2272] T d64af92885f944f9b1ecf193ede281b3 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:17.237864  8959 consensus_peers.cc:597] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 -> Peer 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671): Couldn't send request to peer 43c6faa9496d44dda6b6eaed09cdfd12. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:17.238098  2843 tablet_replica.cc:333] T 21893ae95aed4157a65823826a6badf0 P 43c6faa9496d44dda6b6eaed09cdfd12: stopping tablet replica
I20260709 13:17:17.238793  2843 raft_consensus.cc:2243] T 21893ae95aed4157a65823826a6badf0 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.239264  2843 raft_consensus.cc:2272] T 21893ae95aed4157a65823826a6badf0 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.242040  2843 tablet_replica.cc:333] T 1c9bb56a39d44b71b44c334e0bea59a5 P 43c6faa9496d44dda6b6eaed09cdfd12: stopping tablet replica
I20260709 13:17:17.242652  2843 raft_consensus.cc:2243] T 1c9bb56a39d44b71b44c334e0bea59a5 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.243144  2843 raft_consensus.cc:2272] T 1c9bb56a39d44b71b44c334e0bea59a5 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.245601  2843 tablet_replica.cc:333] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12: stopping tablet replica
I20260709 13:17:17.246245  2843 raft_consensus.cc:2243] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.246795  2843 raft_consensus.cc:2272] T 485b2d9b05744b4f9a22e8f0e8b66e0d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.249233  2843 tablet_replica.cc:333] T ef723f9c640849d3890c61c07ffd0378 P 43c6faa9496d44dda6b6eaed09cdfd12: stopping tablet replica
I20260709 13:17:17.249800  2843 raft_consensus.cc:2243] T ef723f9c640849d3890c61c07ffd0378 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:17.250587  2843 raft_consensus.cc:2272] T ef723f9c640849d3890c61c07ffd0378 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.252693  2843 tablet_replica.cc:333] T 80fde6a0b6334446923248a50e223397 P 43c6faa9496d44dda6b6eaed09cdfd12: stopping tablet replica
I20260709 13:17:17.253279  2843 raft_consensus.cc:2243] T 80fde6a0b6334446923248a50e223397 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:17.254091  2843 raft_consensus.cc:2272] T 80fde6a0b6334446923248a50e223397 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.256137  2843 tablet_replica.cc:333] T 359d64d36e684763884c576f961f829d P 43c6faa9496d44dda6b6eaed09cdfd12: stopping tablet replica
I20260709 13:17:17.256716  2843 raft_consensus.cc:2243] T 359d64d36e684763884c576f961f829d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:17.257534  2843 raft_consensus.cc:2272] T 359d64d36e684763884c576f961f829d P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.259655  2843 tablet_replica.cc:333] T ae1fc430ae3d4315aad2c0eed2f026aa P 43c6faa9496d44dda6b6eaed09cdfd12: stopping tablet replica
I20260709 13:17:17.260447  2843 raft_consensus.cc:2243] T ae1fc430ae3d4315aad2c0eed2f026aa P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:17.261363  2843 raft_consensus.cc:2272] T ae1fc430ae3d4315aad2c0eed2f026aa P 43c6faa9496d44dda6b6eaed09cdfd12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.263863  2843 tablet_replica.cc:333] T 197670bf2e8f4301b060ed8ef6862b22 P 43c6faa9496d44dda6b6eaed09cdfd12: stopping tablet replica
W20260709 13:17:17.264438  8959 consensus_peers.cc:597] T 2945a5b174e14a5a9052897942f876c2 P e8bb7e1240f44fda8b83e4c124852032 -> Peer 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671): Couldn't send request to peer 43c6faa9496d44dda6b6eaed09cdfd12. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:17.264643  2843 raft_consensus.cc:2243] T 197670bf2e8f4301b060ed8ef6862b22 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:17.265522  2843 raft_consensus.cc:2272] T 197670bf2e8f4301b060ed8ef6862b22 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.267761  2843 tablet_replica.cc:333] T 17e47826fe4e4662baba1d095c341c1b P 43c6faa9496d44dda6b6eaed09cdfd12: stopping tablet replica
I20260709 13:17:17.268334  2843 raft_consensus.cc:2243] T 17e47826fe4e4662baba1d095c341c1b P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.268810  2843 raft_consensus.cc:2272] T 17e47826fe4e4662baba1d095c341c1b P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.270814  2843 tablet_replica.cc:333] T f46053ed2641458a87c97152e4979c35 P 43c6faa9496d44dda6b6eaed09cdfd12: stopping tablet replica
I20260709 13:17:17.271371  2843 raft_consensus.cc:2243] T f46053ed2641458a87c97152e4979c35 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:17.272271  2843 raft_consensus.cc:2272] T f46053ed2641458a87c97152e4979c35 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.274401  2843 tablet_replica.cc:333] T 932e5cbccd33414f8b05280505fd8bc7 P 43c6faa9496d44dda6b6eaed09cdfd12: stopping tablet replica
I20260709 13:17:17.274966  2843 raft_consensus.cc:2243] T 932e5cbccd33414f8b05280505fd8bc7 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.275404  2843 raft_consensus.cc:2272] T 932e5cbccd33414f8b05280505fd8bc7 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.277354  2843 tablet_replica.cc:333] T 9fdcbb0a74a64826ab0665c349b16200 P 43c6faa9496d44dda6b6eaed09cdfd12: stopping tablet replica
I20260709 13:17:17.277904  2843 raft_consensus.cc:2243] T 9fdcbb0a74a64826ab0665c349b16200 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.278352  2843 raft_consensus.cc:2272] T 9fdcbb0a74a64826ab0665c349b16200 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.280604  2843 tablet_replica.cc:333] T 734d16820c5640729de24c6edf4c5ed8 P 43c6faa9496d44dda6b6eaed09cdfd12: stopping tablet replica
I20260709 13:17:17.281139  2843 raft_consensus.cc:2243] T 734d16820c5640729de24c6edf4c5ed8 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:17.281994  2843 raft_consensus.cc:2272] T 734d16820c5640729de24c6edf4c5ed8 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.284123  2843 tablet_replica.cc:333] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12: stopping tablet replica
I20260709 13:17:17.284752  2843 raft_consensus.cc:2243] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:17.285439  2843 pending_rounds.cc:70] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12: Trying to abort 1 pending ops.
I20260709 13:17:17.285666  2843 pending_rounds.cc:77] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305638038813020160 op_type: NO_OP noop_request { }
I20260709 13:17:17.285992  2843 raft_consensus.cc:2889] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:17:17.286252  2843 raft_consensus.cc:2272] T 574915613e8a4d3481aef27d3a977caa P 43c6faa9496d44dda6b6eaed09cdfd12 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.288735  2843 tablet_replica.cc:333] T be1c593726564ba7ae9e8b66d1989f69 P 43c6faa9496d44dda6b6eaed09cdfd12: stopping tablet replica
I20260709 13:17:17.289250  2843 raft_consensus.cc:2243] T be1c593726564ba7ae9e8b66d1989f69 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.289674  2843 raft_consensus.cc:2272] T be1c593726564ba7ae9e8b66d1989f69 P 43c6faa9496d44dda6b6eaed09cdfd12 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:17.297679  8959 consensus_peers.cc:597] T 68650af2b1894208a4cc0a1c6ddf880b P e8bb7e1240f44fda8b83e4c124852032 -> Peer 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671): Couldn't send request to peer 43c6faa9496d44dda6b6eaed09cdfd12. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:17.300359  8958 consensus_peers.cc:597] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:17.346779  8959 consensus_peers.cc:597] T 097c705b65de4abe884afdb1fcaaa054 P e8bb7e1240f44fda8b83e4c124852032 -> Peer 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671): Couldn't send request to peer 43c6faa9496d44dda6b6eaed09cdfd12. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:17.348927  8958 consensus_peers.cc:597] T 485b2d9b05744b4f9a22e8f0e8b66e0d P e8bb7e1240f44fda8b83e4c124852032 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:17.367048  8959 consensus_peers.cc:597] T 9fdcbb0a74a64826ab0665c349b16200 P e8bb7e1240f44fda8b83e4c124852032 -> Peer 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671): Couldn't send request to peer 43c6faa9496d44dda6b6eaed09cdfd12. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.195:37671: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:17.372967  2843 tablet_server.cc:196] TabletServer@127.2.198.195:0 shutdown complete.
I20260709 13:17:17.375015  9985 raft_consensus.cc:493] T 675795627b9b4542805157dd7ec531cd P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d3072f2af0b481d94ed70632b90e8c6)
I20260709 13:17:17.375684  9985 raft_consensus.cc:515] T 675795627b9b4542805157dd7ec531cd P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:17:17.377853  9985 leader_election.cc:290] T 675795627b9b4542805157dd7ec531cd P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
W20260709 13:17:17.380321  8959 consensus_peers.cc:597] T 2accf622ad6243e3b7b496fb979fe9d4 P e8bb7e1240f44fda8b83e4c124852032 -> Peer 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671): Couldn't send request to peer 43c6faa9496d44dda6b6eaed09cdfd12. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.195:37671: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:17.382973  8958 leader_election.cc:336] T 675795627b9b4542805157dd7ec531cd P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
W20260709 13:17:17.383785  8957 leader_election.cc:336] T 675795627b9b4542805157dd7ec531cd P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Network error: Client connection negotiation failed: client connection to 127.2.198.194:35315: connect: Connection refused (error 111)
I20260709 13:17:17.384147  8957 leader_election.cc:304] T 675795627b9b4542805157dd7ec531cd P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bb7e1240f44fda8b83e4c124852032; no voters: 7d3072f2af0b481d94ed70632b90e8c6, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:17:17.384727  9985 raft_consensus.cc:2749] T 675795627b9b4542805157dd7ec531cd P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:17:17.403997  8959 consensus_peers.cc:597] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 -> Peer 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671): Couldn't send request to peer 43c6faa9496d44dda6b6eaed09cdfd12. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.195:37671: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:17.412333  9976 raft_consensus.cc:493] T 2c3f7327ddfa499ab1e3f0996a560618 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d3072f2af0b481d94ed70632b90e8c6)
I20260709 13:17:17.412947  9976 raft_consensus.cc:515] T 2c3f7327ddfa499ab1e3f0996a560618 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:17:17.415517  9976 leader_election.cc:290] T 2c3f7327ddfa499ab1e3f0996a560618 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
W20260709 13:17:17.418579  8957 leader_election.cc:336] T 2c3f7327ddfa499ab1e3f0996a560618 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Network error: Client connection negotiation failed: client connection to 127.2.198.194:35315: connect: Connection refused (error 111)
W20260709 13:17:17.420188  8959 leader_election.cc:336] T 2c3f7327ddfa499ab1e3f0996a560618 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671): Network error: Client connection negotiation failed: client connection to 127.2.198.195:37671: connect: Connection refused (error 111)
I20260709 13:17:17.420593  8959 leader_election.cc:304] T 2c3f7327ddfa499ab1e3f0996a560618 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bb7e1240f44fda8b83e4c124852032; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6
I20260709 13:17:17.421257  9976 raft_consensus.cc:2749] T 2c3f7327ddfa499ab1e3f0996a560618 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:17:17.441866  8958 consensus_peers.cc:597] T 9fdcbb0a74a64826ab0665c349b16200 P e8bb7e1240f44fda8b83e4c124852032 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:17.460328  9985 raft_consensus.cc:493] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d3072f2af0b481d94ed70632b90e8c6)
I20260709 13:17:17.461230  9985 raft_consensus.cc:515] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:17:17.463295  2843 tablet_server.cc:179] TabletServer@127.2.198.196:0 shutting down...
I20260709 13:17:17.463721  9985 leader_election.cc:290] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
W20260709 13:17:17.470124  8958 leader_election.cc:336] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
W20260709 13:17:17.471031  8959 consensus_peers.cc:597] T 45d9eb22dee8411b82eb768686e34604 P e8bb7e1240f44fda8b83e4c124852032 -> Peer 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671): Couldn't send request to peer 43c6faa9496d44dda6b6eaed09cdfd12. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.195:37671: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:17.471046  8957 leader_election.cc:336] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Network error: Client connection negotiation failed: client connection to 127.2.198.194:35315: connect: Connection refused (error 111)
I20260709 13:17:17.471745  8957 leader_election.cc:304] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bb7e1240f44fda8b83e4c124852032; no voters: 7d3072f2af0b481d94ed70632b90e8c6, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:17:17.472400  9985 raft_consensus.cc:2749] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:17:17.490459  8958 consensus_peers.cc:597] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 -> Peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Couldn't send request to peer 895d3c58761f427c9c5b3cb41246c243. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:17.512818  2843 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:17.513679  2843 tablet_replica.cc:333] T 45d9eb22dee8411b82eb768686e34604 P e8bb7e1240f44fda8b83e4c124852032: stopping tablet replica
I20260709 13:17:17.514465  2843 raft_consensus.cc:2243] T 45d9eb22dee8411b82eb768686e34604 P e8bb7e1240f44fda8b83e4c124852032 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:17.515386  2843 raft_consensus.cc:2272] T 45d9eb22dee8411b82eb768686e34604 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.517750  2843 tablet_replica.cc:333] T 2accf622ad6243e3b7b496fb979fe9d4 P e8bb7e1240f44fda8b83e4c124852032: stopping tablet replica
I20260709 13:17:17.518365  2843 raft_consensus.cc:2243] T 2accf622ad6243e3b7b496fb979fe9d4 P e8bb7e1240f44fda8b83e4c124852032 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:17.519150  2843 raft_consensus.cc:2272] T 2accf622ad6243e3b7b496fb979fe9d4 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.520741  9985 raft_consensus.cc:493] T 4e1e1e84d68946d682e0944fbd3c51a8 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d3072f2af0b481d94ed70632b90e8c6)
I20260709 13:17:17.521210  9985 raft_consensus.cc:515] T 4e1e1e84d68946d682e0944fbd3c51a8 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } } peers { permanent_uuid: "895d3c58761f427c9c5b3cb41246c243" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39173 } } peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } }
I20260709 13:17:17.521672  2843 tablet_replica.cc:333] T 51992816e23f4cf99d31cec60fa429b9 P e8bb7e1240f44fda8b83e4c124852032: stopping tablet replica
I20260709 13:17:17.522671  2843 raft_consensus.cc:2243] T 51992816e23f4cf99d31cec60fa429b9 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.523370  2843 raft_consensus.cc:2272] T 51992816e23f4cf99d31cec60fa429b9 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.524467  9985 leader_election.cc:290] T 4e1e1e84d68946d682e0944fbd3c51a8 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173), 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315)
I20260709 13:17:17.526401  2843 tablet_replica.cc:333] T b8ded21dd9a54bc8b9cd260808162d0d P e8bb7e1240f44fda8b83e4c124852032: stopping tablet replica
I20260709 13:17:17.527235  2843 raft_consensus.cc:2243] T b8ded21dd9a54bc8b9cd260808162d0d P e8bb7e1240f44fda8b83e4c124852032 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:17.528360  2843 raft_consensus.cc:2272] T b8ded21dd9a54bc8b9cd260808162d0d P e8bb7e1240f44fda8b83e4c124852032 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:17.528450  8958 leader_election.cc:336] T 4e1e1e84d68946d682e0944fbd3c51a8 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 895d3c58761f427c9c5b3cb41246c243 (127.2.198.193:39173): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39173: connect: Connection refused (error 111)
W20260709 13:17:17.529045  8957 leader_election.cc:336] T 4e1e1e84d68946d682e0944fbd3c51a8 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Network error: Client connection negotiation failed: client connection to 127.2.198.194:35315: connect: Connection refused (error 111)
I20260709 13:17:17.529476  8957 leader_election.cc:304] T 4e1e1e84d68946d682e0944fbd3c51a8 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bb7e1240f44fda8b83e4c124852032; no voters: 7d3072f2af0b481d94ed70632b90e8c6, 895d3c58761f427c9c5b3cb41246c243
I20260709 13:17:17.530176  9985 raft_consensus.cc:2749] T 4e1e1e84d68946d682e0944fbd3c51a8 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:17.531072  2843 tablet_replica.cc:333] T 68650af2b1894208a4cc0a1c6ddf880b P e8bb7e1240f44fda8b83e4c124852032: stopping tablet replica
I20260709 13:17:17.531796  2843 raft_consensus.cc:2243] T 68650af2b1894208a4cc0a1c6ddf880b P e8bb7e1240f44fda8b83e4c124852032 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:17.532604  2843 raft_consensus.cc:2272] T 68650af2b1894208a4cc0a1c6ddf880b P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.535159  2843 tablet_replica.cc:333] T 097c705b65de4abe884afdb1fcaaa054 P e8bb7e1240f44fda8b83e4c124852032: stopping tablet replica
I20260709 13:17:17.536000  2843 raft_consensus.cc:2243] T 097c705b65de4abe884afdb1fcaaa054 P e8bb7e1240f44fda8b83e4c124852032 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:17.536285  9985 raft_consensus.cc:493] T 21893ae95aed4157a65823826a6badf0 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d3072f2af0b481d94ed70632b90e8c6)
I20260709 13:17:17.537123  2843 raft_consensus.cc:2272] T 097c705b65de4abe884afdb1fcaaa054 P e8bb7e1240f44fda8b83e4c124852032 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.536793  9985 raft_consensus.cc:515] T 21893ae95aed4157a65823826a6badf0 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:17:17.540303  2843 tablet_replica.cc:333] T dde08046aca642488918d1f2b978c126 P e8bb7e1240f44fda8b83e4c124852032: stopping tablet replica
I20260709 13:17:17.541119  2843 raft_consensus.cc:2243] T dde08046aca642488918d1f2b978c126 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.541623  2843 raft_consensus.cc:2272] T dde08046aca642488918d1f2b978c126 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.541639  9985 leader_election.cc:290] T 21893ae95aed4157a65823826a6badf0 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:17:17.544687  2843 tablet_replica.cc:333] T 278f12b812a8473f8e3fddc73feabb62 P e8bb7e1240f44fda8b83e4c124852032: stopping tablet replica
W20260709 13:17:17.545205  8959 leader_election.cc:336] T 21893ae95aed4157a65823826a6badf0 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671): Network error: Client connection negotiation failed: client connection to 127.2.198.195:37671: connect: Connection refused (error 111)
I20260709 13:17:17.545559  2843 raft_consensus.cc:2243] T 278f12b812a8473f8e3fddc73feabb62 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.546118  2843 raft_consensus.cc:2272] T 278f12b812a8473f8e3fddc73feabb62 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:17.546085  8957 leader_election.cc:336] T 21893ae95aed4157a65823826a6badf0 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Network error: Client connection negotiation failed: client connection to 127.2.198.194:35315: connect: Connection refused (error 111)
I20260709 13:17:17.546677  8957 leader_election.cc:304] T 21893ae95aed4157a65823826a6badf0 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bb7e1240f44fda8b83e4c124852032; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6
I20260709 13:17:17.547390  9985 raft_consensus.cc:2749] T 21893ae95aed4157a65823826a6badf0 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:17.549331  2843 tablet_replica.cc:333] T 852f0ef4508245e2812b76665a70bbf8 P e8bb7e1240f44fda8b83e4c124852032: stopping tablet replica
I20260709 13:17:17.550262  2843 raft_consensus.cc:2243] T 852f0ef4508245e2812b76665a70bbf8 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.550742  2843 raft_consensus.cc:2272] T 852f0ef4508245e2812b76665a70bbf8 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.553634  2843 tablet_replica.cc:333] T 2945a5b174e14a5a9052897942f876c2 P e8bb7e1240f44fda8b83e4c124852032: stopping tablet replica
I20260709 13:17:17.554236  2843 raft_consensus.cc:2243] T 2945a5b174e14a5a9052897942f876c2 P e8bb7e1240f44fda8b83e4c124852032 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:17.555076  2843 raft_consensus.cc:2272] T 2945a5b174e14a5a9052897942f876c2 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.555634  9985 raft_consensus.cc:493] T d64af92885f944f9b1ecf193ede281b3 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3072f2af0b481d94ed70632b90e8c6)
I20260709 13:17:17.556147  9985 raft_consensus.cc:515] T d64af92885f944f9b1ecf193ede281b3 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3072f2af0b481d94ed70632b90e8c6" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 35315 } } peers { permanent_uuid: "43c6faa9496d44dda6b6eaed09cdfd12" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 37671 } } peers { permanent_uuid: "e8bb7e1240f44fda8b83e4c124852032" member_type: VOTER last_known_addr { host: "127.2.198.196" port: 46105 } }
I20260709 13:17:17.557765  2843 tablet_replica.cc:333] T e3ee8f06068449de90c7fb0479f504ca P e8bb7e1240f44fda8b83e4c124852032: stopping tablet replica
I20260709 13:17:17.558321  9985 leader_election.cc:290] T d64af92885f944f9b1ecf193ede281b3 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315), 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671)
I20260709 13:17:17.558691  2843 raft_consensus.cc:2243] T e3ee8f06068449de90c7fb0479f504ca P e8bb7e1240f44fda8b83e4c124852032 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:17.559856  2843 raft_consensus.cc:2272] T e3ee8f06068449de90c7fb0479f504ca P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:17.562227  8959 leader_election.cc:336] T d64af92885f944f9b1ecf193ede281b3 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 43c6faa9496d44dda6b6eaed09cdfd12 (127.2.198.195:37671): Network error: Client connection negotiation failed: client connection to 127.2.198.195:37671: connect: Connection refused (error 111)
I20260709 13:17:17.562709  2843 tablet_replica.cc:333] T 4352fad232ab47588683e51cf4b62080 P e8bb7e1240f44fda8b83e4c124852032: stopping tablet replica
W20260709 13:17:17.563027  8957 leader_election.cc:336] T d64af92885f944f9b1ecf193ede281b3 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7d3072f2af0b481d94ed70632b90e8c6 (127.2.198.194:35315): Network error: Client connection negotiation failed: client connection to 127.2.198.194:35315: connect: Connection refused (error 111)
I20260709 13:17:17.563426  8957 leader_election.cc:304] T d64af92885f944f9b1ecf193ede281b3 P e8bb7e1240f44fda8b83e4c124852032 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8bb7e1240f44fda8b83e4c124852032; no voters: 43c6faa9496d44dda6b6eaed09cdfd12, 7d3072f2af0b481d94ed70632b90e8c6
I20260709 13:17:17.563431  2843 raft_consensus.cc:2243] T 4352fad232ab47588683e51cf4b62080 P e8bb7e1240f44fda8b83e4c124852032 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.564134  2843 raft_consensus.cc:2272] T 4352fad232ab47588683e51cf4b62080 P e8bb7e1240f44fda8b83e4c124852032 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.564167  9985 raft_consensus.cc:2749] T d64af92885f944f9b1ecf193ede281b3 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:17.566452  2843 tablet_replica.cc:333] T 675795627b9b4542805157dd7ec531cd P e8bb7e1240f44fda8b83e4c124852032: stopping tablet replica
I20260709 13:17:17.567121  2843 raft_consensus.cc:2243] T 675795627b9b4542805157dd7ec531cd P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.567646  2843 raft_consensus.cc:2272] T 675795627b9b4542805157dd7ec531cd P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.569784  2843 tablet_replica.cc:333] T 67ea3c8e514f41549c3a96b74a9b5be9 P e8bb7e1240f44fda8b83e4c124852032: stopping tablet replica
I20260709 13:17:17.570554  2843 raft_consensus.cc:2243] T 67ea3c8e514f41549c3a96b74a9b5be9 P e8bb7e1240f44fda8b83e4c124852032 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:17.571389  2843 raft_consensus.cc:2272] T 67ea3c8e514f41549c3a96b74a9b5be9 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.574183  2843 tablet_replica.cc:333] T f3abbeb71eba411bb6dfec800d3bd9c0 P e8bb7e1240f44fda8b83e4c124852032: stopping tablet replica
I20260709 13:17:17.575026  2843 raft_consensus.cc:2243] T f3abbeb71eba411bb6dfec800d3bd9c0 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.575682  2843 raft_consensus.cc:2272] T f3abbeb71eba411bb6dfec800d3bd9c0 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.578403  2843 tablet_replica.cc:333] T dc5cf20be8db404dbda7f0b4a676ab31 P e8bb7e1240f44fda8b83e4c124852032: stopping tablet replica
I20260709 13:17:17.579203  2843 raft_consensus.cc:2243] T dc5cf20be8db404dbda7f0b4a676ab31 P e8bb7e1240f44fda8b83e4c124852032 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:17.580333  2843 raft_consensus.cc:2272] T dc5cf20be8db404dbda7f0b4a676ab31 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.583025  2843 tablet_replica.cc:333] T 390c483b2a1c42b897e166b1a381851c P e8bb7e1240f44fda8b83e4c124852032: stopping tablet replica
I20260709 13:17:17.583739  2843 raft_consensus.cc:2243] T 390c483b2a1c42b897e166b1a381851c P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.584169  2843 raft_consensus.cc:2272] T 390c483b2a1c42b897e166b1a381851c P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.586189  2843 tablet_replica.cc:333] T 2c3f7327ddfa499ab1e3f0996a560618 P e8bb7e1240f44fda8b83e4c124852032: stopping tablet replica
I20260709 13:17:17.586861  2843 raft_consensus.cc:2243] T 2c3f7327ddfa499ab1e3f0996a560618 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.587277  2843 raft_consensus.cc:2272] T 2c3f7327ddfa499ab1e3f0996a560618 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.589134  2843 tablet_replica.cc:333] T 448f6ffb482841a3b489476becf2f851 P e8bb7e1240f44fda8b83e4c124852032: stopping tablet replica
I20260709 13:17:17.589718  2843 raft_consensus.cc:2243] T 448f6ffb482841a3b489476becf2f851 P e8bb7e1240f44fda8b83e4c124852032 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:17.590548  2843 raft_consensus.cc:2272] T 448f6ffb482841a3b489476becf2f851 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.592742  2843 tablet_replica.cc:333] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P e8bb7e1240f44fda8b83e4c124852032: stopping tablet replica
I20260709 13:17:17.593291  2843 raft_consensus.cc:2243] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.593725  2843 raft_consensus.cc:2272] T c44c5aa220814dfd9fc9bb07cd5b1cf7 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.595840  2843 tablet_replica.cc:333] T 1521cafcc31b47c58829494618fc0cd8 P e8bb7e1240f44fda8b83e4c124852032: stopping tablet replica
I20260709 13:17:17.596411  2843 raft_consensus.cc:2243] T 1521cafcc31b47c58829494618fc0cd8 P e8bb7e1240f44fda8b83e4c124852032 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:17.597291  2843 raft_consensus.cc:2272] T 1521cafcc31b47c58829494618fc0cd8 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.599201  2843 tablet_replica.cc:333] T 80fde6a0b6334446923248a50e223397 P e8bb7e1240f44fda8b83e4c124852032: stopping tablet replica
I20260709 13:17:17.599887  2843 raft_consensus.cc:2243] T 80fde6a0b6334446923248a50e223397 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.600317  2843 raft_consensus.cc:2272] T 80fde6a0b6334446923248a50e223397 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.602342  2843 tablet_replica.cc:333] T 359d64d36e684763884c576f961f829d P e8bb7e1240f44fda8b83e4c124852032: stopping tablet replica
I20260709 13:17:17.602916  2843 raft_consensus.cc:2243] T 359d64d36e684763884c576f961f829d P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.603363  2843 raft_consensus.cc:2272] T 359d64d36e684763884c576f961f829d P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.605347  2843 tablet_replica.cc:333] T ae1fc430ae3d4315aad2c0eed2f026aa P e8bb7e1240f44fda8b83e4c124852032: stopping tablet replica
I20260709 13:17:17.605894  2843 raft_consensus.cc:2243] T ae1fc430ae3d4315aad2c0eed2f026aa P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.606362  2843 raft_consensus.cc:2272] T ae1fc430ae3d4315aad2c0eed2f026aa P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.608453  2843 tablet_replica.cc:333] T 197670bf2e8f4301b060ed8ef6862b22 P e8bb7e1240f44fda8b83e4c124852032: stopping tablet replica
I20260709 13:17:17.609043  2843 raft_consensus.cc:2243] T 197670bf2e8f4301b060ed8ef6862b22 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.609513  2843 raft_consensus.cc:2272] T 197670bf2e8f4301b060ed8ef6862b22 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.611685  2843 tablet_replica.cc:333] T 5a26acd2175646e3a53b493571852af4 P e8bb7e1240f44fda8b83e4c124852032: stopping tablet replica
I20260709 13:17:17.612265  2843 raft_consensus.cc:2243] T 5a26acd2175646e3a53b493571852af4 P e8bb7e1240f44fda8b83e4c124852032 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:17.613452  2843 raft_consensus.cc:2272] T 5a26acd2175646e3a53b493571852af4 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.616374  2843 tablet_replica.cc:333] T ed4d847e589942fcbf6dadbb578327f2 P e8bb7e1240f44fda8b83e4c124852032: stopping tablet replica
I20260709 13:17:17.617113  2843 raft_consensus.cc:2243] T ed4d847e589942fcbf6dadbb578327f2 P e8bb7e1240f44fda8b83e4c124852032 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:17.618131  2843 raft_consensus.cc:2272] T ed4d847e589942fcbf6dadbb578327f2 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.620721  2843 tablet_replica.cc:333] T 574915613e8a4d3481aef27d3a977caa P e8bb7e1240f44fda8b83e4c124852032: stopping tablet replica
I20260709 13:17:17.621505  2843 raft_consensus.cc:2243] T 574915613e8a4d3481aef27d3a977caa P e8bb7e1240f44fda8b83e4c124852032 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.621946  2843 raft_consensus.cc:2272] T 574915613e8a4d3481aef27d3a977caa P e8bb7e1240f44fda8b83e4c124852032 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.624133  2843 tablet_replica.cc:333] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032: stopping tablet replica
I20260709 13:17:17.624697  2843 raft_consensus.cc:2243] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:17:17.625447  2843 pending_rounds.cc:70] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032: Trying to abort 1 pending ops.
I20260709 13:17:17.625644  2843 pending_rounds.cc:77] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032: Aborting op as it isn't in flight: id { term: 4 index: 4 } timestamp: 7305638039250567168 op_type: NO_OP noop_request { }
I20260709 13:17:17.625944  2843 raft_consensus.cc:2889] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [term 4 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:17:17.626230  2843 raft_consensus.cc:2272] T be1c593726564ba7ae9e8b66d1989f69 P e8bb7e1240f44fda8b83e4c124852032 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.628536  2843 tablet_replica.cc:333] T 65900ac9e06944639fe557200317fe05 P e8bb7e1240f44fda8b83e4c124852032: stopping tablet replica
I20260709 13:17:17.629105  2843 raft_consensus.cc:2243] T 65900ac9e06944639fe557200317fe05 P e8bb7e1240f44fda8b83e4c124852032 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.629580  2843 raft_consensus.cc:2272] T 65900ac9e06944639fe557200317fe05 P e8bb7e1240f44fda8b83e4c124852032 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.631412  2843 tablet_replica.cc:333] T 8a25176ebf484df29f67908cfa6e2b48 P e8bb7e1240f44fda8b83e4c124852032: stopping tablet replica
I20260709 13:17:17.631974  2843 raft_consensus.cc:2243] T 8a25176ebf484df29f67908cfa6e2b48 P e8bb7e1240f44fda8b83e4c124852032 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:17.632779  2843 raft_consensus.cc:2272] T 8a25176ebf484df29f67908cfa6e2b48 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.634719  2843 tablet_replica.cc:333] T 9fdcbb0a74a64826ab0665c349b16200 P e8bb7e1240f44fda8b83e4c124852032: stopping tablet replica
I20260709 13:17:17.635257  2843 raft_consensus.cc:2243] T 9fdcbb0a74a64826ab0665c349b16200 P e8bb7e1240f44fda8b83e4c124852032 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:17.636015  2843 pending_rounds.cc:70] T 9fdcbb0a74a64826ab0665c349b16200 P e8bb7e1240f44fda8b83e4c124852032: Trying to abort 1 pending ops.
I20260709 13:17:17.636224  2843 pending_rounds.cc:77] T 9fdcbb0a74a64826ab0665c349b16200 P e8bb7e1240f44fda8b83e4c124852032: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305638039184912384 op_type: NO_OP noop_request { }
I20260709 13:17:17.636519  2843 raft_consensus.cc:2889] T 9fdcbb0a74a64826ab0665c349b16200 P e8bb7e1240f44fda8b83e4c124852032 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:17:17.636788  2843 raft_consensus.cc:2272] T 9fdcbb0a74a64826ab0665c349b16200 P e8bb7e1240f44fda8b83e4c124852032 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.639088  2843 tablet_replica.cc:333] T 734d16820c5640729de24c6edf4c5ed8 P e8bb7e1240f44fda8b83e4c124852032: stopping tablet replica
I20260709 13:17:17.639693  2843 raft_consensus.cc:2243] T 734d16820c5640729de24c6edf4c5ed8 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.640112  2843 raft_consensus.cc:2272] T 734d16820c5640729de24c6edf4c5ed8 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.642198  2843 tablet_replica.cc:333] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032: stopping tablet replica
I20260709 13:17:17.642736  2843 raft_consensus.cc:2243] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:17.643640  2843 pending_rounds.cc:70] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032: Trying to abort 1 pending ops.
I20260709 13:17:17.643850  2843 pending_rounds.cc:77] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305638038597226496 op_type: NO_OP noop_request { }
I20260709 13:17:17.644127  2843 raft_consensus.cc:2889] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:17:17.644447  2843 raft_consensus.cc:2272] T 1c9bb56a39d44b71b44c334e0bea59a5 P e8bb7e1240f44fda8b83e4c124852032 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.646921  2843 tablet_replica.cc:333] T 485b2d9b05744b4f9a22e8f0e8b66e0d P e8bb7e1240f44fda8b83e4c124852032: stopping tablet replica
I20260709 13:17:17.647723  2843 raft_consensus.cc:2243] T 485b2d9b05744b4f9a22e8f0e8b66e0d P e8bb7e1240f44fda8b83e4c124852032 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:17.648500  2843 pending_rounds.cc:70] T 485b2d9b05744b4f9a22e8f0e8b66e0d P e8bb7e1240f44fda8b83e4c124852032: Trying to abort 1 pending ops.
I20260709 13:17:17.648710  2843 pending_rounds.cc:77] T 485b2d9b05744b4f9a22e8f0e8b66e0d P e8bb7e1240f44fda8b83e4c124852032: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305638038419447808 op_type: NO_OP noop_request { }
I20260709 13:17:17.648974  2843 raft_consensus.cc:2889] T 485b2d9b05744b4f9a22e8f0e8b66e0d P e8bb7e1240f44fda8b83e4c124852032 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:17:17.649250  2843 raft_consensus.cc:2272] T 485b2d9b05744b4f9a22e8f0e8b66e0d P e8bb7e1240f44fda8b83e4c124852032 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.651384  2843 tablet_replica.cc:333] T 3f0c32d9abf04206a6f08210b3a30794 P e8bb7e1240f44fda8b83e4c124852032: stopping tablet replica
I20260709 13:17:17.651962  2843 raft_consensus.cc:2243] T 3f0c32d9abf04206a6f08210b3a30794 P e8bb7e1240f44fda8b83e4c124852032 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:17.653398  2843 raft_consensus.cc:2272] T 3f0c32d9abf04206a6f08210b3a30794 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.655390  2843 tablet_replica.cc:333] T 825ea78cebec4b10a2f8d03b45d929fa P e8bb7e1240f44fda8b83e4c124852032: stopping tablet replica
I20260709 13:17:17.655961  2843 raft_consensus.cc:2243] T 825ea78cebec4b10a2f8d03b45d929fa P e8bb7e1240f44fda8b83e4c124852032 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.656399  2843 raft_consensus.cc:2272] T 825ea78cebec4b10a2f8d03b45d929fa P e8bb7e1240f44fda8b83e4c124852032 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.658171  2843 tablet_replica.cc:333] T 69e5f8bfdb5a46808e713e051a38866d P e8bb7e1240f44fda8b83e4c124852032: stopping tablet replica
I20260709 13:17:17.658715  2843 raft_consensus.cc:2243] T 69e5f8bfdb5a46808e713e051a38866d P e8bb7e1240f44fda8b83e4c124852032 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:17.659483  2843 raft_consensus.cc:2272] T 69e5f8bfdb5a46808e713e051a38866d P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.661454  2843 tablet_replica.cc:333] T f46053ed2641458a87c97152e4979c35 P e8bb7e1240f44fda8b83e4c124852032: stopping tablet replica
I20260709 13:17:17.662478  2843 raft_consensus.cc:2243] T f46053ed2641458a87c97152e4979c35 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.662978  2843 raft_consensus.cc:2272] T f46053ed2641458a87c97152e4979c35 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.665038  2843 tablet_replica.cc:333] T 55bac44fd5a3462593ab47f6b6f44c6e P e8bb7e1240f44fda8b83e4c124852032: stopping tablet replica
I20260709 13:17:17.665551  2843 raft_consensus.cc:2243] T 55bac44fd5a3462593ab47f6b6f44c6e P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.665959  2843 raft_consensus.cc:2272] T 55bac44fd5a3462593ab47f6b6f44c6e P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.667937  2843 tablet_replica.cc:333] T 4e1e1e84d68946d682e0944fbd3c51a8 P e8bb7e1240f44fda8b83e4c124852032: stopping tablet replica
I20260709 13:17:17.668557  2843 raft_consensus.cc:2243] T 4e1e1e84d68946d682e0944fbd3c51a8 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.668967  2843 raft_consensus.cc:2272] T 4e1e1e84d68946d682e0944fbd3c51a8 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.670898  2843 tablet_replica.cc:333] T ab679ea0af724bd39f753eb407c73264 P e8bb7e1240f44fda8b83e4c124852032: stopping tablet replica
I20260709 13:17:17.671394  2843 raft_consensus.cc:2243] T ab679ea0af724bd39f753eb407c73264 P e8bb7e1240f44fda8b83e4c124852032 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.671850  2843 raft_consensus.cc:2272] T ab679ea0af724bd39f753eb407c73264 P e8bb7e1240f44fda8b83e4c124852032 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.673730  2843 tablet_replica.cc:333] T d64af92885f944f9b1ecf193ede281b3 P e8bb7e1240f44fda8b83e4c124852032: stopping tablet replica
I20260709 13:17:17.674234  2843 raft_consensus.cc:2243] T d64af92885f944f9b1ecf193ede281b3 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.674654  2843 raft_consensus.cc:2272] T d64af92885f944f9b1ecf193ede281b3 P e8bb7e1240f44fda8b83e4c124852032 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.676551  2843 tablet_replica.cc:333] T 21893ae95aed4157a65823826a6badf0 P e8bb7e1240f44fda8b83e4c124852032: stopping tablet replica
I20260709 13:17:17.677017  2843 raft_consensus.cc:2243] T 21893ae95aed4157a65823826a6badf0 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.677446  2843 raft_consensus.cc:2272] T 21893ae95aed4157a65823826a6badf0 P e8bb7e1240f44fda8b83e4c124852032 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.780956  2843 tablet_server.cc:196] TabletServer@127.2.198.196:0 shutdown complete.
I20260709 13:17:17.854133  2843 master.cc:562] Master@127.2.198.254:33107 shutting down...
I20260709 13:17:17.891654  2843 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 3126b3b07ecf4c1da945305b7e462ddc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:17.892406  2843 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 3126b3b07ecf4c1da945305b7e462ddc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.892882  2843 tablet_replica.cc:333] T 00000000000000000000000000000000 P 3126b3b07ecf4c1da945305b7e462ddc: stopping tablet replica
I20260709 13:17:17.920482  2843 master.cc:584] Master@127.2.198.254:33107 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (36006 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:17:18.018319  2843 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.198.254:34125
I20260709 13:17:18.020049  2843 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:18.026600 10007 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:18.027204 10010 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:18.027403 10008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:18.027976  2843 server_base.cc:1061] running on GCE node
I20260709 13:17:18.029209  2843 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:18.029441  2843 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:18.029672  2843 hybrid_clock.cc:648] HybridClock initialized: now 1783603038029653 us; error 0 us; skew 500 ppm
I20260709 13:17:18.030279  2843 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:18.032907  2843 webserver.cc:533] Webserver started at http://127.2.198.254:35103/ using document root <none> and password file <none>
I20260709 13:17:18.033463  2843 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:18.033699  2843 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:18.034010  2843 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:18.035352  2843 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602804652623-2843-0/minicluster-data/master-0-root/instance:
uuid: "6991d1a40a264a188db8acfc2dfe8e91"
format_stamp: "Formatted at 2026-07-09 13:17:18 on dist-test-slave-fc6v"
I20260709 13:17:18.040256  2843 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:17:18.044260 10015 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:18.044966  2843 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:17:18.045274  2843 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602804652623-2843-0/minicluster-data/master-0-root
uuid: "6991d1a40a264a188db8acfc2dfe8e91"
format_stamp: "Formatted at 2026-07-09 13:17:18 on dist-test-slave-fc6v"
I20260709 13:17:18.045568  2843 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602804652623-2843-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602804652623-2843-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602804652623-2843-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:18.060590  2843 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:18.062057  2843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:18.105075  2843 rpc_server.cc:307] RPC server started. Bound to: 127.2.198.254:34125
I20260709 13:17:18.105202 10066 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.198.254:34125 every 8 connection(s)
I20260709 13:17:18.109454 10067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.120774 10067 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6991d1a40a264a188db8acfc2dfe8e91: Bootstrap starting.
I20260709 13:17:18.126111 10067 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6991d1a40a264a188db8acfc2dfe8e91: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.130697 10067 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6991d1a40a264a188db8acfc2dfe8e91: No bootstrap required, opened a new log
I20260709 13:17:18.133117 10067 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6991d1a40a264a188db8acfc2dfe8e91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6991d1a40a264a188db8acfc2dfe8e91" member_type: VOTER }
I20260709 13:17:18.133564 10067 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6991d1a40a264a188db8acfc2dfe8e91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.133744 10067 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6991d1a40a264a188db8acfc2dfe8e91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6991d1a40a264a188db8acfc2dfe8e91, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.134384 10067 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6991d1a40a264a188db8acfc2dfe8e91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6991d1a40a264a188db8acfc2dfe8e91" member_type: VOTER }
I20260709 13:17:18.134819 10067 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6991d1a40a264a188db8acfc2dfe8e91 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:17:18.135010 10067 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6991d1a40a264a188db8acfc2dfe8e91 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:17:18.135239 10067 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6991d1a40a264a188db8acfc2dfe8e91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.140188 10067 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6991d1a40a264a188db8acfc2dfe8e91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6991d1a40a264a188db8acfc2dfe8e91" member_type: VOTER }
I20260709 13:17:18.140671 10067 leader_election.cc:304] T 00000000000000000000000000000000 P 6991d1a40a264a188db8acfc2dfe8e91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6991d1a40a264a188db8acfc2dfe8e91; no voters: 
I20260709 13:17:18.141969 10067 leader_election.cc:290] T 00000000000000000000000000000000 P 6991d1a40a264a188db8acfc2dfe8e91 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:17:18.142484 10070 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6991d1a40a264a188db8acfc2dfe8e91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:18.144049 10070 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6991d1a40a264a188db8acfc2dfe8e91 [term 1 LEADER]: Becoming Leader. State: Replica: 6991d1a40a264a188db8acfc2dfe8e91, State: Running, Role: LEADER
I20260709 13:17:18.144840 10070 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6991d1a40a264a188db8acfc2dfe8e91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6991d1a40a264a188db8acfc2dfe8e91" member_type: VOTER }
I20260709 13:17:18.145311 10067 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6991d1a40a264a188db8acfc2dfe8e91 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:17:18.150362 10072 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6991d1a40a264a188db8acfc2dfe8e91 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6991d1a40a264a188db8acfc2dfe8e91. Latest consensus state: current_term: 1 leader_uuid: "6991d1a40a264a188db8acfc2dfe8e91" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6991d1a40a264a188db8acfc2dfe8e91" member_type: VOTER } }
I20260709 13:17:18.151368 10072 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6991d1a40a264a188db8acfc2dfe8e91 [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:18.150545 10071 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6991d1a40a264a188db8acfc2dfe8e91 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6991d1a40a264a188db8acfc2dfe8e91" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6991d1a40a264a188db8acfc2dfe8e91" member_type: VOTER } }
I20260709 13:17:18.152132 10071 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6991d1a40a264a188db8acfc2dfe8e91 [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:18.153497 10077 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:17:18.159672 10077 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:17:18.162631  2843 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:17:18.169370 10077 catalog_manager.cc:1383] Generated new cluster ID: 71c44fc34f7743518fe17689759b208f
I20260709 13:17:18.169695 10077 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:17:18.190570 10077 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:17:18.191993 10077 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:17:18.217538 10077 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 6991d1a40a264a188db8acfc2dfe8e91: Generated new TSK 0
I20260709 13:17:18.218293 10077 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:17:18.229151  2843 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:18.236954 10088 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:18.238168 10089 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:18.239392 10091 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:18.240092  2843 server_base.cc:1061] running on GCE node
I20260709 13:17:18.241181  2843 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:18.241372  2843 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:18.241498  2843 hybrid_clock.cc:648] HybridClock initialized: now 1783603038241486 us; error 0 us; skew 500 ppm
I20260709 13:17:18.242002  2843 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:18.244621  2843 webserver.cc:533] Webserver started at http://127.2.198.193:44069/ using document root <none> and password file <none>
I20260709 13:17:18.245085  2843 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:18.245244  2843 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:18.245463  2843 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:18.246694  2843 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602804652623-2843-0/minicluster-data/ts-0-root/instance:
uuid: "9f4289676edb4b7c8fe897bafd84e935"
format_stamp: "Formatted at 2026-07-09 13:17:18 on dist-test-slave-fc6v"
I20260709 13:17:18.251453  2843 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:17:18.254917 10096 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:18.255849  2843 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:17:18.256150  2843 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602804652623-2843-0/minicluster-data/ts-0-root
uuid: "9f4289676edb4b7c8fe897bafd84e935"
format_stamp: "Formatted at 2026-07-09 13:17:18 on dist-test-slave-fc6v"
I20260709 13:17:18.256476  2843 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602804652623-2843-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602804652623-2843-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602804652623-2843-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:18.279304  2843 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:18.280769  2843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:18.282366  2843 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:18.285017  2843 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:18.285243  2843 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:18.285516  2843 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:18.285734  2843 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:18.332531  2843 rpc_server.cc:307] RPC server started. Bound to: 127.2.198.193:39957
I20260709 13:17:18.332639 10158 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.198.193:39957 every 8 connection(s)
I20260709 13:17:18.337767  2843 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:18.346411 10163 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:18.347030 10164 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:18.350668 10166 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:18.352066  2843 server_base.cc:1061] running on GCE node
I20260709 13:17:18.353628  2843 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:18.353929  2843 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:18.354147  2843 hybrid_clock.cc:648] HybridClock initialized: now 1783603038354128 us; error 0 us; skew 500 ppm
I20260709 13:17:18.354830  2843 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:18.355464 10159 heartbeater.cc:344] Connected to a master server at 127.2.198.254:34125
I20260709 13:17:18.355955 10159 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:18.356949 10159 heartbeater.cc:507] Master 127.2.198.254:34125 requested a full tablet report, sending...
I20260709 13:17:18.357755  2843 webserver.cc:533] Webserver started at http://127.2.198.194:40517/ using document root <none> and password file <none>
I20260709 13:17:18.358505  2843 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:18.358731  2843 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:18.359061  2843 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:18.359434 10032 ts_manager.cc:194] Registered new tserver with Master: 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957)
I20260709 13:17:18.360355  2843 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602804652623-2843-0/minicluster-data/ts-1-root/instance:
uuid: "e4c126e4957640968340e01461ba12b2"
format_stamp: "Formatted at 2026-07-09 13:17:18 on dist-test-slave-fc6v"
I20260709 13:17:18.361501 10032 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35430
I20260709 13:17:18.365640  2843 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:17:18.369503 10171 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:18.370282  2843 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:17:18.370595  2843 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602804652623-2843-0/minicluster-data/ts-1-root
uuid: "e4c126e4957640968340e01461ba12b2"
format_stamp: "Formatted at 2026-07-09 13:17:18 on dist-test-slave-fc6v"
I20260709 13:17:18.370906  2843 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602804652623-2843-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602804652623-2843-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602804652623-2843-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:18.395181  2843 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:18.396667  2843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:18.398275  2843 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:18.400684  2843 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:18.400916  2843 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:18.401166  2843 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:18.401353  2843 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:18.446549  2843 rpc_server.cc:307] RPC server started. Bound to: 127.2.198.194:39745
I20260709 13:17:18.446655 10233 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.198.194:39745 every 8 connection(s)
I20260709 13:17:18.452044  2843 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:18.459460 10237 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:18.462359 10238 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:18.462440  2843 server_base.cc:1061] running on GCE node
W20260709 13:17:18.463753 10240 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:18.464926  2843 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:18.465222  2843 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:18.465447  2843 hybrid_clock.cc:648] HybridClock initialized: now 1783603038465428 us; error 0 us; skew 500 ppm
I20260709 13:17:18.466171 10234 heartbeater.cc:344] Connected to a master server at 127.2.198.254:34125
I20260709 13:17:18.466212  2843 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:18.466784 10234 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:18.467795 10234 heartbeater.cc:507] Master 127.2.198.254:34125 requested a full tablet report, sending...
I20260709 13:17:18.469213  2843 webserver.cc:533] Webserver started at http://127.2.198.195:43293/ using document root <none> and password file <none>
I20260709 13:17:18.469877  2843 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:18.470090  2843 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:18.470191 10032 ts_manager.cc:194] Registered new tserver with Master: e4c126e4957640968340e01461ba12b2 (127.2.198.194:39745)
I20260709 13:17:18.470355  2843 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:18.471760  2843 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602804652623-2843-0/minicluster-data/ts-2-root/instance:
uuid: "1a0996f2672c4594ab704b98217a662e"
format_stamp: "Formatted at 2026-07-09 13:17:18 on dist-test-slave-fc6v"
I20260709 13:17:18.471849 10032 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35444
I20260709 13:17:18.476673  2843 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:17:18.480103 10245 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:18.480865  2843 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:17:18.481165  2843 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602804652623-2843-0/minicluster-data/ts-2-root
uuid: "1a0996f2672c4594ab704b98217a662e"
format_stamp: "Formatted at 2026-07-09 13:17:18 on dist-test-slave-fc6v"
I20260709 13:17:18.481509  2843 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602804652623-2843-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602804652623-2843-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602804652623-2843-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:18.497798  2843 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:18.499184  2843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:18.500787  2843 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:18.503149  2843 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:18.503393  2843 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:18.503664  2843 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:18.503859  2843 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:18.548699  2843 rpc_server.cc:307] RPC server started. Bound to: 127.2.198.195:45579
I20260709 13:17:18.548835 10307 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.198.195:45579 every 8 connection(s)
I20260709 13:17:18.564970 10308 heartbeater.cc:344] Connected to a master server at 127.2.198.254:34125
I20260709 13:17:18.565508 10308 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:18.566380 10308 heartbeater.cc:507] Master 127.2.198.254:34125 requested a full tablet report, sending...
I20260709 13:17:18.568744 10032 ts_manager.cc:194] Registered new tserver with Master: 1a0996f2672c4594ab704b98217a662e (127.2.198.195:45579)
I20260709 13:17:18.569813  2843 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017617056s
I20260709 13:17:18.570288 10032 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35458
I20260709 13:17:18.598114 10032 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35464:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:17:18.601382 10032 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:17:18.671092 10199 tablet_service.cc:1511] Processing CreateTablet for tablet 78042ece070249adabf7c5df20cb9980 (DEFAULT_TABLE table=test-workload [id=c2bb793938654d60ac03932c7bb4230c]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:17:18.671401 10198 tablet_service.cc:1511] Processing CreateTablet for tablet a410ccc6082d4335943afd658a181935 (DEFAULT_TABLE table=test-workload [id=c2bb793938654d60ac03932c7bb4230c]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:17:18.672857 10199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78042ece070249adabf7c5df20cb9980. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.674296 10197 tablet_service.cc:1511] Processing CreateTablet for tablet 632d0cca3448426a8b909ee924b0244f (DEFAULT_TABLE table=test-workload [id=c2bb793938654d60ac03932c7bb4230c]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:17:18.675024 10198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a410ccc6082d4335943afd658a181935. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.675835 10197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 632d0cca3448426a8b909ee924b0244f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.679319 10196 tablet_service.cc:1511] Processing CreateTablet for tablet b2a40086010b440599041cd4935e5d86 (DEFAULT_TABLE table=test-workload [id=c2bb793938654d60ac03932c7bb4230c]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:17:18.680790 10196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2a40086010b440599041cd4935e5d86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.684607 10195 tablet_service.cc:1511] Processing CreateTablet for tablet d6defd12940b429a875588ff72d9c61e (DEFAULT_TABLE table=test-workload [id=c2bb793938654d60ac03932c7bb4230c]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:17:18.686017 10195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6defd12940b429a875588ff72d9c61e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.700958 10322 tablet_bootstrap.cc:492] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2: Bootstrap starting.
I20260709 13:17:18.707806 10199 tablet_service.cc:1511] Processing CreateTablet for tablet 40054610eaa9497494285ea9ca8ec1e5 (DEFAULT_TABLE table=test-workload [id=c2bb793938654d60ac03932c7bb4230c]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:17:18.707844 10198 tablet_service.cc:1511] Processing CreateTablet for tablet 7abb4eef5abd4a268cbebb6cebd4a051 (DEFAULT_TABLE table=test-workload [id=c2bb793938654d60ac03932c7bb4230c]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:17:18.709561 10199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40054610eaa9497494285ea9ca8ec1e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.713706 10198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7abb4eef5abd4a268cbebb6cebd4a051. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.716024 10195 tablet_service.cc:1511] Processing CreateTablet for tablet 24b88255bc1b4bfc94b15c94efa36a25 (DEFAULT_TABLE table=test-workload [id=c2bb793938654d60ac03932c7bb4230c]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:17:18.720582 10194 tablet_service.cc:1511] Processing CreateTablet for tablet 9e1fdba60af24ecc84c528fb6813d3d7 (DEFAULT_TABLE table=test-workload [id=c2bb793938654d60ac03932c7bb4230c]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:17:18.722237 10194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e1fdba60af24ecc84c528fb6813d3d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.725014 10193 tablet_service.cc:1511] Processing CreateTablet for tablet 5dea73a90f704a799d186b62cabf9383 (DEFAULT_TABLE table=test-workload [id=c2bb793938654d60ac03932c7bb4230c]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:17:18.726468 10193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dea73a90f704a799d186b62cabf9383. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.732738 10124 tablet_service.cc:1511] Processing CreateTablet for tablet 78042ece070249adabf7c5df20cb9980 (DEFAULT_TABLE table=test-workload [id=c2bb793938654d60ac03932c7bb4230c]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:17:18.734324 10124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78042ece070249adabf7c5df20cb9980. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.738519 10195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24b88255bc1b4bfc94b15c94efa36a25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.741863 10322 tablet_bootstrap.cc:654] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.743285 10123 tablet_service.cc:1511] Processing CreateTablet for tablet a410ccc6082d4335943afd658a181935 (DEFAULT_TABLE table=test-workload [id=c2bb793938654d60ac03932c7bb4230c]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:17:18.745051 10123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a410ccc6082d4335943afd658a181935. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.756567 10122 tablet_service.cc:1511] Processing CreateTablet for tablet 632d0cca3448426a8b909ee924b0244f (DEFAULT_TABLE table=test-workload [id=c2bb793938654d60ac03932c7bb4230c]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:17:18.758188 10122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 632d0cca3448426a8b909ee924b0244f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.770953 10273 tablet_service.cc:1511] Processing CreateTablet for tablet 78042ece070249adabf7c5df20cb9980 (DEFAULT_TABLE table=test-workload [id=c2bb793938654d60ac03932c7bb4230c]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:17:18.771914 10121 tablet_service.cc:1511] Processing CreateTablet for tablet b2a40086010b440599041cd4935e5d86 (DEFAULT_TABLE table=test-workload [id=c2bb793938654d60ac03932c7bb4230c]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:17:18.772706 10273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78042ece070249adabf7c5df20cb9980. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.773481 10121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2a40086010b440599041cd4935e5d86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.774899 10322 tablet_bootstrap.cc:492] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2: No bootstrap required, opened a new log
I20260709 13:17:18.775471 10322 ts_tablet_manager.cc:1403] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2: Time spent bootstrapping tablet: real 0.075s	user 0.012s	sys 0.006s
I20260709 13:17:18.777835 10119 tablet_service.cc:1511] Processing CreateTablet for tablet 40054610eaa9497494285ea9ca8ec1e5 (DEFAULT_TABLE table=test-workload [id=c2bb793938654d60ac03932c7bb4230c]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:17:18.779057 10322 raft_consensus.cc:359] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:18.780069 10322 raft_consensus.cc:385] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.780405 10322 raft_consensus.cc:740] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c126e4957640968340e01461ba12b2, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.780686 10118 tablet_service.cc:1511] Processing CreateTablet for tablet 7abb4eef5abd4a268cbebb6cebd4a051 (DEFAULT_TABLE table=test-workload [id=c2bb793938654d60ac03932c7bb4230c]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:17:18.781186 10322 consensus_queue.cc:260] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:18.784795 10116 tablet_service.cc:1511] Processing CreateTablet for tablet 9e1fdba60af24ecc84c528fb6813d3d7 (DEFAULT_TABLE table=test-workload [id=c2bb793938654d60ac03932c7bb4230c]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:17:18.786038 10265 tablet_service.cc:1511] Processing CreateTablet for tablet 9e1fdba60af24ecc84c528fb6813d3d7 (DEFAULT_TABLE table=test-workload [id=c2bb793938654d60ac03932c7bb4230c]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:17:18.787469 10265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e1fdba60af24ecc84c528fb6813d3d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.787256 10115 tablet_service.cc:1511] Processing CreateTablet for tablet 5dea73a90f704a799d186b62cabf9383 (DEFAULT_TABLE table=test-workload [id=c2bb793938654d60ac03932c7bb4230c]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:17:18.789599 10272 tablet_service.cc:1511] Processing CreateTablet for tablet a410ccc6082d4335943afd658a181935 (DEFAULT_TABLE table=test-workload [id=c2bb793938654d60ac03932c7bb4230c]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:17:18.791054 10272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a410ccc6082d4335943afd658a181935. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.791258 10264 tablet_service.cc:1511] Processing CreateTablet for tablet 5dea73a90f704a799d186b62cabf9383 (DEFAULT_TABLE table=test-workload [id=c2bb793938654d60ac03932c7bb4230c]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:17:18.792645 10264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dea73a90f704a799d186b62cabf9383. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.792843 10271 tablet_service.cc:1511] Processing CreateTablet for tablet 632d0cca3448426a8b909ee924b0244f (DEFAULT_TABLE table=test-workload [id=c2bb793938654d60ac03932c7bb4230c]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:17:18.794189 10271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 632d0cca3448426a8b909ee924b0244f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.796808 10269 tablet_service.cc:1511] Processing CreateTablet for tablet d6defd12940b429a875588ff72d9c61e (DEFAULT_TABLE table=test-workload [id=c2bb793938654d60ac03932c7bb4230c]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:17:18.798178 10269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6defd12940b429a875588ff72d9c61e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.800766 10268 tablet_service.cc:1511] Processing CreateTablet for tablet 40054610eaa9497494285ea9ca8ec1e5 (DEFAULT_TABLE table=test-workload [id=c2bb793938654d60ac03932c7bb4230c]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:17:18.802076 10268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40054610eaa9497494285ea9ca8ec1e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.804843 10267 tablet_service.cc:1511] Processing CreateTablet for tablet 7abb4eef5abd4a268cbebb6cebd4a051 (DEFAULT_TABLE table=test-workload [id=c2bb793938654d60ac03932c7bb4230c]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:17:18.806247 10267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7abb4eef5abd4a268cbebb6cebd4a051. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.808792 10266 tablet_service.cc:1511] Processing CreateTablet for tablet 24b88255bc1b4bfc94b15c94efa36a25 (DEFAULT_TABLE table=test-workload [id=c2bb793938654d60ac03932c7bb4230c]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:17:18.810184 10266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24b88255bc1b4bfc94b15c94efa36a25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.775266 10120 tablet_service.cc:1511] Processing CreateTablet for tablet d6defd12940b429a875588ff72d9c61e (DEFAULT_TABLE table=test-workload [id=c2bb793938654d60ac03932c7bb4230c]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:17:18.783084 10117 tablet_service.cc:1511] Processing CreateTablet for tablet 24b88255bc1b4bfc94b15c94efa36a25 (DEFAULT_TABLE table=test-workload [id=c2bb793938654d60ac03932c7bb4230c]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:17:18.779423 10119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40054610eaa9497494285ea9ca8ec1e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.813964 10270 tablet_service.cc:1511] Processing CreateTablet for tablet b2a40086010b440599041cd4935e5d86 (DEFAULT_TABLE table=test-workload [id=c2bb793938654d60ac03932c7bb4230c]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:17:18.815479 10270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2a40086010b440599041cd4935e5d86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.815861 10117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24b88255bc1b4bfc94b15c94efa36a25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.824438 10116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e1fdba60af24ecc84c528fb6813d3d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.827529 10118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7abb4eef5abd4a268cbebb6cebd4a051. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.828339 10120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6defd12940b429a875588ff72d9c61e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.829321 10115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dea73a90f704a799d186b62cabf9383. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:18.843235 10322 ts_tablet_manager.cc:1434] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2: Time spent starting tablet: real 0.067s	user 0.016s	sys 0.029s
I20260709 13:17:18.844426 10234 heartbeater.cc:499] Master 127.2.198.254:34125 was elected leader, sending a full tablet report...
I20260709 13:17:18.844789 10322 tablet_bootstrap.cc:492] T a410ccc6082d4335943afd658a181935 P e4c126e4957640968340e01461ba12b2: Bootstrap starting.
I20260709 13:17:18.852629 10322 tablet_bootstrap.cc:654] T a410ccc6082d4335943afd658a181935 P e4c126e4957640968340e01461ba12b2: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.894640 10326 tablet_bootstrap.cc:492] T a410ccc6082d4335943afd658a181935 P 9f4289676edb4b7c8fe897bafd84e935: Bootstrap starting.
I20260709 13:17:18.911089 10326 tablet_bootstrap.cc:654] T a410ccc6082d4335943afd658a181935 P 9f4289676edb4b7c8fe897bafd84e935: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.928803 10325 tablet_bootstrap.cc:492] T 5dea73a90f704a799d186b62cabf9383 P 1a0996f2672c4594ab704b98217a662e: Bootstrap starting.
I20260709 13:17:18.945592 10322 tablet_bootstrap.cc:492] T a410ccc6082d4335943afd658a181935 P e4c126e4957640968340e01461ba12b2: No bootstrap required, opened a new log
I20260709 13:17:18.946336 10322 ts_tablet_manager.cc:1403] T a410ccc6082d4335943afd658a181935 P e4c126e4957640968340e01461ba12b2: Time spent bootstrapping tablet: real 0.102s	user 0.015s	sys 0.037s
I20260709 13:17:18.950130 10322 raft_consensus.cc:359] T a410ccc6082d4335943afd658a181935 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:18.950922 10322 raft_consensus.cc:385] T a410ccc6082d4335943afd658a181935 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:17:18.950996 10235 tablet.cc:2406] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:17:18.951292 10322 raft_consensus.cc:740] T a410ccc6082d4335943afd658a181935 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c126e4957640968340e01461ba12b2, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.952358 10322 consensus_queue.cc:260] T a410ccc6082d4335943afd658a181935 P e4c126e4957640968340e01461ba12b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:18.954556 10322 ts_tablet_manager.cc:1434] T a410ccc6082d4335943afd658a181935 P e4c126e4957640968340e01461ba12b2: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:17:18.955627 10322 tablet_bootstrap.cc:492] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2: Bootstrap starting.
I20260709 13:17:18.964125 10322 tablet_bootstrap.cc:654] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.970886 10326 tablet_bootstrap.cc:492] T a410ccc6082d4335943afd658a181935 P 9f4289676edb4b7c8fe897bafd84e935: No bootstrap required, opened a new log
I20260709 13:17:18.971500 10326 ts_tablet_manager.cc:1403] T a410ccc6082d4335943afd658a181935 P 9f4289676edb4b7c8fe897bafd84e935: Time spent bootstrapping tablet: real 0.077s	user 0.017s	sys 0.028s
I20260709 13:17:18.974025 10322 tablet_bootstrap.cc:492] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2: No bootstrap required, opened a new log
I20260709 13:17:18.974761 10322 ts_tablet_manager.cc:1403] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 13:17:18.974917 10326 raft_consensus.cc:359] T a410ccc6082d4335943afd658a181935 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:18.975786 10326 raft_consensus.cc:385] T a410ccc6082d4335943afd658a181935 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.976094 10326 raft_consensus.cc:740] T a410ccc6082d4335943afd658a181935 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f4289676edb4b7c8fe897bafd84e935, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.977002 10326 consensus_queue.cc:260] T a410ccc6082d4335943afd658a181935 P 9f4289676edb4b7c8fe897bafd84e935 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:18.978361 10322 raft_consensus.cc:359] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:18.979219 10322 raft_consensus.cc:385] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.979581 10322 raft_consensus.cc:740] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c126e4957640968340e01461ba12b2, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.980389 10322 consensus_queue.cc:260] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:18.982618 10322 ts_tablet_manager.cc:1434] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:17:18.978957 10325 tablet_bootstrap.cc:654] T 5dea73a90f704a799d186b62cabf9383 P 1a0996f2672c4594ab704b98217a662e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.984815 10322 tablet_bootstrap.cc:492] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2: Bootstrap starting.
I20260709 13:17:18.990237 10326 ts_tablet_manager.cc:1434] T a410ccc6082d4335943afd658a181935 P 9f4289676edb4b7c8fe897bafd84e935: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.007s
I20260709 13:17:18.991063 10159 heartbeater.cc:499] Master 127.2.198.254:34125 was elected leader, sending a full tablet report...
I20260709 13:17:18.993499 10322 tablet_bootstrap.cc:654] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.997066 10326 tablet_bootstrap.cc:492] T 78042ece070249adabf7c5df20cb9980 P 9f4289676edb4b7c8fe897bafd84e935: Bootstrap starting.
I20260709 13:17:19.005030 10326 tablet_bootstrap.cc:654] T 78042ece070249adabf7c5df20cb9980 P 9f4289676edb4b7c8fe897bafd84e935: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.014729 10325 tablet_bootstrap.cc:492] T 5dea73a90f704a799d186b62cabf9383 P 1a0996f2672c4594ab704b98217a662e: No bootstrap required, opened a new log
I20260709 13:17:19.015370 10325 ts_tablet_manager.cc:1403] T 5dea73a90f704a799d186b62cabf9383 P 1a0996f2672c4594ab704b98217a662e: Time spent bootstrapping tablet: real 0.087s	user 0.017s	sys 0.018s
I20260709 13:17:19.017554 10326 tablet_bootstrap.cc:492] T 78042ece070249adabf7c5df20cb9980 P 9f4289676edb4b7c8fe897bafd84e935: No bootstrap required, opened a new log
I20260709 13:17:19.018147 10326 ts_tablet_manager.cc:1403] T 78042ece070249adabf7c5df20cb9980 P 9f4289676edb4b7c8fe897bafd84e935: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 13:17:19.018616 10325 raft_consensus.cc:359] T 5dea73a90f704a799d186b62cabf9383 P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.019476 10325 raft_consensus.cc:385] T 5dea73a90f704a799d186b62cabf9383 P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.017614 10322 tablet_bootstrap.cc:492] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2: No bootstrap required, opened a new log
I20260709 13:17:19.019842 10325 raft_consensus.cc:740] T 5dea73a90f704a799d186b62cabf9383 P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a0996f2672c4594ab704b98217a662e, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.020150 10322 ts_tablet_manager.cc:1403] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.022s
I20260709 13:17:19.020758 10325 consensus_queue.cc:260] T 5dea73a90f704a799d186b62cabf9383 P 1a0996f2672c4594ab704b98217a662e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.021450 10326 raft_consensus.cc:359] T 78042ece070249adabf7c5df20cb9980 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.022302 10326 raft_consensus.cc:385] T 78042ece070249adabf7c5df20cb9980 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.022698 10326 raft_consensus.cc:740] T 78042ece070249adabf7c5df20cb9980 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f4289676edb4b7c8fe897bafd84e935, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.022857 10322 raft_consensus.cc:359] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.023582 10322 raft_consensus.cc:385] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.023916 10322 raft_consensus.cc:740] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c126e4957640968340e01461ba12b2, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.023754 10326 consensus_queue.cc:260] T 78042ece070249adabf7c5df20cb9980 P 9f4289676edb4b7c8fe897bafd84e935 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.024803 10322 consensus_queue.cc:260] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.027127 10322 ts_tablet_manager.cc:1434] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:17:19.028332 10322 tablet_bootstrap.cc:492] T 5dea73a90f704a799d186b62cabf9383 P e4c126e4957640968340e01461ba12b2: Bootstrap starting.
I20260709 13:17:19.029600 10308 heartbeater.cc:499] Master 127.2.198.254:34125 was elected leader, sending a full tablet report...
I20260709 13:17:19.031867 10325 ts_tablet_manager.cc:1434] T 5dea73a90f704a799d186b62cabf9383 P 1a0996f2672c4594ab704b98217a662e: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.003s
I20260709 13:17:19.034802 10325 tablet_bootstrap.cc:492] T d6defd12940b429a875588ff72d9c61e P 1a0996f2672c4594ab704b98217a662e: Bootstrap starting.
I20260709 13:17:19.035295 10322 tablet_bootstrap.cc:654] T 5dea73a90f704a799d186b62cabf9383 P e4c126e4957640968340e01461ba12b2: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.039764 10326 ts_tablet_manager.cc:1434] T 78042ece070249adabf7c5df20cb9980 P 9f4289676edb4b7c8fe897bafd84e935: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 13:17:19.040941 10326 tablet_bootstrap.cc:492] T 632d0cca3448426a8b909ee924b0244f P 9f4289676edb4b7c8fe897bafd84e935: Bootstrap starting.
I20260709 13:17:19.041770 10325 tablet_bootstrap.cc:654] T d6defd12940b429a875588ff72d9c61e P 1a0996f2672c4594ab704b98217a662e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.048358 10326 tablet_bootstrap.cc:654] T 632d0cca3448426a8b909ee924b0244f P 9f4289676edb4b7c8fe897bafd84e935: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.048915 10322 tablet_bootstrap.cc:492] T 5dea73a90f704a799d186b62cabf9383 P e4c126e4957640968340e01461ba12b2: No bootstrap required, opened a new log
I20260709 13:17:19.049505 10322 ts_tablet_manager.cc:1403] T 5dea73a90f704a799d186b62cabf9383 P e4c126e4957640968340e01461ba12b2: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.009s
I20260709 13:17:19.054432 10326 tablet_bootstrap.cc:492] T 632d0cca3448426a8b909ee924b0244f P 9f4289676edb4b7c8fe897bafd84e935: No bootstrap required, opened a new log
I20260709 13:17:19.054219 10322 raft_consensus.cc:359] T 5dea73a90f704a799d186b62cabf9383 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.055034 10326 ts_tablet_manager.cc:1403] T 632d0cca3448426a8b909ee924b0244f P 9f4289676edb4b7c8fe897bafd84e935: Time spent bootstrapping tablet: real 0.014s	user 0.005s	sys 0.006s
I20260709 13:17:19.055094 10322 raft_consensus.cc:385] T 5dea73a90f704a799d186b62cabf9383 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.055634 10322 raft_consensus.cc:740] T 5dea73a90f704a799d186b62cabf9383 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c126e4957640968340e01461ba12b2, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.057092 10325 tablet_bootstrap.cc:492] T d6defd12940b429a875588ff72d9c61e P 1a0996f2672c4594ab704b98217a662e: No bootstrap required, opened a new log
I20260709 13:17:19.056463 10322 consensus_queue.cc:260] T 5dea73a90f704a799d186b62cabf9383 P e4c126e4957640968340e01461ba12b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.057677 10325 ts_tablet_manager.cc:1403] T d6defd12940b429a875588ff72d9c61e P 1a0996f2672c4594ab704b98217a662e: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.000s
I20260709 13:17:19.058701 10326 raft_consensus.cc:359] T 632d0cca3448426a8b909ee924b0244f P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.059504 10322 ts_tablet_manager.cc:1434] T 5dea73a90f704a799d186b62cabf9383 P e4c126e4957640968340e01461ba12b2: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:17:19.059566 10326 raft_consensus.cc:385] T 632d0cca3448426a8b909ee924b0244f P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.060158 10326 raft_consensus.cc:740] T 632d0cca3448426a8b909ee924b0244f P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f4289676edb4b7c8fe897bafd84e935, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.060773 10322 tablet_bootstrap.cc:492] T 7abb4eef5abd4a268cbebb6cebd4a051 P e4c126e4957640968340e01461ba12b2: Bootstrap starting.
I20260709 13:17:19.060923 10326 consensus_queue.cc:260] T 632d0cca3448426a8b909ee924b0244f P 9f4289676edb4b7c8fe897bafd84e935 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.061237 10325 raft_consensus.cc:359] T d6defd12940b429a875588ff72d9c61e P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.062004 10325 raft_consensus.cc:385] T d6defd12940b429a875588ff72d9c61e P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.062309 10325 raft_consensus.cc:740] T d6defd12940b429a875588ff72d9c61e P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a0996f2672c4594ab704b98217a662e, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.063210 10326 ts_tablet_manager.cc:1434] T 632d0cca3448426a8b909ee924b0244f P 9f4289676edb4b7c8fe897bafd84e935: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:17:19.063061 10325 consensus_queue.cc:260] T d6defd12940b429a875588ff72d9c61e P 1a0996f2672c4594ab704b98217a662e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.064556 10326 tablet_bootstrap.cc:492] T 40054610eaa9497494285ea9ca8ec1e5 P 9f4289676edb4b7c8fe897bafd84e935: Bootstrap starting.
I20260709 13:17:19.065491 10325 ts_tablet_manager.cc:1434] T d6defd12940b429a875588ff72d9c61e P 1a0996f2672c4594ab704b98217a662e: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:17:19.066658 10325 tablet_bootstrap.cc:492] T a410ccc6082d4335943afd658a181935 P 1a0996f2672c4594ab704b98217a662e: Bootstrap starting.
I20260709 13:17:19.067382 10324 raft_consensus.cc:493] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.067966 10324 raft_consensus.cc:515] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.073267 10326 tablet_bootstrap.cc:654] T 40054610eaa9497494285ea9ca8ec1e5 P 9f4289676edb4b7c8fe897bafd84e935: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.073467 10325 tablet_bootstrap.cc:654] T a410ccc6082d4335943afd658a181935 P 1a0996f2672c4594ab704b98217a662e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.073625 10324 leader_election.cc:290] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957), 1a0996f2672c4594ab704b98217a662e (127.2.198.195:45579)
I20260709 13:17:19.081058 10322 tablet_bootstrap.cc:654] T 7abb4eef5abd4a268cbebb6cebd4a051 P e4c126e4957640968340e01461ba12b2: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.087035 10325 tablet_bootstrap.cc:492] T a410ccc6082d4335943afd658a181935 P 1a0996f2672c4594ab704b98217a662e: No bootstrap required, opened a new log
I20260709 13:17:19.087709 10325 ts_tablet_manager.cc:1403] T a410ccc6082d4335943afd658a181935 P 1a0996f2672c4594ab704b98217a662e: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.003s
I20260709 13:17:19.091461 10325 raft_consensus.cc:359] T a410ccc6082d4335943afd658a181935 P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.092322 10325 raft_consensus.cc:385] T a410ccc6082d4335943afd658a181935 P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.092640 10325 raft_consensus.cc:740] T a410ccc6082d4335943afd658a181935 P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a0996f2672c4594ab704b98217a662e, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.095175 10325 consensus_queue.cc:260] T a410ccc6082d4335943afd658a181935 P 1a0996f2672c4594ab704b98217a662e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.098163 10325 ts_tablet_manager.cc:1434] T a410ccc6082d4335943afd658a181935 P 1a0996f2672c4594ab704b98217a662e: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:17:19.099169 10325 tablet_bootstrap.cc:492] T 78042ece070249adabf7c5df20cb9980 P 1a0996f2672c4594ab704b98217a662e: Bootstrap starting.
I20260709 13:17:19.105396 10134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78042ece070249adabf7c5df20cb9980" candidate_uuid: "e4c126e4957640968340e01461ba12b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f4289676edb4b7c8fe897bafd84e935" is_pre_election: true
I20260709 13:17:19.106280 10134 raft_consensus.cc:2468] T 78042ece070249adabf7c5df20cb9980 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c126e4957640968340e01461ba12b2 in term 0.
I20260709 13:17:19.107755 10172 leader_election.cc:304] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f4289676edb4b7c8fe897bafd84e935, e4c126e4957640968340e01461ba12b2; no voters: 
I20260709 13:17:19.108577 10324 raft_consensus.cc:2804] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:19.108969 10324 raft_consensus.cc:493] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.109289 10324 raft_consensus.cc:3060] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.116442 10325 tablet_bootstrap.cc:654] T 78042ece070249adabf7c5df20cb9980 P 1a0996f2672c4594ab704b98217a662e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.117046 10283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78042ece070249adabf7c5df20cb9980" candidate_uuid: "e4c126e4957640968340e01461ba12b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a0996f2672c4594ab704b98217a662e" is_pre_election: true
W20260709 13:17:19.118633 10172 leader_election.cc:343] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a0996f2672c4594ab704b98217a662e (127.2.198.195:45579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.120399 10324 raft_consensus.cc:515] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.123458 10324 leader_election.cc:290] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2 [CANDIDATE]: Term 1 election: Requested vote from peers 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957), 1a0996f2672c4594ab704b98217a662e (127.2.198.195:45579)
I20260709 13:17:19.124457 10134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78042ece070249adabf7c5df20cb9980" candidate_uuid: "e4c126e4957640968340e01461ba12b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f4289676edb4b7c8fe897bafd84e935"
I20260709 13:17:19.125347 10134 raft_consensus.cc:3060] T 78042ece070249adabf7c5df20cb9980 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.125501 10283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78042ece070249adabf7c5df20cb9980" candidate_uuid: "e4c126e4957640968340e01461ba12b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a0996f2672c4594ab704b98217a662e"
W20260709 13:17:19.127153 10172 leader_election.cc:343] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1a0996f2672c4594ab704b98217a662e (127.2.198.195:45579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.128695 10325 tablet_bootstrap.cc:492] T 78042ece070249adabf7c5df20cb9980 P 1a0996f2672c4594ab704b98217a662e: No bootstrap required, opened a new log
I20260709 13:17:19.129300 10325 ts_tablet_manager.cc:1403] T 78042ece070249adabf7c5df20cb9980 P 1a0996f2672c4594ab704b98217a662e: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.007s
I20260709 13:17:19.132624 10325 raft_consensus.cc:359] T 78042ece070249adabf7c5df20cb9980 P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.134167 10134 raft_consensus.cc:2468] T 78042ece070249adabf7c5df20cb9980 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c126e4957640968340e01461ba12b2 in term 1.
I20260709 13:17:19.133363 10325 raft_consensus.cc:385] T 78042ece070249adabf7c5df20cb9980 P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.135763 10322 tablet_bootstrap.cc:492] T 7abb4eef5abd4a268cbebb6cebd4a051 P e4c126e4957640968340e01461ba12b2: No bootstrap required, opened a new log
I20260709 13:17:19.135643 10172 leader_election.cc:304] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f4289676edb4b7c8fe897bafd84e935, e4c126e4957640968340e01461ba12b2; no voters: 1a0996f2672c4594ab704b98217a662e
I20260709 13:17:19.135643 10325 raft_consensus.cc:740] T 78042ece070249adabf7c5df20cb9980 P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a0996f2672c4594ab704b98217a662e, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.136468 10322 ts_tablet_manager.cc:1403] T 7abb4eef5abd4a268cbebb6cebd4a051 P e4c126e4957640968340e01461ba12b2: Time spent bootstrapping tablet: real 0.076s	user 0.013s	sys 0.001s
I20260709 13:17:19.136932 10326 tablet_bootstrap.cc:492] T 40054610eaa9497494285ea9ca8ec1e5 P 9f4289676edb4b7c8fe897bafd84e935: No bootstrap required, opened a new log
I20260709 13:17:19.137002 10324 raft_consensus.cc:2804] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:19.137727 10326 ts_tablet_manager.cc:1403] T 40054610eaa9497494285ea9ca8ec1e5 P 9f4289676edb4b7c8fe897bafd84e935: Time spent bootstrapping tablet: real 0.073s	user 0.018s	sys 0.048s
I20260709 13:17:19.137279 10325 consensus_queue.cc:260] T 78042ece070249adabf7c5df20cb9980 P 1a0996f2672c4594ab704b98217a662e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.140168 10325 ts_tablet_manager.cc:1434] T 78042ece070249adabf7c5df20cb9980 P 1a0996f2672c4594ab704b98217a662e: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:17:19.140939 10324 raft_consensus.cc:697] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2 [term 1 LEADER]: Becoming Leader. State: Replica: e4c126e4957640968340e01461ba12b2, State: Running, Role: LEADER
I20260709 13:17:19.141094 10326 raft_consensus.cc:359] T 40054610eaa9497494285ea9ca8ec1e5 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.141911 10326 raft_consensus.cc:385] T 40054610eaa9497494285ea9ca8ec1e5 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.142273 10326 raft_consensus.cc:740] T 40054610eaa9497494285ea9ca8ec1e5 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f4289676edb4b7c8fe897bafd84e935, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.141989 10324 consensus_queue.cc:237] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.143206 10326 consensus_queue.cc:260] T 40054610eaa9497494285ea9ca8ec1e5 P 9f4289676edb4b7c8fe897bafd84e935 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.144537 10325 tablet_bootstrap.cc:492] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e: Bootstrap starting.
I20260709 13:17:19.149150 10326 ts_tablet_manager.cc:1434] T 40054610eaa9497494285ea9ca8ec1e5 P 9f4289676edb4b7c8fe897bafd84e935: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:17:19.150475 10326 tablet_bootstrap.cc:492] T d6defd12940b429a875588ff72d9c61e P 9f4289676edb4b7c8fe897bafd84e935: Bootstrap starting.
I20260709 13:17:19.152884 10325 tablet_bootstrap.cc:654] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.160321 10326 tablet_bootstrap.cc:654] T d6defd12940b429a875588ff72d9c61e P 9f4289676edb4b7c8fe897bafd84e935: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.162917 10032 catalog_manager.cc:5697] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4c126e4957640968340e01461ba12b2 (127.2.198.194). New cstate: current_term: 1 leader_uuid: "e4c126e4957640968340e01461ba12b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:19.164538 10080 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:19.170207 10322 raft_consensus.cc:359] T 7abb4eef5abd4a268cbebb6cebd4a051 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.171196 10322 raft_consensus.cc:385] T 7abb4eef5abd4a268cbebb6cebd4a051 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.171519 10322 raft_consensus.cc:740] T 7abb4eef5abd4a268cbebb6cebd4a051 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c126e4957640968340e01461ba12b2, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.172363 10322 consensus_queue.cc:260] T 7abb4eef5abd4a268cbebb6cebd4a051 P e4c126e4957640968340e01461ba12b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.175824 10322 ts_tablet_manager.cc:1434] T 7abb4eef5abd4a268cbebb6cebd4a051 P e4c126e4957640968340e01461ba12b2: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.002s
I20260709 13:17:19.176625 10330 raft_consensus.cc:493] T 40054610eaa9497494285ea9ca8ec1e5 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.177248 10322 tablet_bootstrap.cc:492] T b2a40086010b440599041cd4935e5d86 P e4c126e4957640968340e01461ba12b2: Bootstrap starting.
I20260709 13:17:19.177415 10330 raft_consensus.cc:515] T 40054610eaa9497494285ea9ca8ec1e5 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.193213 10334 raft_consensus.cc:493] T a410ccc6082d4335943afd658a181935 P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.196070 10334 raft_consensus.cc:515] T a410ccc6082d4335943afd658a181935 P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.197052 10326 tablet_bootstrap.cc:492] T d6defd12940b429a875588ff72d9c61e P 9f4289676edb4b7c8fe897bafd84e935: No bootstrap required, opened a new log
I20260709 13:17:19.197712 10326 ts_tablet_manager.cc:1403] T d6defd12940b429a875588ff72d9c61e P 9f4289676edb4b7c8fe897bafd84e935: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.016s
I20260709 13:17:19.199507 10322 tablet_bootstrap.cc:654] T b2a40086010b440599041cd4935e5d86 P e4c126e4957640968340e01461ba12b2: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.201330 10326 raft_consensus.cc:359] T d6defd12940b429a875588ff72d9c61e P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.195715 10330 leader_election.cc:290] T 40054610eaa9497494285ea9ca8ec1e5 P 9f4289676edb4b7c8fe897bafd84e935 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c126e4957640968340e01461ba12b2 (127.2.198.194:39745), 1a0996f2672c4594ab704b98217a662e (127.2.198.195:45579)
I20260709 13:17:19.202203 10326 raft_consensus.cc:385] T d6defd12940b429a875588ff72d9c61e P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.206485 10326 raft_consensus.cc:740] T d6defd12940b429a875588ff72d9c61e P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f4289676edb4b7c8fe897bafd84e935, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.206048 10330 raft_consensus.cc:493] T a410ccc6082d4335943afd658a181935 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.207969 10326 consensus_queue.cc:260] T d6defd12940b429a875588ff72d9c61e P 9f4289676edb4b7c8fe897bafd84e935 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.208864 10330 raft_consensus.cc:515] T a410ccc6082d4335943afd658a181935 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.209882 10325 tablet_bootstrap.cc:492] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e: No bootstrap required, opened a new log
I20260709 13:17:19.203235 10334 leader_election.cc:290] T a410ccc6082d4335943afd658a181935 P 1a0996f2672c4594ab704b98217a662e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957), e4c126e4957640968340e01461ba12b2 (127.2.198.194:39745)
I20260709 13:17:19.214156 10324 raft_consensus.cc:493] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.215317 10325 ts_tablet_manager.cc:1403] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e: Time spent bootstrapping tablet: real 0.071s	user 0.020s	sys 0.029s
I20260709 13:17:19.214874 10324 raft_consensus.cc:515] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.217175 10326 ts_tablet_manager.cc:1434] T d6defd12940b429a875588ff72d9c61e P 9f4289676edb4b7c8fe897bafd84e935: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.003s
I20260709 13:17:19.217275 10324 leader_election.cc:290] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957), 1a0996f2672c4594ab704b98217a662e (127.2.198.195:45579)
I20260709 13:17:19.218883 10326 tablet_bootstrap.cc:492] T 24b88255bc1b4bfc94b15c94efa36a25 P 9f4289676edb4b7c8fe897bafd84e935: Bootstrap starting.
I20260709 13:17:19.219524 10283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6defd12940b429a875588ff72d9c61e" candidate_uuid: "e4c126e4957640968340e01461ba12b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a0996f2672c4594ab704b98217a662e" is_pre_election: true
I20260709 13:17:19.220559 10283 raft_consensus.cc:2468] T d6defd12940b429a875588ff72d9c61e P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c126e4957640968340e01461ba12b2 in term 0.
I20260709 13:17:19.219609 10134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6defd12940b429a875588ff72d9c61e" candidate_uuid: "e4c126e4957640968340e01461ba12b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f4289676edb4b7c8fe897bafd84e935" is_pre_election: true
I20260709 13:17:19.226527 10134 raft_consensus.cc:2468] T d6defd12940b429a875588ff72d9c61e P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c126e4957640968340e01461ba12b2 in term 0.
I20260709 13:17:19.218641 10330 leader_election.cc:290] T a410ccc6082d4335943afd658a181935 P 9f4289676edb4b7c8fe897bafd84e935 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c126e4957640968340e01461ba12b2 (127.2.198.194:39745), 1a0996f2672c4594ab704b98217a662e (127.2.198.195:45579)
I20260709 13:17:19.230796 10172 leader_election.cc:304] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a0996f2672c4594ab704b98217a662e, e4c126e4957640968340e01461ba12b2; no voters: 
I20260709 13:17:19.233340 10324 raft_consensus.cc:2804] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:19.233749 10324 raft_consensus.cc:493] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.233989 10324 raft_consensus.cc:3060] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.241003 10326 tablet_bootstrap.cc:654] T 24b88255bc1b4bfc94b15c94efa36a25 P 9f4289676edb4b7c8fe897bafd84e935: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.229315 10325 raft_consensus.cc:359] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.239841 10324 raft_consensus.cc:515] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.242285 10325 raft_consensus.cc:385] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.242707 10325 raft_consensus.cc:740] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a0996f2672c4594ab704b98217a662e, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.243763 10325 consensus_queue.cc:260] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.246956 10325 ts_tablet_manager.cc:1434] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.003s
I20260709 13:17:19.253981 10322 tablet_bootstrap.cc:492] T b2a40086010b440599041cd4935e5d86 P e4c126e4957640968340e01461ba12b2: No bootstrap required, opened a new log
I20260709 13:17:19.254900 10322 ts_tablet_manager.cc:1403] T b2a40086010b440599041cd4935e5d86 P e4c126e4957640968340e01461ba12b2: Time spent bootstrapping tablet: real 0.078s	user 0.013s	sys 0.004s
I20260709 13:17:19.263154 10134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a410ccc6082d4335943afd658a181935" candidate_uuid: "1a0996f2672c4594ab704b98217a662e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f4289676edb4b7c8fe897bafd84e935" is_pre_election: true
I20260709 13:17:19.264109 10134 raft_consensus.cc:2468] T a410ccc6082d4335943afd658a181935 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a0996f2672c4594ab704b98217a662e in term 0.
I20260709 13:17:19.265556 10246 leader_election.cc:304] T a410ccc6082d4335943afd658a181935 P 1a0996f2672c4594ab704b98217a662e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a0996f2672c4594ab704b98217a662e, 9f4289676edb4b7c8fe897bafd84e935; no voters: 
I20260709 13:17:19.266499 10334 raft_consensus.cc:2804] T a410ccc6082d4335943afd658a181935 P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:19.267024 10334 raft_consensus.cc:493] T a410ccc6082d4335943afd658a181935 P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.267438 10334 raft_consensus.cc:3060] T a410ccc6082d4335943afd658a181935 P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.269220 10324 leader_election.cc:290] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 [CANDIDATE]: Term 1 election: Requested vote from peers 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957), 1a0996f2672c4594ab704b98217a662e (127.2.198.195:45579)
I20260709 13:17:19.270308 10325 tablet_bootstrap.cc:492] T 632d0cca3448426a8b909ee924b0244f P 1a0996f2672c4594ab704b98217a662e: Bootstrap starting.
I20260709 13:17:19.270922 10283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6defd12940b429a875588ff72d9c61e" candidate_uuid: "e4c126e4957640968340e01461ba12b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a0996f2672c4594ab704b98217a662e"
I20260709 13:17:19.271670 10283 raft_consensus.cc:3060] T d6defd12940b429a875588ff72d9c61e P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.275708 10134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6defd12940b429a875588ff72d9c61e" candidate_uuid: "e4c126e4957640968340e01461ba12b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f4289676edb4b7c8fe897bafd84e935"
I20260709 13:17:19.276469 10134 raft_consensus.cc:3060] T d6defd12940b429a875588ff72d9c61e P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.279142 10325 tablet_bootstrap.cc:654] T 632d0cca3448426a8b909ee924b0244f P 1a0996f2672c4594ab704b98217a662e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.287997 10134 raft_consensus.cc:2468] T d6defd12940b429a875588ff72d9c61e P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c126e4957640968340e01461ba12b2 in term 1.
I20260709 13:17:19.289578 10172 leader_election.cc:304] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f4289676edb4b7c8fe897bafd84e935, e4c126e4957640968340e01461ba12b2; no voters: 
I20260709 13:17:19.290660 10324 raft_consensus.cc:2804] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:19.291240 10324 raft_consensus.cc:697] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 [term 1 LEADER]: Becoming Leader. State: Replica: e4c126e4957640968340e01461ba12b2, State: Running, Role: LEADER
I20260709 13:17:19.292268 10324 consensus_queue.cc:237] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.294202 10283 raft_consensus.cc:2468] T d6defd12940b429a875588ff72d9c61e P 1a0996f2672c4594ab704b98217a662e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c126e4957640968340e01461ba12b2 in term 1.
I20260709 13:17:19.297968 10282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a410ccc6082d4335943afd658a181935" candidate_uuid: "9f4289676edb4b7c8fe897bafd84e935" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a0996f2672c4594ab704b98217a662e" is_pre_election: true
I20260709 13:17:19.298152 10322 raft_consensus.cc:359] T b2a40086010b440599041cd4935e5d86 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.299437 10322 raft_consensus.cc:385] T b2a40086010b440599041cd4935e5d86 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.303310 10322 raft_consensus.cc:740] T b2a40086010b440599041cd4935e5d86 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c126e4957640968340e01461ba12b2, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.304275 10322 consensus_queue.cc:260] T b2a40086010b440599041cd4935e5d86 P e4c126e4957640968340e01461ba12b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.305056 10334 raft_consensus.cc:515] T a410ccc6082d4335943afd658a181935 P 1a0996f2672c4594ab704b98217a662e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.306330 10282 raft_consensus.cc:2393] T a410ccc6082d4335943afd658a181935 P 1a0996f2672c4594ab704b98217a662e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f4289676edb4b7c8fe897bafd84e935 in current term 1: Already voted for candidate 1a0996f2672c4594ab704b98217a662e in this term.
I20260709 13:17:19.307487 10344 raft_consensus.cc:493] T b2a40086010b440599041cd4935e5d86 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.308146 10344 raft_consensus.cc:515] T b2a40086010b440599041cd4935e5d86 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.309465 10209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40054610eaa9497494285ea9ca8ec1e5" candidate_uuid: "9f4289676edb4b7c8fe897bafd84e935" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c126e4957640968340e01461ba12b2" is_pre_election: true
I20260709 13:17:19.310781 10344 leader_election.cc:290] T b2a40086010b440599041cd4935e5d86 P e4c126e4957640968340e01461ba12b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957), 1a0996f2672c4594ab704b98217a662e (127.2.198.195:45579)
I20260709 13:17:19.307530 10322 ts_tablet_manager.cc:1434] T b2a40086010b440599041cd4935e5d86 P e4c126e4957640968340e01461ba12b2: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.001s
W20260709 13:17:19.312425 10099 leader_election.cc:343] T 40054610eaa9497494285ea9ca8ec1e5 P 9f4289676edb4b7c8fe897bafd84e935 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4c126e4957640968340e01461ba12b2 (127.2.198.194:39745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.312744 10322 tablet_bootstrap.cc:492] T 9e1fdba60af24ecc84c528fb6813d3d7 P e4c126e4957640968340e01461ba12b2: Bootstrap starting.
I20260709 13:17:19.312466 10209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a410ccc6082d4335943afd658a181935" candidate_uuid: "1a0996f2672c4594ab704b98217a662e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c126e4957640968340e01461ba12b2" is_pre_election: true
I20260709 13:17:19.313503 10282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2a40086010b440599041cd4935e5d86" candidate_uuid: "e4c126e4957640968340e01461ba12b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a0996f2672c4594ab704b98217a662e" is_pre_election: true
I20260709 13:17:19.313915 10209 raft_consensus.cc:2468] T a410ccc6082d4335943afd658a181935 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a0996f2672c4594ab704b98217a662e in term 0.
I20260709 13:17:19.302474 10362 raft_consensus.cc:493] T 5dea73a90f704a799d186b62cabf9383 P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.311157 10208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a410ccc6082d4335943afd658a181935" candidate_uuid: "9f4289676edb4b7c8fe897bafd84e935" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c126e4957640968340e01461ba12b2" is_pre_election: true
I20260709 13:17:19.312610 10283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40054610eaa9497494285ea9ca8ec1e5" candidate_uuid: "9f4289676edb4b7c8fe897bafd84e935" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a0996f2672c4594ab704b98217a662e" is_pre_election: true
I20260709 13:17:19.315369 10208 raft_consensus.cc:2468] T a410ccc6082d4335943afd658a181935 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f4289676edb4b7c8fe897bafd84e935 in term 0.
W20260709 13:17:19.316260 10172 leader_election.cc:343] T b2a40086010b440599041cd4935e5d86 P e4c126e4957640968340e01461ba12b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a0996f2672c4594ab704b98217a662e (127.2.198.195:45579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.316896 10099 leader_election.cc:304] T a410ccc6082d4335943afd658a181935 P 9f4289676edb4b7c8fe897bafd84e935 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f4289676edb4b7c8fe897bafd84e935, e4c126e4957640968340e01461ba12b2; no voters: 1a0996f2672c4594ab704b98217a662e
W20260709 13:17:19.317570 10097 leader_election.cc:343] T 40054610eaa9497494285ea9ca8ec1e5 P 9f4289676edb4b7c8fe897bafd84e935 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a0996f2672c4594ab704b98217a662e (127.2.198.195:45579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.318181 10097 leader_election.cc:304] T 40054610eaa9497494285ea9ca8ec1e5 P 9f4289676edb4b7c8fe897bafd84e935 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f4289676edb4b7c8fe897bafd84e935; no voters: 1a0996f2672c4594ab704b98217a662e, e4c126e4957640968340e01461ba12b2
I20260709 13:17:19.318442 10330 raft_consensus.cc:2804] T a410ccc6082d4335943afd658a181935 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:19.318949 10330 raft_consensus.cc:493] T a410ccc6082d4335943afd658a181935 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.302984 10326 tablet_bootstrap.cc:492] T 24b88255bc1b4bfc94b15c94efa36a25 P 9f4289676edb4b7c8fe897bafd84e935: No bootstrap required, opened a new log
I20260709 13:17:19.319335 10330 raft_consensus.cc:3060] T a410ccc6082d4335943afd658a181935 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.319741 10326 ts_tablet_manager.cc:1403] T 24b88255bc1b4bfc94b15c94efa36a25 P 9f4289676edb4b7c8fe897bafd84e935: Time spent bootstrapping tablet: real 0.101s	user 0.041s	sys 0.022s
I20260709 13:17:19.319669 10352 raft_consensus.cc:2749] T 40054610eaa9497494285ea9ca8ec1e5 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:19.323769 10326 raft_consensus.cc:359] T 24b88255bc1b4bfc94b15c94efa36a25 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.324615 10326 raft_consensus.cc:385] T 24b88255bc1b4bfc94b15c94efa36a25 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.324970 10326 raft_consensus.cc:740] T 24b88255bc1b4bfc94b15c94efa36a25 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f4289676edb4b7c8fe897bafd84e935, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.325866 10326 consensus_queue.cc:260] T 24b88255bc1b4bfc94b15c94efa36a25 P 9f4289676edb4b7c8fe897bafd84e935 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.327342 10133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a410ccc6082d4335943afd658a181935" candidate_uuid: "1a0996f2672c4594ab704b98217a662e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f4289676edb4b7c8fe897bafd84e935"
I20260709 13:17:19.328619 10326 ts_tablet_manager.cc:1434] T 24b88255bc1b4bfc94b15c94efa36a25 P 9f4289676edb4b7c8fe897bafd84e935: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:17:19.328207 10030 catalog_manager.cc:5697] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4c126e4957640968340e01461ba12b2 (127.2.198.194). New cstate: current_term: 1 leader_uuid: "e4c126e4957640968340e01461ba12b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:19.328708 10330 raft_consensus.cc:515] T a410ccc6082d4335943afd658a181935 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.330257 10133 raft_consensus.cc:2393] T a410ccc6082d4335943afd658a181935 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a0996f2672c4594ab704b98217a662e in current term 1: Already voted for candidate 9f4289676edb4b7c8fe897bafd84e935 in this term.
I20260709 13:17:19.330965 10208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a410ccc6082d4335943afd658a181935" candidate_uuid: "1a0996f2672c4594ab704b98217a662e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c126e4957640968340e01461ba12b2"
I20260709 13:17:19.331619 10208 raft_consensus.cc:3060] T a410ccc6082d4335943afd658a181935 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.332671 10326 tablet_bootstrap.cc:492] T b2a40086010b440599041cd4935e5d86 P 9f4289676edb4b7c8fe897bafd84e935: Bootstrap starting.
I20260709 13:17:19.333966 10209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a410ccc6082d4335943afd658a181935" candidate_uuid: "9f4289676edb4b7c8fe897bafd84e935" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c126e4957640968340e01461ba12b2"
I20260709 13:17:19.336088 10362 raft_consensus.cc:515] T 5dea73a90f704a799d186b62cabf9383 P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.338946 10362 leader_election.cc:290] T 5dea73a90f704a799d186b62cabf9383 P 1a0996f2672c4594ab704b98217a662e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957), e4c126e4957640968340e01461ba12b2 (127.2.198.194:39745)
I20260709 13:17:19.341006 10326 tablet_bootstrap.cc:654] T b2a40086010b440599041cd4935e5d86 P 9f4289676edb4b7c8fe897bafd84e935: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.342978 10352 raft_consensus.cc:493] T 632d0cca3448426a8b909ee924b0244f P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.343933 10322 tablet_bootstrap.cc:654] T 9e1fdba60af24ecc84c528fb6813d3d7 P e4c126e4957640968340e01461ba12b2: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.343614 10352 raft_consensus.cc:515] T 632d0cca3448426a8b909ee924b0244f P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.344470 10324 raft_consensus.cc:493] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.345013 10324 raft_consensus.cc:515] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.347415 10324 leader_election.cc:290] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957), 1a0996f2672c4594ab704b98217a662e (127.2.198.195:45579)
I20260709 13:17:19.347944 10352 leader_election.cc:290] T 632d0cca3448426a8b909ee924b0244f P 9f4289676edb4b7c8fe897bafd84e935 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c126e4957640968340e01461ba12b2 (127.2.198.194:39745), 1a0996f2672c4594ab704b98217a662e (127.2.198.195:45579)
I20260709 13:17:19.349984 10283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632d0cca3448426a8b909ee924b0244f" candidate_uuid: "9f4289676edb4b7c8fe897bafd84e935" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a0996f2672c4594ab704b98217a662e" is_pre_election: true
I20260709 13:17:19.349787 10209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632d0cca3448426a8b909ee924b0244f" candidate_uuid: "9f4289676edb4b7c8fe897bafd84e935" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c126e4957640968340e01461ba12b2" is_pre_election: true
W20260709 13:17:19.351447 10097 leader_election.cc:343] T 632d0cca3448426a8b909ee924b0244f P 9f4289676edb4b7c8fe897bafd84e935 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a0996f2672c4594ab704b98217a662e (127.2.198.195:45579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.353479 10209 raft_consensus.cc:2468] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f4289676edb4b7c8fe897bafd84e935 in term 0.
I20260709 13:17:19.353700 10133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dea73a90f704a799d186b62cabf9383" candidate_uuid: "1a0996f2672c4594ab704b98217a662e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f4289676edb4b7c8fe897bafd84e935" is_pre_election: true
I20260709 13:17:19.355741 10283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a410ccc6082d4335943afd658a181935" candidate_uuid: "9f4289676edb4b7c8fe897bafd84e935" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a0996f2672c4594ab704b98217a662e"
W20260709 13:17:19.355870 10246 leader_election.cc:343] T 5dea73a90f704a799d186b62cabf9383 P 1a0996f2672c4594ab704b98217a662e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.356546 10283 raft_consensus.cc:2393] T a410ccc6082d4335943afd658a181935 P 1a0996f2672c4594ab704b98217a662e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f4289676edb4b7c8fe897bafd84e935 in current term 1: Already voted for candidate 1a0996f2672c4594ab704b98217a662e in this term.
I20260709 13:17:19.358152 10099 leader_election.cc:304] T 632d0cca3448426a8b909ee924b0244f P 9f4289676edb4b7c8fe897bafd84e935 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f4289676edb4b7c8fe897bafd84e935, e4c126e4957640968340e01461ba12b2; no voters: 1a0996f2672c4594ab704b98217a662e
I20260709 13:17:19.360021 10133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632d0cca3448426a8b909ee924b0244f" candidate_uuid: "e4c126e4957640968340e01461ba12b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f4289676edb4b7c8fe897bafd84e935" is_pre_election: true
I20260709 13:17:19.360682 10133 raft_consensus.cc:2468] T 632d0cca3448426a8b909ee924b0244f P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c126e4957640968340e01461ba12b2 in term 0.
I20260709 13:17:19.360412 10097 leader_election.cc:304] T a410ccc6082d4335943afd658a181935 P 9f4289676edb4b7c8fe897bafd84e935 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f4289676edb4b7c8fe897bafd84e935; no voters: 1a0996f2672c4594ab704b98217a662e, e4c126e4957640968340e01461ba12b2
I20260709 13:17:19.324775 10134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2a40086010b440599041cd4935e5d86" candidate_uuid: "e4c126e4957640968340e01461ba12b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f4289676edb4b7c8fe897bafd84e935" is_pre_election: true
I20260709 13:17:19.357607 10330 leader_election.cc:290] T a410ccc6082d4335943afd658a181935 P 9f4289676edb4b7c8fe897bafd84e935 [CANDIDATE]: Term 1 election: Requested vote from peers e4c126e4957640968340e01461ba12b2 (127.2.198.194:39745), 1a0996f2672c4594ab704b98217a662e (127.2.198.195:45579)
I20260709 13:17:19.362028 10172 leader_election.cc:304] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f4289676edb4b7c8fe897bafd84e935, e4c126e4957640968340e01461ba12b2; no voters: 
I20260709 13:17:19.363919 10283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632d0cca3448426a8b909ee924b0244f" candidate_uuid: "e4c126e4957640968340e01461ba12b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a0996f2672c4594ab704b98217a662e" is_pre_election: true
I20260709 13:17:19.364271 10330 raft_consensus.cc:2749] T a410ccc6082d4335943afd658a181935 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:17:19.364576 10324 raft_consensus.cc:2804] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:19.365067 10324 raft_consensus.cc:493] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.362776 10352 raft_consensus.cc:2804] T 632d0cca3448426a8b909ee924b0244f P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:19.365474 10324 raft_consensus.cc:3060] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.367965 10352 raft_consensus.cc:493] T 632d0cca3448426a8b909ee924b0244f P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.352774 10334 leader_election.cc:290] T a410ccc6082d4335943afd658a181935 P 1a0996f2672c4594ab704b98217a662e [CANDIDATE]: Term 1 election: Requested vote from peers 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957), e4c126e4957640968340e01461ba12b2 (127.2.198.194:39745)
I20260709 13:17:19.368381 10352 raft_consensus.cc:3060] T 632d0cca3448426a8b909ee924b0244f P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:19.368597 10172 leader_election.cc:343] T b2a40086010b440599041cd4935e5d86 P e4c126e4957640968340e01461ba12b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.369108 10172 leader_election.cc:304] T b2a40086010b440599041cd4935e5d86 P e4c126e4957640968340e01461ba12b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c126e4957640968340e01461ba12b2; no voters: 1a0996f2672c4594ab704b98217a662e, 9f4289676edb4b7c8fe897bafd84e935
I20260709 13:17:19.369388 10209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dea73a90f704a799d186b62cabf9383" candidate_uuid: "1a0996f2672c4594ab704b98217a662e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c126e4957640968340e01461ba12b2" is_pre_election: true
I20260709 13:17:19.369975 10344 raft_consensus.cc:2749] T b2a40086010b440599041cd4935e5d86 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:19.370289 10209 raft_consensus.cc:2468] T 5dea73a90f704a799d186b62cabf9383 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a0996f2672c4594ab704b98217a662e in term 0.
W20260709 13:17:19.370410 10172 leader_election.cc:343] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a0996f2672c4594ab704b98217a662e (127.2.198.195:45579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.374424 10248 leader_election.cc:304] T 5dea73a90f704a799d186b62cabf9383 P 1a0996f2672c4594ab704b98217a662e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a0996f2672c4594ab704b98217a662e, e4c126e4957640968340e01461ba12b2; no voters: 9f4289676edb4b7c8fe897bafd84e935
I20260709 13:17:19.376080 10334 raft_consensus.cc:2804] T 5dea73a90f704a799d186b62cabf9383 P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:19.376509 10334 raft_consensus.cc:493] T 5dea73a90f704a799d186b62cabf9383 P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.376868 10334 raft_consensus.cc:3060] T 5dea73a90f704a799d186b62cabf9383 P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.381397 10352 raft_consensus.cc:515] T 632d0cca3448426a8b909ee924b0244f P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.382107 10208 raft_consensus.cc:2468] T a410ccc6082d4335943afd658a181935 P e4c126e4957640968340e01461ba12b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a0996f2672c4594ab704b98217a662e in term 1.
I20260709 13:17:19.384847 10248 leader_election.cc:304] T a410ccc6082d4335943afd658a181935 P 1a0996f2672c4594ab704b98217a662e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a0996f2672c4594ab704b98217a662e, e4c126e4957640968340e01461ba12b2; no voters: 9f4289676edb4b7c8fe897bafd84e935
I20260709 13:17:19.386222 10362 raft_consensus.cc:2804] T a410ccc6082d4335943afd658a181935 P 1a0996f2672c4594ab704b98217a662e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:19.386860 10322 tablet_bootstrap.cc:492] T 9e1fdba60af24ecc84c528fb6813d3d7 P e4c126e4957640968340e01461ba12b2: No bootstrap required, opened a new log
I20260709 13:17:19.386375 10334 raft_consensus.cc:515] T 5dea73a90f704a799d186b62cabf9383 P 1a0996f2672c4594ab704b98217a662e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.387980 10208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632d0cca3448426a8b909ee924b0244f" candidate_uuid: "9f4289676edb4b7c8fe897bafd84e935" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c126e4957640968340e01461ba12b2"
I20260709 13:17:19.387910 10324 raft_consensus.cc:515] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.388867 10322 ts_tablet_manager.cc:1403] T 9e1fdba60af24ecc84c528fb6813d3d7 P e4c126e4957640968340e01461ba12b2: Time spent bootstrapping tablet: real 0.076s	user 0.020s	sys 0.024s
I20260709 13:17:19.389670 10325 tablet_bootstrap.cc:492] T 632d0cca3448426a8b909ee924b0244f P 1a0996f2672c4594ab704b98217a662e: No bootstrap required, opened a new log
I20260709 13:17:19.390398 10325 ts_tablet_manager.cc:1403] T 632d0cca3448426a8b909ee924b0244f P 1a0996f2672c4594ab704b98217a662e: Time spent bootstrapping tablet: real 0.120s	user 0.010s	sys 0.009s
I20260709 13:17:19.390931 10208 raft_consensus.cc:2393] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f4289676edb4b7c8fe897bafd84e935 in current term 1: Already voted for candidate e4c126e4957640968340e01461ba12b2 in this term.
I20260709 13:17:19.391839 10134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632d0cca3448426a8b909ee924b0244f" candidate_uuid: "e4c126e4957640968340e01461ba12b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f4289676edb4b7c8fe897bafd84e935"
I20260709 13:17:19.390498 10324 leader_election.cc:290] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2 [CANDIDATE]: Term 1 election: Requested vote from peers 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957), 1a0996f2672c4594ab704b98217a662e (127.2.198.195:45579)
I20260709 13:17:19.393097 10134 raft_consensus.cc:2393] T 632d0cca3448426a8b909ee924b0244f P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c126e4957640968340e01461ba12b2 in current term 1: Already voted for candidate 9f4289676edb4b7c8fe897bafd84e935 in this term.
I20260709 13:17:19.393530 10209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dea73a90f704a799d186b62cabf9383" candidate_uuid: "1a0996f2672c4594ab704b98217a662e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c126e4957640968340e01461ba12b2"
I20260709 13:17:19.394158 10209 raft_consensus.cc:3060] T 5dea73a90f704a799d186b62cabf9383 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.394078 10283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632d0cca3448426a8b909ee924b0244f" candidate_uuid: "e4c126e4957640968340e01461ba12b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a0996f2672c4594ab704b98217a662e"
I20260709 13:17:19.394851 10352 leader_election.cc:290] T 632d0cca3448426a8b909ee924b0244f P 9f4289676edb4b7c8fe897bafd84e935 [CANDIDATE]: Term 1 election: Requested vote from peers e4c126e4957640968340e01461ba12b2 (127.2.198.194:39745), 1a0996f2672c4594ab704b98217a662e (127.2.198.195:45579)
I20260709 13:17:19.395022 10322 raft_consensus.cc:359] T 9e1fdba60af24ecc84c528fb6813d3d7 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.395911 10322 raft_consensus.cc:385] T 9e1fdba60af24ecc84c528fb6813d3d7 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.396306 10322 raft_consensus.cc:740] T 9e1fdba60af24ecc84c528fb6813d3d7 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c126e4957640968340e01461ba12b2, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.397261 10322 consensus_queue.cc:260] T 9e1fdba60af24ecc84c528fb6813d3d7 P e4c126e4957640968340e01461ba12b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.399775 10322 ts_tablet_manager.cc:1434] T 9e1fdba60af24ecc84c528fb6813d3d7 P e4c126e4957640968340e01461ba12b2: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:17:19.403314 10322 tablet_bootstrap.cc:492] T 40054610eaa9497494285ea9ca8ec1e5 P e4c126e4957640968340e01461ba12b2: Bootstrap starting.
I20260709 13:17:19.403996 10325 raft_consensus.cc:359] T 632d0cca3448426a8b909ee924b0244f P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.404834 10325 raft_consensus.cc:385] T 632d0cca3448426a8b909ee924b0244f P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.405123 10325 raft_consensus.cc:740] T 632d0cca3448426a8b909ee924b0244f P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a0996f2672c4594ab704b98217a662e, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.406060 10325 consensus_queue.cc:260] T 632d0cca3448426a8b909ee924b0244f P 1a0996f2672c4594ab704b98217a662e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.411068 10209 raft_consensus.cc:2468] T 5dea73a90f704a799d186b62cabf9383 P e4c126e4957640968340e01461ba12b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a0996f2672c4594ab704b98217a662e in term 1.
W20260709 13:17:19.407295 10172 leader_election.cc:343] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1a0996f2672c4594ab704b98217a662e (127.2.198.195:45579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.412755 10322 tablet_bootstrap.cc:654] T 40054610eaa9497494285ea9ca8ec1e5 P e4c126e4957640968340e01461ba12b2: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.412909 10134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dea73a90f704a799d186b62cabf9383" candidate_uuid: "1a0996f2672c4594ab704b98217a662e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f4289676edb4b7c8fe897bafd84e935"
I20260709 13:17:19.413206 10172 leader_election.cc:304] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c126e4957640968340e01461ba12b2; no voters: 1a0996f2672c4594ab704b98217a662e, 9f4289676edb4b7c8fe897bafd84e935
I20260709 13:17:19.412914 10283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632d0cca3448426a8b909ee924b0244f" candidate_uuid: "9f4289676edb4b7c8fe897bafd84e935" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a0996f2672c4594ab704b98217a662e"
I20260709 13:17:19.414168 10324 raft_consensus.cc:2749] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:17:19.414678 10283 raft_consensus.cc:3060] T 632d0cca3448426a8b909ee924b0244f P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:19.417682 10246 leader_election.cc:343] T 5dea73a90f704a799d186b62cabf9383 P 1a0996f2672c4594ab704b98217a662e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.420086 10326 tablet_bootstrap.cc:492] T b2a40086010b440599041cd4935e5d86 P 9f4289676edb4b7c8fe897bafd84e935: No bootstrap required, opened a new log
I20260709 13:17:19.420755 10326 ts_tablet_manager.cc:1403] T b2a40086010b440599041cd4935e5d86 P 9f4289676edb4b7c8fe897bafd84e935: Time spent bootstrapping tablet: real 0.088s	user 0.013s	sys 0.006s
I20260709 13:17:19.421916 10248 leader_election.cc:304] T 5dea73a90f704a799d186b62cabf9383 P 1a0996f2672c4594ab704b98217a662e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a0996f2672c4594ab704b98217a662e, e4c126e4957640968340e01461ba12b2; no voters: 9f4289676edb4b7c8fe897bafd84e935
I20260709 13:17:19.400411 10334 leader_election.cc:290] T 5dea73a90f704a799d186b62cabf9383 P 1a0996f2672c4594ab704b98217a662e [CANDIDATE]: Term 1 election: Requested vote from peers 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957), e4c126e4957640968340e01461ba12b2 (127.2.198.194:39745)
I20260709 13:17:19.423012 10362 raft_consensus.cc:697] T a410ccc6082d4335943afd658a181935 P 1a0996f2672c4594ab704b98217a662e [term 1 LEADER]: Becoming Leader. State: Replica: 1a0996f2672c4594ab704b98217a662e, State: Running, Role: LEADER
I20260709 13:17:19.429461 10362 consensus_queue.cc:237] T a410ccc6082d4335943afd658a181935 P 1a0996f2672c4594ab704b98217a662e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.430598 10326 raft_consensus.cc:359] T b2a40086010b440599041cd4935e5d86 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.431268 10326 raft_consensus.cc:385] T b2a40086010b440599041cd4935e5d86 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.431529 10326 raft_consensus.cc:740] T b2a40086010b440599041cd4935e5d86 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f4289676edb4b7c8fe897bafd84e935, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.432735 10326 consensus_queue.cc:260] T b2a40086010b440599041cd4935e5d86 P 9f4289676edb4b7c8fe897bafd84e935 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.438653 10366 raft_consensus.cc:2804] T 5dea73a90f704a799d186b62cabf9383 P 1a0996f2672c4594ab704b98217a662e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:19.439513 10366 raft_consensus.cc:697] T 5dea73a90f704a799d186b62cabf9383 P 1a0996f2672c4594ab704b98217a662e [term 1 LEADER]: Becoming Leader. State: Replica: 1a0996f2672c4594ab704b98217a662e, State: Running, Role: LEADER
I20260709 13:17:19.440900 10366 consensus_queue.cc:237] T 5dea73a90f704a799d186b62cabf9383 P 1a0996f2672c4594ab704b98217a662e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.450242 10326 ts_tablet_manager.cc:1434] T b2a40086010b440599041cd4935e5d86 P 9f4289676edb4b7c8fe897bafd84e935: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:17:19.450421 10325 ts_tablet_manager.cc:1434] T 632d0cca3448426a8b909ee924b0244f P 1a0996f2672c4594ab704b98217a662e: Time spent starting tablet: real 0.059s	user 0.013s	sys 0.012s
I20260709 13:17:19.454957 10322 tablet_bootstrap.cc:492] T 40054610eaa9497494285ea9ca8ec1e5 P e4c126e4957640968340e01461ba12b2: No bootstrap required, opened a new log
I20260709 13:17:19.455446 10325 tablet_bootstrap.cc:492] T 9e1fdba60af24ecc84c528fb6813d3d7 P 1a0996f2672c4594ab704b98217a662e: Bootstrap starting.
I20260709 13:17:19.455753 10322 ts_tablet_manager.cc:1403] T 40054610eaa9497494285ea9ca8ec1e5 P e4c126e4957640968340e01461ba12b2: Time spent bootstrapping tablet: real 0.053s	user 0.014s	sys 0.006s
I20260709 13:17:19.460227 10322 raft_consensus.cc:359] T 40054610eaa9497494285ea9ca8ec1e5 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.461325 10322 raft_consensus.cc:385] T 40054610eaa9497494285ea9ca8ec1e5 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.461748 10322 raft_consensus.cc:740] T 40054610eaa9497494285ea9ca8ec1e5 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c126e4957640968340e01461ba12b2, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.454034 10283 raft_consensus.cc:2468] T 632d0cca3448426a8b909ee924b0244f P 1a0996f2672c4594ab704b98217a662e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f4289676edb4b7c8fe897bafd84e935 in term 1.
I20260709 13:17:19.451848 10326 tablet_bootstrap.cc:492] T 9e1fdba60af24ecc84c528fb6813d3d7 P 9f4289676edb4b7c8fe897bafd84e935: Bootstrap starting.
I20260709 13:17:19.462801 10322 consensus_queue.cc:260] T 40054610eaa9497494285ea9ca8ec1e5 P e4c126e4957640968340e01461ba12b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.465298 10097 leader_election.cc:304] T 632d0cca3448426a8b909ee924b0244f P 9f4289676edb4b7c8fe897bafd84e935 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a0996f2672c4594ab704b98217a662e, 9f4289676edb4b7c8fe897bafd84e935; no voters: e4c126e4957640968340e01461ba12b2
I20260709 13:17:19.466547 10325 tablet_bootstrap.cc:654] T 9e1fdba60af24ecc84c528fb6813d3d7 P 1a0996f2672c4594ab704b98217a662e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.466940 10322 ts_tablet_manager.cc:1434] T 40054610eaa9497494285ea9ca8ec1e5 P e4c126e4957640968340e01461ba12b2: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:17:19.467644 10364 raft_consensus.cc:2804] T 632d0cca3448426a8b909ee924b0244f P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:19.468218 10364 raft_consensus.cc:697] T 632d0cca3448426a8b909ee924b0244f P 9f4289676edb4b7c8fe897bafd84e935 [term 1 LEADER]: Becoming Leader. State: Replica: 9f4289676edb4b7c8fe897bafd84e935, State: Running, Role: LEADER
I20260709 13:17:19.470530 10322 tablet_bootstrap.cc:492] T 24b88255bc1b4bfc94b15c94efa36a25 P e4c126e4957640968340e01461ba12b2: Bootstrap starting.
I20260709 13:17:19.474829 10364 consensus_queue.cc:237] T 632d0cca3448426a8b909ee924b0244f P 9f4289676edb4b7c8fe897bafd84e935 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.480399 10031 catalog_manager.cc:5697] T a410ccc6082d4335943afd658a181935 P 1a0996f2672c4594ab704b98217a662e reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a0996f2672c4594ab704b98217a662e (127.2.198.195). New cstate: current_term: 1 leader_uuid: "1a0996f2672c4594ab704b98217a662e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:19.487690 10322 tablet_bootstrap.cc:654] T 24b88255bc1b4bfc94b15c94efa36a25 P e4c126e4957640968340e01461ba12b2: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.488726 10326 tablet_bootstrap.cc:654] T 9e1fdba60af24ecc84c528fb6813d3d7 P 9f4289676edb4b7c8fe897bafd84e935: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.500639 10322 tablet_bootstrap.cc:492] T 24b88255bc1b4bfc94b15c94efa36a25 P e4c126e4957640968340e01461ba12b2: No bootstrap required, opened a new log
I20260709 13:17:19.501155 10322 ts_tablet_manager.cc:1403] T 24b88255bc1b4bfc94b15c94efa36a25 P e4c126e4957640968340e01461ba12b2: Time spent bootstrapping tablet: real 0.031s	user 0.008s	sys 0.013s
I20260709 13:17:19.504170 10322 raft_consensus.cc:359] T 24b88255bc1b4bfc94b15c94efa36a25 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.504925 10322 raft_consensus.cc:385] T 24b88255bc1b4bfc94b15c94efa36a25 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.505220 10322 raft_consensus.cc:740] T 24b88255bc1b4bfc94b15c94efa36a25 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c126e4957640968340e01461ba12b2, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.505470 10030 catalog_manager.cc:5697] T 632d0cca3448426a8b909ee924b0244f P 9f4289676edb4b7c8fe897bafd84e935 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "9f4289676edb4b7c8fe897bafd84e935" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:19.507344 10326 tablet_bootstrap.cc:492] T 9e1fdba60af24ecc84c528fb6813d3d7 P 9f4289676edb4b7c8fe897bafd84e935: No bootstrap required, opened a new log
I20260709 13:17:19.507114 10322 consensus_queue.cc:260] T 24b88255bc1b4bfc94b15c94efa36a25 P e4c126e4957640968340e01461ba12b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.507931 10326 ts_tablet_manager.cc:1403] T 9e1fdba60af24ecc84c528fb6813d3d7 P 9f4289676edb4b7c8fe897bafd84e935: Time spent bootstrapping tablet: real 0.056s	user 0.015s	sys 0.005s
I20260709 13:17:19.508801 10325 tablet_bootstrap.cc:492] T 9e1fdba60af24ecc84c528fb6813d3d7 P 1a0996f2672c4594ab704b98217a662e: No bootstrap required, opened a new log
I20260709 13:17:19.509389 10325 ts_tablet_manager.cc:1403] T 9e1fdba60af24ecc84c528fb6813d3d7 P 1a0996f2672c4594ab704b98217a662e: Time spent bootstrapping tablet: real 0.054s	user 0.014s	sys 0.004s
I20260709 13:17:19.511022 10326 raft_consensus.cc:359] T 9e1fdba60af24ecc84c528fb6813d3d7 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.511791 10326 raft_consensus.cc:385] T 9e1fdba60af24ecc84c528fb6813d3d7 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.512070 10326 raft_consensus.cc:740] T 9e1fdba60af24ecc84c528fb6813d3d7 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f4289676edb4b7c8fe897bafd84e935, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.512699 10325 raft_consensus.cc:359] T 9e1fdba60af24ecc84c528fb6813d3d7 P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.512984 10326 consensus_queue.cc:260] T 9e1fdba60af24ecc84c528fb6813d3d7 P 9f4289676edb4b7c8fe897bafd84e935 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.513549 10325 raft_consensus.cc:385] T 9e1fdba60af24ecc84c528fb6813d3d7 P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.513993 10325 raft_consensus.cc:740] T 9e1fdba60af24ecc84c528fb6813d3d7 P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a0996f2672c4594ab704b98217a662e, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.514816 10325 consensus_queue.cc:260] T 9e1fdba60af24ecc84c528fb6813d3d7 P 1a0996f2672c4594ab704b98217a662e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.516577 10326 ts_tablet_manager.cc:1434] T 9e1fdba60af24ecc84c528fb6813d3d7 P 9f4289676edb4b7c8fe897bafd84e935: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:17:19.517632 10325 ts_tablet_manager.cc:1434] T 9e1fdba60af24ecc84c528fb6813d3d7 P 1a0996f2672c4594ab704b98217a662e: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:17:19.519047 10325 tablet_bootstrap.cc:492] T b2a40086010b440599041cd4935e5d86 P 1a0996f2672c4594ab704b98217a662e: Bootstrap starting.
I20260709 13:17:19.517719 10322 ts_tablet_manager.cc:1434] T 24b88255bc1b4bfc94b15c94efa36a25 P e4c126e4957640968340e01461ba12b2: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:17:19.517632 10326 tablet_bootstrap.cc:492] T 7abb4eef5abd4a268cbebb6cebd4a051 P 9f4289676edb4b7c8fe897bafd84e935: Bootstrap starting.
I20260709 13:17:19.519301 10031 catalog_manager.cc:5697] T 5dea73a90f704a799d186b62cabf9383 P 1a0996f2672c4594ab704b98217a662e reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a0996f2672c4594ab704b98217a662e (127.2.198.195). New cstate: current_term: 1 leader_uuid: "1a0996f2672c4594ab704b98217a662e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:19.526332 10326 tablet_bootstrap.cc:654] T 7abb4eef5abd4a268cbebb6cebd4a051 P 9f4289676edb4b7c8fe897bafd84e935: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.528484 10325 tablet_bootstrap.cc:654] T b2a40086010b440599041cd4935e5d86 P 1a0996f2672c4594ab704b98217a662e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.532214 10364 raft_consensus.cc:493] T 24b88255bc1b4bfc94b15c94efa36a25 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.532892 10364 raft_consensus.cc:515] T 24b88255bc1b4bfc94b15c94efa36a25 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.534260 10326 tablet_bootstrap.cc:492] T 7abb4eef5abd4a268cbebb6cebd4a051 P 9f4289676edb4b7c8fe897bafd84e935: No bootstrap required, opened a new log
I20260709 13:17:19.534785 10326 ts_tablet_manager.cc:1403] T 7abb4eef5abd4a268cbebb6cebd4a051 P 9f4289676edb4b7c8fe897bafd84e935: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.000s
I20260709 13:17:19.536847 10283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b88255bc1b4bfc94b15c94efa36a25" candidate_uuid: "9f4289676edb4b7c8fe897bafd84e935" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a0996f2672c4594ab704b98217a662e" is_pre_election: true
I20260709 13:17:19.537519 10283 raft_consensus.cc:2468] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f4289676edb4b7c8fe897bafd84e935 in term 0.
I20260709 13:17:19.537797 10326 raft_consensus.cc:359] T 7abb4eef5abd4a268cbebb6cebd4a051 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.538473 10326 raft_consensus.cc:385] T 7abb4eef5abd4a268cbebb6cebd4a051 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.538810 10326 raft_consensus.cc:740] T 7abb4eef5abd4a268cbebb6cebd4a051 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f4289676edb4b7c8fe897bafd84e935, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.539057 10209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b88255bc1b4bfc94b15c94efa36a25" candidate_uuid: "9f4289676edb4b7c8fe897bafd84e935" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c126e4957640968340e01461ba12b2" is_pre_election: true
I20260709 13:17:19.539746 10209 raft_consensus.cc:2468] T 24b88255bc1b4bfc94b15c94efa36a25 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f4289676edb4b7c8fe897bafd84e935 in term 0.
I20260709 13:17:19.541005 10097 leader_election.cc:304] T 24b88255bc1b4bfc94b15c94efa36a25 P 9f4289676edb4b7c8fe897bafd84e935 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a0996f2672c4594ab704b98217a662e, 9f4289676edb4b7c8fe897bafd84e935; no voters: 
I20260709 13:17:19.541953 10352 raft_consensus.cc:2804] T 24b88255bc1b4bfc94b15c94efa36a25 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:19.542333 10352 raft_consensus.cc:493] T 24b88255bc1b4bfc94b15c94efa36a25 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.542691 10352 raft_consensus.cc:3060] T 24b88255bc1b4bfc94b15c94efa36a25 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.543521 10326 consensus_queue.cc:260] T 7abb4eef5abd4a268cbebb6cebd4a051 P 9f4289676edb4b7c8fe897bafd84e935 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.545738 10326 ts_tablet_manager.cc:1434] T 7abb4eef5abd4a268cbebb6cebd4a051 P 9f4289676edb4b7c8fe897bafd84e935: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:17:19.547101 10326 tablet_bootstrap.cc:492] T 5dea73a90f704a799d186b62cabf9383 P 9f4289676edb4b7c8fe897bafd84e935: Bootstrap starting.
I20260709 13:17:19.547700 10364 leader_election.cc:290] T 24b88255bc1b4bfc94b15c94efa36a25 P 9f4289676edb4b7c8fe897bafd84e935 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c126e4957640968340e01461ba12b2 (127.2.198.194:39745), 1a0996f2672c4594ab704b98217a662e (127.2.198.195:45579)
I20260709 13:17:19.553231 10326 tablet_bootstrap.cc:654] T 5dea73a90f704a799d186b62cabf9383 P 9f4289676edb4b7c8fe897bafd84e935: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.553869 10352 raft_consensus.cc:515] T 24b88255bc1b4bfc94b15c94efa36a25 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.556198 10352 leader_election.cc:290] T 24b88255bc1b4bfc94b15c94efa36a25 P 9f4289676edb4b7c8fe897bafd84e935 [CANDIDATE]: Term 1 election: Requested vote from peers e4c126e4957640968340e01461ba12b2 (127.2.198.194:39745), 1a0996f2672c4594ab704b98217a662e (127.2.198.195:45579)
I20260709 13:17:19.557387 10325 tablet_bootstrap.cc:492] T b2a40086010b440599041cd4935e5d86 P 1a0996f2672c4594ab704b98217a662e: No bootstrap required, opened a new log
I20260709 13:17:19.557947 10325 ts_tablet_manager.cc:1403] T b2a40086010b440599041cd4935e5d86 P 1a0996f2672c4594ab704b98217a662e: Time spent bootstrapping tablet: real 0.039s	user 0.018s	sys 0.014s
I20260709 13:17:19.558578 10283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b88255bc1b4bfc94b15c94efa36a25" candidate_uuid: "9f4289676edb4b7c8fe897bafd84e935" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a0996f2672c4594ab704b98217a662e"
I20260709 13:17:19.559442 10283 raft_consensus.cc:3060] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.561523 10325 raft_consensus.cc:359] T b2a40086010b440599041cd4935e5d86 P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.562290 10325 raft_consensus.cc:385] T b2a40086010b440599041cd4935e5d86 P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.562559 10325 raft_consensus.cc:740] T b2a40086010b440599041cd4935e5d86 P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a0996f2672c4594ab704b98217a662e, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.557238 10209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b88255bc1b4bfc94b15c94efa36a25" candidate_uuid: "9f4289676edb4b7c8fe897bafd84e935" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c126e4957640968340e01461ba12b2"
I20260709 13:17:19.563275 10325 consensus_queue.cc:260] T b2a40086010b440599041cd4935e5d86 P 1a0996f2672c4594ab704b98217a662e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.563846 10209 raft_consensus.cc:3060] T 24b88255bc1b4bfc94b15c94efa36a25 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.564462 10362 raft_consensus.cc:493] T 78042ece070249adabf7c5df20cb9980 P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.564708 10326 tablet_bootstrap.cc:492] T 5dea73a90f704a799d186b62cabf9383 P 9f4289676edb4b7c8fe897bafd84e935: No bootstrap required, opened a new log
I20260709 13:17:19.565290 10326 ts_tablet_manager.cc:1403] T 5dea73a90f704a799d186b62cabf9383 P 9f4289676edb4b7c8fe897bafd84e935: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 13:17:19.565039 10362 raft_consensus.cc:515] T 78042ece070249adabf7c5df20cb9980 P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.568243 10325 ts_tablet_manager.cc:1434] T b2a40086010b440599041cd4935e5d86 P 1a0996f2672c4594ab704b98217a662e: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:17:19.568421 10326 raft_consensus.cc:359] T 5dea73a90f704a799d186b62cabf9383 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.568893 10208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78042ece070249adabf7c5df20cb9980" candidate_uuid: "1a0996f2672c4594ab704b98217a662e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c126e4957640968340e01461ba12b2" is_pre_election: true
I20260709 13:17:19.569192 10326 raft_consensus.cc:385] T 5dea73a90f704a799d186b62cabf9383 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.569411 10325 tablet_bootstrap.cc:492] T 7abb4eef5abd4a268cbebb6cebd4a051 P 1a0996f2672c4594ab704b98217a662e: Bootstrap starting.
I20260709 13:17:19.569548 10326 raft_consensus.cc:740] T 5dea73a90f704a799d186b62cabf9383 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f4289676edb4b7c8fe897bafd84e935, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.570685 10326 consensus_queue.cc:260] T 5dea73a90f704a799d186b62cabf9383 P 9f4289676edb4b7c8fe897bafd84e935 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.567394 10362 leader_election.cc:290] T 78042ece070249adabf7c5df20cb9980 P 1a0996f2672c4594ab704b98217a662e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c126e4957640968340e01461ba12b2 (127.2.198.194:39745), 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957)
I20260709 13:17:19.572755 10362 raft_consensus.cc:493] T b2a40086010b440599041cd4935e5d86 P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.573194 10326 ts_tablet_manager.cc:1434] T 5dea73a90f704a799d186b62cabf9383 P 9f4289676edb4b7c8fe897bafd84e935: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:17:19.572980 10134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78042ece070249adabf7c5df20cb9980" candidate_uuid: "1a0996f2672c4594ab704b98217a662e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f4289676edb4b7c8fe897bafd84e935" is_pre_election: true
I20260709 13:17:19.574055 10134 raft_consensus.cc:2393] T 78042ece070249adabf7c5df20cb9980 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a0996f2672c4594ab704b98217a662e in current term 1: Already voted for candidate e4c126e4957640968340e01461ba12b2 in this term.
I20260709 13:17:19.573344 10362 raft_consensus.cc:515] T b2a40086010b440599041cd4935e5d86 P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.575361 10246 leader_election.cc:304] T 78042ece070249adabf7c5df20cb9980 P 1a0996f2672c4594ab704b98217a662e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a0996f2672c4594ab704b98217a662e; no voters: 9f4289676edb4b7c8fe897bafd84e935, e4c126e4957640968340e01461ba12b2
I20260709 13:17:19.576460 10362 leader_election.cc:290] T b2a40086010b440599041cd4935e5d86 P 1a0996f2672c4594ab704b98217a662e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957), e4c126e4957640968340e01461ba12b2 (127.2.198.194:39745)
I20260709 13:17:19.577047 10325 tablet_bootstrap.cc:654] T 7abb4eef5abd4a268cbebb6cebd4a051 P 1a0996f2672c4594ab704b98217a662e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.577039 10366 raft_consensus.cc:3060] T 78042ece070249adabf7c5df20cb9980 P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.577728 10208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2a40086010b440599041cd4935e5d86" candidate_uuid: "1a0996f2672c4594ab704b98217a662e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c126e4957640968340e01461ba12b2" is_pre_election: true
I20260709 13:17:19.578555 10208 raft_consensus.cc:2468] T b2a40086010b440599041cd4935e5d86 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a0996f2672c4594ab704b98217a662e in term 0.
I20260709 13:17:19.579988 10248 leader_election.cc:304] T b2a40086010b440599041cd4935e5d86 P 1a0996f2672c4594ab704b98217a662e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a0996f2672c4594ab704b98217a662e, e4c126e4957640968340e01461ba12b2; no voters: 
I20260709 13:17:19.581250 10209 raft_consensus.cc:2468] T 24b88255bc1b4bfc94b15c94efa36a25 P e4c126e4957640968340e01461ba12b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f4289676edb4b7c8fe897bafd84e935 in term 1.
I20260709 13:17:19.581512 10134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2a40086010b440599041cd4935e5d86" candidate_uuid: "1a0996f2672c4594ab704b98217a662e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f4289676edb4b7c8fe897bafd84e935" is_pre_election: true
I20260709 13:17:19.582598 10134 raft_consensus.cc:2468] T b2a40086010b440599041cd4935e5d86 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a0996f2672c4594ab704b98217a662e in term 0.
I20260709 13:17:19.582721 10099 leader_election.cc:304] T 24b88255bc1b4bfc94b15c94efa36a25 P 9f4289676edb4b7c8fe897bafd84e935 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f4289676edb4b7c8fe897bafd84e935, e4c126e4957640968340e01461ba12b2; no voters: 
I20260709 13:17:19.583778 10352 raft_consensus.cc:2804] T 24b88255bc1b4bfc94b15c94efa36a25 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:19.584267 10352 raft_consensus.cc:697] T 24b88255bc1b4bfc94b15c94efa36a25 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 LEADER]: Becoming Leader. State: Replica: 9f4289676edb4b7c8fe897bafd84e935, State: Running, Role: LEADER
I20260709 13:17:19.585160 10352 consensus_queue.cc:237] T 24b88255bc1b4bfc94b15c94efa36a25 P 9f4289676edb4b7c8fe897bafd84e935 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.586225 10366 raft_consensus.cc:2749] T 78042ece070249adabf7c5df20cb9980 P 1a0996f2672c4594ab704b98217a662e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:19.587008 10366 raft_consensus.cc:2804] T b2a40086010b440599041cd4935e5d86 P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:19.587383 10366 raft_consensus.cc:493] T b2a40086010b440599041cd4935e5d86 P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.587749 10366 raft_consensus.cc:3060] T b2a40086010b440599041cd4935e5d86 P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.592121 10283 raft_consensus.cc:2468] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f4289676edb4b7c8fe897bafd84e935 in term 1.
I20260709 13:17:19.596616 10366 raft_consensus.cc:515] T b2a40086010b440599041cd4935e5d86 P 1a0996f2672c4594ab704b98217a662e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.599967 10134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2a40086010b440599041cd4935e5d86" candidate_uuid: "1a0996f2672c4594ab704b98217a662e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f4289676edb4b7c8fe897bafd84e935"
I20260709 13:17:19.600584 10134 raft_consensus.cc:3060] T b2a40086010b440599041cd4935e5d86 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.600653 10366 leader_election.cc:290] T b2a40086010b440599041cd4935e5d86 P 1a0996f2672c4594ab704b98217a662e [CANDIDATE]: Term 1 election: Requested vote from peers 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957), e4c126e4957640968340e01461ba12b2 (127.2.198.194:39745)
I20260709 13:17:19.604688 10209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2a40086010b440599041cd4935e5d86" candidate_uuid: "1a0996f2672c4594ab704b98217a662e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c126e4957640968340e01461ba12b2"
I20260709 13:17:19.605373 10209 raft_consensus.cc:3060] T b2a40086010b440599041cd4935e5d86 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.608439 10324 consensus_queue.cc:1048] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:19.613657 10209 raft_consensus.cc:2468] T b2a40086010b440599041cd4935e5d86 P e4c126e4957640968340e01461ba12b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a0996f2672c4594ab704b98217a662e in term 1.
I20260709 13:17:19.615576 10248 leader_election.cc:304] T b2a40086010b440599041cd4935e5d86 P 1a0996f2672c4594ab704b98217a662e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a0996f2672c4594ab704b98217a662e, e4c126e4957640968340e01461ba12b2; no voters: 
I20260709 13:17:19.616549 10366 raft_consensus.cc:2804] T b2a40086010b440599041cd4935e5d86 P 1a0996f2672c4594ab704b98217a662e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:19.617267 10366 raft_consensus.cc:697] T b2a40086010b440599041cd4935e5d86 P 1a0996f2672c4594ab704b98217a662e [term 1 LEADER]: Becoming Leader. State: Replica: 1a0996f2672c4594ab704b98217a662e, State: Running, Role: LEADER
I20260709 13:17:19.618404 10134 raft_consensus.cc:2468] T b2a40086010b440599041cd4935e5d86 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a0996f2672c4594ab704b98217a662e in term 1.
I20260709 13:17:19.618181 10366 consensus_queue.cc:237] T b2a40086010b440599041cd4935e5d86 P 1a0996f2672c4594ab704b98217a662e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.622309 10325 tablet_bootstrap.cc:492] T 7abb4eef5abd4a268cbebb6cebd4a051 P 1a0996f2672c4594ab704b98217a662e: No bootstrap required, opened a new log
I20260709 13:17:19.623029 10325 ts_tablet_manager.cc:1403] T 7abb4eef5abd4a268cbebb6cebd4a051 P 1a0996f2672c4594ab704b98217a662e: Time spent bootstrapping tablet: real 0.054s	user 0.026s	sys 0.020s
I20260709 13:17:19.624089 10031 catalog_manager.cc:5697] T 24b88255bc1b4bfc94b15c94efa36a25 P 9f4289676edb4b7c8fe897bafd84e935 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "9f4289676edb4b7c8fe897bafd84e935" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:19.626428 10325 raft_consensus.cc:359] T 7abb4eef5abd4a268cbebb6cebd4a051 P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.627414 10325 raft_consensus.cc:385] T 7abb4eef5abd4a268cbebb6cebd4a051 P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.627815 10325 raft_consensus.cc:740] T 7abb4eef5abd4a268cbebb6cebd4a051 P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a0996f2672c4594ab704b98217a662e, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.628679 10325 consensus_queue.cc:260] T 7abb4eef5abd4a268cbebb6cebd4a051 P 1a0996f2672c4594ab704b98217a662e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.630945 10325 ts_tablet_manager.cc:1434] T 7abb4eef5abd4a268cbebb6cebd4a051 P 1a0996f2672c4594ab704b98217a662e: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.001s
I20260709 13:17:19.632014 10325 tablet_bootstrap.cc:492] T 40054610eaa9497494285ea9ca8ec1e5 P 1a0996f2672c4594ab704b98217a662e: Bootstrap starting.
I20260709 13:17:19.635336 10032 catalog_manager.cc:5697] T b2a40086010b440599041cd4935e5d86 P 1a0996f2672c4594ab704b98217a662e reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a0996f2672c4594ab704b98217a662e (127.2.198.195). New cstate: current_term: 1 leader_uuid: "1a0996f2672c4594ab704b98217a662e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:19.639882 10325 tablet_bootstrap.cc:654] T 40054610eaa9497494285ea9ca8ec1e5 P 1a0996f2672c4594ab704b98217a662e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.646344 10344 consensus_queue.cc:1048] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:19.653864 10386 raft_consensus.cc:493] T 7abb4eef5abd4a268cbebb6cebd4a051 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.654460 10386 raft_consensus.cc:515] T 7abb4eef5abd4a268cbebb6cebd4a051 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.655073 10325 tablet_bootstrap.cc:492] T 40054610eaa9497494285ea9ca8ec1e5 P 1a0996f2672c4594ab704b98217a662e: No bootstrap required, opened a new log
I20260709 13:17:19.655638 10325 ts_tablet_manager.cc:1403] T 40054610eaa9497494285ea9ca8ec1e5 P 1a0996f2672c4594ab704b98217a662e: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.008s
I20260709 13:17:19.657472 10133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abb4eef5abd4a268cbebb6cebd4a051" candidate_uuid: "e4c126e4957640968340e01461ba12b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f4289676edb4b7c8fe897bafd84e935" is_pre_election: true
I20260709 13:17:19.658203 10133 raft_consensus.cc:2468] T 7abb4eef5abd4a268cbebb6cebd4a051 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c126e4957640968340e01461ba12b2 in term 0.
I20260709 13:17:19.658452 10282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abb4eef5abd4a268cbebb6cebd4a051" candidate_uuid: "e4c126e4957640968340e01461ba12b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a0996f2672c4594ab704b98217a662e" is_pre_election: true
I20260709 13:17:19.656778 10386 leader_election.cc:290] T 7abb4eef5abd4a268cbebb6cebd4a051 P e4c126e4957640968340e01461ba12b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957), 1a0996f2672c4594ab704b98217a662e (127.2.198.195:45579)
I20260709 13:17:19.659098 10282 raft_consensus.cc:2468] T 7abb4eef5abd4a268cbebb6cebd4a051 P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c126e4957640968340e01461ba12b2 in term 0.
I20260709 13:17:19.659428 10325 raft_consensus.cc:359] T 40054610eaa9497494285ea9ca8ec1e5 P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.660187 10325 raft_consensus.cc:385] T 40054610eaa9497494285ea9ca8ec1e5 P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.660472 10325 raft_consensus.cc:740] T 40054610eaa9497494285ea9ca8ec1e5 P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a0996f2672c4594ab704b98217a662e, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.661175 10172 leader_election.cc:304] T 7abb4eef5abd4a268cbebb6cebd4a051 P e4c126e4957640968340e01461ba12b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f4289676edb4b7c8fe897bafd84e935, e4c126e4957640968340e01461ba12b2; no voters: 
I20260709 13:17:19.661198 10325 consensus_queue.cc:260] T 40054610eaa9497494285ea9ca8ec1e5 P 1a0996f2672c4594ab704b98217a662e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.662806 10386 raft_consensus.cc:2804] T 7abb4eef5abd4a268cbebb6cebd4a051 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:19.663220 10386 raft_consensus.cc:493] T 7abb4eef5abd4a268cbebb6cebd4a051 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.663627 10325 ts_tablet_manager.cc:1434] T 40054610eaa9497494285ea9ca8ec1e5 P 1a0996f2672c4594ab704b98217a662e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:17:19.663656 10386 raft_consensus.cc:3060] T 7abb4eef5abd4a268cbebb6cebd4a051 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.664584 10352 raft_consensus.cc:493] T 5dea73a90f704a799d186b62cabf9383 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.664801 10344 raft_consensus.cc:493] T 40054610eaa9497494285ea9ca8ec1e5 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.665207 10352 raft_consensus.cc:515] T 5dea73a90f704a799d186b62cabf9383 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.665359 10344 raft_consensus.cc:515] T 40054610eaa9497494285ea9ca8ec1e5 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.668926 10344 leader_election.cc:290] T 40054610eaa9497494285ea9ca8ec1e5 P e4c126e4957640968340e01461ba12b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957), 1a0996f2672c4594ab704b98217a662e (127.2.198.195:45579)
I20260709 13:17:19.670207 10282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dea73a90f704a799d186b62cabf9383" candidate_uuid: "9f4289676edb4b7c8fe897bafd84e935" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a0996f2672c4594ab704b98217a662e" is_pre_election: true
I20260709 13:17:19.671236 10283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40054610eaa9497494285ea9ca8ec1e5" candidate_uuid: "e4c126e4957640968340e01461ba12b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a0996f2672c4594ab704b98217a662e" is_pre_election: true
I20260709 13:17:19.672137 10283 raft_consensus.cc:2468] T 40054610eaa9497494285ea9ca8ec1e5 P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c126e4957640968340e01461ba12b2 in term 0.
I20260709 13:17:19.668927 10209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dea73a90f704a799d186b62cabf9383" candidate_uuid: "9f4289676edb4b7c8fe897bafd84e935" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c126e4957640968340e01461ba12b2" is_pre_election: true
I20260709 13:17:19.673368 10209 raft_consensus.cc:2393] T 5dea73a90f704a799d186b62cabf9383 P e4c126e4957640968340e01461ba12b2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f4289676edb4b7c8fe897bafd84e935 in current term 1: Already voted for candidate 1a0996f2672c4594ab704b98217a662e in this term.
I20260709 13:17:19.673542 10172 leader_election.cc:304] T 40054610eaa9497494285ea9ca8ec1e5 P e4c126e4957640968340e01461ba12b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a0996f2672c4594ab704b98217a662e, e4c126e4957640968340e01461ba12b2; no voters: 
I20260709 13:17:19.674713 10133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40054610eaa9497494285ea9ca8ec1e5" candidate_uuid: "e4c126e4957640968340e01461ba12b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f4289676edb4b7c8fe897bafd84e935" is_pre_election: true
I20260709 13:17:19.674896 10099 leader_election.cc:304] T 5dea73a90f704a799d186b62cabf9383 P 9f4289676edb4b7c8fe897bafd84e935 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f4289676edb4b7c8fe897bafd84e935; no voters: 1a0996f2672c4594ab704b98217a662e, e4c126e4957640968340e01461ba12b2
I20260709 13:17:19.675438 10133 raft_consensus.cc:2468] T 40054610eaa9497494285ea9ca8ec1e5 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c126e4957640968340e01461ba12b2 in term 0.
I20260709 13:17:19.675834 10364 raft_consensus.cc:3060] T 5dea73a90f704a799d186b62cabf9383 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.675625 10386 raft_consensus.cc:515] T 7abb4eef5abd4a268cbebb6cebd4a051 P e4c126e4957640968340e01461ba12b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.678606 10386 leader_election.cc:290] T 7abb4eef5abd4a268cbebb6cebd4a051 P e4c126e4957640968340e01461ba12b2 [CANDIDATE]: Term 1 election: Requested vote from peers 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957), 1a0996f2672c4594ab704b98217a662e (127.2.198.195:45579)
I20260709 13:17:19.679342 10386 raft_consensus.cc:2804] T 40054610eaa9497494285ea9ca8ec1e5 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:19.679836 10386 raft_consensus.cc:493] T 40054610eaa9497494285ea9ca8ec1e5 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.680295 10386 raft_consensus.cc:3060] T 40054610eaa9497494285ea9ca8ec1e5 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.682134 10132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abb4eef5abd4a268cbebb6cebd4a051" candidate_uuid: "e4c126e4957640968340e01461ba12b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f4289676edb4b7c8fe897bafd84e935"
I20260709 13:17:19.682453 10283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abb4eef5abd4a268cbebb6cebd4a051" candidate_uuid: "e4c126e4957640968340e01461ba12b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a0996f2672c4594ab704b98217a662e"
I20260709 13:17:19.682878 10132 raft_consensus.cc:3060] T 7abb4eef5abd4a268cbebb6cebd4a051 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.683131 10283 raft_consensus.cc:3060] T 7abb4eef5abd4a268cbebb6cebd4a051 P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.687968 10352 leader_election.cc:290] T 5dea73a90f704a799d186b62cabf9383 P 9f4289676edb4b7c8fe897bafd84e935 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c126e4957640968340e01461ba12b2 (127.2.198.194:39745), 1a0996f2672c4594ab704b98217a662e (127.2.198.195:45579)
I20260709 13:17:19.691107 10386 raft_consensus.cc:515] T 40054610eaa9497494285ea9ca8ec1e5 P e4c126e4957640968340e01461ba12b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.693511 10364 raft_consensus.cc:2749] T 5dea73a90f704a799d186b62cabf9383 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:19.694610 10132 raft_consensus.cc:2468] T 7abb4eef5abd4a268cbebb6cebd4a051 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c126e4957640968340e01461ba12b2 in term 1.
I20260709 13:17:19.695655 10386 leader_election.cc:290] T 40054610eaa9497494285ea9ca8ec1e5 P e4c126e4957640968340e01461ba12b2 [CANDIDATE]: Term 1 election: Requested vote from peers 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957), 1a0996f2672c4594ab704b98217a662e (127.2.198.195:45579)
I20260709 13:17:19.695848 10133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40054610eaa9497494285ea9ca8ec1e5" candidate_uuid: "e4c126e4957640968340e01461ba12b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f4289676edb4b7c8fe897bafd84e935"
I20260709 13:17:19.696520 10133 raft_consensus.cc:3060] T 40054610eaa9497494285ea9ca8ec1e5 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.698087 10386 consensus_queue.cc:1048] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:19.699007 10282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40054610eaa9497494285ea9ca8ec1e5" candidate_uuid: "e4c126e4957640968340e01461ba12b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a0996f2672c4594ab704b98217a662e"
I20260709 13:17:19.699702 10282 raft_consensus.cc:3060] T 40054610eaa9497494285ea9ca8ec1e5 P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.698179 10172 leader_election.cc:304] T 7abb4eef5abd4a268cbebb6cebd4a051 P e4c126e4957640968340e01461ba12b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f4289676edb4b7c8fe897bafd84e935, e4c126e4957640968340e01461ba12b2; no voters: 
I20260709 13:17:19.704479 10386 raft_consensus.cc:2804] T 7abb4eef5abd4a268cbebb6cebd4a051 P e4c126e4957640968340e01461ba12b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:19.704989 10386 raft_consensus.cc:697] T 7abb4eef5abd4a268cbebb6cebd4a051 P e4c126e4957640968340e01461ba12b2 [term 1 LEADER]: Becoming Leader. State: Replica: e4c126e4957640968340e01461ba12b2, State: Running, Role: LEADER
I20260709 13:17:19.705853 10386 consensus_queue.cc:237] T 7abb4eef5abd4a268cbebb6cebd4a051 P e4c126e4957640968340e01461ba12b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.709548 10282 raft_consensus.cc:2468] T 40054610eaa9497494285ea9ca8ec1e5 P 1a0996f2672c4594ab704b98217a662e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c126e4957640968340e01461ba12b2 in term 1.
I20260709 13:17:19.709697 10283 raft_consensus.cc:2468] T 7abb4eef5abd4a268cbebb6cebd4a051 P 1a0996f2672c4594ab704b98217a662e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c126e4957640968340e01461ba12b2 in term 1.
I20260709 13:17:19.711310 10133 raft_consensus.cc:2468] T 40054610eaa9497494285ea9ca8ec1e5 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c126e4957640968340e01461ba12b2 in term 1.
I20260709 13:17:19.711696 10172 leader_election.cc:304] T 40054610eaa9497494285ea9ca8ec1e5 P e4c126e4957640968340e01461ba12b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a0996f2672c4594ab704b98217a662e, e4c126e4957640968340e01461ba12b2; no voters: 
I20260709 13:17:19.715159 10386 raft_consensus.cc:2804] T 40054610eaa9497494285ea9ca8ec1e5 P e4c126e4957640968340e01461ba12b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:19.715885 10386 raft_consensus.cc:697] T 40054610eaa9497494285ea9ca8ec1e5 P e4c126e4957640968340e01461ba12b2 [term 1 LEADER]: Becoming Leader. State: Replica: e4c126e4957640968340e01461ba12b2, State: Running, Role: LEADER
I20260709 13:17:19.716763 10386 consensus_queue.cc:237] T 40054610eaa9497494285ea9ca8ec1e5 P e4c126e4957640968340e01461ba12b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.724375 10030 catalog_manager.cc:5697] T 7abb4eef5abd4a268cbebb6cebd4a051 P e4c126e4957640968340e01461ba12b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4c126e4957640968340e01461ba12b2 (127.2.198.194). New cstate: current_term: 1 leader_uuid: "e4c126e4957640968340e01461ba12b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:19.732173 10386 consensus_queue.cc:1048] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:19.739892 10344 raft_consensus.cc:493] T 9e1fdba60af24ecc84c528fb6813d3d7 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.740432 10344 raft_consensus.cc:515] T 9e1fdba60af24ecc84c528fb6813d3d7 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.742816 10344 leader_election.cc:290] T 9e1fdba60af24ecc84c528fb6813d3d7 P e4c126e4957640968340e01461ba12b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957), 1a0996f2672c4594ab704b98217a662e (127.2.198.195:45579)
I20260709 13:17:19.744016 10133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1fdba60af24ecc84c528fb6813d3d7" candidate_uuid: "e4c126e4957640968340e01461ba12b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f4289676edb4b7c8fe897bafd84e935" is_pre_election: true
I20260709 13:17:19.744819 10133 raft_consensus.cc:2468] T 9e1fdba60af24ecc84c528fb6813d3d7 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c126e4957640968340e01461ba12b2 in term 0.
I20260709 13:17:19.745450 10283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1fdba60af24ecc84c528fb6813d3d7" candidate_uuid: "e4c126e4957640968340e01461ba12b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a0996f2672c4594ab704b98217a662e" is_pre_election: true
I20260709 13:17:19.746187 10172 leader_election.cc:304] T 9e1fdba60af24ecc84c528fb6813d3d7 P e4c126e4957640968340e01461ba12b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f4289676edb4b7c8fe897bafd84e935, e4c126e4957640968340e01461ba12b2; no voters: 
I20260709 13:17:19.746820 10283 raft_consensus.cc:2468] T 9e1fdba60af24ecc84c528fb6813d3d7 P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c126e4957640968340e01461ba12b2 in term 0.
I20260709 13:17:19.747195 10344 raft_consensus.cc:2804] T 9e1fdba60af24ecc84c528fb6813d3d7 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:19.747735 10344 raft_consensus.cc:493] T 9e1fdba60af24ecc84c528fb6813d3d7 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.748111 10344 raft_consensus.cc:3060] T 9e1fdba60af24ecc84c528fb6813d3d7 P e4c126e4957640968340e01461ba12b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.749629 10031 catalog_manager.cc:5697] T 40054610eaa9497494285ea9ca8ec1e5 P e4c126e4957640968340e01461ba12b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4c126e4957640968340e01461ba12b2 (127.2.198.194). New cstate: current_term: 1 leader_uuid: "e4c126e4957640968340e01461ba12b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:19.755929 10344 raft_consensus.cc:515] T 9e1fdba60af24ecc84c528fb6813d3d7 P e4c126e4957640968340e01461ba12b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.758116 10344 leader_election.cc:290] T 9e1fdba60af24ecc84c528fb6813d3d7 P e4c126e4957640968340e01461ba12b2 [CANDIDATE]: Term 1 election: Requested vote from peers 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957), 1a0996f2672c4594ab704b98217a662e (127.2.198.195:45579)
I20260709 13:17:19.758963 10133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1fdba60af24ecc84c528fb6813d3d7" candidate_uuid: "e4c126e4957640968340e01461ba12b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f4289676edb4b7c8fe897bafd84e935"
I20260709 13:17:19.759734 10133 raft_consensus.cc:3060] T 9e1fdba60af24ecc84c528fb6813d3d7 P 9f4289676edb4b7c8fe897bafd84e935 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.759161 10283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1fdba60af24ecc84c528fb6813d3d7" candidate_uuid: "e4c126e4957640968340e01461ba12b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a0996f2672c4594ab704b98217a662e"
I20260709 13:17:19.761636 10283 raft_consensus.cc:3060] T 9e1fdba60af24ecc84c528fb6813d3d7 P 1a0996f2672c4594ab704b98217a662e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.768509 10133 raft_consensus.cc:2468] T 9e1fdba60af24ecc84c528fb6813d3d7 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c126e4957640968340e01461ba12b2 in term 1.
I20260709 13:17:19.769789 10172 leader_election.cc:304] T 9e1fdba60af24ecc84c528fb6813d3d7 P e4c126e4957640968340e01461ba12b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f4289676edb4b7c8fe897bafd84e935, e4c126e4957640968340e01461ba12b2; no voters: 
I20260709 13:17:19.769891 10283 raft_consensus.cc:2468] T 9e1fdba60af24ecc84c528fb6813d3d7 P 1a0996f2672c4594ab704b98217a662e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c126e4957640968340e01461ba12b2 in term 1.
I20260709 13:17:19.770601 10344 raft_consensus.cc:2804] T 9e1fdba60af24ecc84c528fb6813d3d7 P e4c126e4957640968340e01461ba12b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:19.771162 10344 raft_consensus.cc:697] T 9e1fdba60af24ecc84c528fb6813d3d7 P e4c126e4957640968340e01461ba12b2 [term 1 LEADER]: Becoming Leader. State: Replica: e4c126e4957640968340e01461ba12b2, State: Running, Role: LEADER
I20260709 13:17:19.772001 10344 consensus_queue.cc:237] T 9e1fdba60af24ecc84c528fb6813d3d7 P e4c126e4957640968340e01461ba12b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:19.780498 10030 catalog_manager.cc:5697] T 9e1fdba60af24ecc84c528fb6813d3d7 P e4c126e4957640968340e01461ba12b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4c126e4957640968340e01461ba12b2 (127.2.198.194). New cstate: current_term: 1 leader_uuid: "e4c126e4957640968340e01461ba12b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:19.827634 10366 consensus_queue.cc:1048] T a410ccc6082d4335943afd658a181935 P 1a0996f2672c4594ab704b98217a662e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:19.837689 10369 consensus_queue.cc:1048] T a410ccc6082d4335943afd658a181935 P 1a0996f2672c4594ab704b98217a662e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:19.892153 10364 consensus_queue.cc:1048] T 632d0cca3448426a8b909ee924b0244f P 9f4289676edb4b7c8fe897bafd84e935 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:19.903571 10330 consensus_queue.cc:1048] T 632d0cca3448426a8b909ee924b0244f P 9f4289676edb4b7c8fe897bafd84e935 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:19.936908  2843 ts_manager.cc:295] Set tserver state for 9f4289676edb4b7c8fe897bafd84e935 to MAINTENANCE_MODE
I20260709 13:17:19.937810  2843 tablet_server.cc:179] TabletServer@127.2.198.193:0 shutting down...
I20260709 13:17:19.948868 10369 consensus_queue.cc:1048] T 5dea73a90f704a799d186b62cabf9383 P 1a0996f2672c4594ab704b98217a662e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:17:19.982827 10246 consensus_peers.cc:597] T 5dea73a90f704a799d186b62cabf9383 P 1a0996f2672c4594ab704b98217a662e -> Peer 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957): Couldn't send request to peer 9f4289676edb4b7c8fe897bafd84e935. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:19.986454  2843 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:19.988390  2843 tablet_replica.cc:333] T 5dea73a90f704a799d186b62cabf9383 P 9f4289676edb4b7c8fe897bafd84e935: stopping tablet replica
I20260709 13:17:19.989351  2843 raft_consensus.cc:2243] T 5dea73a90f704a799d186b62cabf9383 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:19.989969  2843 raft_consensus.cc:2272] T 5dea73a90f704a799d186b62cabf9383 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:19.992502  2843 tablet_replica.cc:333] T b2a40086010b440599041cd4935e5d86 P 9f4289676edb4b7c8fe897bafd84e935: stopping tablet replica
I20260709 13:17:19.993151  2843 raft_consensus.cc:2243] T b2a40086010b440599041cd4935e5d86 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:19.993562  2843 raft_consensus.cc:2272] T b2a40086010b440599041cd4935e5d86 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:19.995378  2843 tablet_replica.cc:333] T 24b88255bc1b4bfc94b15c94efa36a25 P 9f4289676edb4b7c8fe897bafd84e935: stopping tablet replica
I20260709 13:17:19.996025  2843 raft_consensus.cc:2243] T 24b88255bc1b4bfc94b15c94efa36a25 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:19.996673  2843 pending_rounds.cc:70] T 24b88255bc1b4bfc94b15c94efa36a25 P 9f4289676edb4b7c8fe897bafd84e935: Trying to abort 1 pending ops.
I20260709 13:17:19.996886  2843 pending_rounds.cc:77] T 24b88255bc1b4bfc94b15c94efa36a25 P 9f4289676edb4b7c8fe897bafd84e935: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305638050153353216 op_type: NO_OP noop_request { }
I20260709 13:17:19.997206  2843 raft_consensus.cc:2889] T 24b88255bc1b4bfc94b15c94efa36a25 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:17:19.997496  2843 raft_consensus.cc:2272] T 24b88255bc1b4bfc94b15c94efa36a25 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:20.000092  2843 tablet_replica.cc:333] T 40054610eaa9497494285ea9ca8ec1e5 P 9f4289676edb4b7c8fe897bafd84e935: stopping tablet replica
I20260709 13:17:20.000671  2843 raft_consensus.cc:2243] T 40054610eaa9497494285ea9ca8ec1e5 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:20.001051  2843 raft_consensus.cc:2272] T 40054610eaa9497494285ea9ca8ec1e5 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:20.002825  2843 tablet_replica.cc:333] T 632d0cca3448426a8b909ee924b0244f P 9f4289676edb4b7c8fe897bafd84e935: stopping tablet replica
I20260709 13:17:20.003499  2843 raft_consensus.cc:2243] T 632d0cca3448426a8b909ee924b0244f P 9f4289676edb4b7c8fe897bafd84e935 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:20.004621  2843 raft_consensus.cc:2272] T 632d0cca3448426a8b909ee924b0244f P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:20.005985 10246 consensus_peers.cc:597] T b2a40086010b440599041cd4935e5d86 P 1a0996f2672c4594ab704b98217a662e -> Peer 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957): Couldn't send request to peer 9f4289676edb4b7c8fe897bafd84e935. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:20.007261  2843 tablet_replica.cc:333] T 78042ece070249adabf7c5df20cb9980 P 9f4289676edb4b7c8fe897bafd84e935: stopping tablet replica
I20260709 13:17:20.007951  2843 raft_consensus.cc:2243] T 78042ece070249adabf7c5df20cb9980 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:20.008358  2843 raft_consensus.cc:2272] T 78042ece070249adabf7c5df20cb9980 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:20.010506  2843 tablet_replica.cc:333] T 7abb4eef5abd4a268cbebb6cebd4a051 P 9f4289676edb4b7c8fe897bafd84e935: stopping tablet replica
I20260709 13:17:20.011034  2843 raft_consensus.cc:2243] T 7abb4eef5abd4a268cbebb6cebd4a051 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:20.011370  2843 raft_consensus.cc:2272] T 7abb4eef5abd4a268cbebb6cebd4a051 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:20.013353  2843 tablet_replica.cc:333] T d6defd12940b429a875588ff72d9c61e P 9f4289676edb4b7c8fe897bafd84e935: stopping tablet replica
I20260709 13:17:20.013861  2843 raft_consensus.cc:2243] T d6defd12940b429a875588ff72d9c61e P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:20.014253  2843 raft_consensus.cc:2272] T d6defd12940b429a875588ff72d9c61e P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:20.016716  2843 tablet_replica.cc:333] T 9e1fdba60af24ecc84c528fb6813d3d7 P 9f4289676edb4b7c8fe897bafd84e935: stopping tablet replica
I20260709 13:17:20.017213  2843 raft_consensus.cc:2243] T 9e1fdba60af24ecc84c528fb6813d3d7 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:20.017539  2843 raft_consensus.cc:2272] T 9e1fdba60af24ecc84c528fb6813d3d7 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:20.019294  2843 tablet_replica.cc:333] T a410ccc6082d4335943afd658a181935 P 9f4289676edb4b7c8fe897bafd84e935: stopping tablet replica
I20260709 13:17:20.019824  2843 raft_consensus.cc:2243] T a410ccc6082d4335943afd658a181935 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:20.020200  2843 raft_consensus.cc:2272] T a410ccc6082d4335943afd658a181935 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:20.052735  2843 tablet_server.cc:196] TabletServer@127.2.198.193:0 shutdown complete.
W20260709 13:17:20.070212 10172 consensus_peers.cc:597] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2 -> Peer 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957): Couldn't send request to peer 9f4289676edb4b7c8fe897bafd84e935. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39957: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:20.141885 10324 consensus_queue.cc:1048] T 7abb4eef5abd4a268cbebb6cebd4a051 P e4c126e4957640968340e01461ba12b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:20.144548 10324 consensus_queue.cc:1048] T 40054610eaa9497494285ea9ca8ec1e5 P e4c126e4957640968340e01461ba12b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:17:20.163425 10172 consensus_peers.cc:597] T 7abb4eef5abd4a268cbebb6cebd4a051 P e4c126e4957640968340e01461ba12b2 -> Peer 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957): Couldn't send request to peer 9f4289676edb4b7c8fe897bafd84e935. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39957: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:20.165640 10080 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:17:20.167156 10172 consensus_peers.cc:597] T 40054610eaa9497494285ea9ca8ec1e5 P e4c126e4957640968340e01461ba12b2 -> Peer 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957): Couldn't send request to peer 9f4289676edb4b7c8fe897bafd84e935. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39957: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:20.222754 10344 consensus_queue.cc:1048] T 9e1fdba60af24ecc84c528fb6813d3d7 P e4c126e4957640968340e01461ba12b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:17:20.236560 10172 consensus_peers.cc:597] T 9e1fdba60af24ecc84c528fb6813d3d7 P e4c126e4957640968340e01461ba12b2 -> Peer 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957): Couldn't send request to peer 9f4289676edb4b7c8fe897bafd84e935. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39957: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:20.238092 10366 consensus_queue.cc:1048] T b2a40086010b440599041cd4935e5d86 P 1a0996f2672c4594ab704b98217a662e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:17:20.265098 10246 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39957: connect: Connection refused (error 111) [suppressed 262 similar messages]
W20260709 13:17:20.267473 10246 consensus_peers.cc:597] T a410ccc6082d4335943afd658a181935 P 1a0996f2672c4594ab704b98217a662e -> Peer 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957): Couldn't send request to peer 9f4289676edb4b7c8fe897bafd84e935. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39957: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:20.316303 10172 consensus_peers.cc:597] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 -> Peer 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957): Couldn't send request to peer 9f4289676edb4b7c8fe897bafd84e935. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39957: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:21.166898 10080 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:17:21.402312 10324 raft_consensus.cc:493] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f4289676edb4b7c8fe897bafd84e935)
I20260709 13:17:21.403056 10324 raft_consensus.cc:515] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:21.405136 10324 leader_election.cc:290] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957), 1a0996f2672c4594ab704b98217a662e (127.2.198.195:45579)
I20260709 13:17:21.406843 10282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632d0cca3448426a8b909ee924b0244f" candidate_uuid: "e4c126e4957640968340e01461ba12b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a0996f2672c4594ab704b98217a662e" is_pre_election: true
I20260709 13:17:21.407718 10282 raft_consensus.cc:2468] T 632d0cca3448426a8b909ee924b0244f P 1a0996f2672c4594ab704b98217a662e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c126e4957640968340e01461ba12b2 in term 1.
I20260709 13:17:21.408177 10366 raft_consensus.cc:493] T 632d0cca3448426a8b909ee924b0244f P 1a0996f2672c4594ab704b98217a662e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f4289676edb4b7c8fe897bafd84e935)
I20260709 13:17:21.408686 10366 raft_consensus.cc:515] T 632d0cca3448426a8b909ee924b0244f P 1a0996f2672c4594ab704b98217a662e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
W20260709 13:17:21.409263 10172 leader_election.cc:336] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39957: connect: Connection refused (error 111)
I20260709 13:17:21.410223 10172 leader_election.cc:304] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a0996f2672c4594ab704b98217a662e, e4c126e4957640968340e01461ba12b2; no voters: 9f4289676edb4b7c8fe897bafd84e935
I20260709 13:17:21.410745 10366 leader_election.cc:290] T 632d0cca3448426a8b909ee924b0244f P 1a0996f2672c4594ab704b98217a662e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957), e4c126e4957640968340e01461ba12b2 (127.2.198.194:39745)
I20260709 13:17:21.411408 10324 raft_consensus.cc:2804] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:21.411847 10324 raft_consensus.cc:493] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9f4289676edb4b7c8fe897bafd84e935)
I20260709 13:17:21.411989 10209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632d0cca3448426a8b909ee924b0244f" candidate_uuid: "1a0996f2672c4594ab704b98217a662e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c126e4957640968340e01461ba12b2" is_pre_election: true
I20260709 13:17:21.412281 10324 raft_consensus.cc:3060] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:21.414510 10246 leader_election.cc:336] T 632d0cca3448426a8b909ee924b0244f P 1a0996f2672c4594ab704b98217a662e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39957: connect: Connection refused (error 111)
I20260709 13:17:21.418349 10324 raft_consensus.cc:515] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:21.419482 10209 raft_consensus.cc:2393] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a0996f2672c4594ab704b98217a662e in current term 2: Already voted for candidate e4c126e4957640968340e01461ba12b2 in this term.
I20260709 13:17:21.420544 10324 leader_election.cc:290] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2 [CANDIDATE]: Term 2 election: Requested vote from peers 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957), 1a0996f2672c4594ab704b98217a662e (127.2.198.195:45579)
I20260709 13:17:21.421775 10248 leader_election.cc:304] T 632d0cca3448426a8b909ee924b0244f P 1a0996f2672c4594ab704b98217a662e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a0996f2672c4594ab704b98217a662e; no voters: 9f4289676edb4b7c8fe897bafd84e935, e4c126e4957640968340e01461ba12b2
I20260709 13:17:21.422252 10282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632d0cca3448426a8b909ee924b0244f" candidate_uuid: "e4c126e4957640968340e01461ba12b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a0996f2672c4594ab704b98217a662e"
I20260709 13:17:21.422693 10366 raft_consensus.cc:3060] T 632d0cca3448426a8b909ee924b0244f P 1a0996f2672c4594ab704b98217a662e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:21.424428 10172 leader_election.cc:336] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39957: connect: Connection refused (error 111)
I20260709 13:17:21.428931 10366 raft_consensus.cc:2749] T 632d0cca3448426a8b909ee924b0244f P 1a0996f2672c4594ab704b98217a662e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:21.434876 10282 raft_consensus.cc:2468] T 632d0cca3448426a8b909ee924b0244f P 1a0996f2672c4594ab704b98217a662e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c126e4957640968340e01461ba12b2 in term 2.
I20260709 13:17:21.436535 10172 leader_election.cc:304] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a0996f2672c4594ab704b98217a662e, e4c126e4957640968340e01461ba12b2; no voters: 9f4289676edb4b7c8fe897bafd84e935
I20260709 13:17:21.437256 10324 raft_consensus.cc:2804] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:21.438285 10324 raft_consensus.cc:697] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2 [term 2 LEADER]: Becoming Leader. State: Replica: e4c126e4957640968340e01461ba12b2, State: Running, Role: LEADER
I20260709 13:17:21.439188 10324 consensus_queue.cc:237] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:21.447956 10030 catalog_manager.cc:5697] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2 reported cstate change: term changed from 1 to 2, leader changed from 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193) to e4c126e4957640968340e01461ba12b2 (127.2.198.194). New cstate: current_term: 2 leader_uuid: "e4c126e4957640968340e01461ba12b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:21.631444 10366 raft_consensus.cc:493] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.632217 10366 raft_consensus.cc:515] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:21.634198 10366 leader_election.cc:290] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957), e4c126e4957640968340e01461ba12b2 (127.2.198.194:39745)
I20260709 13:17:21.635510 10209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b88255bc1b4bfc94b15c94efa36a25" candidate_uuid: "1a0996f2672c4594ab704b98217a662e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c126e4957640968340e01461ba12b2" is_pre_election: true
I20260709 13:17:21.636431 10209 raft_consensus.cc:2468] T 24b88255bc1b4bfc94b15c94efa36a25 P e4c126e4957640968340e01461ba12b2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a0996f2672c4594ab704b98217a662e in term 1.
I20260709 13:17:21.637660 10248 leader_election.cc:304] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a0996f2672c4594ab704b98217a662e, e4c126e4957640968340e01461ba12b2; no voters: 
I20260709 13:17:21.638561 10366 raft_consensus.cc:2804] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:17:21.638861 10246 leader_election.cc:336] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39957: connect: Connection refused (error 111)
I20260709 13:17:21.639012 10366 raft_consensus.cc:493] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:21.639530 10366 raft_consensus.cc:3060] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:21.646745 10366 raft_consensus.cc:515] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:21.648659 10366 leader_election.cc:290] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e [CANDIDATE]: Term 2 election: Requested vote from peers 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957), e4c126e4957640968340e01461ba12b2 (127.2.198.194:39745)
I20260709 13:17:21.649866 10209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b88255bc1b4bfc94b15c94efa36a25" candidate_uuid: "1a0996f2672c4594ab704b98217a662e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c126e4957640968340e01461ba12b2"
I20260709 13:17:21.650600 10209 raft_consensus.cc:3060] T 24b88255bc1b4bfc94b15c94efa36a25 P e4c126e4957640968340e01461ba12b2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:21.652841 10246 leader_election.cc:336] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957): Network error: Client connection negotiation failed: client connection to 127.2.198.193:39957: connect: Connection refused (error 111)
I20260709 13:17:21.657003 10209 raft_consensus.cc:2468] T 24b88255bc1b4bfc94b15c94efa36a25 P e4c126e4957640968340e01461ba12b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a0996f2672c4594ab704b98217a662e in term 2.
I20260709 13:17:21.658165 10248 leader_election.cc:304] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a0996f2672c4594ab704b98217a662e, e4c126e4957640968340e01461ba12b2; no voters: 9f4289676edb4b7c8fe897bafd84e935
I20260709 13:17:21.658859 10366 raft_consensus.cc:2804] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:21.659973 10366 raft_consensus.cc:697] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e [term 2 LEADER]: Becoming Leader. State: Replica: 1a0996f2672c4594ab704b98217a662e, State: Running, Role: LEADER
I20260709 13:17:21.660692 10366 consensus_queue.cc:237] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:21.669085 10030 catalog_manager.cc:5697] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e reported cstate change: term changed from 1 to 2, leader changed from 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193) to 1a0996f2672c4594ab704b98217a662e (127.2.198.195). New cstate: current_term: 2 leader_uuid: "1a0996f2672c4594ab704b98217a662e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:21.832783 10282 raft_consensus.cc:1275] T 632d0cca3448426a8b909ee924b0244f P 1a0996f2672c4594ab704b98217a662e [term 2 FOLLOWER]: Refusing update from remote peer e4c126e4957640968340e01461ba12b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:21.835861 10324 consensus_queue.cc:1048] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:17:21.852458 10172 consensus_peers.cc:597] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2 -> Peer 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957): Couldn't send request to peer 9f4289676edb4b7c8fe897bafd84e935. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39957: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:22.092442 10209 raft_consensus.cc:1275] T 24b88255bc1b4bfc94b15c94efa36a25 P e4c126e4957640968340e01461ba12b2 [term 2 FOLLOWER]: Refusing update from remote peer 1a0996f2672c4594ab704b98217a662e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:17:22.093954 10366 consensus_queue.cc:1048] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:17:22.109318 10246 consensus_peers.cc:597] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e -> Peer 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957): Couldn't send request to peer 9f4289676edb4b7c8fe897bafd84e935. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39957: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:22.168193 10080 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:17:22.257846 10246 consensus_peers.cc:597] T b2a40086010b440599041cd4935e5d86 P 1a0996f2672c4594ab704b98217a662e -> Peer 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957): Couldn't send request to peer 9f4289676edb4b7c8fe897bafd84e935. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39957: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:22.439661 10172 consensus_peers.cc:597] T 40054610eaa9497494285ea9ca8ec1e5 P e4c126e4957640968340e01461ba12b2 -> Peer 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957): Couldn't send request to peer 9f4289676edb4b7c8fe897bafd84e935. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39957: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:22.502398 10172 consensus_peers.cc:597] T 7abb4eef5abd4a268cbebb6cebd4a051 P e4c126e4957640968340e01461ba12b2 -> Peer 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957): Couldn't send request to peer 9f4289676edb4b7c8fe897bafd84e935. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39957: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:22.537885 10246 consensus_peers.cc:597] T a410ccc6082d4335943afd658a181935 P 1a0996f2672c4594ab704b98217a662e -> Peer 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957): Couldn't send request to peer 9f4289676edb4b7c8fe897bafd84e935. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39957: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:22.564594 10246 consensus_peers.cc:597] T 5dea73a90f704a799d186b62cabf9383 P 1a0996f2672c4594ab704b98217a662e -> Peer 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957): Couldn't send request to peer 9f4289676edb4b7c8fe897bafd84e935. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39957: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:22.639919 10172 consensus_peers.cc:597] T 9e1fdba60af24ecc84c528fb6813d3d7 P e4c126e4957640968340e01461ba12b2 -> Peer 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957): Couldn't send request to peer 9f4289676edb4b7c8fe897bafd84e935. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39957: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:22.642599 10172 consensus_peers.cc:597] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2 -> Peer 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957): Couldn't send request to peer 9f4289676edb4b7c8fe897bafd84e935. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39957: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:22.850476 10172 consensus_peers.cc:597] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 -> Peer 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957): Couldn't send request to peer 9f4289676edb4b7c8fe897bafd84e935. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39957: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:23.169776 10080 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:17:24.170845 10080 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:17:24.329764 10172 consensus_peers.cc:597] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2 -> Peer 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957): Couldn't send request to peer 9f4289676edb4b7c8fe897bafd84e935. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39957: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:24.464847 10246 consensus_peers.cc:597] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e -> Peer 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957): Couldn't send request to peer 9f4289676edb4b7c8fe897bafd84e935. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39957: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:24.804548 10246 consensus_peers.cc:597] T b2a40086010b440599041cd4935e5d86 P 1a0996f2672c4594ab704b98217a662e -> Peer 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957): Couldn't send request to peer 9f4289676edb4b7c8fe897bafd84e935. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:24.908174 10172 consensus_peers.cc:597] T 40054610eaa9497494285ea9ca8ec1e5 P e4c126e4957640968340e01461ba12b2 -> Peer 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957): Couldn't send request to peer 9f4289676edb4b7c8fe897bafd84e935. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:25.032284 10172 consensus_peers.cc:597] T 9e1fdba60af24ecc84c528fb6813d3d7 P e4c126e4957640968340e01461ba12b2 -> Peer 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957): Couldn't send request to peer 9f4289676edb4b7c8fe897bafd84e935. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:25.069437 10172 consensus_peers.cc:597] T 7abb4eef5abd4a268cbebb6cebd4a051 P e4c126e4957640968340e01461ba12b2 -> Peer 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957): Couldn't send request to peer 9f4289676edb4b7c8fe897bafd84e935. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:17:25.081060  2843 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:25.089607 10426 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:25.089885 10427 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:25.095515 10429 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:25.096542  2843 server_base.cc:1061] running on GCE node
I20260709 13:17:25.099136  2843 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:25.099409  2843 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:25.099623  2843 hybrid_clock.cc:648] HybridClock initialized: now 1783603045099597 us; error 0 us; skew 500 ppm
I20260709 13:17:25.100236  2843 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:25.103052  2843 webserver.cc:533] Webserver started at http://127.2.198.193:44069/ using document root <none> and password file <none>
I20260709 13:17:25.103679  2843 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:25.103894  2843 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:17:25.108992  2843 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.004s	sys 0.000s
W20260709 13:17:25.110275 10172 consensus_peers.cc:597] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2 -> Peer 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957): Couldn't send request to peer 9f4289676edb4b7c8fe897bafd84e935. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:17:25.113745 10434 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:25.114683  2843 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.001s
I20260709 13:17:25.115007  2843 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602804652623-2843-0/minicluster-data/ts-0-root
uuid: "9f4289676edb4b7c8fe897bafd84e935"
format_stamp: "Formatted at 2026-07-09 13:17:18 on dist-test-slave-fc6v"
I20260709 13:17:25.115407  2843 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602804652623-2843-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602804652623-2843-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602804652623-2843-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 13:17:25.122728 10246 consensus_peers.cc:597] T a410ccc6082d4335943afd658a181935 P 1a0996f2672c4594ab704b98217a662e -> Peer 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957): Couldn't send request to peer 9f4289676edb4b7c8fe897bafd84e935. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:17:25.133251  2843 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:25.134898  2843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:25.136667  2843 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:25.140946 10441 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 13:17:25.171923 10080 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:17:25.197737  2843 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:17:25.198225  2843 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.058s	user 0.003s	sys 0.000s
I20260709 13:17:25.198588  2843 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:17:25.205080 10441 tablet_bootstrap.cc:492] T 24b88255bc1b4bfc94b15c94efa36a25 P 9f4289676edb4b7c8fe897bafd84e935: Bootstrap starting.
I20260709 13:17:25.219362 10441 tablet_bootstrap.cc:492] T 24b88255bc1b4bfc94b15c94efa36a25 P 9f4289676edb4b7c8fe897bafd84e935: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:17:25.220256 10441 tablet_bootstrap.cc:492] T 24b88255bc1b4bfc94b15c94efa36a25 P 9f4289676edb4b7c8fe897bafd84e935: Bootstrap complete.
I20260709 13:17:25.220923 10441 ts_tablet_manager.cc:1403] T 24b88255bc1b4bfc94b15c94efa36a25 P 9f4289676edb4b7c8fe897bafd84e935: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 13:17:25.223383 10441 raft_consensus.cc:359] T 24b88255bc1b4bfc94b15c94efa36a25 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:25.224454 10441 raft_consensus.cc:740] T 24b88255bc1b4bfc94b15c94efa36a25 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f4289676edb4b7c8fe897bafd84e935, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.225143 10441 consensus_queue.cc:260] T 24b88255bc1b4bfc94b15c94efa36a25 P 9f4289676edb4b7c8fe897bafd84e935 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:25.227993 10441 ts_tablet_manager.cc:1434] T 24b88255bc1b4bfc94b15c94efa36a25 P 9f4289676edb4b7c8fe897bafd84e935: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.005s
I20260709 13:17:25.228744 10441 tablet_bootstrap.cc:492] T 40054610eaa9497494285ea9ca8ec1e5 P 9f4289676edb4b7c8fe897bafd84e935: Bootstrap starting.
I20260709 13:17:25.240624 10441 tablet_bootstrap.cc:492] T 40054610eaa9497494285ea9ca8ec1e5 P 9f4289676edb4b7c8fe897bafd84e935: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:25.241382 10441 tablet_bootstrap.cc:492] T 40054610eaa9497494285ea9ca8ec1e5 P 9f4289676edb4b7c8fe897bafd84e935: Bootstrap complete.
I20260709 13:17:25.241693  2843 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:17:25.242025 10441 ts_tablet_manager.cc:1403] T 40054610eaa9497494285ea9ca8ec1e5 P 9f4289676edb4b7c8fe897bafd84e935: Time spent bootstrapping tablet: real 0.013s	user 0.004s	sys 0.007s
I20260709 13:17:25.242086  2843 ts_tablet_manager.cc:595] Time spent register tablets: real 0.043s	user 0.031s	sys 0.011s
I20260709 13:17:25.245327 10441 raft_consensus.cc:359] T 40054610eaa9497494285ea9ca8ec1e5 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:25.246179 10441 raft_consensus.cc:740] T 40054610eaa9497494285ea9ca8ec1e5 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f4289676edb4b7c8fe897bafd84e935, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.246901 10441 consensus_queue.cc:260] T 40054610eaa9497494285ea9ca8ec1e5 P 9f4289676edb4b7c8fe897bafd84e935 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:25.248849 10441 ts_tablet_manager.cc:1434] T 40054610eaa9497494285ea9ca8ec1e5 P 9f4289676edb4b7c8fe897bafd84e935: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.004s
I20260709 13:17:25.249549 10441 tablet_bootstrap.cc:492] T 9e1fdba60af24ecc84c528fb6813d3d7 P 9f4289676edb4b7c8fe897bafd84e935: Bootstrap starting.
I20260709 13:17:25.264777 10441 tablet_bootstrap.cc:492] T 9e1fdba60af24ecc84c528fb6813d3d7 P 9f4289676edb4b7c8fe897bafd84e935: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:25.265556 10441 tablet_bootstrap.cc:492] T 9e1fdba60af24ecc84c528fb6813d3d7 P 9f4289676edb4b7c8fe897bafd84e935: Bootstrap complete.
I20260709 13:17:25.266291 10441 ts_tablet_manager.cc:1403] T 9e1fdba60af24ecc84c528fb6813d3d7 P 9f4289676edb4b7c8fe897bafd84e935: Time spent bootstrapping tablet: real 0.017s	user 0.005s	sys 0.009s
I20260709 13:17:25.269052 10441 raft_consensus.cc:359] T 9e1fdba60af24ecc84c528fb6813d3d7 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:25.269650 10441 raft_consensus.cc:740] T 9e1fdba60af24ecc84c528fb6813d3d7 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f4289676edb4b7c8fe897bafd84e935, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.270418 10441 consensus_queue.cc:260] T 9e1fdba60af24ecc84c528fb6813d3d7 P 9f4289676edb4b7c8fe897bafd84e935 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:25.272657 10441 ts_tablet_manager.cc:1434] T 9e1fdba60af24ecc84c528fb6813d3d7 P 9f4289676edb4b7c8fe897bafd84e935: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.002s
I20260709 13:17:25.273672 10441 tablet_bootstrap.cc:492] T d6defd12940b429a875588ff72d9c61e P 9f4289676edb4b7c8fe897bafd84e935: Bootstrap starting.
W20260709 13:17:25.275630 10246 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39957: connect: Connection refused (error 111) [suppressed 98 similar messages]
I20260709 13:17:25.296639 10441 tablet_bootstrap.cc:492] T d6defd12940b429a875588ff72d9c61e P 9f4289676edb4b7c8fe897bafd84e935: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:25.297884 10441 tablet_bootstrap.cc:492] T d6defd12940b429a875588ff72d9c61e P 9f4289676edb4b7c8fe897bafd84e935: Bootstrap complete.
I20260709 13:17:25.298595 10441 ts_tablet_manager.cc:1403] T d6defd12940b429a875588ff72d9c61e P 9f4289676edb4b7c8fe897bafd84e935: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.006s
I20260709 13:17:25.303241 10441 raft_consensus.cc:359] T d6defd12940b429a875588ff72d9c61e P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:25.304081 10441 raft_consensus.cc:740] T d6defd12940b429a875588ff72d9c61e P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f4289676edb4b7c8fe897bafd84e935, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.304853 10441 consensus_queue.cc:260] T d6defd12940b429a875588ff72d9c61e P 9f4289676edb4b7c8fe897bafd84e935 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
W20260709 13:17:25.306479 10246 consensus_peers.cc:597] T 5dea73a90f704a799d186b62cabf9383 P 1a0996f2672c4594ab704b98217a662e -> Peer 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957): Couldn't send request to peer 9f4289676edb4b7c8fe897bafd84e935. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39957: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:17:25.307241 10441 ts_tablet_manager.cc:1434] T d6defd12940b429a875588ff72d9c61e P 9f4289676edb4b7c8fe897bafd84e935: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:17:25.308430 10441 tablet_bootstrap.cc:492] T 632d0cca3448426a8b909ee924b0244f P 9f4289676edb4b7c8fe897bafd84e935: Bootstrap starting.
I20260709 13:17:25.322309  2843 rpc_server.cc:307] RPC server started. Bound to: 127.2.198.193:39957
I20260709 13:17:25.322383 10503 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.198.193:39957 every 8 connection(s)
I20260709 13:17:25.328727  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:25.328928 10441 tablet_bootstrap.cc:492] T 632d0cca3448426a8b909ee924b0244f P 9f4289676edb4b7c8fe897bafd84e935: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:25.330066 10441 tablet_bootstrap.cc:492] T 632d0cca3448426a8b909ee924b0244f P 9f4289676edb4b7c8fe897bafd84e935: Bootstrap complete.
I20260709 13:17:25.330875 10441 ts_tablet_manager.cc:1403] T 632d0cca3448426a8b909ee924b0244f P 9f4289676edb4b7c8fe897bafd84e935: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.006s
I20260709 13:17:25.333956 10441 raft_consensus.cc:359] T 632d0cca3448426a8b909ee924b0244f P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:25.334766 10441 raft_consensus.cc:740] T 632d0cca3448426a8b909ee924b0244f P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f4289676edb4b7c8fe897bafd84e935, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.335650 10441 consensus_queue.cc:260] T 632d0cca3448426a8b909ee924b0244f P 9f4289676edb4b7c8fe897bafd84e935 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:25.337905 10441 ts_tablet_manager.cc:1434] T 632d0cca3448426a8b909ee924b0244f P 9f4289676edb4b7c8fe897bafd84e935: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:17:25.338847 10441 tablet_bootstrap.cc:492] T b2a40086010b440599041cd4935e5d86 P 9f4289676edb4b7c8fe897bafd84e935: Bootstrap starting.
I20260709 13:17:25.356016 10209 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7abb4eef5abd4a268cbebb6cebd4a051"
dest_uuid: "e4c126e4957640968340e01461ba12b2"
mode: GRACEFUL
new_leader_uuid: "1a0996f2672c4594ab704b98217a662e"
 from {username='slave'} at 127.0.0.1:40216
I20260709 13:17:25.357039 10209 raft_consensus.cc:606] T 7abb4eef5abd4a268cbebb6cebd4a051 P e4c126e4957640968340e01461ba12b2 [term 1 LEADER]: Received request to transfer leadership to TS 1a0996f2672c4594ab704b98217a662e
I20260709 13:17:25.357672 10505 heartbeater.cc:344] Connected to a master server at 127.2.198.254:34125
I20260709 13:17:25.358217 10505 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:25.358549 10441 tablet_bootstrap.cc:492] T b2a40086010b440599041cd4935e5d86 P 9f4289676edb4b7c8fe897bafd84e935: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:25.359184 10505 heartbeater.cc:507] Master 127.2.198.254:34125 requested a full tablet report, sending...
I20260709 13:17:25.359524 10441 tablet_bootstrap.cc:492] T b2a40086010b440599041cd4935e5d86 P 9f4289676edb4b7c8fe897bafd84e935: Bootstrap complete.
I20260709 13:17:25.360244 10441 ts_tablet_manager.cc:1403] T b2a40086010b440599041cd4935e5d86 P 9f4289676edb4b7c8fe897bafd84e935: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.011s
I20260709 13:17:25.360478 10209 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e1fdba60af24ecc84c528fb6813d3d7"
dest_uuid: "e4c126e4957640968340e01461ba12b2"
mode: GRACEFUL
new_leader_uuid: "1a0996f2672c4594ab704b98217a662e"
 from {username='slave'} at 127.0.0.1:40216
I20260709 13:17:25.361172 10209 raft_consensus.cc:606] T 9e1fdba60af24ecc84c528fb6813d3d7 P e4c126e4957640968340e01461ba12b2 [term 1 LEADER]: Received request to transfer leadership to TS 1a0996f2672c4594ab704b98217a662e
I20260709 13:17:25.362406  2843 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:17:25.363070  2843 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:25.363165 10441 raft_consensus.cc:359] T b2a40086010b440599041cd4935e5d86 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:25.363931 10441 raft_consensus.cc:740] T b2a40086010b440599041cd4935e5d86 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f4289676edb4b7c8fe897bafd84e935, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.364035  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:25.364756 10441 consensus_queue.cc:260] T b2a40086010b440599041cd4935e5d86 P 9f4289676edb4b7c8fe897bafd84e935 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:25.365877 10030 ts_manager.cc:194] Re-registered known tserver with Master: 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957)
I20260709 13:17:25.366933 10441 ts_tablet_manager.cc:1434] T b2a40086010b440599041cd4935e5d86 P 9f4289676edb4b7c8fe897bafd84e935: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260709 13:17:25.367849 10441 tablet_bootstrap.cc:492] T 5dea73a90f704a799d186b62cabf9383 P 9f4289676edb4b7c8fe897bafd84e935: Bootstrap starting.
I20260709 13:17:25.374696 10030 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56486
I20260709 13:17:25.378011 10505 heartbeater.cc:499] Master 127.2.198.254:34125 was elected leader, sending a full tablet report...
I20260709 13:17:25.380918 10441 tablet_bootstrap.cc:492] T 5dea73a90f704a799d186b62cabf9383 P 9f4289676edb4b7c8fe897bafd84e935: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:25.381608 10441 tablet_bootstrap.cc:492] T 5dea73a90f704a799d186b62cabf9383 P 9f4289676edb4b7c8fe897bafd84e935: Bootstrap complete.
I20260709 13:17:25.382182 10441 ts_tablet_manager.cc:1403] T 5dea73a90f704a799d186b62cabf9383 P 9f4289676edb4b7c8fe897bafd84e935: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.001s
I20260709 13:17:25.384326 10441 raft_consensus.cc:359] T 5dea73a90f704a799d186b62cabf9383 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:25.384840 10441 raft_consensus.cc:740] T 5dea73a90f704a799d186b62cabf9383 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f4289676edb4b7c8fe897bafd84e935, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.385514 10441 consensus_queue.cc:260] T 5dea73a90f704a799d186b62cabf9383 P 9f4289676edb4b7c8fe897bafd84e935 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:25.387058 10441 ts_tablet_manager.cc:1434] T 5dea73a90f704a799d186b62cabf9383 P 9f4289676edb4b7c8fe897bafd84e935: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:17:25.387844 10441 tablet_bootstrap.cc:492] T 78042ece070249adabf7c5df20cb9980 P 9f4289676edb4b7c8fe897bafd84e935: Bootstrap starting.
I20260709 13:17:25.401036 10441 tablet_bootstrap.cc:492] T 78042ece070249adabf7c5df20cb9980 P 9f4289676edb4b7c8fe897bafd84e935: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:25.401841 10441 tablet_bootstrap.cc:492] T 78042ece070249adabf7c5df20cb9980 P 9f4289676edb4b7c8fe897bafd84e935: Bootstrap complete.
I20260709 13:17:25.402406 10441 ts_tablet_manager.cc:1403] T 78042ece070249adabf7c5df20cb9980 P 9f4289676edb4b7c8fe897bafd84e935: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.001s
I20260709 13:17:25.404425 10441 raft_consensus.cc:359] T 78042ece070249adabf7c5df20cb9980 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:25.404940 10441 raft_consensus.cc:740] T 78042ece070249adabf7c5df20cb9980 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f4289676edb4b7c8fe897bafd84e935, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.405526 10441 consensus_queue.cc:260] T 78042ece070249adabf7c5df20cb9980 P 9f4289676edb4b7c8fe897bafd84e935 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:25.406985 10441 ts_tablet_manager.cc:1434] T 78042ece070249adabf7c5df20cb9980 P 9f4289676edb4b7c8fe897bafd84e935: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:17:25.408001 10441 tablet_bootstrap.cc:492] T 7abb4eef5abd4a268cbebb6cebd4a051 P 9f4289676edb4b7c8fe897bafd84e935: Bootstrap starting.
I20260709 13:17:25.421314 10441 tablet_bootstrap.cc:492] T 7abb4eef5abd4a268cbebb6cebd4a051 P 9f4289676edb4b7c8fe897bafd84e935: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:25.422029 10441 tablet_bootstrap.cc:492] T 7abb4eef5abd4a268cbebb6cebd4a051 P 9f4289676edb4b7c8fe897bafd84e935: Bootstrap complete.
I20260709 13:17:25.422608 10441 ts_tablet_manager.cc:1403] T 7abb4eef5abd4a268cbebb6cebd4a051 P 9f4289676edb4b7c8fe897bafd84e935: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:17:25.424685 10441 raft_consensus.cc:359] T 7abb4eef5abd4a268cbebb6cebd4a051 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:25.425212 10441 raft_consensus.cc:740] T 7abb4eef5abd4a268cbebb6cebd4a051 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f4289676edb4b7c8fe897bafd84e935, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.425813 10441 consensus_queue.cc:260] T 7abb4eef5abd4a268cbebb6cebd4a051 P 9f4289676edb4b7c8fe897bafd84e935 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:25.427767 10441 ts_tablet_manager.cc:1434] T 7abb4eef5abd4a268cbebb6cebd4a051 P 9f4289676edb4b7c8fe897bafd84e935: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:17:25.428689 10441 tablet_bootstrap.cc:492] T a410ccc6082d4335943afd658a181935 P 9f4289676edb4b7c8fe897bafd84e935: Bootstrap starting.
I20260709 13:17:25.444079 10441 tablet_bootstrap.cc:492] T a410ccc6082d4335943afd658a181935 P 9f4289676edb4b7c8fe897bafd84e935: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:25.444947 10441 tablet_bootstrap.cc:492] T a410ccc6082d4335943afd658a181935 P 9f4289676edb4b7c8fe897bafd84e935: Bootstrap complete.
I20260709 13:17:25.445523 10441 ts_tablet_manager.cc:1403] T a410ccc6082d4335943afd658a181935 P 9f4289676edb4b7c8fe897bafd84e935: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 13:17:25.447736 10441 raft_consensus.cc:359] T a410ccc6082d4335943afd658a181935 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:25.448264 10441 raft_consensus.cc:740] T a410ccc6082d4335943afd658a181935 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f4289676edb4b7c8fe897bafd84e935, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.448839 10441 consensus_queue.cc:260] T a410ccc6082d4335943afd658a181935 P 9f4289676edb4b7c8fe897bafd84e935 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:25.450704 10441 ts_tablet_manager.cc:1434] T a410ccc6082d4335943afd658a181935 P 9f4289676edb4b7c8fe897bafd84e935: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:17:25.489151 10477 raft_consensus.cc:3060] T 24b88255bc1b4bfc94b15c94efa36a25 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:25.499317 10477 pending_rounds.cc:85] T 24b88255bc1b4bfc94b15c94efa36a25 P 9f4289676edb4b7c8fe897bafd84e935: Aborting all ops after (but not including) 0
I20260709 13:17:25.499655 10477 pending_rounds.cc:107] T 24b88255bc1b4bfc94b15c94efa36a25 P 9f4289676edb4b7c8fe897bafd84e935: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:17:25.499987 10477 raft_consensus.cc:2889] T 24b88255bc1b4bfc94b15c94efa36a25 P 9f4289676edb4b7c8fe897bafd84e935 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:25.603434 10423 raft_consensus.cc:993] T 9e1fdba60af24ecc84c528fb6813d3d7 P e4c126e4957640968340e01461ba12b2: : Instructing follower 1a0996f2672c4594ab704b98217a662e to start an election
I20260709 13:17:25.604094 10478 raft_consensus.cc:1081] T 9e1fdba60af24ecc84c528fb6813d3d7 P e4c126e4957640968340e01461ba12b2 [term 1 LEADER]: Signalling peer 1a0996f2672c4594ab704b98217a662e to start an election
I20260709 13:17:25.605688 10283 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e1fdba60af24ecc84c528fb6813d3d7"
dest_uuid: "1a0996f2672c4594ab704b98217a662e"
 from {username='slave'} at 127.0.0.1:55410
I20260709 13:17:25.606174 10283 raft_consensus.cc:493] T 9e1fdba60af24ecc84c528fb6813d3d7 P 1a0996f2672c4594ab704b98217a662e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:25.606463 10283 raft_consensus.cc:3060] T 9e1fdba60af24ecc84c528fb6813d3d7 P 1a0996f2672c4594ab704b98217a662e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:25.614480 10283 raft_consensus.cc:515] T 9e1fdba60af24ecc84c528fb6813d3d7 P 1a0996f2672c4594ab704b98217a662e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:25.617100 10283 leader_election.cc:290] T 9e1fdba60af24ecc84c528fb6813d3d7 P 1a0996f2672c4594ab704b98217a662e [CANDIDATE]: Term 2 election: Requested vote from peers 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957), e4c126e4957640968340e01461ba12b2 (127.2.198.194:39745)
I20260709 13:17:25.618150 10477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1fdba60af24ecc84c528fb6813d3d7" candidate_uuid: "1a0996f2672c4594ab704b98217a662e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f4289676edb4b7c8fe897bafd84e935"
I20260709 13:17:25.619102 10477 raft_consensus.cc:3060] T 9e1fdba60af24ecc84c528fb6813d3d7 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:25.619908 10209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1fdba60af24ecc84c528fb6813d3d7" candidate_uuid: "1a0996f2672c4594ab704b98217a662e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4c126e4957640968340e01461ba12b2"
I20260709 13:17:25.620642 10209 raft_consensus.cc:3055] T 9e1fdba60af24ecc84c528fb6813d3d7 P e4c126e4957640968340e01461ba12b2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:25.620983 10209 raft_consensus.cc:740] T 9e1fdba60af24ecc84c528fb6813d3d7 P e4c126e4957640968340e01461ba12b2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4c126e4957640968340e01461ba12b2, State: Running, Role: LEADER
I20260709 13:17:25.621937 10209 consensus_queue.cc:260] T 9e1fdba60af24ecc84c528fb6813d3d7 P e4c126e4957640968340e01461ba12b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:25.623219 10209 raft_consensus.cc:3060] T 9e1fdba60af24ecc84c528fb6813d3d7 P e4c126e4957640968340e01461ba12b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:25.625926 10477 raft_consensus.cc:2468] T 9e1fdba60af24ecc84c528fb6813d3d7 P 9f4289676edb4b7c8fe897bafd84e935 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a0996f2672c4594ab704b98217a662e in term 2.
I20260709 13:17:25.627092 10246 leader_election.cc:304] T 9e1fdba60af24ecc84c528fb6813d3d7 P 1a0996f2672c4594ab704b98217a662e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a0996f2672c4594ab704b98217a662e, 9f4289676edb4b7c8fe897bafd84e935; no voters: 
I20260709 13:17:25.628018 10415 raft_consensus.cc:2804] T 9e1fdba60af24ecc84c528fb6813d3d7 P 1a0996f2672c4594ab704b98217a662e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:25.629130 10415 raft_consensus.cc:697] T 9e1fdba60af24ecc84c528fb6813d3d7 P 1a0996f2672c4594ab704b98217a662e [term 2 LEADER]: Becoming Leader. State: Replica: 1a0996f2672c4594ab704b98217a662e, State: Running, Role: LEADER
I20260709 13:17:25.629832 10209 raft_consensus.cc:2468] T 9e1fdba60af24ecc84c528fb6813d3d7 P e4c126e4957640968340e01461ba12b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a0996f2672c4594ab704b98217a662e in term 2.
I20260709 13:17:25.630281 10415 consensus_queue.cc:237] T 9e1fdba60af24ecc84c528fb6813d3d7 P 1a0996f2672c4594ab704b98217a662e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:25.638278 10030 catalog_manager.cc:5697] T 9e1fdba60af24ecc84c528fb6813d3d7 P 1a0996f2672c4594ab704b98217a662e reported cstate change: term changed from 1 to 2, leader changed from e4c126e4957640968340e01461ba12b2 (127.2.198.194) to 1a0996f2672c4594ab704b98217a662e (127.2.198.195). New cstate: current_term: 2 leader_uuid: "1a0996f2672c4594ab704b98217a662e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:25.698148 10477 raft_consensus.cc:3060] T 632d0cca3448426a8b909ee924b0244f P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:25.915012 10478 raft_consensus.cc:993] T 7abb4eef5abd4a268cbebb6cebd4a051 P e4c126e4957640968340e01461ba12b2: : Instructing follower 1a0996f2672c4594ab704b98217a662e to start an election
I20260709 13:17:25.915484 10423 raft_consensus.cc:1081] T 7abb4eef5abd4a268cbebb6cebd4a051 P e4c126e4957640968340e01461ba12b2 [term 1 LEADER]: Signalling peer 1a0996f2672c4594ab704b98217a662e to start an election
I20260709 13:17:25.917126 10282 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7abb4eef5abd4a268cbebb6cebd4a051"
dest_uuid: "1a0996f2672c4594ab704b98217a662e"
 from {username='slave'} at 127.0.0.1:55410
I20260709 13:17:25.917631 10282 raft_consensus.cc:493] T 7abb4eef5abd4a268cbebb6cebd4a051 P 1a0996f2672c4594ab704b98217a662e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:25.917917 10282 raft_consensus.cc:3060] T 7abb4eef5abd4a268cbebb6cebd4a051 P 1a0996f2672c4594ab704b98217a662e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:25.924978 10282 raft_consensus.cc:515] T 7abb4eef5abd4a268cbebb6cebd4a051 P 1a0996f2672c4594ab704b98217a662e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:25.926853 10282 leader_election.cc:290] T 7abb4eef5abd4a268cbebb6cebd4a051 P 1a0996f2672c4594ab704b98217a662e [CANDIDATE]: Term 2 election: Requested vote from peers 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957), e4c126e4957640968340e01461ba12b2 (127.2.198.194:39745)
I20260709 13:17:25.927693 10477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abb4eef5abd4a268cbebb6cebd4a051" candidate_uuid: "1a0996f2672c4594ab704b98217a662e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f4289676edb4b7c8fe897bafd84e935"
I20260709 13:17:25.927845 10209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abb4eef5abd4a268cbebb6cebd4a051" candidate_uuid: "1a0996f2672c4594ab704b98217a662e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4c126e4957640968340e01461ba12b2"
I20260709 13:17:25.928484 10477 raft_consensus.cc:3060] T 7abb4eef5abd4a268cbebb6cebd4a051 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:25.928555 10209 raft_consensus.cc:3055] T 7abb4eef5abd4a268cbebb6cebd4a051 P e4c126e4957640968340e01461ba12b2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:25.928989 10209 raft_consensus.cc:740] T 7abb4eef5abd4a268cbebb6cebd4a051 P e4c126e4957640968340e01461ba12b2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4c126e4957640968340e01461ba12b2, State: Running, Role: LEADER
I20260709 13:17:25.929741 10209 consensus_queue.cc:260] T 7abb4eef5abd4a268cbebb6cebd4a051 P e4c126e4957640968340e01461ba12b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:25.930786 10209 raft_consensus.cc:3060] T 7abb4eef5abd4a268cbebb6cebd4a051 P e4c126e4957640968340e01461ba12b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:25.934387 10477 raft_consensus.cc:2468] T 7abb4eef5abd4a268cbebb6cebd4a051 P 9f4289676edb4b7c8fe897bafd84e935 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a0996f2672c4594ab704b98217a662e in term 2.
I20260709 13:17:25.935650 10246 leader_election.cc:304] T 7abb4eef5abd4a268cbebb6cebd4a051 P 1a0996f2672c4594ab704b98217a662e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a0996f2672c4594ab704b98217a662e, 9f4289676edb4b7c8fe897bafd84e935; no voters: 
I20260709 13:17:25.936470 10415 raft_consensus.cc:2804] T 7abb4eef5abd4a268cbebb6cebd4a051 P 1a0996f2672c4594ab704b98217a662e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:25.936791 10209 raft_consensus.cc:2468] T 7abb4eef5abd4a268cbebb6cebd4a051 P e4c126e4957640968340e01461ba12b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a0996f2672c4594ab704b98217a662e in term 2.
I20260709 13:17:25.936913 10415 raft_consensus.cc:697] T 7abb4eef5abd4a268cbebb6cebd4a051 P 1a0996f2672c4594ab704b98217a662e [term 2 LEADER]: Becoming Leader. State: Replica: 1a0996f2672c4594ab704b98217a662e, State: Running, Role: LEADER
I20260709 13:17:25.938124 10415 consensus_queue.cc:237] T 7abb4eef5abd4a268cbebb6cebd4a051 P 1a0996f2672c4594ab704b98217a662e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:25.946008 10030 catalog_manager.cc:5697] T 7abb4eef5abd4a268cbebb6cebd4a051 P 1a0996f2672c4594ab704b98217a662e reported cstate change: term changed from 1 to 2, leader changed from e4c126e4957640968340e01461ba12b2 (127.2.198.194) to 1a0996f2672c4594ab704b98217a662e (127.2.198.195). New cstate: current_term: 2 leader_uuid: "1a0996f2672c4594ab704b98217a662e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:26.086197 10477 raft_consensus.cc:1275] T 9e1fdba60af24ecc84c528fb6813d3d7 P 9f4289676edb4b7c8fe897bafd84e935 [term 2 FOLLOWER]: Refusing update from remote peer 1a0996f2672c4594ab704b98217a662e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:26.087657 10534 consensus_queue.cc:1048] T 9e1fdba60af24ecc84c528fb6813d3d7 P 1a0996f2672c4594ab704b98217a662e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:26.098163 10209 raft_consensus.cc:1275] T 9e1fdba60af24ecc84c528fb6813d3d7 P e4c126e4957640968340e01461ba12b2 [term 2 FOLLOWER]: Refusing update from remote peer 1a0996f2672c4594ab704b98217a662e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:26.099712 10523 consensus_queue.cc:1048] T 9e1fdba60af24ecc84c528fb6813d3d7 P 1a0996f2672c4594ab704b98217a662e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:17:26.173327 10080 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:17:26.374982  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:26.392802 10282 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24b88255bc1b4bfc94b15c94efa36a25"
dest_uuid: "1a0996f2672c4594ab704b98217a662e"
mode: GRACEFUL
new_leader_uuid: "e4c126e4957640968340e01461ba12b2"
 from {username='slave'} at 127.0.0.1:36824
I20260709 13:17:26.393428 10282 raft_consensus.cc:606] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e [term 2 LEADER]: Received request to transfer leadership to TS e4c126e4957640968340e01461ba12b2
I20260709 13:17:26.396169 10282 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e1fdba60af24ecc84c528fb6813d3d7"
dest_uuid: "1a0996f2672c4594ab704b98217a662e"
mode: GRACEFUL
new_leader_uuid: "e4c126e4957640968340e01461ba12b2"
 from {username='slave'} at 127.0.0.1:36824
I20260709 13:17:26.396688 10282 raft_consensus.cc:606] T 9e1fdba60af24ecc84c528fb6813d3d7 P 1a0996f2672c4594ab704b98217a662e [term 2 LEADER]: Received request to transfer leadership to TS e4c126e4957640968340e01461ba12b2
I20260709 13:17:26.399209 10208 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6defd12940b429a875588ff72d9c61e"
dest_uuid: "e4c126e4957640968340e01461ba12b2"
mode: GRACEFUL
new_leader_uuid: "1a0996f2672c4594ab704b98217a662e"
 from {username='slave'} at 127.0.0.1:40216
I20260709 13:17:26.399761 10208 raft_consensus.cc:606] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 [term 1 LEADER]: Received request to transfer leadership to TS 1a0996f2672c4594ab704b98217a662e
I20260709 13:17:26.400892  2843 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:17:26.401417  2843 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:26.402034  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:26.465405 10477 raft_consensus.cc:1275] T 7abb4eef5abd4a268cbebb6cebd4a051 P 9f4289676edb4b7c8fe897bafd84e935 [term 2 FOLLOWER]: Refusing update from remote peer 1a0996f2672c4594ab704b98217a662e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:26.466861 10415 consensus_queue.cc:1048] T 7abb4eef5abd4a268cbebb6cebd4a051 P 1a0996f2672c4594ab704b98217a662e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:26.474905 10208 raft_consensus.cc:1275] T 7abb4eef5abd4a268cbebb6cebd4a051 P e4c126e4957640968340e01461ba12b2 [term 2 FOLLOWER]: Refusing update from remote peer 1a0996f2672c4594ab704b98217a662e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:26.479215 10534 consensus_queue.cc:1048] T 7abb4eef5abd4a268cbebb6cebd4a051 P 1a0996f2672c4594ab704b98217a662e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:26.675771 10523 raft_consensus.cc:993] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e: : Instructing follower e4c126e4957640968340e01461ba12b2 to start an election
I20260709 13:17:26.676312 10534 raft_consensus.cc:1081] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e [term 2 LEADER]: Signalling peer e4c126e4957640968340e01461ba12b2 to start an election
I20260709 13:17:26.677650 10208 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "24b88255bc1b4bfc94b15c94efa36a25"
dest_uuid: "e4c126e4957640968340e01461ba12b2"
 from {username='slave'} at 127.0.0.1:46458
I20260709 13:17:26.678158 10208 raft_consensus.cc:493] T 24b88255bc1b4bfc94b15c94efa36a25 P e4c126e4957640968340e01461ba12b2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:26.678463 10208 raft_consensus.cc:3060] T 24b88255bc1b4bfc94b15c94efa36a25 P e4c126e4957640968340e01461ba12b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:26.684736 10208 raft_consensus.cc:515] T 24b88255bc1b4bfc94b15c94efa36a25 P e4c126e4957640968340e01461ba12b2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:26.686407 10208 leader_election.cc:290] T 24b88255bc1b4bfc94b15c94efa36a25 P e4c126e4957640968340e01461ba12b2 [CANDIDATE]: Term 3 election: Requested vote from peers 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957), 1a0996f2672c4594ab704b98217a662e (127.2.198.195:45579)
I20260709 13:17:26.687213 10477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b88255bc1b4bfc94b15c94efa36a25" candidate_uuid: "e4c126e4957640968340e01461ba12b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "9f4289676edb4b7c8fe897bafd84e935"
I20260709 13:17:26.687426 10282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b88255bc1b4bfc94b15c94efa36a25" candidate_uuid: "e4c126e4957640968340e01461ba12b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "1a0996f2672c4594ab704b98217a662e"
I20260709 13:17:26.687987 10477 raft_consensus.cc:3060] T 24b88255bc1b4bfc94b15c94efa36a25 P 9f4289676edb4b7c8fe897bafd84e935 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:26.688079 10282 raft_consensus.cc:3055] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:26.688505 10282 raft_consensus.cc:740] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1a0996f2672c4594ab704b98217a662e, State: Running, Role: LEADER
I20260709 13:17:26.689195 10282 consensus_queue.cc:260] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:26.690208 10282 raft_consensus.cc:3060] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:26.694049 10477 raft_consensus.cc:2468] T 24b88255bc1b4bfc94b15c94efa36a25 P 9f4289676edb4b7c8fe897bafd84e935 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c126e4957640968340e01461ba12b2 in term 3.
I20260709 13:17:26.695240 10172 leader_election.cc:304] T 24b88255bc1b4bfc94b15c94efa36a25 P e4c126e4957640968340e01461ba12b2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f4289676edb4b7c8fe897bafd84e935, e4c126e4957640968340e01461ba12b2; no voters: 
I20260709 13:17:26.695940 10282 raft_consensus.cc:2468] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c126e4957640968340e01461ba12b2 in term 3.
I20260709 13:17:26.696087 10535 raft_consensus.cc:2804] T 24b88255bc1b4bfc94b15c94efa36a25 P e4c126e4957640968340e01461ba12b2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:26.696691 10535 raft_consensus.cc:697] T 24b88255bc1b4bfc94b15c94efa36a25 P e4c126e4957640968340e01461ba12b2 [term 3 LEADER]: Becoming Leader. State: Replica: e4c126e4957640968340e01461ba12b2, State: Running, Role: LEADER
I20260709 13:17:26.697674 10535 consensus_queue.cc:237] T 24b88255bc1b4bfc94b15c94efa36a25 P e4c126e4957640968340e01461ba12b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:26.705219 10030 catalog_manager.cc:5697] T 24b88255bc1b4bfc94b15c94efa36a25 P e4c126e4957640968340e01461ba12b2 reported cstate change: term changed from 2 to 3, leader changed from 1a0996f2672c4594ab704b98217a662e (127.2.198.195) to e4c126e4957640968340e01461ba12b2 (127.2.198.194). New cstate: current_term: 3 leader_uuid: "e4c126e4957640968340e01461ba12b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:26.716842 10415 raft_consensus.cc:993] T 9e1fdba60af24ecc84c528fb6813d3d7 P 1a0996f2672c4594ab704b98217a662e: : Instructing follower e4c126e4957640968340e01461ba12b2 to start an election
I20260709 13:17:26.717363 10534 raft_consensus.cc:1081] T 9e1fdba60af24ecc84c528fb6813d3d7 P 1a0996f2672c4594ab704b98217a662e [term 2 LEADER]: Signalling peer e4c126e4957640968340e01461ba12b2 to start an election
I20260709 13:17:26.718860 10208 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e1fdba60af24ecc84c528fb6813d3d7"
dest_uuid: "e4c126e4957640968340e01461ba12b2"
 from {username='slave'} at 127.0.0.1:46458
I20260709 13:17:26.719360 10208 raft_consensus.cc:493] T 9e1fdba60af24ecc84c528fb6813d3d7 P e4c126e4957640968340e01461ba12b2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:26.719748 10208 raft_consensus.cc:3060] T 9e1fdba60af24ecc84c528fb6813d3d7 P e4c126e4957640968340e01461ba12b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:26.725375 10208 raft_consensus.cc:515] T 9e1fdba60af24ecc84c528fb6813d3d7 P e4c126e4957640968340e01461ba12b2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:26.726982 10208 leader_election.cc:290] T 9e1fdba60af24ecc84c528fb6813d3d7 P e4c126e4957640968340e01461ba12b2 [CANDIDATE]: Term 3 election: Requested vote from peers 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957), 1a0996f2672c4594ab704b98217a662e (127.2.198.195:45579)
I20260709 13:17:26.727716 10477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1fdba60af24ecc84c528fb6813d3d7" candidate_uuid: "e4c126e4957640968340e01461ba12b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9f4289676edb4b7c8fe897bafd84e935"
I20260709 13:17:26.728106 10282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1fdba60af24ecc84c528fb6813d3d7" candidate_uuid: "e4c126e4957640968340e01461ba12b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1a0996f2672c4594ab704b98217a662e"
I20260709 13:17:26.728355 10477 raft_consensus.cc:3060] T 9e1fdba60af24ecc84c528fb6813d3d7 P 9f4289676edb4b7c8fe897bafd84e935 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:26.728717 10282 raft_consensus.cc:3055] T 9e1fdba60af24ecc84c528fb6813d3d7 P 1a0996f2672c4594ab704b98217a662e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:26.729005 10282 raft_consensus.cc:740] T 9e1fdba60af24ecc84c528fb6813d3d7 P 1a0996f2672c4594ab704b98217a662e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1a0996f2672c4594ab704b98217a662e, State: Running, Role: LEADER
I20260709 13:17:26.729784 10282 consensus_queue.cc:260] T 9e1fdba60af24ecc84c528fb6813d3d7 P 1a0996f2672c4594ab704b98217a662e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:26.730769 10282 raft_consensus.cc:3060] T 9e1fdba60af24ecc84c528fb6813d3d7 P 1a0996f2672c4594ab704b98217a662e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:26.733783 10477 raft_consensus.cc:2468] T 9e1fdba60af24ecc84c528fb6813d3d7 P 9f4289676edb4b7c8fe897bafd84e935 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c126e4957640968340e01461ba12b2 in term 3.
I20260709 13:17:26.734869 10172 leader_election.cc:304] T 9e1fdba60af24ecc84c528fb6813d3d7 P e4c126e4957640968340e01461ba12b2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f4289676edb4b7c8fe897bafd84e935, e4c126e4957640968340e01461ba12b2; no voters: 
I20260709 13:17:26.735535 10535 raft_consensus.cc:2804] T 9e1fdba60af24ecc84c528fb6813d3d7 P e4c126e4957640968340e01461ba12b2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:26.736040 10535 raft_consensus.cc:697] T 9e1fdba60af24ecc84c528fb6813d3d7 P e4c126e4957640968340e01461ba12b2 [term 3 LEADER]: Becoming Leader. State: Replica: e4c126e4957640968340e01461ba12b2, State: Running, Role: LEADER
I20260709 13:17:26.736567 10282 raft_consensus.cc:2468] T 9e1fdba60af24ecc84c528fb6813d3d7 P 1a0996f2672c4594ab704b98217a662e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c126e4957640968340e01461ba12b2 in term 3.
I20260709 13:17:26.737000 10535 consensus_queue.cc:237] T 9e1fdba60af24ecc84c528fb6813d3d7 P e4c126e4957640968340e01461ba12b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:26.743777 10030 catalog_manager.cc:5697] T 9e1fdba60af24ecc84c528fb6813d3d7 P e4c126e4957640968340e01461ba12b2 reported cstate change: term changed from 2 to 3, leader changed from 1a0996f2672c4594ab704b98217a662e (127.2.198.195) to e4c126e4957640968340e01461ba12b2 (127.2.198.194). New cstate: current_term: 3 leader_uuid: "e4c126e4957640968340e01461ba12b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:26.884969 10478 raft_consensus.cc:993] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2: : Instructing follower 1a0996f2672c4594ab704b98217a662e to start an election
I20260709 13:17:26.885444 10535 raft_consensus.cc:1081] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 [term 1 LEADER]: Signalling peer 1a0996f2672c4594ab704b98217a662e to start an election
I20260709 13:17:26.886896 10282 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d6defd12940b429a875588ff72d9c61e"
dest_uuid: "1a0996f2672c4594ab704b98217a662e"
 from {username='slave'} at 127.0.0.1:55410
I20260709 13:17:26.887423 10282 raft_consensus.cc:493] T d6defd12940b429a875588ff72d9c61e P 1a0996f2672c4594ab704b98217a662e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:26.887770 10282 raft_consensus.cc:3060] T d6defd12940b429a875588ff72d9c61e P 1a0996f2672c4594ab704b98217a662e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:26.895206 10282 raft_consensus.cc:515] T d6defd12940b429a875588ff72d9c61e P 1a0996f2672c4594ab704b98217a662e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:26.897387 10282 leader_election.cc:290] T d6defd12940b429a875588ff72d9c61e P 1a0996f2672c4594ab704b98217a662e [CANDIDATE]: Term 2 election: Requested vote from peers 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957), e4c126e4957640968340e01461ba12b2 (127.2.198.194:39745)
I20260709 13:17:26.898329 10477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6defd12940b429a875588ff72d9c61e" candidate_uuid: "1a0996f2672c4594ab704b98217a662e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f4289676edb4b7c8fe897bafd84e935"
I20260709 13:17:26.898458 10208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6defd12940b429a875588ff72d9c61e" candidate_uuid: "1a0996f2672c4594ab704b98217a662e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4c126e4957640968340e01461ba12b2"
I20260709 13:17:26.899052 10477 raft_consensus.cc:3060] T d6defd12940b429a875588ff72d9c61e P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:26.899088 10208 raft_consensus.cc:3055] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:26.899523 10208 raft_consensus.cc:740] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4c126e4957640968340e01461ba12b2, State: Running, Role: LEADER
I20260709 13:17:26.900347 10208 consensus_queue.cc:260] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:26.901399 10208 raft_consensus.cc:3060] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:26.904834 10477 raft_consensus.cc:2468] T d6defd12940b429a875588ff72d9c61e P 9f4289676edb4b7c8fe897bafd84e935 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a0996f2672c4594ab704b98217a662e in term 2.
I20260709 13:17:26.905959 10246 leader_election.cc:304] T d6defd12940b429a875588ff72d9c61e P 1a0996f2672c4594ab704b98217a662e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a0996f2672c4594ab704b98217a662e, 9f4289676edb4b7c8fe897bafd84e935; no voters: 
I20260709 13:17:26.906719 10534 raft_consensus.cc:2804] T d6defd12940b429a875588ff72d9c61e P 1a0996f2672c4594ab704b98217a662e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:26.907037 10208 raft_consensus.cc:2468] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a0996f2672c4594ab704b98217a662e in term 2.
I20260709 13:17:26.907117 10534 raft_consensus.cc:697] T d6defd12940b429a875588ff72d9c61e P 1a0996f2672c4594ab704b98217a662e [term 2 LEADER]: Becoming Leader. State: Replica: 1a0996f2672c4594ab704b98217a662e, State: Running, Role: LEADER
I20260709 13:17:26.908433 10534 consensus_queue.cc:237] T d6defd12940b429a875588ff72d9c61e P 1a0996f2672c4594ab704b98217a662e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:26.915406 10030 catalog_manager.cc:5697] T d6defd12940b429a875588ff72d9c61e P 1a0996f2672c4594ab704b98217a662e reported cstate change: term changed from 1 to 2, leader changed from e4c126e4957640968340e01461ba12b2 (127.2.198.194) to 1a0996f2672c4594ab704b98217a662e (127.2.198.195). New cstate: current_term: 2 leader_uuid: "1a0996f2672c4594ab704b98217a662e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:27.174407 10080 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:17:27.218223 10477 raft_consensus.cc:1275] T 24b88255bc1b4bfc94b15c94efa36a25 P 9f4289676edb4b7c8fe897bafd84e935 [term 3 FOLLOWER]: Refusing update from remote peer e4c126e4957640968340e01461ba12b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:27.219848 10547 consensus_queue.cc:1048] T 24b88255bc1b4bfc94b15c94efa36a25 P e4c126e4957640968340e01461ba12b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:27.231446 10282 raft_consensus.cc:1275] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e [term 3 FOLLOWER]: Refusing update from remote peer e4c126e4957640968340e01461ba12b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:27.234427 10547 consensus_queue.cc:1048] T 24b88255bc1b4bfc94b15c94efa36a25 P e4c126e4957640968340e01461ba12b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:27.276856 10476 raft_consensus.cc:1275] T 9e1fdba60af24ecc84c528fb6813d3d7 P 9f4289676edb4b7c8fe897bafd84e935 [term 3 FOLLOWER]: Refusing update from remote peer e4c126e4957640968340e01461ba12b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:27.278586 10478 consensus_queue.cc:1048] T 9e1fdba60af24ecc84c528fb6813d3d7 P e4c126e4957640968340e01461ba12b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:27.280205 10282 raft_consensus.cc:1275] T 9e1fdba60af24ecc84c528fb6813d3d7 P 1a0996f2672c4594ab704b98217a662e [term 3 FOLLOWER]: Refusing update from remote peer e4c126e4957640968340e01461ba12b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:27.281713 10478 consensus_queue.cc:1048] T 9e1fdba60af24ecc84c528fb6813d3d7 P e4c126e4957640968340e01461ba12b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:27.409307  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:27.417769 10208 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24b88255bc1b4bfc94b15c94efa36a25"
dest_uuid: "e4c126e4957640968340e01461ba12b2"
mode: GRACEFUL
new_leader_uuid: "1a0996f2672c4594ab704b98217a662e"
 from {username='slave'} at 127.0.0.1:40216
I20260709 13:17:27.418416 10208 raft_consensus.cc:606] T 24b88255bc1b4bfc94b15c94efa36a25 P e4c126e4957640968340e01461ba12b2 [term 3 LEADER]: Received request to transfer leadership to TS 1a0996f2672c4594ab704b98217a662e
I20260709 13:17:27.421254 10208 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78042ece070249adabf7c5df20cb9980"
dest_uuid: "e4c126e4957640968340e01461ba12b2"
mode: GRACEFUL
new_leader_uuid: "1a0996f2672c4594ab704b98217a662e"
 from {username='slave'} at 127.0.0.1:40216
I20260709 13:17:27.421783 10208 raft_consensus.cc:606] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2 [term 1 LEADER]: Received request to transfer leadership to TS 1a0996f2672c4594ab704b98217a662e
I20260709 13:17:27.424259 10282 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6defd12940b429a875588ff72d9c61e"
dest_uuid: "1a0996f2672c4594ab704b98217a662e"
mode: GRACEFUL
new_leader_uuid: "e4c126e4957640968340e01461ba12b2"
 from {username='slave'} at 127.0.0.1:36824
I20260709 13:17:27.424798 10282 raft_consensus.cc:606] T d6defd12940b429a875588ff72d9c61e P 1a0996f2672c4594ab704b98217a662e [term 2 LEADER]: Received request to transfer leadership to TS e4c126e4957640968340e01461ba12b2
I20260709 13:17:27.425879  2843 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:17:27.426396  2843 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:27.426976  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:27.444676 10476 raft_consensus.cc:1275] T d6defd12940b429a875588ff72d9c61e P 9f4289676edb4b7c8fe897bafd84e935 [term 2 FOLLOWER]: Refusing update from remote peer 1a0996f2672c4594ab704b98217a662e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:27.446118 10534 consensus_queue.cc:1048] T d6defd12940b429a875588ff72d9c61e P 1a0996f2672c4594ab704b98217a662e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:27.456494 10208 raft_consensus.cc:1275] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 [term 2 FOLLOWER]: Refusing update from remote peer 1a0996f2672c4594ab704b98217a662e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:27.458182 10558 consensus_queue.cc:1048] T d6defd12940b429a875588ff72d9c61e P 1a0996f2672c4594ab704b98217a662e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:27.467661 10558 raft_consensus.cc:993] T d6defd12940b429a875588ff72d9c61e P 1a0996f2672c4594ab704b98217a662e: : Instructing follower e4c126e4957640968340e01461ba12b2 to start an election
I20260709 13:17:27.468191 10534 raft_consensus.cc:1081] T d6defd12940b429a875588ff72d9c61e P 1a0996f2672c4594ab704b98217a662e [term 2 LEADER]: Signalling peer e4c126e4957640968340e01461ba12b2 to start an election
I20260709 13:17:27.469832 10208 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d6defd12940b429a875588ff72d9c61e"
dest_uuid: "e4c126e4957640968340e01461ba12b2"
 from {username='slave'} at 127.0.0.1:46458
I20260709 13:17:27.470386 10208 raft_consensus.cc:493] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:27.470764 10208 raft_consensus.cc:3060] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:27.477030 10208 raft_consensus.cc:515] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:27.479166 10208 leader_election.cc:290] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 [CANDIDATE]: Term 3 election: Requested vote from peers 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957), 1a0996f2672c4594ab704b98217a662e (127.2.198.195:45579)
I20260709 13:17:27.480149 10476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6defd12940b429a875588ff72d9c61e" candidate_uuid: "e4c126e4957640968340e01461ba12b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9f4289676edb4b7c8fe897bafd84e935"
I20260709 13:17:27.480436 10282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6defd12940b429a875588ff72d9c61e" candidate_uuid: "e4c126e4957640968340e01461ba12b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1a0996f2672c4594ab704b98217a662e"
I20260709 13:17:27.480911 10476 raft_consensus.cc:3060] T d6defd12940b429a875588ff72d9c61e P 9f4289676edb4b7c8fe897bafd84e935 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:27.481086 10282 raft_consensus.cc:3055] T d6defd12940b429a875588ff72d9c61e P 1a0996f2672c4594ab704b98217a662e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:27.481523 10282 raft_consensus.cc:740] T d6defd12940b429a875588ff72d9c61e P 1a0996f2672c4594ab704b98217a662e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1a0996f2672c4594ab704b98217a662e, State: Running, Role: LEADER
I20260709 13:17:27.482393 10282 consensus_queue.cc:260] T d6defd12940b429a875588ff72d9c61e P 1a0996f2672c4594ab704b98217a662e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:27.483793 10282 raft_consensus.cc:3060] T d6defd12940b429a875588ff72d9c61e P 1a0996f2672c4594ab704b98217a662e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:27.487707 10476 raft_consensus.cc:2468] T d6defd12940b429a875588ff72d9c61e P 9f4289676edb4b7c8fe897bafd84e935 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c126e4957640968340e01461ba12b2 in term 3.
I20260709 13:17:27.488730 10172 leader_election.cc:304] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f4289676edb4b7c8fe897bafd84e935, e4c126e4957640968340e01461ba12b2; no voters: 
I20260709 13:17:27.489413 10478 raft_consensus.cc:2804] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:27.489817 10478 raft_consensus.cc:697] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 [term 3 LEADER]: Becoming Leader. State: Replica: e4c126e4957640968340e01461ba12b2, State: Running, Role: LEADER
I20260709 13:17:27.490456 10282 raft_consensus.cc:2468] T d6defd12940b429a875588ff72d9c61e P 1a0996f2672c4594ab704b98217a662e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c126e4957640968340e01461ba12b2 in term 3.
I20260709 13:17:27.490641 10478 consensus_queue.cc:237] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:27.497184 10031 catalog_manager.cc:5697] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 reported cstate change: term changed from 2 to 3, leader changed from 1a0996f2672c4594ab704b98217a662e (127.2.198.195) to e4c126e4957640968340e01461ba12b2 (127.2.198.194). New cstate: current_term: 3 leader_uuid: "e4c126e4957640968340e01461ba12b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:27.697415 10535 raft_consensus.cc:993] T 24b88255bc1b4bfc94b15c94efa36a25 P e4c126e4957640968340e01461ba12b2: : Instructing follower 1a0996f2672c4594ab704b98217a662e to start an election
I20260709 13:17:27.698033 10478 raft_consensus.cc:1081] T 24b88255bc1b4bfc94b15c94efa36a25 P e4c126e4957640968340e01461ba12b2 [term 3 LEADER]: Signalling peer 1a0996f2672c4594ab704b98217a662e to start an election
I20260709 13:17:27.699572 10282 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "24b88255bc1b4bfc94b15c94efa36a25"
dest_uuid: "1a0996f2672c4594ab704b98217a662e"
 from {username='slave'} at 127.0.0.1:55410
I20260709 13:17:27.700088 10282 raft_consensus.cc:493] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:27.700433 10282 raft_consensus.cc:3060] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:27.706094 10282 raft_consensus.cc:515] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:27.707664 10282 leader_election.cc:290] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e [CANDIDATE]: Term 4 election: Requested vote from peers 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957), e4c126e4957640968340e01461ba12b2 (127.2.198.194:39745)
I20260709 13:17:27.708576 10476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b88255bc1b4bfc94b15c94efa36a25" candidate_uuid: "1a0996f2672c4594ab704b98217a662e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "9f4289676edb4b7c8fe897bafd84e935"
I20260709 13:17:27.708683 10208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b88255bc1b4bfc94b15c94efa36a25" candidate_uuid: "1a0996f2672c4594ab704b98217a662e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "e4c126e4957640968340e01461ba12b2"
I20260709 13:17:27.709424 10476 raft_consensus.cc:3060] T 24b88255bc1b4bfc94b15c94efa36a25 P 9f4289676edb4b7c8fe897bafd84e935 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:27.709509 10208 raft_consensus.cc:3055] T 24b88255bc1b4bfc94b15c94efa36a25 P e4c126e4957640968340e01461ba12b2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:27.709928 10208 raft_consensus.cc:740] T 24b88255bc1b4bfc94b15c94efa36a25 P e4c126e4957640968340e01461ba12b2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e4c126e4957640968340e01461ba12b2, State: Running, Role: LEADER
I20260709 13:17:27.710598 10208 consensus_queue.cc:260] T 24b88255bc1b4bfc94b15c94efa36a25 P e4c126e4957640968340e01461ba12b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:27.711691 10208 raft_consensus.cc:3060] T 24b88255bc1b4bfc94b15c94efa36a25 P e4c126e4957640968340e01461ba12b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:27.714987 10476 raft_consensus.cc:2468] T 24b88255bc1b4bfc94b15c94efa36a25 P 9f4289676edb4b7c8fe897bafd84e935 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a0996f2672c4594ab704b98217a662e in term 4.
I20260709 13:17:27.716203 10246 leader_election.cc:304] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a0996f2672c4594ab704b98217a662e, 9f4289676edb4b7c8fe897bafd84e935; no voters: 
I20260709 13:17:27.716912 10534 raft_consensus.cc:2804] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:27.717067 10208 raft_consensus.cc:2468] T 24b88255bc1b4bfc94b15c94efa36a25 P e4c126e4957640968340e01461ba12b2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a0996f2672c4594ab704b98217a662e in term 4.
I20260709 13:17:27.717391 10534 raft_consensus.cc:697] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e [term 4 LEADER]: Becoming Leader. State: Replica: 1a0996f2672c4594ab704b98217a662e, State: Running, Role: LEADER
I20260709 13:17:27.718329 10534 consensus_queue.cc:237] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:27.724463 10031 catalog_manager.cc:5697] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e reported cstate change: term changed from 3 to 4, leader changed from e4c126e4957640968340e01461ba12b2 (127.2.198.194) to 1a0996f2672c4594ab704b98217a662e (127.2.198.195). New cstate: current_term: 4 leader_uuid: "1a0996f2672c4594ab704b98217a662e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:27.795322 10535 raft_consensus.cc:993] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2: : Instructing follower 1a0996f2672c4594ab704b98217a662e to start an election
I20260709 13:17:27.796000 10478 raft_consensus.cc:1081] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2 [term 1 LEADER]: Signalling peer 1a0996f2672c4594ab704b98217a662e to start an election
I20260709 13:17:27.797587 10282 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78042ece070249adabf7c5df20cb9980"
dest_uuid: "1a0996f2672c4594ab704b98217a662e"
 from {username='slave'} at 127.0.0.1:55410
I20260709 13:17:27.798190 10282 raft_consensus.cc:493] T 78042ece070249adabf7c5df20cb9980 P 1a0996f2672c4594ab704b98217a662e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:27.798583 10282 raft_consensus.cc:3060] T 78042ece070249adabf7c5df20cb9980 P 1a0996f2672c4594ab704b98217a662e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:27.803968 10282 raft_consensus.cc:515] T 78042ece070249adabf7c5df20cb9980 P 1a0996f2672c4594ab704b98217a662e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:27.805665 10282 leader_election.cc:290] T 78042ece070249adabf7c5df20cb9980 P 1a0996f2672c4594ab704b98217a662e [CANDIDATE]: Term 2 election: Requested vote from peers e4c126e4957640968340e01461ba12b2 (127.2.198.194:39745), 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957)
I20260709 13:17:27.806967 10208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78042ece070249adabf7c5df20cb9980" candidate_uuid: "1a0996f2672c4594ab704b98217a662e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4c126e4957640968340e01461ba12b2"
I20260709 13:17:27.806946 10476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78042ece070249adabf7c5df20cb9980" candidate_uuid: "1a0996f2672c4594ab704b98217a662e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f4289676edb4b7c8fe897bafd84e935"
I20260709 13:17:27.807928 10208 raft_consensus.cc:3055] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:27.807978 10476 raft_consensus.cc:3060] T 78042ece070249adabf7c5df20cb9980 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:27.808243 10208 raft_consensus.cc:740] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4c126e4957640968340e01461ba12b2, State: Running, Role: LEADER
I20260709 13:17:27.809195 10208 consensus_queue.cc:260] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:27.810308 10208 raft_consensus.cc:3060] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:27.813874 10476 raft_consensus.cc:2468] T 78042ece070249adabf7c5df20cb9980 P 9f4289676edb4b7c8fe897bafd84e935 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a0996f2672c4594ab704b98217a662e in term 2.
I20260709 13:17:27.814990 10246 leader_election.cc:304] T 78042ece070249adabf7c5df20cb9980 P 1a0996f2672c4594ab704b98217a662e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a0996f2672c4594ab704b98217a662e, 9f4289676edb4b7c8fe897bafd84e935; no voters: 
I20260709 13:17:27.815822 10534 raft_consensus.cc:2804] T 78042ece070249adabf7c5df20cb9980 P 1a0996f2672c4594ab704b98217a662e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:27.815832 10208 raft_consensus.cc:2468] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a0996f2672c4594ab704b98217a662e in term 2.
I20260709 13:17:27.816437 10534 raft_consensus.cc:697] T 78042ece070249adabf7c5df20cb9980 P 1a0996f2672c4594ab704b98217a662e [term 2 LEADER]: Becoming Leader. State: Replica: 1a0996f2672c4594ab704b98217a662e, State: Running, Role: LEADER
I20260709 13:17:27.817503 10534 consensus_queue.cc:237] T 78042ece070249adabf7c5df20cb9980 P 1a0996f2672c4594ab704b98217a662e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:27.825107 10031 catalog_manager.cc:5697] T 78042ece070249adabf7c5df20cb9980 P 1a0996f2672c4594ab704b98217a662e reported cstate change: term changed from 1 to 2, leader changed from e4c126e4957640968340e01461ba12b2 (127.2.198.194) to 1a0996f2672c4594ab704b98217a662e (127.2.198.195). New cstate: current_term: 2 leader_uuid: "1a0996f2672c4594ab704b98217a662e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:27.940665 10476 raft_consensus.cc:1275] T d6defd12940b429a875588ff72d9c61e P 9f4289676edb4b7c8fe897bafd84e935 [term 3 FOLLOWER]: Refusing update from remote peer e4c126e4957640968340e01461ba12b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:27.943746 10478 consensus_queue.cc:1048] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:27.952951 10282 raft_consensus.cc:1275] T d6defd12940b429a875588ff72d9c61e P 1a0996f2672c4594ab704b98217a662e [term 3 FOLLOWER]: Refusing update from remote peer e4c126e4957640968340e01461ba12b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:27.954941 10547 consensus_queue.cc:1048] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:17:28.175603 10080 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:17:28.220366 10477 raft_consensus.cc:1275] T 78042ece070249adabf7c5df20cb9980 P 9f4289676edb4b7c8fe897bafd84e935 [term 2 FOLLOWER]: Refusing update from remote peer 1a0996f2672c4594ab704b98217a662e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:28.221889 10534 consensus_queue.cc:1048] T 78042ece070249adabf7c5df20cb9980 P 1a0996f2672c4594ab704b98217a662e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:28.231809 10208 raft_consensus.cc:1275] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2 [term 2 FOLLOWER]: Refusing update from remote peer 1a0996f2672c4594ab704b98217a662e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:28.233368 10534 consensus_queue.cc:1048] T 78042ece070249adabf7c5df20cb9980 P 1a0996f2672c4594ab704b98217a662e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:28.313199 10477 raft_consensus.cc:1275] T 24b88255bc1b4bfc94b15c94efa36a25 P 9f4289676edb4b7c8fe897bafd84e935 [term 4 FOLLOWER]: Refusing update from remote peer 1a0996f2672c4594ab704b98217a662e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:28.314584 10534 consensus_queue.cc:1048] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:28.325208 10208 raft_consensus.cc:1275] T 24b88255bc1b4bfc94b15c94efa36a25 P e4c126e4957640968340e01461ba12b2 [term 4 FOLLOWER]: Refusing update from remote peer 1a0996f2672c4594ab704b98217a662e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:28.326748 10569 consensus_queue.cc:1048] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:28.433535  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:28.441161 10208 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "632d0cca3448426a8b909ee924b0244f"
dest_uuid: "e4c126e4957640968340e01461ba12b2"
mode: GRACEFUL
new_leader_uuid: "1a0996f2672c4594ab704b98217a662e"
 from {username='slave'} at 127.0.0.1:40216
I20260709 13:17:28.441799 10208 raft_consensus.cc:606] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2 [term 2 LEADER]: Received request to transfer leadership to TS 1a0996f2672c4594ab704b98217a662e
I20260709 13:17:28.444473 10282 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78042ece070249adabf7c5df20cb9980"
dest_uuid: "1a0996f2672c4594ab704b98217a662e"
mode: GRACEFUL
new_leader_uuid: "e4c126e4957640968340e01461ba12b2"
 from {username='slave'} at 127.0.0.1:36824
I20260709 13:17:28.445032 10282 raft_consensus.cc:606] T 78042ece070249adabf7c5df20cb9980 P 1a0996f2672c4594ab704b98217a662e [term 2 LEADER]: Received request to transfer leadership to TS e4c126e4957640968340e01461ba12b2
I20260709 13:17:28.447868 10282 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2a40086010b440599041cd4935e5d86"
dest_uuid: "1a0996f2672c4594ab704b98217a662e"
mode: GRACEFUL
new_leader_uuid: "e4c126e4957640968340e01461ba12b2"
 from {username='slave'} at 127.0.0.1:36824
I20260709 13:17:28.448328 10282 raft_consensus.cc:606] T b2a40086010b440599041cd4935e5d86 P 1a0996f2672c4594ab704b98217a662e [term 1 LEADER]: Received request to transfer leadership to TS e4c126e4957640968340e01461ba12b2
I20260709 13:17:28.449239  2843 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:17:28.449745  2843 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:28.450321  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:28.721323 10566 raft_consensus.cc:993] T 78042ece070249adabf7c5df20cb9980 P 1a0996f2672c4594ab704b98217a662e: : Instructing follower e4c126e4957640968340e01461ba12b2 to start an election
I20260709 13:17:28.721916 10569 raft_consensus.cc:1081] T 78042ece070249adabf7c5df20cb9980 P 1a0996f2672c4594ab704b98217a662e [term 2 LEADER]: Signalling peer e4c126e4957640968340e01461ba12b2 to start an election
I20260709 13:17:28.723523 10208 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78042ece070249adabf7c5df20cb9980"
dest_uuid: "e4c126e4957640968340e01461ba12b2"
 from {username='slave'} at 127.0.0.1:46458
I20260709 13:17:28.724069 10208 raft_consensus.cc:493] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:28.724409 10208 raft_consensus.cc:3060] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:28.730202 10208 raft_consensus.cc:515] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:28.731958 10208 leader_election.cc:290] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2 [CANDIDATE]: Term 3 election: Requested vote from peers 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957), 1a0996f2672c4594ab704b98217a662e (127.2.198.195:45579)
I20260709 13:17:28.732713 10476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78042ece070249adabf7c5df20cb9980" candidate_uuid: "e4c126e4957640968340e01461ba12b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9f4289676edb4b7c8fe897bafd84e935"
I20260709 13:17:28.732904 10282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78042ece070249adabf7c5df20cb9980" candidate_uuid: "e4c126e4957640968340e01461ba12b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1a0996f2672c4594ab704b98217a662e"
I20260709 13:17:28.733373 10476 raft_consensus.cc:3060] T 78042ece070249adabf7c5df20cb9980 P 9f4289676edb4b7c8fe897bafd84e935 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:28.733500 10282 raft_consensus.cc:3055] T 78042ece070249adabf7c5df20cb9980 P 1a0996f2672c4594ab704b98217a662e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:28.733839 10282 raft_consensus.cc:740] T 78042ece070249adabf7c5df20cb9980 P 1a0996f2672c4594ab704b98217a662e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1a0996f2672c4594ab704b98217a662e, State: Running, Role: LEADER
I20260709 13:17:28.734390 10282 consensus_queue.cc:260] T 78042ece070249adabf7c5df20cb9980 P 1a0996f2672c4594ab704b98217a662e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:28.735242 10282 raft_consensus.cc:3060] T 78042ece070249adabf7c5df20cb9980 P 1a0996f2672c4594ab704b98217a662e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:28.739025 10476 raft_consensus.cc:2468] T 78042ece070249adabf7c5df20cb9980 P 9f4289676edb4b7c8fe897bafd84e935 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c126e4957640968340e01461ba12b2 in term 3.
I20260709 13:17:28.740289 10172 leader_election.cc:304] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f4289676edb4b7c8fe897bafd84e935, e4c126e4957640968340e01461ba12b2; no voters: 
I20260709 13:17:28.740283 10282 raft_consensus.cc:2468] T 78042ece070249adabf7c5df20cb9980 P 1a0996f2672c4594ab704b98217a662e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c126e4957640968340e01461ba12b2 in term 3.
I20260709 13:17:28.741040 10535 raft_consensus.cc:2804] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:28.741580 10535 raft_consensus.cc:697] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2 [term 3 LEADER]: Becoming Leader. State: Replica: e4c126e4957640968340e01461ba12b2, State: Running, Role: LEADER
I20260709 13:17:28.742369 10535 consensus_queue.cc:237] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:28.748183 10535 raft_consensus.cc:993] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2: : Instructing follower 1a0996f2672c4594ab704b98217a662e to start an election
I20260709 13:17:28.748627 10478 raft_consensus.cc:1081] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2 [term 2 LEADER]: Signalling peer 1a0996f2672c4594ab704b98217a662e to start an election
I20260709 13:17:28.750283 10282 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "632d0cca3448426a8b909ee924b0244f"
dest_uuid: "1a0996f2672c4594ab704b98217a662e"
 from {username='slave'} at 127.0.0.1:55410
I20260709 13:17:28.749817 10030 catalog_manager.cc:5697] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2 reported cstate change: term changed from 2 to 3, leader changed from 1a0996f2672c4594ab704b98217a662e (127.2.198.195) to e4c126e4957640968340e01461ba12b2 (127.2.198.194). New cstate: current_term: 3 leader_uuid: "e4c126e4957640968340e01461ba12b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:28.750854 10282 raft_consensus.cc:493] T 632d0cca3448426a8b909ee924b0244f P 1a0996f2672c4594ab704b98217a662e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:28.751180 10282 raft_consensus.cc:3060] T 632d0cca3448426a8b909ee924b0244f P 1a0996f2672c4594ab704b98217a662e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:28.757792 10282 raft_consensus.cc:515] T 632d0cca3448426a8b909ee924b0244f P 1a0996f2672c4594ab704b98217a662e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:28.760504 10476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632d0cca3448426a8b909ee924b0244f" candidate_uuid: "1a0996f2672c4594ab704b98217a662e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9f4289676edb4b7c8fe897bafd84e935"
I20260709 13:17:28.760818 10208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632d0cca3448426a8b909ee924b0244f" candidate_uuid: "1a0996f2672c4594ab704b98217a662e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e4c126e4957640968340e01461ba12b2"
I20260709 13:17:28.761304 10476 raft_consensus.cc:3060] T 632d0cca3448426a8b909ee924b0244f P 9f4289676edb4b7c8fe897bafd84e935 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:28.761502 10208 raft_consensus.cc:3055] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:28.761937 10208 raft_consensus.cc:740] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e4c126e4957640968340e01461ba12b2, State: Running, Role: LEADER
I20260709 13:17:28.760263 10282 leader_election.cc:290] T 632d0cca3448426a8b909ee924b0244f P 1a0996f2672c4594ab704b98217a662e [CANDIDATE]: Term 3 election: Requested vote from peers 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957), e4c126e4957640968340e01461ba12b2 (127.2.198.194:39745)
I20260709 13:17:28.762799 10208 consensus_queue.cc:260] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:28.764400 10208 raft_consensus.cc:3060] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:28.768332 10476 raft_consensus.cc:2468] T 632d0cca3448426a8b909ee924b0244f P 9f4289676edb4b7c8fe897bafd84e935 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a0996f2672c4594ab704b98217a662e in term 3.
I20260709 13:17:28.769402 10246 leader_election.cc:304] T 632d0cca3448426a8b909ee924b0244f P 1a0996f2672c4594ab704b98217a662e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a0996f2672c4594ab704b98217a662e, 9f4289676edb4b7c8fe897bafd84e935; no voters: 
I20260709 13:17:28.770057 10208 raft_consensus.cc:2468] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a0996f2672c4594ab704b98217a662e in term 3.
I20260709 13:17:28.770118 10569 raft_consensus.cc:2804] T 632d0cca3448426a8b909ee924b0244f P 1a0996f2672c4594ab704b98217a662e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:28.770805 10569 raft_consensus.cc:697] T 632d0cca3448426a8b909ee924b0244f P 1a0996f2672c4594ab704b98217a662e [term 3 LEADER]: Becoming Leader. State: Replica: 1a0996f2672c4594ab704b98217a662e, State: Running, Role: LEADER
I20260709 13:17:28.771865 10569 consensus_queue.cc:237] T 632d0cca3448426a8b909ee924b0244f P 1a0996f2672c4594ab704b98217a662e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:28.779978 10030 catalog_manager.cc:5697] T 632d0cca3448426a8b909ee924b0244f P 1a0996f2672c4594ab704b98217a662e reported cstate change: term changed from 2 to 3, leader changed from e4c126e4957640968340e01461ba12b2 (127.2.198.194) to 1a0996f2672c4594ab704b98217a662e (127.2.198.195). New cstate: current_term: 3 leader_uuid: "1a0996f2672c4594ab704b98217a662e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:28.872525 10566 raft_consensus.cc:993] T b2a40086010b440599041cd4935e5d86 P 1a0996f2672c4594ab704b98217a662e: : Instructing follower e4c126e4957640968340e01461ba12b2 to start an election
I20260709 13:17:28.873081 10569 raft_consensus.cc:1081] T b2a40086010b440599041cd4935e5d86 P 1a0996f2672c4594ab704b98217a662e [term 1 LEADER]: Signalling peer e4c126e4957640968340e01461ba12b2 to start an election
I20260709 13:17:28.874765 10208 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b2a40086010b440599041cd4935e5d86"
dest_uuid: "e4c126e4957640968340e01461ba12b2"
 from {username='slave'} at 127.0.0.1:46458
I20260709 13:17:28.875279 10208 raft_consensus.cc:493] T b2a40086010b440599041cd4935e5d86 P e4c126e4957640968340e01461ba12b2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:28.875604 10208 raft_consensus.cc:3060] T b2a40086010b440599041cd4935e5d86 P e4c126e4957640968340e01461ba12b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:28.881191 10208 raft_consensus.cc:515] T b2a40086010b440599041cd4935e5d86 P e4c126e4957640968340e01461ba12b2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:28.882778 10208 leader_election.cc:290] T b2a40086010b440599041cd4935e5d86 P e4c126e4957640968340e01461ba12b2 [CANDIDATE]: Term 2 election: Requested vote from peers 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957), 1a0996f2672c4594ab704b98217a662e (127.2.198.195:45579)
I20260709 13:17:28.884423 10476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2a40086010b440599041cd4935e5d86" candidate_uuid: "e4c126e4957640968340e01461ba12b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f4289676edb4b7c8fe897bafd84e935"
I20260709 13:17:28.884457 10282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2a40086010b440599041cd4935e5d86" candidate_uuid: "e4c126e4957640968340e01461ba12b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1a0996f2672c4594ab704b98217a662e"
I20260709 13:17:28.885157 10476 raft_consensus.cc:3060] T b2a40086010b440599041cd4935e5d86 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:28.885249 10282 raft_consensus.cc:3055] T b2a40086010b440599041cd4935e5d86 P 1a0996f2672c4594ab704b98217a662e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:28.885664 10282 raft_consensus.cc:740] T b2a40086010b440599041cd4935e5d86 P 1a0996f2672c4594ab704b98217a662e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a0996f2672c4594ab704b98217a662e, State: Running, Role: LEADER
I20260709 13:17:28.886575 10282 consensus_queue.cc:260] T b2a40086010b440599041cd4935e5d86 P 1a0996f2672c4594ab704b98217a662e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:28.887605 10282 raft_consensus.cc:3060] T b2a40086010b440599041cd4935e5d86 P 1a0996f2672c4594ab704b98217a662e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:28.890993 10476 raft_consensus.cc:2468] T b2a40086010b440599041cd4935e5d86 P 9f4289676edb4b7c8fe897bafd84e935 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c126e4957640968340e01461ba12b2 in term 2.
I20260709 13:17:28.892038 10172 leader_election.cc:304] T b2a40086010b440599041cd4935e5d86 P e4c126e4957640968340e01461ba12b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f4289676edb4b7c8fe897bafd84e935, e4c126e4957640968340e01461ba12b2; no voters: 
I20260709 13:17:28.892695 10282 raft_consensus.cc:2468] T b2a40086010b440599041cd4935e5d86 P 1a0996f2672c4594ab704b98217a662e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c126e4957640968340e01461ba12b2 in term 2.
I20260709 13:17:28.892825 10478 raft_consensus.cc:2804] T b2a40086010b440599041cd4935e5d86 P e4c126e4957640968340e01461ba12b2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:28.893384 10478 raft_consensus.cc:697] T b2a40086010b440599041cd4935e5d86 P e4c126e4957640968340e01461ba12b2 [term 2 LEADER]: Becoming Leader. State: Replica: e4c126e4957640968340e01461ba12b2, State: Running, Role: LEADER
I20260709 13:17:28.894297 10478 consensus_queue.cc:237] T b2a40086010b440599041cd4935e5d86 P e4c126e4957640968340e01461ba12b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:28.901079 10030 catalog_manager.cc:5697] T b2a40086010b440599041cd4935e5d86 P e4c126e4957640968340e01461ba12b2 reported cstate change: term changed from 1 to 2, leader changed from 1a0996f2672c4594ab704b98217a662e (127.2.198.195) to e4c126e4957640968340e01461ba12b2 (127.2.198.194). New cstate: current_term: 2 leader_uuid: "e4c126e4957640968340e01461ba12b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:29.167826 10476 raft_consensus.cc:1275] T 632d0cca3448426a8b909ee924b0244f P 9f4289676edb4b7c8fe897bafd84e935 [term 3 FOLLOWER]: Refusing update from remote peer 1a0996f2672c4594ab704b98217a662e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:29.169245 10576 consensus_queue.cc:1048] T 632d0cca3448426a8b909ee924b0244f P 1a0996f2672c4594ab704b98217a662e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:17:29.176687 10080 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:17:29.180471 10208 raft_consensus.cc:1275] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2 [term 3 FOLLOWER]: Refusing update from remote peer 1a0996f2672c4594ab704b98217a662e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:29.182891 10576 consensus_queue.cc:1048] T 632d0cca3448426a8b909ee924b0244f P 1a0996f2672c4594ab704b98217a662e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:29.281579 10476 raft_consensus.cc:1275] T 78042ece070249adabf7c5df20cb9980 P 9f4289676edb4b7c8fe897bafd84e935 [term 3 FOLLOWER]: Refusing update from remote peer e4c126e4957640968340e01461ba12b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:29.282878 10478 consensus_queue.cc:1048] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:29.292405 10282 raft_consensus.cc:1275] T 78042ece070249adabf7c5df20cb9980 P 1a0996f2672c4594ab704b98217a662e [term 3 FOLLOWER]: Refusing update from remote peer e4c126e4957640968340e01461ba12b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:29.293856 10584 consensus_queue.cc:1048] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:29.480273  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:29.495944 10281 raft_consensus.cc:1275] T b2a40086010b440599041cd4935e5d86 P 1a0996f2672c4594ab704b98217a662e [term 2 FOLLOWER]: Refusing update from remote peer e4c126e4957640968340e01461ba12b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:29.501189 10478 consensus_queue.cc:1048] T b2a40086010b440599041cd4935e5d86 P e4c126e4957640968340e01461ba12b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:29.503360 10477 raft_consensus.cc:1275] T b2a40086010b440599041cd4935e5d86 P 9f4289676edb4b7c8fe897bafd84e935 [term 2 FOLLOWER]: Refusing update from remote peer e4c126e4957640968340e01461ba12b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:29.510191 10535 consensus_queue.cc:1048] T b2a40086010b440599041cd4935e5d86 P e4c126e4957640968340e01461ba12b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:29.517633 10208 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40054610eaa9497494285ea9ca8ec1e5"
dest_uuid: "e4c126e4957640968340e01461ba12b2"
mode: GRACEFUL
new_leader_uuid: "1a0996f2672c4594ab704b98217a662e"
 from {username='slave'} at 127.0.0.1:40216
I20260709 13:17:29.518363 10208 raft_consensus.cc:606] T 40054610eaa9497494285ea9ca8ec1e5 P e4c126e4957640968340e01461ba12b2 [term 1 LEADER]: Received request to transfer leadership to TS 1a0996f2672c4594ab704b98217a662e
I20260709 13:17:29.522811 10281 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7abb4eef5abd4a268cbebb6cebd4a051"
dest_uuid: "1a0996f2672c4594ab704b98217a662e"
mode: GRACEFUL
new_leader_uuid: "e4c126e4957640968340e01461ba12b2"
 from {username='slave'} at 127.0.0.1:36824
I20260709 13:17:29.523453 10281 raft_consensus.cc:606] T 7abb4eef5abd4a268cbebb6cebd4a051 P 1a0996f2672c4594ab704b98217a662e [term 2 LEADER]: Received request to transfer leadership to TS e4c126e4957640968340e01461ba12b2
I20260709 13:17:29.527292 10208 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6defd12940b429a875588ff72d9c61e"
dest_uuid: "e4c126e4957640968340e01461ba12b2"
mode: GRACEFUL
new_leader_uuid: "1a0996f2672c4594ab704b98217a662e"
 from {username='slave'} at 127.0.0.1:40216
I20260709 13:17:29.527848 10208 raft_consensus.cc:606] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 [term 3 LEADER]: Received request to transfer leadership to TS 1a0996f2672c4594ab704b98217a662e
I20260709 13:17:29.529508  2843 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:17:29.533442  2843 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:29.534294  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:29.630672 10584 raft_consensus.cc:993] T 40054610eaa9497494285ea9ca8ec1e5 P e4c126e4957640968340e01461ba12b2: : Instructing follower 1a0996f2672c4594ab704b98217a662e to start an election
I20260709 13:17:29.631173 10478 raft_consensus.cc:1081] T 40054610eaa9497494285ea9ca8ec1e5 P e4c126e4957640968340e01461ba12b2 [term 1 LEADER]: Signalling peer 1a0996f2672c4594ab704b98217a662e to start an election
I20260709 13:17:29.632728 10281 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40054610eaa9497494285ea9ca8ec1e5"
dest_uuid: "1a0996f2672c4594ab704b98217a662e"
 from {username='slave'} at 127.0.0.1:55410
I20260709 13:17:29.633229 10281 raft_consensus.cc:493] T 40054610eaa9497494285ea9ca8ec1e5 P 1a0996f2672c4594ab704b98217a662e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:29.633502 10281 raft_consensus.cc:3060] T 40054610eaa9497494285ea9ca8ec1e5 P 1a0996f2672c4594ab704b98217a662e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:29.639532 10281 raft_consensus.cc:515] T 40054610eaa9497494285ea9ca8ec1e5 P 1a0996f2672c4594ab704b98217a662e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:29.641182 10281 leader_election.cc:290] T 40054610eaa9497494285ea9ca8ec1e5 P 1a0996f2672c4594ab704b98217a662e [CANDIDATE]: Term 2 election: Requested vote from peers 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957), e4c126e4957640968340e01461ba12b2 (127.2.198.194:39745)
I20260709 13:17:29.642143 10208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40054610eaa9497494285ea9ca8ec1e5" candidate_uuid: "1a0996f2672c4594ab704b98217a662e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4c126e4957640968340e01461ba12b2"
I20260709 13:17:29.641952 10476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40054610eaa9497494285ea9ca8ec1e5" candidate_uuid: "1a0996f2672c4594ab704b98217a662e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f4289676edb4b7c8fe897bafd84e935"
I20260709 13:17:29.642725 10208 raft_consensus.cc:3055] T 40054610eaa9497494285ea9ca8ec1e5 P e4c126e4957640968340e01461ba12b2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:29.642867 10476 raft_consensus.cc:3060] T 40054610eaa9497494285ea9ca8ec1e5 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:29.642985 10208 raft_consensus.cc:740] T 40054610eaa9497494285ea9ca8ec1e5 P e4c126e4957640968340e01461ba12b2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4c126e4957640968340e01461ba12b2, State: Running, Role: LEADER
I20260709 13:17:29.643842 10208 consensus_queue.cc:260] T 40054610eaa9497494285ea9ca8ec1e5 P e4c126e4957640968340e01461ba12b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:29.644763 10208 raft_consensus.cc:3060] T 40054610eaa9497494285ea9ca8ec1e5 P e4c126e4957640968340e01461ba12b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:29.648552 10476 raft_consensus.cc:2468] T 40054610eaa9497494285ea9ca8ec1e5 P 9f4289676edb4b7c8fe897bafd84e935 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a0996f2672c4594ab704b98217a662e in term 2.
I20260709 13:17:29.649641 10246 leader_election.cc:304] T 40054610eaa9497494285ea9ca8ec1e5 P 1a0996f2672c4594ab704b98217a662e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a0996f2672c4594ab704b98217a662e, 9f4289676edb4b7c8fe897bafd84e935; no voters: 
I20260709 13:17:29.650422 10576 raft_consensus.cc:2804] T 40054610eaa9497494285ea9ca8ec1e5 P 1a0996f2672c4594ab704b98217a662e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:29.650815 10208 raft_consensus.cc:2468] T 40054610eaa9497494285ea9ca8ec1e5 P e4c126e4957640968340e01461ba12b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a0996f2672c4594ab704b98217a662e in term 2.
I20260709 13:17:29.650943 10576 raft_consensus.cc:697] T 40054610eaa9497494285ea9ca8ec1e5 P 1a0996f2672c4594ab704b98217a662e [term 2 LEADER]: Becoming Leader. State: Replica: 1a0996f2672c4594ab704b98217a662e, State: Running, Role: LEADER
I20260709 13:17:29.652088 10576 consensus_queue.cc:237] T 40054610eaa9497494285ea9ca8ec1e5 P 1a0996f2672c4594ab704b98217a662e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:29.660802 10030 catalog_manager.cc:5697] T 40054610eaa9497494285ea9ca8ec1e5 P 1a0996f2672c4594ab704b98217a662e reported cstate change: term changed from 1 to 2, leader changed from e4c126e4957640968340e01461ba12b2 (127.2.198.194) to 1a0996f2672c4594ab704b98217a662e (127.2.198.195). New cstate: current_term: 2 leader_uuid: "1a0996f2672c4594ab704b98217a662e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:29.850045 10584 raft_consensus.cc:993] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2: : Instructing follower 1a0996f2672c4594ab704b98217a662e to start an election
I20260709 13:17:29.850716 10584 raft_consensus.cc:1081] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 [term 3 LEADER]: Signalling peer 1a0996f2672c4594ab704b98217a662e to start an election
I20260709 13:17:29.852589 10283 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d6defd12940b429a875588ff72d9c61e"
dest_uuid: "1a0996f2672c4594ab704b98217a662e"
 from {username='slave'} at 127.0.0.1:55410
I20260709 13:17:29.853163 10283 raft_consensus.cc:493] T d6defd12940b429a875588ff72d9c61e P 1a0996f2672c4594ab704b98217a662e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:29.853582 10283 raft_consensus.cc:3060] T d6defd12940b429a875588ff72d9c61e P 1a0996f2672c4594ab704b98217a662e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:29.860821 10283 raft_consensus.cc:515] T d6defd12940b429a875588ff72d9c61e P 1a0996f2672c4594ab704b98217a662e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:29.863407 10283 leader_election.cc:290] T d6defd12940b429a875588ff72d9c61e P 1a0996f2672c4594ab704b98217a662e [CANDIDATE]: Term 4 election: Requested vote from peers 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957), e4c126e4957640968340e01461ba12b2 (127.2.198.194:39745)
I20260709 13:17:29.864883 10208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6defd12940b429a875588ff72d9c61e" candidate_uuid: "1a0996f2672c4594ab704b98217a662e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e4c126e4957640968340e01461ba12b2"
I20260709 13:17:29.864851 10476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6defd12940b429a875588ff72d9c61e" candidate_uuid: "1a0996f2672c4594ab704b98217a662e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9f4289676edb4b7c8fe897bafd84e935"
I20260709 13:17:29.865796 10208 raft_consensus.cc:3055] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:29.865897 10476 raft_consensus.cc:3060] T d6defd12940b429a875588ff72d9c61e P 9f4289676edb4b7c8fe897bafd84e935 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:29.866130 10208 raft_consensus.cc:740] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e4c126e4957640968340e01461ba12b2, State: Running, Role: LEADER
I20260709 13:17:29.867012 10208 consensus_queue.cc:260] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:29.868062 10208 raft_consensus.cc:3060] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:29.871938 10476 raft_consensus.cc:2468] T d6defd12940b429a875588ff72d9c61e P 9f4289676edb4b7c8fe897bafd84e935 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a0996f2672c4594ab704b98217a662e in term 4.
I20260709 13:17:29.873129 10246 leader_election.cc:304] T d6defd12940b429a875588ff72d9c61e P 1a0996f2672c4594ab704b98217a662e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a0996f2672c4594ab704b98217a662e, 9f4289676edb4b7c8fe897bafd84e935; no voters: 
I20260709 13:17:29.873914 10576 raft_consensus.cc:2804] T d6defd12940b429a875588ff72d9c61e P 1a0996f2672c4594ab704b98217a662e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:29.874089 10208 raft_consensus.cc:2468] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a0996f2672c4594ab704b98217a662e in term 4.
I20260709 13:17:29.874536 10576 raft_consensus.cc:697] T d6defd12940b429a875588ff72d9c61e P 1a0996f2672c4594ab704b98217a662e [term 4 LEADER]: Becoming Leader. State: Replica: 1a0996f2672c4594ab704b98217a662e, State: Running, Role: LEADER
I20260709 13:17:29.875619 10576 consensus_queue.cc:237] T d6defd12940b429a875588ff72d9c61e P 1a0996f2672c4594ab704b98217a662e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:29.883271 10030 catalog_manager.cc:5697] T d6defd12940b429a875588ff72d9c61e P 1a0996f2672c4594ab704b98217a662e reported cstate change: term changed from 3 to 4, leader changed from e4c126e4957640968340e01461ba12b2 (127.2.198.194) to 1a0996f2672c4594ab704b98217a662e (127.2.198.195). New cstate: current_term: 4 leader_uuid: "1a0996f2672c4594ab704b98217a662e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:29.957100 10566 raft_consensus.cc:993] T 7abb4eef5abd4a268cbebb6cebd4a051 P 1a0996f2672c4594ab704b98217a662e: : Instructing follower e4c126e4957640968340e01461ba12b2 to start an election
I20260709 13:17:29.957718 10576 raft_consensus.cc:1081] T 7abb4eef5abd4a268cbebb6cebd4a051 P 1a0996f2672c4594ab704b98217a662e [term 2 LEADER]: Signalling peer e4c126e4957640968340e01461ba12b2 to start an election
I20260709 13:17:29.959219 10208 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7abb4eef5abd4a268cbebb6cebd4a051"
dest_uuid: "e4c126e4957640968340e01461ba12b2"
 from {username='slave'} at 127.0.0.1:46458
I20260709 13:17:29.959828 10208 raft_consensus.cc:493] T 7abb4eef5abd4a268cbebb6cebd4a051 P e4c126e4957640968340e01461ba12b2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:29.960131 10208 raft_consensus.cc:3060] T 7abb4eef5abd4a268cbebb6cebd4a051 P e4c126e4957640968340e01461ba12b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:29.965158 10208 raft_consensus.cc:515] T 7abb4eef5abd4a268cbebb6cebd4a051 P e4c126e4957640968340e01461ba12b2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:29.966645 10208 leader_election.cc:290] T 7abb4eef5abd4a268cbebb6cebd4a051 P e4c126e4957640968340e01461ba12b2 [CANDIDATE]: Term 3 election: Requested vote from peers 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957), 1a0996f2672c4594ab704b98217a662e (127.2.198.195:45579)
I20260709 13:17:29.967731 10476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abb4eef5abd4a268cbebb6cebd4a051" candidate_uuid: "e4c126e4957640968340e01461ba12b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9f4289676edb4b7c8fe897bafd84e935"
I20260709 13:17:29.967902 10283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abb4eef5abd4a268cbebb6cebd4a051" candidate_uuid: "e4c126e4957640968340e01461ba12b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1a0996f2672c4594ab704b98217a662e"
I20260709 13:17:29.968593 10476 raft_consensus.cc:3060] T 7abb4eef5abd4a268cbebb6cebd4a051 P 9f4289676edb4b7c8fe897bafd84e935 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:29.968611 10283 raft_consensus.cc:3055] T 7abb4eef5abd4a268cbebb6cebd4a051 P 1a0996f2672c4594ab704b98217a662e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:29.969187 10283 raft_consensus.cc:740] T 7abb4eef5abd4a268cbebb6cebd4a051 P 1a0996f2672c4594ab704b98217a662e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1a0996f2672c4594ab704b98217a662e, State: Running, Role: LEADER
I20260709 13:17:29.970079 10283 consensus_queue.cc:260] T 7abb4eef5abd4a268cbebb6cebd4a051 P 1a0996f2672c4594ab704b98217a662e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:29.971448 10283 raft_consensus.cc:3060] T 7abb4eef5abd4a268cbebb6cebd4a051 P 1a0996f2672c4594ab704b98217a662e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:29.976888 10476 raft_consensus.cc:2468] T 7abb4eef5abd4a268cbebb6cebd4a051 P 9f4289676edb4b7c8fe897bafd84e935 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c126e4957640968340e01461ba12b2 in term 3.
I20260709 13:17:29.978379 10172 leader_election.cc:304] T 7abb4eef5abd4a268cbebb6cebd4a051 P e4c126e4957640968340e01461ba12b2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f4289676edb4b7c8fe897bafd84e935, e4c126e4957640968340e01461ba12b2; no voters: 
I20260709 13:17:29.979205 10584 raft_consensus.cc:2804] T 7abb4eef5abd4a268cbebb6cebd4a051 P e4c126e4957640968340e01461ba12b2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:29.979409 10283 raft_consensus.cc:2468] T 7abb4eef5abd4a268cbebb6cebd4a051 P 1a0996f2672c4594ab704b98217a662e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c126e4957640968340e01461ba12b2 in term 3.
I20260709 13:17:29.979662 10584 raft_consensus.cc:697] T 7abb4eef5abd4a268cbebb6cebd4a051 P e4c126e4957640968340e01461ba12b2 [term 3 LEADER]: Becoming Leader. State: Replica: e4c126e4957640968340e01461ba12b2, State: Running, Role: LEADER
I20260709 13:17:29.980612 10584 consensus_queue.cc:237] T 7abb4eef5abd4a268cbebb6cebd4a051 P e4c126e4957640968340e01461ba12b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } }
I20260709 13:17:29.988509 10030 catalog_manager.cc:5697] T 7abb4eef5abd4a268cbebb6cebd4a051 P e4c126e4957640968340e01461ba12b2 reported cstate change: term changed from 2 to 3, leader changed from 1a0996f2672c4594ab704b98217a662e (127.2.198.195) to e4c126e4957640968340e01461ba12b2 (127.2.198.194). New cstate: current_term: 3 leader_uuid: "e4c126e4957640968340e01461ba12b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:30.143257 10208 raft_consensus.cc:1275] T 40054610eaa9497494285ea9ca8ec1e5 P e4c126e4957640968340e01461ba12b2 [term 2 FOLLOWER]: Refusing update from remote peer 1a0996f2672c4594ab704b98217a662e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:30.144745 10576 consensus_queue.cc:1048] T 40054610eaa9497494285ea9ca8ec1e5 P 1a0996f2672c4594ab704b98217a662e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:30.157536 10476 raft_consensus.cc:1275] T 40054610eaa9497494285ea9ca8ec1e5 P 9f4289676edb4b7c8fe897bafd84e935 [term 2 FOLLOWER]: Refusing update from remote peer 1a0996f2672c4594ab704b98217a662e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:30.159090 10576 consensus_queue.cc:1048] T 40054610eaa9497494285ea9ca8ec1e5 P 1a0996f2672c4594ab704b98217a662e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:17:30.177763 10080 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:17:30.292526 10208 raft_consensus.cc:1275] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 [term 4 FOLLOWER]: Refusing update from remote peer 1a0996f2672c4594ab704b98217a662e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:30.294018 10576 consensus_queue.cc:1048] T d6defd12940b429a875588ff72d9c61e P 1a0996f2672c4594ab704b98217a662e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c126e4957640968340e01461ba12b2" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 39745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:30.302551 10476 raft_consensus.cc:1275] T d6defd12940b429a875588ff72d9c61e P 9f4289676edb4b7c8fe897bafd84e935 [term 4 FOLLOWER]: Refusing update from remote peer 1a0996f2672c4594ab704b98217a662e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:30.304229 10566 consensus_queue.cc:1048] T d6defd12940b429a875588ff72d9c61e P 1a0996f2672c4594ab704b98217a662e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:17:30.400206 10063 debug-util.cc:398] Leaking SignalData structure 0x7b08003664c0 after lost signal to thread 2846
W20260709 13:17:30.401556 10063 debug-util.cc:398] Leaking SignalData structure 0x7b080038e040 after lost signal to thread 10066
W20260709 13:17:30.402846 10063 debug-util.cc:398] Leaking SignalData structure 0x7b08001f80a0 after lost signal to thread 10233
W20260709 13:17:30.404002 10063 debug-util.cc:398] Leaking SignalData structure 0x7b08000efb80 after lost signal to thread 10307
W20260709 13:17:30.405195 10063 debug-util.cc:398] Leaking SignalData structure 0x7b08000beb80 after lost signal to thread 10503
I20260709 13:17:30.412355 10476 raft_consensus.cc:1275] T 7abb4eef5abd4a268cbebb6cebd4a051 P 9f4289676edb4b7c8fe897bafd84e935 [term 3 FOLLOWER]: Refusing update from remote peer e4c126e4957640968340e01461ba12b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:30.413985 10584 consensus_queue.cc:1048] T 7abb4eef5abd4a268cbebb6cebd4a051 P e4c126e4957640968340e01461ba12b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f4289676edb4b7c8fe897bafd84e935" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:30.424754 10283 raft_consensus.cc:1275] T 7abb4eef5abd4a268cbebb6cebd4a051 P 1a0996f2672c4594ab704b98217a662e [term 3 FOLLOWER]: Refusing update from remote peer e4c126e4957640968340e01461ba12b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:30.427179 10584 consensus_queue.cc:1048] T 7abb4eef5abd4a268cbebb6cebd4a051 P e4c126e4957640968340e01461ba12b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a0996f2672c4594ab704b98217a662e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 45579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:30.542768  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:30.578076  2843 tablet_server.cc:179] TabletServer@127.2.198.193:39957 shutting down...
W20260709 13:17:30.581243 10246 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
W20260709 13:17:30.587016 10246 consensus_peers.cc:597] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e -> Peer 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957): Couldn't send request to peer 9f4289676edb4b7c8fe897bafd84e935. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:30.595079 10172 consensus_peers.cc:597] T b2a40086010b440599041cd4935e5d86 P e4c126e4957640968340e01461ba12b2 -> Peer 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957): Couldn't send request to peer 9f4289676edb4b7c8fe897bafd84e935. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:30.616545  2843 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:30.617429  2843 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:30.618178  2843 raft_consensus.cc:2243] T 78042ece070249adabf7c5df20cb9980 P 9f4289676edb4b7c8fe897bafd84e935 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:30.618707  2843 raft_consensus.cc:2272] T 78042ece070249adabf7c5df20cb9980 P 9f4289676edb4b7c8fe897bafd84e935 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.620903  2843 tablet_replica.cc:333] stopping tablet replica
W20260709 13:17:30.620935 10172 consensus_peers.cc:597] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2 -> Peer 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957): Couldn't send request to peer 9f4289676edb4b7c8fe897bafd84e935. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:30.621755  2843 raft_consensus.cc:2243] T 5dea73a90f704a799d186b62cabf9383 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:30.622222  2843 raft_consensus.cc:2272] T 5dea73a90f704a799d186b62cabf9383 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.624589  2843 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:30.625357  2843 raft_consensus.cc:2243] T b2a40086010b440599041cd4935e5d86 P 9f4289676edb4b7c8fe897bafd84e935 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:30.625857  2843 raft_consensus.cc:2272] T b2a40086010b440599041cd4935e5d86 P 9f4289676edb4b7c8fe897bafd84e935 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.628315  2843 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:30.628911  2843 raft_consensus.cc:2243] T 7abb4eef5abd4a268cbebb6cebd4a051 P 9f4289676edb4b7c8fe897bafd84e935 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:30.629429  2843 raft_consensus.cc:2272] T 7abb4eef5abd4a268cbebb6cebd4a051 P 9f4289676edb4b7c8fe897bafd84e935 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:30.631439 10246 consensus_peers.cc:597] T a410ccc6082d4335943afd658a181935 P 1a0996f2672c4594ab704b98217a662e -> Peer 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957): Couldn't send request to peer 9f4289676edb4b7c8fe897bafd84e935. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:30.633934  2843 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:30.634943  2843 raft_consensus.cc:2243] T d6defd12940b429a875588ff72d9c61e P 9f4289676edb4b7c8fe897bafd84e935 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:30.635627  2843 raft_consensus.cc:2272] T d6defd12940b429a875588ff72d9c61e P 9f4289676edb4b7c8fe897bafd84e935 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.639458  2843 tablet_replica.cc:333] stopping tablet replica
W20260709 13:17:30.639928 10246 consensus_peers.cc:597] T 40054610eaa9497494285ea9ca8ec1e5 P 1a0996f2672c4594ab704b98217a662e -> Peer 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957): Couldn't send request to peer 9f4289676edb4b7c8fe897bafd84e935. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:30.640336  2843 raft_consensus.cc:2243] T 24b88255bc1b4bfc94b15c94efa36a25 P 9f4289676edb4b7c8fe897bafd84e935 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:30.641040  2843 raft_consensus.cc:2272] T 24b88255bc1b4bfc94b15c94efa36a25 P 9f4289676edb4b7c8fe897bafd84e935 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.643878  2843 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:30.644702  2843 raft_consensus.cc:2243] T 40054610eaa9497494285ea9ca8ec1e5 P 9f4289676edb4b7c8fe897bafd84e935 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:30.645226  2843 raft_consensus.cc:2272] T 40054610eaa9497494285ea9ca8ec1e5 P 9f4289676edb4b7c8fe897bafd84e935 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.648530  2843 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:30.649363  2843 raft_consensus.cc:2243] T 632d0cca3448426a8b909ee924b0244f P 9f4289676edb4b7c8fe897bafd84e935 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:30.649945  2843 raft_consensus.cc:2272] T 632d0cca3448426a8b909ee924b0244f P 9f4289676edb4b7c8fe897bafd84e935 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.652719  2843 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:30.653462  2843 raft_consensus.cc:2243] T a410ccc6082d4335943afd658a181935 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:30.654135  2843 raft_consensus.cc:2272] T a410ccc6082d4335943afd658a181935 P 9f4289676edb4b7c8fe897bafd84e935 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.657262  2843 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:30.658027  2843 raft_consensus.cc:2243] T 9e1fdba60af24ecc84c528fb6813d3d7 P 9f4289676edb4b7c8fe897bafd84e935 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:30.658685  2843 raft_consensus.cc:2272] T 9e1fdba60af24ecc84c528fb6813d3d7 P 9f4289676edb4b7c8fe897bafd84e935 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.689414  2843 tablet_server.cc:196] TabletServer@127.2.198.193:39957 shutdown complete.
I20260709 13:17:30.712249  2843 tablet_server.cc:179] TabletServer@127.2.198.194:0 shutting down...
W20260709 13:17:30.725888 10248 consensus_peers.cc:597] T 40054610eaa9497494285ea9ca8ec1e5 P 1a0996f2672c4594ab704b98217a662e -> Peer e4c126e4957640968340e01461ba12b2 (127.2.198.194:39745): Couldn't send request to peer e4c126e4957640968340e01461ba12b2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:30.754122  2843 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:30.755332  2843 tablet_replica.cc:333] T b2a40086010b440599041cd4935e5d86 P e4c126e4957640968340e01461ba12b2: stopping tablet replica
I20260709 13:17:30.756624  2843 raft_consensus.cc:2243] T b2a40086010b440599041cd4935e5d86 P e4c126e4957640968340e01461ba12b2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:30.757889  2843 raft_consensus.cc:2272] T b2a40086010b440599041cd4935e5d86 P e4c126e4957640968340e01461ba12b2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.761520  2843 tablet_replica.cc:333] T 5dea73a90f704a799d186b62cabf9383 P e4c126e4957640968340e01461ba12b2: stopping tablet replica
I20260709 13:17:30.762488  2843 raft_consensus.cc:2243] T 5dea73a90f704a799d186b62cabf9383 P e4c126e4957640968340e01461ba12b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:30.763222  2843 raft_consensus.cc:2272] T 5dea73a90f704a799d186b62cabf9383 P e4c126e4957640968340e01461ba12b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.766909  2843 tablet_replica.cc:333] T 24b88255bc1b4bfc94b15c94efa36a25 P e4c126e4957640968340e01461ba12b2: stopping tablet replica
I20260709 13:17:30.767864  2843 raft_consensus.cc:2243] T 24b88255bc1b4bfc94b15c94efa36a25 P e4c126e4957640968340e01461ba12b2 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:30.768445  2843 raft_consensus.cc:2272] T 24b88255bc1b4bfc94b15c94efa36a25 P e4c126e4957640968340e01461ba12b2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.771690  2843 tablet_replica.cc:333] T 40054610eaa9497494285ea9ca8ec1e5 P e4c126e4957640968340e01461ba12b2: stopping tablet replica
I20260709 13:17:30.772572  2843 raft_consensus.cc:2243] T 40054610eaa9497494285ea9ca8ec1e5 P e4c126e4957640968340e01461ba12b2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:30.773123  2843 raft_consensus.cc:2272] T 40054610eaa9497494285ea9ca8ec1e5 P e4c126e4957640968340e01461ba12b2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.776914  2843 tablet_replica.cc:333] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2: stopping tablet replica
I20260709 13:17:30.777546  2843 raft_consensus.cc:2243] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:30.777997  2843 raft_consensus.cc:2272] T 632d0cca3448426a8b909ee924b0244f P e4c126e4957640968340e01461ba12b2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.780496  2843 tablet_replica.cc:333] T 7abb4eef5abd4a268cbebb6cebd4a051 P e4c126e4957640968340e01461ba12b2: stopping tablet replica
I20260709 13:17:30.781086  2843 raft_consensus.cc:2243] T 7abb4eef5abd4a268cbebb6cebd4a051 P e4c126e4957640968340e01461ba12b2 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:30.781993  2843 raft_consensus.cc:2272] T 7abb4eef5abd4a268cbebb6cebd4a051 P e4c126e4957640968340e01461ba12b2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.785796  2843 tablet_replica.cc:333] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2: stopping tablet replica
I20260709 13:17:30.786610  2843 raft_consensus.cc:2243] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:30.787159  2843 raft_consensus.cc:2272] T d6defd12940b429a875588ff72d9c61e P e4c126e4957640968340e01461ba12b2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.790583  2843 tablet_replica.cc:333] T 9e1fdba60af24ecc84c528fb6813d3d7 P e4c126e4957640968340e01461ba12b2: stopping tablet replica
I20260709 13:17:30.791231  2843 raft_consensus.cc:2243] T 9e1fdba60af24ecc84c528fb6813d3d7 P e4c126e4957640968340e01461ba12b2 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:30.792064  2843 raft_consensus.cc:2272] T 9e1fdba60af24ecc84c528fb6813d3d7 P e4c126e4957640968340e01461ba12b2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.794417  2843 tablet_replica.cc:333] T a410ccc6082d4335943afd658a181935 P e4c126e4957640968340e01461ba12b2: stopping tablet replica
I20260709 13:17:30.794982  2843 raft_consensus.cc:2243] T a410ccc6082d4335943afd658a181935 P e4c126e4957640968340e01461ba12b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:30.795437  2843 raft_consensus.cc:2272] T a410ccc6082d4335943afd658a181935 P e4c126e4957640968340e01461ba12b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.797698  2843 tablet_replica.cc:333] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2: stopping tablet replica
I20260709 13:17:30.798260  2843 raft_consensus.cc:2243] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:30.799090  2843 raft_consensus.cc:2272] T 78042ece070249adabf7c5df20cb9980 P e4c126e4957640968340e01461ba12b2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.835318  2843 tablet_server.cc:196] TabletServer@127.2.198.194:0 shutdown complete.
W20260709 13:17:30.849228 10246 consensus_peers.cc:597] T 632d0cca3448426a8b909ee924b0244f P 1a0996f2672c4594ab704b98217a662e -> Peer 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957): Couldn't send request to peer 9f4289676edb4b7c8fe897bafd84e935. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39957: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:30.867863 10246 consensus_peers.cc:597] T d6defd12940b429a875588ff72d9c61e P 1a0996f2672c4594ab704b98217a662e -> Peer 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957): Couldn't send request to peer 9f4289676edb4b7c8fe897bafd84e935. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39957: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:30.882596  2843 tablet_server.cc:179] TabletServer@127.2.198.195:0 shutting down...
W20260709 13:17:30.913200 10248 consensus_peers.cc:597] T 5dea73a90f704a799d186b62cabf9383 P 1a0996f2672c4594ab704b98217a662e -> Peer e4c126e4957640968340e01461ba12b2 (127.2.198.194:39745): Couldn't send request to peer e4c126e4957640968340e01461ba12b2. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:39745: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:30.922652  2843 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:30.923578  2843 tablet_replica.cc:333] T b2a40086010b440599041cd4935e5d86 P 1a0996f2672c4594ab704b98217a662e: stopping tablet replica
I20260709 13:17:30.924566  2843 raft_consensus.cc:2243] T b2a40086010b440599041cd4935e5d86 P 1a0996f2672c4594ab704b98217a662e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:30.925071  2843 raft_consensus.cc:2272] T b2a40086010b440599041cd4935e5d86 P 1a0996f2672c4594ab704b98217a662e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:30.924986 10246 consensus_peers.cc:597] T 5dea73a90f704a799d186b62cabf9383 P 1a0996f2672c4594ab704b98217a662e -> Peer 9f4289676edb4b7c8fe897bafd84e935 (127.2.198.193:39957): Couldn't send request to peer 9f4289676edb4b7c8fe897bafd84e935. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39957: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:30.927861  2843 tablet_replica.cc:333] T 78042ece070249adabf7c5df20cb9980 P 1a0996f2672c4594ab704b98217a662e: stopping tablet replica
I20260709 13:17:30.928526  2843 raft_consensus.cc:2243] T 78042ece070249adabf7c5df20cb9980 P 1a0996f2672c4594ab704b98217a662e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:30.928970  2843 raft_consensus.cc:2272] T 78042ece070249adabf7c5df20cb9980 P 1a0996f2672c4594ab704b98217a662e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.931255  2843 tablet_replica.cc:333] T 9e1fdba60af24ecc84c528fb6813d3d7 P 1a0996f2672c4594ab704b98217a662e: stopping tablet replica
I20260709 13:17:30.931970  2843 raft_consensus.cc:2243] T 9e1fdba60af24ecc84c528fb6813d3d7 P 1a0996f2672c4594ab704b98217a662e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:30.932394  2843 raft_consensus.cc:2272] T 9e1fdba60af24ecc84c528fb6813d3d7 P 1a0996f2672c4594ab704b98217a662e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.935021  2843 tablet_replica.cc:333] T a410ccc6082d4335943afd658a181935 P 1a0996f2672c4594ab704b98217a662e: stopping tablet replica
I20260709 13:17:30.935866  2843 raft_consensus.cc:2243] T a410ccc6082d4335943afd658a181935 P 1a0996f2672c4594ab704b98217a662e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:30.936797  2843 raft_consensus.cc:2272] T a410ccc6082d4335943afd658a181935 P 1a0996f2672c4594ab704b98217a662e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.939579  2843 tablet_replica.cc:333] T 7abb4eef5abd4a268cbebb6cebd4a051 P 1a0996f2672c4594ab704b98217a662e: stopping tablet replica
I20260709 13:17:30.940551  2843 raft_consensus.cc:2243] T 7abb4eef5abd4a268cbebb6cebd4a051 P 1a0996f2672c4594ab704b98217a662e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:30.941176  2843 raft_consensus.cc:2272] T 7abb4eef5abd4a268cbebb6cebd4a051 P 1a0996f2672c4594ab704b98217a662e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.943838  2843 tablet_replica.cc:333] T d6defd12940b429a875588ff72d9c61e P 1a0996f2672c4594ab704b98217a662e: stopping tablet replica
I20260709 13:17:30.944469  2843 raft_consensus.cc:2243] T d6defd12940b429a875588ff72d9c61e P 1a0996f2672c4594ab704b98217a662e [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:17:30.945326  2843 raft_consensus.cc:2272] T d6defd12940b429a875588ff72d9c61e P 1a0996f2672c4594ab704b98217a662e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.948156  2843 tablet_replica.cc:333] T 40054610eaa9497494285ea9ca8ec1e5 P 1a0996f2672c4594ab704b98217a662e: stopping tablet replica
I20260709 13:17:30.948735  2843 raft_consensus.cc:2243] T 40054610eaa9497494285ea9ca8ec1e5 P 1a0996f2672c4594ab704b98217a662e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:30.949566  2843 raft_consensus.cc:2272] T 40054610eaa9497494285ea9ca8ec1e5 P 1a0996f2672c4594ab704b98217a662e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.952219  2843 tablet_replica.cc:333] T 632d0cca3448426a8b909ee924b0244f P 1a0996f2672c4594ab704b98217a662e: stopping tablet replica
I20260709 13:17:30.952756  2843 raft_consensus.cc:2243] T 632d0cca3448426a8b909ee924b0244f P 1a0996f2672c4594ab704b98217a662e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:30.953562  2843 raft_consensus.cc:2272] T 632d0cca3448426a8b909ee924b0244f P 1a0996f2672c4594ab704b98217a662e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.955848  2843 tablet_replica.cc:333] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e: stopping tablet replica
I20260709 13:17:30.956328  2843 raft_consensus.cc:2243] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:17:30.957226  2843 raft_consensus.cc:2272] T 24b88255bc1b4bfc94b15c94efa36a25 P 1a0996f2672c4594ab704b98217a662e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.959260  2843 tablet_replica.cc:333] T 5dea73a90f704a799d186b62cabf9383 P 1a0996f2672c4594ab704b98217a662e: stopping tablet replica
I20260709 13:17:30.959807  2843 raft_consensus.cc:2243] T 5dea73a90f704a799d186b62cabf9383 P 1a0996f2672c4594ab704b98217a662e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:30.960700  2843 raft_consensus.cc:2272] T 5dea73a90f704a799d186b62cabf9383 P 1a0996f2672c4594ab704b98217a662e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.997691  2843 tablet_server.cc:196] TabletServer@127.2.198.195:0 shutdown complete.
I20260709 13:17:31.027873  2843 master.cc:562] Master@127.2.198.254:34125 shutting down...
I20260709 13:17:31.062302  2843 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6991d1a40a264a188db8acfc2dfe8e91 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:31.063123  2843 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6991d1a40a264a188db8acfc2dfe8e91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:31.063609  2843 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6991d1a40a264a188db8acfc2dfe8e91: stopping tablet replica
W20260709 13:17:32.082755  2843 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 10063)
W20260709 13:17:33.083585  2843 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 10063)
I20260709 13:17:33.716799  2843 master.cc:584] Master@127.2.198.254:34125 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (15761 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:17:33.781267  2843 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.198.254:43945
I20260709 13:17:33.782598  2843 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:33.789292 10613 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:33.789367 10614 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:33.790091 10616 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:33.791780  2843 server_base.cc:1061] running on GCE node
I20260709 13:17:33.792867  2843 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:33.793093  2843 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:33.793236  2843 hybrid_clock.cc:648] HybridClock initialized: now 1783603053793221 us; error 0 us; skew 500 ppm
I20260709 13:17:33.793745  2843 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:33.796561  2843 webserver.cc:533] Webserver started at http://127.2.198.254:44501/ using document root <none> and password file <none>
I20260709 13:17:33.797052  2843 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:33.797220  2843 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:33.797456  2843 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:33.798804  2843 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602804652623-2843-0/minicluster-data/master-0-root/instance:
uuid: "2003993e2b524aeba845be06ce1c7ec7"
format_stamp: "Formatted at 2026-07-09 13:17:33 on dist-test-slave-fc6v"
I20260709 13:17:33.803486  2843 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:17:33.807143 10621 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:33.807978  2843 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:17:33.808233  2843 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602804652623-2843-0/minicluster-data/master-0-root
uuid: "2003993e2b524aeba845be06ce1c7ec7"
format_stamp: "Formatted at 2026-07-09 13:17:33 on dist-test-slave-fc6v"
I20260709 13:17:33.808496  2843 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602804652623-2843-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602804652623-2843-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602804652623-2843-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:33.829473  2843 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:33.830833  2843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:33.875204  2843 rpc_server.cc:307] RPC server started. Bound to: 127.2.198.254:43945
I20260709 13:17:33.875341 10672 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.198.254:43945 every 8 connection(s)
I20260709 13:17:33.879943 10673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:33.896188 10673 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2003993e2b524aeba845be06ce1c7ec7: Bootstrap starting.
I20260709 13:17:33.901953 10673 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2003993e2b524aeba845be06ce1c7ec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:33.906643 10673 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2003993e2b524aeba845be06ce1c7ec7: No bootstrap required, opened a new log
I20260709 13:17:33.909201 10673 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2003993e2b524aeba845be06ce1c7ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2003993e2b524aeba845be06ce1c7ec7" member_type: VOTER }
I20260709 13:17:33.909837 10673 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2003993e2b524aeba845be06ce1c7ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:33.910076 10673 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2003993e2b524aeba845be06ce1c7ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2003993e2b524aeba845be06ce1c7ec7, State: Initialized, Role: FOLLOWER
I20260709 13:17:33.910735 10673 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2003993e2b524aeba845be06ce1c7ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2003993e2b524aeba845be06ce1c7ec7" member_type: VOTER }
I20260709 13:17:33.911242 10673 raft_consensus.cc:399] T 00000000000000000000000000000000 P 2003993e2b524aeba845be06ce1c7ec7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:17:33.911478 10673 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2003993e2b524aeba845be06ce1c7ec7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:17:33.911850 10673 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2003993e2b524aeba845be06ce1c7ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:33.917251 10673 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2003993e2b524aeba845be06ce1c7ec7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2003993e2b524aeba845be06ce1c7ec7" member_type: VOTER }
I20260709 13:17:33.917747 10673 leader_election.cc:304] T 00000000000000000000000000000000 P 2003993e2b524aeba845be06ce1c7ec7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2003993e2b524aeba845be06ce1c7ec7; no voters: 
I20260709 13:17:33.918979 10673 leader_election.cc:290] T 00000000000000000000000000000000 P 2003993e2b524aeba845be06ce1c7ec7 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:17:33.919349 10676 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2003993e2b524aeba845be06ce1c7ec7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:33.920884 10676 raft_consensus.cc:697] T 00000000000000000000000000000000 P 2003993e2b524aeba845be06ce1c7ec7 [term 1 LEADER]: Becoming Leader. State: Replica: 2003993e2b524aeba845be06ce1c7ec7, State: Running, Role: LEADER
I20260709 13:17:33.921635 10676 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2003993e2b524aeba845be06ce1c7ec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2003993e2b524aeba845be06ce1c7ec7" member_type: VOTER }
I20260709 13:17:33.922178 10673 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2003993e2b524aeba845be06ce1c7ec7 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:17:33.928570 10678 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2003993e2b524aeba845be06ce1c7ec7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2003993e2b524aeba845be06ce1c7ec7. Latest consensus state: current_term: 1 leader_uuid: "2003993e2b524aeba845be06ce1c7ec7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2003993e2b524aeba845be06ce1c7ec7" member_type: VOTER } }
I20260709 13:17:33.929255 10678 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2003993e2b524aeba845be06ce1c7ec7 [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:33.930488 10677 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2003993e2b524aeba845be06ce1c7ec7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2003993e2b524aeba845be06ce1c7ec7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2003993e2b524aeba845be06ce1c7ec7" member_type: VOTER } }
I20260709 13:17:33.931248 10677 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2003993e2b524aeba845be06ce1c7ec7 [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:33.934617 10685 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:17:33.940714 10685 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:17:33.941896  2843 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:17:33.950450 10685 catalog_manager.cc:1383] Generated new cluster ID: 31a3889366aa4688a727e362fda8c238
I20260709 13:17:33.950765 10685 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:17:33.962769 10685 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:17:33.964298 10685 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:17:33.977120 10685 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 2003993e2b524aeba845be06ce1c7ec7: Generated new TSK 0
I20260709 13:17:33.977720 10685 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:17:34.008934  2843 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:34.015977 10694 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:34.017858 10695 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:34.020023 10697 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:34.021064  2843 server_base.cc:1061] running on GCE node
I20260709 13:17:34.022547  2843 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:34.022776  2843 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:34.022958  2843 hybrid_clock.cc:648] HybridClock initialized: now 1783603054022940 us; error 0 us; skew 500 ppm
I20260709 13:17:34.023633  2843 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:34.026160  2843 webserver.cc:533] Webserver started at http://127.2.198.193:37967/ using document root <none> and password file <none>
I20260709 13:17:34.026620  2843 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:34.026788  2843 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:34.027012  2843 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:34.028478  2843 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602804652623-2843-0/minicluster-data/ts-0-root/instance:
uuid: "e51dc9362e3f42279e5840d9e6957bc7"
format_stamp: "Formatted at 2026-07-09 13:17:34 on dist-test-slave-fc6v"
I20260709 13:17:34.033473  2843 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:17:34.037096 10702 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:34.037947  2843 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:17:34.038256  2843 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602804652623-2843-0/minicluster-data/ts-0-root
uuid: "e51dc9362e3f42279e5840d9e6957bc7"
format_stamp: "Formatted at 2026-07-09 13:17:34 on dist-test-slave-fc6v"
I20260709 13:17:34.038528  2843 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602804652623-2843-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602804652623-2843-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602804652623-2843-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:34.059973  2843 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:34.061398  2843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:34.063037  2843 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:34.065662  2843 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:34.065871  2843 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:34.066138  2843 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:34.066313  2843 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:34.114689  2843 rpc_server.cc:307] RPC server started. Bound to: 127.2.198.193:35533
I20260709 13:17:34.114825 10764 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.198.193:35533 every 8 connection(s)
I20260709 13:17:34.120847  2843 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:34.129135 10769 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:34.131863 10770 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:34.135228 10772 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:34.135802  2843 server_base.cc:1061] running on GCE node
I20260709 13:17:34.135926 10765 heartbeater.cc:344] Connected to a master server at 127.2.198.254:43945
I20260709 13:17:34.136535 10765 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:34.137432  2843 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:17:34.137665 10765 heartbeater.cc:507] Master 127.2.198.254:43945 requested a full tablet report, sending...
W20260709 13:17:34.137852  2843 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:34.138128  2843 hybrid_clock.cc:648] HybridClock initialized: now 1783603054138105 us; error 0 us; skew 500 ppm
I20260709 13:17:34.138953  2843 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:34.140488 10638 ts_manager.cc:194] Registered new tserver with Master: e51dc9362e3f42279e5840d9e6957bc7 (127.2.198.193:35533)
I20260709 13:17:34.142257  2843 webserver.cc:533] Webserver started at http://127.2.198.194:43863/ using document root <none> and password file <none>
I20260709 13:17:34.142815  2843 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:34.142866 10638 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60046
I20260709 13:17:34.143020  2843 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:34.143476  2843 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:34.145561  2843 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602804652623-2843-0/minicluster-data/ts-1-root/instance:
uuid: "d620f151ca8746a9a5e82828e3f8678f"
format_stamp: "Formatted at 2026-07-09 13:17:34 on dist-test-slave-fc6v"
I20260709 13:17:34.150653  2843 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:17:34.154537 10777 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:34.155356  2843 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:17:34.155681  2843 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602804652623-2843-0/minicluster-data/ts-1-root
uuid: "d620f151ca8746a9a5e82828e3f8678f"
format_stamp: "Formatted at 2026-07-09 13:17:34 on dist-test-slave-fc6v"
I20260709 13:17:34.155946  2843 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602804652623-2843-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602804652623-2843-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602804652623-2843-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:34.175719  2843 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:34.177065  2843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:34.178689  2843 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:34.181313  2843 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:34.181493  2843 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:34.181819  2843 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:34.181959  2843 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:34.229655  2843 rpc_server.cc:307] RPC server started. Bound to: 127.2.198.194:40351
I20260709 13:17:34.229764 10839 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.198.194:40351 every 8 connection(s)
I20260709 13:17:34.235361  2843 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:34.245283 10843 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:34.246613 10844 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:34.249996  2843 server_base.cc:1061] running on GCE node
W20260709 13:17:34.250344 10846 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:34.250550 10840 heartbeater.cc:344] Connected to a master server at 127.2.198.254:43945
I20260709 13:17:34.251076 10840 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:34.251626  2843 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:34.251920  2843 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:34.252104  2843 hybrid_clock.cc:648] HybridClock initialized: now 1783603054252084 us; error 0 us; skew 500 ppm
I20260709 13:17:34.252108 10840 heartbeater.cc:507] Master 127.2.198.254:43945 requested a full tablet report, sending...
I20260709 13:17:34.252928  2843 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:34.254494 10638 ts_manager.cc:194] Registered new tserver with Master: d620f151ca8746a9a5e82828e3f8678f (127.2.198.194:40351)
I20260709 13:17:34.256105 10638 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60052
I20260709 13:17:34.256150  2843 webserver.cc:533] Webserver started at http://127.2.198.195:33181/ using document root <none> and password file <none>
I20260709 13:17:34.256811  2843 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:34.257035  2843 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:34.257323  2843 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:34.258829  2843 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602804652623-2843-0/minicluster-data/ts-2-root/instance:
uuid: "1ebc149a3815471c8680c5f3611eb094"
format_stamp: "Formatted at 2026-07-09 13:17:34 on dist-test-slave-fc6v"
I20260709 13:17:34.263461  2843 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.006s
I20260709 13:17:34.266981 10851 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:34.267771  2843 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:17:34.268067  2843 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602804652623-2843-0/minicluster-data/ts-2-root
uuid: "1ebc149a3815471c8680c5f3611eb094"
format_stamp: "Formatted at 2026-07-09 13:17:34 on dist-test-slave-fc6v"
I20260709 13:17:34.268379  2843 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602804652623-2843-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602804652623-2843-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602804652623-2843-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:34.290691  2843 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:34.292090  2843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:34.293687  2843 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:34.296175  2843 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:34.296418  2843 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:34.296662  2843 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:34.296840  2843 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:34.345441  2843 rpc_server.cc:307] RPC server started. Bound to: 127.2.198.195:34299
I20260709 13:17:34.345556 10913 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.198.195:34299 every 8 connection(s)
I20260709 13:17:34.361500 10914 heartbeater.cc:344] Connected to a master server at 127.2.198.254:43945
I20260709 13:17:34.361970 10914 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:34.362840 10914 heartbeater.cc:507] Master 127.2.198.254:43945 requested a full tablet report, sending...
I20260709 13:17:34.365100 10638 ts_manager.cc:194] Registered new tserver with Master: 1ebc149a3815471c8680c5f3611eb094 (127.2.198.195:34299)
I20260709 13:17:34.366026  2843 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016747634s
I20260709 13:17:34.366953 10638 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60068
I20260709 13:17:34.395347 10638 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60084:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:17:34.397866 10638 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:17:34.454691 10805 tablet_service.cc:1511] Processing CreateTablet for tablet 3a64e19a8d9149f0abf109accd42d9ae (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=65d04b4d8aae4828b8b718acc7bdddc5]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:17:34.454874 10879 tablet_service.cc:1511] Processing CreateTablet for tablet 3a64e19a8d9149f0abf109accd42d9ae (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=65d04b4d8aae4828b8b718acc7bdddc5]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:17:34.456700 10879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a64e19a8d9149f0abf109accd42d9ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:34.456629 10878 tablet_service.cc:1511] Processing CreateTablet for tablet c3f7fbfc06a14d18bcd5eed1510d5bd2 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=65d04b4d8aae4828b8b718acc7bdddc5]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:17:34.456712 10805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a64e19a8d9149f0abf109accd42d9ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:34.458923 10804 tablet_service.cc:1511] Processing CreateTablet for tablet c3f7fbfc06a14d18bcd5eed1510d5bd2 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=65d04b4d8aae4828b8b718acc7bdddc5]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:17:34.460546 10804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3f7fbfc06a14d18bcd5eed1510d5bd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:34.458508 10878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3f7fbfc06a14d18bcd5eed1510d5bd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:34.465902 10730 tablet_service.cc:1511] Processing CreateTablet for tablet 3a64e19a8d9149f0abf109accd42d9ae (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=65d04b4d8aae4828b8b718acc7bdddc5]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:17:34.469161 10729 tablet_service.cc:1511] Processing CreateTablet for tablet c3f7fbfc06a14d18bcd5eed1510d5bd2 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=65d04b4d8aae4828b8b718acc7bdddc5]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:17:34.475149 10730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a64e19a8d9149f0abf109accd42d9ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:34.477875 10729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3f7fbfc06a14d18bcd5eed1510d5bd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:34.506691 10929 tablet_bootstrap.cc:492] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P d620f151ca8746a9a5e82828e3f8678f: Bootstrap starting.
I20260709 13:17:34.506891 10930 tablet_bootstrap.cc:492] T 3a64e19a8d9149f0abf109accd42d9ae P 1ebc149a3815471c8680c5f3611eb094: Bootstrap starting.
I20260709 13:17:34.523738 10930 tablet_bootstrap.cc:654] T 3a64e19a8d9149f0abf109accd42d9ae P 1ebc149a3815471c8680c5f3611eb094: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:34.524014 10929 tablet_bootstrap.cc:654] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P d620f151ca8746a9a5e82828e3f8678f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:34.524291 10931 tablet_bootstrap.cc:492] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P e51dc9362e3f42279e5840d9e6957bc7: Bootstrap starting.
I20260709 13:17:34.529863 10929 tablet_bootstrap.cc:492] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P d620f151ca8746a9a5e82828e3f8678f: No bootstrap required, opened a new log
I20260709 13:17:34.530488 10929 ts_tablet_manager.cc:1403] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P d620f151ca8746a9a5e82828e3f8678f: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.010s
I20260709 13:17:34.531036 10930 tablet_bootstrap.cc:492] T 3a64e19a8d9149f0abf109accd42d9ae P 1ebc149a3815471c8680c5f3611eb094: No bootstrap required, opened a new log
I20260709 13:17:34.531668 10930 ts_tablet_manager.cc:1403] T 3a64e19a8d9149f0abf109accd42d9ae P 1ebc149a3815471c8680c5f3611eb094: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.000s
I20260709 13:17:34.533380 10931 tablet_bootstrap.cc:654] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P e51dc9362e3f42279e5840d9e6957bc7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:34.534054 10929 raft_consensus.cc:359] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P d620f151ca8746a9a5e82828e3f8678f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } } peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } }
I20260709 13:17:34.534910 10929 raft_consensus.cc:385] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P d620f151ca8746a9a5e82828e3f8678f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:34.535291 10929 raft_consensus.cc:740] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P d620f151ca8746a9a5e82828e3f8678f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d620f151ca8746a9a5e82828e3f8678f, State: Initialized, Role: FOLLOWER
I20260709 13:17:34.534986 10930 raft_consensus.cc:359] T 3a64e19a8d9149f0abf109accd42d9ae P 1ebc149a3815471c8680c5f3611eb094 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } } peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } }
I20260709 13:17:34.535825 10930 raft_consensus.cc:385] T 3a64e19a8d9149f0abf109accd42d9ae P 1ebc149a3815471c8680c5f3611eb094 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:34.536144 10930 raft_consensus.cc:740] T 3a64e19a8d9149f0abf109accd42d9ae P 1ebc149a3815471c8680c5f3611eb094 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ebc149a3815471c8680c5f3611eb094, State: Initialized, Role: FOLLOWER
I20260709 13:17:34.536590 10929 consensus_queue.cc:260] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P d620f151ca8746a9a5e82828e3f8678f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } } peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } }
I20260709 13:17:34.537098 10930 consensus_queue.cc:260] T 3a64e19a8d9149f0abf109accd42d9ae P 1ebc149a3815471c8680c5f3611eb094 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } } peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } }
I20260709 13:17:34.538853 10931 tablet_bootstrap.cc:492] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P e51dc9362e3f42279e5840d9e6957bc7: No bootstrap required, opened a new log
I20260709 13:17:34.539016 10840 heartbeater.cc:499] Master 127.2.198.254:43945 was elected leader, sending a full tablet report...
I20260709 13:17:34.539419 10931 ts_tablet_manager.cc:1403] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P e51dc9362e3f42279e5840d9e6957bc7: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.003s
I20260709 13:17:34.539906 10929 ts_tablet_manager.cc:1434] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P d620f151ca8746a9a5e82828e3f8678f: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:17:34.541751 10929 tablet_bootstrap.cc:492] T 3a64e19a8d9149f0abf109accd42d9ae P d620f151ca8746a9a5e82828e3f8678f: Bootstrap starting.
I20260709 13:17:34.542734 10931 raft_consensus.cc:359] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P e51dc9362e3f42279e5840d9e6957bc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } } peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } }
I20260709 13:17:34.543591 10931 raft_consensus.cc:385] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P e51dc9362e3f42279e5840d9e6957bc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:34.543926 10931 raft_consensus.cc:740] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P e51dc9362e3f42279e5840d9e6957bc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51dc9362e3f42279e5840d9e6957bc7, State: Initialized, Role: FOLLOWER
I20260709 13:17:34.545006 10931 consensus_queue.cc:260] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P e51dc9362e3f42279e5840d9e6957bc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } } peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } }
I20260709 13:17:34.554322 10765 heartbeater.cc:499] Master 127.2.198.254:43945 was elected leader, sending a full tablet report...
I20260709 13:17:34.554893 10931 ts_tablet_manager.cc:1434] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P e51dc9362e3f42279e5840d9e6957bc7: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.007s
I20260709 13:17:34.555043 10914 heartbeater.cc:499] Master 127.2.198.254:43945 was elected leader, sending a full tablet report...
I20260709 13:17:34.555709 10930 ts_tablet_manager.cc:1434] T 3a64e19a8d9149f0abf109accd42d9ae P 1ebc149a3815471c8680c5f3611eb094: Time spent starting tablet: real 0.024s	user 0.011s	sys 0.013s
I20260709 13:17:34.556114 10931 tablet_bootstrap.cc:492] T 3a64e19a8d9149f0abf109accd42d9ae P e51dc9362e3f42279e5840d9e6957bc7: Bootstrap starting.
I20260709 13:17:34.552246 10929 tablet_bootstrap.cc:654] T 3a64e19a8d9149f0abf109accd42d9ae P d620f151ca8746a9a5e82828e3f8678f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:34.558607 10930 tablet_bootstrap.cc:492] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P 1ebc149a3815471c8680c5f3611eb094: Bootstrap starting.
I20260709 13:17:34.564754 10931 tablet_bootstrap.cc:654] T 3a64e19a8d9149f0abf109accd42d9ae P e51dc9362e3f42279e5840d9e6957bc7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:34.566819 10930 tablet_bootstrap.cc:654] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P 1ebc149a3815471c8680c5f3611eb094: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:34.572005 10929 tablet_bootstrap.cc:492] T 3a64e19a8d9149f0abf109accd42d9ae P d620f151ca8746a9a5e82828e3f8678f: No bootstrap required, opened a new log
I20260709 13:17:34.572799 10929 ts_tablet_manager.cc:1403] T 3a64e19a8d9149f0abf109accd42d9ae P d620f151ca8746a9a5e82828e3f8678f: Time spent bootstrapping tablet: real 0.031s	user 0.007s	sys 0.018s
I20260709 13:17:34.572944 10931 tablet_bootstrap.cc:492] T 3a64e19a8d9149f0abf109accd42d9ae P e51dc9362e3f42279e5840d9e6957bc7: No bootstrap required, opened a new log
I20260709 13:17:34.573642 10931 ts_tablet_manager.cc:1403] T 3a64e19a8d9149f0abf109accd42d9ae P e51dc9362e3f42279e5840d9e6957bc7: Time spent bootstrapping tablet: real 0.018s	user 0.004s	sys 0.008s
I20260709 13:17:34.577417 10931 raft_consensus.cc:359] T 3a64e19a8d9149f0abf109accd42d9ae P e51dc9362e3f42279e5840d9e6957bc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } } peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } }
I20260709 13:17:34.578310 10931 raft_consensus.cc:385] T 3a64e19a8d9149f0abf109accd42d9ae P e51dc9362e3f42279e5840d9e6957bc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:34.578792 10931 raft_consensus.cc:740] T 3a64e19a8d9149f0abf109accd42d9ae P e51dc9362e3f42279e5840d9e6957bc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51dc9362e3f42279e5840d9e6957bc7, State: Initialized, Role: FOLLOWER
I20260709 13:17:34.578017 10929 raft_consensus.cc:359] T 3a64e19a8d9149f0abf109accd42d9ae P d620f151ca8746a9a5e82828e3f8678f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } } peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } }
I20260709 13:17:34.579701 10929 raft_consensus.cc:385] T 3a64e19a8d9149f0abf109accd42d9ae P d620f151ca8746a9a5e82828e3f8678f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:34.580350 10929 raft_consensus.cc:740] T 3a64e19a8d9149f0abf109accd42d9ae P d620f151ca8746a9a5e82828e3f8678f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d620f151ca8746a9a5e82828e3f8678f, State: Initialized, Role: FOLLOWER
I20260709 13:17:34.581506 10929 consensus_queue.cc:260] T 3a64e19a8d9149f0abf109accd42d9ae P d620f151ca8746a9a5e82828e3f8678f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } } peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } }
I20260709 13:17:34.584437 10929 ts_tablet_manager.cc:1434] T 3a64e19a8d9149f0abf109accd42d9ae P d620f151ca8746a9a5e82828e3f8678f: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.005s
I20260709 13:17:34.579743 10931 consensus_queue.cc:260] T 3a64e19a8d9149f0abf109accd42d9ae P e51dc9362e3f42279e5840d9e6957bc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } } peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } }
I20260709 13:17:34.587821 10931 ts_tablet_manager.cc:1434] T 3a64e19a8d9149f0abf109accd42d9ae P e51dc9362e3f42279e5840d9e6957bc7: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.001s
I20260709 13:17:34.588837 10930 tablet_bootstrap.cc:492] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P 1ebc149a3815471c8680c5f3611eb094: No bootstrap required, opened a new log
I20260709 13:17:34.589473 10930 ts_tablet_manager.cc:1403] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P 1ebc149a3815471c8680c5f3611eb094: Time spent bootstrapping tablet: real 0.031s	user 0.020s	sys 0.009s
I20260709 13:17:34.592799 10930 raft_consensus.cc:359] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P 1ebc149a3815471c8680c5f3611eb094 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } } peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } }
I20260709 13:17:34.593683 10930 raft_consensus.cc:385] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P 1ebc149a3815471c8680c5f3611eb094 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:34.594049 10930 raft_consensus.cc:740] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P 1ebc149a3815471c8680c5f3611eb094 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ebc149a3815471c8680c5f3611eb094, State: Initialized, Role: FOLLOWER
I20260709 13:17:34.594933 10930 consensus_queue.cc:260] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P 1ebc149a3815471c8680c5f3611eb094 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } } peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } }
I20260709 13:17:34.597143 10930 ts_tablet_manager.cc:1434] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P 1ebc149a3815471c8680c5f3611eb094: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:17:34.697553 10937 raft_consensus.cc:493] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P e51dc9362e3f42279e5840d9e6957bc7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.698197 10937 raft_consensus.cc:515] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P e51dc9362e3f42279e5840d9e6957bc7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } } peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } }
I20260709 13:17:34.700448 10937 leader_election.cc:290] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P e51dc9362e3f42279e5840d9e6957bc7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d620f151ca8746a9a5e82828e3f8678f (127.2.198.194:40351), 1ebc149a3815471c8680c5f3611eb094 (127.2.198.195:34299)
I20260709 13:17:34.714102 10889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3f7fbfc06a14d18bcd5eed1510d5bd2" candidate_uuid: "e51dc9362e3f42279e5840d9e6957bc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ebc149a3815471c8680c5f3611eb094" is_pre_election: true
I20260709 13:17:34.714282 10815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3f7fbfc06a14d18bcd5eed1510d5bd2" candidate_uuid: "e51dc9362e3f42279e5840d9e6957bc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d620f151ca8746a9a5e82828e3f8678f" is_pre_election: true
I20260709 13:17:34.715080 10889 raft_consensus.cc:2468] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P 1ebc149a3815471c8680c5f3611eb094 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51dc9362e3f42279e5840d9e6957bc7 in term 0.
I20260709 13:17:34.715143 10815 raft_consensus.cc:2468] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P d620f151ca8746a9a5e82828e3f8678f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51dc9362e3f42279e5840d9e6957bc7 in term 0.
I20260709 13:17:34.716480 10706 leader_election.cc:304] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P e51dc9362e3f42279e5840d9e6957bc7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ebc149a3815471c8680c5f3611eb094, e51dc9362e3f42279e5840d9e6957bc7; no voters: 
I20260709 13:17:34.717257 10937 raft_consensus.cc:2804] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P e51dc9362e3f42279e5840d9e6957bc7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:34.717644 10937 raft_consensus.cc:493] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P e51dc9362e3f42279e5840d9e6957bc7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.717908 10937 raft_consensus.cc:3060] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P e51dc9362e3f42279e5840d9e6957bc7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:34.725083 10937 raft_consensus.cc:515] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P e51dc9362e3f42279e5840d9e6957bc7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } } peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } }
I20260709 13:17:34.726816 10937 leader_election.cc:290] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P e51dc9362e3f42279e5840d9e6957bc7 [CANDIDATE]: Term 1 election: Requested vote from peers d620f151ca8746a9a5e82828e3f8678f (127.2.198.194:40351), 1ebc149a3815471c8680c5f3611eb094 (127.2.198.195:34299)
I20260709 13:17:34.728081 10815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3f7fbfc06a14d18bcd5eed1510d5bd2" candidate_uuid: "e51dc9362e3f42279e5840d9e6957bc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d620f151ca8746a9a5e82828e3f8678f"
I20260709 13:17:34.728081 10889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3f7fbfc06a14d18bcd5eed1510d5bd2" candidate_uuid: "e51dc9362e3f42279e5840d9e6957bc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ebc149a3815471c8680c5f3611eb094"
I20260709 13:17:34.728998 10815 raft_consensus.cc:3060] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P d620f151ca8746a9a5e82828e3f8678f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:34.729079 10889 raft_consensus.cc:3060] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P 1ebc149a3815471c8680c5f3611eb094 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:34.735899 10815 raft_consensus.cc:2468] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P d620f151ca8746a9a5e82828e3f8678f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51dc9362e3f42279e5840d9e6957bc7 in term 1.
I20260709 13:17:34.736441 10889 raft_consensus.cc:2468] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P 1ebc149a3815471c8680c5f3611eb094 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51dc9362e3f42279e5840d9e6957bc7 in term 1.
I20260709 13:17:34.737162 10704 leader_election.cc:304] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P e51dc9362e3f42279e5840d9e6957bc7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d620f151ca8746a9a5e82828e3f8678f, e51dc9362e3f42279e5840d9e6957bc7; no voters: 
I20260709 13:17:34.738166 10937 raft_consensus.cc:2804] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P e51dc9362e3f42279e5840d9e6957bc7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:34.739352 10937 raft_consensus.cc:697] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P e51dc9362e3f42279e5840d9e6957bc7 [term 1 LEADER]: Becoming Leader. State: Replica: e51dc9362e3f42279e5840d9e6957bc7, State: Running, Role: LEADER
I20260709 13:17:34.740317 10937 consensus_queue.cc:237] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P e51dc9362e3f42279e5840d9e6957bc7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } } peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } }
I20260709 13:17:34.747889 10636 catalog_manager.cc:5697] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P e51dc9362e3f42279e5840d9e6957bc7 reported cstate change: term changed from 0 to 1, leader changed from <none> to e51dc9362e3f42279e5840d9e6957bc7 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "e51dc9362e3f42279e5840d9e6957bc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:34.834381 10937 raft_consensus.cc:493] T 3a64e19a8d9149f0abf109accd42d9ae P e51dc9362e3f42279e5840d9e6957bc7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.834970 10937 raft_consensus.cc:515] T 3a64e19a8d9149f0abf109accd42d9ae P e51dc9362e3f42279e5840d9e6957bc7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } } peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } }
I20260709 13:17:34.837018 10937 leader_election.cc:290] T 3a64e19a8d9149f0abf109accd42d9ae P e51dc9362e3f42279e5840d9e6957bc7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ebc149a3815471c8680c5f3611eb094 (127.2.198.195:34299), d620f151ca8746a9a5e82828e3f8678f (127.2.198.194:40351)
I20260709 13:17:34.838295 10815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a64e19a8d9149f0abf109accd42d9ae" candidate_uuid: "e51dc9362e3f42279e5840d9e6957bc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d620f151ca8746a9a5e82828e3f8678f" is_pre_election: true
I20260709 13:17:34.838238 10889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a64e19a8d9149f0abf109accd42d9ae" candidate_uuid: "e51dc9362e3f42279e5840d9e6957bc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ebc149a3815471c8680c5f3611eb094" is_pre_election: true
I20260709 13:17:34.839193 10815 raft_consensus.cc:2468] T 3a64e19a8d9149f0abf109accd42d9ae P d620f151ca8746a9a5e82828e3f8678f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51dc9362e3f42279e5840d9e6957bc7 in term 0.
I20260709 13:17:34.839217 10889 raft_consensus.cc:2468] T 3a64e19a8d9149f0abf109accd42d9ae P 1ebc149a3815471c8680c5f3611eb094 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51dc9362e3f42279e5840d9e6957bc7 in term 0.
I20260709 13:17:34.840579 10704 leader_election.cc:304] T 3a64e19a8d9149f0abf109accd42d9ae P e51dc9362e3f42279e5840d9e6957bc7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d620f151ca8746a9a5e82828e3f8678f, e51dc9362e3f42279e5840d9e6957bc7; no voters: 
I20260709 13:17:34.841346 10937 raft_consensus.cc:2804] T 3a64e19a8d9149f0abf109accd42d9ae P e51dc9362e3f42279e5840d9e6957bc7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:34.841640 10937 raft_consensus.cc:493] T 3a64e19a8d9149f0abf109accd42d9ae P e51dc9362e3f42279e5840d9e6957bc7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.842025 10937 raft_consensus.cc:3060] T 3a64e19a8d9149f0abf109accd42d9ae P e51dc9362e3f42279e5840d9e6957bc7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:34.849915 10937 raft_consensus.cc:515] T 3a64e19a8d9149f0abf109accd42d9ae P e51dc9362e3f42279e5840d9e6957bc7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } } peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } }
I20260709 13:17:34.851931 10937 leader_election.cc:290] T 3a64e19a8d9149f0abf109accd42d9ae P e51dc9362e3f42279e5840d9e6957bc7 [CANDIDATE]: Term 1 election: Requested vote from peers 1ebc149a3815471c8680c5f3611eb094 (127.2.198.195:34299), d620f151ca8746a9a5e82828e3f8678f (127.2.198.194:40351)
I20260709 13:17:34.852778 10889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a64e19a8d9149f0abf109accd42d9ae" candidate_uuid: "e51dc9362e3f42279e5840d9e6957bc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ebc149a3815471c8680c5f3611eb094"
I20260709 13:17:34.853147 10815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a64e19a8d9149f0abf109accd42d9ae" candidate_uuid: "e51dc9362e3f42279e5840d9e6957bc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d620f151ca8746a9a5e82828e3f8678f"
I20260709 13:17:34.853562 10889 raft_consensus.cc:3060] T 3a64e19a8d9149f0abf109accd42d9ae P 1ebc149a3815471c8680c5f3611eb094 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:34.853807 10815 raft_consensus.cc:3060] T 3a64e19a8d9149f0abf109accd42d9ae P d620f151ca8746a9a5e82828e3f8678f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:34.861897 10815 raft_consensus.cc:2468] T 3a64e19a8d9149f0abf109accd42d9ae P d620f151ca8746a9a5e82828e3f8678f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51dc9362e3f42279e5840d9e6957bc7 in term 1.
I20260709 13:17:34.861897 10889 raft_consensus.cc:2468] T 3a64e19a8d9149f0abf109accd42d9ae P 1ebc149a3815471c8680c5f3611eb094 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51dc9362e3f42279e5840d9e6957bc7 in term 1.
I20260709 13:17:34.863487 10706 leader_election.cc:304] T 3a64e19a8d9149f0abf109accd42d9ae P e51dc9362e3f42279e5840d9e6957bc7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ebc149a3815471c8680c5f3611eb094, e51dc9362e3f42279e5840d9e6957bc7; no voters: 
I20260709 13:17:34.864283 10937 raft_consensus.cc:2804] T 3a64e19a8d9149f0abf109accd42d9ae P e51dc9362e3f42279e5840d9e6957bc7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:34.864750 10937 raft_consensus.cc:697] T 3a64e19a8d9149f0abf109accd42d9ae P e51dc9362e3f42279e5840d9e6957bc7 [term 1 LEADER]: Becoming Leader. State: Replica: e51dc9362e3f42279e5840d9e6957bc7, State: Running, Role: LEADER
I20260709 13:17:34.865583 10937 consensus_queue.cc:237] T 3a64e19a8d9149f0abf109accd42d9ae P e51dc9362e3f42279e5840d9e6957bc7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } } peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } }
I20260709 13:17:34.873030 10636 catalog_manager.cc:5697] T 3a64e19a8d9149f0abf109accd42d9ae P e51dc9362e3f42279e5840d9e6957bc7 reported cstate change: term changed from 0 to 1, leader changed from <none> to e51dc9362e3f42279e5840d9e6957bc7 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "e51dc9362e3f42279e5840d9e6957bc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:34.955353 10636 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60086:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:17:34.957538 10636 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:17:34.985270 10729 tablet_service.cc:1511] Processing CreateTablet for tablet 091ab5b3eeb7431c801d87f032fa2884 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=5ab1c18c5e6a40d58db1420a6eb04082]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:17:34.986708 10729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 091ab5b3eeb7431c801d87f032fa2884. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:34.986868 10804 tablet_service.cc:1511] Processing CreateTablet for tablet 091ab5b3eeb7431c801d87f032fa2884 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=5ab1c18c5e6a40d58db1420a6eb04082]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:17:34.988590 10878 tablet_service.cc:1511] Processing CreateTablet for tablet 091ab5b3eeb7431c801d87f032fa2884 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=5ab1c18c5e6a40d58db1420a6eb04082]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:17:34.991940 10805 tablet_service.cc:1511] Processing CreateTablet for tablet 9f9ccd6f8215499bbeec362b4e9d3e0d (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=5ab1c18c5e6a40d58db1420a6eb04082]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:17:34.992810 10878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 091ab5b3eeb7431c801d87f032fa2884. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:34.994254 10879 tablet_service.cc:1511] Processing CreateTablet for tablet 9f9ccd6f8215499bbeec362b4e9d3e0d (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=5ab1c18c5e6a40d58db1420a6eb04082]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:17:34.995604 10879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f9ccd6f8215499bbeec362b4e9d3e0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:34.990643 10730 tablet_service.cc:1511] Processing CreateTablet for tablet 9f9ccd6f8215499bbeec362b4e9d3e0d (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=5ab1c18c5e6a40d58db1420a6eb04082]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:17:35.000523 10730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f9ccd6f8215499bbeec362b4e9d3e0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:34.991992 10804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 091ab5b3eeb7431c801d87f032fa2884. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:35.004415 10805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f9ccd6f8215499bbeec362b4e9d3e0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:35.005846 10931 tablet_bootstrap.cc:492] T 091ab5b3eeb7431c801d87f032fa2884 P e51dc9362e3f42279e5840d9e6957bc7: Bootstrap starting.
I20260709 13:17:35.012089 10930 tablet_bootstrap.cc:492] T 091ab5b3eeb7431c801d87f032fa2884 P 1ebc149a3815471c8680c5f3611eb094: Bootstrap starting.
I20260709 13:17:35.013739 10931 tablet_bootstrap.cc:654] T 091ab5b3eeb7431c801d87f032fa2884 P e51dc9362e3f42279e5840d9e6957bc7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:35.020807 10930 tablet_bootstrap.cc:654] T 091ab5b3eeb7431c801d87f032fa2884 P 1ebc149a3815471c8680c5f3611eb094: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:35.021181 10931 tablet_bootstrap.cc:492] T 091ab5b3eeb7431c801d87f032fa2884 P e51dc9362e3f42279e5840d9e6957bc7: No bootstrap required, opened a new log
I20260709 13:17:35.021716 10931 ts_tablet_manager.cc:1403] T 091ab5b3eeb7431c801d87f032fa2884 P e51dc9362e3f42279e5840d9e6957bc7: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.001s
I20260709 13:17:35.025525 10931 raft_consensus.cc:359] T 091ab5b3eeb7431c801d87f032fa2884 P e51dc9362e3f42279e5840d9e6957bc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } } peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } }
I20260709 13:17:35.026597 10931 raft_consensus.cc:385] T 091ab5b3eeb7431c801d87f032fa2884 P e51dc9362e3f42279e5840d9e6957bc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:35.027045 10931 raft_consensus.cc:740] T 091ab5b3eeb7431c801d87f032fa2884 P e51dc9362e3f42279e5840d9e6957bc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51dc9362e3f42279e5840d9e6957bc7, State: Initialized, Role: FOLLOWER
I20260709 13:17:35.028316 10931 consensus_queue.cc:260] T 091ab5b3eeb7431c801d87f032fa2884 P e51dc9362e3f42279e5840d9e6957bc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } } peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } }
I20260709 13:17:35.030117 10929 tablet_bootstrap.cc:492] T 9f9ccd6f8215499bbeec362b4e9d3e0d P d620f151ca8746a9a5e82828e3f8678f: Bootstrap starting.
I20260709 13:17:35.031877 10931 ts_tablet_manager.cc:1434] T 091ab5b3eeb7431c801d87f032fa2884 P e51dc9362e3f42279e5840d9e6957bc7: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.003s
I20260709 13:17:35.034214 10930 tablet_bootstrap.cc:492] T 091ab5b3eeb7431c801d87f032fa2884 P 1ebc149a3815471c8680c5f3611eb094: No bootstrap required, opened a new log
I20260709 13:17:35.034703 10930 ts_tablet_manager.cc:1403] T 091ab5b3eeb7431c801d87f032fa2884 P 1ebc149a3815471c8680c5f3611eb094: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.008s
I20260709 13:17:35.038138 10930 raft_consensus.cc:359] T 091ab5b3eeb7431c801d87f032fa2884 P 1ebc149a3815471c8680c5f3611eb094 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } } peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } }
I20260709 13:17:35.038862 10930 raft_consensus.cc:385] T 091ab5b3eeb7431c801d87f032fa2884 P 1ebc149a3815471c8680c5f3611eb094 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:35.039235 10930 raft_consensus.cc:740] T 091ab5b3eeb7431c801d87f032fa2884 P 1ebc149a3815471c8680c5f3611eb094 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ebc149a3815471c8680c5f3611eb094, State: Initialized, Role: FOLLOWER
I20260709 13:17:35.039351 10929 tablet_bootstrap.cc:654] T 9f9ccd6f8215499bbeec362b4e9d3e0d P d620f151ca8746a9a5e82828e3f8678f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:35.040190 10930 consensus_queue.cc:260] T 091ab5b3eeb7431c801d87f032fa2884 P 1ebc149a3815471c8680c5f3611eb094 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } } peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } }
I20260709 13:17:35.042757 10930 ts_tablet_manager.cc:1434] T 091ab5b3eeb7431c801d87f032fa2884 P 1ebc149a3815471c8680c5f3611eb094: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.008s
I20260709 13:17:35.052803 10930 tablet_bootstrap.cc:492] T 9f9ccd6f8215499bbeec362b4e9d3e0d P 1ebc149a3815471c8680c5f3611eb094: Bootstrap starting.
I20260709 13:17:35.053201 10931 tablet_bootstrap.cc:492] T 9f9ccd6f8215499bbeec362b4e9d3e0d P e51dc9362e3f42279e5840d9e6957bc7: Bootstrap starting.
I20260709 13:17:35.053892 10929 tablet_bootstrap.cc:492] T 9f9ccd6f8215499bbeec362b4e9d3e0d P d620f151ca8746a9a5e82828e3f8678f: No bootstrap required, opened a new log
I20260709 13:17:35.054535 10929 ts_tablet_manager.cc:1403] T 9f9ccd6f8215499bbeec362b4e9d3e0d P d620f151ca8746a9a5e82828e3f8678f: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.000s
I20260709 13:17:35.058499 10936 raft_consensus.cc:493] T 091ab5b3eeb7431c801d87f032fa2884 P 1ebc149a3815471c8680c5f3611eb094 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.059103 10936 raft_consensus.cc:515] T 091ab5b3eeb7431c801d87f032fa2884 P 1ebc149a3815471c8680c5f3611eb094 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } } peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } }
I20260709 13:17:35.061264 10930 tablet_bootstrap.cc:654] T 9f9ccd6f8215499bbeec362b4e9d3e0d P 1ebc149a3815471c8680c5f3611eb094: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:35.058007 10929 raft_consensus.cc:359] T 9f9ccd6f8215499bbeec362b4e9d3e0d P d620f151ca8746a9a5e82828e3f8678f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } } peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } }
I20260709 13:17:35.062454 10929 raft_consensus.cc:385] T 9f9ccd6f8215499bbeec362b4e9d3e0d P d620f151ca8746a9a5e82828e3f8678f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:35.062902 10929 raft_consensus.cc:740] T 9f9ccd6f8215499bbeec362b4e9d3e0d P d620f151ca8746a9a5e82828e3f8678f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d620f151ca8746a9a5e82828e3f8678f, State: Initialized, Role: FOLLOWER
I20260709 13:17:35.061259 10931 tablet_bootstrap.cc:654] T 9f9ccd6f8215499bbeec362b4e9d3e0d P e51dc9362e3f42279e5840d9e6957bc7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:35.064100 10936 leader_election.cc:290] T 091ab5b3eeb7431c801d87f032fa2884 P 1ebc149a3815471c8680c5f3611eb094 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51dc9362e3f42279e5840d9e6957bc7 (127.2.198.193:35533), d620f151ca8746a9a5e82828e3f8678f (127.2.198.194:40351)
I20260709 13:17:35.064086 10929 consensus_queue.cc:260] T 9f9ccd6f8215499bbeec362b4e9d3e0d P d620f151ca8746a9a5e82828e3f8678f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } } peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } }
I20260709 13:17:35.073407 10929 ts_tablet_manager.cc:1434] T 9f9ccd6f8215499bbeec362b4e9d3e0d P d620f151ca8746a9a5e82828e3f8678f: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.001s
I20260709 13:17:35.077380 10929 tablet_bootstrap.cc:492] T 091ab5b3eeb7431c801d87f032fa2884 P d620f151ca8746a9a5e82828e3f8678f: Bootstrap starting.
I20260709 13:17:35.081411 10930 tablet_bootstrap.cc:492] T 9f9ccd6f8215499bbeec362b4e9d3e0d P 1ebc149a3815471c8680c5f3611eb094: No bootstrap required, opened a new log
I20260709 13:17:35.082280 10930 ts_tablet_manager.cc:1403] T 9f9ccd6f8215499bbeec362b4e9d3e0d P 1ebc149a3815471c8680c5f3611eb094: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.008s
I20260709 13:17:35.082315 10815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ab5b3eeb7431c801d87f032fa2884" candidate_uuid: "1ebc149a3815471c8680c5f3611eb094" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d620f151ca8746a9a5e82828e3f8678f" is_pre_election: true
W20260709 13:17:35.084753 10853 leader_election.cc:343] T 091ab5b3eeb7431c801d87f032fa2884 P 1ebc149a3815471c8680c5f3611eb094 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d620f151ca8746a9a5e82828e3f8678f (127.2.198.194:40351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:35.086824 10931 tablet_bootstrap.cc:492] T 9f9ccd6f8215499bbeec362b4e9d3e0d P e51dc9362e3f42279e5840d9e6957bc7: No bootstrap required, opened a new log
I20260709 13:17:35.086723 10930 raft_consensus.cc:359] T 9f9ccd6f8215499bbeec362b4e9d3e0d P 1ebc149a3815471c8680c5f3611eb094 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } } peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } }
I20260709 13:17:35.088436 10930 raft_consensus.cc:385] T 9f9ccd6f8215499bbeec362b4e9d3e0d P 1ebc149a3815471c8680c5f3611eb094 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:35.088791 10930 raft_consensus.cc:740] T 9f9ccd6f8215499bbeec362b4e9d3e0d P 1ebc149a3815471c8680c5f3611eb094 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ebc149a3815471c8680c5f3611eb094, State: Initialized, Role: FOLLOWER
I20260709 13:17:35.089102 10929 tablet_bootstrap.cc:654] T 091ab5b3eeb7431c801d87f032fa2884 P d620f151ca8746a9a5e82828e3f8678f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:35.090226 10930 consensus_queue.cc:260] T 9f9ccd6f8215499bbeec362b4e9d3e0d P 1ebc149a3815471c8680c5f3611eb094 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } } peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } }
I20260709 13:17:35.088021 10931 ts_tablet_manager.cc:1403] T 9f9ccd6f8215499bbeec362b4e9d3e0d P e51dc9362e3f42279e5840d9e6957bc7: Time spent bootstrapping tablet: real 0.035s	user 0.016s	sys 0.003s
I20260709 13:17:35.092991 10930 ts_tablet_manager.cc:1434] T 9f9ccd6f8215499bbeec362b4e9d3e0d P 1ebc149a3815471c8680c5f3611eb094: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.002s
I20260709 13:17:35.094843 10931 raft_consensus.cc:359] T 9f9ccd6f8215499bbeec362b4e9d3e0d P e51dc9362e3f42279e5840d9e6957bc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } } peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } }
I20260709 13:17:35.095650 10931 raft_consensus.cc:385] T 9f9ccd6f8215499bbeec362b4e9d3e0d P e51dc9362e3f42279e5840d9e6957bc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:35.095952 10931 raft_consensus.cc:740] T 9f9ccd6f8215499bbeec362b4e9d3e0d P e51dc9362e3f42279e5840d9e6957bc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51dc9362e3f42279e5840d9e6957bc7, State: Initialized, Role: FOLLOWER
I20260709 13:17:35.096843 10931 consensus_queue.cc:260] T 9f9ccd6f8215499bbeec362b4e9d3e0d P e51dc9362e3f42279e5840d9e6957bc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } } peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } }
I20260709 13:17:35.099283 10931 ts_tablet_manager.cc:1434] T 9f9ccd6f8215499bbeec362b4e9d3e0d P e51dc9362e3f42279e5840d9e6957bc7: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:17:35.111693 10929 tablet_bootstrap.cc:492] T 091ab5b3eeb7431c801d87f032fa2884 P d620f151ca8746a9a5e82828e3f8678f: No bootstrap required, opened a new log
I20260709 13:17:35.112390 10929 ts_tablet_manager.cc:1403] T 091ab5b3eeb7431c801d87f032fa2884 P d620f151ca8746a9a5e82828e3f8678f: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.021s
I20260709 13:17:35.115139 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ab5b3eeb7431c801d87f032fa2884" candidate_uuid: "1ebc149a3815471c8680c5f3611eb094" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51dc9362e3f42279e5840d9e6957bc7" is_pre_election: true
I20260709 13:17:35.115366 10929 raft_consensus.cc:359] T 091ab5b3eeb7431c801d87f032fa2884 P d620f151ca8746a9a5e82828e3f8678f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } } peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } }
I20260709 13:17:35.115908 10740 raft_consensus.cc:2468] T 091ab5b3eeb7431c801d87f032fa2884 P e51dc9362e3f42279e5840d9e6957bc7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ebc149a3815471c8680c5f3611eb094 in term 0.
I20260709 13:17:35.116117 10929 raft_consensus.cc:385] T 091ab5b3eeb7431c801d87f032fa2884 P d620f151ca8746a9a5e82828e3f8678f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:35.116492 10929 raft_consensus.cc:740] T 091ab5b3eeb7431c801d87f032fa2884 P d620f151ca8746a9a5e82828e3f8678f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d620f151ca8746a9a5e82828e3f8678f, State: Initialized, Role: FOLLOWER
I20260709 13:17:35.117106 10853 leader_election.cc:304] T 091ab5b3eeb7431c801d87f032fa2884 P 1ebc149a3815471c8680c5f3611eb094 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ebc149a3815471c8680c5f3611eb094, e51dc9362e3f42279e5840d9e6957bc7; no voters: d620f151ca8746a9a5e82828e3f8678f
I20260709 13:17:35.117252 10929 consensus_queue.cc:260] T 091ab5b3eeb7431c801d87f032fa2884 P d620f151ca8746a9a5e82828e3f8678f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } } peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } }
I20260709 13:17:35.118038 10936 raft_consensus.cc:2804] T 091ab5b3eeb7431c801d87f032fa2884 P 1ebc149a3815471c8680c5f3611eb094 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:35.118422 10936 raft_consensus.cc:493] T 091ab5b3eeb7431c801d87f032fa2884 P 1ebc149a3815471c8680c5f3611eb094 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:35.118780 10936 raft_consensus.cc:3060] T 091ab5b3eeb7431c801d87f032fa2884 P 1ebc149a3815471c8680c5f3611eb094 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:35.121483 10929 ts_tablet_manager.cc:1434] T 091ab5b3eeb7431c801d87f032fa2884 P d620f151ca8746a9a5e82828e3f8678f: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:17:35.127497 10936 raft_consensus.cc:515] T 091ab5b3eeb7431c801d87f032fa2884 P 1ebc149a3815471c8680c5f3611eb094 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } } peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } }
I20260709 13:17:35.128515 10935 raft_consensus.cc:493] T 9f9ccd6f8215499bbeec362b4e9d3e0d P d620f151ca8746a9a5e82828e3f8678f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.129099 10935 raft_consensus.cc:515] T 9f9ccd6f8215499bbeec362b4e9d3e0d P d620f151ca8746a9a5e82828e3f8678f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } } peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } }
I20260709 13:17:35.130512 10936 leader_election.cc:290] T 091ab5b3eeb7431c801d87f032fa2884 P 1ebc149a3815471c8680c5f3611eb094 [CANDIDATE]: Term 1 election: Requested vote from peers e51dc9362e3f42279e5840d9e6957bc7 (127.2.198.193:35533), d620f151ca8746a9a5e82828e3f8678f (127.2.198.194:40351)
I20260709 13:17:35.130782 10815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ab5b3eeb7431c801d87f032fa2884" candidate_uuid: "1ebc149a3815471c8680c5f3611eb094" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d620f151ca8746a9a5e82828e3f8678f"
I20260709 13:17:35.130739 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ab5b3eeb7431c801d87f032fa2884" candidate_uuid: "1ebc149a3815471c8680c5f3611eb094" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51dc9362e3f42279e5840d9e6957bc7"
I20260709 13:17:35.131462 10815 raft_consensus.cc:3060] T 091ab5b3eeb7431c801d87f032fa2884 P d620f151ca8746a9a5e82828e3f8678f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:35.131615 10740 raft_consensus.cc:3060] T 091ab5b3eeb7431c801d87f032fa2884 P e51dc9362e3f42279e5840d9e6957bc7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:35.134649 10935 leader_election.cc:290] T 9f9ccd6f8215499bbeec362b4e9d3e0d P d620f151ca8746a9a5e82828e3f8678f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51dc9362e3f42279e5840d9e6957bc7 (127.2.198.193:35533), 1ebc149a3815471c8680c5f3611eb094 (127.2.198.195:34299)
I20260709 13:17:35.143217 10740 raft_consensus.cc:2468] T 091ab5b3eeb7431c801d87f032fa2884 P e51dc9362e3f42279e5840d9e6957bc7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ebc149a3815471c8680c5f3611eb094 in term 1.
I20260709 13:17:35.143491 10815 raft_consensus.cc:2468] T 091ab5b3eeb7431c801d87f032fa2884 P d620f151ca8746a9a5e82828e3f8678f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ebc149a3815471c8680c5f3611eb094 in term 1.
I20260709 13:17:35.146548 10853 leader_election.cc:304] T 091ab5b3eeb7431c801d87f032fa2884 P 1ebc149a3815471c8680c5f3611eb094 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ebc149a3815471c8680c5f3611eb094, e51dc9362e3f42279e5840d9e6957bc7; no voters: 
I20260709 13:17:35.148968 10936 raft_consensus.cc:2804] T 091ab5b3eeb7431c801d87f032fa2884 P 1ebc149a3815471c8680c5f3611eb094 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:35.150520 10936 raft_consensus.cc:697] T 091ab5b3eeb7431c801d87f032fa2884 P 1ebc149a3815471c8680c5f3611eb094 [term 1 LEADER]: Becoming Leader. State: Replica: 1ebc149a3815471c8680c5f3611eb094, State: Running, Role: LEADER
I20260709 13:17:35.151394 10936 consensus_queue.cc:237] T 091ab5b3eeb7431c801d87f032fa2884 P 1ebc149a3815471c8680c5f3611eb094 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } } peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } }
I20260709 13:17:35.152323 10937 consensus_queue.cc:1048] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P e51dc9362e3f42279e5840d9e6957bc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:35.156821 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9ccd6f8215499bbeec362b4e9d3e0d" candidate_uuid: "d620f151ca8746a9a5e82828e3f8678f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51dc9362e3f42279e5840d9e6957bc7" is_pre_election: true
I20260709 13:17:35.157624 10740 raft_consensus.cc:2468] T 9f9ccd6f8215499bbeec362b4e9d3e0d P e51dc9362e3f42279e5840d9e6957bc7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d620f151ca8746a9a5e82828e3f8678f in term 0.
I20260709 13:17:35.158949 10779 leader_election.cc:304] T 9f9ccd6f8215499bbeec362b4e9d3e0d P d620f151ca8746a9a5e82828e3f8678f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d620f151ca8746a9a5e82828e3f8678f, e51dc9362e3f42279e5840d9e6957bc7; no voters: 
I20260709 13:17:35.159838 10935 raft_consensus.cc:2804] T 9f9ccd6f8215499bbeec362b4e9d3e0d P d620f151ca8746a9a5e82828e3f8678f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:35.160339 10935 raft_consensus.cc:493] T 9f9ccd6f8215499bbeec362b4e9d3e0d P d620f151ca8746a9a5e82828e3f8678f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:35.160758 10935 raft_consensus.cc:3060] T 9f9ccd6f8215499bbeec362b4e9d3e0d P d620f151ca8746a9a5e82828e3f8678f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:35.164896 10888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9ccd6f8215499bbeec362b4e9d3e0d" candidate_uuid: "d620f151ca8746a9a5e82828e3f8678f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ebc149a3815471c8680c5f3611eb094" is_pre_election: true
I20260709 13:17:35.166098 10888 raft_consensus.cc:2468] T 9f9ccd6f8215499bbeec362b4e9d3e0d P 1ebc149a3815471c8680c5f3611eb094 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d620f151ca8746a9a5e82828e3f8678f in term 0.
I20260709 13:17:35.172107 10935 raft_consensus.cc:515] T 9f9ccd6f8215499bbeec362b4e9d3e0d P d620f151ca8746a9a5e82828e3f8678f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } } peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } }
I20260709 13:17:35.175726 10888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9ccd6f8215499bbeec362b4e9d3e0d" candidate_uuid: "d620f151ca8746a9a5e82828e3f8678f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ebc149a3815471c8680c5f3611eb094"
I20260709 13:17:35.176362 10888 raft_consensus.cc:3060] T 9f9ccd6f8215499bbeec362b4e9d3e0d P 1ebc149a3815471c8680c5f3611eb094 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:35.177515 10637 catalog_manager.cc:5697] T 091ab5b3eeb7431c801d87f032fa2884 P 1ebc149a3815471c8680c5f3611eb094 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ebc149a3815471c8680c5f3611eb094 (127.2.198.195). New cstate: current_term: 1 leader_uuid: "1ebc149a3815471c8680c5f3611eb094" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:35.180500 10935 leader_election.cc:290] T 9f9ccd6f8215499bbeec362b4e9d3e0d P d620f151ca8746a9a5e82828e3f8678f [CANDIDATE]: Term 1 election: Requested vote from peers e51dc9362e3f42279e5840d9e6957bc7 (127.2.198.193:35533), 1ebc149a3815471c8680c5f3611eb094 (127.2.198.195:34299)
I20260709 13:17:35.181399 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9ccd6f8215499bbeec362b4e9d3e0d" candidate_uuid: "d620f151ca8746a9a5e82828e3f8678f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51dc9362e3f42279e5840d9e6957bc7"
I20260709 13:17:35.182091 10740 raft_consensus.cc:3060] T 9f9ccd6f8215499bbeec362b4e9d3e0d P e51dc9362e3f42279e5840d9e6957bc7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:35.193892 10740 raft_consensus.cc:2468] T 9f9ccd6f8215499bbeec362b4e9d3e0d P e51dc9362e3f42279e5840d9e6957bc7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d620f151ca8746a9a5e82828e3f8678f in term 1.
I20260709 13:17:35.195748 10779 leader_election.cc:304] T 9f9ccd6f8215499bbeec362b4e9d3e0d P d620f151ca8746a9a5e82828e3f8678f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d620f151ca8746a9a5e82828e3f8678f, e51dc9362e3f42279e5840d9e6957bc7; no voters: 
I20260709 13:17:35.197100 10935 raft_consensus.cc:2804] T 9f9ccd6f8215499bbeec362b4e9d3e0d P d620f151ca8746a9a5e82828e3f8678f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:35.197743 10888 raft_consensus.cc:2468] T 9f9ccd6f8215499bbeec362b4e9d3e0d P 1ebc149a3815471c8680c5f3611eb094 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d620f151ca8746a9a5e82828e3f8678f in term 1.
I20260709 13:17:35.205897 10935 raft_consensus.cc:697] T 9f9ccd6f8215499bbeec362b4e9d3e0d P d620f151ca8746a9a5e82828e3f8678f [term 1 LEADER]: Becoming Leader. State: Replica: d620f151ca8746a9a5e82828e3f8678f, State: Running, Role: LEADER
I20260709 13:17:35.207142 10935 consensus_queue.cc:237] T 9f9ccd6f8215499bbeec362b4e9d3e0d P d620f151ca8746a9a5e82828e3f8678f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } } peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } }
I20260709 13:17:35.211032 10943 consensus_queue.cc:1048] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P e51dc9362e3f42279e5840d9e6957bc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:35.225359 10637 catalog_manager.cc:5697] T 9f9ccd6f8215499bbeec362b4e9d3e0d P d620f151ca8746a9a5e82828e3f8678f reported cstate change: term changed from 0 to 1, leader changed from <none> to d620f151ca8746a9a5e82828e3f8678f (127.2.198.194). New cstate: current_term: 1 leader_uuid: "d620f151ca8746a9a5e82828e3f8678f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:35.282481 10740 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3f7fbfc06a14d18bcd5eed1510d5bd2"
dest_uuid: "e51dc9362e3f42279e5840d9e6957bc7"
mode: GRACEFUL
new_leader_uuid: "1ebc149a3815471c8680c5f3611eb094"
 from {username='slave'} at 127.0.0.1:40722
I20260709 13:17:35.283138 10740 raft_consensus.cc:606] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P e51dc9362e3f42279e5840d9e6957bc7 [term 1 LEADER]: Received request to transfer leadership to TS 1ebc149a3815471c8680c5f3611eb094
I20260709 13:17:35.296705 10889 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "091ab5b3eeb7431c801d87f032fa2884"
dest_uuid: "1ebc149a3815471c8680c5f3611eb094"
mode: GRACEFUL
new_leader_uuid: "e51dc9362e3f42279e5840d9e6957bc7"
 from {username='slave'} at 127.0.0.1:42088
I20260709 13:17:35.297283 10889 raft_consensus.cc:606] T 091ab5b3eeb7431c801d87f032fa2884 P 1ebc149a3815471c8680c5f3611eb094 [term 1 LEADER]: Received request to transfer leadership to TS e51dc9362e3f42279e5840d9e6957bc7
I20260709 13:17:35.310297 10815 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f9ccd6f8215499bbeec362b4e9d3e0d"
dest_uuid: "d620f151ca8746a9a5e82828e3f8678f"
mode: GRACEFUL
new_leader_uuid: "e51dc9362e3f42279e5840d9e6957bc7"
 from {username='slave'} at 127.0.0.1:46946
I20260709 13:17:35.310901 10815 raft_consensus.cc:606] T 9f9ccd6f8215499bbeec362b4e9d3e0d P d620f151ca8746a9a5e82828e3f8678f [term 1 LEADER]: Received request to transfer leadership to TS e51dc9362e3f42279e5840d9e6957bc7
I20260709 13:17:35.332665 10943 consensus_queue.cc:1048] T 3a64e19a8d9149f0abf109accd42d9ae P e51dc9362e3f42279e5840d9e6957bc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:35.349351 10969 consensus_queue.cc:1048] T 3a64e19a8d9149f0abf109accd42d9ae P e51dc9362e3f42279e5840d9e6957bc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:35.629580 10936 consensus_queue.cc:1048] T 091ab5b3eeb7431c801d87f032fa2884 P 1ebc149a3815471c8680c5f3611eb094 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:35.641439 10977 consensus_queue.cc:1048] T 091ab5b3eeb7431c801d87f032fa2884 P 1ebc149a3815471c8680c5f3611eb094 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:35.655406 10936 raft_consensus.cc:993] T 091ab5b3eeb7431c801d87f032fa2884 P 1ebc149a3815471c8680c5f3611eb094: : Instructing follower e51dc9362e3f42279e5840d9e6957bc7 to start an election
I20260709 13:17:35.655962 10977 raft_consensus.cc:1081] T 091ab5b3eeb7431c801d87f032fa2884 P 1ebc149a3815471c8680c5f3611eb094 [term 1 LEADER]: Signalling peer e51dc9362e3f42279e5840d9e6957bc7 to start an election
I20260709 13:17:35.657819 10740 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "091ab5b3eeb7431c801d87f032fa2884"
dest_uuid: "e51dc9362e3f42279e5840d9e6957bc7"
 from {username='slave'} at 127.0.0.1:40698
I20260709 13:17:35.658566 10740 raft_consensus.cc:493] T 091ab5b3eeb7431c801d87f032fa2884 P e51dc9362e3f42279e5840d9e6957bc7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:35.658984 10740 raft_consensus.cc:3060] T 091ab5b3eeb7431c801d87f032fa2884 P e51dc9362e3f42279e5840d9e6957bc7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:35.665071 10740 raft_consensus.cc:515] T 091ab5b3eeb7431c801d87f032fa2884 P e51dc9362e3f42279e5840d9e6957bc7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } } peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } }
I20260709 13:17:35.667132 10740 leader_election.cc:290] T 091ab5b3eeb7431c801d87f032fa2884 P e51dc9362e3f42279e5840d9e6957bc7 [CANDIDATE]: Term 2 election: Requested vote from peers d620f151ca8746a9a5e82828e3f8678f (127.2.198.194:40351), 1ebc149a3815471c8680c5f3611eb094 (127.2.198.195:34299)
I20260709 13:17:35.668386 10889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ab5b3eeb7431c801d87f032fa2884" candidate_uuid: "e51dc9362e3f42279e5840d9e6957bc7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1ebc149a3815471c8680c5f3611eb094"
I20260709 13:17:35.668527 10815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ab5b3eeb7431c801d87f032fa2884" candidate_uuid: "e51dc9362e3f42279e5840d9e6957bc7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d620f151ca8746a9a5e82828e3f8678f"
I20260709 13:17:35.669283 10889 raft_consensus.cc:3055] T 091ab5b3eeb7431c801d87f032fa2884 P 1ebc149a3815471c8680c5f3611eb094 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:35.669364 10815 raft_consensus.cc:3060] T 091ab5b3eeb7431c801d87f032fa2884 P d620f151ca8746a9a5e82828e3f8678f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:35.669723 10889 raft_consensus.cc:740] T 091ab5b3eeb7431c801d87f032fa2884 P 1ebc149a3815471c8680c5f3611eb094 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1ebc149a3815471c8680c5f3611eb094, State: Running, Role: LEADER
I20260709 13:17:35.670678 10889 consensus_queue.cc:260] T 091ab5b3eeb7431c801d87f032fa2884 P 1ebc149a3815471c8680c5f3611eb094 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } } peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } }
I20260709 13:17:35.672113 10889 raft_consensus.cc:3060] T 091ab5b3eeb7431c801d87f032fa2884 P 1ebc149a3815471c8680c5f3611eb094 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:35.677438 10815 raft_consensus.cc:2468] T 091ab5b3eeb7431c801d87f032fa2884 P d620f151ca8746a9a5e82828e3f8678f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51dc9362e3f42279e5840d9e6957bc7 in term 2.
I20260709 13:17:35.678679 10935 consensus_queue.cc:1048] T 9f9ccd6f8215499bbeec362b4e9d3e0d P d620f151ca8746a9a5e82828e3f8678f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:35.678858 10704 leader_election.cc:304] T 091ab5b3eeb7431c801d87f032fa2884 P e51dc9362e3f42279e5840d9e6957bc7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d620f151ca8746a9a5e82828e3f8678f, e51dc9362e3f42279e5840d9e6957bc7; no voters: 
I20260709 13:17:35.680007 10943 raft_consensus.cc:2804] T 091ab5b3eeb7431c801d87f032fa2884 P e51dc9362e3f42279e5840d9e6957bc7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:35.680480 10943 raft_consensus.cc:697] T 091ab5b3eeb7431c801d87f032fa2884 P e51dc9362e3f42279e5840d9e6957bc7 [term 2 LEADER]: Becoming Leader. State: Replica: e51dc9362e3f42279e5840d9e6957bc7, State: Running, Role: LEADER
I20260709 13:17:35.680943 10889 raft_consensus.cc:2468] T 091ab5b3eeb7431c801d87f032fa2884 P 1ebc149a3815471c8680c5f3611eb094 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51dc9362e3f42279e5840d9e6957bc7 in term 2.
I20260709 13:17:35.681373 10943 consensus_queue.cc:237] T 091ab5b3eeb7431c801d87f032fa2884 P e51dc9362e3f42279e5840d9e6957bc7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } } peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } }
I20260709 13:17:35.684288 10937 raft_consensus.cc:993] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P e51dc9362e3f42279e5840d9e6957bc7: : Instructing follower 1ebc149a3815471c8680c5f3611eb094 to start an election
I20260709 13:17:35.684863 10969 raft_consensus.cc:1081] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P e51dc9362e3f42279e5840d9e6957bc7 [term 1 LEADER]: Signalling peer 1ebc149a3815471c8680c5f3611eb094 to start an election
I20260709 13:17:35.686717 10968 raft_consensus.cc:993] T 9f9ccd6f8215499bbeec362b4e9d3e0d P d620f151ca8746a9a5e82828e3f8678f: : Instructing follower e51dc9362e3f42279e5840d9e6957bc7 to start an election
I20260709 13:17:35.686725 10889 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c3f7fbfc06a14d18bcd5eed1510d5bd2"
dest_uuid: "1ebc149a3815471c8680c5f3611eb094"
 from {username='slave'} at 127.0.0.1:42068
I20260709 13:17:35.687516 10889 raft_consensus.cc:493] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P 1ebc149a3815471c8680c5f3611eb094 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:35.687932 10889 raft_consensus.cc:3060] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P 1ebc149a3815471c8680c5f3611eb094 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:35.688141 10935 raft_consensus.cc:1081] T 9f9ccd6f8215499bbeec362b4e9d3e0d P d620f151ca8746a9a5e82828e3f8678f [term 1 LEADER]: Signalling peer e51dc9362e3f42279e5840d9e6957bc7 to start an election
I20260709 13:17:35.690567 10739 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f9ccd6f8215499bbeec362b4e9d3e0d"
dest_uuid: "e51dc9362e3f42279e5840d9e6957bc7"
 from {username='slave'} at 127.0.0.1:40714
I20260709 13:17:35.691347 10739 raft_consensus.cc:493] T 9f9ccd6f8215499bbeec362b4e9d3e0d P e51dc9362e3f42279e5840d9e6957bc7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:35.692485 10739 raft_consensus.cc:3060] T 9f9ccd6f8215499bbeec362b4e9d3e0d P e51dc9362e3f42279e5840d9e6957bc7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:35.691416 10636 catalog_manager.cc:5697] T 091ab5b3eeb7431c801d87f032fa2884 P e51dc9362e3f42279e5840d9e6957bc7 reported cstate change: term changed from 1 to 2, leader changed from 1ebc149a3815471c8680c5f3611eb094 (127.2.198.195) to e51dc9362e3f42279e5840d9e6957bc7 (127.2.198.193). New cstate: current_term: 2 leader_uuid: "e51dc9362e3f42279e5840d9e6957bc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:35.695684 10889 raft_consensus.cc:515] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P 1ebc149a3815471c8680c5f3611eb094 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } } peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } }
I20260709 13:17:35.697979 10889 leader_election.cc:290] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P 1ebc149a3815471c8680c5f3611eb094 [CANDIDATE]: Term 2 election: Requested vote from peers e51dc9362e3f42279e5840d9e6957bc7 (127.2.198.193:35533), d620f151ca8746a9a5e82828e3f8678f (127.2.198.194:40351)
I20260709 13:17:35.698832 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3f7fbfc06a14d18bcd5eed1510d5bd2" candidate_uuid: "1ebc149a3815471c8680c5f3611eb094" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e51dc9362e3f42279e5840d9e6957bc7"
I20260709 13:17:35.699268 10815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3f7fbfc06a14d18bcd5eed1510d5bd2" candidate_uuid: "1ebc149a3815471c8680c5f3611eb094" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d620f151ca8746a9a5e82828e3f8678f"
I20260709 13:17:35.699509 10738 raft_consensus.cc:3055] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P e51dc9362e3f42279e5840d9e6957bc7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:35.699929 10815 raft_consensus.cc:3060] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P d620f151ca8746a9a5e82828e3f8678f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:35.700042 10738 raft_consensus.cc:740] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P e51dc9362e3f42279e5840d9e6957bc7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e51dc9362e3f42279e5840d9e6957bc7, State: Running, Role: LEADER
I20260709 13:17:35.701293 10738 consensus_queue.cc:260] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P e51dc9362e3f42279e5840d9e6957bc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } } peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } }
I20260709 13:17:35.702919 10738 raft_consensus.cc:3060] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P e51dc9362e3f42279e5840d9e6957bc7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:35.708043 10815 raft_consensus.cc:2468] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P d620f151ca8746a9a5e82828e3f8678f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ebc149a3815471c8680c5f3611eb094 in term 2.
I20260709 13:17:35.709604 10853 leader_election.cc:304] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P 1ebc149a3815471c8680c5f3611eb094 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ebc149a3815471c8680c5f3611eb094, d620f151ca8746a9a5e82828e3f8678f; no voters: 
I20260709 13:17:35.710675 10977 raft_consensus.cc:2804] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P 1ebc149a3815471c8680c5f3611eb094 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:35.711159 10977 raft_consensus.cc:697] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P 1ebc149a3815471c8680c5f3611eb094 [term 2 LEADER]: Becoming Leader. State: Replica: 1ebc149a3815471c8680c5f3611eb094, State: Running, Role: LEADER
I20260709 13:17:35.712034 10977 consensus_queue.cc:237] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P 1ebc149a3815471c8680c5f3611eb094 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } } peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } }
I20260709 13:17:35.712319 10739 raft_consensus.cc:515] T 9f9ccd6f8215499bbeec362b4e9d3e0d P e51dc9362e3f42279e5840d9e6957bc7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } } peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } }
I20260709 13:17:35.713770 10738 raft_consensus.cc:2468] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P e51dc9362e3f42279e5840d9e6957bc7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ebc149a3815471c8680c5f3611eb094 in term 2.
I20260709 13:17:35.715088 10740 raft_consensus.cc:1240] T 9f9ccd6f8215499bbeec362b4e9d3e0d P e51dc9362e3f42279e5840d9e6957bc7 [term 2 FOLLOWER]: Rejecting Update request from peer d620f151ca8746a9a5e82828e3f8678f for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:35.714700 10739 leader_election.cc:290] T 9f9ccd6f8215499bbeec362b4e9d3e0d P e51dc9362e3f42279e5840d9e6957bc7 [CANDIDATE]: Term 2 election: Requested vote from peers d620f151ca8746a9a5e82828e3f8678f (127.2.198.194:40351), 1ebc149a3815471c8680c5f3611eb094 (127.2.198.195:34299)
I20260709 13:17:35.716327 10815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9ccd6f8215499bbeec362b4e9d3e0d" candidate_uuid: "e51dc9362e3f42279e5840d9e6957bc7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d620f151ca8746a9a5e82828e3f8678f"
I20260709 13:17:35.716981 10815 raft_consensus.cc:3055] T 9f9ccd6f8215499bbeec362b4e9d3e0d P d620f151ca8746a9a5e82828e3f8678f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:35.717329 10815 raft_consensus.cc:740] T 9f9ccd6f8215499bbeec362b4e9d3e0d P d620f151ca8746a9a5e82828e3f8678f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d620f151ca8746a9a5e82828e3f8678f, State: Running, Role: LEADER
I20260709 13:17:35.718026 10889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9ccd6f8215499bbeec362b4e9d3e0d" candidate_uuid: "e51dc9362e3f42279e5840d9e6957bc7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1ebc149a3815471c8680c5f3611eb094"
I20260709 13:17:35.718701 10889 raft_consensus.cc:3060] T 9f9ccd6f8215499bbeec362b4e9d3e0d P 1ebc149a3815471c8680c5f3611eb094 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:35.718252 10815 consensus_queue.cc:260] T 9f9ccd6f8215499bbeec362b4e9d3e0d P d620f151ca8746a9a5e82828e3f8678f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } } peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } }
I20260709 13:17:35.719223 10935 consensus_queue.cc:1048] T 9f9ccd6f8215499bbeec362b4e9d3e0d P d620f151ca8746a9a5e82828e3f8678f [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:35.720016 10935 consensus_queue.cc:1059] T 9f9ccd6f8215499bbeec362b4e9d3e0d P d620f151ca8746a9a5e82828e3f8678f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:35.724311 10815 raft_consensus.cc:3060] T 9f9ccd6f8215499bbeec362b4e9d3e0d P d620f151ca8746a9a5e82828e3f8678f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:35.728492 10889 raft_consensus.cc:2468] T 9f9ccd6f8215499bbeec362b4e9d3e0d P 1ebc149a3815471c8680c5f3611eb094 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51dc9362e3f42279e5840d9e6957bc7 in term 2.
I20260709 13:17:35.728014 10638 catalog_manager.cc:5697] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P 1ebc149a3815471c8680c5f3611eb094 reported cstate change: term changed from 1 to 2, leader changed from e51dc9362e3f42279e5840d9e6957bc7 (127.2.198.193) to 1ebc149a3815471c8680c5f3611eb094 (127.2.198.195). New cstate: current_term: 2 leader_uuid: "1ebc149a3815471c8680c5f3611eb094" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:35.729811 10706 leader_election.cc:304] T 9f9ccd6f8215499bbeec362b4e9d3e0d P e51dc9362e3f42279e5840d9e6957bc7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ebc149a3815471c8680c5f3611eb094, e51dc9362e3f42279e5840d9e6957bc7; no voters: 
I20260709 13:17:35.730746 10969 raft_consensus.cc:2804] T 9f9ccd6f8215499bbeec362b4e9d3e0d P e51dc9362e3f42279e5840d9e6957bc7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:35.731226 10969 raft_consensus.cc:697] T 9f9ccd6f8215499bbeec362b4e9d3e0d P e51dc9362e3f42279e5840d9e6957bc7 [term 2 LEADER]: Becoming Leader. State: Replica: e51dc9362e3f42279e5840d9e6957bc7, State: Running, Role: LEADER
I20260709 13:17:35.731709 10815 raft_consensus.cc:2468] T 9f9ccd6f8215499bbeec362b4e9d3e0d P d620f151ca8746a9a5e82828e3f8678f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51dc9362e3f42279e5840d9e6957bc7 in term 2.
I20260709 13:17:35.732117 10969 consensus_queue.cc:237] T 9f9ccd6f8215499bbeec362b4e9d3e0d P e51dc9362e3f42279e5840d9e6957bc7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } } peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } }
I20260709 13:17:35.739256 10636 catalog_manager.cc:5697] T 9f9ccd6f8215499bbeec362b4e9d3e0d P e51dc9362e3f42279e5840d9e6957bc7 reported cstate change: term changed from 1 to 2, leader changed from d620f151ca8746a9a5e82828e3f8678f (127.2.198.194) to e51dc9362e3f42279e5840d9e6957bc7 (127.2.198.193). New cstate: current_term: 2 leader_uuid: "e51dc9362e3f42279e5840d9e6957bc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:35.759582  2843 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:17:35.761288  2843 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:17:35.761709  2843 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:17:35.778975 10740 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "091ab5b3eeb7431c801d87f032fa2884"
dest_uuid: "e51dc9362e3f42279e5840d9e6957bc7"
mode: GRACEFUL
new_leader_uuid: "d620f151ca8746a9a5e82828e3f8678f"
 from {username='slave'} at 127.0.0.1:40736
I20260709 13:17:35.779680 10740 raft_consensus.cc:606] T 091ab5b3eeb7431c801d87f032fa2884 P e51dc9362e3f42279e5840d9e6957bc7 [term 2 LEADER]: Received request to transfer leadership to TS d620f151ca8746a9a5e82828e3f8678f
I20260709 13:17:35.780768  2843 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:17:36.117981 10889 raft_consensus.cc:1275] T 091ab5b3eeb7431c801d87f032fa2884 P 1ebc149a3815471c8680c5f3611eb094 [term 2 FOLLOWER]: Refusing update from remote peer e51dc9362e3f42279e5840d9e6957bc7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:36.119357 10969 consensus_queue.cc:1048] T 091ab5b3eeb7431c801d87f032fa2884 P e51dc9362e3f42279e5840d9e6957bc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:36.129139 10815 raft_consensus.cc:1275] T 091ab5b3eeb7431c801d87f032fa2884 P d620f151ca8746a9a5e82828e3f8678f [term 2 FOLLOWER]: Refusing update from remote peer e51dc9362e3f42279e5840d9e6957bc7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:36.130759 10937 consensus_queue.cc:1048] T 091ab5b3eeb7431c801d87f032fa2884 P e51dc9362e3f42279e5840d9e6957bc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:36.137212 10937 raft_consensus.cc:993] T 091ab5b3eeb7431c801d87f032fa2884 P e51dc9362e3f42279e5840d9e6957bc7: : Instructing follower d620f151ca8746a9a5e82828e3f8678f to start an election
I20260709 13:17:36.137701 10943 raft_consensus.cc:1081] T 091ab5b3eeb7431c801d87f032fa2884 P e51dc9362e3f42279e5840d9e6957bc7 [term 2 LEADER]: Signalling peer d620f151ca8746a9a5e82828e3f8678f to start an election
I20260709 13:17:36.139297 10815 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "091ab5b3eeb7431c801d87f032fa2884"
dest_uuid: "d620f151ca8746a9a5e82828e3f8678f"
 from {username='slave'} at 127.0.0.1:46924
I20260709 13:17:36.139966 10815 raft_consensus.cc:493] T 091ab5b3eeb7431c801d87f032fa2884 P d620f151ca8746a9a5e82828e3f8678f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:36.140461 10815 raft_consensus.cc:3060] T 091ab5b3eeb7431c801d87f032fa2884 P d620f151ca8746a9a5e82828e3f8678f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:36.147159 10815 raft_consensus.cc:515] T 091ab5b3eeb7431c801d87f032fa2884 P d620f151ca8746a9a5e82828e3f8678f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } } peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } }
I20260709 13:17:36.149314 10815 leader_election.cc:290] T 091ab5b3eeb7431c801d87f032fa2884 P d620f151ca8746a9a5e82828e3f8678f [CANDIDATE]: Term 3 election: Requested vote from peers e51dc9362e3f42279e5840d9e6957bc7 (127.2.198.193:35533), 1ebc149a3815471c8680c5f3611eb094 (127.2.198.195:34299)
I20260709 13:17:36.150211 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ab5b3eeb7431c801d87f032fa2884" candidate_uuid: "d620f151ca8746a9a5e82828e3f8678f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e51dc9362e3f42279e5840d9e6957bc7"
I20260709 13:17:36.150605 10889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ab5b3eeb7431c801d87f032fa2884" candidate_uuid: "d620f151ca8746a9a5e82828e3f8678f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1ebc149a3815471c8680c5f3611eb094"
I20260709 13:17:36.150966 10740 raft_consensus.cc:3055] T 091ab5b3eeb7431c801d87f032fa2884 P e51dc9362e3f42279e5840d9e6957bc7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:36.151327 10889 raft_consensus.cc:3060] T 091ab5b3eeb7431c801d87f032fa2884 P 1ebc149a3815471c8680c5f3611eb094 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:36.151374 10740 raft_consensus.cc:740] T 091ab5b3eeb7431c801d87f032fa2884 P e51dc9362e3f42279e5840d9e6957bc7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e51dc9362e3f42279e5840d9e6957bc7, State: Running, Role: LEADER
I20260709 13:17:36.152431 10740 consensus_queue.cc:260] T 091ab5b3eeb7431c801d87f032fa2884 P e51dc9362e3f42279e5840d9e6957bc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } } peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } }
I20260709 13:17:36.153620 10740 raft_consensus.cc:3060] T 091ab5b3eeb7431c801d87f032fa2884 P e51dc9362e3f42279e5840d9e6957bc7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:36.158354 10889 raft_consensus.cc:2468] T 091ab5b3eeb7431c801d87f032fa2884 P 1ebc149a3815471c8680c5f3611eb094 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d620f151ca8746a9a5e82828e3f8678f in term 3.
I20260709 13:17:36.159531 10740 raft_consensus.cc:2468] T 091ab5b3eeb7431c801d87f032fa2884 P e51dc9362e3f42279e5840d9e6957bc7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d620f151ca8746a9a5e82828e3f8678f in term 3.
I20260709 13:17:36.159859 10781 leader_election.cc:304] T 091ab5b3eeb7431c801d87f032fa2884 P d620f151ca8746a9a5e82828e3f8678f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ebc149a3815471c8680c5f3611eb094, d620f151ca8746a9a5e82828e3f8678f; no voters: 
I20260709 13:17:36.160907 10980 raft_consensus.cc:2804] T 091ab5b3eeb7431c801d87f032fa2884 P d620f151ca8746a9a5e82828e3f8678f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:36.161316 10980 raft_consensus.cc:697] T 091ab5b3eeb7431c801d87f032fa2884 P d620f151ca8746a9a5e82828e3f8678f [term 3 LEADER]: Becoming Leader. State: Replica: d620f151ca8746a9a5e82828e3f8678f, State: Running, Role: LEADER
I20260709 13:17:36.162153 10980 consensus_queue.cc:237] T 091ab5b3eeb7431c801d87f032fa2884 P d620f151ca8746a9a5e82828e3f8678f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } } peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } }
I20260709 13:17:36.168493 10636 catalog_manager.cc:5697] T 091ab5b3eeb7431c801d87f032fa2884 P d620f151ca8746a9a5e82828e3f8678f reported cstate change: term changed from 2 to 3, leader changed from e51dc9362e3f42279e5840d9e6957bc7 (127.2.198.193) to d620f151ca8746a9a5e82828e3f8678f (127.2.198.194). New cstate: current_term: 3 leader_uuid: "d620f151ca8746a9a5e82828e3f8678f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:36.215175 10815 raft_consensus.cc:1275] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P d620f151ca8746a9a5e82828e3f8678f [term 2 FOLLOWER]: Refusing update from remote peer 1ebc149a3815471c8680c5f3611eb094: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:36.217139 10977 consensus_queue.cc:1048] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P 1ebc149a3815471c8680c5f3611eb094 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:36.226058 10740 raft_consensus.cc:1275] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P e51dc9362e3f42279e5840d9e6957bc7 [term 2 FOLLOWER]: Refusing update from remote peer 1ebc149a3815471c8680c5f3611eb094: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:36.228346 10977 consensus_queue.cc:1048] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P 1ebc149a3815471c8680c5f3611eb094 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51dc9362e3f42279e5840d9e6957bc7" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 35533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:36.240676 10815 raft_consensus.cc:1275] T 9f9ccd6f8215499bbeec362b4e9d3e0d P d620f151ca8746a9a5e82828e3f8678f [term 2 FOLLOWER]: Refusing update from remote peer e51dc9362e3f42279e5840d9e6957bc7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:36.242164 10943 consensus_queue.cc:1048] T 9f9ccd6f8215499bbeec362b4e9d3e0d P e51dc9362e3f42279e5840d9e6957bc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d620f151ca8746a9a5e82828e3f8678f" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:36.253459 10889 raft_consensus.cc:1275] T 9f9ccd6f8215499bbeec362b4e9d3e0d P 1ebc149a3815471c8680c5f3611eb094 [term 2 FOLLOWER]: Refusing update from remote peer e51dc9362e3f42279e5840d9e6957bc7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:36.255218 10943 consensus_queue.cc:1048] T 9f9ccd6f8215499bbeec362b4e9d3e0d P e51dc9362e3f42279e5840d9e6957bc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ebc149a3815471c8680c5f3611eb094" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 34299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:36.395468  2843 tablet_server.cc:179] TabletServer@127.2.198.193:0 shutting down...
I20260709 13:17:36.417214  2843 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:36.417981  2843 tablet_replica.cc:333] T 9f9ccd6f8215499bbeec362b4e9d3e0d P e51dc9362e3f42279e5840d9e6957bc7: stopping tablet replica
I20260709 13:17:36.418659  2843 raft_consensus.cc:2243] T 9f9ccd6f8215499bbeec362b4e9d3e0d P e51dc9362e3f42279e5840d9e6957bc7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:36.419962  2843 raft_consensus.cc:2272] T 9f9ccd6f8215499bbeec362b4e9d3e0d P e51dc9362e3f42279e5840d9e6957bc7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.422711  2843 tablet_replica.cc:333] T 091ab5b3eeb7431c801d87f032fa2884 P e51dc9362e3f42279e5840d9e6957bc7: stopping tablet replica
I20260709 13:17:36.423372  2843 raft_consensus.cc:2243] T 091ab5b3eeb7431c801d87f032fa2884 P e51dc9362e3f42279e5840d9e6957bc7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:36.423957  2843 raft_consensus.cc:2272] T 091ab5b3eeb7431c801d87f032fa2884 P e51dc9362e3f42279e5840d9e6957bc7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.426754  2843 tablet_replica.cc:333] T 3a64e19a8d9149f0abf109accd42d9ae P e51dc9362e3f42279e5840d9e6957bc7: stopping tablet replica
I20260709 13:17:36.427326  2843 raft_consensus.cc:2243] T 3a64e19a8d9149f0abf109accd42d9ae P e51dc9362e3f42279e5840d9e6957bc7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:36.428196  2843 raft_consensus.cc:2272] T 3a64e19a8d9149f0abf109accd42d9ae P e51dc9362e3f42279e5840d9e6957bc7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.430197  2843 tablet_replica.cc:333] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P e51dc9362e3f42279e5840d9e6957bc7: stopping tablet replica
I20260709 13:17:36.430730  2843 raft_consensus.cc:2243] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P e51dc9362e3f42279e5840d9e6957bc7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:36.431166  2843 raft_consensus.cc:2272] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P e51dc9362e3f42279e5840d9e6957bc7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.446497  2843 tablet_server.cc:196] TabletServer@127.2.198.193:0 shutdown complete.
I20260709 13:17:36.460067  2843 tablet_server.cc:179] TabletServer@127.2.198.194:0 shutting down...
I20260709 13:17:36.480520  2843 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:36.481189  2843 tablet_replica.cc:333] T 9f9ccd6f8215499bbeec362b4e9d3e0d P d620f151ca8746a9a5e82828e3f8678f: stopping tablet replica
I20260709 13:17:36.481791  2843 raft_consensus.cc:2243] T 9f9ccd6f8215499bbeec362b4e9d3e0d P d620f151ca8746a9a5e82828e3f8678f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:36.482321  2843 raft_consensus.cc:2272] T 9f9ccd6f8215499bbeec362b4e9d3e0d P d620f151ca8746a9a5e82828e3f8678f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.484965  2843 tablet_replica.cc:333] T 091ab5b3eeb7431c801d87f032fa2884 P d620f151ca8746a9a5e82828e3f8678f: stopping tablet replica
I20260709 13:17:36.485533  2843 raft_consensus.cc:2243] T 091ab5b3eeb7431c801d87f032fa2884 P d620f151ca8746a9a5e82828e3f8678f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:36.486176  2843 pending_rounds.cc:70] T 091ab5b3eeb7431c801d87f032fa2884 P d620f151ca8746a9a5e82828e3f8678f: Trying to abort 1 pending ops.
I20260709 13:17:36.486361  2843 pending_rounds.cc:77] T 091ab5b3eeb7431c801d87f032fa2884 P d620f151ca8746a9a5e82828e3f8678f: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305638118047477760 op_type: NO_OP noop_request { }
I20260709 13:17:36.486696  2843 raft_consensus.cc:2889] T 091ab5b3eeb7431c801d87f032fa2884 P d620f151ca8746a9a5e82828e3f8678f [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:17:36.486971  2843 raft_consensus.cc:2272] T 091ab5b3eeb7431c801d87f032fa2884 P d620f151ca8746a9a5e82828e3f8678f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.489851  2843 tablet_replica.cc:333] T 3a64e19a8d9149f0abf109accd42d9ae P d620f151ca8746a9a5e82828e3f8678f: stopping tablet replica
I20260709 13:17:36.490394  2843 raft_consensus.cc:2243] T 3a64e19a8d9149f0abf109accd42d9ae P d620f151ca8746a9a5e82828e3f8678f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:36.490818  2843 raft_consensus.cc:2272] T 3a64e19a8d9149f0abf109accd42d9ae P d620f151ca8746a9a5e82828e3f8678f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.492691  2843 tablet_replica.cc:333] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P d620f151ca8746a9a5e82828e3f8678f: stopping tablet replica
I20260709 13:17:36.493178  2843 raft_consensus.cc:2243] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P d620f151ca8746a9a5e82828e3f8678f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:36.493642  2843 raft_consensus.cc:2272] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P d620f151ca8746a9a5e82828e3f8678f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.506275  2843 tablet_server.cc:196] TabletServer@127.2.198.194:0 shutdown complete.
I20260709 13:17:36.519799  2843 tablet_server.cc:179] TabletServer@127.2.198.195:0 shutting down...
I20260709 13:17:36.538748  2843 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:36.539443  2843 tablet_replica.cc:333] T 9f9ccd6f8215499bbeec362b4e9d3e0d P 1ebc149a3815471c8680c5f3611eb094: stopping tablet replica
I20260709 13:17:36.540141  2843 raft_consensus.cc:2243] T 9f9ccd6f8215499bbeec362b4e9d3e0d P 1ebc149a3815471c8680c5f3611eb094 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:36.540674  2843 raft_consensus.cc:2272] T 9f9ccd6f8215499bbeec362b4e9d3e0d P 1ebc149a3815471c8680c5f3611eb094 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.543308  2843 tablet_replica.cc:333] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P 1ebc149a3815471c8680c5f3611eb094: stopping tablet replica
I20260709 13:17:36.543905  2843 raft_consensus.cc:2243] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P 1ebc149a3815471c8680c5f3611eb094 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:36.544804  2843 raft_consensus.cc:2272] T c3f7fbfc06a14d18bcd5eed1510d5bd2 P 1ebc149a3815471c8680c5f3611eb094 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.546995  2843 tablet_replica.cc:333] T 091ab5b3eeb7431c801d87f032fa2884 P 1ebc149a3815471c8680c5f3611eb094: stopping tablet replica
I20260709 13:17:36.547518  2843 raft_consensus.cc:2243] T 091ab5b3eeb7431c801d87f032fa2884 P 1ebc149a3815471c8680c5f3611eb094 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:36.548038  2843 raft_consensus.cc:2272] T 091ab5b3eeb7431c801d87f032fa2884 P 1ebc149a3815471c8680c5f3611eb094 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.550137  2843 tablet_replica.cc:333] T 3a64e19a8d9149f0abf109accd42d9ae P 1ebc149a3815471c8680c5f3611eb094: stopping tablet replica
I20260709 13:17:36.550637  2843 raft_consensus.cc:2243] T 3a64e19a8d9149f0abf109accd42d9ae P 1ebc149a3815471c8680c5f3611eb094 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:36.551046  2843 raft_consensus.cc:2272] T 3a64e19a8d9149f0abf109accd42d9ae P 1ebc149a3815471c8680c5f3611eb094 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.573800  2843 tablet_server.cc:196] TabletServer@127.2.198.195:0 shutdown complete.
I20260709 13:17:36.587857  2843 master.cc:562] Master@127.2.198.254:43945 shutting down...
I20260709 13:17:36.604866  2843 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 2003993e2b524aeba845be06ce1c7ec7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:36.605528  2843 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 2003993e2b524aeba845be06ce1c7ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.605885  2843 tablet_replica.cc:333] T 00000000000000000000000000000000 P 2003993e2b524aeba845be06ce1c7ec7: stopping tablet replica
I20260709 13:17:36.625851  2843 master.cc:584] Master@127.2.198.254:43945 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2878 ms)
[----------] 6 tests from LeaderRebalancerTest (251826 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:17:36.658387  2843 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.198.254:40735
I20260709 13:17:36.659936  2843 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:36.665587 10986 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:36.666638 10987 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:36.668111 10989 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:36.669147  2843 server_base.cc:1061] running on GCE node
I20260709 13:17:36.670054  2843 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:36.670256  2843 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:36.670430  2843 hybrid_clock.cc:648] HybridClock initialized: now 1783603056670397 us; error 0 us; skew 500 ppm
I20260709 13:17:36.671037  2843 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:36.673642  2843 webserver.cc:533] Webserver started at http://127.2.198.254:43661/ using document root <none> and password file <none>
I20260709 13:17:36.674176  2843 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:36.674392  2843 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:36.674700  2843 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:36.675972  2843 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602804652623-2843-0/minicluster-data/master-0-root/instance:
uuid: "46ac69a322c84e148564f67454fb0dbb"
format_stamp: "Formatted at 2026-07-09 13:17:36 on dist-test-slave-fc6v"
I20260709 13:17:36.680852  2843 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:17:36.684705 10994 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:36.685439  2843 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 13:17:36.685745  2843 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602804652623-2843-0/minicluster-data/master-0-root
uuid: "46ac69a322c84e148564f67454fb0dbb"
format_stamp: "Formatted at 2026-07-09 13:17:36 on dist-test-slave-fc6v"
I20260709 13:17:36.686036  2843 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602804652623-2843-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602804652623-2843-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602804652623-2843-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:36.710027  2843 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:36.711181  2843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:36.750983  2843 rpc_server.cc:307] RPC server started. Bound to: 127.2.198.254:40735
I20260709 13:17:36.751094 11045 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.198.254:40735 every 8 connection(s)
I20260709 13:17:36.755365 11046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:36.767730 11046 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 46ac69a322c84e148564f67454fb0dbb: Bootstrap starting.
I20260709 13:17:36.772817 11046 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 46ac69a322c84e148564f67454fb0dbb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:36.777509 11046 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 46ac69a322c84e148564f67454fb0dbb: No bootstrap required, opened a new log
I20260709 13:17:36.780037 11046 raft_consensus.cc:359] T 00000000000000000000000000000000 P 46ac69a322c84e148564f67454fb0dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46ac69a322c84e148564f67454fb0dbb" member_type: VOTER }
I20260709 13:17:36.780478 11046 raft_consensus.cc:385] T 00000000000000000000000000000000 P 46ac69a322c84e148564f67454fb0dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:36.780659 11046 raft_consensus.cc:740] T 00000000000000000000000000000000 P 46ac69a322c84e148564f67454fb0dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46ac69a322c84e148564f67454fb0dbb, State: Initialized, Role: FOLLOWER
I20260709 13:17:36.781220 11046 consensus_queue.cc:260] T 00000000000000000000000000000000 P 46ac69a322c84e148564f67454fb0dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46ac69a322c84e148564f67454fb0dbb" member_type: VOTER }
I20260709 13:17:36.781666 11046 raft_consensus.cc:399] T 00000000000000000000000000000000 P 46ac69a322c84e148564f67454fb0dbb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:17:36.781873 11046 raft_consensus.cc:493] T 00000000000000000000000000000000 P 46ac69a322c84e148564f67454fb0dbb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:17:36.782089 11046 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 46ac69a322c84e148564f67454fb0dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:36.788028 11046 raft_consensus.cc:515] T 00000000000000000000000000000000 P 46ac69a322c84e148564f67454fb0dbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46ac69a322c84e148564f67454fb0dbb" member_type: VOTER }
I20260709 13:17:36.788589 11046 leader_election.cc:304] T 00000000000000000000000000000000 P 46ac69a322c84e148564f67454fb0dbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 46ac69a322c84e148564f67454fb0dbb; no voters: 
I20260709 13:17:36.789825 11046 leader_election.cc:290] T 00000000000000000000000000000000 P 46ac69a322c84e148564f67454fb0dbb [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:17:36.790235 11049 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 46ac69a322c84e148564f67454fb0dbb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:36.791803 11049 raft_consensus.cc:697] T 00000000000000000000000000000000 P 46ac69a322c84e148564f67454fb0dbb [term 1 LEADER]: Becoming Leader. State: Replica: 46ac69a322c84e148564f67454fb0dbb, State: Running, Role: LEADER
I20260709 13:17:36.792559 11049 consensus_queue.cc:237] T 00000000000000000000000000000000 P 46ac69a322c84e148564f67454fb0dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46ac69a322c84e148564f67454fb0dbb" member_type: VOTER }
I20260709 13:17:36.792994 11046 sys_catalog.cc:565] T 00000000000000000000000000000000 P 46ac69a322c84e148564f67454fb0dbb [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:17:36.795727 11051 sys_catalog.cc:455] T 00000000000000000000000000000000 P 46ac69a322c84e148564f67454fb0dbb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 46ac69a322c84e148564f67454fb0dbb. Latest consensus state: current_term: 1 leader_uuid: "46ac69a322c84e148564f67454fb0dbb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46ac69a322c84e148564f67454fb0dbb" member_type: VOTER } }
I20260709 13:17:36.795727 11050 sys_catalog.cc:455] T 00000000000000000000000000000000 P 46ac69a322c84e148564f67454fb0dbb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "46ac69a322c84e148564f67454fb0dbb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46ac69a322c84e148564f67454fb0dbb" member_type: VOTER } }
I20260709 13:17:36.796656 11051 sys_catalog.cc:458] T 00000000000000000000000000000000 P 46ac69a322c84e148564f67454fb0dbb [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:36.796741 11050 sys_catalog.cc:458] T 00000000000000000000000000000000 P 46ac69a322c84e148564f67454fb0dbb [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:36.800295 11054 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:17:36.805277 11054 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:17:36.811230  2843 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:17:36.815057 11054 catalog_manager.cc:1383] Generated new cluster ID: 3ce38f72b7de4997b880cdafc4d9df5a
I20260709 13:17:36.815395 11054 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:17:36.849978 11054 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:17:36.851513 11054 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:17:36.869239 11054 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 46ac69a322c84e148564f67454fb0dbb: Generated new TSK 0
I20260709 13:17:36.869904 11054 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:17:36.878422  2843 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:36.884764 11067 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:36.886263 11068 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:36.887650 11070 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:36.888427  2843 server_base.cc:1061] running on GCE node
I20260709 13:17:36.889329  2843 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:36.889515  2843 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:36.889652  2843 hybrid_clock.cc:648] HybridClock initialized: now 1783603056889634 us; error 0 us; skew 500 ppm
I20260709 13:17:36.890163  2843 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:36.892549  2843 webserver.cc:533] Webserver started at http://127.2.198.193:39449/ using document root <none> and password file <none>
I20260709 13:17:36.893050  2843 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:36.893221  2843 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:36.893481  2843 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:36.894758  2843 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602804652623-2843-0/minicluster-data/ts-0-root/instance:
uuid: "ceb819e448e34d73b2cd02fdc2e3747c"
format_stamp: "Formatted at 2026-07-09 13:17:36 on dist-test-slave-fc6v"
I20260709 13:17:36.899423  2843 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:17:36.903064 11075 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:36.903995  2843 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:17:36.904345  2843 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602804652623-2843-0/minicluster-data/ts-0-root
uuid: "ceb819e448e34d73b2cd02fdc2e3747c"
format_stamp: "Formatted at 2026-07-09 13:17:36 on dist-test-slave-fc6v"
I20260709 13:17:36.904770  2843 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602804652623-2843-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602804652623-2843-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602804652623-2843-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:36.920720  2843 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:36.921984  2843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:36.923528  2843 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:36.926108  2843 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:36.926363  2843 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:36.926623  2843 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:36.926805  2843 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:36.971206  2843 rpc_server.cc:307] RPC server started. Bound to: 127.2.198.193:34307
I20260709 13:17:36.971346 11137 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.198.193:34307 every 8 connection(s)
I20260709 13:17:36.976946  2843 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:36.984226 11142 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:36.984656 11143 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:36.988780  2843 server_base.cc:1061] running on GCE node
W20260709 13:17:36.989007 11145 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:36.990243  2843 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:17:36.990355 11138 heartbeater.cc:344] Connected to a master server at 127.2.198.254:40735
W20260709 13:17:36.990554  2843 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:36.990852  2843 hybrid_clock.cc:648] HybridClock initialized: now 1783603056990835 us; error 0 us; skew 500 ppm
I20260709 13:17:36.990891 11138 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:36.991602  2843 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:36.991933 11138 heartbeater.cc:507] Master 127.2.198.254:40735 requested a full tablet report, sending...
I20260709 13:17:36.994534 11011 ts_manager.cc:194] Registered new tserver with Master: ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307)
I20260709 13:17:36.994721  2843 webserver.cc:533] Webserver started at http://127.2.198.194:41617/ using document root <none> and password file <none>
I20260709 13:17:36.995461  2843 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:36.995770  2843 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:36.996124  2843 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:36.997156 11011 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39818
I20260709 13:17:36.997850  2843 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602804652623-2843-0/minicluster-data/ts-1-root/instance:
uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d"
format_stamp: "Formatted at 2026-07-09 13:17:36 on dist-test-slave-fc6v"
I20260709 13:17:37.003309  2843 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260709 13:17:37.007030 11150 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:37.007833  2843 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:17:37.008152  2843 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602804652623-2843-0/minicluster-data/ts-1-root
uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d"
format_stamp: "Formatted at 2026-07-09 13:17:36 on dist-test-slave-fc6v"
I20260709 13:17:37.008456  2843 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602804652623-2843-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602804652623-2843-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602804652623-2843-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:37.038239  2843 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:37.039496  2843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:37.041139  2843 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:37.043622  2843 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:37.043867  2843 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:37.044142  2843 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:37.044322  2843 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:37.086855  2843 rpc_server.cc:307] RPC server started. Bound to: 127.2.198.194:42941
I20260709 13:17:37.086973 11212 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.198.194:42941 every 8 connection(s)
I20260709 13:17:37.092586  2843 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:37.099958 11216 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:37.100826 11217 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:37.104979 11219 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:37.105345  2843 server_base.cc:1061] running on GCE node
I20260709 13:17:37.106103 11213 heartbeater.cc:344] Connected to a master server at 127.2.198.254:40735
I20260709 13:17:37.106599 11213 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:37.106566  2843 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:37.107153  2843 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:37.107381  2843 hybrid_clock.cc:648] HybridClock initialized: now 1783603057107361 us; error 0 us; skew 500 ppm
I20260709 13:17:37.107789 11213 heartbeater.cc:507] Master 127.2.198.254:40735 requested a full tablet report, sending...
I20260709 13:17:37.108260  2843 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:37.110210 11011 ts_manager.cc:194] Registered new tserver with Master: 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941)
I20260709 13:17:37.111598  2843 webserver.cc:533] Webserver started at http://127.2.198.195:33885/ using document root <none> and password file <none>
I20260709 13:17:37.112102 11011 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39826
I20260709 13:17:37.112207  2843 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:37.112572  2843 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:37.112879  2843 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:37.114298  2843 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602804652623-2843-0/minicluster-data/ts-2-root/instance:
uuid: "7e5b746c9d10411cb2e3948be2e9db1e"
format_stamp: "Formatted at 2026-07-09 13:17:37 on dist-test-slave-fc6v"
I20260709 13:17:37.119060  2843 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:17:37.122555 11224 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:37.123366  2843 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:17:37.123711  2843 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602804652623-2843-0/minicluster-data/ts-2-root
uuid: "7e5b746c9d10411cb2e3948be2e9db1e"
format_stamp: "Formatted at 2026-07-09 13:17:37 on dist-test-slave-fc6v"
I20260709 13:17:37.124027  2843 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602804652623-2843-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602804652623-2843-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602804652623-2843-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:37.145040  2843 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:37.146401  2843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:37.148038  2843 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:37.150512  2843 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:37.150763  2843 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:37.151036  2843 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:37.151227  2843 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:37.194495  2843 rpc_server.cc:307] RPC server started. Bound to: 127.2.198.195:33049
I20260709 13:17:37.194644 11286 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.198.195:33049 every 8 connection(s)
I20260709 13:17:37.209306 11287 heartbeater.cc:344] Connected to a master server at 127.2.198.254:40735
I20260709 13:17:37.209841 11287 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:37.210685 11287 heartbeater.cc:507] Master 127.2.198.254:40735 requested a full tablet report, sending...
I20260709 13:17:37.212675 11011 ts_manager.cc:194] Registered new tserver with Master: 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195:33049)
I20260709 13:17:37.212908  2843 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014807s
I20260709 13:17:37.214150 11011 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39830
I20260709 13:17:37.240314 11011 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39838:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:17:37.243050 11011 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:17:37.332597 11177 tablet_service.cc:1511] Processing CreateTablet for tablet e7e16d7d38af4781975f803c3d05e208 (DEFAULT_TABLE table=test-workload [id=ccf7ed2b72e04602846c143956eea3b4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:17:37.334386 11177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7e16d7d38af4781975f803c3d05e208. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:37.335469 11175 tablet_service.cc:1511] Processing CreateTablet for tablet 7e274b51306c4d09872f37009c6f5e1e (DEFAULT_TABLE table=test-workload [id=ccf7ed2b72e04602846c143956eea3b4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:17:37.337101 11175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e274b51306c4d09872f37009c6f5e1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:37.339097 11178 tablet_service.cc:1511] Processing CreateTablet for tablet 8b7700103ed8419c8e4b63058f7969f6 (DEFAULT_TABLE table=test-workload [id=ccf7ed2b72e04602846c143956eea3b4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:17:37.340586 11178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b7700103ed8419c8e4b63058f7969f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:37.342696 11103 tablet_service.cc:1511] Processing CreateTablet for tablet 8b7700103ed8419c8e4b63058f7969f6 (DEFAULT_TABLE table=test-workload [id=ccf7ed2b72e04602846c143956eea3b4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:17:37.343094 11102 tablet_service.cc:1511] Processing CreateTablet for tablet e7e16d7d38af4781975f803c3d05e208 (DEFAULT_TABLE table=test-workload [id=ccf7ed2b72e04602846c143956eea3b4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:17:37.344269 11103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b7700103ed8419c8e4b63058f7969f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:37.344357 11099 tablet_service.cc:1511] Processing CreateTablet for tablet 66972c9ebce04c89a8e6b410dee75534 (DEFAULT_TABLE table=test-workload [id=ccf7ed2b72e04602846c143956eea3b4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:17:37.345758 11099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66972c9ebce04c89a8e6b410dee75534. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:37.345453 11101 tablet_service.cc:1511] Processing CreateTablet for tablet 79e021e2ff374d78b82d53e7631dc83c (DEFAULT_TABLE table=test-workload [id=ccf7ed2b72e04602846c143956eea3b4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:17:37.346813 11101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79e021e2ff374d78b82d53e7631dc83c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:37.348671 11100 tablet_service.cc:1511] Processing CreateTablet for tablet 7e274b51306c4d09872f37009c6f5e1e (DEFAULT_TABLE table=test-workload [id=ccf7ed2b72e04602846c143956eea3b4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:17:37.350018 11100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e274b51306c4d09872f37009c6f5e1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:37.351783 11176 tablet_service.cc:1511] Processing CreateTablet for tablet 79e021e2ff374d78b82d53e7631dc83c (DEFAULT_TABLE table=test-workload [id=ccf7ed2b72e04602846c143956eea3b4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:17:37.353224 11176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79e021e2ff374d78b82d53e7631dc83c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:37.357987 11174 tablet_service.cc:1511] Processing CreateTablet for tablet 66972c9ebce04c89a8e6b410dee75534 (DEFAULT_TABLE table=test-workload [id=ccf7ed2b72e04602846c143956eea3b4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:17:37.360682 11173 tablet_service.cc:1511] Processing CreateTablet for tablet 85ed2545e6bf44589a83b5a92d807ea0 (DEFAULT_TABLE table=test-workload [id=ccf7ed2b72e04602846c143956eea3b4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:17:37.362980 11172 tablet_service.cc:1511] Processing CreateTablet for tablet a13cc15140be4d119a2fee5acc480df1 (DEFAULT_TABLE table=test-workload [id=ccf7ed2b72e04602846c143956eea3b4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:17:37.363746 11102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7e16d7d38af4781975f803c3d05e208. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:37.365744 11098 tablet_service.cc:1511] Processing CreateTablet for tablet 85ed2545e6bf44589a83b5a92d807ea0 (DEFAULT_TABLE table=test-workload [id=ccf7ed2b72e04602846c143956eea3b4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:17:37.359498 11174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66972c9ebce04c89a8e6b410dee75534. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:37.367678 11098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85ed2545e6bf44589a83b5a92d807ea0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:37.371945 11173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85ed2545e6bf44589a83b5a92d807ea0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:37.372709 11172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a13cc15140be4d119a2fee5acc480df1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:37.374728 11171 tablet_service.cc:1511] Processing CreateTablet for tablet c4f71e70f87441408c0353d089d9557d (DEFAULT_TABLE table=test-workload [id=ccf7ed2b72e04602846c143956eea3b4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:17:37.376233 11171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4f71e70f87441408c0353d089d9557d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:37.379750 11170 tablet_service.cc:1511] Processing CreateTablet for tablet 4309ede3f11d451ab65bbdfb178d98d1 (DEFAULT_TABLE table=test-workload [id=ccf7ed2b72e04602846c143956eea3b4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:17:37.381259 11170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4309ede3f11d451ab65bbdfb178d98d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:37.390131 11097 tablet_service.cc:1511] Processing CreateTablet for tablet a13cc15140be4d119a2fee5acc480df1 (DEFAULT_TABLE table=test-workload [id=ccf7ed2b72e04602846c143956eea3b4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:17:37.392282 11097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a13cc15140be4d119a2fee5acc480df1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:37.406107 11303 tablet_bootstrap.cc:492] T a13cc15140be4d119a2fee5acc480df1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Bootstrap starting.
I20260709 13:17:37.406781 11096 tablet_service.cc:1511] Processing CreateTablet for tablet c4f71e70f87441408c0353d089d9557d (DEFAULT_TABLE table=test-workload [id=ccf7ed2b72e04602846c143956eea3b4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:17:37.408524 11096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4f71e70f87441408c0353d089d9557d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:37.419462 11095 tablet_service.cc:1511] Processing CreateTablet for tablet 4309ede3f11d451ab65bbdfb178d98d1 (DEFAULT_TABLE table=test-workload [id=ccf7ed2b72e04602846c143956eea3b4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:17:37.421134 11095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4309ede3f11d451ab65bbdfb178d98d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:37.420166 11303 tablet_bootstrap.cc:654] T a13cc15140be4d119a2fee5acc480df1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:37.434069 11303 tablet_bootstrap.cc:492] T a13cc15140be4d119a2fee5acc480df1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: No bootstrap required, opened a new log
I20260709 13:17:37.434906 11252 tablet_service.cc:1511] Processing CreateTablet for tablet 8b7700103ed8419c8e4b63058f7969f6 (DEFAULT_TABLE table=test-workload [id=ccf7ed2b72e04602846c143956eea3b4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:17:37.436750 11252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b7700103ed8419c8e4b63058f7969f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:37.437407 11251 tablet_service.cc:1511] Processing CreateTablet for tablet e7e16d7d38af4781975f803c3d05e208 (DEFAULT_TABLE table=test-workload [id=ccf7ed2b72e04602846c143956eea3b4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:17:37.438951 11251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7e16d7d38af4781975f803c3d05e208. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:37.445351 11250 tablet_service.cc:1511] Processing CreateTablet for tablet 79e021e2ff374d78b82d53e7631dc83c (DEFAULT_TABLE table=test-workload [id=ccf7ed2b72e04602846c143956eea3b4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:17:37.446964 11250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79e021e2ff374d78b82d53e7631dc83c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:37.451241 11249 tablet_service.cc:1511] Processing CreateTablet for tablet 7e274b51306c4d09872f37009c6f5e1e (DEFAULT_TABLE table=test-workload [id=ccf7ed2b72e04602846c143956eea3b4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:17:37.451942 11303 ts_tablet_manager.cc:1403] T a13cc15140be4d119a2fee5acc480df1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Time spent bootstrapping tablet: real 0.046s	user 0.010s	sys 0.004s
I20260709 13:17:37.452698 11249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e274b51306c4d09872f37009c6f5e1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:37.458254 11248 tablet_service.cc:1511] Processing CreateTablet for tablet 66972c9ebce04c89a8e6b410dee75534 (DEFAULT_TABLE table=test-workload [id=ccf7ed2b72e04602846c143956eea3b4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:17:37.459769 11248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66972c9ebce04c89a8e6b410dee75534. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:37.455369 11303 raft_consensus.cc:359] T a13cc15140be4d119a2fee5acc480df1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:37.460338 11303 raft_consensus.cc:385] T a13cc15140be4d119a2fee5acc480df1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:37.460649 11303 raft_consensus.cc:740] T a13cc15140be4d119a2fee5acc480df1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fc0290ef4cf4ffa8c82c234ed04ff1d, State: Initialized, Role: FOLLOWER
I20260709 13:17:37.463117 11303 consensus_queue.cc:260] T a13cc15140be4d119a2fee5acc480df1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:37.465278 11247 tablet_service.cc:1511] Processing CreateTablet for tablet 85ed2545e6bf44589a83b5a92d807ea0 (DEFAULT_TABLE table=test-workload [id=ccf7ed2b72e04602846c143956eea3b4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:17:37.466833 11247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85ed2545e6bf44589a83b5a92d807ea0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:37.473145 11246 tablet_service.cc:1511] Processing CreateTablet for tablet a13cc15140be4d119a2fee5acc480df1 (DEFAULT_TABLE table=test-workload [id=ccf7ed2b72e04602846c143956eea3b4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:17:37.474584 11246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a13cc15140be4d119a2fee5acc480df1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:37.481117 11245 tablet_service.cc:1511] Processing CreateTablet for tablet c4f71e70f87441408c0353d089d9557d (DEFAULT_TABLE table=test-workload [id=ccf7ed2b72e04602846c143956eea3b4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:17:37.482602 11245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4f71e70f87441408c0353d089d9557d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:37.501186 11244 tablet_service.cc:1511] Processing CreateTablet for tablet 4309ede3f11d451ab65bbdfb178d98d1 (DEFAULT_TABLE table=test-workload [id=ccf7ed2b72e04602846c143956eea3b4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:17:37.502763 11244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4309ede3f11d451ab65bbdfb178d98d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:37.542321 11303 ts_tablet_manager.cc:1434] T a13cc15140be4d119a2fee5acc480df1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Time spent starting tablet: real 0.090s	user 0.015s	sys 0.016s
I20260709 13:17:37.547283 11213 heartbeater.cc:499] Master 127.2.198.254:40735 was elected leader, sending a full tablet report...
I20260709 13:17:37.573977 11302 tablet_bootstrap.cc:492] T 8b7700103ed8419c8e4b63058f7969f6 P ceb819e448e34d73b2cd02fdc2e3747c: Bootstrap starting.
I20260709 13:17:37.579851 11303 tablet_bootstrap.cc:492] T e7e16d7d38af4781975f803c3d05e208 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Bootstrap starting.
I20260709 13:17:37.587313 11303 tablet_bootstrap.cc:654] T e7e16d7d38af4781975f803c3d05e208 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:37.574123 11306 tablet_bootstrap.cc:492] T 8b7700103ed8419c8e4b63058f7969f6 P 7e5b746c9d10411cb2e3948be2e9db1e: Bootstrap starting.
I20260709 13:17:37.583091 11302 tablet_bootstrap.cc:654] T 8b7700103ed8419c8e4b63058f7969f6 P ceb819e448e34d73b2cd02fdc2e3747c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:37.605682 11306 tablet_bootstrap.cc:654] T 8b7700103ed8419c8e4b63058f7969f6 P 7e5b746c9d10411cb2e3948be2e9db1e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:37.610570 11302 tablet_bootstrap.cc:492] T 8b7700103ed8419c8e4b63058f7969f6 P ceb819e448e34d73b2cd02fdc2e3747c: No bootstrap required, opened a new log
I20260709 13:17:37.611364 11302 ts_tablet_manager.cc:1403] T 8b7700103ed8419c8e4b63058f7969f6 P ceb819e448e34d73b2cd02fdc2e3747c: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.000s
I20260709 13:17:37.616391 11302 raft_consensus.cc:359] T 8b7700103ed8419c8e4b63058f7969f6 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } } peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } }
I20260709 13:17:37.617424 11302 raft_consensus.cc:385] T 8b7700103ed8419c8e4b63058f7969f6 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:37.617949 11302 raft_consensus.cc:740] T 8b7700103ed8419c8e4b63058f7969f6 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ceb819e448e34d73b2cd02fdc2e3747c, State: Initialized, Role: FOLLOWER
I20260709 13:17:37.618649 11303 tablet_bootstrap.cc:492] T e7e16d7d38af4781975f803c3d05e208 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: No bootstrap required, opened a new log
I20260709 13:17:37.619560 11303 ts_tablet_manager.cc:1403] T e7e16d7d38af4781975f803c3d05e208 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Time spent bootstrapping tablet: real 0.048s	user 0.029s	sys 0.006s
I20260709 13:17:37.619483 11302 consensus_queue.cc:260] T 8b7700103ed8419c8e4b63058f7969f6 P ceb819e448e34d73b2cd02fdc2e3747c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } } peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } }
I20260709 13:17:37.622867 11306 tablet_bootstrap.cc:492] T 8b7700103ed8419c8e4b63058f7969f6 P 7e5b746c9d10411cb2e3948be2e9db1e: No bootstrap required, opened a new log
I20260709 13:17:37.623571 11306 ts_tablet_manager.cc:1403] T 8b7700103ed8419c8e4b63058f7969f6 P 7e5b746c9d10411cb2e3948be2e9db1e: Time spent bootstrapping tablet: real 0.050s	user 0.021s	sys 0.005s
I20260709 13:17:37.623332 11303 raft_consensus.cc:359] T e7e16d7d38af4781975f803c3d05e208 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:37.624243 11303 raft_consensus.cc:385] T e7e16d7d38af4781975f803c3d05e208 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:37.624567 11303 raft_consensus.cc:740] T e7e16d7d38af4781975f803c3d05e208 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fc0290ef4cf4ffa8c82c234ed04ff1d, State: Initialized, Role: FOLLOWER
I20260709 13:17:37.625435 11303 consensus_queue.cc:260] T e7e16d7d38af4781975f803c3d05e208 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:37.626947 11306 raft_consensus.cc:359] T 8b7700103ed8419c8e4b63058f7969f6 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } } peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } }
I20260709 13:17:37.627799 11303 ts_tablet_manager.cc:1434] T e7e16d7d38af4781975f803c3d05e208 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:17:37.627851 11306 raft_consensus.cc:385] T 8b7700103ed8419c8e4b63058f7969f6 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:37.628400 11306 raft_consensus.cc:740] T 8b7700103ed8419c8e4b63058f7969f6 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e5b746c9d10411cb2e3948be2e9db1e, State: Initialized, Role: FOLLOWER
I20260709 13:17:37.629320 11303 tablet_bootstrap.cc:492] T 7e274b51306c4d09872f37009c6f5e1e P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Bootstrap starting.
I20260709 13:17:37.629320 11306 consensus_queue.cc:260] T 8b7700103ed8419c8e4b63058f7969f6 P 7e5b746c9d10411cb2e3948be2e9db1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } } peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } }
I20260709 13:17:37.631209 11302 ts_tablet_manager.cc:1434] T 8b7700103ed8419c8e4b63058f7969f6 P ceb819e448e34d73b2cd02fdc2e3747c: Time spent starting tablet: real 0.019s	user 0.014s	sys 0.000s
I20260709 13:17:37.632282 11138 heartbeater.cc:499] Master 127.2.198.254:40735 was elected leader, sending a full tablet report...
I20260709 13:17:37.633212 11287 heartbeater.cc:499] Master 127.2.198.254:40735 was elected leader, sending a full tablet report...
I20260709 13:17:37.641006 11303 tablet_bootstrap.cc:654] T 7e274b51306c4d09872f37009c6f5e1e P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:37.642517 11302 tablet_bootstrap.cc:492] T 66972c9ebce04c89a8e6b410dee75534 P ceb819e448e34d73b2cd02fdc2e3747c: Bootstrap starting.
I20260709 13:17:37.643663 11306 ts_tablet_manager.cc:1434] T 8b7700103ed8419c8e4b63058f7969f6 P 7e5b746c9d10411cb2e3948be2e9db1e: Time spent starting tablet: real 0.020s	user 0.010s	sys 0.000s
I20260709 13:17:37.644805 11306 tablet_bootstrap.cc:492] T 85ed2545e6bf44589a83b5a92d807ea0 P 7e5b746c9d10411cb2e3948be2e9db1e: Bootstrap starting.
I20260709 13:17:37.650393 11302 tablet_bootstrap.cc:654] T 66972c9ebce04c89a8e6b410dee75534 P ceb819e448e34d73b2cd02fdc2e3747c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:37.651328 11306 tablet_bootstrap.cc:654] T 85ed2545e6bf44589a83b5a92d807ea0 P 7e5b746c9d10411cb2e3948be2e9db1e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:37.670499 11303 tablet_bootstrap.cc:492] T 7e274b51306c4d09872f37009c6f5e1e P 6fc0290ef4cf4ffa8c82c234ed04ff1d: No bootstrap required, opened a new log
I20260709 13:17:37.671113 11303 ts_tablet_manager.cc:1403] T 7e274b51306c4d09872f37009c6f5e1e P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Time spent bootstrapping tablet: real 0.042s	user 0.027s	sys 0.008s
I20260709 13:17:37.674454 11303 raft_consensus.cc:359] T 7e274b51306c4d09872f37009c6f5e1e P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:37.676247 11303 raft_consensus.cc:385] T 7e274b51306c4d09872f37009c6f5e1e P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:37.676537 11303 raft_consensus.cc:740] T 7e274b51306c4d09872f37009c6f5e1e P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fc0290ef4cf4ffa8c82c234ed04ff1d, State: Initialized, Role: FOLLOWER
I20260709 13:17:37.677454 11303 consensus_queue.cc:260] T 7e274b51306c4d09872f37009c6f5e1e P 6fc0290ef4cf4ffa8c82c234ed04ff1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:37.680140 11303 ts_tablet_manager.cc:1434] T 7e274b51306c4d09872f37009c6f5e1e P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.002s
I20260709 13:17:37.681236 11303 tablet_bootstrap.cc:492] T 85ed2545e6bf44589a83b5a92d807ea0 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Bootstrap starting.
I20260709 13:17:37.688171 11303 tablet_bootstrap.cc:654] T 85ed2545e6bf44589a83b5a92d807ea0 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:37.704458 11302 tablet_bootstrap.cc:492] T 66972c9ebce04c89a8e6b410dee75534 P ceb819e448e34d73b2cd02fdc2e3747c: No bootstrap required, opened a new log
I20260709 13:17:37.704571 11303 tablet_bootstrap.cc:492] T 85ed2545e6bf44589a83b5a92d807ea0 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: No bootstrap required, opened a new log
I20260709 13:17:37.704963 11302 ts_tablet_manager.cc:1403] T 66972c9ebce04c89a8e6b410dee75534 P ceb819e448e34d73b2cd02fdc2e3747c: Time spent bootstrapping tablet: real 0.072s	user 0.024s	sys 0.024s
I20260709 13:17:37.705327 11303 ts_tablet_manager.cc:1403] T 85ed2545e6bf44589a83b5a92d807ea0 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.007s
I20260709 13:17:37.705338 11306 tablet_bootstrap.cc:492] T 85ed2545e6bf44589a83b5a92d807ea0 P 7e5b746c9d10411cb2e3948be2e9db1e: No bootstrap required, opened a new log
I20260709 13:17:37.706274 11306 ts_tablet_manager.cc:1403] T 85ed2545e6bf44589a83b5a92d807ea0 P 7e5b746c9d10411cb2e3948be2e9db1e: Time spent bootstrapping tablet: real 0.062s	user 0.027s	sys 0.032s
I20260709 13:17:37.708350 11302 raft_consensus.cc:359] T 66972c9ebce04c89a8e6b410dee75534 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:37.709277 11302 raft_consensus.cc:385] T 66972c9ebce04c89a8e6b410dee75534 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:37.709743 11302 raft_consensus.cc:740] T 66972c9ebce04c89a8e6b410dee75534 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ceb819e448e34d73b2cd02fdc2e3747c, State: Initialized, Role: FOLLOWER
I20260709 13:17:37.709302 11306 raft_consensus.cc:359] T 85ed2545e6bf44589a83b5a92d807ea0 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:37.710203 11306 raft_consensus.cc:385] T 85ed2545e6bf44589a83b5a92d807ea0 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:37.710505 11306 raft_consensus.cc:740] T 85ed2545e6bf44589a83b5a92d807ea0 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e5b746c9d10411cb2e3948be2e9db1e, State: Initialized, Role: FOLLOWER
I20260709 13:17:37.710563 11302 consensus_queue.cc:260] T 66972c9ebce04c89a8e6b410dee75534 P ceb819e448e34d73b2cd02fdc2e3747c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:37.708623 11303 raft_consensus.cc:359] T 85ed2545e6bf44589a83b5a92d807ea0 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:37.711320 11306 consensus_queue.cc:260] T 85ed2545e6bf44589a83b5a92d807ea0 P 7e5b746c9d10411cb2e3948be2e9db1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:37.711792 11303 raft_consensus.cc:385] T 85ed2545e6bf44589a83b5a92d807ea0 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:37.712189 11303 raft_consensus.cc:740] T 85ed2545e6bf44589a83b5a92d807ea0 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fc0290ef4cf4ffa8c82c234ed04ff1d, State: Initialized, Role: FOLLOWER
I20260709 13:17:37.712960 11302 ts_tablet_manager.cc:1434] T 66972c9ebce04c89a8e6b410dee75534 P ceb819e448e34d73b2cd02fdc2e3747c: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:17:37.713598 11306 ts_tablet_manager.cc:1434] T 85ed2545e6bf44589a83b5a92d807ea0 P 7e5b746c9d10411cb2e3948be2e9db1e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:17:37.714126 11302 tablet_bootstrap.cc:492] T a13cc15140be4d119a2fee5acc480df1 P ceb819e448e34d73b2cd02fdc2e3747c: Bootstrap starting.
I20260709 13:17:37.713490 11303 consensus_queue.cc:260] T 85ed2545e6bf44589a83b5a92d807ea0 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:37.714905 11306 tablet_bootstrap.cc:492] T a13cc15140be4d119a2fee5acc480df1 P 7e5b746c9d10411cb2e3948be2e9db1e: Bootstrap starting.
I20260709 13:17:37.718461 11303 ts_tablet_manager.cc:1434] T 85ed2545e6bf44589a83b5a92d807ea0 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:17:37.719616 11303 tablet_bootstrap.cc:492] T c4f71e70f87441408c0353d089d9557d P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Bootstrap starting.
I20260709 13:17:37.721163 11306 tablet_bootstrap.cc:654] T a13cc15140be4d119a2fee5acc480df1 P 7e5b746c9d10411cb2e3948be2e9db1e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:37.722379 11302 tablet_bootstrap.cc:654] T a13cc15140be4d119a2fee5acc480df1 P ceb819e448e34d73b2cd02fdc2e3747c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:37.726117 11303 tablet_bootstrap.cc:654] T c4f71e70f87441408c0353d089d9557d P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:37.738026 11303 tablet_bootstrap.cc:492] T c4f71e70f87441408c0353d089d9557d P 6fc0290ef4cf4ffa8c82c234ed04ff1d: No bootstrap required, opened a new log
I20260709 13:17:37.738685 11303 ts_tablet_manager.cc:1403] T c4f71e70f87441408c0353d089d9557d P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.009s
I20260709 13:17:37.742000 11303 raft_consensus.cc:359] T c4f71e70f87441408c0353d089d9557d P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:37.742913 11303 raft_consensus.cc:385] T c4f71e70f87441408c0353d089d9557d P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:37.743268 11303 raft_consensus.cc:740] T c4f71e70f87441408c0353d089d9557d P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fc0290ef4cf4ffa8c82c234ed04ff1d, State: Initialized, Role: FOLLOWER
I20260709 13:17:37.744340 11303 consensus_queue.cc:260] T c4f71e70f87441408c0353d089d9557d P 6fc0290ef4cf4ffa8c82c234ed04ff1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:37.747092 11303 ts_tablet_manager.cc:1434] T c4f71e70f87441408c0353d089d9557d P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:17:37.747830 11305 raft_consensus.cc:493] T e7e16d7d38af4781975f803c3d05e208 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.748487 11305 raft_consensus.cc:515] T e7e16d7d38af4781975f803c3d05e208 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:37.760320 11305 leader_election.cc:290] T e7e16d7d38af4781975f803c3d05e208 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195:33049)
I20260709 13:17:37.765007 11306 tablet_bootstrap.cc:492] T a13cc15140be4d119a2fee5acc480df1 P 7e5b746c9d10411cb2e3948be2e9db1e: No bootstrap required, opened a new log
I20260709 13:17:37.765678 11306 ts_tablet_manager.cc:1403] T a13cc15140be4d119a2fee5acc480df1 P 7e5b746c9d10411cb2e3948be2e9db1e: Time spent bootstrapping tablet: real 0.051s	user 0.022s	sys 0.021s
I20260709 13:17:37.765873 11311 raft_consensus.cc:493] T 85ed2545e6bf44589a83b5a92d807ea0 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.766237 11302 tablet_bootstrap.cc:492] T a13cc15140be4d119a2fee5acc480df1 P ceb819e448e34d73b2cd02fdc2e3747c: No bootstrap required, opened a new log
I20260709 13:17:37.766826 11302 ts_tablet_manager.cc:1403] T a13cc15140be4d119a2fee5acc480df1 P ceb819e448e34d73b2cd02fdc2e3747c: Time spent bootstrapping tablet: real 0.053s	user 0.028s	sys 0.019s
I20260709 13:17:37.766625 11311 raft_consensus.cc:515] T 85ed2545e6bf44589a83b5a92d807ea0 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:37.768814 11306 raft_consensus.cc:359] T a13cc15140be4d119a2fee5acc480df1 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:37.769590 11306 raft_consensus.cc:385] T a13cc15140be4d119a2fee5acc480df1 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:37.769884 11306 raft_consensus.cc:740] T a13cc15140be4d119a2fee5acc480df1 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e5b746c9d10411cb2e3948be2e9db1e, State: Initialized, Role: FOLLOWER
I20260709 13:17:37.770129 11311 leader_election.cc:290] T 85ed2545e6bf44589a83b5a92d807ea0 P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941)
I20260709 13:17:37.769925 11302 raft_consensus.cc:359] T a13cc15140be4d119a2fee5acc480df1 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:37.770773 11302 raft_consensus.cc:385] T a13cc15140be4d119a2fee5acc480df1 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:37.771116 11302 raft_consensus.cc:740] T a13cc15140be4d119a2fee5acc480df1 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ceb819e448e34d73b2cd02fdc2e3747c, State: Initialized, Role: FOLLOWER
I20260709 13:17:37.770941 11306 consensus_queue.cc:260] T a13cc15140be4d119a2fee5acc480df1 P 7e5b746c9d10411cb2e3948be2e9db1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:37.771966 11302 consensus_queue.cc:260] T a13cc15140be4d119a2fee5acc480df1 P ceb819e448e34d73b2cd02fdc2e3747c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:37.774358 11302 ts_tablet_manager.cc:1434] T a13cc15140be4d119a2fee5acc480df1 P ceb819e448e34d73b2cd02fdc2e3747c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:17:37.775413 11302 tablet_bootstrap.cc:492] T 7e274b51306c4d09872f37009c6f5e1e P ceb819e448e34d73b2cd02fdc2e3747c: Bootstrap starting.
I20260709 13:17:37.777686 11306 ts_tablet_manager.cc:1434] T a13cc15140be4d119a2fee5acc480df1 P 7e5b746c9d10411cb2e3948be2e9db1e: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:17:37.778888 11306 tablet_bootstrap.cc:492] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e: Bootstrap starting.
I20260709 13:17:37.784217 11302 tablet_bootstrap.cc:654] T 7e274b51306c4d09872f37009c6f5e1e P ceb819e448e34d73b2cd02fdc2e3747c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:37.786489 11306 tablet_bootstrap.cc:654] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:37.799309 11302 tablet_bootstrap.cc:492] T 7e274b51306c4d09872f37009c6f5e1e P ceb819e448e34d73b2cd02fdc2e3747c: No bootstrap required, opened a new log
I20260709 13:17:37.799477 11303 tablet_bootstrap.cc:492] T 8b7700103ed8419c8e4b63058f7969f6 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Bootstrap starting.
I20260709 13:17:37.800168 11302 ts_tablet_manager.cc:1403] T 7e274b51306c4d09872f37009c6f5e1e P ceb819e448e34d73b2cd02fdc2e3747c: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.000s
W20260709 13:17:37.805984 11059 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:37.808624 11302 raft_consensus.cc:359] T 7e274b51306c4d09872f37009c6f5e1e P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:37.809520 11302 raft_consensus.cc:385] T 7e274b51306c4d09872f37009c6f5e1e P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:37.809860 11302 raft_consensus.cc:740] T 7e274b51306c4d09872f37009c6f5e1e P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ceb819e448e34d73b2cd02fdc2e3747c, State: Initialized, Role: FOLLOWER
I20260709 13:17:37.810742 11302 consensus_queue.cc:260] T 7e274b51306c4d09872f37009c6f5e1e P ceb819e448e34d73b2cd02fdc2e3747c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:37.802697 11306 tablet_bootstrap.cc:492] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e: No bootstrap required, opened a new log
I20260709 13:17:37.813344 11306 ts_tablet_manager.cc:1403] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e: Time spent bootstrapping tablet: real 0.035s	user 0.017s	sys 0.000s
I20260709 13:17:37.813663 11302 ts_tablet_manager.cc:1434] T 7e274b51306c4d09872f37009c6f5e1e P ceb819e448e34d73b2cd02fdc2e3747c: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:17:37.814915 11302 tablet_bootstrap.cc:492] T c4f71e70f87441408c0353d089d9557d P ceb819e448e34d73b2cd02fdc2e3747c: Bootstrap starting.
I20260709 13:17:37.816784 11306 raft_consensus.cc:359] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:37.817587 11306 raft_consensus.cc:385] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:37.817905 11306 raft_consensus.cc:740] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e5b746c9d10411cb2e3948be2e9db1e, State: Initialized, Role: FOLLOWER
I20260709 13:17:37.818816 11306 consensus_queue.cc:260] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:37.820098 11311 raft_consensus.cc:493] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.820570 11311 raft_consensus.cc:515] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:37.822681 11311 leader_election.cc:290] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941)
I20260709 13:17:37.823993 11302 tablet_bootstrap.cc:654] T c4f71e70f87441408c0353d089d9557d P ceb819e448e34d73b2cd02fdc2e3747c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:37.829057 11188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85ed2545e6bf44589a83b5a92d807ea0" candidate_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" is_pre_election: true
I20260709 13:17:37.830950 11188 raft_consensus.cc:2468] T 85ed2545e6bf44589a83b5a92d807ea0 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e5b746c9d10411cb2e3948be2e9db1e in term 0.
I20260709 13:17:37.832863 11306 ts_tablet_manager.cc:1434] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:17:37.834100 11306 tablet_bootstrap.cc:492] T 7e274b51306c4d09872f37009c6f5e1e P 7e5b746c9d10411cb2e3948be2e9db1e: Bootstrap starting.
I20260709 13:17:37.834769 11303 tablet_bootstrap.cc:654] T 8b7700103ed8419c8e4b63058f7969f6 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:37.836580 11187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f71e70f87441408c0353d089d9557d" candidate_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" is_pre_election: true
I20260709 13:17:37.837390 11187 raft_consensus.cc:2468] T c4f71e70f87441408c0353d089d9557d P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e5b746c9d10411cb2e3948be2e9db1e in term 0.
I20260709 13:17:37.839212 11311 raft_consensus.cc:493] T 8b7700103ed8419c8e4b63058f7969f6 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.840408 11311 raft_consensus.cc:515] T 8b7700103ed8419c8e4b63058f7969f6 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } } peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } }
I20260709 13:17:37.841701 11113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85ed2545e6bf44589a83b5a92d807ea0" candidate_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" is_pre_election: true
I20260709 13:17:37.843894 11112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f71e70f87441408c0353d089d9557d" candidate_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" is_pre_election: true
I20260709 13:17:37.843168 11311 leader_election.cc:290] T 8b7700103ed8419c8e4b63058f7969f6 P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941), ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307)
I20260709 13:17:37.849187 11188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b7700103ed8419c8e4b63058f7969f6" candidate_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" is_pre_election: true
I20260709 13:17:37.851480 11112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b7700103ed8419c8e4b63058f7969f6" candidate_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" is_pre_election: true
I20260709 13:17:37.852418 11112 raft_consensus.cc:2468] T 8b7700103ed8419c8e4b63058f7969f6 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e5b746c9d10411cb2e3948be2e9db1e in term 0.
W20260709 13:17:37.847213 11225 leader_election.cc:343] T 85ed2545e6bf44589a83b5a92d807ea0 P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:37.854830 11225 leader_election.cc:343] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:37.855822 11225 leader_election.cc:304] T 8b7700103ed8419c8e4b63058f7969f6 P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e5b746c9d10411cb2e3948be2e9db1e, ceb819e448e34d73b2cd02fdc2e3747c; no voters: 
I20260709 13:17:37.857193 11225 leader_election.cc:304] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, 7e5b746c9d10411cb2e3948be2e9db1e; no voters: ceb819e448e34d73b2cd02fdc2e3747c
I20260709 13:17:37.858654 11311 raft_consensus.cc:2804] T 8b7700103ed8419c8e4b63058f7969f6 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:37.859144 11311 raft_consensus.cc:493] T 8b7700103ed8419c8e4b63058f7969f6 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:37.859604 11311 raft_consensus.cc:3060] T 8b7700103ed8419c8e4b63058f7969f6 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:37.864914 11306 tablet_bootstrap.cc:654] T 7e274b51306c4d09872f37009c6f5e1e P 7e5b746c9d10411cb2e3948be2e9db1e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:37.886785 11112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e16d7d38af4781975f803c3d05e208" candidate_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" is_pre_election: true
I20260709 13:17:37.887444 11262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e16d7d38af4781975f803c3d05e208" candidate_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" is_pre_election: true
I20260709 13:17:37.889132 11302 tablet_bootstrap.cc:492] T c4f71e70f87441408c0353d089d9557d P ceb819e448e34d73b2cd02fdc2e3747c: No bootstrap required, opened a new log
I20260709 13:17:37.889828 11302 ts_tablet_manager.cc:1403] T c4f71e70f87441408c0353d089d9557d P ceb819e448e34d73b2cd02fdc2e3747c: Time spent bootstrapping tablet: real 0.075s	user 0.021s	sys 0.031s
W20260709 13:17:37.889748 11154 leader_election.cc:343] T e7e16d7d38af4781975f803c3d05e208 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195:33049): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:37.890728 11151 leader_election.cc:343] T e7e16d7d38af4781975f803c3d05e208 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:37.891196 11151 leader_election.cc:304] T e7e16d7d38af4781975f803c3d05e208 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d; no voters: 7e5b746c9d10411cb2e3948be2e9db1e, ceb819e448e34d73b2cd02fdc2e3747c
I20260709 13:17:37.892444 11225 leader_election.cc:304] T 85ed2545e6bf44589a83b5a92d807ea0 P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, 7e5b746c9d10411cb2e3948be2e9db1e; no voters: ceb819e448e34d73b2cd02fdc2e3747c
I20260709 13:17:37.894157 11305 raft_consensus.cc:2749] T e7e16d7d38af4781975f803c3d05e208 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:37.895313 11328 raft_consensus.cc:2804] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:37.895782 11328 raft_consensus.cc:493] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:37.896136 11328 raft_consensus.cc:3060] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:37.896610 11303 tablet_bootstrap.cc:492] T 8b7700103ed8419c8e4b63058f7969f6 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: No bootstrap required, opened a new log
I20260709 13:17:37.897233 11303 ts_tablet_manager.cc:1403] T 8b7700103ed8419c8e4b63058f7969f6 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Time spent bootstrapping tablet: real 0.098s	user 0.024s	sys 0.016s
I20260709 13:17:37.899062 11311 raft_consensus.cc:515] T 8b7700103ed8419c8e4b63058f7969f6 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } } peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } }
I20260709 13:17:37.896363 11302 raft_consensus.cc:359] T c4f71e70f87441408c0353d089d9557d P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:37.900553 11303 raft_consensus.cc:359] T 8b7700103ed8419c8e4b63058f7969f6 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } } peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } }
I20260709 13:17:37.900990 11302 raft_consensus.cc:385] T c4f71e70f87441408c0353d089d9557d P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:37.901404 11311 leader_election.cc:290] T 8b7700103ed8419c8e4b63058f7969f6 P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 1 election: Requested vote from peers 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941), ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307)
I20260709 13:17:37.901510 11302 raft_consensus.cc:740] T c4f71e70f87441408c0353d089d9557d P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ceb819e448e34d73b2cd02fdc2e3747c, State: Initialized, Role: FOLLOWER
I20260709 13:17:37.902256 11311 raft_consensus.cc:2804] T 85ed2545e6bf44589a83b5a92d807ea0 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:37.902751 11311 raft_consensus.cc:493] T 85ed2545e6bf44589a83b5a92d807ea0 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:37.903159 11311 raft_consensus.cc:3060] T 85ed2545e6bf44589a83b5a92d807ea0 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:37.902860 11302 consensus_queue.cc:260] T c4f71e70f87441408c0353d089d9557d P ceb819e448e34d73b2cd02fdc2e3747c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:37.902299 11306 tablet_bootstrap.cc:492] T 7e274b51306c4d09872f37009c6f5e1e P 7e5b746c9d10411cb2e3948be2e9db1e: No bootstrap required, opened a new log
I20260709 13:17:37.901386 11303 raft_consensus.cc:385] T 8b7700103ed8419c8e4b63058f7969f6 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:37.905575 11306 ts_tablet_manager.cc:1403] T 7e274b51306c4d09872f37009c6f5e1e P 7e5b746c9d10411cb2e3948be2e9db1e: Time spent bootstrapping tablet: real 0.072s	user 0.020s	sys 0.014s
I20260709 13:17:37.905373 11328 raft_consensus.cc:515] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:37.905675 11303 raft_consensus.cc:740] T 8b7700103ed8419c8e4b63058f7969f6 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fc0290ef4cf4ffa8c82c234ed04ff1d, State: Initialized, Role: FOLLOWER
I20260709 13:17:37.907855 11328 leader_election.cc:290] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 1 election: Requested vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941)
I20260709 13:17:37.908038 11303 consensus_queue.cc:260] T 8b7700103ed8419c8e4b63058f7969f6 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } } peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } }
I20260709 13:17:37.912292 11303 ts_tablet_manager.cc:1434] T 8b7700103ed8419c8e4b63058f7969f6 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 13:17:37.913462 11303 tablet_bootstrap.cc:492] T 79e021e2ff374d78b82d53e7631dc83c P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Bootstrap starting.
I20260709 13:17:37.913622 11302 ts_tablet_manager.cc:1434] T c4f71e70f87441408c0353d089d9557d P ceb819e448e34d73b2cd02fdc2e3747c: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.003s
I20260709 13:17:37.915899 11311 raft_consensus.cc:515] T 85ed2545e6bf44589a83b5a92d807ea0 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:37.909334 11306 raft_consensus.cc:359] T 7e274b51306c4d09872f37009c6f5e1e P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:37.917305 11306 raft_consensus.cc:385] T 7e274b51306c4d09872f37009c6f5e1e P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:37.917620 11306 raft_consensus.cc:740] T 7e274b51306c4d09872f37009c6f5e1e P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e5b746c9d10411cb2e3948be2e9db1e, State: Initialized, Role: FOLLOWER
I20260709 13:17:37.918587 11306 consensus_queue.cc:260] T 7e274b51306c4d09872f37009c6f5e1e P 7e5b746c9d10411cb2e3948be2e9db1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:37.921051 11306 ts_tablet_manager.cc:1434] T 7e274b51306c4d09872f37009c6f5e1e P 7e5b746c9d10411cb2e3948be2e9db1e: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:17:37.922043 11306 tablet_bootstrap.cc:492] T e7e16d7d38af4781975f803c3d05e208 P 7e5b746c9d10411cb2e3948be2e9db1e: Bootstrap starting.
I20260709 13:17:37.923532 11302 tablet_bootstrap.cc:492] T 85ed2545e6bf44589a83b5a92d807ea0 P ceb819e448e34d73b2cd02fdc2e3747c: Bootstrap starting.
I20260709 13:17:37.926831 11311 leader_election.cc:290] T 85ed2545e6bf44589a83b5a92d807ea0 P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 1 election: Requested vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941)
I20260709 13:17:37.930549 11303 tablet_bootstrap.cc:654] T 79e021e2ff374d78b82d53e7631dc83c P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:37.931994 11306 tablet_bootstrap.cc:654] T e7e16d7d38af4781975f803c3d05e208 P 7e5b746c9d10411cb2e3948be2e9db1e: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:37.932533 11225 leader_election.cc:343] T 8b7700103ed8419c8e4b63058f7969f6 P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:37.934574 11188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b7700103ed8419c8e4b63058f7969f6" candidate_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d"
I20260709 13:17:37.935273 11188 raft_consensus.cc:3060] T 8b7700103ed8419c8e4b63058f7969f6 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:37.936604 11302 tablet_bootstrap.cc:654] T 85ed2545e6bf44589a83b5a92d807ea0 P ceb819e448e34d73b2cd02fdc2e3747c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:37.943346 11306 tablet_bootstrap.cc:492] T e7e16d7d38af4781975f803c3d05e208 P 7e5b746c9d10411cb2e3948be2e9db1e: No bootstrap required, opened a new log
I20260709 13:17:37.943372 11188 raft_consensus.cc:2468] T 8b7700103ed8419c8e4b63058f7969f6 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e5b746c9d10411cb2e3948be2e9db1e in term 1.
I20260709 13:17:37.944702 11112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b7700103ed8419c8e4b63058f7969f6" candidate_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c"
I20260709 13:17:37.945479 11303 tablet_bootstrap.cc:492] T 79e021e2ff374d78b82d53e7631dc83c P 6fc0290ef4cf4ffa8c82c234ed04ff1d: No bootstrap required, opened a new log
I20260709 13:17:37.945408 11112 raft_consensus.cc:3060] T 8b7700103ed8419c8e4b63058f7969f6 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:37.946108 11303 ts_tablet_manager.cc:1403] T 79e021e2ff374d78b82d53e7631dc83c P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Time spent bootstrapping tablet: real 0.033s	user 0.004s	sys 0.008s
I20260709 13:17:37.947660 11305 raft_consensus.cc:493] T a13cc15140be4d119a2fee5acc480df1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.948596 11305 raft_consensus.cc:515] T a13cc15140be4d119a2fee5acc480df1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:37.949690 11303 raft_consensus.cc:359] T 79e021e2ff374d78b82d53e7631dc83c P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:37.950410 11303 raft_consensus.cc:385] T 79e021e2ff374d78b82d53e7631dc83c P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:37.950698 11303 raft_consensus.cc:740] T 79e021e2ff374d78b82d53e7631dc83c P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fc0290ef4cf4ffa8c82c234ed04ff1d, State: Initialized, Role: FOLLOWER
I20260709 13:17:37.951462 11303 consensus_queue.cc:260] T 79e021e2ff374d78b82d53e7631dc83c P 6fc0290ef4cf4ffa8c82c234ed04ff1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:37.952726 11113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a13cc15140be4d119a2fee5acc480df1" candidate_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" is_pre_election: true
I20260709 13:17:37.953670 11113 raft_consensus.cc:2468] T a13cc15140be4d119a2fee5acc480df1 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fc0290ef4cf4ffa8c82c234ed04ff1d in term 0.
I20260709 13:17:37.955500 11151 leader_election.cc:304] T a13cc15140be4d119a2fee5acc480df1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, ceb819e448e34d73b2cd02fdc2e3747c; no voters: 
I20260709 13:17:37.958369 11112 raft_consensus.cc:2468] T 8b7700103ed8419c8e4b63058f7969f6 P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e5b746c9d10411cb2e3948be2e9db1e in term 1.
I20260709 13:17:37.944746 11306 ts_tablet_manager.cc:1403] T e7e16d7d38af4781975f803c3d05e208 P 7e5b746c9d10411cb2e3948be2e9db1e: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.009s
I20260709 13:17:37.959503 11262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a13cc15140be4d119a2fee5acc480df1" candidate_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" is_pre_election: true
I20260709 13:17:37.960670 11262 raft_consensus.cc:2468] T a13cc15140be4d119a2fee5acc480df1 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fc0290ef4cf4ffa8c82c234ed04ff1d in term 0.
I20260709 13:17:37.962659 11305 leader_election.cc:290] T a13cc15140be4d119a2fee5acc480df1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195:33049)
I20260709 13:17:37.964511 11306 raft_consensus.cc:359] T e7e16d7d38af4781975f803c3d05e208 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:37.965633 11306 raft_consensus.cc:385] T e7e16d7d38af4781975f803c3d05e208 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:37.966013 11306 raft_consensus.cc:740] T e7e16d7d38af4781975f803c3d05e208 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e5b746c9d10411cb2e3948be2e9db1e, State: Initialized, Role: FOLLOWER
I20260709 13:17:37.970078 11113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f71e70f87441408c0353d089d9557d" candidate_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c"
I20260709 13:17:37.970990 11113 raft_consensus.cc:3060] T c4f71e70f87441408c0353d089d9557d P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:37.974377 11305 raft_consensus.cc:2804] T a13cc15140be4d119a2fee5acc480df1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:37.975152 11305 raft_consensus.cc:493] T a13cc15140be4d119a2fee5acc480df1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:37.976202 11305 raft_consensus.cc:3060] T a13cc15140be4d119a2fee5acc480df1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:37.982271 11111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85ed2545e6bf44589a83b5a92d807ea0" candidate_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c"
I20260709 13:17:37.985636 11187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85ed2545e6bf44589a83b5a92d807ea0" candidate_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d"
I20260709 13:17:37.986447 11187 raft_consensus.cc:3060] T 85ed2545e6bf44589a83b5a92d807ea0 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:37.982420 11188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f71e70f87441408c0353d089d9557d" candidate_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d"
I20260709 13:17:37.989734 11188 raft_consensus.cc:3060] T c4f71e70f87441408c0353d089d9557d P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:37.995409 11225 leader_election.cc:304] T 8b7700103ed8419c8e4b63058f7969f6 P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e5b746c9d10411cb2e3948be2e9db1e, ceb819e448e34d73b2cd02fdc2e3747c; no voters: 
I20260709 13:17:37.996872 11330 raft_consensus.cc:2804] T 8b7700103ed8419c8e4b63058f7969f6 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:17:37.996937 11225 leader_election.cc:343] T 85ed2545e6bf44589a83b5a92d807ea0 P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:37.997526 11330 raft_consensus.cc:697] T 8b7700103ed8419c8e4b63058f7969f6 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 LEADER]: Becoming Leader. State: Replica: 7e5b746c9d10411cb2e3948be2e9db1e, State: Running, Role: LEADER
I20260709 13:17:37.998488 11330 consensus_queue.cc:237] T 8b7700103ed8419c8e4b63058f7969f6 P 7e5b746c9d10411cb2e3948be2e9db1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } } peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } }
I20260709 13:17:37.999898 11310 raft_consensus.cc:493] T 66972c9ebce04c89a8e6b410dee75534 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.000648 11310 raft_consensus.cc:515] T 66972c9ebce04c89a8e6b410dee75534 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.008443 11310 leader_election.cc:290] T 66972c9ebce04c89a8e6b410dee75534 P ceb819e448e34d73b2cd02fdc2e3747c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941), 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195:33049)
I20260709 13:17:38.014477 11305 raft_consensus.cc:515] T a13cc15140be4d119a2fee5acc480df1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.025399 11112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a13cc15140be4d119a2fee5acc480df1" candidate_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c"
I20260709 13:17:38.026134 11112 raft_consensus.cc:3060] T a13cc15140be4d119a2fee5acc480df1 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:38.026541 11262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a13cc15140be4d119a2fee5acc480df1" candidate_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e"
I20260709 13:17:38.027241 11302 tablet_bootstrap.cc:492] T 85ed2545e6bf44589a83b5a92d807ea0 P ceb819e448e34d73b2cd02fdc2e3747c: No bootstrap required, opened a new log
I20260709 13:17:38.019200 11303 ts_tablet_manager.cc:1434] T 79e021e2ff374d78b82d53e7631dc83c P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Time spent starting tablet: real 0.073s	user 0.034s	sys 0.029s
I20260709 13:17:38.027740 11305 leader_election.cc:290] T a13cc15140be4d119a2fee5acc480df1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 1 election: Requested vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195:33049)
I20260709 13:17:38.027201 11262 raft_consensus.cc:3060] T a13cc15140be4d119a2fee5acc480df1 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:38.030821 11303 tablet_bootstrap.cc:492] T 66972c9ebce04c89a8e6b410dee75534 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Bootstrap starting.
I20260709 13:17:38.027951 11302 ts_tablet_manager.cc:1403] T 85ed2545e6bf44589a83b5a92d807ea0 P ceb819e448e34d73b2cd02fdc2e3747c: Time spent bootstrapping tablet: real 0.105s	user 0.034s	sys 0.036s
I20260709 13:17:38.019935 11187 raft_consensus.cc:2468] T 85ed2545e6bf44589a83b5a92d807ea0 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e5b746c9d10411cb2e3948be2e9db1e in term 1.
I20260709 13:17:38.036760 11225 leader_election.cc:304] T 85ed2545e6bf44589a83b5a92d807ea0 P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, 7e5b746c9d10411cb2e3948be2e9db1e; no voters: ceb819e448e34d73b2cd02fdc2e3747c
I20260709 13:17:38.037562 11262 raft_consensus.cc:2468] T a13cc15140be4d119a2fee5acc480df1 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fc0290ef4cf4ffa8c82c234ed04ff1d in term 1.
I20260709 13:17:38.037860 11328 raft_consensus.cc:2804] T 85ed2545e6bf44589a83b5a92d807ea0 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:38.038460 11328 raft_consensus.cc:697] T 85ed2545e6bf44589a83b5a92d807ea0 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 LEADER]: Becoming Leader. State: Replica: 7e5b746c9d10411cb2e3948be2e9db1e, State: Running, Role: LEADER
I20260709 13:17:38.038875 11303 tablet_bootstrap.cc:654] T 66972c9ebce04c89a8e6b410dee75534 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:38.039016 11154 leader_election.cc:304] T a13cc15140be4d119a2fee5acc480df1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, 7e5b746c9d10411cb2e3948be2e9db1e; no voters: 
I20260709 13:17:38.039387 11328 consensus_queue.cc:237] T 85ed2545e6bf44589a83b5a92d807ea0 P 7e5b746c9d10411cb2e3948be2e9db1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.040163 11305 raft_consensus.cc:2804] T a13cc15140be4d119a2fee5acc480df1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:38.041779 11305 raft_consensus.cc:697] T a13cc15140be4d119a2fee5acc480df1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 LEADER]: Becoming Leader. State: Replica: 6fc0290ef4cf4ffa8c82c234ed04ff1d, State: Running, Role: LEADER
I20260709 13:17:38.042742 11305 consensus_queue.cc:237] T a13cc15140be4d119a2fee5acc480df1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.045607 11188 raft_consensus.cc:2468] T c4f71e70f87441408c0353d089d9557d P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e5b746c9d10411cb2e3948be2e9db1e in term 1.
I20260709 13:17:38.047158 11302 raft_consensus.cc:359] T 85ed2545e6bf44589a83b5a92d807ea0 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.048002 11302 raft_consensus.cc:385] T 85ed2545e6bf44589a83b5a92d807ea0 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:38.017915 11113 raft_consensus.cc:2468] T c4f71e70f87441408c0353d089d9557d P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e5b746c9d10411cb2e3948be2e9db1e in term 1.
I20260709 13:17:38.048342 11302 raft_consensus.cc:740] T 85ed2545e6bf44589a83b5a92d807ea0 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ceb819e448e34d73b2cd02fdc2e3747c, State: Initialized, Role: FOLLOWER
I20260709 13:17:38.047127 11225 leader_election.cc:304] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, 7e5b746c9d10411cb2e3948be2e9db1e; no voters: 
I20260709 13:17:37.967094 11306 consensus_queue.cc:260] T e7e16d7d38af4781975f803c3d05e208 P 7e5b746c9d10411cb2e3948be2e9db1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.048661 11011 catalog_manager.cc:5697] T 8b7700103ed8419c8e4b63058f7969f6 P 7e5b746c9d10411cb2e3948be2e9db1e reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195). New cstate: current_term: 1 leader_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:38.050002 11330 raft_consensus.cc:2804] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:38.051337 11330 raft_consensus.cc:697] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 LEADER]: Becoming Leader. State: Replica: 7e5b746c9d10411cb2e3948be2e9db1e, State: Running, Role: LEADER
I20260709 13:17:38.052305 11330 consensus_queue.cc:237] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.059239 11306 ts_tablet_manager.cc:1434] T e7e16d7d38af4781975f803c3d05e208 P 7e5b746c9d10411cb2e3948be2e9db1e: Time spent starting tablet: real 0.099s	user 0.009s	sys 0.000s
I20260709 13:17:38.058911 11262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66972c9ebce04c89a8e6b410dee75534" candidate_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" is_pre_election: true
I20260709 13:17:38.059902 11302 consensus_queue.cc:260] T 85ed2545e6bf44589a83b5a92d807ea0 P ceb819e448e34d73b2cd02fdc2e3747c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
W20260709 13:17:38.061072 11079 leader_election.cc:343] T 66972c9ebce04c89a8e6b410dee75534 P ceb819e448e34d73b2cd02fdc2e3747c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195:33049): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:38.062867 11302 ts_tablet_manager.cc:1434] T 85ed2545e6bf44589a83b5a92d807ea0 P ceb819e448e34d73b2cd02fdc2e3747c: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.001s
I20260709 13:17:38.065593 11302 tablet_bootstrap.cc:492] T 79e021e2ff374d78b82d53e7631dc83c P ceb819e448e34d73b2cd02fdc2e3747c: Bootstrap starting.
I20260709 13:17:38.067018 11303 tablet_bootstrap.cc:492] T 66972c9ebce04c89a8e6b410dee75534 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: No bootstrap required, opened a new log
I20260709 13:17:38.070863 11303 ts_tablet_manager.cc:1403] T 66972c9ebce04c89a8e6b410dee75534 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.003s
I20260709 13:17:38.075461 11306 tablet_bootstrap.cc:492] T 79e021e2ff374d78b82d53e7631dc83c P 7e5b746c9d10411cb2e3948be2e9db1e: Bootstrap starting.
I20260709 13:17:38.074267 11303 raft_consensus.cc:359] T 66972c9ebce04c89a8e6b410dee75534 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.079152 11303 raft_consensus.cc:385] T 66972c9ebce04c89a8e6b410dee75534 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:38.072799 11305 raft_consensus.cc:493] T 7e274b51306c4d09872f37009c6f5e1e P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.079413 11303 raft_consensus.cc:740] T 66972c9ebce04c89a8e6b410dee75534 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fc0290ef4cf4ffa8c82c234ed04ff1d, State: Initialized, Role: FOLLOWER
I20260709 13:17:38.079816 11305 raft_consensus.cc:515] T 7e274b51306c4d09872f37009c6f5e1e P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.080271 11303 consensus_queue.cc:260] T 66972c9ebce04c89a8e6b410dee75534 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.082178 11305 leader_election.cc:290] T 7e274b51306c4d09872f37009c6f5e1e P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195:33049)
I20260709 13:17:38.082324 11302 tablet_bootstrap.cc:654] T 79e021e2ff374d78b82d53e7631dc83c P ceb819e448e34d73b2cd02fdc2e3747c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:38.071477 11112 raft_consensus.cc:2468] T a13cc15140be4d119a2fee5acc480df1 P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fc0290ef4cf4ffa8c82c234ed04ff1d in term 1.
I20260709 13:17:38.083092 11303 ts_tablet_manager.cc:1434] T 66972c9ebce04c89a8e6b410dee75534 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:17:38.084252 11303 tablet_bootstrap.cc:492] T 4309ede3f11d451ab65bbdfb178d98d1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Bootstrap starting.
I20260709 13:17:38.084141 11262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e274b51306c4d09872f37009c6f5e1e" candidate_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" is_pre_election: true
I20260709 13:17:38.084925 11262 raft_consensus.cc:2468] T 7e274b51306c4d09872f37009c6f5e1e P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fc0290ef4cf4ffa8c82c234ed04ff1d in term 0.
I20260709 13:17:38.087764 11306 tablet_bootstrap.cc:654] T 79e021e2ff374d78b82d53e7631dc83c P 7e5b746c9d10411cb2e3948be2e9db1e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:38.093412 11188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66972c9ebce04c89a8e6b410dee75534" candidate_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" is_pre_election: true
I20260709 13:17:38.094329 11188 raft_consensus.cc:2468] T 66972c9ebce04c89a8e6b410dee75534 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb819e448e34d73b2cd02fdc2e3747c in term 0.
I20260709 13:17:38.096757 11112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e274b51306c4d09872f37009c6f5e1e" candidate_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" is_pre_election: true
I20260709 13:17:38.102931 11112 raft_consensus.cc:2468] T 7e274b51306c4d09872f37009c6f5e1e P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fc0290ef4cf4ffa8c82c234ed04ff1d in term 0.
I20260709 13:17:38.097076 11154 leader_election.cc:304] T 7e274b51306c4d09872f37009c6f5e1e P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, 7e5b746c9d10411cb2e3948be2e9db1e; no voters: 
I20260709 13:17:38.105458 11305 raft_consensus.cc:2804] T 7e274b51306c4d09872f37009c6f5e1e P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:38.105958 11305 raft_consensus.cc:493] T 7e274b51306c4d09872f37009c6f5e1e P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:38.106460 11305 raft_consensus.cc:3060] T 7e274b51306c4d09872f37009c6f5e1e P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:38.106092 11008 catalog_manager.cc:5697] T a13cc15140be4d119a2fee5acc480df1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194). New cstate: current_term: 1 leader_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:38.107409 11011 catalog_manager.cc:5697] T 85ed2545e6bf44589a83b5a92d807ea0 P 7e5b746c9d10411cb2e3948be2e9db1e reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195). New cstate: current_term: 1 leader_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:38.109632 11011 catalog_manager.cc:5697] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195). New cstate: current_term: 1 leader_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:38.098729 11076 leader_election.cc:304] T 66972c9ebce04c89a8e6b410dee75534 P ceb819e448e34d73b2cd02fdc2e3747c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, ceb819e448e34d73b2cd02fdc2e3747c; no voters: 7e5b746c9d10411cb2e3948be2e9db1e
I20260709 13:17:38.113986 11310 raft_consensus.cc:2804] T 66972c9ebce04c89a8e6b410dee75534 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:38.114465 11310 raft_consensus.cc:493] T 66972c9ebce04c89a8e6b410dee75534 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:38.114902 11310 raft_consensus.cc:3060] T 66972c9ebce04c89a8e6b410dee75534 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:38.127400 11302 tablet_bootstrap.cc:492] T 79e021e2ff374d78b82d53e7631dc83c P ceb819e448e34d73b2cd02fdc2e3747c: No bootstrap required, opened a new log
I20260709 13:17:38.128258 11302 ts_tablet_manager.cc:1403] T 79e021e2ff374d78b82d53e7631dc83c P ceb819e448e34d73b2cd02fdc2e3747c: Time spent bootstrapping tablet: real 0.064s	user 0.012s	sys 0.010s
I20260709 13:17:38.132131 11302 raft_consensus.cc:359] T 79e021e2ff374d78b82d53e7631dc83c P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.133141 11302 raft_consensus.cc:385] T 79e021e2ff374d78b82d53e7631dc83c P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:38.133539 11302 raft_consensus.cc:740] T 79e021e2ff374d78b82d53e7631dc83c P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ceb819e448e34d73b2cd02fdc2e3747c, State: Initialized, Role: FOLLOWER
I20260709 13:17:38.134496 11302 consensus_queue.cc:260] T 79e021e2ff374d78b82d53e7631dc83c P ceb819e448e34d73b2cd02fdc2e3747c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.140776 11305 raft_consensus.cc:515] T 7e274b51306c4d09872f37009c6f5e1e P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.096575 11303 tablet_bootstrap.cc:654] T 4309ede3f11d451ab65bbdfb178d98d1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:38.138736 11310 raft_consensus.cc:515] T 66972c9ebce04c89a8e6b410dee75534 P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.150231 11188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66972c9ebce04c89a8e6b410dee75534" candidate_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d"
I20260709 13:17:38.150919 11188 raft_consensus.cc:3060] T 66972c9ebce04c89a8e6b410dee75534 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:38.150977 11310 leader_election.cc:290] T 66972c9ebce04c89a8e6b410dee75534 P ceb819e448e34d73b2cd02fdc2e3747c [CANDIDATE]: Term 1 election: Requested vote from peers 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941), 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195:33049)
I20260709 13:17:38.152098 11305 leader_election.cc:290] T 7e274b51306c4d09872f37009c6f5e1e P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 1 election: Requested vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195:33049)
I20260709 13:17:38.152216 11262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66972c9ebce04c89a8e6b410dee75534" candidate_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e"
W20260709 13:17:38.153901 11079 leader_election.cc:343] T 66972c9ebce04c89a8e6b410dee75534 P ceb819e448e34d73b2cd02fdc2e3747c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195:33049): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:38.154945 11303 tablet_bootstrap.cc:492] T 4309ede3f11d451ab65bbdfb178d98d1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: No bootstrap required, opened a new log
I20260709 13:17:38.154731 11262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e274b51306c4d09872f37009c6f5e1e" candidate_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e"
I20260709 13:17:38.155179 11112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e274b51306c4d09872f37009c6f5e1e" candidate_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c"
I20260709 13:17:38.155478 11303 ts_tablet_manager.cc:1403] T 4309ede3f11d451ab65bbdfb178d98d1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Time spent bootstrapping tablet: real 0.071s	user 0.013s	sys 0.001s
I20260709 13:17:38.155416 11262 raft_consensus.cc:3060] T 7e274b51306c4d09872f37009c6f5e1e P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:38.155944 11112 raft_consensus.cc:3060] T 7e274b51306c4d09872f37009c6f5e1e P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:38.158891 11303 raft_consensus.cc:359] T 4309ede3f11d451ab65bbdfb178d98d1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.159680 11303 raft_consensus.cc:385] T 4309ede3f11d451ab65bbdfb178d98d1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:38.159977 11303 raft_consensus.cc:740] T 4309ede3f11d451ab65bbdfb178d98d1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fc0290ef4cf4ffa8c82c234ed04ff1d, State: Initialized, Role: FOLLOWER
I20260709 13:17:38.160796 11303 consensus_queue.cc:260] T 4309ede3f11d451ab65bbdfb178d98d1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.161732 11306 tablet_bootstrap.cc:492] T 79e021e2ff374d78b82d53e7631dc83c P 7e5b746c9d10411cb2e3948be2e9db1e: No bootstrap required, opened a new log
I20260709 13:17:38.162391 11306 ts_tablet_manager.cc:1403] T 79e021e2ff374d78b82d53e7631dc83c P 7e5b746c9d10411cb2e3948be2e9db1e: Time spent bootstrapping tablet: real 0.087s	user 0.025s	sys 0.040s
I20260709 13:17:38.163358 11303 ts_tablet_manager.cc:1434] T 4309ede3f11d451ab65bbdfb178d98d1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:17:38.163892 11262 raft_consensus.cc:2468] T 7e274b51306c4d09872f37009c6f5e1e P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fc0290ef4cf4ffa8c82c234ed04ff1d in term 1.
I20260709 13:17:38.165160 11154 leader_election.cc:304] T 7e274b51306c4d09872f37009c6f5e1e P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, 7e5b746c9d10411cb2e3948be2e9db1e; no voters: 
I20260709 13:17:38.165872 11305 raft_consensus.cc:2804] T 7e274b51306c4d09872f37009c6f5e1e P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:38.165903 11306 raft_consensus.cc:359] T 79e021e2ff374d78b82d53e7631dc83c P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.166471 11305 raft_consensus.cc:697] T 7e274b51306c4d09872f37009c6f5e1e P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 LEADER]: Becoming Leader. State: Replica: 6fc0290ef4cf4ffa8c82c234ed04ff1d, State: Running, Role: LEADER
I20260709 13:17:38.166821 11306 raft_consensus.cc:385] T 79e021e2ff374d78b82d53e7631dc83c P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:38.167181 11306 raft_consensus.cc:740] T 79e021e2ff374d78b82d53e7631dc83c P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e5b746c9d10411cb2e3948be2e9db1e, State: Initialized, Role: FOLLOWER
I20260709 13:17:38.167402 11305 consensus_queue.cc:237] T 7e274b51306c4d09872f37009c6f5e1e P 6fc0290ef4cf4ffa8c82c234ed04ff1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.168232 11306 consensus_queue.cc:260] T 79e021e2ff374d78b82d53e7631dc83c P 7e5b746c9d10411cb2e3948be2e9db1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.169039 11188 raft_consensus.cc:2468] T 66972c9ebce04c89a8e6b410dee75534 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb819e448e34d73b2cd02fdc2e3747c in term 1.
I20260709 13:17:38.170475 11076 leader_election.cc:304] T 66972c9ebce04c89a8e6b410dee75534 P ceb819e448e34d73b2cd02fdc2e3747c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, ceb819e448e34d73b2cd02fdc2e3747c; no voters: 7e5b746c9d10411cb2e3948be2e9db1e
I20260709 13:17:38.170917 11306 ts_tablet_manager.cc:1434] T 79e021e2ff374d78b82d53e7631dc83c P 7e5b746c9d10411cb2e3948be2e9db1e: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:17:38.172072 11306 tablet_bootstrap.cc:492] T 4309ede3f11d451ab65bbdfb178d98d1 P 7e5b746c9d10411cb2e3948be2e9db1e: Bootstrap starting.
I20260709 13:17:38.173691 11112 raft_consensus.cc:2468] T 7e274b51306c4d09872f37009c6f5e1e P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fc0290ef4cf4ffa8c82c234ed04ff1d in term 1.
I20260709 13:17:38.173904 11349 raft_consensus.cc:2804] T 66972c9ebce04c89a8e6b410dee75534 P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:38.176158 11302 ts_tablet_manager.cc:1434] T 79e021e2ff374d78b82d53e7631dc83c P ceb819e448e34d73b2cd02fdc2e3747c: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.006s
I20260709 13:17:38.176784 11349 raft_consensus.cc:697] T 66972c9ebce04c89a8e6b410dee75534 P ceb819e448e34d73b2cd02fdc2e3747c [term 1 LEADER]: Becoming Leader. State: Replica: ceb819e448e34d73b2cd02fdc2e3747c, State: Running, Role: LEADER
I20260709 13:17:38.177379 11302 tablet_bootstrap.cc:492] T 4309ede3f11d451ab65bbdfb178d98d1 P ceb819e448e34d73b2cd02fdc2e3747c: Bootstrap starting.
I20260709 13:17:38.177999 11349 consensus_queue.cc:237] T 66972c9ebce04c89a8e6b410dee75534 P ceb819e448e34d73b2cd02fdc2e3747c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.179610 11306 tablet_bootstrap.cc:654] T 4309ede3f11d451ab65bbdfb178d98d1 P 7e5b746c9d10411cb2e3948be2e9db1e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:38.185256 11302 tablet_bootstrap.cc:654] T 4309ede3f11d451ab65bbdfb178d98d1 P ceb819e448e34d73b2cd02fdc2e3747c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:38.199380 11302 tablet_bootstrap.cc:492] T 4309ede3f11d451ab65bbdfb178d98d1 P ceb819e448e34d73b2cd02fdc2e3747c: No bootstrap required, opened a new log
I20260709 13:17:38.200145 11302 ts_tablet_manager.cc:1403] T 4309ede3f11d451ab65bbdfb178d98d1 P ceb819e448e34d73b2cd02fdc2e3747c: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.007s
I20260709 13:17:38.199380 11011 catalog_manager.cc:5697] T 66972c9ebce04c89a8e6b410dee75534 P ceb819e448e34d73b2cd02fdc2e3747c reported cstate change: term changed from 0 to 1, leader changed from <none> to ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193). New cstate: current_term: 1 leader_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:38.204104 11302 raft_consensus.cc:359] T 4309ede3f11d451ab65bbdfb178d98d1 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.204861 11302 raft_consensus.cc:385] T 4309ede3f11d451ab65bbdfb178d98d1 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:38.205137 11302 raft_consensus.cc:740] T 4309ede3f11d451ab65bbdfb178d98d1 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ceb819e448e34d73b2cd02fdc2e3747c, State: Initialized, Role: FOLLOWER
I20260709 13:17:38.206075 11302 consensus_queue.cc:260] T 4309ede3f11d451ab65bbdfb178d98d1 P ceb819e448e34d73b2cd02fdc2e3747c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.208564 11302 ts_tablet_manager.cc:1434] T 4309ede3f11d451ab65bbdfb178d98d1 P ceb819e448e34d73b2cd02fdc2e3747c: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:17:38.209609 11302 tablet_bootstrap.cc:492] T e7e16d7d38af4781975f803c3d05e208 P ceb819e448e34d73b2cd02fdc2e3747c: Bootstrap starting.
I20260709 13:17:38.208660 11009 catalog_manager.cc:5697] T 7e274b51306c4d09872f37009c6f5e1e P 6fc0290ef4cf4ffa8c82c234ed04ff1d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194). New cstate: current_term: 1 leader_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:38.215260 11302 tablet_bootstrap.cc:654] T e7e16d7d38af4781975f803c3d05e208 P ceb819e448e34d73b2cd02fdc2e3747c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:38.226717 11302 tablet_bootstrap.cc:492] T e7e16d7d38af4781975f803c3d05e208 P ceb819e448e34d73b2cd02fdc2e3747c: No bootstrap required, opened a new log
I20260709 13:17:38.227329 11302 ts_tablet_manager.cc:1403] T e7e16d7d38af4781975f803c3d05e208 P ceb819e448e34d73b2cd02fdc2e3747c: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.007s
I20260709 13:17:38.227414 11306 tablet_bootstrap.cc:492] T 4309ede3f11d451ab65bbdfb178d98d1 P 7e5b746c9d10411cb2e3948be2e9db1e: No bootstrap required, opened a new log
I20260709 13:17:38.228075 11306 ts_tablet_manager.cc:1403] T 4309ede3f11d451ab65bbdfb178d98d1 P 7e5b746c9d10411cb2e3948be2e9db1e: Time spent bootstrapping tablet: real 0.056s	user 0.027s	sys 0.021s
I20260709 13:17:38.230564 11306 raft_consensus.cc:359] T 4309ede3f11d451ab65bbdfb178d98d1 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.231109 11306 raft_consensus.cc:385] T 4309ede3f11d451ab65bbdfb178d98d1 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:38.231343 11306 raft_consensus.cc:740] T 4309ede3f11d451ab65bbdfb178d98d1 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e5b746c9d10411cb2e3948be2e9db1e, State: Initialized, Role: FOLLOWER
I20260709 13:17:38.231659 11302 raft_consensus.cc:359] T e7e16d7d38af4781975f803c3d05e208 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.232021 11306 consensus_queue.cc:260] T 4309ede3f11d451ab65bbdfb178d98d1 P 7e5b746c9d10411cb2e3948be2e9db1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.232441 11302 raft_consensus.cc:385] T e7e16d7d38af4781975f803c3d05e208 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:38.232777 11302 raft_consensus.cc:740] T e7e16d7d38af4781975f803c3d05e208 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ceb819e448e34d73b2cd02fdc2e3747c, State: Initialized, Role: FOLLOWER
I20260709 13:17:38.233601 11302 consensus_queue.cc:260] T e7e16d7d38af4781975f803c3d05e208 P ceb819e448e34d73b2cd02fdc2e3747c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.234287 11306 ts_tablet_manager.cc:1434] T 4309ede3f11d451ab65bbdfb178d98d1 P 7e5b746c9d10411cb2e3948be2e9db1e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:17:38.235385 11306 tablet_bootstrap.cc:492] T 66972c9ebce04c89a8e6b410dee75534 P 7e5b746c9d10411cb2e3948be2e9db1e: Bootstrap starting.
I20260709 13:17:38.235455 11302 ts_tablet_manager.cc:1434] T e7e16d7d38af4781975f803c3d05e208 P ceb819e448e34d73b2cd02fdc2e3747c: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:17:38.241426 11306 tablet_bootstrap.cc:654] T 66972c9ebce04c89a8e6b410dee75534 P 7e5b746c9d10411cb2e3948be2e9db1e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:38.246528 11306 tablet_bootstrap.cc:492] T 66972c9ebce04c89a8e6b410dee75534 P 7e5b746c9d10411cb2e3948be2e9db1e: No bootstrap required, opened a new log
I20260709 13:17:38.246975 11306 ts_tablet_manager.cc:1403] T 66972c9ebce04c89a8e6b410dee75534 P 7e5b746c9d10411cb2e3948be2e9db1e: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:17:38.249385 11306 raft_consensus.cc:359] T 66972c9ebce04c89a8e6b410dee75534 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.249918 11306 raft_consensus.cc:385] T 66972c9ebce04c89a8e6b410dee75534 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:38.250151 11306 raft_consensus.cc:740] T 66972c9ebce04c89a8e6b410dee75534 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e5b746c9d10411cb2e3948be2e9db1e, State: Initialized, Role: FOLLOWER
I20260709 13:17:38.250802 11306 consensus_queue.cc:260] T 66972c9ebce04c89a8e6b410dee75534 P 7e5b746c9d10411cb2e3948be2e9db1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.252540 11306 ts_tablet_manager.cc:1434] T 66972c9ebce04c89a8e6b410dee75534 P 7e5b746c9d10411cb2e3948be2e9db1e: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:17:38.264079 11328 raft_consensus.cc:493] T e7e16d7d38af4781975f803c3d05e208 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.264688 11328 raft_consensus.cc:515] T e7e16d7d38af4781975f803c3d05e208 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.266542 11328 leader_election.cc:290] T e7e16d7d38af4781975f803c3d05e208 P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941)
I20260709 13:17:38.267351 11112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e16d7d38af4781975f803c3d05e208" candidate_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" is_pre_election: true
I20260709 13:17:38.267474 11188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e16d7d38af4781975f803c3d05e208" candidate_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" is_pre_election: true
I20260709 13:17:38.268098 11112 raft_consensus.cc:2468] T e7e16d7d38af4781975f803c3d05e208 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e5b746c9d10411cb2e3948be2e9db1e in term 0.
I20260709 13:17:38.268188 11188 raft_consensus.cc:2468] T e7e16d7d38af4781975f803c3d05e208 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e5b746c9d10411cb2e3948be2e9db1e in term 0.
I20260709 13:17:38.269181 11225 leader_election.cc:304] T e7e16d7d38af4781975f803c3d05e208 P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e5b746c9d10411cb2e3948be2e9db1e, ceb819e448e34d73b2cd02fdc2e3747c; no voters: 
I20260709 13:17:38.269861 11328 raft_consensus.cc:2804] T e7e16d7d38af4781975f803c3d05e208 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:38.270180 11328 raft_consensus.cc:493] T e7e16d7d38af4781975f803c3d05e208 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:38.270476 11328 raft_consensus.cc:3060] T e7e16d7d38af4781975f803c3d05e208 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:38.270742 11349 raft_consensus.cc:493] T 79e021e2ff374d78b82d53e7631dc83c P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.271227 11349 raft_consensus.cc:515] T 79e021e2ff374d78b82d53e7631dc83c P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.273162 11349 leader_election.cc:290] T 79e021e2ff374d78b82d53e7631dc83c P ceb819e448e34d73b2cd02fdc2e3747c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941), 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195:33049)
I20260709 13:17:38.273838 11188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e021e2ff374d78b82d53e7631dc83c" candidate_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" is_pre_election: true
I20260709 13:17:38.274292 11262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e021e2ff374d78b82d53e7631dc83c" candidate_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" is_pre_election: true
I20260709 13:17:38.274562 11188 raft_consensus.cc:2468] T 79e021e2ff374d78b82d53e7631dc83c P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb819e448e34d73b2cd02fdc2e3747c in term 0.
I20260709 13:17:38.274978 11262 raft_consensus.cc:2468] T 79e021e2ff374d78b82d53e7631dc83c P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb819e448e34d73b2cd02fdc2e3747c in term 0.
I20260709 13:17:38.275789 11076 leader_election.cc:304] T 79e021e2ff374d78b82d53e7631dc83c P ceb819e448e34d73b2cd02fdc2e3747c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, ceb819e448e34d73b2cd02fdc2e3747c; no voters: 
I20260709 13:17:38.276561 11349 raft_consensus.cc:2804] T 79e021e2ff374d78b82d53e7631dc83c P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:38.276938 11349 raft_consensus.cc:493] T 79e021e2ff374d78b82d53e7631dc83c P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:38.277173 11349 raft_consensus.cc:3060] T 79e021e2ff374d78b82d53e7631dc83c P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:38.278697 11328 raft_consensus.cc:515] T e7e16d7d38af4781975f803c3d05e208 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.280581 11328 leader_election.cc:290] T e7e16d7d38af4781975f803c3d05e208 P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 1 election: Requested vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941)
I20260709 13:17:38.281389 11112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e16d7d38af4781975f803c3d05e208" candidate_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c"
I20260709 13:17:38.281718 11188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e16d7d38af4781975f803c3d05e208" candidate_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d"
I20260709 13:17:38.282039 11112 raft_consensus.cc:3060] T e7e16d7d38af4781975f803c3d05e208 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:38.282331 11188 raft_consensus.cc:3060] T e7e16d7d38af4781975f803c3d05e208 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:38.284063 11349 raft_consensus.cc:515] T 79e021e2ff374d78b82d53e7631dc83c P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.286710 11349 leader_election.cc:290] T 79e021e2ff374d78b82d53e7631dc83c P ceb819e448e34d73b2cd02fdc2e3747c [CANDIDATE]: Term 1 election: Requested vote from peers 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941), 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195:33049)
I20260709 13:17:38.287106 11187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e021e2ff374d78b82d53e7631dc83c" candidate_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d"
I20260709 13:17:38.287300 11262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e021e2ff374d78b82d53e7631dc83c" candidate_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e"
I20260709 13:17:38.287797 11187 raft_consensus.cc:3060] T 79e021e2ff374d78b82d53e7631dc83c P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:38.287886 11262 raft_consensus.cc:3060] T 79e021e2ff374d78b82d53e7631dc83c P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:38.289377 11112 raft_consensus.cc:2468] T e7e16d7d38af4781975f803c3d05e208 P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e5b746c9d10411cb2e3948be2e9db1e in term 1.
I20260709 13:17:38.290565 11225 leader_election.cc:304] T e7e16d7d38af4781975f803c3d05e208 P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e5b746c9d10411cb2e3948be2e9db1e, ceb819e448e34d73b2cd02fdc2e3747c; no voters: 
I20260709 13:17:38.291605 11328 raft_consensus.cc:2804] T e7e16d7d38af4781975f803c3d05e208 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:38.292930 11328 raft_consensus.cc:697] T e7e16d7d38af4781975f803c3d05e208 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 LEADER]: Becoming Leader. State: Replica: 7e5b746c9d10411cb2e3948be2e9db1e, State: Running, Role: LEADER
I20260709 13:17:38.292335 11188 raft_consensus.cc:2468] T e7e16d7d38af4781975f803c3d05e208 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e5b746c9d10411cb2e3948be2e9db1e in term 1.
I20260709 13:17:38.293038 11349 raft_consensus.cc:493] T 85ed2545e6bf44589a83b5a92d807ea0 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.293996 11328 consensus_queue.cc:237] T e7e16d7d38af4781975f803c3d05e208 P 7e5b746c9d10411cb2e3948be2e9db1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.294174 11349 raft_consensus.cc:515] T 85ed2545e6bf44589a83b5a92d807ea0 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.295451 11262 raft_consensus.cc:2468] T 79e021e2ff374d78b82d53e7631dc83c P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb819e448e34d73b2cd02fdc2e3747c in term 1.
I20260709 13:17:38.296440 11349 leader_election.cc:290] T 85ed2545e6bf44589a83b5a92d807ea0 P ceb819e448e34d73b2cd02fdc2e3747c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941), 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195:33049)
I20260709 13:17:38.297070 11079 leader_election.cc:304] T 79e021e2ff374d78b82d53e7631dc83c P ceb819e448e34d73b2cd02fdc2e3747c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e5b746c9d10411cb2e3948be2e9db1e, ceb819e448e34d73b2cd02fdc2e3747c; no voters: 
I20260709 13:17:38.298004 11349 raft_consensus.cc:2804] T 79e021e2ff374d78b82d53e7631dc83c P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:38.298247 11261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85ed2545e6bf44589a83b5a92d807ea0" candidate_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" is_pre_election: true
I20260709 13:17:38.298907 11188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85ed2545e6bf44589a83b5a92d807ea0" candidate_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" is_pre_election: true
I20260709 13:17:38.299728 11349 raft_consensus.cc:697] T 79e021e2ff374d78b82d53e7631dc83c P ceb819e448e34d73b2cd02fdc2e3747c [term 1 LEADER]: Becoming Leader. State: Replica: ceb819e448e34d73b2cd02fdc2e3747c, State: Running, Role: LEADER
I20260709 13:17:38.297861 11187 raft_consensus.cc:2468] T 79e021e2ff374d78b82d53e7631dc83c P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb819e448e34d73b2cd02fdc2e3747c in term 1.
I20260709 13:17:38.300052 11188 raft_consensus.cc:2393] T 85ed2545e6bf44589a83b5a92d807ea0 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb819e448e34d73b2cd02fdc2e3747c in current term 1: Already voted for candidate 7e5b746c9d10411cb2e3948be2e9db1e in this term.
I20260709 13:17:38.302323 11349 consensus_queue.cc:237] T 79e021e2ff374d78b82d53e7631dc83c P ceb819e448e34d73b2cd02fdc2e3747c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.304327 11076 leader_election.cc:304] T 85ed2545e6bf44589a83b5a92d807ea0 P ceb819e448e34d73b2cd02fdc2e3747c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb819e448e34d73b2cd02fdc2e3747c; no voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, 7e5b746c9d10411cb2e3948be2e9db1e
I20260709 13:17:38.305214 11310 raft_consensus.cc:3060] T 85ed2545e6bf44589a83b5a92d807ea0 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:38.306654 11011 catalog_manager.cc:5697] T e7e16d7d38af4781975f803c3d05e208 P 7e5b746c9d10411cb2e3948be2e9db1e reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195). New cstate: current_term: 1 leader_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:38.311959 11009 catalog_manager.cc:5697] T 79e021e2ff374d78b82d53e7631dc83c P ceb819e448e34d73b2cd02fdc2e3747c reported cstate change: term changed from 0 to 1, leader changed from <none> to ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193). New cstate: current_term: 1 leader_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:38.315577 11310 raft_consensus.cc:2749] T 85ed2545e6bf44589a83b5a92d807ea0 P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:38.324210 11305 raft_consensus.cc:493] T 4309ede3f11d451ab65bbdfb178d98d1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.324733 11305 raft_consensus.cc:515] T 4309ede3f11d451ab65bbdfb178d98d1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.326566 11305 leader_election.cc:290] T 4309ede3f11d451ab65bbdfb178d98d1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195:33049)
I20260709 13:17:38.327216 11112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4309ede3f11d451ab65bbdfb178d98d1" candidate_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" is_pre_election: true
I20260709 13:17:38.327764 11261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4309ede3f11d451ab65bbdfb178d98d1" candidate_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" is_pre_election: true
I20260709 13:17:38.328001 11112 raft_consensus.cc:2468] T 4309ede3f11d451ab65bbdfb178d98d1 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fc0290ef4cf4ffa8c82c234ed04ff1d in term 0.
I20260709 13:17:38.328442 11261 raft_consensus.cc:2468] T 4309ede3f11d451ab65bbdfb178d98d1 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fc0290ef4cf4ffa8c82c234ed04ff1d in term 0.
I20260709 13:17:38.329114 11151 leader_election.cc:304] T 4309ede3f11d451ab65bbdfb178d98d1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, ceb819e448e34d73b2cd02fdc2e3747c; no voters: 
I20260709 13:17:38.329969 11305 raft_consensus.cc:2804] T 4309ede3f11d451ab65bbdfb178d98d1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:38.330262 11305 raft_consensus.cc:493] T 4309ede3f11d451ab65bbdfb178d98d1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:38.330569 11305 raft_consensus.cc:3060] T 4309ede3f11d451ab65bbdfb178d98d1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:38.336225 11305 raft_consensus.cc:515] T 4309ede3f11d451ab65bbdfb178d98d1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.337826 11305 leader_election.cc:290] T 4309ede3f11d451ab65bbdfb178d98d1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 1 election: Requested vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195:33049)
I20260709 13:17:38.338594 11112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4309ede3f11d451ab65bbdfb178d98d1" candidate_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c"
I20260709 13:17:38.338784 11261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4309ede3f11d451ab65bbdfb178d98d1" candidate_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e"
I20260709 13:17:38.339143 11112 raft_consensus.cc:3060] T 4309ede3f11d451ab65bbdfb178d98d1 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:38.339357 11261 raft_consensus.cc:3060] T 4309ede3f11d451ab65bbdfb178d98d1 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:38.344569 11261 raft_consensus.cc:2468] T 4309ede3f11d451ab65bbdfb178d98d1 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fc0290ef4cf4ffa8c82c234ed04ff1d in term 1.
I20260709 13:17:38.344571 11112 raft_consensus.cc:2468] T 4309ede3f11d451ab65bbdfb178d98d1 P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fc0290ef4cf4ffa8c82c234ed04ff1d in term 1.
I20260709 13:17:38.345654 11154 leader_election.cc:304] T 4309ede3f11d451ab65bbdfb178d98d1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, 7e5b746c9d10411cb2e3948be2e9db1e; no voters: 
I20260709 13:17:38.346320 11305 raft_consensus.cc:2804] T 4309ede3f11d451ab65bbdfb178d98d1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:38.346776 11305 raft_consensus.cc:697] T 4309ede3f11d451ab65bbdfb178d98d1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 LEADER]: Becoming Leader. State: Replica: 6fc0290ef4cf4ffa8c82c234ed04ff1d, State: Running, Role: LEADER
I20260709 13:17:38.347522 11305 consensus_queue.cc:237] T 4309ede3f11d451ab65bbdfb178d98d1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.355497 11009 catalog_manager.cc:5697] T 4309ede3f11d451ab65bbdfb178d98d1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194). New cstate: current_term: 1 leader_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:38.398138 11328 consensus_queue.cc:1048] T 8b7700103ed8419c8e4b63058f7969f6 P 7e5b746c9d10411cb2e3948be2e9db1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:38.406011 11328 consensus_queue.cc:1048] T 8b7700103ed8419c8e4b63058f7969f6 P 7e5b746c9d10411cb2e3948be2e9db1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:38.441525 11261 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b7700103ed8419c8e4b63058f7969f6"
dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e"
mode: GRACEFUL
new_leader_uuid: "ceb819e448e34d73b2cd02fdc2e3747c"
 from {username='slave'} at 127.0.0.1:53880
I20260709 13:17:38.442195 11261 raft_consensus.cc:606] T 8b7700103ed8419c8e4b63058f7969f6 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 LEADER]: Received request to transfer leadership to TS ceb819e448e34d73b2cd02fdc2e3747c
I20260709 13:17:38.447731 11261 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7e16d7d38af4781975f803c3d05e208"
dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e"
mode: GRACEFUL
new_leader_uuid: "ceb819e448e34d73b2cd02fdc2e3747c"
 from {username='slave'} at 127.0.0.1:53880
I20260709 13:17:38.448305 11261 raft_consensus.cc:606] T e7e16d7d38af4781975f803c3d05e208 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 LEADER]: Received request to transfer leadership to TS ceb819e448e34d73b2cd02fdc2e3747c
I20260709 13:17:38.463778 11188 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e274b51306c4d09872f37009c6f5e1e"
dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d"
mode: GRACEFUL
new_leader_uuid: "ceb819e448e34d73b2cd02fdc2e3747c"
 from {username='slave'} at 127.0.0.1:47256
I20260709 13:17:38.464354 11188 raft_consensus.cc:606] T 7e274b51306c4d09872f37009c6f5e1e P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 LEADER]: Received request to transfer leadership to TS ceb819e448e34d73b2cd02fdc2e3747c
I20260709 13:17:38.477608 11112 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66972c9ebce04c89a8e6b410dee75534"
dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c"
mode: GRACEFUL
new_leader_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d"
 from {username='slave'} at 127.0.0.1:55900
I20260709 13:17:38.478202 11112 raft_consensus.cc:606] T 66972c9ebce04c89a8e6b410dee75534 P ceb819e448e34d73b2cd02fdc2e3747c [term 1 LEADER]: Received request to transfer leadership to TS 6fc0290ef4cf4ffa8c82c234ed04ff1d
I20260709 13:17:38.483604 11261 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "85ed2545e6bf44589a83b5a92d807ea0"
dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e"
mode: GRACEFUL
new_leader_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d"
 from {username='slave'} at 127.0.0.1:53880
I20260709 13:17:38.484176 11261 raft_consensus.cc:606] T 85ed2545e6bf44589a83b5a92d807ea0 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 LEADER]: Received request to transfer leadership to TS 6fc0290ef4cf4ffa8c82c234ed04ff1d
I20260709 13:17:38.492089 11261 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4f71e70f87441408c0353d089d9557d"
dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e"
mode: GRACEFUL
new_leader_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d"
 from {username='slave'} at 127.0.0.1:53880
I20260709 13:17:38.492663 11261 raft_consensus.cc:606] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 LEADER]: Received request to transfer leadership to TS 6fc0290ef4cf4ffa8c82c234ed04ff1d
I20260709 13:17:38.493466 11330 consensus_queue.cc:1048] T 85ed2545e6bf44589a83b5a92d807ea0 P 7e5b746c9d10411cb2e3948be2e9db1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:38.498433 11188 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4309ede3f11d451ab65bbdfb178d98d1"
dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d"
mode: GRACEFUL
new_leader_uuid: "7e5b746c9d10411cb2e3948be2e9db1e"
 from {username='slave'} at 127.0.0.1:47256
I20260709 13:17:38.499128 11188 raft_consensus.cc:606] T 4309ede3f11d451ab65bbdfb178d98d1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 LEADER]: Received request to transfer leadership to TS 7e5b746c9d10411cb2e3948be2e9db1e
I20260709 13:17:38.505541 11328 consensus_queue.cc:1048] T 85ed2545e6bf44589a83b5a92d807ea0 P 7e5b746c9d10411cb2e3948be2e9db1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:38.515921 11328 raft_consensus.cc:993] T 85ed2545e6bf44589a83b5a92d807ea0 P 7e5b746c9d10411cb2e3948be2e9db1e: : Instructing follower 6fc0290ef4cf4ffa8c82c234ed04ff1d to start an election
I20260709 13:17:38.516414 11311 raft_consensus.cc:1081] T 85ed2545e6bf44589a83b5a92d807ea0 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 LEADER]: Signalling peer 6fc0290ef4cf4ffa8c82c234ed04ff1d to start an election
I20260709 13:17:38.517130 11330 consensus_queue.cc:1048] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:38.518285 11188 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "85ed2545e6bf44589a83b5a92d807ea0"
dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d"
 from {username='slave'} at 127.0.0.1:47240
I20260709 13:17:38.518931 11188 raft_consensus.cc:493] T 85ed2545e6bf44589a83b5a92d807ea0 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:38.519284 11188 raft_consensus.cc:3060] T 85ed2545e6bf44589a83b5a92d807ea0 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:38.525892 11188 raft_consensus.cc:515] T 85ed2545e6bf44589a83b5a92d807ea0 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.530105 11113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85ed2545e6bf44589a83b5a92d807ea0" candidate_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c"
I20260709 13:17:38.530730 11113 raft_consensus.cc:3060] T 85ed2545e6bf44589a83b5a92d807ea0 P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:38.531738 11328 consensus_queue.cc:1048] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:38.539937 11113 raft_consensus.cc:2468] T 85ed2545e6bf44589a83b5a92d807ea0 P ceb819e448e34d73b2cd02fdc2e3747c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fc0290ef4cf4ffa8c82c234ed04ff1d in term 2.
I20260709 13:17:38.541415 11151 leader_election.cc:304] T 85ed2545e6bf44589a83b5a92d807ea0 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, ceb819e448e34d73b2cd02fdc2e3747c; no voters: 
I20260709 13:17:38.541594 11261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85ed2545e6bf44589a83b5a92d807ea0" candidate_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e"
I20260709 13:17:38.541460 11188 leader_election.cc:290] T 85ed2545e6bf44589a83b5a92d807ea0 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 2 election: Requested vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195:33049)
I20260709 13:17:38.542161 11305 raft_consensus.cc:2804] T 85ed2545e6bf44589a83b5a92d807ea0 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:38.542454 11261 raft_consensus.cc:3055] T 85ed2545e6bf44589a83b5a92d807ea0 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:38.542837 11305 raft_consensus.cc:697] T 85ed2545e6bf44589a83b5a92d807ea0 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 LEADER]: Becoming Leader. State: Replica: 6fc0290ef4cf4ffa8c82c234ed04ff1d, State: Running, Role: LEADER
I20260709 13:17:38.543092 11261 raft_consensus.cc:740] T 85ed2545e6bf44589a83b5a92d807ea0 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e5b746c9d10411cb2e3948be2e9db1e, State: Running, Role: LEADER
I20260709 13:17:38.543710 11305 consensus_queue.cc:237] T 85ed2545e6bf44589a83b5a92d807ea0 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.544303 11261 consensus_queue.cc:260] T 85ed2545e6bf44589a83b5a92d807ea0 P 7e5b746c9d10411cb2e3948be2e9db1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.546344 11261 raft_consensus.cc:3060] T 85ed2545e6bf44589a83b5a92d807ea0 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:38.553565 11311 raft_consensus.cc:993] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e: : Instructing follower 6fc0290ef4cf4ffa8c82c234ed04ff1d to start an election
I20260709 13:17:38.554122 11328 raft_consensus.cc:1081] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 LEADER]: Signalling peer 6fc0290ef4cf4ffa8c82c234ed04ff1d to start an election
I20260709 13:17:38.555984 11187 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4f71e70f87441408c0353d089d9557d"
dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d"
 from {username='slave'} at 127.0.0.1:47240
I20260709 13:17:38.556823 11187 raft_consensus.cc:493] T c4f71e70f87441408c0353d089d9557d P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:38.557178 11187 raft_consensus.cc:3060] T c4f71e70f87441408c0353d089d9557d P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:38.557909 11261 raft_consensus.cc:2468] T 85ed2545e6bf44589a83b5a92d807ea0 P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fc0290ef4cf4ffa8c82c234ed04ff1d in term 2.
I20260709 13:17:38.562642 11187 raft_consensus.cc:515] T c4f71e70f87441408c0353d089d9557d P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.564914 11187 leader_election.cc:290] T c4f71e70f87441408c0353d089d9557d P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 2 election: Requested vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195:33049)
I20260709 13:17:38.566007 11112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f71e70f87441408c0353d089d9557d" candidate_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c"
I20260709 13:17:38.566635 11112 raft_consensus.cc:3060] T c4f71e70f87441408c0353d089d9557d P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:38.566884 11261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f71e70f87441408c0353d089d9557d" candidate_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e"
I20260709 13:17:38.567739 11334 consensus_queue.cc:1048] T a13cc15140be4d119a2fee5acc480df1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:38.568410 11261 raft_consensus.cc:3055] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:38.568781 11261 raft_consensus.cc:740] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e5b746c9d10411cb2e3948be2e9db1e, State: Running, Role: LEADER
I20260709 13:17:38.569645 11261 consensus_queue.cc:260] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.570515 11334 consensus_queue.cc:1048] T a13cc15140be4d119a2fee5acc480df1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:38.571023 11261 raft_consensus.cc:3060] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:38.575083 11112 raft_consensus.cc:2468] T c4f71e70f87441408c0353d089d9557d P ceb819e448e34d73b2cd02fdc2e3747c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fc0290ef4cf4ffa8c82c234ed04ff1d in term 2.
I20260709 13:17:38.585479 11151 leader_election.cc:304] T c4f71e70f87441408c0353d089d9557d P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, ceb819e448e34d73b2cd02fdc2e3747c; no voters: 
I20260709 13:17:38.586323 11334 raft_consensus.cc:2804] T c4f71e70f87441408c0353d089d9557d P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:38.586257 11261 raft_consensus.cc:2468] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fc0290ef4cf4ffa8c82c234ed04ff1d in term 2.
I20260709 13:17:38.586969 11334 raft_consensus.cc:697] T c4f71e70f87441408c0353d089d9557d P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 LEADER]: Becoming Leader. State: Replica: 6fc0290ef4cf4ffa8c82c234ed04ff1d, State: Running, Role: LEADER
I20260709 13:17:38.588023 11334 consensus_queue.cc:237] T c4f71e70f87441408c0353d089d9557d P 6fc0290ef4cf4ffa8c82c234ed04ff1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.578274 11008 catalog_manager.cc:5697] T 85ed2545e6bf44589a83b5a92d807ea0 P 6fc0290ef4cf4ffa8c82c234ed04ff1d reported cstate change: term changed from 1 to 2, leader changed from 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195) to 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194). New cstate: current_term: 2 leader_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:38.606966 11011 catalog_manager.cc:5697] T c4f71e70f87441408c0353d089d9557d P 6fc0290ef4cf4ffa8c82c234ed04ff1d reported cstate change: term changed from 1 to 2, leader changed from 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195) to 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194). New cstate: current_term: 2 leader_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:38.612098 11373 consensus_queue.cc:1048] T 7e274b51306c4d09872f37009c6f5e1e P 6fc0290ef4cf4ffa8c82c234ed04ff1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:38.623956 11334 consensus_queue.cc:1048] T 7e274b51306c4d09872f37009c6f5e1e P 6fc0290ef4cf4ffa8c82c234ed04ff1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:38.632200 11373 raft_consensus.cc:993] T 7e274b51306c4d09872f37009c6f5e1e P 6fc0290ef4cf4ffa8c82c234ed04ff1d: : Instructing follower ceb819e448e34d73b2cd02fdc2e3747c to start an election
I20260709 13:17:38.632690 11334 raft_consensus.cc:1081] T 7e274b51306c4d09872f37009c6f5e1e P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 LEADER]: Signalling peer ceb819e448e34d73b2cd02fdc2e3747c to start an election
I20260709 13:17:38.634245 11113 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7e274b51306c4d09872f37009c6f5e1e"
dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c"
 from {username='slave'} at 127.0.0.1:55880
I20260709 13:17:38.634743 11113 raft_consensus.cc:493] T 7e274b51306c4d09872f37009c6f5e1e P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:38.635133 11113 raft_consensus.cc:3060] T 7e274b51306c4d09872f37009c6f5e1e P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:38.638059 11328 raft_consensus.cc:493] T 66972c9ebce04c89a8e6b410dee75534 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.638744 11328 raft_consensus.cc:515] T 66972c9ebce04c89a8e6b410dee75534 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.640902 11328 leader_election.cc:290] T 66972c9ebce04c89a8e6b410dee75534 P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941)
I20260709 13:17:38.642170 11113 raft_consensus.cc:515] T 7e274b51306c4d09872f37009c6f5e1e P ceb819e448e34d73b2cd02fdc2e3747c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.642590 11112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66972c9ebce04c89a8e6b410dee75534" candidate_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" is_pre_election: true
I20260709 13:17:38.642784 11187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66972c9ebce04c89a8e6b410dee75534" candidate_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" is_pre_election: true
I20260709 13:17:38.643944 11187 raft_consensus.cc:2393] T 66972c9ebce04c89a8e6b410dee75534 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e5b746c9d10411cb2e3948be2e9db1e in current term 1: Already voted for candidate ceb819e448e34d73b2cd02fdc2e3747c in this term.
I20260709 13:17:38.644564 11113 leader_election.cc:290] T 7e274b51306c4d09872f37009c6f5e1e P ceb819e448e34d73b2cd02fdc2e3747c [CANDIDATE]: Term 2 election: Requested vote from peers 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941), 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195:33049)
I20260709 13:17:38.644997 11225 leader_election.cc:304] T 66972c9ebce04c89a8e6b410dee75534 P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e5b746c9d10411cb2e3948be2e9db1e; no voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, ceb819e448e34d73b2cd02fdc2e3747c
I20260709 13:17:38.645819 11261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e274b51306c4d09872f37009c6f5e1e" candidate_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e"
I20260709 13:17:38.646176 11328 raft_consensus.cc:3060] T 66972c9ebce04c89a8e6b410dee75534 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:38.646468 11261 raft_consensus.cc:3060] T 7e274b51306c4d09872f37009c6f5e1e P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:38.646296 11187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e274b51306c4d09872f37009c6f5e1e" candidate_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d"
I20260709 13:17:38.647048 11187 raft_consensus.cc:3055] T 7e274b51306c4d09872f37009c6f5e1e P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:38.647389 11187 raft_consensus.cc:740] T 7e274b51306c4d09872f37009c6f5e1e P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6fc0290ef4cf4ffa8c82c234ed04ff1d, State: Running, Role: LEADER
I20260709 13:17:38.648270 11187 consensus_queue.cc:260] T 7e274b51306c4d09872f37009c6f5e1e P 6fc0290ef4cf4ffa8c82c234ed04ff1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.649626 11187 raft_consensus.cc:3060] T 7e274b51306c4d09872f37009c6f5e1e P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:38.652523 11328 raft_consensus.cc:2749] T 66972c9ebce04c89a8e6b410dee75534 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:38.656762 11261 raft_consensus.cc:2468] T 7e274b51306c4d09872f37009c6f5e1e P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb819e448e34d73b2cd02fdc2e3747c in term 2.
I20260709 13:17:38.657112 11187 raft_consensus.cc:2468] T 7e274b51306c4d09872f37009c6f5e1e P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb819e448e34d73b2cd02fdc2e3747c in term 2.
I20260709 13:17:38.658030 11079 leader_election.cc:304] T 7e274b51306c4d09872f37009c6f5e1e P ceb819e448e34d73b2cd02fdc2e3747c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e5b746c9d10411cb2e3948be2e9db1e, ceb819e448e34d73b2cd02fdc2e3747c; no voters: 
I20260709 13:17:38.658735 11310 raft_consensus.cc:2804] T 7e274b51306c4d09872f37009c6f5e1e P ceb819e448e34d73b2cd02fdc2e3747c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:38.659168 11310 raft_consensus.cc:697] T 7e274b51306c4d09872f37009c6f5e1e P ceb819e448e34d73b2cd02fdc2e3747c [term 2 LEADER]: Becoming Leader. State: Replica: ceb819e448e34d73b2cd02fdc2e3747c, State: Running, Role: LEADER
I20260709 13:17:38.660030 11310 consensus_queue.cc:237] T 7e274b51306c4d09872f37009c6f5e1e P ceb819e448e34d73b2cd02fdc2e3747c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.666358 11011 catalog_manager.cc:5697] T 7e274b51306c4d09872f37009c6f5e1e P ceb819e448e34d73b2cd02fdc2e3747c reported cstate change: term changed from 1 to 2, leader changed from 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194) to ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193). New cstate: current_term: 2 leader_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:38.682592 11310 consensus_queue.cc:1048] T 66972c9ebce04c89a8e6b410dee75534 P ceb819e448e34d73b2cd02fdc2e3747c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:38.688728 11310 consensus_queue.cc:1048] T 66972c9ebce04c89a8e6b410dee75534 P ceb819e448e34d73b2cd02fdc2e3747c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:38.690763 11377 raft_consensus.cc:993] T 66972c9ebce04c89a8e6b410dee75534 P ceb819e448e34d73b2cd02fdc2e3747c: : Instructing follower 6fc0290ef4cf4ffa8c82c234ed04ff1d to start an election
I20260709 13:17:38.691696 11349 raft_consensus.cc:1081] T 66972c9ebce04c89a8e6b410dee75534 P ceb819e448e34d73b2cd02fdc2e3747c [term 1 LEADER]: Signalling peer 6fc0290ef4cf4ffa8c82c234ed04ff1d to start an election
I20260709 13:17:38.693502 11188 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66972c9ebce04c89a8e6b410dee75534"
dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d"
 from {username='slave'} at 127.0.0.1:47254
I20260709 13:17:38.695055 11188 raft_consensus.cc:493] T 66972c9ebce04c89a8e6b410dee75534 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:38.695482 11188 raft_consensus.cc:3060] T 66972c9ebce04c89a8e6b410dee75534 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:38.706969 11188 raft_consensus.cc:515] T 66972c9ebce04c89a8e6b410dee75534 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.717994 11113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66972c9ebce04c89a8e6b410dee75534" candidate_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c"
I20260709 13:17:38.718376 11261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66972c9ebce04c89a8e6b410dee75534" candidate_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e"
I20260709 13:17:38.718745 11113 raft_consensus.cc:3055] T 66972c9ebce04c89a8e6b410dee75534 P ceb819e448e34d73b2cd02fdc2e3747c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:38.718047 11188 leader_election.cc:290] T 66972c9ebce04c89a8e6b410dee75534 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 2 election: Requested vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195:33049)
I20260709 13:17:38.719133 11113 raft_consensus.cc:740] T 66972c9ebce04c89a8e6b410dee75534 P ceb819e448e34d73b2cd02fdc2e3747c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ceb819e448e34d73b2cd02fdc2e3747c, State: Running, Role: LEADER
I20260709 13:17:38.719146 11261 raft_consensus.cc:3060] T 66972c9ebce04c89a8e6b410dee75534 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:38.720474 11113 consensus_queue.cc:260] T 66972c9ebce04c89a8e6b410dee75534 P ceb819e448e34d73b2cd02fdc2e3747c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.721774 11113 raft_consensus.cc:3060] T 66972c9ebce04c89a8e6b410dee75534 P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:38.728116 11261 raft_consensus.cc:2468] T 66972c9ebce04c89a8e6b410dee75534 P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fc0290ef4cf4ffa8c82c234ed04ff1d in term 2.
I20260709 13:17:38.729308 11154 leader_election.cc:304] T 66972c9ebce04c89a8e6b410dee75534 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, 7e5b746c9d10411cb2e3948be2e9db1e; no voters: 
I20260709 13:17:38.730274 11334 raft_consensus.cc:2804] T 66972c9ebce04c89a8e6b410dee75534 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:38.730788 11113 raft_consensus.cc:2468] T 66972c9ebce04c89a8e6b410dee75534 P ceb819e448e34d73b2cd02fdc2e3747c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fc0290ef4cf4ffa8c82c234ed04ff1d in term 2.
I20260709 13:17:38.730811 11334 raft_consensus.cc:697] T 66972c9ebce04c89a8e6b410dee75534 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 LEADER]: Becoming Leader. State: Replica: 6fc0290ef4cf4ffa8c82c234ed04ff1d, State: Running, Role: LEADER
I20260709 13:17:38.732208 11334 consensus_queue.cc:237] T 66972c9ebce04c89a8e6b410dee75534 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.733635 11310 consensus_queue.cc:1048] T 79e021e2ff374d78b82d53e7631dc83c P ceb819e448e34d73b2cd02fdc2e3747c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:38.742358 11011 catalog_manager.cc:5697] T 66972c9ebce04c89a8e6b410dee75534 P 6fc0290ef4cf4ffa8c82c234ed04ff1d reported cstate change: term changed from 1 to 2, leader changed from ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193) to 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194). New cstate: current_term: 2 leader_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:38.747254 11378 consensus_queue.cc:1048] T 79e021e2ff374d78b82d53e7631dc83c P ceb819e448e34d73b2cd02fdc2e3747c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:38.771288 11328 consensus_queue.cc:1048] T e7e16d7d38af4781975f803c3d05e208 P 7e5b746c9d10411cb2e3948be2e9db1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:38.781828 11330 consensus_queue.cc:1048] T e7e16d7d38af4781975f803c3d05e208 P 7e5b746c9d10411cb2e3948be2e9db1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:38.786487 11334 consensus_queue.cc:1048] T 4309ede3f11d451ab65bbdfb178d98d1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:38.791769 11330 raft_consensus.cc:993] T e7e16d7d38af4781975f803c3d05e208 P 7e5b746c9d10411cb2e3948be2e9db1e: : Instructing follower ceb819e448e34d73b2cd02fdc2e3747c to start an election
I20260709 13:17:38.792382 11311 raft_consensus.cc:1081] T e7e16d7d38af4781975f803c3d05e208 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 LEADER]: Signalling peer ceb819e448e34d73b2cd02fdc2e3747c to start an election
I20260709 13:17:38.794212 11112 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7e16d7d38af4781975f803c3d05e208"
dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c"
 from {username='slave'} at 127.0.0.1:55888
I20260709 13:17:38.794821 11112 raft_consensus.cc:493] T e7e16d7d38af4781975f803c3d05e208 P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:38.795215 11112 raft_consensus.cc:3060] T e7e16d7d38af4781975f803c3d05e208 P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:38.802278 11334 consensus_queue.cc:1048] T 4309ede3f11d451ab65bbdfb178d98d1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:38.805871 11112 raft_consensus.cc:515] T e7e16d7d38af4781975f803c3d05e208 P ceb819e448e34d73b2cd02fdc2e3747c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.812227 11187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e16d7d38af4781975f803c3d05e208" candidate_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d"
I20260709 13:17:38.812840 11187 raft_consensus.cc:3060] T e7e16d7d38af4781975f803c3d05e208 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:38.817090 11334 raft_consensus.cc:993] T 4309ede3f11d451ab65bbdfb178d98d1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: : Instructing follower 7e5b746c9d10411cb2e3948be2e9db1e to start an election
I20260709 13:17:38.817703 11334 raft_consensus.cc:1081] T 4309ede3f11d451ab65bbdfb178d98d1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 LEADER]: Signalling peer 7e5b746c9d10411cb2e3948be2e9db1e to start an election
I20260709 13:17:38.820514 11187 raft_consensus.cc:2468] T e7e16d7d38af4781975f803c3d05e208 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb819e448e34d73b2cd02fdc2e3747c in term 2.
I20260709 13:17:38.821851 11076 leader_election.cc:304] T e7e16d7d38af4781975f803c3d05e208 P ceb819e448e34d73b2cd02fdc2e3747c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, ceb819e448e34d73b2cd02fdc2e3747c; no voters: 
I20260709 13:17:38.822790 11378 raft_consensus.cc:2804] T e7e16d7d38af4781975f803c3d05e208 P ceb819e448e34d73b2cd02fdc2e3747c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:38.823277 11378 raft_consensus.cc:697] T e7e16d7d38af4781975f803c3d05e208 P ceb819e448e34d73b2cd02fdc2e3747c [term 2 LEADER]: Becoming Leader. State: Replica: ceb819e448e34d73b2cd02fdc2e3747c, State: Running, Role: LEADER
I20260709 13:17:38.824038 11261 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4309ede3f11d451ab65bbdfb178d98d1"
dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e"
 from {username='slave'} at 127.0.0.1:53868
I20260709 13:17:38.824162 11378 consensus_queue.cc:237] T e7e16d7d38af4781975f803c3d05e208 P ceb819e448e34d73b2cd02fdc2e3747c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.824815 11261 raft_consensus.cc:493] T 4309ede3f11d451ab65bbdfb178d98d1 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:38.825248 11261 raft_consensus.cc:3060] T 4309ede3f11d451ab65bbdfb178d98d1 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:38.827142 11112 leader_election.cc:290] T e7e16d7d38af4781975f803c3d05e208 P ceb819e448e34d73b2cd02fdc2e3747c [CANDIDATE]: Term 2 election: Requested vote from peers 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941), 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195:33049)
I20260709 13:17:38.828256 11260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e16d7d38af4781975f803c3d05e208" candidate_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e"
I20260709 13:17:38.828980 11260 raft_consensus.cc:3055] T e7e16d7d38af4781975f803c3d05e208 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:38.829258 11260 raft_consensus.cc:740] T e7e16d7d38af4781975f803c3d05e208 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e5b746c9d10411cb2e3948be2e9db1e, State: Running, Role: LEADER
I20260709 13:17:38.830049 11260 consensus_queue.cc:260] T e7e16d7d38af4781975f803c3d05e208 P 7e5b746c9d10411cb2e3948be2e9db1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.831317 11260 raft_consensus.cc:3060] T e7e16d7d38af4781975f803c3d05e208 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:38.834199 11261 raft_consensus.cc:515] T 4309ede3f11d451ab65bbdfb178d98d1 P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.835999 11009 catalog_manager.cc:5697] T e7e16d7d38af4781975f803c3d05e208 P ceb819e448e34d73b2cd02fdc2e3747c reported cstate change: term changed from 1 to 2, leader changed from 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195) to ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193). New cstate: current_term: 2 leader_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:38.836885 11112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4309ede3f11d451ab65bbdfb178d98d1" candidate_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c"
I20260709 13:17:38.837273 11187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4309ede3f11d451ab65bbdfb178d98d1" candidate_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d"
I20260709 13:17:38.837788 11112 raft_consensus.cc:3060] T 4309ede3f11d451ab65bbdfb178d98d1 P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:38.837900 11187 raft_consensus.cc:3055] T 4309ede3f11d451ab65bbdfb178d98d1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:38.838328 11187 raft_consensus.cc:740] T 4309ede3f11d451ab65bbdfb178d98d1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6fc0290ef4cf4ffa8c82c234ed04ff1d, State: Running, Role: LEADER
I20260709 13:17:38.838544 11260 raft_consensus.cc:2468] T e7e16d7d38af4781975f803c3d05e208 P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb819e448e34d73b2cd02fdc2e3747c in term 2.
I20260709 13:17:38.839687 11261 leader_election.cc:290] T 4309ede3f11d451ab65bbdfb178d98d1 P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 2 election: Requested vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941)
I20260709 13:17:38.839331 11187 consensus_queue.cc:260] T 4309ede3f11d451ab65bbdfb178d98d1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.843215 11187 raft_consensus.cc:3060] T 4309ede3f11d451ab65bbdfb178d98d1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:38.845146 11112 raft_consensus.cc:2468] T 4309ede3f11d451ab65bbdfb178d98d1 P ceb819e448e34d73b2cd02fdc2e3747c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e5b746c9d10411cb2e3948be2e9db1e in term 2.
I20260709 13:17:38.846377 11225 leader_election.cc:304] T 4309ede3f11d451ab65bbdfb178d98d1 P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e5b746c9d10411cb2e3948be2e9db1e, ceb819e448e34d73b2cd02fdc2e3747c; no voters: 
I20260709 13:17:38.847126 11311 raft_consensus.cc:2804] T 4309ede3f11d451ab65bbdfb178d98d1 P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:38.847694 11311 raft_consensus.cc:697] T 4309ede3f11d451ab65bbdfb178d98d1 P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 LEADER]: Becoming Leader. State: Replica: 7e5b746c9d10411cb2e3948be2e9db1e, State: Running, Role: LEADER
I20260709 13:17:38.848582 11311 consensus_queue.cc:237] T 4309ede3f11d451ab65bbdfb178d98d1 P 7e5b746c9d10411cb2e3948be2e9db1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:38.850597 11187 raft_consensus.cc:2468] T 4309ede3f11d451ab65bbdfb178d98d1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e5b746c9d10411cb2e3948be2e9db1e in term 2.
I20260709 13:17:38.855904 11009 catalog_manager.cc:5697] T 4309ede3f11d451ab65bbdfb178d98d1 P 7e5b746c9d10411cb2e3948be2e9db1e reported cstate change: term changed from 1 to 2, leader changed from 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194) to 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195). New cstate: current_term: 2 leader_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:38.947352 11330 raft_consensus.cc:993] T 8b7700103ed8419c8e4b63058f7969f6 P 7e5b746c9d10411cb2e3948be2e9db1e: : Instructing follower ceb819e448e34d73b2cd02fdc2e3747c to start an election
I20260709 13:17:38.947908 11311 raft_consensus.cc:1081] T 8b7700103ed8419c8e4b63058f7969f6 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 LEADER]: Signalling peer ceb819e448e34d73b2cd02fdc2e3747c to start an election
I20260709 13:17:38.949481 11112 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b7700103ed8419c8e4b63058f7969f6"
dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c"
 from {username='slave'} at 127.0.0.1:55888
I20260709 13:17:38.949990 11112 raft_consensus.cc:493] T 8b7700103ed8419c8e4b63058f7969f6 P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:38.950337 11112 raft_consensus.cc:3060] T 8b7700103ed8419c8e4b63058f7969f6 P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:38.955955 11112 raft_consensus.cc:515] T 8b7700103ed8419c8e4b63058f7969f6 P ceb819e448e34d73b2cd02fdc2e3747c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } } peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } }
I20260709 13:17:38.957620 11112 leader_election.cc:290] T 8b7700103ed8419c8e4b63058f7969f6 P ceb819e448e34d73b2cd02fdc2e3747c [CANDIDATE]: Term 2 election: Requested vote from peers 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941), 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195:33049)
I20260709 13:17:38.958351 11187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b7700103ed8419c8e4b63058f7969f6" candidate_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d"
I20260709 13:17:38.958997 11187 raft_consensus.cc:3060] T 8b7700103ed8419c8e4b63058f7969f6 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:38.958891 11261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b7700103ed8419c8e4b63058f7969f6" candidate_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e"
I20260709 13:17:38.959616 11261 raft_consensus.cc:3055] T 8b7700103ed8419c8e4b63058f7969f6 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:38.959921 11261 raft_consensus.cc:740] T 8b7700103ed8419c8e4b63058f7969f6 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e5b746c9d10411cb2e3948be2e9db1e, State: Running, Role: LEADER
I20260709 13:17:38.960691 11261 consensus_queue.cc:260] T 8b7700103ed8419c8e4b63058f7969f6 P 7e5b746c9d10411cb2e3948be2e9db1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } } peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } }
I20260709 13:17:38.961678 11261 raft_consensus.cc:3060] T 8b7700103ed8419c8e4b63058f7969f6 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:38.965197 11187 raft_consensus.cc:2468] T 8b7700103ed8419c8e4b63058f7969f6 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb819e448e34d73b2cd02fdc2e3747c in term 2.
I20260709 13:17:38.966653 11076 leader_election.cc:304] T 8b7700103ed8419c8e4b63058f7969f6 P ceb819e448e34d73b2cd02fdc2e3747c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, ceb819e448e34d73b2cd02fdc2e3747c; no voters: 
I20260709 13:17:38.967514 11378 raft_consensus.cc:2804] T 8b7700103ed8419c8e4b63058f7969f6 P ceb819e448e34d73b2cd02fdc2e3747c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:38.967777 11261 raft_consensus.cc:2468] T 8b7700103ed8419c8e4b63058f7969f6 P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb819e448e34d73b2cd02fdc2e3747c in term 2.
I20260709 13:17:38.968125 11378 raft_consensus.cc:697] T 8b7700103ed8419c8e4b63058f7969f6 P ceb819e448e34d73b2cd02fdc2e3747c [term 2 LEADER]: Becoming Leader. State: Replica: ceb819e448e34d73b2cd02fdc2e3747c, State: Running, Role: LEADER
I20260709 13:17:38.969105 11378 consensus_queue.cc:237] T 8b7700103ed8419c8e4b63058f7969f6 P ceb819e448e34d73b2cd02fdc2e3747c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } } peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } }
I20260709 13:17:38.975878 11009 catalog_manager.cc:5697] T 8b7700103ed8419c8e4b63058f7969f6 P ceb819e448e34d73b2cd02fdc2e3747c reported cstate change: term changed from 1 to 2, leader changed from 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195) to ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193). New cstate: current_term: 2 leader_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:39.058760 11112 raft_consensus.cc:1275] T c4f71e70f87441408c0353d089d9557d P ceb819e448e34d73b2cd02fdc2e3747c [term 2 FOLLOWER]: Refusing update from remote peer 6fc0290ef4cf4ffa8c82c234ed04ff1d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:39.060365 11385 consensus_queue.cc:1048] T c4f71e70f87441408c0353d089d9557d P 6fc0290ef4cf4ffa8c82c234ed04ff1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:39.068339 11261 raft_consensus.cc:1275] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Refusing update from remote peer 6fc0290ef4cf4ffa8c82c234ed04ff1d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:39.069944 11305 consensus_queue.cc:1048] T c4f71e70f87441408c0353d089d9557d P 6fc0290ef4cf4ffa8c82c234ed04ff1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:39.090111 11187 raft_consensus.cc:1275] T 7e274b51306c4d09872f37009c6f5e1e P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 FOLLOWER]: Refusing update from remote peer ceb819e448e34d73b2cd02fdc2e3747c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:39.091444 11378 consensus_queue.cc:1048] T 7e274b51306c4d09872f37009c6f5e1e P ceb819e448e34d73b2cd02fdc2e3747c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:39.099659 11261 raft_consensus.cc:1275] T 7e274b51306c4d09872f37009c6f5e1e P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Refusing update from remote peer ceb819e448e34d73b2cd02fdc2e3747c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:39.101361 11378 consensus_queue.cc:1048] T 7e274b51306c4d09872f37009c6f5e1e P ceb819e448e34d73b2cd02fdc2e3747c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:39.116812 11112 raft_consensus.cc:1275] T 85ed2545e6bf44589a83b5a92d807ea0 P ceb819e448e34d73b2cd02fdc2e3747c [term 2 FOLLOWER]: Refusing update from remote peer 6fc0290ef4cf4ffa8c82c234ed04ff1d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:39.118027 11305 consensus_queue.cc:1048] T 85ed2545e6bf44589a83b5a92d807ea0 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:39.126155 11261 raft_consensus.cc:1275] T 85ed2545e6bf44589a83b5a92d807ea0 P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Refusing update from remote peer 6fc0290ef4cf4ffa8c82c234ed04ff1d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:39.128225 11373 consensus_queue.cc:1048] T 85ed2545e6bf44589a83b5a92d807ea0 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:39.177325 11112 raft_consensus.cc:1275] T 66972c9ebce04c89a8e6b410dee75534 P ceb819e448e34d73b2cd02fdc2e3747c [term 2 FOLLOWER]: Refusing update from remote peer 6fc0290ef4cf4ffa8c82c234ed04ff1d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:39.178624 11305 consensus_queue.cc:1048] T 66972c9ebce04c89a8e6b410dee75534 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:39.186451 11261 raft_consensus.cc:1275] T 66972c9ebce04c89a8e6b410dee75534 P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Refusing update from remote peer 6fc0290ef4cf4ffa8c82c234ed04ff1d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:39.188133 11305 consensus_queue.cc:1048] T 66972c9ebce04c89a8e6b410dee75534 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:39.317200 11187 raft_consensus.cc:1275] T 4309ede3f11d451ab65bbdfb178d98d1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 FOLLOWER]: Refusing update from remote peer 7e5b746c9d10411cb2e3948be2e9db1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:39.318631 11311 consensus_queue.cc:1048] T 4309ede3f11d451ab65bbdfb178d98d1 P 7e5b746c9d10411cb2e3948be2e9db1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:39.326893 11112 raft_consensus.cc:1275] T 4309ede3f11d451ab65bbdfb178d98d1 P ceb819e448e34d73b2cd02fdc2e3747c [term 2 FOLLOWER]: Refusing update from remote peer 7e5b746c9d10411cb2e3948be2e9db1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:39.328824 11328 consensus_queue.cc:1048] T 4309ede3f11d451ab65bbdfb178d98d1 P 7e5b746c9d10411cb2e3948be2e9db1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:39.353057 11261 raft_consensus.cc:1275] T e7e16d7d38af4781975f803c3d05e208 P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Refusing update from remote peer ceb819e448e34d73b2cd02fdc2e3747c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:39.354368 11310 consensus_queue.cc:1048] T e7e16d7d38af4781975f803c3d05e208 P ceb819e448e34d73b2cd02fdc2e3747c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:39.359325 11187 raft_consensus.cc:1275] T e7e16d7d38af4781975f803c3d05e208 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 FOLLOWER]: Refusing update from remote peer ceb819e448e34d73b2cd02fdc2e3747c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:39.360852 11378 consensus_queue.cc:1048] T e7e16d7d38af4781975f803c3d05e208 P ceb819e448e34d73b2cd02fdc2e3747c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:39.379973 11187 raft_consensus.cc:1275] T 8b7700103ed8419c8e4b63058f7969f6 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 FOLLOWER]: Refusing update from remote peer ceb819e448e34d73b2cd02fdc2e3747c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:39.381106 11310 consensus_queue.cc:1048] T 8b7700103ed8419c8e4b63058f7969f6 P ceb819e448e34d73b2cd02fdc2e3747c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:39.388746 11261 raft_consensus.cc:1275] T 8b7700103ed8419c8e4b63058f7969f6 P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Refusing update from remote peer ceb819e448e34d73b2cd02fdc2e3747c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:39.390578 11378 consensus_queue.cc:1048] T 8b7700103ed8419c8e4b63058f7969f6 P ceb819e448e34d73b2cd02fdc2e3747c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:41.534600 11008 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58318:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:17:41.537498 11008 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:17:41.590698 11102 tablet_service.cc:1511] Processing CreateTablet for tablet f184ae5efb4641d9b6442c2a743f1f81 (DEFAULT_TABLE table=soft_deleted_table [id=7f6417f6e4c549b0967edc12b45fbec1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:17:41.592141 11102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f184ae5efb4641d9b6442c2a743f1f81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.592084 11170 tablet_service.cc:1511] Processing CreateTablet for tablet f184ae5efb4641d9b6442c2a743f1f81 (DEFAULT_TABLE table=soft_deleted_table [id=7f6417f6e4c549b0967edc12b45fbec1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:17:41.593632 11170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f184ae5efb4641d9b6442c2a743f1f81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.593904 11248 tablet_service.cc:1511] Processing CreateTablet for tablet f184ae5efb4641d9b6442c2a743f1f81 (DEFAULT_TABLE table=soft_deleted_table [id=7f6417f6e4c549b0967edc12b45fbec1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:17:41.595196 11248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f184ae5efb4641d9b6442c2a743f1f81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.595309 11103 tablet_service.cc:1511] Processing CreateTablet for tablet d0b8e0b882c143c5b45154837705e287 (DEFAULT_TABLE table=soft_deleted_table [id=7f6417f6e4c549b0967edc12b45fbec1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:17:41.596617 11103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0b8e0b882c143c5b45154837705e287. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.599038 11244 tablet_service.cc:1511] Processing CreateTablet for tablet d0b8e0b882c143c5b45154837705e287 (DEFAULT_TABLE table=soft_deleted_table [id=7f6417f6e4c549b0967edc12b45fbec1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:17:41.600368 11244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0b8e0b882c143c5b45154837705e287. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.602566 11174 tablet_service.cc:1511] Processing CreateTablet for tablet d0b8e0b882c143c5b45154837705e287 (DEFAULT_TABLE table=soft_deleted_table [id=7f6417f6e4c549b0967edc12b45fbec1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:17:41.603886 11174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0b8e0b882c143c5b45154837705e287. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.604576 11095 tablet_service.cc:1511] Processing CreateTablet for tablet 2bf72bd1b7f841189a36dc8e9cc20b4c (DEFAULT_TABLE table=soft_deleted_table [id=7f6417f6e4c549b0967edc12b45fbec1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:17:41.605885 11095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bf72bd1b7f841189a36dc8e9cc20b4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.608608 11098 tablet_service.cc:1511] Processing CreateTablet for tablet 6eab4df2be764be5b57dcd1fc08345fd (DEFAULT_TABLE table=soft_deleted_table [id=7f6417f6e4c549b0967edc12b45fbec1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:17:41.609921 11098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eab4df2be764be5b57dcd1fc08345fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.611876 11176 tablet_service.cc:1511] Processing CreateTablet for tablet 2bf72bd1b7f841189a36dc8e9cc20b4c (DEFAULT_TABLE table=soft_deleted_table [id=7f6417f6e4c549b0967edc12b45fbec1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:17:41.613756 11176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bf72bd1b7f841189a36dc8e9cc20b4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.614105 11251 tablet_service.cc:1511] Processing CreateTablet for tablet 2bf72bd1b7f841189a36dc8e9cc20b4c (DEFAULT_TABLE table=soft_deleted_table [id=7f6417f6e4c549b0967edc12b45fbec1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:17:41.616927 11178 tablet_service.cc:1511] Processing CreateTablet for tablet 6eab4df2be764be5b57dcd1fc08345fd (DEFAULT_TABLE table=soft_deleted_table [id=7f6417f6e4c549b0967edc12b45fbec1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:17:41.619673 11251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bf72bd1b7f841189a36dc8e9cc20b4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.620362 11178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eab4df2be764be5b57dcd1fc08345fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.628914 11250 tablet_service.cc:1511] Processing CreateTablet for tablet 6eab4df2be764be5b57dcd1fc08345fd (DEFAULT_TABLE table=soft_deleted_table [id=7f6417f6e4c549b0967edc12b45fbec1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:17:41.630367 11250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eab4df2be764be5b57dcd1fc08345fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.636153 11101 tablet_service.cc:1511] Processing CreateTablet for tablet 7aae7b1e191e428d9abcb7c76f088181 (DEFAULT_TABLE table=soft_deleted_table [id=7f6417f6e4c549b0967edc12b45fbec1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:17:41.637549 11101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7aae7b1e191e428d9abcb7c76f088181. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.638458 11173 tablet_service.cc:1511] Processing CreateTablet for tablet 7aae7b1e191e428d9abcb7c76f088181 (DEFAULT_TABLE table=soft_deleted_table [id=7f6417f6e4c549b0967edc12b45fbec1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:17:41.639854 11173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7aae7b1e191e428d9abcb7c76f088181. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.647604 11100 tablet_service.cc:1511] Processing CreateTablet for tablet 05b49fb53338498d94d1df63d6d809ef (DEFAULT_TABLE table=soft_deleted_table [id=7f6417f6e4c549b0967edc12b45fbec1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:17:41.647802 11249 tablet_service.cc:1511] Processing CreateTablet for tablet 7aae7b1e191e428d9abcb7c76f088181 (DEFAULT_TABLE table=soft_deleted_table [id=7f6417f6e4c549b0967edc12b45fbec1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:17:41.649042 11100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05b49fb53338498d94d1df63d6d809ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.649184 11249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7aae7b1e191e428d9abcb7c76f088181. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.659335 11171 tablet_service.cc:1511] Processing CreateTablet for tablet 05b49fb53338498d94d1df63d6d809ef (DEFAULT_TABLE table=soft_deleted_table [id=7f6417f6e4c549b0967edc12b45fbec1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:17:41.660907 11171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05b49fb53338498d94d1df63d6d809ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.678625 11252 tablet_service.cc:1511] Processing CreateTablet for tablet 05b49fb53338498d94d1df63d6d809ef (DEFAULT_TABLE table=soft_deleted_table [id=7f6417f6e4c549b0967edc12b45fbec1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:17:41.680231 11252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05b49fb53338498d94d1df63d6d809ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.681299 11096 tablet_service.cc:1511] Processing CreateTablet for tablet 1b8455bef8cb45b8b9cb5ff12454264f (DEFAULT_TABLE table=soft_deleted_table [id=7f6417f6e4c549b0967edc12b45fbec1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:17:41.682700 11096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b8455bef8cb45b8b9cb5ff12454264f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.683063 11245 tablet_service.cc:1511] Processing CreateTablet for tablet 1b8455bef8cb45b8b9cb5ff12454264f (DEFAULT_TABLE table=soft_deleted_table [id=7f6417f6e4c549b0967edc12b45fbec1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:17:41.685578 11245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b8455bef8cb45b8b9cb5ff12454264f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.689565 11246 tablet_service.cc:1511] Processing CreateTablet for tablet deff9c42898e48bdaa4575ff88e733a6 (DEFAULT_TABLE table=soft_deleted_table [id=7f6417f6e4c549b0967edc12b45fbec1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:17:41.690932 11246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deff9c42898e48bdaa4575ff88e733a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.693866 11175 tablet_service.cc:1511] Processing CreateTablet for tablet 1b8455bef8cb45b8b9cb5ff12454264f (DEFAULT_TABLE table=soft_deleted_table [id=7f6417f6e4c549b0967edc12b45fbec1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:17:41.694276 11177 tablet_service.cc:1511] Processing CreateTablet for tablet deff9c42898e48bdaa4575ff88e733a6 (DEFAULT_TABLE table=soft_deleted_table [id=7f6417f6e4c549b0967edc12b45fbec1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:17:41.695281 11175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b8455bef8cb45b8b9cb5ff12454264f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.700042 11177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deff9c42898e48bdaa4575ff88e733a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.728688 11095 tablet_service.cc:1511] Processing CreateTablet for tablet b4c4141fdaa04cffb06507e0010fefae (DEFAULT_TABLE table=soft_deleted_table [id=7f6417f6e4c549b0967edc12b45fbec1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:17:41.730263 11095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4c4141fdaa04cffb06507e0010fefae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.731521 11100 tablet_service.cc:1511] Processing CreateTablet for tablet deff9c42898e48bdaa4575ff88e733a6 (DEFAULT_TABLE table=soft_deleted_table [id=7f6417f6e4c549b0967edc12b45fbec1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:17:41.733942 11100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deff9c42898e48bdaa4575ff88e733a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.734977 11172 tablet_service.cc:1511] Processing CreateTablet for tablet b4c4141fdaa04cffb06507e0010fefae (DEFAULT_TABLE table=soft_deleted_table [id=7f6417f6e4c549b0967edc12b45fbec1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:17:41.740406 11172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4c4141fdaa04cffb06507e0010fefae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.740767 11400 tablet_bootstrap.cc:492] T f184ae5efb4641d9b6442c2a743f1f81 P ceb819e448e34d73b2cd02fdc2e3747c: Bootstrap starting.
I20260709 13:17:41.755507 11247 tablet_service.cc:1511] Processing CreateTablet for tablet b4c4141fdaa04cffb06507e0010fefae (DEFAULT_TABLE table=soft_deleted_table [id=7f6417f6e4c549b0967edc12b45fbec1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:17:41.757035 11247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4c4141fdaa04cffb06507e0010fefae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.780396 11401 tablet_bootstrap.cc:492] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e: Bootstrap starting.
I20260709 13:17:41.796239 11400 tablet_bootstrap.cc:654] T f184ae5efb4641d9b6442c2a743f1f81 P ceb819e448e34d73b2cd02fdc2e3747c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:41.801915 11401 tablet_bootstrap.cc:654] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:41.807250 11402 tablet_bootstrap.cc:492] T 6eab4df2be764be5b57dcd1fc08345fd P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Bootstrap starting.
I20260709 13:17:41.824190 11402 tablet_bootstrap.cc:654] T 6eab4df2be764be5b57dcd1fc08345fd P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:41.825479 11400 tablet_bootstrap.cc:492] T f184ae5efb4641d9b6442c2a743f1f81 P ceb819e448e34d73b2cd02fdc2e3747c: No bootstrap required, opened a new log
I20260709 13:17:41.826187 11400 ts_tablet_manager.cc:1403] T f184ae5efb4641d9b6442c2a743f1f81 P ceb819e448e34d73b2cd02fdc2e3747c: Time spent bootstrapping tablet: real 0.086s	user 0.008s	sys 0.020s
I20260709 13:17:41.831741 11400 raft_consensus.cc:359] T f184ae5efb4641d9b6442c2a743f1f81 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:41.833612 11400 raft_consensus.cc:385] T f184ae5efb4641d9b6442c2a743f1f81 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:41.833961 11400 raft_consensus.cc:740] T f184ae5efb4641d9b6442c2a743f1f81 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ceb819e448e34d73b2cd02fdc2e3747c, State: Initialized, Role: FOLLOWER
I20260709 13:17:41.834700 11400 consensus_queue.cc:260] T f184ae5efb4641d9b6442c2a743f1f81 P ceb819e448e34d73b2cd02fdc2e3747c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:41.835323 11401 tablet_bootstrap.cc:492] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e: No bootstrap required, opened a new log
I20260709 13:17:41.835947 11401 ts_tablet_manager.cc:1403] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e: Time spent bootstrapping tablet: real 0.056s	user 0.021s	sys 0.005s
I20260709 13:17:41.836700 11400 ts_tablet_manager.cc:1434] T f184ae5efb4641d9b6442c2a743f1f81 P ceb819e448e34d73b2cd02fdc2e3747c: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.002s
I20260709 13:17:41.837976 11400 tablet_bootstrap.cc:492] T 05b49fb53338498d94d1df63d6d809ef P ceb819e448e34d73b2cd02fdc2e3747c: Bootstrap starting.
I20260709 13:17:41.839195 11401 raft_consensus.cc:359] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:41.839993 11401 raft_consensus.cc:385] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:41.840265 11401 raft_consensus.cc:740] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e5b746c9d10411cb2e3948be2e9db1e, State: Initialized, Role: FOLLOWER
I20260709 13:17:41.841037 11401 consensus_queue.cc:260] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:41.842491 11402 tablet_bootstrap.cc:492] T 6eab4df2be764be5b57dcd1fc08345fd P 6fc0290ef4cf4ffa8c82c234ed04ff1d: No bootstrap required, opened a new log
I20260709 13:17:41.843089 11402 ts_tablet_manager.cc:1403] T 6eab4df2be764be5b57dcd1fc08345fd P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Time spent bootstrapping tablet: real 0.036s	user 0.008s	sys 0.010s
I20260709 13:17:41.843474 11401 ts_tablet_manager.cc:1434] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:17:41.844621 11401 tablet_bootstrap.cc:492] T deff9c42898e48bdaa4575ff88e733a6 P 7e5b746c9d10411cb2e3948be2e9db1e: Bootstrap starting.
I20260709 13:17:41.848191 11400 tablet_bootstrap.cc:654] T 05b49fb53338498d94d1df63d6d809ef P ceb819e448e34d73b2cd02fdc2e3747c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:41.849225 11402 raft_consensus.cc:359] T 6eab4df2be764be5b57dcd1fc08345fd P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:41.850147 11402 raft_consensus.cc:385] T 6eab4df2be764be5b57dcd1fc08345fd P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:41.850539 11402 raft_consensus.cc:740] T 6eab4df2be764be5b57dcd1fc08345fd P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fc0290ef4cf4ffa8c82c234ed04ff1d, State: Initialized, Role: FOLLOWER
I20260709 13:17:41.851672 11401 tablet_bootstrap.cc:654] T deff9c42898e48bdaa4575ff88e733a6 P 7e5b746c9d10411cb2e3948be2e9db1e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:41.851573 11402 consensus_queue.cc:260] T 6eab4df2be764be5b57dcd1fc08345fd P 6fc0290ef4cf4ffa8c82c234ed04ff1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
W20260709 13:17:41.853329 11059 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:41.859202 11402 ts_tablet_manager.cc:1434] T 6eab4df2be764be5b57dcd1fc08345fd P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:17:41.860859 11402 tablet_bootstrap.cc:492] T f184ae5efb4641d9b6442c2a743f1f81 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Bootstrap starting.
I20260709 13:17:41.870584 11402 tablet_bootstrap.cc:654] T f184ae5efb4641d9b6442c2a743f1f81 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:41.882293 11401 tablet_bootstrap.cc:492] T deff9c42898e48bdaa4575ff88e733a6 P 7e5b746c9d10411cb2e3948be2e9db1e: No bootstrap required, opened a new log
I20260709 13:17:41.882884 11401 ts_tablet_manager.cc:1403] T deff9c42898e48bdaa4575ff88e733a6 P 7e5b746c9d10411cb2e3948be2e9db1e: Time spent bootstrapping tablet: real 0.038s	user 0.023s	sys 0.012s
I20260709 13:17:41.885731 11400 tablet_bootstrap.cc:492] T 05b49fb53338498d94d1df63d6d809ef P ceb819e448e34d73b2cd02fdc2e3747c: No bootstrap required, opened a new log
I20260709 13:17:41.886353 11402 tablet_bootstrap.cc:492] T f184ae5efb4641d9b6442c2a743f1f81 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: No bootstrap required, opened a new log
I20260709 13:17:41.886353 11400 ts_tablet_manager.cc:1403] T 05b49fb53338498d94d1df63d6d809ef P ceb819e448e34d73b2cd02fdc2e3747c: Time spent bootstrapping tablet: real 0.049s	user 0.020s	sys 0.020s
I20260709 13:17:41.886179 11401 raft_consensus.cc:359] T deff9c42898e48bdaa4575ff88e733a6 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:41.887104 11401 raft_consensus.cc:385] T deff9c42898e48bdaa4575ff88e733a6 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:41.887413 11402 ts_tablet_manager.cc:1403] T f184ae5efb4641d9b6442c2a743f1f81 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.000s
I20260709 13:17:41.887421 11401 raft_consensus.cc:740] T deff9c42898e48bdaa4575ff88e733a6 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e5b746c9d10411cb2e3948be2e9db1e, State: Initialized, Role: FOLLOWER
I20260709 13:17:41.888540 11401 consensus_queue.cc:260] T deff9c42898e48bdaa4575ff88e733a6 P 7e5b746c9d10411cb2e3948be2e9db1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:41.890201 11400 raft_consensus.cc:359] T 05b49fb53338498d94d1df63d6d809ef P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:41.890926 11400 raft_consensus.cc:385] T 05b49fb53338498d94d1df63d6d809ef P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:41.891122 11401 ts_tablet_manager.cc:1434] T deff9c42898e48bdaa4575ff88e733a6 P 7e5b746c9d10411cb2e3948be2e9db1e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:17:41.891213 11400 raft_consensus.cc:740] T 05b49fb53338498d94d1df63d6d809ef P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ceb819e448e34d73b2cd02fdc2e3747c, State: Initialized, Role: FOLLOWER
I20260709 13:17:41.892264 11401 tablet_bootstrap.cc:492] T 1b8455bef8cb45b8b9cb5ff12454264f P 7e5b746c9d10411cb2e3948be2e9db1e: Bootstrap starting.
I20260709 13:17:41.892289 11400 consensus_queue.cc:260] T 05b49fb53338498d94d1df63d6d809ef P ceb819e448e34d73b2cd02fdc2e3747c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:41.895156 11400 ts_tablet_manager.cc:1434] T 05b49fb53338498d94d1df63d6d809ef P ceb819e448e34d73b2cd02fdc2e3747c: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:17:41.896190 11400 tablet_bootstrap.cc:492] T d0b8e0b882c143c5b45154837705e287 P ceb819e448e34d73b2cd02fdc2e3747c: Bootstrap starting.
I20260709 13:17:41.892961 11402 raft_consensus.cc:359] T f184ae5efb4641d9b6442c2a743f1f81 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:41.900074 11402 raft_consensus.cc:385] T f184ae5efb4641d9b6442c2a743f1f81 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:41.900451 11402 raft_consensus.cc:740] T f184ae5efb4641d9b6442c2a743f1f81 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fc0290ef4cf4ffa8c82c234ed04ff1d, State: Initialized, Role: FOLLOWER
I20260709 13:17:41.901304 11402 consensus_queue.cc:260] T f184ae5efb4641d9b6442c2a743f1f81 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:41.903252 11402 ts_tablet_manager.cc:1434] T f184ae5efb4641d9b6442c2a743f1f81 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.002s
I20260709 13:17:41.903406 11400 tablet_bootstrap.cc:654] T d0b8e0b882c143c5b45154837705e287 P ceb819e448e34d73b2cd02fdc2e3747c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:41.904539 11402 tablet_bootstrap.cc:492] T 05b49fb53338498d94d1df63d6d809ef P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Bootstrap starting.
I20260709 13:17:41.906163 11401 tablet_bootstrap.cc:654] T 1b8455bef8cb45b8b9cb5ff12454264f P 7e5b746c9d10411cb2e3948be2e9db1e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:41.915689 11400 tablet_bootstrap.cc:492] T d0b8e0b882c143c5b45154837705e287 P ceb819e448e34d73b2cd02fdc2e3747c: No bootstrap required, opened a new log
I20260709 13:17:41.916318 11400 ts_tablet_manager.cc:1403] T d0b8e0b882c143c5b45154837705e287 P ceb819e448e34d73b2cd02fdc2e3747c: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.007s
I20260709 13:17:41.918247 11401 tablet_bootstrap.cc:492] T 1b8455bef8cb45b8b9cb5ff12454264f P 7e5b746c9d10411cb2e3948be2e9db1e: No bootstrap required, opened a new log
I20260709 13:17:41.918802 11402 tablet_bootstrap.cc:654] T 05b49fb53338498d94d1df63d6d809ef P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:41.918838 11401 ts_tablet_manager.cc:1403] T 1b8455bef8cb45b8b9cb5ff12454264f P 7e5b746c9d10411cb2e3948be2e9db1e: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.000s
I20260709 13:17:41.919791 11400 raft_consensus.cc:359] T d0b8e0b882c143c5b45154837705e287 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:41.920581 11400 raft_consensus.cc:385] T d0b8e0b882c143c5b45154837705e287 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:41.920898 11400 raft_consensus.cc:740] T d0b8e0b882c143c5b45154837705e287 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ceb819e448e34d73b2cd02fdc2e3747c, State: Initialized, Role: FOLLOWER
I20260709 13:17:41.921669 11400 consensus_queue.cc:260] T d0b8e0b882c143c5b45154837705e287 P ceb819e448e34d73b2cd02fdc2e3747c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:41.922688 11401 raft_consensus.cc:359] T 1b8455bef8cb45b8b9cb5ff12454264f P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:41.923374 11401 raft_consensus.cc:385] T 1b8455bef8cb45b8b9cb5ff12454264f P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:41.923684 11401 raft_consensus.cc:740] T 1b8455bef8cb45b8b9cb5ff12454264f P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e5b746c9d10411cb2e3948be2e9db1e, State: Initialized, Role: FOLLOWER
I20260709 13:17:41.924022 11400 ts_tablet_manager.cc:1434] T d0b8e0b882c143c5b45154837705e287 P ceb819e448e34d73b2cd02fdc2e3747c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:17:41.925014 11400 tablet_bootstrap.cc:492] T 2bf72bd1b7f841189a36dc8e9cc20b4c P ceb819e448e34d73b2cd02fdc2e3747c: Bootstrap starting.
I20260709 13:17:41.924379 11401 consensus_queue.cc:260] T 1b8455bef8cb45b8b9cb5ff12454264f P 7e5b746c9d10411cb2e3948be2e9db1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:41.928506 11401 ts_tablet_manager.cc:1434] T 1b8455bef8cb45b8b9cb5ff12454264f P 7e5b746c9d10411cb2e3948be2e9db1e: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 13:17:41.932214 11401 tablet_bootstrap.cc:492] T f184ae5efb4641d9b6442c2a743f1f81 P 7e5b746c9d10411cb2e3948be2e9db1e: Bootstrap starting.
I20260709 13:17:41.932953 11400 tablet_bootstrap.cc:654] T 2bf72bd1b7f841189a36dc8e9cc20b4c P ceb819e448e34d73b2cd02fdc2e3747c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:41.942013 11401 tablet_bootstrap.cc:654] T f184ae5efb4641d9b6442c2a743f1f81 P 7e5b746c9d10411cb2e3948be2e9db1e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:41.945206 11400 tablet_bootstrap.cc:492] T 2bf72bd1b7f841189a36dc8e9cc20b4c P ceb819e448e34d73b2cd02fdc2e3747c: No bootstrap required, opened a new log
I20260709 13:17:41.945802 11400 ts_tablet_manager.cc:1403] T 2bf72bd1b7f841189a36dc8e9cc20b4c P ceb819e448e34d73b2cd02fdc2e3747c: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.009s
I20260709 13:17:41.951077 11400 raft_consensus.cc:359] T 2bf72bd1b7f841189a36dc8e9cc20b4c P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:41.951928 11400 raft_consensus.cc:385] T 2bf72bd1b7f841189a36dc8e9cc20b4c P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:41.952250 11400 raft_consensus.cc:740] T 2bf72bd1b7f841189a36dc8e9cc20b4c P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ceb819e448e34d73b2cd02fdc2e3747c, State: Initialized, Role: FOLLOWER
I20260709 13:17:41.953300 11400 consensus_queue.cc:260] T 2bf72bd1b7f841189a36dc8e9cc20b4c P ceb819e448e34d73b2cd02fdc2e3747c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:41.956818 11400 ts_tablet_manager.cc:1434] T 2bf72bd1b7f841189a36dc8e9cc20b4c P ceb819e448e34d73b2cd02fdc2e3747c: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.003s
I20260709 13:17:41.957682 11305 raft_consensus.cc:493] T f184ae5efb4641d9b6442c2a743f1f81 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.958593 11305 raft_consensus.cc:515] T f184ae5efb4641d9b6442c2a743f1f81 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:41.959280 11400 tablet_bootstrap.cc:492] T 7aae7b1e191e428d9abcb7c76f088181 P ceb819e448e34d73b2cd02fdc2e3747c: Bootstrap starting.
I20260709 13:17:41.961899 11112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f184ae5efb4641d9b6442c2a743f1f81" candidate_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" is_pre_election: true
I20260709 13:17:41.962751 11112 raft_consensus.cc:2468] T f184ae5efb4641d9b6442c2a743f1f81 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fc0290ef4cf4ffa8c82c234ed04ff1d in term 0.
I20260709 13:17:41.964066 11151 leader_election.cc:304] T f184ae5efb4641d9b6442c2a743f1f81 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, ceb819e448e34d73b2cd02fdc2e3747c; no voters: 
I20260709 13:17:41.964972 11261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f184ae5efb4641d9b6442c2a743f1f81" candidate_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" is_pre_election: true
I20260709 13:17:41.962080 11305 leader_election.cc:290] T f184ae5efb4641d9b6442c2a743f1f81 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195:33049)
W20260709 13:17:41.967468 11154 leader_election.cc:343] T f184ae5efb4641d9b6442c2a743f1f81 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195:33049): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:41.969143 11305 raft_consensus.cc:2804] T f184ae5efb4641d9b6442c2a743f1f81 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:41.969790 11305 raft_consensus.cc:493] T f184ae5efb4641d9b6442c2a743f1f81 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:41.970316 11305 raft_consensus.cc:3060] T f184ae5efb4641d9b6442c2a743f1f81 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:41.976286 11400 tablet_bootstrap.cc:654] T 7aae7b1e191e428d9abcb7c76f088181 P ceb819e448e34d73b2cd02fdc2e3747c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:41.978097 11402 tablet_bootstrap.cc:492] T 05b49fb53338498d94d1df63d6d809ef P 6fc0290ef4cf4ffa8c82c234ed04ff1d: No bootstrap required, opened a new log
I20260709 13:17:41.978873 11402 ts_tablet_manager.cc:1403] T 05b49fb53338498d94d1df63d6d809ef P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Time spent bootstrapping tablet: real 0.075s	user 0.015s	sys 0.027s
I20260709 13:17:41.989845 11402 raft_consensus.cc:359] T 05b49fb53338498d94d1df63d6d809ef P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:41.990655 11402 raft_consensus.cc:385] T 05b49fb53338498d94d1df63d6d809ef P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:41.990949 11402 raft_consensus.cc:740] T 05b49fb53338498d94d1df63d6d809ef P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fc0290ef4cf4ffa8c82c234ed04ff1d, State: Initialized, Role: FOLLOWER
I20260709 13:17:41.991735 11402 consensus_queue.cc:260] T 05b49fb53338498d94d1df63d6d809ef P 6fc0290ef4cf4ffa8c82c234ed04ff1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:41.992036 11305 raft_consensus.cc:515] T f184ae5efb4641d9b6442c2a743f1f81 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:41.994325 11402 ts_tablet_manager.cc:1434] T 05b49fb53338498d94d1df63d6d809ef P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.004s
I20260709 13:17:41.995447 11112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f184ae5efb4641d9b6442c2a743f1f81" candidate_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c"
I20260709 13:17:41.996129 11112 raft_consensus.cc:3060] T f184ae5efb4641d9b6442c2a743f1f81 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:41.996574 11401 tablet_bootstrap.cc:492] T f184ae5efb4641d9b6442c2a743f1f81 P 7e5b746c9d10411cb2e3948be2e9db1e: No bootstrap required, opened a new log
I20260709 13:17:41.997161 11401 ts_tablet_manager.cc:1403] T f184ae5efb4641d9b6442c2a743f1f81 P 7e5b746c9d10411cb2e3948be2e9db1e: Time spent bootstrapping tablet: real 0.065s	user 0.024s	sys 0.013s
I20260709 13:17:42.000244 11401 raft_consensus.cc:359] T f184ae5efb4641d9b6442c2a743f1f81 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.000923 11401 raft_consensus.cc:385] T f184ae5efb4641d9b6442c2a743f1f81 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:42.001190 11401 raft_consensus.cc:740] T f184ae5efb4641d9b6442c2a743f1f81 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e5b746c9d10411cb2e3948be2e9db1e, State: Initialized, Role: FOLLOWER
I20260709 13:17:42.001907 11401 consensus_queue.cc:260] T f184ae5efb4641d9b6442c2a743f1f81 P 7e5b746c9d10411cb2e3948be2e9db1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.003826 11402 tablet_bootstrap.cc:492] T deff9c42898e48bdaa4575ff88e733a6 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Bootstrap starting.
I20260709 13:17:42.004077 11112 raft_consensus.cc:2468] T f184ae5efb4641d9b6442c2a743f1f81 P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fc0290ef4cf4ffa8c82c234ed04ff1d in term 1.
I20260709 13:17:42.006511 11261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f184ae5efb4641d9b6442c2a743f1f81" candidate_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e"
I20260709 13:17:42.007082 11261 raft_consensus.cc:3060] T f184ae5efb4641d9b6442c2a743f1f81 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.015304 11261 raft_consensus.cc:2468] T f184ae5efb4641d9b6442c2a743f1f81 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fc0290ef4cf4ffa8c82c234ed04ff1d in term 1.
I20260709 13:17:42.016547 11154 leader_election.cc:304] T f184ae5efb4641d9b6442c2a743f1f81 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, 7e5b746c9d10411cb2e3948be2e9db1e; no voters: 
I20260709 13:17:42.017151 11402 tablet_bootstrap.cc:654] T deff9c42898e48bdaa4575ff88e733a6 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:42.020102 11414 raft_consensus.cc:2804] T f184ae5efb4641d9b6442c2a743f1f81 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:42.020814 11401 ts_tablet_manager.cc:1434] T f184ae5efb4641d9b6442c2a743f1f81 P 7e5b746c9d10411cb2e3948be2e9db1e: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:17:42.022261 11401 tablet_bootstrap.cc:492] T 05b49fb53338498d94d1df63d6d809ef P 7e5b746c9d10411cb2e3948be2e9db1e: Bootstrap starting.
I20260709 13:17:42.022375 11305 leader_election.cc:290] T f184ae5efb4641d9b6442c2a743f1f81 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 1 election: Requested vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195:33049)
I20260709 13:17:42.021270 11414 raft_consensus.cc:697] T f184ae5efb4641d9b6442c2a743f1f81 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 LEADER]: Becoming Leader. State: Replica: 6fc0290ef4cf4ffa8c82c234ed04ff1d, State: Running, Role: LEADER
I20260709 13:17:42.028486 11414 consensus_queue.cc:237] T f184ae5efb4641d9b6442c2a743f1f81 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.033962 11401 tablet_bootstrap.cc:654] T 05b49fb53338498d94d1df63d6d809ef P 7e5b746c9d10411cb2e3948be2e9db1e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:42.033977 11400 tablet_bootstrap.cc:492] T 7aae7b1e191e428d9abcb7c76f088181 P ceb819e448e34d73b2cd02fdc2e3747c: No bootstrap required, opened a new log
I20260709 13:17:42.036139 11400 ts_tablet_manager.cc:1403] T 7aae7b1e191e428d9abcb7c76f088181 P ceb819e448e34d73b2cd02fdc2e3747c: Time spent bootstrapping tablet: real 0.077s	user 0.017s	sys 0.030s
I20260709 13:17:42.046015 11011 catalog_manager.cc:5697] T f184ae5efb4641d9b6442c2a743f1f81 P 6fc0290ef4cf4ffa8c82c234ed04ff1d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194). New cstate: current_term: 1 leader_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:42.047596 11401 tablet_bootstrap.cc:492] T 05b49fb53338498d94d1df63d6d809ef P 7e5b746c9d10411cb2e3948be2e9db1e: No bootstrap required, opened a new log
I20260709 13:17:42.048167 11401 ts_tablet_manager.cc:1403] T 05b49fb53338498d94d1df63d6d809ef P 7e5b746c9d10411cb2e3948be2e9db1e: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.003s
I20260709 13:17:42.048045 11400 raft_consensus.cc:359] T 7aae7b1e191e428d9abcb7c76f088181 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.048882 11400 raft_consensus.cc:385] T 7aae7b1e191e428d9abcb7c76f088181 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:42.049212 11400 raft_consensus.cc:740] T 7aae7b1e191e428d9abcb7c76f088181 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ceb819e448e34d73b2cd02fdc2e3747c, State: Initialized, Role: FOLLOWER
I20260709 13:17:42.050005 11400 consensus_queue.cc:260] T 7aae7b1e191e428d9abcb7c76f088181 P ceb819e448e34d73b2cd02fdc2e3747c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.051452 11401 raft_consensus.cc:359] T 05b49fb53338498d94d1df63d6d809ef P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.052214 11401 raft_consensus.cc:385] T 05b49fb53338498d94d1df63d6d809ef P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:42.052527 11400 ts_tablet_manager.cc:1434] T 7aae7b1e191e428d9abcb7c76f088181 P ceb819e448e34d73b2cd02fdc2e3747c: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.001s
I20260709 13:17:42.052500 11401 raft_consensus.cc:740] T 05b49fb53338498d94d1df63d6d809ef P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e5b746c9d10411cb2e3948be2e9db1e, State: Initialized, Role: FOLLOWER
I20260709 13:17:42.053900 11401 consensus_queue.cc:260] T 05b49fb53338498d94d1df63d6d809ef P 7e5b746c9d10411cb2e3948be2e9db1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.054850 11402 tablet_bootstrap.cc:492] T deff9c42898e48bdaa4575ff88e733a6 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: No bootstrap required, opened a new log
I20260709 13:17:42.055398 11402 ts_tablet_manager.cc:1403] T deff9c42898e48bdaa4575ff88e733a6 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.004s
I20260709 13:17:42.056401 11401 ts_tablet_manager.cc:1434] T 05b49fb53338498d94d1df63d6d809ef P 7e5b746c9d10411cb2e3948be2e9db1e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:17:42.057531 11401 tablet_bootstrap.cc:492] T 6eab4df2be764be5b57dcd1fc08345fd P 7e5b746c9d10411cb2e3948be2e9db1e: Bootstrap starting.
I20260709 13:17:42.058869 11388 raft_consensus.cc:493] T 1b8455bef8cb45b8b9cb5ff12454264f P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.058643 11402 raft_consensus.cc:359] T deff9c42898e48bdaa4575ff88e733a6 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.059465 11402 raft_consensus.cc:385] T deff9c42898e48bdaa4575ff88e733a6 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:42.059399 11388 raft_consensus.cc:515] T 1b8455bef8cb45b8b9cb5ff12454264f P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.059847 11402 raft_consensus.cc:740] T deff9c42898e48bdaa4575ff88e733a6 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fc0290ef4cf4ffa8c82c234ed04ff1d, State: Initialized, Role: FOLLOWER
I20260709 13:17:42.060636 11402 consensus_queue.cc:260] T deff9c42898e48bdaa4575ff88e733a6 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.061685 11388 leader_election.cc:290] T 1b8455bef8cb45b8b9cb5ff12454264f P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941)
I20260709 13:17:42.063086 11402 ts_tablet_manager.cc:1434] T deff9c42898e48bdaa4575ff88e733a6 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:17:42.073205 11402 tablet_bootstrap.cc:492] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Bootstrap starting.
I20260709 13:17:42.063956 11400 tablet_bootstrap.cc:492] T 6eab4df2be764be5b57dcd1fc08345fd P ceb819e448e34d73b2cd02fdc2e3747c: Bootstrap starting.
I20260709 13:17:42.064169 11187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8455bef8cb45b8b9cb5ff12454264f" candidate_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" is_pre_election: true
I20260709 13:17:42.065078 11112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8455bef8cb45b8b9cb5ff12454264f" candidate_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" is_pre_election: true
I20260709 13:17:42.067786 11401 tablet_bootstrap.cc:654] T 6eab4df2be764be5b57dcd1fc08345fd P 7e5b746c9d10411cb2e3948be2e9db1e: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:42.080163 11225 leader_election.cc:343] T 1b8455bef8cb45b8b9cb5ff12454264f P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:42.081027 11225 leader_election.cc:343] T 1b8455bef8cb45b8b9cb5ff12454264f P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:42.081441 11225 leader_election.cc:304] T 1b8455bef8cb45b8b9cb5ff12454264f P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e5b746c9d10411cb2e3948be2e9db1e; no voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, ceb819e448e34d73b2cd02fdc2e3747c
I20260709 13:17:42.082930 11388 raft_consensus.cc:2749] T 1b8455bef8cb45b8b9cb5ff12454264f P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:42.088501 11402 tablet_bootstrap.cc:654] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:42.091518 11401 tablet_bootstrap.cc:492] T 6eab4df2be764be5b57dcd1fc08345fd P 7e5b746c9d10411cb2e3948be2e9db1e: No bootstrap required, opened a new log
I20260709 13:17:42.092299 11401 ts_tablet_manager.cc:1403] T 6eab4df2be764be5b57dcd1fc08345fd P 7e5b746c9d10411cb2e3948be2e9db1e: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.007s
I20260709 13:17:42.096200 11401 raft_consensus.cc:359] T 6eab4df2be764be5b57dcd1fc08345fd P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.097517 11401 raft_consensus.cc:385] T 6eab4df2be764be5b57dcd1fc08345fd P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:42.097765 11400 tablet_bootstrap.cc:654] T 6eab4df2be764be5b57dcd1fc08345fd P ceb819e448e34d73b2cd02fdc2e3747c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:42.097806 11401 raft_consensus.cc:740] T 6eab4df2be764be5b57dcd1fc08345fd P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e5b746c9d10411cb2e3948be2e9db1e, State: Initialized, Role: FOLLOWER
I20260709 13:17:42.098966 11401 consensus_queue.cc:260] T 6eab4df2be764be5b57dcd1fc08345fd P 7e5b746c9d10411cb2e3948be2e9db1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.099965 11402 tablet_bootstrap.cc:492] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 6fc0290ef4cf4ffa8c82c234ed04ff1d: No bootstrap required, opened a new log
I20260709 13:17:42.100620 11402 ts_tablet_manager.cc:1403] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.005s
I20260709 13:17:42.101559 11401 ts_tablet_manager.cc:1434] T 6eab4df2be764be5b57dcd1fc08345fd P 7e5b746c9d10411cb2e3948be2e9db1e: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:17:42.103125 11401 tablet_bootstrap.cc:492] T b4c4141fdaa04cffb06507e0010fefae P 7e5b746c9d10411cb2e3948be2e9db1e: Bootstrap starting.
I20260709 13:17:42.103875 11402 raft_consensus.cc:359] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.104768 11402 raft_consensus.cc:385] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:42.105057 11402 raft_consensus.cc:740] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fc0290ef4cf4ffa8c82c234ed04ff1d, State: Initialized, Role: FOLLOWER
I20260709 13:17:42.105896 11402 consensus_queue.cc:260] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 6fc0290ef4cf4ffa8c82c234ed04ff1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.108785 11402 ts_tablet_manager.cc:1434] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:17:42.109896 11402 tablet_bootstrap.cc:492] T 7aae7b1e191e428d9abcb7c76f088181 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Bootstrap starting.
I20260709 13:17:42.110430 11400 tablet_bootstrap.cc:492] T 6eab4df2be764be5b57dcd1fc08345fd P ceb819e448e34d73b2cd02fdc2e3747c: No bootstrap required, opened a new log
I20260709 13:17:42.110994 11400 ts_tablet_manager.cc:1403] T 6eab4df2be764be5b57dcd1fc08345fd P ceb819e448e34d73b2cd02fdc2e3747c: Time spent bootstrapping tablet: real 0.047s	user 0.012s	sys 0.006s
I20260709 13:17:42.111563 11401 tablet_bootstrap.cc:654] T b4c4141fdaa04cffb06507e0010fefae P 7e5b746c9d10411cb2e3948be2e9db1e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:42.114306 11416 raft_consensus.cc:493] T deff9c42898e48bdaa4575ff88e733a6 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.114830 11416 raft_consensus.cc:515] T deff9c42898e48bdaa4575ff88e733a6 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.118253 11402 tablet_bootstrap.cc:654] T 7aae7b1e191e428d9abcb7c76f088181 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:42.119177 11260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deff9c42898e48bdaa4575ff88e733a6" candidate_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" is_pre_election: true
I20260709 13:17:42.119911 11260 raft_consensus.cc:2468] T deff9c42898e48bdaa4575ff88e733a6 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fc0290ef4cf4ffa8c82c234ed04ff1d in term 0.
I20260709 13:17:42.120932 11112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deff9c42898e48bdaa4575ff88e733a6" candidate_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" is_pre_election: true
W20260709 13:17:42.122457 11151 leader_election.cc:343] T deff9c42898e48bdaa4575ff88e733a6 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:42.123469 11416 leader_election.cc:290] T deff9c42898e48bdaa4575ff88e733a6 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195:33049)
I20260709 13:17:42.123524 11154 leader_election.cc:304] T deff9c42898e48bdaa4575ff88e733a6 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, 7e5b746c9d10411cb2e3948be2e9db1e; no voters: ceb819e448e34d73b2cd02fdc2e3747c
I20260709 13:17:42.124724 11416 raft_consensus.cc:2804] T deff9c42898e48bdaa4575ff88e733a6 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:42.125109 11416 raft_consensus.cc:493] T deff9c42898e48bdaa4575ff88e733a6 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.125473 11416 raft_consensus.cc:3060] T deff9c42898e48bdaa4575ff88e733a6 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.127260 11401 tablet_bootstrap.cc:492] T b4c4141fdaa04cffb06507e0010fefae P 7e5b746c9d10411cb2e3948be2e9db1e: No bootstrap required, opened a new log
I20260709 13:17:42.127900 11401 ts_tablet_manager.cc:1403] T b4c4141fdaa04cffb06507e0010fefae P 7e5b746c9d10411cb2e3948be2e9db1e: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.006s
I20260709 13:17:42.129770 11402 tablet_bootstrap.cc:492] T 7aae7b1e191e428d9abcb7c76f088181 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: No bootstrap required, opened a new log
I20260709 13:17:42.130299 11402 ts_tablet_manager.cc:1403] T 7aae7b1e191e428d9abcb7c76f088181 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.005s
I20260709 13:17:42.131275 11401 raft_consensus.cc:359] T b4c4141fdaa04cffb06507e0010fefae P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.132098 11401 raft_consensus.cc:385] T b4c4141fdaa04cffb06507e0010fefae P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:42.132388 11401 raft_consensus.cc:740] T b4c4141fdaa04cffb06507e0010fefae P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e5b746c9d10411cb2e3948be2e9db1e, State: Initialized, Role: FOLLOWER
I20260709 13:17:42.133301 11401 consensus_queue.cc:260] T b4c4141fdaa04cffb06507e0010fefae P 7e5b746c9d10411cb2e3948be2e9db1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.133450 11402 raft_consensus.cc:359] T 7aae7b1e191e428d9abcb7c76f088181 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.134181 11402 raft_consensus.cc:385] T 7aae7b1e191e428d9abcb7c76f088181 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:42.133965 11416 raft_consensus.cc:515] T deff9c42898e48bdaa4575ff88e733a6 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.134527 11402 raft_consensus.cc:740] T 7aae7b1e191e428d9abcb7c76f088181 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fc0290ef4cf4ffa8c82c234ed04ff1d, State: Initialized, Role: FOLLOWER
I20260709 13:17:42.124442 11400 raft_consensus.cc:359] T 6eab4df2be764be5b57dcd1fc08345fd P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.135864 11401 ts_tablet_manager.cc:1434] T b4c4141fdaa04cffb06507e0010fefae P 7e5b746c9d10411cb2e3948be2e9db1e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:17:42.135427 11402 consensus_queue.cc:260] T 7aae7b1e191e428d9abcb7c76f088181 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.136044 11400 raft_consensus.cc:385] T 6eab4df2be764be5b57dcd1fc08345fd P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:42.136430 11400 raft_consensus.cc:740] T 6eab4df2be764be5b57dcd1fc08345fd P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ceb819e448e34d73b2cd02fdc2e3747c, State: Initialized, Role: FOLLOWER
I20260709 13:17:42.137007 11401 tablet_bootstrap.cc:492] T 7aae7b1e191e428d9abcb7c76f088181 P 7e5b746c9d10411cb2e3948be2e9db1e: Bootstrap starting.
I20260709 13:17:42.137179 11400 consensus_queue.cc:260] T 6eab4df2be764be5b57dcd1fc08345fd P ceb819e448e34d73b2cd02fdc2e3747c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.138239 11402 ts_tablet_manager.cc:1434] T 7aae7b1e191e428d9abcb7c76f088181 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:17:42.139385 11402 tablet_bootstrap.cc:492] T 1b8455bef8cb45b8b9cb5ff12454264f P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Bootstrap starting.
I20260709 13:17:42.139763 11400 ts_tablet_manager.cc:1434] T 6eab4df2be764be5b57dcd1fc08345fd P ceb819e448e34d73b2cd02fdc2e3747c: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.000s
I20260709 13:17:42.140898 11400 tablet_bootstrap.cc:492] T 1b8455bef8cb45b8b9cb5ff12454264f P ceb819e448e34d73b2cd02fdc2e3747c: Bootstrap starting.
I20260709 13:17:42.147111 11401 tablet_bootstrap.cc:654] T 7aae7b1e191e428d9abcb7c76f088181 P 7e5b746c9d10411cb2e3948be2e9db1e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:42.150715 11112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deff9c42898e48bdaa4575ff88e733a6" candidate_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c"
W20260709 13:17:42.152287 11151 leader_election.cc:343] T deff9c42898e48bdaa4575ff88e733a6 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:42.154507 11260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deff9c42898e48bdaa4575ff88e733a6" candidate_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e"
I20260709 13:17:42.155117 11260 raft_consensus.cc:3060] T deff9c42898e48bdaa4575ff88e733a6 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.159395 11401 tablet_bootstrap.cc:492] T 7aae7b1e191e428d9abcb7c76f088181 P 7e5b746c9d10411cb2e3948be2e9db1e: No bootstrap required, opened a new log
I20260709 13:17:42.160041 11401 ts_tablet_manager.cc:1403] T 7aae7b1e191e428d9abcb7c76f088181 P 7e5b746c9d10411cb2e3948be2e9db1e: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.012s
I20260709 13:17:42.161518 11402 tablet_bootstrap.cc:654] T 1b8455bef8cb45b8b9cb5ff12454264f P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:42.163257 11401 raft_consensus.cc:359] T 7aae7b1e191e428d9abcb7c76f088181 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.164083 11401 raft_consensus.cc:385] T 7aae7b1e191e428d9abcb7c76f088181 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:42.164364 11401 raft_consensus.cc:740] T 7aae7b1e191e428d9abcb7c76f088181 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e5b746c9d10411cb2e3948be2e9db1e, State: Initialized, Role: FOLLOWER
I20260709 13:17:42.165267 11401 consensus_queue.cc:260] T 7aae7b1e191e428d9abcb7c76f088181 P 7e5b746c9d10411cb2e3948be2e9db1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.168465 11401 ts_tablet_manager.cc:1434] T 7aae7b1e191e428d9abcb7c76f088181 P 7e5b746c9d10411cb2e3948be2e9db1e: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:17:42.169826 11401 tablet_bootstrap.cc:492] T d0b8e0b882c143c5b45154837705e287 P 7e5b746c9d10411cb2e3948be2e9db1e: Bootstrap starting.
I20260709 13:17:42.170961 11378 raft_consensus.cc:493] T d0b8e0b882c143c5b45154837705e287 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.171527 11378 raft_consensus.cc:515] T d0b8e0b882c143c5b45154837705e287 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.173838 11378 leader_election.cc:290] T d0b8e0b882c143c5b45154837705e287 P ceb819e448e34d73b2cd02fdc2e3747c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941), 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195:33049)
I20260709 13:17:42.175612 11261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b8e0b882c143c5b45154837705e287" candidate_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" is_pre_election: true
I20260709 13:17:42.176194 11416 leader_election.cc:290] T deff9c42898e48bdaa4575ff88e733a6 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 1 election: Requested vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195:33049)
I20260709 13:17:42.170943 11260 raft_consensus.cc:2468] T deff9c42898e48bdaa4575ff88e733a6 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fc0290ef4cf4ffa8c82c234ed04ff1d in term 1.
I20260709 13:17:42.177053 11187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b8e0b882c143c5b45154837705e287" candidate_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" is_pre_election: true
I20260709 13:17:42.178081 11154 leader_election.cc:304] T deff9c42898e48bdaa4575ff88e733a6 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, 7e5b746c9d10411cb2e3948be2e9db1e; no voters: ceb819e448e34d73b2cd02fdc2e3747c
W20260709 13:17:42.179013 11076 leader_election.cc:343] T d0b8e0b882c143c5b45154837705e287 P ceb819e448e34d73b2cd02fdc2e3747c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:42.179273 11416 raft_consensus.cc:2804] T deff9c42898e48bdaa4575ff88e733a6 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:17:42.180299 11079 leader_election.cc:343] T d0b8e0b882c143c5b45154837705e287 P ceb819e448e34d73b2cd02fdc2e3747c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195:33049): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:42.180770 11079 leader_election.cc:304] T d0b8e0b882c143c5b45154837705e287 P ceb819e448e34d73b2cd02fdc2e3747c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb819e448e34d73b2cd02fdc2e3747c; no voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, 7e5b746c9d10411cb2e3948be2e9db1e
I20260709 13:17:42.181914 11378 raft_consensus.cc:2749] T d0b8e0b882c143c5b45154837705e287 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:42.183075 11416 raft_consensus.cc:697] T deff9c42898e48bdaa4575ff88e733a6 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 LEADER]: Becoming Leader. State: Replica: 6fc0290ef4cf4ffa8c82c234ed04ff1d, State: Running, Role: LEADER
I20260709 13:17:42.183750 11401 tablet_bootstrap.cc:654] T d0b8e0b882c143c5b45154837705e287 P 7e5b746c9d10411cb2e3948be2e9db1e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:42.184099 11416 consensus_queue.cc:237] T deff9c42898e48bdaa4575ff88e733a6 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.187919 11400 tablet_bootstrap.cc:654] T 1b8455bef8cb45b8b9cb5ff12454264f P ceb819e448e34d73b2cd02fdc2e3747c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:42.194490 11401 tablet_bootstrap.cc:492] T d0b8e0b882c143c5b45154837705e287 P 7e5b746c9d10411cb2e3948be2e9db1e: No bootstrap required, opened a new log
I20260709 13:17:42.195256 11401 ts_tablet_manager.cc:1403] T d0b8e0b882c143c5b45154837705e287 P 7e5b746c9d10411cb2e3948be2e9db1e: Time spent bootstrapping tablet: real 0.026s	user 0.006s	sys 0.013s
I20260709 13:17:42.196504 11400 tablet_bootstrap.cc:492] T 1b8455bef8cb45b8b9cb5ff12454264f P ceb819e448e34d73b2cd02fdc2e3747c: No bootstrap required, opened a new log
I20260709 13:17:42.197084 11400 ts_tablet_manager.cc:1403] T 1b8455bef8cb45b8b9cb5ff12454264f P ceb819e448e34d73b2cd02fdc2e3747c: Time spent bootstrapping tablet: real 0.056s	user 0.007s	sys 0.004s
I20260709 13:17:42.198655 11402 tablet_bootstrap.cc:492] T 1b8455bef8cb45b8b9cb5ff12454264f P 6fc0290ef4cf4ffa8c82c234ed04ff1d: No bootstrap required, opened a new log
I20260709 13:17:42.198446 11401 raft_consensus.cc:359] T d0b8e0b882c143c5b45154837705e287 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.199242 11402 ts_tablet_manager.cc:1403] T 1b8455bef8cb45b8b9cb5ff12454264f P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Time spent bootstrapping tablet: real 0.060s	user 0.019s	sys 0.019s
I20260709 13:17:42.199388 11401 raft_consensus.cc:385] T d0b8e0b882c143c5b45154837705e287 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:42.199860 11401 raft_consensus.cc:740] T d0b8e0b882c143c5b45154837705e287 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e5b746c9d10411cb2e3948be2e9db1e, State: Initialized, Role: FOLLOWER
I20260709 13:17:42.200388 11400 raft_consensus.cc:359] T 1b8455bef8cb45b8b9cb5ff12454264f P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.200621 11401 consensus_queue.cc:260] T d0b8e0b882c143c5b45154837705e287 P 7e5b746c9d10411cb2e3948be2e9db1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.201201 11011 catalog_manager.cc:5697] T deff9c42898e48bdaa4575ff88e733a6 P 6fc0290ef4cf4ffa8c82c234ed04ff1d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194). New cstate: current_term: 1 leader_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:42.201224 11400 raft_consensus.cc:385] T 1b8455bef8cb45b8b9cb5ff12454264f P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:42.202540 11400 raft_consensus.cc:740] T 1b8455bef8cb45b8b9cb5ff12454264f P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ceb819e448e34d73b2cd02fdc2e3747c, State: Initialized, Role: FOLLOWER
I20260709 13:17:42.202646 11402 raft_consensus.cc:359] T 1b8455bef8cb45b8b9cb5ff12454264f P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.203652 11402 raft_consensus.cc:385] T 1b8455bef8cb45b8b9cb5ff12454264f P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:42.203348 11400 consensus_queue.cc:260] T 1b8455bef8cb45b8b9cb5ff12454264f P ceb819e448e34d73b2cd02fdc2e3747c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.204471 11416 raft_consensus.cc:493] T 6eab4df2be764be5b57dcd1fc08345fd P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.205093 11416 raft_consensus.cc:515] T 6eab4df2be764be5b57dcd1fc08345fd P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.205909 11400 ts_tablet_manager.cc:1434] T 1b8455bef8cb45b8b9cb5ff12454264f P ceb819e448e34d73b2cd02fdc2e3747c: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:17:42.208928 11260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eab4df2be764be5b57dcd1fc08345fd" candidate_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" is_pre_election: true
I20260709 13:17:42.209636 11260 raft_consensus.cc:2468] T 6eab4df2be764be5b57dcd1fc08345fd P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fc0290ef4cf4ffa8c82c234ed04ff1d in term 0.
I20260709 13:17:42.211266 11154 leader_election.cc:304] T 6eab4df2be764be5b57dcd1fc08345fd P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, 7e5b746c9d10411cb2e3948be2e9db1e; no voters: 
I20260709 13:17:42.211653 11112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eab4df2be764be5b57dcd1fc08345fd" candidate_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" is_pre_election: true
I20260709 13:17:42.212200 11414 raft_consensus.cc:2804] T 6eab4df2be764be5b57dcd1fc08345fd P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:42.212350 11112 raft_consensus.cc:2468] T 6eab4df2be764be5b57dcd1fc08345fd P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fc0290ef4cf4ffa8c82c234ed04ff1d in term 0.
I20260709 13:17:42.212646 11414 raft_consensus.cc:493] T 6eab4df2be764be5b57dcd1fc08345fd P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.213063 11414 raft_consensus.cc:3060] T 6eab4df2be764be5b57dcd1fc08345fd P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.214605 11401 ts_tablet_manager.cc:1434] T d0b8e0b882c143c5b45154837705e287 P 7e5b746c9d10411cb2e3948be2e9db1e: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:17:42.214898 11402 raft_consensus.cc:740] T 1b8455bef8cb45b8b9cb5ff12454264f P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fc0290ef4cf4ffa8c82c234ed04ff1d, State: Initialized, Role: FOLLOWER
I20260709 13:17:42.215785 11402 consensus_queue.cc:260] T 1b8455bef8cb45b8b9cb5ff12454264f P 6fc0290ef4cf4ffa8c82c234ed04ff1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.218429 11402 ts_tablet_manager.cc:1434] T 1b8455bef8cb45b8b9cb5ff12454264f P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.002s
I20260709 13:17:42.219521 11402 tablet_bootstrap.cc:492] T d0b8e0b882c143c5b45154837705e287 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Bootstrap starting.
I20260709 13:17:42.226552 11400 tablet_bootstrap.cc:492] T deff9c42898e48bdaa4575ff88e733a6 P ceb819e448e34d73b2cd02fdc2e3747c: Bootstrap starting.
I20260709 13:17:42.227038 11402 tablet_bootstrap.cc:654] T d0b8e0b882c143c5b45154837705e287 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:42.226277 11305 raft_consensus.cc:493] T 1b8455bef8cb45b8b9cb5ff12454264f P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.231686 11305 raft_consensus.cc:515] T 1b8455bef8cb45b8b9cb5ff12454264f P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.235586 11112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8455bef8cb45b8b9cb5ff12454264f" candidate_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" is_pre_election: true
I20260709 13:17:42.236272 11112 raft_consensus.cc:2468] T 1b8455bef8cb45b8b9cb5ff12454264f P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fc0290ef4cf4ffa8c82c234ed04ff1d in term 0.
I20260709 13:17:42.237505 11151 leader_election.cc:304] T 1b8455bef8cb45b8b9cb5ff12454264f P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, ceb819e448e34d73b2cd02fdc2e3747c; no voters: 
I20260709 13:17:42.238395 11431 raft_consensus.cc:2804] T 1b8455bef8cb45b8b9cb5ff12454264f P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:42.238819 11431 raft_consensus.cc:493] T 1b8455bef8cb45b8b9cb5ff12454264f P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.239207 11431 raft_consensus.cc:3060] T 1b8455bef8cb45b8b9cb5ff12454264f P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.239300 11402 tablet_bootstrap.cc:492] T d0b8e0b882c143c5b45154837705e287 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: No bootstrap required, opened a new log
I20260709 13:17:42.240021 11402 ts_tablet_manager.cc:1403] T d0b8e0b882c143c5b45154837705e287 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.007s
I20260709 13:17:42.240265 11260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8455bef8cb45b8b9cb5ff12454264f" candidate_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" is_pre_election: true
I20260709 13:17:42.241071 11260 raft_consensus.cc:2468] T 1b8455bef8cb45b8b9cb5ff12454264f P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fc0290ef4cf4ffa8c82c234ed04ff1d in term 0.
I20260709 13:17:42.241830 11388 raft_consensus.cc:493] T b4c4141fdaa04cffb06507e0010fefae P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.242383 11388 raft_consensus.cc:515] T b4c4141fdaa04cffb06507e0010fefae P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.243484 11402 raft_consensus.cc:359] T d0b8e0b882c143c5b45154837705e287 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.244315 11402 raft_consensus.cc:385] T d0b8e0b882c143c5b45154837705e287 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:42.244059 11414 raft_consensus.cc:515] T 6eab4df2be764be5b57dcd1fc08345fd P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.244669 11402 raft_consensus.cc:740] T d0b8e0b882c143c5b45154837705e287 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fc0290ef4cf4ffa8c82c234ed04ff1d, State: Initialized, Role: FOLLOWER
I20260709 13:17:42.244758 11388 leader_election.cc:290] T b4c4141fdaa04cffb06507e0010fefae P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941)
I20260709 13:17:42.245644 11402 consensus_queue.cc:260] T d0b8e0b882c143c5b45154837705e287 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.246943 11400 tablet_bootstrap.cc:654] T deff9c42898e48bdaa4575ff88e733a6 P ceb819e448e34d73b2cd02fdc2e3747c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:42.247146 11113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eab4df2be764be5b57dcd1fc08345fd" candidate_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c"
I20260709 13:17:42.247365 11187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4c4141fdaa04cffb06507e0010fefae" candidate_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" is_pre_election: true
I20260709 13:17:42.248077 11113 raft_consensus.cc:3060] T 6eab4df2be764be5b57dcd1fc08345fd P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:42.249040 11225 leader_election.cc:343] T b4c4141fdaa04cffb06507e0010fefae P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:42.249974 11112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4c4141fdaa04cffb06507e0010fefae" candidate_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" is_pre_election: true
W20260709 13:17:42.251716 11225 leader_election.cc:343] T b4c4141fdaa04cffb06507e0010fefae P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:42.252310 11225 leader_election.cc:304] T b4c4141fdaa04cffb06507e0010fefae P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e5b746c9d10411cb2e3948be2e9db1e; no voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, ceb819e448e34d73b2cd02fdc2e3747c
I20260709 13:17:42.253880 11388 raft_consensus.cc:2749] T b4c4141fdaa04cffb06507e0010fefae P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:42.242507 11305 leader_election.cc:290] T 1b8455bef8cb45b8b9cb5ff12454264f P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195:33049)
I20260709 13:17:42.264003 11431 raft_consensus.cc:515] T 1b8455bef8cb45b8b9cb5ff12454264f P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.268373 11112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8455bef8cb45b8b9cb5ff12454264f" candidate_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c"
I20260709 13:17:42.269158 11112 raft_consensus.cc:3060] T 1b8455bef8cb45b8b9cb5ff12454264f P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.277737 11112 raft_consensus.cc:2468] T 1b8455bef8cb45b8b9cb5ff12454264f P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fc0290ef4cf4ffa8c82c234ed04ff1d in term 1.
I20260709 13:17:42.278869 11151 leader_election.cc:304] T 1b8455bef8cb45b8b9cb5ff12454264f P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, ceb819e448e34d73b2cd02fdc2e3747c; no voters: 
I20260709 13:17:42.279683 11416 leader_election.cc:290] T 6eab4df2be764be5b57dcd1fc08345fd P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195:33049)
I20260709 13:17:42.280318 11305 raft_consensus.cc:2804] T 1b8455bef8cb45b8b9cb5ff12454264f P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:42.281088 11305 raft_consensus.cc:697] T 1b8455bef8cb45b8b9cb5ff12454264f P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 LEADER]: Becoming Leader. State: Replica: 6fc0290ef4cf4ffa8c82c234ed04ff1d, State: Running, Role: LEADER
I20260709 13:17:42.282181 11305 consensus_queue.cc:237] T 1b8455bef8cb45b8b9cb5ff12454264f P 6fc0290ef4cf4ffa8c82c234ed04ff1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.289395 11113 raft_consensus.cc:2468] T 6eab4df2be764be5b57dcd1fc08345fd P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fc0290ef4cf4ffa8c82c234ed04ff1d in term 1.
I20260709 13:17:42.289688 11400 tablet_bootstrap.cc:492] T deff9c42898e48bdaa4575ff88e733a6 P ceb819e448e34d73b2cd02fdc2e3747c: No bootstrap required, opened a new log
I20260709 13:17:42.290557 11400 ts_tablet_manager.cc:1403] T deff9c42898e48bdaa4575ff88e733a6 P ceb819e448e34d73b2cd02fdc2e3747c: Time spent bootstrapping tablet: real 0.064s	user 0.015s	sys 0.028s
I20260709 13:17:42.291014 11151 leader_election.cc:304] T 6eab4df2be764be5b57dcd1fc08345fd P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, ceb819e448e34d73b2cd02fdc2e3747c; no voters: 
I20260709 13:17:42.292194 11416 raft_consensus.cc:2804] T 6eab4df2be764be5b57dcd1fc08345fd P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:42.294003 11431 leader_election.cc:290] T 1b8455bef8cb45b8b9cb5ff12454264f P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 1 election: Requested vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195:33049)
I20260709 13:17:42.295146 11400 raft_consensus.cc:359] T deff9c42898e48bdaa4575ff88e733a6 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.296352 11400 raft_consensus.cc:385] T deff9c42898e48bdaa4575ff88e733a6 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:42.296718 11400 raft_consensus.cc:740] T deff9c42898e48bdaa4575ff88e733a6 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ceb819e448e34d73b2cd02fdc2e3747c, State: Initialized, Role: FOLLOWER
I20260709 13:17:42.297674 11400 consensus_queue.cc:260] T deff9c42898e48bdaa4575ff88e733a6 P ceb819e448e34d73b2cd02fdc2e3747c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.299503 11400 ts_tablet_manager.cc:1434] T deff9c42898e48bdaa4575ff88e733a6 P ceb819e448e34d73b2cd02fdc2e3747c: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:17:42.299953 11261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8455bef8cb45b8b9cb5ff12454264f" candidate_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e"
I20260709 13:17:42.300652 11261 raft_consensus.cc:3060] T 1b8455bef8cb45b8b9cb5ff12454264f P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.301347 11416 raft_consensus.cc:697] T 6eab4df2be764be5b57dcd1fc08345fd P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 LEADER]: Becoming Leader. State: Replica: 6fc0290ef4cf4ffa8c82c234ed04ff1d, State: Running, Role: LEADER
I20260709 13:17:42.302030 11402 ts_tablet_manager.cc:1434] T d0b8e0b882c143c5b45154837705e287 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Time spent starting tablet: real 0.062s	user 0.015s	sys 0.038s
I20260709 13:17:42.303107 11402 tablet_bootstrap.cc:492] T b4c4141fdaa04cffb06507e0010fefae P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Bootstrap starting.
I20260709 13:17:42.300392 11414 leader_election.cc:290] T 6eab4df2be764be5b57dcd1fc08345fd P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 1 election: Requested vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195:33049)
I20260709 13:17:42.302925 11416 consensus_queue.cc:237] T 6eab4df2be764be5b57dcd1fc08345fd P 6fc0290ef4cf4ffa8c82c234ed04ff1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.301362 11260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eab4df2be764be5b57dcd1fc08345fd" candidate_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e"
I20260709 13:17:42.304231 11260 raft_consensus.cc:3060] T 6eab4df2be764be5b57dcd1fc08345fd P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.306948 11400 tablet_bootstrap.cc:492] T b4c4141fdaa04cffb06507e0010fefae P ceb819e448e34d73b2cd02fdc2e3747c: Bootstrap starting.
I20260709 13:17:42.308826 11388 raft_consensus.cc:493] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.309404 11388 raft_consensus.cc:515] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.311030 11402 tablet_bootstrap.cc:654] T b4c4141fdaa04cffb06507e0010fefae P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:42.312206 11388 leader_election.cc:290] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941)
I20260709 13:17:42.314374 11187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf72bd1b7f841189a36dc8e9cc20b4c" candidate_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" is_pre_election: true
I20260709 13:17:42.315197 11187 raft_consensus.cc:2468] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e5b746c9d10411cb2e3948be2e9db1e in term 0.
I20260709 13:17:42.315804 11400 tablet_bootstrap.cc:654] T b4c4141fdaa04cffb06507e0010fefae P ceb819e448e34d73b2cd02fdc2e3747c: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:42.317332 11225 leader_election.cc:304] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, 7e5b746c9d10411cb2e3948be2e9db1e; no voters: 
I20260709 13:17:42.318974 11388 raft_consensus.cc:2804] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:42.319832 11388 raft_consensus.cc:493] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.320544 11388 raft_consensus.cc:3060] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.323619 11402 tablet_bootstrap.cc:492] T b4c4141fdaa04cffb06507e0010fefae P 6fc0290ef4cf4ffa8c82c234ed04ff1d: No bootstrap required, opened a new log
I20260709 13:17:42.324295 11402 ts_tablet_manager.cc:1403] T b4c4141fdaa04cffb06507e0010fefae P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Time spent bootstrapping tablet: real 0.021s	user 0.020s	sys 0.000s
I20260709 13:17:42.327185 11260 raft_consensus.cc:2468] T 6eab4df2be764be5b57dcd1fc08345fd P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fc0290ef4cf4ffa8c82c234ed04ff1d in term 1.
I20260709 13:17:42.328307 11402 raft_consensus.cc:359] T b4c4141fdaa04cffb06507e0010fefae P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.330813 11402 raft_consensus.cc:385] T b4c4141fdaa04cffb06507e0010fefae P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:42.330040 11261 raft_consensus.cc:2468] T 1b8455bef8cb45b8b9cb5ff12454264f P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fc0290ef4cf4ffa8c82c234ed04ff1d in term 1.
I20260709 13:17:42.331269 11402 raft_consensus.cc:740] T b4c4141fdaa04cffb06507e0010fefae P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fc0290ef4cf4ffa8c82c234ed04ff1d, State: Initialized, Role: FOLLOWER
I20260709 13:17:42.332283 11402 consensus_queue.cc:260] T b4c4141fdaa04cffb06507e0010fefae P 6fc0290ef4cf4ffa8c82c234ed04ff1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.335170 11402 ts_tablet_manager.cc:1434] T b4c4141fdaa04cffb06507e0010fefae P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:17:42.378863 11113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf72bd1b7f841189a36dc8e9cc20b4c" candidate_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" is_pre_election: true
I20260709 13:17:42.381001 11113 raft_consensus.cc:2468] T 2bf72bd1b7f841189a36dc8e9cc20b4c P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e5b746c9d10411cb2e3948be2e9db1e in term 0.
I20260709 13:17:42.391572 11378 raft_consensus.cc:493] T 2bf72bd1b7f841189a36dc8e9cc20b4c P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.398571 11414 raft_consensus.cc:493] T b4c4141fdaa04cffb06507e0010fefae P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.400534 11400 tablet_bootstrap.cc:492] T b4c4141fdaa04cffb06507e0010fefae P ceb819e448e34d73b2cd02fdc2e3747c: No bootstrap required, opened a new log
I20260709 13:17:42.400616 11420 raft_consensus.cc:493] T 05b49fb53338498d94d1df63d6d809ef P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.395969 11378 raft_consensus.cc:515] T 2bf72bd1b7f841189a36dc8e9cc20b4c P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.402290 11420 raft_consensus.cc:515] T 05b49fb53338498d94d1df63d6d809ef P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.404737 11414 raft_consensus.cc:515] T b4c4141fdaa04cffb06507e0010fefae P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.405349 11378 leader_election.cc:290] T 2bf72bd1b7f841189a36dc8e9cc20b4c P ceb819e448e34d73b2cd02fdc2e3747c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941), 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195:33049)
I20260709 13:17:42.409266 11420 leader_election.cc:290] T 05b49fb53338498d94d1df63d6d809ef P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941)
I20260709 13:17:42.416297 11188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b49fb53338498d94d1df63d6d809ef" candidate_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" is_pre_election: true
I20260709 13:17:42.417696 11188 raft_consensus.cc:2468] T 05b49fb53338498d94d1df63d6d809ef P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e5b746c9d10411cb2e3948be2e9db1e in term 0.
I20260709 13:17:42.421851 11225 leader_election.cc:304] T 05b49fb53338498d94d1df63d6d809ef P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, 7e5b746c9d10411cb2e3948be2e9db1e; no voters: 
I20260709 13:17:42.425738 11188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf72bd1b7f841189a36dc8e9cc20b4c" candidate_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" is_pre_election: true
I20260709 13:17:42.427019 11188 raft_consensus.cc:2468] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb819e448e34d73b2cd02fdc2e3747c in term 0.
I20260709 13:17:42.427084 11388 raft_consensus.cc:515] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.428584 11076 leader_election.cc:304] T 2bf72bd1b7f841189a36dc8e9cc20b4c P ceb819e448e34d73b2cd02fdc2e3747c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, ceb819e448e34d73b2cd02fdc2e3747c; no voters: 
I20260709 13:17:42.429603 11400 ts_tablet_manager.cc:1403] T b4c4141fdaa04cffb06507e0010fefae P ceb819e448e34d73b2cd02fdc2e3747c: Time spent bootstrapping tablet: real 0.123s	user 0.012s	sys 0.009s
I20260709 13:17:42.429728 11388 leader_election.cc:290] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 1 election: Requested vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941)
I20260709 13:17:42.413786 11113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b49fb53338498d94d1df63d6d809ef" candidate_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" is_pre_election: true
I20260709 13:17:42.434147 11420 raft_consensus.cc:2804] T 05b49fb53338498d94d1df63d6d809ef P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:42.435828 11378 raft_consensus.cc:493] T 05b49fb53338498d94d1df63d6d809ef P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:42.439148 11439 log.cc:927] Time spent T 6eab4df2be764be5b57dcd1fc08345fd P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:17:42.440007 11414 leader_election.cc:290] T b4c4141fdaa04cffb06507e0010fefae P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195:33049)
I20260709 13:17:42.440183 11112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4c4141fdaa04cffb06507e0010fefae" candidate_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" is_pre_election: true
I20260709 13:17:42.439956 11378 raft_consensus.cc:515] T 05b49fb53338498d94d1df63d6d809ef P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.445137 11111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf72bd1b7f841189a36dc8e9cc20b4c" candidate_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c"
I20260709 13:17:42.446390 11188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf72bd1b7f841189a36dc8e9cc20b4c" candidate_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d"
I20260709 13:17:42.447243 11186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b49fb53338498d94d1df63d6d809ef" candidate_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" is_pre_election: true
I20260709 13:17:42.448280 11186 raft_consensus.cc:2468] T 05b49fb53338498d94d1df63d6d809ef P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb819e448e34d73b2cd02fdc2e3747c in term 0.
I20260709 13:17:42.449041 11378 leader_election.cc:290] T 05b49fb53338498d94d1df63d6d809ef P ceb819e448e34d73b2cd02fdc2e3747c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941), 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195:33049)
I20260709 13:17:42.447270 11188 raft_consensus.cc:3060] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.449965 11076 leader_election.cc:304] T 05b49fb53338498d94d1df63d6d809ef P ceb819e448e34d73b2cd02fdc2e3747c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, ceb819e448e34d73b2cd02fdc2e3747c; no voters: 
I20260709 13:17:42.456063 11260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4c4141fdaa04cffb06507e0010fefae" candidate_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" is_pre_election: true
I20260709 13:17:42.456183 11262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf72bd1b7f841189a36dc8e9cc20b4c" candidate_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" is_pre_election: true
I20260709 13:17:42.457513 11262 raft_consensus.cc:2393] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb819e448e34d73b2cd02fdc2e3747c in current term 1: Already voted for candidate 7e5b746c9d10411cb2e3948be2e9db1e in this term.
I20260709 13:17:42.457242 11260 raft_consensus.cc:2468] T b4c4141fdaa04cffb06507e0010fefae P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fc0290ef4cf4ffa8c82c234ed04ff1d in term 0.
I20260709 13:17:42.458877 11440 raft_consensus.cc:2804] T 2bf72bd1b7f841189a36dc8e9cc20b4c P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:42.451586 11113 raft_consensus.cc:2468] T 05b49fb53338498d94d1df63d6d809ef P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e5b746c9d10411cb2e3948be2e9db1e in term 0.
I20260709 13:17:42.459728 11261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b49fb53338498d94d1df63d6d809ef" candidate_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" is_pre_election: true
I20260709 13:17:42.459868 11440 raft_consensus.cc:493] T 2bf72bd1b7f841189a36dc8e9cc20b4c P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.464871 11440 raft_consensus.cc:3060] T 2bf72bd1b7f841189a36dc8e9cc20b4c P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.467975 11154 leader_election.cc:304] T b4c4141fdaa04cffb06507e0010fefae P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, 7e5b746c9d10411cb2e3948be2e9db1e; no voters: 
I20260709 13:17:42.464152 11378 raft_consensus.cc:2804] T 05b49fb53338498d94d1df63d6d809ef P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:42.469118 11414 consensus_queue.cc:1048] T f184ae5efb4641d9b6442c2a743f1f81 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:42.468796 11378 raft_consensus.cc:493] T 05b49fb53338498d94d1df63d6d809ef P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.470325 11378 raft_consensus.cc:3060] T 05b49fb53338498d94d1df63d6d809ef P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.471024 11414 raft_consensus.cc:2804] T b4c4141fdaa04cffb06507e0010fefae P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:42.471524 11414 raft_consensus.cc:493] T b4c4141fdaa04cffb06507e0010fefae P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.471935 11414 raft_consensus.cc:3060] T b4c4141fdaa04cffb06507e0010fefae P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.465622 11400 raft_consensus.cc:359] T b4c4141fdaa04cffb06507e0010fefae P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.437492 11420 raft_consensus.cc:493] T 05b49fb53338498d94d1df63d6d809ef P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.474270 11420 raft_consensus.cc:3060] T 05b49fb53338498d94d1df63d6d809ef P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.465744 11007 catalog_manager.cc:5697] T 1b8455bef8cb45b8b9cb5ff12454264f P 6fc0290ef4cf4ffa8c82c234ed04ff1d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194). New cstate: current_term: 1 leader_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:42.476985 11400 raft_consensus.cc:385] T b4c4141fdaa04cffb06507e0010fefae P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:42.477413 11400 raft_consensus.cc:740] T b4c4141fdaa04cffb06507e0010fefae P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ceb819e448e34d73b2cd02fdc2e3747c, State: Initialized, Role: FOLLOWER
I20260709 13:17:42.478487 11400 consensus_queue.cc:260] T b4c4141fdaa04cffb06507e0010fefae P ceb819e448e34d73b2cd02fdc2e3747c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.479933 11112 raft_consensus.cc:2468] T b4c4141fdaa04cffb06507e0010fefae P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fc0290ef4cf4ffa8c82c234ed04ff1d in term 0.
I20260709 13:17:42.490847 11400 ts_tablet_manager.cc:1434] T b4c4141fdaa04cffb06507e0010fefae P ceb819e448e34d73b2cd02fdc2e3747c: Time spent starting tablet: real 0.059s	user 0.009s	sys 0.005s
I20260709 13:17:42.497730 11188 raft_consensus.cc:2468] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e5b746c9d10411cb2e3948be2e9db1e in term 1.
I20260709 13:17:42.503998 11225 leader_election.cc:304] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, 7e5b746c9d10411cb2e3948be2e9db1e; no voters: 
I20260709 13:17:42.508721 11443 raft_consensus.cc:493] T 7aae7b1e191e428d9abcb7c76f088181 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.509572 11443 raft_consensus.cc:515] T 7aae7b1e191e428d9abcb7c76f088181 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.511036 11442 raft_consensus.cc:2804] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:42.511709 11442 raft_consensus.cc:697] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 LEADER]: Becoming Leader. State: Replica: 7e5b746c9d10411cb2e3948be2e9db1e, State: Running, Role: LEADER
I20260709 13:17:42.513660 11443 leader_election.cc:290] T 7aae7b1e191e428d9abcb7c76f088181 P ceb819e448e34d73b2cd02fdc2e3747c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941), 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195:33049)
I20260709 13:17:42.513684 11262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aae7b1e191e428d9abcb7c76f088181" candidate_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" is_pre_election: true
I20260709 13:17:42.514887 11262 raft_consensus.cc:2468] T 7aae7b1e191e428d9abcb7c76f088181 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb819e448e34d73b2cd02fdc2e3747c in term 0.
I20260709 13:17:42.514963 11187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aae7b1e191e428d9abcb7c76f088181" candidate_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" is_pre_election: true
I20260709 13:17:42.516098 11187 raft_consensus.cc:2468] T 7aae7b1e191e428d9abcb7c76f088181 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb819e448e34d73b2cd02fdc2e3747c in term 0.
I20260709 13:17:42.516840 11079 leader_election.cc:304] T 7aae7b1e191e428d9abcb7c76f088181 P ceb819e448e34d73b2cd02fdc2e3747c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e5b746c9d10411cb2e3948be2e9db1e, ceb819e448e34d73b2cd02fdc2e3747c; no voters: 
I20260709 13:17:42.517839 11443 raft_consensus.cc:2804] T 7aae7b1e191e428d9abcb7c76f088181 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:42.518239 11443 raft_consensus.cc:493] T 7aae7b1e191e428d9abcb7c76f088181 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.518635 11443 raft_consensus.cc:3060] T 7aae7b1e191e428d9abcb7c76f088181 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.513118 11442 consensus_queue.cc:237] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.524847 11440 raft_consensus.cc:515] T 2bf72bd1b7f841189a36dc8e9cc20b4c P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.524940 11378 raft_consensus.cc:515] T 05b49fb53338498d94d1df63d6d809ef P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.526612 11111 raft_consensus.cc:2393] T 2bf72bd1b7f841189a36dc8e9cc20b4c P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e5b746c9d10411cb2e3948be2e9db1e in current term 1: Already voted for candidate ceb819e448e34d73b2cd02fdc2e3747c in this term.
I20260709 13:17:42.529546 11378 leader_election.cc:290] T 05b49fb53338498d94d1df63d6d809ef P ceb819e448e34d73b2cd02fdc2e3747c [CANDIDATE]: Term 1 election: Requested vote from peers 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941), 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195:33049)
I20260709 13:17:42.529804 11262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b49fb53338498d94d1df63d6d809ef" candidate_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e"
I20260709 13:17:42.530783 11187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b49fb53338498d94d1df63d6d809ef" candidate_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d"
I20260709 13:17:42.531611 11187 raft_consensus.cc:3060] T 05b49fb53338498d94d1df63d6d809ef P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.529791 11443 raft_consensus.cc:515] T 7aae7b1e191e428d9abcb7c76f088181 P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.541613 11188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aae7b1e191e428d9abcb7c76f088181" candidate_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d"
I20260709 13:17:42.542339 11188 raft_consensus.cc:3060] T 7aae7b1e191e428d9abcb7c76f088181 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.543776 11414 raft_consensus.cc:515] T b4c4141fdaa04cffb06507e0010fefae P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.547650 11416 consensus_queue.cc:1048] T f184ae5efb4641d9b6442c2a743f1f81 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:42.548012 11187 raft_consensus.cc:2468] T 05b49fb53338498d94d1df63d6d809ef P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb819e448e34d73b2cd02fdc2e3747c in term 1.
I20260709 13:17:42.548493 11420 raft_consensus.cc:515] T 05b49fb53338498d94d1df63d6d809ef P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.549737 11261 raft_consensus.cc:2393] T 05b49fb53338498d94d1df63d6d809ef P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb819e448e34d73b2cd02fdc2e3747c in current term 1: Already voted for candidate 7e5b746c9d10411cb2e3948be2e9db1e in this term.
I20260709 13:17:42.550889 11420 leader_election.cc:290] T 05b49fb53338498d94d1df63d6d809ef P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 1 election: Requested vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941)
I20260709 13:17:42.553156 11076 leader_election.cc:304] T 05b49fb53338498d94d1df63d6d809ef P ceb819e448e34d73b2cd02fdc2e3747c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, ceb819e448e34d73b2cd02fdc2e3747c; no voters: 7e5b746c9d10411cb2e3948be2e9db1e
I20260709 13:17:42.555811 11378 raft_consensus.cc:2804] T 05b49fb53338498d94d1df63d6d809ef P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:42.556738 11378 raft_consensus.cc:697] T 05b49fb53338498d94d1df63d6d809ef P ceb819e448e34d73b2cd02fdc2e3747c [term 1 LEADER]: Becoming Leader. State: Replica: ceb819e448e34d73b2cd02fdc2e3747c, State: Running, Role: LEADER
I20260709 13:17:42.555294 11112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b49fb53338498d94d1df63d6d809ef" candidate_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c"
I20260709 13:17:42.558413 11378 consensus_queue.cc:237] T 05b49fb53338498d94d1df63d6d809ef P ceb819e448e34d73b2cd02fdc2e3747c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.564579 11188 raft_consensus.cc:2468] T 7aae7b1e191e428d9abcb7c76f088181 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb819e448e34d73b2cd02fdc2e3747c in term 1.
I20260709 13:17:42.572190 11440 leader_election.cc:290] T 2bf72bd1b7f841189a36dc8e9cc20b4c P ceb819e448e34d73b2cd02fdc2e3747c [CANDIDATE]: Term 1 election: Requested vote from peers 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941), 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195:33049)
I20260709 13:17:42.573391 11260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf72bd1b7f841189a36dc8e9cc20b4c" candidate_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e"
I20260709 13:17:42.573580 11187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf72bd1b7f841189a36dc8e9cc20b4c" candidate_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d"
I20260709 13:17:42.575803 11443 leader_election.cc:290] T 7aae7b1e191e428d9abcb7c76f088181 P ceb819e448e34d73b2cd02fdc2e3747c [CANDIDATE]: Term 1 election: Requested vote from peers 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941), 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195:33049)
I20260709 13:17:42.576781 11414 leader_election.cc:290] T b4c4141fdaa04cffb06507e0010fefae P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 1 election: Requested vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195:33049)
I20260709 13:17:42.577239 11112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4c4141fdaa04cffb06507e0010fefae" candidate_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c"
I20260709 13:17:42.591150 11112 raft_consensus.cc:3060] T b4c4141fdaa04cffb06507e0010fefae P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.577988 11261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4c4141fdaa04cffb06507e0010fefae" candidate_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e"
I20260709 13:17:42.578404 11262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aae7b1e191e428d9abcb7c76f088181" candidate_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e"
I20260709 13:17:42.591938 11261 raft_consensus.cc:3060] T b4c4141fdaa04cffb06507e0010fefae P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.592002 11262 raft_consensus.cc:3060] T 7aae7b1e191e428d9abcb7c76f088181 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.595762 11187 raft_consensus.cc:2393] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ceb819e448e34d73b2cd02fdc2e3747c in current term 1: Already voted for candidate 7e5b746c9d10411cb2e3948be2e9db1e in this term.
I20260709 13:17:42.597347 11305 raft_consensus.cc:493] T d0b8e0b882c143c5b45154837705e287 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.597994 11305 raft_consensus.cc:515] T d0b8e0b882c143c5b45154837705e287 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.565675 11010 catalog_manager.cc:5697] T 6eab4df2be764be5b57dcd1fc08345fd P 6fc0290ef4cf4ffa8c82c234ed04ff1d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194). New cstate: current_term: 1 leader_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:42.586858 11186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b49fb53338498d94d1df63d6d809ef" candidate_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d"
I20260709 13:17:42.589551 11442 raft_consensus.cc:493] T d0b8e0b882c143c5b45154837705e287 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.603632 11442 raft_consensus.cc:515] T d0b8e0b882c143c5b45154837705e287 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.607735 11186 raft_consensus.cc:2393] T 05b49fb53338498d94d1df63d6d809ef P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e5b746c9d10411cb2e3948be2e9db1e in current term 1: Already voted for candidate ceb819e448e34d73b2cd02fdc2e3747c in this term.
I20260709 13:17:42.609649 11443 raft_consensus.cc:493] T deff9c42898e48bdaa4575ff88e733a6 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.611132 11443 raft_consensus.cc:515] T deff9c42898e48bdaa4575ff88e733a6 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.614720 11443 leader_election.cc:290] T deff9c42898e48bdaa4575ff88e733a6 P ceb819e448e34d73b2cd02fdc2e3747c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941), 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195:33049)
I20260709 13:17:42.615273 11259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deff9c42898e48bdaa4575ff88e733a6" candidate_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" is_pre_election: true
I20260709 13:17:42.616683 11259 raft_consensus.cc:2393] T deff9c42898e48bdaa4575ff88e733a6 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ceb819e448e34d73b2cd02fdc2e3747c in current term 1: Already voted for candidate 6fc0290ef4cf4ffa8c82c234ed04ff1d in this term.
I20260709 13:17:42.624475 11305 leader_election.cc:290] T d0b8e0b882c143c5b45154837705e287 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195:33049)
I20260709 13:17:42.606283 11442 leader_election.cc:290] T d0b8e0b882c143c5b45154837705e287 P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941)
I20260709 13:17:42.641983 11113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b8e0b882c143c5b45154837705e287" candidate_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" is_pre_election: true
I20260709 13:17:42.643244 11113 raft_consensus.cc:2468] T d0b8e0b882c143c5b45154837705e287 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e5b746c9d10411cb2e3948be2e9db1e in term 0.
W20260709 13:17:42.633591 11076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:42941, user_credentials={real_user=slave}} blocked reactor thread for 51768us
I20260709 13:17:42.651388 11186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deff9c42898e48bdaa4575ff88e733a6" candidate_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" is_pre_election: true
I20260709 13:17:42.634771 11259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b8e0b882c143c5b45154837705e287" candidate_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" is_pre_election: true
I20260709 13:17:42.655565 11007 catalog_manager.cc:5697] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195). New cstate: current_term: 1 leader_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:42.656790 11259 raft_consensus.cc:2468] T d0b8e0b882c143c5b45154837705e287 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fc0290ef4cf4ffa8c82c234ed04ff1d in term 0.
I20260709 13:17:42.658429 11154 leader_election.cc:304] T d0b8e0b882c143c5b45154837705e287 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, 7e5b746c9d10411cb2e3948be2e9db1e; no voters: 
I20260709 13:17:42.658569 11225 leader_election.cc:304] T 05b49fb53338498d94d1df63d6d809ef P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e5b746c9d10411cb2e3948be2e9db1e; no voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, ceb819e448e34d73b2cd02fdc2e3747c
I20260709 13:17:42.659025 11186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b8e0b882c143c5b45154837705e287" candidate_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" is_pre_election: true
I20260709 13:17:42.659845 11186 raft_consensus.cc:2468] T d0b8e0b882c143c5b45154837705e287 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e5b746c9d10411cb2e3948be2e9db1e in term 0.
I20260709 13:17:42.660197 11225 leader_election.cc:304] T d0b8e0b882c143c5b45154837705e287 P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e5b746c9d10411cb2e3948be2e9db1e, ceb819e448e34d73b2cd02fdc2e3747c; no voters: 
I20260709 13:17:42.661264 11420 raft_consensus.cc:2749] T 05b49fb53338498d94d1df63d6d809ef P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:17:42.661715 11305 raft_consensus.cc:2804] T d0b8e0b882c143c5b45154837705e287 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:42.662046 11420 raft_consensus.cc:2804] T d0b8e0b882c143c5b45154837705e287 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:42.662623 11420 raft_consensus.cc:493] T d0b8e0b882c143c5b45154837705e287 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.663007 11420 raft_consensus.cc:3060] T d0b8e0b882c143c5b45154837705e287 P 7e5b746c9d10411cb2e3948be2e9db1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.667194 11113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b8e0b882c143c5b45154837705e287" candidate_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" is_pre_election: true
I20260709 13:17:42.662129 11305 raft_consensus.cc:493] T d0b8e0b882c143c5b45154837705e287 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.667959 11113 raft_consensus.cc:2468] T d0b8e0b882c143c5b45154837705e287 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fc0290ef4cf4ffa8c82c234ed04ff1d in term 0.
I20260709 13:17:42.669409 11261 raft_consensus.cc:2468] T b4c4141fdaa04cffb06507e0010fefae P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fc0290ef4cf4ffa8c82c234ed04ff1d in term 1.
I20260709 13:17:42.670884 11154 leader_election.cc:304] T b4c4141fdaa04cffb06507e0010fefae P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, 7e5b746c9d10411cb2e3948be2e9db1e; no voters: 
I20260709 13:17:42.671679 11305 raft_consensus.cc:3060] T d0b8e0b882c143c5b45154837705e287 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.671981 11431 raft_consensus.cc:2804] T b4c4141fdaa04cffb06507e0010fefae P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:42.672560 11431 raft_consensus.cc:697] T b4c4141fdaa04cffb06507e0010fefae P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 LEADER]: Becoming Leader. State: Replica: 6fc0290ef4cf4ffa8c82c234ed04ff1d, State: Running, Role: LEADER
I20260709 13:17:42.673524 11431 consensus_queue.cc:237] T b4c4141fdaa04cffb06507e0010fefae P 6fc0290ef4cf4ffa8c82c234ed04ff1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.675940 11112 raft_consensus.cc:2468] T b4c4141fdaa04cffb06507e0010fefae P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fc0290ef4cf4ffa8c82c234ed04ff1d in term 1.
I20260709 13:17:42.683344 11076 leader_election.cc:304] T 7aae7b1e191e428d9abcb7c76f088181 P ceb819e448e34d73b2cd02fdc2e3747c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, ceb819e448e34d73b2cd02fdc2e3747c; no voters: 
I20260709 13:17:42.684058 11305 raft_consensus.cc:515] T d0b8e0b882c143c5b45154837705e287 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.684598 11441 raft_consensus.cc:2804] T 7aae7b1e191e428d9abcb7c76f088181 P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:42.685233 11441 raft_consensus.cc:697] T 7aae7b1e191e428d9abcb7c76f088181 P ceb819e448e34d73b2cd02fdc2e3747c [term 1 LEADER]: Becoming Leader. State: Replica: ceb819e448e34d73b2cd02fdc2e3747c, State: Running, Role: LEADER
I20260709 13:17:42.684588 11420 raft_consensus.cc:515] T d0b8e0b882c143c5b45154837705e287 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.686707 11441 consensus_queue.cc:237] T 7aae7b1e191e428d9abcb7c76f088181 P ceb819e448e34d73b2cd02fdc2e3747c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.688265 11305 leader_election.cc:290] T d0b8e0b882c143c5b45154837705e287 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 1 election: Requested vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195:33049)
I20260709 13:17:42.688387 11260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b8e0b882c143c5b45154837705e287" candidate_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e"
I20260709 13:17:42.688514 11110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b8e0b882c143c5b45154837705e287" candidate_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c"
I20260709 13:17:42.689481 11260 raft_consensus.cc:2393] T d0b8e0b882c143c5b45154837705e287 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fc0290ef4cf4ffa8c82c234ed04ff1d in current term 1: Already voted for candidate 7e5b746c9d10411cb2e3948be2e9db1e in this term.
I20260709 13:17:42.689476 11110 raft_consensus.cc:3060] T d0b8e0b882c143c5b45154837705e287 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.685159 11076 leader_election.cc:304] T 2bf72bd1b7f841189a36dc8e9cc20b4c P ceb819e448e34d73b2cd02fdc2e3747c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb819e448e34d73b2cd02fdc2e3747c; no voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, 7e5b746c9d10411cb2e3948be2e9db1e
I20260709 13:17:42.691850 11186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b8e0b882c143c5b45154837705e287" candidate_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d"
I20260709 13:17:42.692022 11420 leader_election.cc:290] T d0b8e0b882c143c5b45154837705e287 P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 1 election: Requested vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941)
I20260709 13:17:42.692765 11186 raft_consensus.cc:2393] T d0b8e0b882c143c5b45154837705e287 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e5b746c9d10411cb2e3948be2e9db1e in current term 1: Already voted for candidate 6fc0290ef4cf4ffa8c82c234ed04ff1d in this term.
I20260709 13:17:42.692894 11449 raft_consensus.cc:2749] T 2bf72bd1b7f841189a36dc8e9cc20b4c P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:17:42.693485 11076 leader_election.cc:304] T deff9c42898e48bdaa4575ff88e733a6 P ceb819e448e34d73b2cd02fdc2e3747c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ceb819e448e34d73b2cd02fdc2e3747c; no voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, 7e5b746c9d10411cb2e3948be2e9db1e
I20260709 13:17:42.678980 11262 raft_consensus.cc:2468] T 7aae7b1e191e428d9abcb7c76f088181 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb819e448e34d73b2cd02fdc2e3747c in term 1.
I20260709 13:17:42.669763 11011 catalog_manager.cc:5697] T 05b49fb53338498d94d1df63d6d809ef P ceb819e448e34d73b2cd02fdc2e3747c reported cstate change: term changed from 0 to 1, leader changed from <none> to ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193). New cstate: current_term: 1 leader_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:42.702805 11449 raft_consensus.cc:3060] T deff9c42898e48bdaa4575ff88e733a6 P ceb819e448e34d73b2cd02fdc2e3747c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:42.714080 11110 raft_consensus.cc:2468] T d0b8e0b882c143c5b45154837705e287 P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e5b746c9d10411cb2e3948be2e9db1e in term 1.
I20260709 13:17:42.716460 11305 consensus_queue.cc:1048] T deff9c42898e48bdaa4575ff88e733a6 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:17:42.717708 11225 leader_election.cc:304] T d0b8e0b882c143c5b45154837705e287 P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e5b746c9d10411cb2e3948be2e9db1e, ceb819e448e34d73b2cd02fdc2e3747c; no voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d
I20260709 13:17:42.715274 11010 catalog_manager.cc:5697] T b4c4141fdaa04cffb06507e0010fefae P 6fc0290ef4cf4ffa8c82c234ed04ff1d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194). New cstate: current_term: 1 leader_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:42.726037 11420 raft_consensus.cc:2804] T d0b8e0b882c143c5b45154837705e287 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:42.727496 11420 raft_consensus.cc:697] T d0b8e0b882c143c5b45154837705e287 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 LEADER]: Becoming Leader. State: Replica: 7e5b746c9d10411cb2e3948be2e9db1e, State: Running, Role: LEADER
I20260709 13:17:42.728327 11110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b8e0b882c143c5b45154837705e287" candidate_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c"
I20260709 13:17:42.729279 11110 raft_consensus.cc:2393] T d0b8e0b882c143c5b45154837705e287 P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fc0290ef4cf4ffa8c82c234ed04ff1d in current term 1: Already voted for candidate 7e5b746c9d10411cb2e3948be2e9db1e in this term.
I20260709 13:17:42.728708 11420 consensus_queue.cc:237] T d0b8e0b882c143c5b45154837705e287 P 7e5b746c9d10411cb2e3948be2e9db1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.729935 11449 raft_consensus.cc:2749] T deff9c42898e48bdaa4575ff88e733a6 P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:42.720777 11431 consensus_queue.cc:1048] T 6eab4df2be764be5b57dcd1fc08345fd P 6fc0290ef4cf4ffa8c82c234ed04ff1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:17:42.734004 11151 leader_election.cc:304] T d0b8e0b882c143c5b45154837705e287 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d; no voters: 7e5b746c9d10411cb2e3948be2e9db1e, ceb819e448e34d73b2cd02fdc2e3747c
I20260709 13:17:42.734949 11416 raft_consensus.cc:2749] T d0b8e0b882c143c5b45154837705e287 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:17:42.735852 11305 consensus_queue.cc:1048] T 1b8455bef8cb45b8b9cb5ff12454264f P 6fc0290ef4cf4ffa8c82c234ed04ff1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:42.751874 11007 catalog_manager.cc:5697] T 7aae7b1e191e428d9abcb7c76f088181 P ceb819e448e34d73b2cd02fdc2e3747c reported cstate change: term changed from 0 to 1, leader changed from <none> to ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193). New cstate: current_term: 1 leader_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:42.758277 11431 consensus_queue.cc:1048] T 6eab4df2be764be5b57dcd1fc08345fd P 6fc0290ef4cf4ffa8c82c234ed04ff1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:42.791435 11305 consensus_queue.cc:1048] T deff9c42898e48bdaa4575ff88e733a6 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:42.796242 11010 catalog_manager.cc:5697] T d0b8e0b882c143c5b45154837705e287 P 7e5b746c9d10411cb2e3948be2e9db1e reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195). New cstate: current_term: 1 leader_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:42.814086 11433 consensus_queue.cc:1048] T 1b8455bef8cb45b8b9cb5ff12454264f P 6fc0290ef4cf4ffa8c82c234ed04ff1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:42.850354 11186 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f184ae5efb4641d9b6442c2a743f1f81"
dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d"
mode: GRACEFUL
new_leader_uuid: "ceb819e448e34d73b2cd02fdc2e3747c"
 from {username='slave'} at 127.0.0.1:47256
I20260709 13:17:42.851289 11186 raft_consensus.cc:606] T f184ae5efb4641d9b6442c2a743f1f81 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 LEADER]: Received request to transfer leadership to TS ceb819e448e34d73b2cd02fdc2e3747c
I20260709 13:17:42.859089 11262 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0b8e0b882c143c5b45154837705e287"
dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e"
mode: GRACEFUL
new_leader_uuid: "ceb819e448e34d73b2cd02fdc2e3747c"
 from {username='slave'} at 127.0.0.1:53880
I20260709 13:17:42.859760 11262 raft_consensus.cc:606] T d0b8e0b882c143c5b45154837705e287 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 LEADER]: Received request to transfer leadership to TS ceb819e448e34d73b2cd02fdc2e3747c
I20260709 13:17:42.865329 11262 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2bf72bd1b7f841189a36dc8e9cc20b4c"
dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e"
mode: GRACEFUL
new_leader_uuid: "ceb819e448e34d73b2cd02fdc2e3747c"
 from {username='slave'} at 127.0.0.1:53880
I20260709 13:17:42.866026 11262 raft_consensus.cc:606] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 LEADER]: Received request to transfer leadership to TS ceb819e448e34d73b2cd02fdc2e3747c
I20260709 13:17:42.871724 11187 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6eab4df2be764be5b57dcd1fc08345fd"
dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d"
mode: GRACEFUL
new_leader_uuid: "ceb819e448e34d73b2cd02fdc2e3747c"
 from {username='slave'} at 127.0.0.1:47256
I20260709 13:17:42.872341 11187 raft_consensus.cc:606] T 6eab4df2be764be5b57dcd1fc08345fd P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 LEADER]: Received request to transfer leadership to TS ceb819e448e34d73b2cd02fdc2e3747c
I20260709 13:17:42.877841 11111 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7aae7b1e191e428d9abcb7c76f088181"
dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c"
mode: GRACEFUL
new_leader_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d"
 from {username='slave'} at 127.0.0.1:55900
I20260709 13:17:42.878384 11111 raft_consensus.cc:606] T 7aae7b1e191e428d9abcb7c76f088181 P ceb819e448e34d73b2cd02fdc2e3747c [term 1 LEADER]: Received request to transfer leadership to TS 6fc0290ef4cf4ffa8c82c234ed04ff1d
I20260709 13:17:42.884235 11111 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05b49fb53338498d94d1df63d6d809ef"
dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c"
mode: GRACEFUL
new_leader_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d"
 from {username='slave'} at 127.0.0.1:55900
I20260709 13:17:42.884799 11111 raft_consensus.cc:606] T 05b49fb53338498d94d1df63d6d809ef P ceb819e448e34d73b2cd02fdc2e3747c [term 1 LEADER]: Received request to transfer leadership to TS 6fc0290ef4cf4ffa8c82c234ed04ff1d
I20260709 13:17:42.896188 11187 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4c4141fdaa04cffb06507e0010fefae"
dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d"
mode: GRACEFUL
new_leader_uuid: "7e5b746c9d10411cb2e3948be2e9db1e"
 from {username='slave'} at 127.0.0.1:47256
I20260709 13:17:42.896848 11187 raft_consensus.cc:606] T b4c4141fdaa04cffb06507e0010fefae P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 LEADER]: Received request to transfer leadership to TS 7e5b746c9d10411cb2e3948be2e9db1e
I20260709 13:17:42.914525 11420 consensus_queue.cc:1048] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:42.927753 11420 consensus_queue.cc:1048] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:42.938472 11420 raft_consensus.cc:993] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e: : Instructing follower ceb819e448e34d73b2cd02fdc2e3747c to start an election
I20260709 13:17:42.938966 11420 raft_consensus.cc:1081] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 LEADER]: Signalling peer ceb819e448e34d73b2cd02fdc2e3747c to start an election
I20260709 13:17:42.940945 11111 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2bf72bd1b7f841189a36dc8e9cc20b4c"
dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c"
 from {username='slave'} at 127.0.0.1:55888
I20260709 13:17:42.941638 11111 raft_consensus.cc:493] T 2bf72bd1b7f841189a36dc8e9cc20b4c P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:42.942070 11111 raft_consensus.cc:3060] T 2bf72bd1b7f841189a36dc8e9cc20b4c P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:42.949527 11111 raft_consensus.cc:515] T 2bf72bd1b7f841189a36dc8e9cc20b4c P ceb819e448e34d73b2cd02fdc2e3747c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.952442 11187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf72bd1b7f841189a36dc8e9cc20b4c" candidate_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d"
I20260709 13:17:42.953065 11187 raft_consensus.cc:3060] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:42.953760 11111 leader_election.cc:290] T 2bf72bd1b7f841189a36dc8e9cc20b4c P ceb819e448e34d73b2cd02fdc2e3747c [CANDIDATE]: Term 2 election: Requested vote from peers 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941), 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195:33049)
I20260709 13:17:42.954957 11262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf72bd1b7f841189a36dc8e9cc20b4c" candidate_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e"
I20260709 13:17:42.955677 11262 raft_consensus.cc:3055] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:42.955988 11262 raft_consensus.cc:740] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e5b746c9d10411cb2e3948be2e9db1e, State: Running, Role: LEADER
I20260709 13:17:42.956822 11262 consensus_queue.cc:260] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.958223 11262 raft_consensus.cc:3060] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:42.961236 11187 raft_consensus.cc:2468] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb819e448e34d73b2cd02fdc2e3747c in term 2.
I20260709 13:17:42.962445 11076 leader_election.cc:304] T 2bf72bd1b7f841189a36dc8e9cc20b4c P ceb819e448e34d73b2cd02fdc2e3747c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, ceb819e448e34d73b2cd02fdc2e3747c; no voters: 
I20260709 13:17:42.963189 11449 raft_consensus.cc:2804] T 2bf72bd1b7f841189a36dc8e9cc20b4c P ceb819e448e34d73b2cd02fdc2e3747c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:42.963665 11449 raft_consensus.cc:697] T 2bf72bd1b7f841189a36dc8e9cc20b4c P ceb819e448e34d73b2cd02fdc2e3747c [term 2 LEADER]: Becoming Leader. State: Replica: ceb819e448e34d73b2cd02fdc2e3747c, State: Running, Role: LEADER
I20260709 13:17:42.964569 11449 consensus_queue.cc:237] T 2bf72bd1b7f841189a36dc8e9cc20b4c P ceb819e448e34d73b2cd02fdc2e3747c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:42.965528 11262 raft_consensus.cc:2468] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb819e448e34d73b2cd02fdc2e3747c in term 2.
I20260709 13:17:42.971874 11011 catalog_manager.cc:5697] T 2bf72bd1b7f841189a36dc8e9cc20b4c P ceb819e448e34d73b2cd02fdc2e3747c reported cstate change: term changed from 1 to 2, leader changed from 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195) to ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193). New cstate: current_term: 2 leader_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:43.032886 11449 consensus_queue.cc:1048] T 05b49fb53338498d94d1df63d6d809ef P ceb819e448e34d73b2cd02fdc2e3747c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:43.044317 11443 consensus_queue.cc:1048] T 05b49fb53338498d94d1df63d6d809ef P ceb819e448e34d73b2cd02fdc2e3747c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:43.053476 11443 raft_consensus.cc:993] T 05b49fb53338498d94d1df63d6d809ef P ceb819e448e34d73b2cd02fdc2e3747c: : Instructing follower 6fc0290ef4cf4ffa8c82c234ed04ff1d to start an election
I20260709 13:17:43.054020 11449 raft_consensus.cc:1081] T 05b49fb53338498d94d1df63d6d809ef P ceb819e448e34d73b2cd02fdc2e3747c [term 1 LEADER]: Signalling peer 6fc0290ef4cf4ffa8c82c234ed04ff1d to start an election
I20260709 13:17:43.055835 11187 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "05b49fb53338498d94d1df63d6d809ef"
dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d"
 from {username='slave'} at 127.0.0.1:47254
I20260709 13:17:43.056406 11187 raft_consensus.cc:493] T 05b49fb53338498d94d1df63d6d809ef P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:43.056792 11187 raft_consensus.cc:3060] T 05b49fb53338498d94d1df63d6d809ef P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:43.062347 11187 raft_consensus.cc:515] T 05b49fb53338498d94d1df63d6d809ef P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:43.064173 11187 leader_election.cc:290] T 05b49fb53338498d94d1df63d6d809ef P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 2 election: Requested vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195:33049)
I20260709 13:17:43.065029 11111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b49fb53338498d94d1df63d6d809ef" candidate_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c"
I20260709 13:17:43.065527 11260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b49fb53338498d94d1df63d6d809ef" candidate_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e"
I20260709 13:17:43.065779 11111 raft_consensus.cc:3055] T 05b49fb53338498d94d1df63d6d809ef P ceb819e448e34d73b2cd02fdc2e3747c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:43.066226 11260 raft_consensus.cc:3060] T 05b49fb53338498d94d1df63d6d809ef P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:43.066211 11111 raft_consensus.cc:740] T 05b49fb53338498d94d1df63d6d809ef P ceb819e448e34d73b2cd02fdc2e3747c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ceb819e448e34d73b2cd02fdc2e3747c, State: Running, Role: LEADER
I20260709 13:17:43.067366 11111 consensus_queue.cc:260] T 05b49fb53338498d94d1df63d6d809ef P ceb819e448e34d73b2cd02fdc2e3747c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:43.068893 11111 raft_consensus.cc:3060] T 05b49fb53338498d94d1df63d6d809ef P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:43.075443 11260 raft_consensus.cc:2468] T 05b49fb53338498d94d1df63d6d809ef P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fc0290ef4cf4ffa8c82c234ed04ff1d in term 2.
I20260709 13:17:43.076766 11154 leader_election.cc:304] T 05b49fb53338498d94d1df63d6d809ef P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, 7e5b746c9d10411cb2e3948be2e9db1e; no voters: 
I20260709 13:17:43.077518 11111 raft_consensus.cc:2468] T 05b49fb53338498d94d1df63d6d809ef P ceb819e448e34d73b2cd02fdc2e3747c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fc0290ef4cf4ffa8c82c234ed04ff1d in term 2.
I20260709 13:17:43.077720 11416 raft_consensus.cc:2804] T 05b49fb53338498d94d1df63d6d809ef P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:43.078369 11416 raft_consensus.cc:697] T 05b49fb53338498d94d1df63d6d809ef P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 LEADER]: Becoming Leader. State: Replica: 6fc0290ef4cf4ffa8c82c234ed04ff1d, State: Running, Role: LEADER
I20260709 13:17:43.079280 11416 consensus_queue.cc:237] T 05b49fb53338498d94d1df63d6d809ef P 6fc0290ef4cf4ffa8c82c234ed04ff1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:43.086481 11011 catalog_manager.cc:5697] T 05b49fb53338498d94d1df63d6d809ef P 6fc0290ef4cf4ffa8c82c234ed04ff1d reported cstate change: term changed from 1 to 2, leader changed from ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193) to 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194). New cstate: current_term: 2 leader_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:43.113370 11416 consensus_queue.cc:1048] T b4c4141fdaa04cffb06507e0010fefae P 6fc0290ef4cf4ffa8c82c234ed04ff1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:43.126588 11305 consensus_queue.cc:1048] T b4c4141fdaa04cffb06507e0010fefae P 6fc0290ef4cf4ffa8c82c234ed04ff1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:43.128782 11445 consensus_queue.cc:1048] T d0b8e0b882c143c5b45154837705e287 P 7e5b746c9d10411cb2e3948be2e9db1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:43.137799 11416 raft_consensus.cc:993] T b4c4141fdaa04cffb06507e0010fefae P 6fc0290ef4cf4ffa8c82c234ed04ff1d: : Instructing follower 7e5b746c9d10411cb2e3948be2e9db1e to start an election
I20260709 13:17:43.138332 11416 raft_consensus.cc:1081] T b4c4141fdaa04cffb06507e0010fefae P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 LEADER]: Signalling peer 7e5b746c9d10411cb2e3948be2e9db1e to start an election
I20260709 13:17:43.140123 11262 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4c4141fdaa04cffb06507e0010fefae"
dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e"
 from {username='slave'} at 127.0.0.1:53868
I20260709 13:17:43.140770 11262 raft_consensus.cc:493] T b4c4141fdaa04cffb06507e0010fefae P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:43.141170 11262 raft_consensus.cc:3060] T b4c4141fdaa04cffb06507e0010fefae P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:43.173714 11262 raft_consensus.cc:515] T b4c4141fdaa04cffb06507e0010fefae P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:43.175107 11420 consensus_queue.cc:1048] T d0b8e0b882c143c5b45154837705e287 P 7e5b746c9d10411cb2e3948be2e9db1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:43.176189 11262 leader_election.cc:290] T b4c4141fdaa04cffb06507e0010fefae P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 2 election: Requested vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941)
I20260709 13:17:43.178027 11443 consensus_queue.cc:1048] T 7aae7b1e191e428d9abcb7c76f088181 P ceb819e448e34d73b2cd02fdc2e3747c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:43.181162 11187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4c4141fdaa04cffb06507e0010fefae" candidate_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d"
I20260709 13:17:43.182598 11449 consensus_queue.cc:1048] T 7aae7b1e191e428d9abcb7c76f088181 P ceb819e448e34d73b2cd02fdc2e3747c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:43.188832 11187 raft_consensus.cc:3055] T b4c4141fdaa04cffb06507e0010fefae P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:43.189870 11187 raft_consensus.cc:740] T b4c4141fdaa04cffb06507e0010fefae P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6fc0290ef4cf4ffa8c82c234ed04ff1d, State: Running, Role: LEADER
I20260709 13:17:43.191274 11187 consensus_queue.cc:260] T b4c4141fdaa04cffb06507e0010fefae P 6fc0290ef4cf4ffa8c82c234ed04ff1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:43.193920 11187 raft_consensus.cc:3060] T b4c4141fdaa04cffb06507e0010fefae P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:43.195736 11416 raft_consensus.cc:993] T 6eab4df2be764be5b57dcd1fc08345fd P 6fc0290ef4cf4ffa8c82c234ed04ff1d: : Instructing follower ceb819e448e34d73b2cd02fdc2e3747c to start an election
I20260709 13:17:43.198863 11416 raft_consensus.cc:1081] T 6eab4df2be764be5b57dcd1fc08345fd P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 LEADER]: Signalling peer ceb819e448e34d73b2cd02fdc2e3747c to start an election
I20260709 13:17:43.200148 11441 raft_consensus.cc:993] T 7aae7b1e191e428d9abcb7c76f088181 P ceb819e448e34d73b2cd02fdc2e3747c: : Instructing follower 6fc0290ef4cf4ffa8c82c234ed04ff1d to start an election
I20260709 13:17:43.200738 11441 raft_consensus.cc:1081] T 7aae7b1e191e428d9abcb7c76f088181 P ceb819e448e34d73b2cd02fdc2e3747c [term 1 LEADER]: Signalling peer 6fc0290ef4cf4ffa8c82c234ed04ff1d to start an election
I20260709 13:17:43.187943 11111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4c4141fdaa04cffb06507e0010fefae" candidate_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c"
I20260709 13:17:43.200887 11110 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6eab4df2be764be5b57dcd1fc08345fd"
dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c"
 from {username='slave'} at 127.0.0.1:55880
I20260709 13:17:43.201414 11111 raft_consensus.cc:3060] T b4c4141fdaa04cffb06507e0010fefae P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:43.201591 11110 raft_consensus.cc:493] T 6eab4df2be764be5b57dcd1fc08345fd P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:43.202083 11110 raft_consensus.cc:3060] T 6eab4df2be764be5b57dcd1fc08345fd P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:43.205175 11188 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7aae7b1e191e428d9abcb7c76f088181"
dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d"
 from {username='slave'} at 127.0.0.1:47254
I20260709 13:17:43.205809 11188 raft_consensus.cc:493] T 7aae7b1e191e428d9abcb7c76f088181 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:43.206154 11188 raft_consensus.cc:3060] T 7aae7b1e191e428d9abcb7c76f088181 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:43.217232 11414 raft_consensus.cc:993] T f184ae5efb4641d9b6442c2a743f1f81 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: : Instructing follower ceb819e448e34d73b2cd02fdc2e3747c to start an election
I20260709 13:17:43.217869 11414 raft_consensus.cc:1081] T f184ae5efb4641d9b6442c2a743f1f81 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 LEADER]: Signalling peer ceb819e448e34d73b2cd02fdc2e3747c to start an election
I20260709 13:17:43.219326 11420 raft_consensus.cc:993] T d0b8e0b882c143c5b45154837705e287 P 7e5b746c9d10411cb2e3948be2e9db1e: : Instructing follower ceb819e448e34d73b2cd02fdc2e3747c to start an election
I20260709 13:17:43.219898 11420 raft_consensus.cc:1081] T d0b8e0b882c143c5b45154837705e287 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 LEADER]: Signalling peer ceb819e448e34d73b2cd02fdc2e3747c to start an election
I20260709 13:17:43.220362 11113 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f184ae5efb4641d9b6442c2a743f1f81"
dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c"
 from {username='slave'} at 127.0.0.1:55880
I20260709 13:17:43.221074 11113 raft_consensus.cc:493] T f184ae5efb4641d9b6442c2a743f1f81 P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:43.221503 11113 raft_consensus.cc:3060] T f184ae5efb4641d9b6442c2a743f1f81 P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:43.223891 11109 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0b8e0b882c143c5b45154837705e287"
dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c"
 from {username='slave'} at 127.0.0.1:55888
I20260709 13:17:43.224671 11109 raft_consensus.cc:493] T d0b8e0b882c143c5b45154837705e287 P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:43.225024 11109 raft_consensus.cc:3060] T d0b8e0b882c143c5b45154837705e287 P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:43.236203 11187 raft_consensus.cc:2468] T b4c4141fdaa04cffb06507e0010fefae P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e5b746c9d10411cb2e3948be2e9db1e in term 2.
I20260709 13:17:43.238023 11225 leader_election.cc:304] T b4c4141fdaa04cffb06507e0010fefae P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, 7e5b746c9d10411cb2e3948be2e9db1e; no voters: 
I20260709 13:17:43.239058 11445 raft_consensus.cc:2804] T b4c4141fdaa04cffb06507e0010fefae P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:43.239565 11445 raft_consensus.cc:697] T b4c4141fdaa04cffb06507e0010fefae P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 LEADER]: Becoming Leader. State: Replica: 7e5b746c9d10411cb2e3948be2e9db1e, State: Running, Role: LEADER
I20260709 13:17:43.240510 11188 raft_consensus.cc:515] T 7aae7b1e191e428d9abcb7c76f088181 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:43.240577 11445 consensus_queue.cc:237] T b4c4141fdaa04cffb06507e0010fefae P 7e5b746c9d10411cb2e3948be2e9db1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:43.242354 11186 raft_consensus.cc:1240] T 7aae7b1e191e428d9abcb7c76f088181 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 FOLLOWER]: Rejecting Update request from peer ceb819e448e34d73b2cd02fdc2e3747c for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:43.243121 11188 leader_election.cc:290] T 7aae7b1e191e428d9abcb7c76f088181 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 2 election: Requested vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195:33049)
I20260709 13:17:43.245044 11260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aae7b1e191e428d9abcb7c76f088181" candidate_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e"
I20260709 13:17:43.245765 11260 raft_consensus.cc:3060] T 7aae7b1e191e428d9abcb7c76f088181 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:43.246080 11112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aae7b1e191e428d9abcb7c76f088181" candidate_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c"
I20260709 13:17:43.246747 11112 raft_consensus.cc:3055] T 7aae7b1e191e428d9abcb7c76f088181 P ceb819e448e34d73b2cd02fdc2e3747c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:43.247009 11112 raft_consensus.cc:740] T 7aae7b1e191e428d9abcb7c76f088181 P ceb819e448e34d73b2cd02fdc2e3747c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ceb819e448e34d73b2cd02fdc2e3747c, State: Running, Role: LEADER
I20260709 13:17:43.249161 11112 consensus_queue.cc:260] T 7aae7b1e191e428d9abcb7c76f088181 P ceb819e448e34d73b2cd02fdc2e3747c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:43.250214 11111 raft_consensus.cc:2468] T b4c4141fdaa04cffb06507e0010fefae P ceb819e448e34d73b2cd02fdc2e3747c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e5b746c9d10411cb2e3948be2e9db1e in term 2.
I20260709 13:17:43.245740 11110 raft_consensus.cc:515] T 6eab4df2be764be5b57dcd1fc08345fd P ceb819e448e34d73b2cd02fdc2e3747c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:43.253558 11110 leader_election.cc:290] T 6eab4df2be764be5b57dcd1fc08345fd P ceb819e448e34d73b2cd02fdc2e3747c [CANDIDATE]: Term 2 election: Requested vote from peers 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941), 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195:33049)
I20260709 13:17:43.254776 11262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eab4df2be764be5b57dcd1fc08345fd" candidate_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e"
I20260709 13:17:43.255463 11262 raft_consensus.cc:3060] T 6eab4df2be764be5b57dcd1fc08345fd P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:43.255716 11109 raft_consensus.cc:515] T d0b8e0b882c143c5b45154837705e287 P ceb819e448e34d73b2cd02fdc2e3747c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:43.256261 11260 raft_consensus.cc:2468] T 7aae7b1e191e428d9abcb7c76f088181 P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fc0290ef4cf4ffa8c82c234ed04ff1d in term 2.
I20260709 13:17:43.250309 11112 raft_consensus.cc:3060] T 7aae7b1e191e428d9abcb7c76f088181 P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:43.257818 11154 leader_election.cc:304] T 7aae7b1e191e428d9abcb7c76f088181 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, 7e5b746c9d10411cb2e3948be2e9db1e; no voters: 
I20260709 13:17:43.258739 11416 raft_consensus.cc:2804] T 7aae7b1e191e428d9abcb7c76f088181 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:43.259423 11416 raft_consensus.cc:697] T 7aae7b1e191e428d9abcb7c76f088181 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 LEADER]: Becoming Leader. State: Replica: 6fc0290ef4cf4ffa8c82c234ed04ff1d, State: Running, Role: LEADER
I20260709 13:17:43.260421 11416 consensus_queue.cc:237] T 7aae7b1e191e428d9abcb7c76f088181 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:43.263266 11262 raft_consensus.cc:2468] T 6eab4df2be764be5b57dcd1fc08345fd P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb819e448e34d73b2cd02fdc2e3747c in term 2.
I20260709 13:17:43.264791 11079 leader_election.cc:304] T 6eab4df2be764be5b57dcd1fc08345fd P ceb819e448e34d73b2cd02fdc2e3747c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e5b746c9d10411cb2e3948be2e9db1e, ceb819e448e34d73b2cd02fdc2e3747c; no voters: 
I20260709 13:17:43.265707 11378 raft_consensus.cc:2804] T 6eab4df2be764be5b57dcd1fc08345fd P ceb819e448e34d73b2cd02fdc2e3747c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:43.265671 11186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eab4df2be764be5b57dcd1fc08345fd" candidate_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d"
I20260709 13:17:43.266206 11187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b8e0b882c143c5b45154837705e287" candidate_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d"
I20260709 13:17:43.266844 11187 raft_consensus.cc:3060] T d0b8e0b882c143c5b45154837705e287 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:43.266525 11378 raft_consensus.cc:697] T 6eab4df2be764be5b57dcd1fc08345fd P ceb819e448e34d73b2cd02fdc2e3747c [term 2 LEADER]: Becoming Leader. State: Replica: ceb819e448e34d73b2cd02fdc2e3747c, State: Running, Role: LEADER
I20260709 13:17:43.266491 11113 raft_consensus.cc:515] T f184ae5efb4641d9b6442c2a743f1f81 P ceb819e448e34d73b2cd02fdc2e3747c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:43.264909 11011 catalog_manager.cc:5697] T b4c4141fdaa04cffb06507e0010fefae P 7e5b746c9d10411cb2e3948be2e9db1e reported cstate change: term changed from 1 to 2, leader changed from 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194) to 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195). New cstate: current_term: 2 leader_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:43.268185 11378 consensus_queue.cc:237] T 6eab4df2be764be5b57dcd1fc08345fd P ceb819e448e34d73b2cd02fdc2e3747c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:43.269538 11113 leader_election.cc:290] T f184ae5efb4641d9b6442c2a743f1f81 P ceb819e448e34d73b2cd02fdc2e3747c [CANDIDATE]: Term 2 election: Requested vote from peers 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941), 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195:33049)
I20260709 13:17:43.270886 11262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f184ae5efb4641d9b6442c2a743f1f81" candidate_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e"
I20260709 13:17:43.271868 11262 raft_consensus.cc:3060] T f184ae5efb4641d9b6442c2a743f1f81 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:43.266695 11186 raft_consensus.cc:3055] T 6eab4df2be764be5b57dcd1fc08345fd P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:43.275393 11186 raft_consensus.cc:740] T 6eab4df2be764be5b57dcd1fc08345fd P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6fc0290ef4cf4ffa8c82c234ed04ff1d, State: Running, Role: LEADER
I20260709 13:17:43.276494 11186 consensus_queue.cc:260] T 6eab4df2be764be5b57dcd1fc08345fd P 6fc0290ef4cf4ffa8c82c234ed04ff1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:43.280400 11186 raft_consensus.cc:3060] T 6eab4df2be764be5b57dcd1fc08345fd P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:43.281424 11112 raft_consensus.cc:2468] T 7aae7b1e191e428d9abcb7c76f088181 P ceb819e448e34d73b2cd02fdc2e3747c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fc0290ef4cf4ffa8c82c234ed04ff1d in term 2.
I20260709 13:17:43.286527 11262 raft_consensus.cc:2468] T f184ae5efb4641d9b6442c2a743f1f81 P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb819e448e34d73b2cd02fdc2e3747c in term 2.
I20260709 13:17:43.287963 11079 leader_election.cc:304] T f184ae5efb4641d9b6442c2a743f1f81 P ceb819e448e34d73b2cd02fdc2e3747c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e5b746c9d10411cb2e3948be2e9db1e, ceb819e448e34d73b2cd02fdc2e3747c; no voters: 
I20260709 13:17:43.288455 11109 leader_election.cc:290] T d0b8e0b882c143c5b45154837705e287 P ceb819e448e34d73b2cd02fdc2e3747c [CANDIDATE]: Term 2 election: Requested vote from peers 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941), 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195:33049)
I20260709 13:17:43.289503 11188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f184ae5efb4641d9b6442c2a743f1f81" candidate_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d"
I20260709 13:17:43.290233 11188 raft_consensus.cc:3055] T f184ae5efb4641d9b6442c2a743f1f81 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:43.290578 11188 raft_consensus.cc:740] T f184ae5efb4641d9b6442c2a743f1f81 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6fc0290ef4cf4ffa8c82c234ed04ff1d, State: Running, Role: LEADER
I20260709 13:17:43.291153 11378 raft_consensus.cc:2804] T f184ae5efb4641d9b6442c2a743f1f81 P ceb819e448e34d73b2cd02fdc2e3747c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:43.290771 11007 catalog_manager.cc:5697] T 6eab4df2be764be5b57dcd1fc08345fd P ceb819e448e34d73b2cd02fdc2e3747c reported cstate change: term changed from 1 to 2, leader changed from 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194) to ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193). New cstate: current_term: 2 leader_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:43.291733 11188 consensus_queue.cc:260] T f184ae5efb4641d9b6442c2a743f1f81 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:43.291754 11378 raft_consensus.cc:697] T f184ae5efb4641d9b6442c2a743f1f81 P ceb819e448e34d73b2cd02fdc2e3747c [term 2 LEADER]: Becoming Leader. State: Replica: ceb819e448e34d73b2cd02fdc2e3747c, State: Running, Role: LEADER
I20260709 13:17:43.293231 11188 raft_consensus.cc:3060] T f184ae5efb4641d9b6442c2a743f1f81 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:43.290433 11260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b8e0b882c143c5b45154837705e287" candidate_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e"
I20260709 13:17:43.293598 11378 consensus_queue.cc:237] T f184ae5efb4641d9b6442c2a743f1f81 P ceb819e448e34d73b2cd02fdc2e3747c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:43.294358 11260 raft_consensus.cc:3055] T d0b8e0b882c143c5b45154837705e287 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:43.294688 11260 raft_consensus.cc:740] T d0b8e0b882c143c5b45154837705e287 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e5b746c9d10411cb2e3948be2e9db1e, State: Running, Role: LEADER
I20260709 13:17:43.295554 11260 consensus_queue.cc:260] T d0b8e0b882c143c5b45154837705e287 P 7e5b746c9d10411cb2e3948be2e9db1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:43.297047 11187 raft_consensus.cc:2468] T d0b8e0b882c143c5b45154837705e287 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb819e448e34d73b2cd02fdc2e3747c in term 2.
I20260709 13:17:43.298324 11260 raft_consensus.cc:3060] T d0b8e0b882c143c5b45154837705e287 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:43.298393 11076 leader_election.cc:304] T d0b8e0b882c143c5b45154837705e287 P ceb819e448e34d73b2cd02fdc2e3747c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, ceb819e448e34d73b2cd02fdc2e3747c; no voters: 
I20260709 13:17:43.299973 11378 raft_consensus.cc:2804] T d0b8e0b882c143c5b45154837705e287 P ceb819e448e34d73b2cd02fdc2e3747c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:43.305780 11378 raft_consensus.cc:697] T d0b8e0b882c143c5b45154837705e287 P ceb819e448e34d73b2cd02fdc2e3747c [term 2 LEADER]: Becoming Leader. State: Replica: ceb819e448e34d73b2cd02fdc2e3747c, State: Running, Role: LEADER
I20260709 13:17:43.306799 11378 consensus_queue.cc:237] T d0b8e0b882c143c5b45154837705e287 P ceb819e448e34d73b2cd02fdc2e3747c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:43.309232 11260 raft_consensus.cc:2468] T d0b8e0b882c143c5b45154837705e287 P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb819e448e34d73b2cd02fdc2e3747c in term 2.
I20260709 13:17:43.308820 11007 catalog_manager.cc:5697] T f184ae5efb4641d9b6442c2a743f1f81 P ceb819e448e34d73b2cd02fdc2e3747c reported cstate change: term changed from 1 to 2, leader changed from 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194) to ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193). New cstate: current_term: 2 leader_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:43.303795 11011 catalog_manager.cc:5697] T 7aae7b1e191e428d9abcb7c76f088181 P 6fc0290ef4cf4ffa8c82c234ed04ff1d reported cstate change: term changed from 1 to 2, leader changed from ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193) to 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194). New cstate: current_term: 2 leader_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:43.304697 11188 raft_consensus.cc:2468] T f184ae5efb4641d9b6442c2a743f1f81 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb819e448e34d73b2cd02fdc2e3747c in term 2.
I20260709 13:17:43.315343 11186 raft_consensus.cc:2468] T 6eab4df2be764be5b57dcd1fc08345fd P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb819e448e34d73b2cd02fdc2e3747c in term 2.
I20260709 13:17:43.326714 11007 catalog_manager.cc:5697] T d0b8e0b882c143c5b45154837705e287 P ceb819e448e34d73b2cd02fdc2e3747c reported cstate change: term changed from 1 to 2, leader changed from 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195) to ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193). New cstate: current_term: 2 leader_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:43.395488 11186 raft_consensus.cc:1275] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 FOLLOWER]: Refusing update from remote peer ceb819e448e34d73b2cd02fdc2e3747c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:43.396996 11378 consensus_queue.cc:1048] T 2bf72bd1b7f841189a36dc8e9cc20b4c P ceb819e448e34d73b2cd02fdc2e3747c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:43.405018 11260 raft_consensus.cc:1275] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Refusing update from remote peer ceb819e448e34d73b2cd02fdc2e3747c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:43.406914 11378 consensus_queue.cc:1048] T 2bf72bd1b7f841189a36dc8e9cc20b4c P ceb819e448e34d73b2cd02fdc2e3747c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:43.610705 11109 raft_consensus.cc:1275] T 05b49fb53338498d94d1df63d6d809ef P ceb819e448e34d73b2cd02fdc2e3747c [term 2 FOLLOWER]: Refusing update from remote peer 6fc0290ef4cf4ffa8c82c234ed04ff1d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:43.612493 11416 consensus_queue.cc:1048] T 05b49fb53338498d94d1df63d6d809ef P 6fc0290ef4cf4ffa8c82c234ed04ff1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:43.625927 11260 raft_consensus.cc:1275] T 05b49fb53338498d94d1df63d6d809ef P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Refusing update from remote peer 6fc0290ef4cf4ffa8c82c234ed04ff1d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:43.627806 11416 consensus_queue.cc:1048] T 05b49fb53338498d94d1df63d6d809ef P 6fc0290ef4cf4ffa8c82c234ed04ff1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:43.723168 11186 raft_consensus.cc:1275] T 6eab4df2be764be5b57dcd1fc08345fd P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 FOLLOWER]: Refusing update from remote peer ceb819e448e34d73b2cd02fdc2e3747c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:43.724503 11378 consensus_queue.cc:1048] T 6eab4df2be764be5b57dcd1fc08345fd P ceb819e448e34d73b2cd02fdc2e3747c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:43.728293 11260 raft_consensus.cc:1275] T 6eab4df2be764be5b57dcd1fc08345fd P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Refusing update from remote peer ceb819e448e34d73b2cd02fdc2e3747c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:43.729777 11449 consensus_queue.cc:1048] T 6eab4df2be764be5b57dcd1fc08345fd P ceb819e448e34d73b2cd02fdc2e3747c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:43.730621 11260 raft_consensus.cc:1275] T f184ae5efb4641d9b6442c2a743f1f81 P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Refusing update from remote peer ceb819e448e34d73b2cd02fdc2e3747c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:43.732692 11441 consensus_queue.cc:1048] T f184ae5efb4641d9b6442c2a743f1f81 P ceb819e448e34d73b2cd02fdc2e3747c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:43.746824 11261 raft_consensus.cc:1275] T d0b8e0b882c143c5b45154837705e287 P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Refusing update from remote peer ceb819e448e34d73b2cd02fdc2e3747c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:43.748678 11473 consensus_queue.cc:1048] T d0b8e0b882c143c5b45154837705e287 P ceb819e448e34d73b2cd02fdc2e3747c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:43.762776 11259 raft_consensus.cc:1275] T 7aae7b1e191e428d9abcb7c76f088181 P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Refusing update from remote peer 6fc0290ef4cf4ffa8c82c234ed04ff1d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:43.764889 11416 consensus_queue.cc:1048] T 7aae7b1e191e428d9abcb7c76f088181 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:43.765084 11109 raft_consensus.cc:1275] T 7aae7b1e191e428d9abcb7c76f088181 P ceb819e448e34d73b2cd02fdc2e3747c [term 2 FOLLOWER]: Refusing update from remote peer 6fc0290ef4cf4ffa8c82c234ed04ff1d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:43.765455 11186 raft_consensus.cc:1275] T f184ae5efb4641d9b6442c2a743f1f81 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 FOLLOWER]: Refusing update from remote peer ceb819e448e34d73b2cd02fdc2e3747c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:43.767210 11188 raft_consensus.cc:1275] T d0b8e0b882c143c5b45154837705e287 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 FOLLOWER]: Refusing update from remote peer ceb819e448e34d73b2cd02fdc2e3747c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:43.767907 11416 consensus_queue.cc:1048] T 7aae7b1e191e428d9abcb7c76f088181 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:43.768677 11441 consensus_queue.cc:1048] T d0b8e0b882c143c5b45154837705e287 P ceb819e448e34d73b2cd02fdc2e3747c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:43.767096 11473 consensus_queue.cc:1048] T f184ae5efb4641d9b6442c2a743f1f81 P ceb819e448e34d73b2cd02fdc2e3747c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:43.833118 11188 raft_consensus.cc:1275] T b4c4141fdaa04cffb06507e0010fefae P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 FOLLOWER]: Refusing update from remote peer 7e5b746c9d10411cb2e3948be2e9db1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:43.835330 11445 consensus_queue.cc:1048] T b4c4141fdaa04cffb06507e0010fefae P 7e5b746c9d10411cb2e3948be2e9db1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:43.837232 11109 raft_consensus.cc:1275] T b4c4141fdaa04cffb06507e0010fefae P ceb819e448e34d73b2cd02fdc2e3747c [term 2 FOLLOWER]: Refusing update from remote peer 7e5b746c9d10411cb2e3948be2e9db1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:43.838796 11445 consensus_queue.cc:1048] T b4c4141fdaa04cffb06507e0010fefae P 7e5b746c9d10411cb2e3948be2e9db1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:45.918298 11007 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58318:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:17:45.944977 11007 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58318:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:17:45.985221  2843 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 13:17:46.132855 11499 log.cc:927] Time spent T 2bf72bd1b7f841189a36dc8e9cc20b4c P ceb819e448e34d73b2cd02fdc2e3747c: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
W20260709 13:17:46.151301 11503 log.cc:927] Time spent T f184ae5efb4641d9b6442c2a743f1f81 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
W20260709 13:17:46.213441 11076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:42941, user_credentials={real_user=slave}} blocked reactor thread for 59926.9us
I20260709 13:17:46.244905 11187 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05b49fb53338498d94d1df63d6d809ef"
dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d"
mode: GRACEFUL
new_leader_uuid: "7e5b746c9d10411cb2e3948be2e9db1e"
 from {username='slave'} at 127.0.0.1:40602
I20260709 13:17:46.245607 11187 raft_consensus.cc:606] T 05b49fb53338498d94d1df63d6d809ef P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 LEADER]: Received request to transfer leadership to TS 7e5b746c9d10411cb2e3948be2e9db1e
W20260709 13:17:46.251492 11518 log.cc:927] Time spent T deff9c42898e48bdaa4575ff88e733a6 P 7e5b746c9d10411cb2e3948be2e9db1e: Append to log took a long time: real 0.087s	user 0.000s	sys 0.003s
W20260709 13:17:46.298942 11524 log.cc:927] Time spent T d0b8e0b882c143c5b45154837705e287 P 7e5b746c9d10411cb2e3948be2e9db1e: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
W20260709 13:17:46.288621 11225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:42941, user_credentials={real_user=slave}} blocked reactor thread for 43501us
W20260709 13:17:46.336205 11525 log.cc:927] Time spent T 1b8455bef8cb45b8b9cb5ff12454264f P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:17:46.338125 11542 tablet.cc:1724] T f184ae5efb4641d9b6442c2a743f1f81 P ceb819e448e34d73b2cd02fdc2e3747c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:46.343813 11541 tablet.cc:1724] T f184ae5efb4641d9b6442c2a743f1f81 P 7e5b746c9d10411cb2e3948be2e9db1e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:17:46.358564 11531 log.cc:927] Time spent T b4c4141fdaa04cffb06507e0010fefae P 7e5b746c9d10411cb2e3948be2e9db1e: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:17:46.358677 11538 tablet.cc:1724] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:17:46.360556 11533 log.cc:927] Time spent T 6eab4df2be764be5b57dcd1fc08345fd P 7e5b746c9d10411cb2e3948be2e9db1e: Append to log took a long time: real 0.059s	user 0.002s	sys 0.000s
W20260709 13:17:46.361616 11527 log.cc:927] Time spent T 05b49fb53338498d94d1df63d6d809ef P 7e5b746c9d10411cb2e3948be2e9db1e: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260709 13:17:46.368438 11535 log.cc:927] Time spent T 7aae7b1e191e428d9abcb7c76f088181 P 7e5b746c9d10411cb2e3948be2e9db1e: Append to log took a long time: real 0.067s	user 0.000s	sys 0.002s
I20260709 13:17:46.368608 11528 raft_consensus.cc:993] T 05b49fb53338498d94d1df63d6d809ef P 6fc0290ef4cf4ffa8c82c234ed04ff1d: : Instructing follower 7e5b746c9d10411cb2e3948be2e9db1e to start an election
I20260709 13:17:46.369215 11528 raft_consensus.cc:1081] T 05b49fb53338498d94d1df63d6d809ef P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 LEADER]: Signalling peer 7e5b746c9d10411cb2e3948be2e9db1e to start an election
I20260709 13:17:46.369554 11537 tablet.cc:1724] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:46.383116 11543 tablet.cc:1724] T d0b8e0b882c143c5b45154837705e287 P ceb819e448e34d73b2cd02fdc2e3747c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:17:46.409957 11076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:42941, user_credentials={real_user=slave}} blocked reactor thread for 166871us
I20260709 13:17:46.427165 11547 tablet.cc:1724] T b4c4141fdaa04cffb06507e0010fefae P 7e5b746c9d10411cb2e3948be2e9db1e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:46.415549 11540 tablet.cc:1724] T 2bf72bd1b7f841189a36dc8e9cc20b4c P ceb819e448e34d73b2cd02fdc2e3747c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:46.449767 11549 tablet.cc:1724] T b4c4141fdaa04cffb06507e0010fefae P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:46.472057 11537 tablet.cc:1724] T 05b49fb53338498d94d1df63d6d809ef P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:46.474134 11258 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "05b49fb53338498d94d1df63d6d809ef"
dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e"
 from {username='slave'} at 127.0.0.1:53868
I20260709 13:17:46.481330 11541 tablet.cc:1724] T 05b49fb53338498d94d1df63d6d809ef P 7e5b746c9d10411cb2e3948be2e9db1e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:46.483441 11552 tablet.cc:1724] T b4c4141fdaa04cffb06507e0010fefae P ceb819e448e34d73b2cd02fdc2e3747c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:46.488102 11548 tablet.cc:1724] T deff9c42898e48bdaa4575ff88e733a6 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:17:46.492316 11209 debug-util.cc:398] Leaking SignalData structure 0x7b08002b1300 after lost signal to thread 2846
W20260709 13:17:46.493762 11209 debug-util.cc:398] Leaking SignalData structure 0x7b080013aa60 after lost signal to thread 11045
W20260709 13:17:46.497963 11209 debug-util.cc:398] Leaking SignalData structure 0x7b08000cede0 after lost signal to thread 11286
I20260709 13:17:46.520948 11552 tablet.cc:1724] T 6eab4df2be764be5b57dcd1fc08345fd P ceb819e448e34d73b2cd02fdc2e3747c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:46.528013 11258 raft_consensus.cc:493] T 05b49fb53338498d94d1df63d6d809ef P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:46.502488 11553 tablet.cc:1724] T f184ae5efb4641d9b6442c2a743f1f81 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:46.537575 11555 tablet.cc:1724] T d0b8e0b882c143c5b45154837705e287 P 7e5b746c9d10411cb2e3948be2e9db1e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:46.537931 11258 raft_consensus.cc:3060] T 05b49fb53338498d94d1df63d6d809ef P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:46.542922 11543 tablet.cc:1724] T deff9c42898e48bdaa4575ff88e733a6 P ceb819e448e34d73b2cd02fdc2e3747c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:46.549855 11552 tablet.cc:1724] T 1b8455bef8cb45b8b9cb5ff12454264f P ceb819e448e34d73b2cd02fdc2e3747c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:46.555485 11258 raft_consensus.cc:515] T 05b49fb53338498d94d1df63d6d809ef P 7e5b746c9d10411cb2e3948be2e9db1e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:46.555945 11542 tablet.cc:1724] T 7aae7b1e191e428d9abcb7c76f088181 P ceb819e448e34d73b2cd02fdc2e3747c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:46.567211 11547 tablet.cc:1724] T 6eab4df2be764be5b57dcd1fc08345fd P 7e5b746c9d10411cb2e3948be2e9db1e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:46.569904 11113 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2bf72bd1b7f841189a36dc8e9cc20b4c"
dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c"
mode: GRACEFUL
new_leader_uuid: "7e5b746c9d10411cb2e3948be2e9db1e"
 from {username='slave'} at 127.0.0.1:36202
I20260709 13:17:46.570722 11113 raft_consensus.cc:606] T 2bf72bd1b7f841189a36dc8e9cc20b4c P ceb819e448e34d73b2cd02fdc2e3747c [term 2 LEADER]: Received request to transfer leadership to TS 7e5b746c9d10411cb2e3948be2e9db1e
I20260709 13:17:46.573462  2843 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:17:46.574203  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:17:46.577420 11288 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:05b49fb53338498d94d1df63d6d809ef)
I20260709 13:17:46.577318 11538 tablet.cc:1724] T 7aae7b1e191e428d9abcb7c76f088181 P 7e5b746c9d10411cb2e3948be2e9db1e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:46.580072 11113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b49fb53338498d94d1df63d6d809ef" candidate_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c"
I20260709 13:17:46.580765 11113 raft_consensus.cc:3060] T 05b49fb53338498d94d1df63d6d809ef P ceb819e448e34d73b2cd02fdc2e3747c [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:46.583330 11288 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:05b49fb53338498d94d1df63d6d809ef)
W20260709 13:17:46.584293 11288 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:05b49fb53338498d94d1df63d6d809ef)
I20260709 13:17:46.592921 11552 tablet.cc:1724] T 05b49fb53338498d94d1df63d6d809ef P ceb819e448e34d73b2cd02fdc2e3747c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:46.606621 11186 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4f71e70f87441408c0353d089d9557d"
dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d"
mode: GRACEFUL
new_leader_uuid: "7e5b746c9d10411cb2e3948be2e9db1e"
 from {username='slave'} at 127.0.0.1:40602
I20260709 13:17:46.609483 11186 raft_consensus.cc:606] T c4f71e70f87441408c0353d089d9557d P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 LEADER]: Received request to transfer leadership to TS 7e5b746c9d10411cb2e3948be2e9db1e
I20260709 13:17:46.615767 11258 leader_election.cc:290] T 05b49fb53338498d94d1df63d6d809ef P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 3 election: Requested vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941)
I20260709 13:17:46.615936 11110 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7e16d7d38af4781975f803c3d05e208"
dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c"
mode: GRACEFUL
new_leader_uuid: "7e5b746c9d10411cb2e3948be2e9db1e"
 from {username='slave'} at 127.0.0.1:36202
I20260709 13:17:46.616739 11110 raft_consensus.cc:606] T e7e16d7d38af4781975f803c3d05e208 P ceb819e448e34d73b2cd02fdc2e3747c [term 2 LEADER]: Received request to transfer leadership to TS 7e5b746c9d10411cb2e3948be2e9db1e
I20260709 13:17:46.617017 11186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b49fb53338498d94d1df63d6d809ef" candidate_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d"
I20260709 13:17:46.617731 11186 raft_consensus.cc:3055] T 05b49fb53338498d94d1df63d6d809ef P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:46.618093 11186 raft_consensus.cc:740] T 05b49fb53338498d94d1df63d6d809ef P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6fc0290ef4cf4ffa8c82c234ed04ff1d, State: Running, Role: LEADER
I20260709 13:17:46.617486 11541 tablet.cc:1724] T deff9c42898e48bdaa4575ff88e733a6 P 7e5b746c9d10411cb2e3948be2e9db1e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:46.619346 11186 consensus_queue.cc:260] T 05b49fb53338498d94d1df63d6d809ef P 6fc0290ef4cf4ffa8c82c234ed04ff1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:46.620906 11548 tablet.cc:1724] T d0b8e0b882c143c5b45154837705e287 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:46.623639 11186 raft_consensus.cc:3060] T 05b49fb53338498d94d1df63d6d809ef P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:46.624257  2843 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:17:46.625833 11113 raft_consensus.cc:2468] T 05b49fb53338498d94d1df63d6d809ef P ceb819e448e34d73b2cd02fdc2e3747c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e5b746c9d10411cb2e3948be2e9db1e in term 3.
I20260709 13:17:46.627919 11225 leader_election.cc:304] T 05b49fb53338498d94d1df63d6d809ef P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e5b746c9d10411cb2e3948be2e9db1e, ceb819e448e34d73b2cd02fdc2e3747c; no voters: 
I20260709 13:17:46.629467 11554 raft_consensus.cc:2804] T 05b49fb53338498d94d1df63d6d809ef P 7e5b746c9d10411cb2e3948be2e9db1e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:46.629951 11554 raft_consensus.cc:697] T 05b49fb53338498d94d1df63d6d809ef P 7e5b746c9d10411cb2e3948be2e9db1e [term 3 LEADER]: Becoming Leader. State: Replica: 7e5b746c9d10411cb2e3948be2e9db1e, State: Running, Role: LEADER
I20260709 13:17:46.625296  2843 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:46.630894 11554 consensus_queue.cc:237] T 05b49fb53338498d94d1df63d6d809ef P 7e5b746c9d10411cb2e3948be2e9db1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:46.638764 11553 tablet.cc:1724] T 7aae7b1e191e428d9abcb7c76f088181 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:46.654011 11547 tablet.cc:1724] T 1b8455bef8cb45b8b9cb5ff12454264f P 7e5b746c9d10411cb2e3948be2e9db1e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:46.636731 11537 tablet.cc:1724] T 1b8455bef8cb45b8b9cb5ff12454264f P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:46.657721 11007 catalog_manager.cc:5697] T 05b49fb53338498d94d1df63d6d809ef P 7e5b746c9d10411cb2e3948be2e9db1e reported cstate change: term changed from 2 to 3, leader changed from 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194) to 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195). New cstate: current_term: 3 leader_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:46.646759 11549 tablet.cc:1724] T 6eab4df2be764be5b57dcd1fc08345fd P 6fc0290ef4cf4ffa8c82c234ed04ff1d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:17:46.691799 11186 raft_consensus.cc:2468] T 05b49fb53338498d94d1df63d6d809ef P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e5b746c9d10411cb2e3948be2e9db1e in term 3.
I20260709 13:17:46.703862 11009 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 46ac69a322c84e148564f67454fb0dbb: soft_deleted_table [id=7f6417f6e4c549b0967edc12b45fbec1] alter complete (version 1)
I20260709 13:17:46.798339 11526 raft_consensus.cc:993] T e7e16d7d38af4781975f803c3d05e208 P ceb819e448e34d73b2cd02fdc2e3747c: : Instructing follower 7e5b746c9d10411cb2e3948be2e9db1e to start an election
I20260709 13:17:46.799034 11550 raft_consensus.cc:1081] T e7e16d7d38af4781975f803c3d05e208 P ceb819e448e34d73b2cd02fdc2e3747c [term 2 LEADER]: Signalling peer 7e5b746c9d10411cb2e3948be2e9db1e to start an election
I20260709 13:17:46.800729 11258 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7e16d7d38af4781975f803c3d05e208"
dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e"
 from {username='slave'} at 127.0.0.1:53876
I20260709 13:17:46.801384 11258 raft_consensus.cc:493] T e7e16d7d38af4781975f803c3d05e208 P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:46.801779 11258 raft_consensus.cc:3060] T e7e16d7d38af4781975f803c3d05e208 P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:46.811133 11258 raft_consensus.cc:515] T e7e16d7d38af4781975f803c3d05e208 P 7e5b746c9d10411cb2e3948be2e9db1e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:46.813681 11258 leader_election.cc:290] T e7e16d7d38af4781975f803c3d05e208 P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 3 election: Requested vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941)
I20260709 13:17:46.814975 11113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e16d7d38af4781975f803c3d05e208" candidate_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c"
I20260709 13:17:46.815189 11186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e16d7d38af4781975f803c3d05e208" candidate_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d"
I20260709 13:17:46.815811 11113 raft_consensus.cc:3055] T e7e16d7d38af4781975f803c3d05e208 P ceb819e448e34d73b2cd02fdc2e3747c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:46.815941 11186 raft_consensus.cc:3060] T e7e16d7d38af4781975f803c3d05e208 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:46.816272 11113 raft_consensus.cc:740] T e7e16d7d38af4781975f803c3d05e208 P ceb819e448e34d73b2cd02fdc2e3747c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ceb819e448e34d73b2cd02fdc2e3747c, State: Running, Role: LEADER
I20260709 13:17:46.817428 11113 consensus_queue.cc:260] T e7e16d7d38af4781975f803c3d05e208 P ceb819e448e34d73b2cd02fdc2e3747c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:46.818643 11113 raft_consensus.cc:3060] T e7e16d7d38af4781975f803c3d05e208 P ceb819e448e34d73b2cd02fdc2e3747c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:46.825270 11186 raft_consensus.cc:2468] T e7e16d7d38af4781975f803c3d05e208 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e5b746c9d10411cb2e3948be2e9db1e in term 3.
I20260709 13:17:46.825632 11113 raft_consensus.cc:2468] T e7e16d7d38af4781975f803c3d05e208 P ceb819e448e34d73b2cd02fdc2e3747c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e5b746c9d10411cb2e3948be2e9db1e in term 3.
I20260709 13:17:46.826730 11225 leader_election.cc:304] T e7e16d7d38af4781975f803c3d05e208 P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, 7e5b746c9d10411cb2e3948be2e9db1e; no voters: 
I20260709 13:17:46.827751 11554 raft_consensus.cc:2804] T e7e16d7d38af4781975f803c3d05e208 P 7e5b746c9d10411cb2e3948be2e9db1e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:46.828227 11554 raft_consensus.cc:697] T e7e16d7d38af4781975f803c3d05e208 P 7e5b746c9d10411cb2e3948be2e9db1e [term 3 LEADER]: Becoming Leader. State: Replica: 7e5b746c9d10411cb2e3948be2e9db1e, State: Running, Role: LEADER
I20260709 13:17:46.829052 11554 consensus_queue.cc:237] T e7e16d7d38af4781975f803c3d05e208 P 7e5b746c9d10411cb2e3948be2e9db1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:46.840854 11007 catalog_manager.cc:5697] T e7e16d7d38af4781975f803c3d05e208 P 7e5b746c9d10411cb2e3948be2e9db1e reported cstate change: term changed from 2 to 3, leader changed from ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193) to 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195). New cstate: current_term: 3 leader_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:46.860059 11526 raft_consensus.cc:993] T 2bf72bd1b7f841189a36dc8e9cc20b4c P ceb819e448e34d73b2cd02fdc2e3747c: : Instructing follower 7e5b746c9d10411cb2e3948be2e9db1e to start an election
I20260709 13:17:46.860678 11550 raft_consensus.cc:1081] T 2bf72bd1b7f841189a36dc8e9cc20b4c P ceb819e448e34d73b2cd02fdc2e3747c [term 2 LEADER]: Signalling peer 7e5b746c9d10411cb2e3948be2e9db1e to start an election
I20260709 13:17:46.862345 11258 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2bf72bd1b7f841189a36dc8e9cc20b4c"
dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e"
 from {username='slave'} at 127.0.0.1:53876
I20260709 13:17:46.863113 11258 raft_consensus.cc:493] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:46.863518 11258 raft_consensus.cc:3060] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:46.872845 11258 raft_consensus.cc:515] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:46.873924 11528 raft_consensus.cc:993] T c4f71e70f87441408c0353d089d9557d P 6fc0290ef4cf4ffa8c82c234ed04ff1d: : Instructing follower 7e5b746c9d10411cb2e3948be2e9db1e to start an election
I20260709 13:17:46.874538 11414 raft_consensus.cc:1081] T c4f71e70f87441408c0353d089d9557d P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 LEADER]: Signalling peer 7e5b746c9d10411cb2e3948be2e9db1e to start an election
I20260709 13:17:46.876032 11113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf72bd1b7f841189a36dc8e9cc20b4c" candidate_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c"
I20260709 13:17:46.876370 11259 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4f71e70f87441408c0353d089d9557d"
dest_uuid: "7e5b746c9d10411cb2e3948be2e9db1e"
 from {username='slave'} at 127.0.0.1:53868
I20260709 13:17:46.876807 11113 raft_consensus.cc:3055] T 2bf72bd1b7f841189a36dc8e9cc20b4c P ceb819e448e34d73b2cd02fdc2e3747c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:46.876979 11186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf72bd1b7f841189a36dc8e9cc20b4c" candidate_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d"
I20260709 13:17:46.877194 11113 raft_consensus.cc:740] T 2bf72bd1b7f841189a36dc8e9cc20b4c P ceb819e448e34d73b2cd02fdc2e3747c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ceb819e448e34d73b2cd02fdc2e3747c, State: Running, Role: LEADER
I20260709 13:17:46.876986 11259 raft_consensus.cc:493] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:46.877884 11186 raft_consensus.cc:3060] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:46.877970 11259 raft_consensus.cc:3060] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:46.878441 11113 consensus_queue.cc:260] T 2bf72bd1b7f841189a36dc8e9cc20b4c P ceb819e448e34d73b2cd02fdc2e3747c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:46.879747 11113 raft_consensus.cc:3060] T 2bf72bd1b7f841189a36dc8e9cc20b4c P ceb819e448e34d73b2cd02fdc2e3747c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:46.886273 11259 raft_consensus.cc:515] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:46.886842 11186 raft_consensus.cc:2468] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e5b746c9d10411cb2e3948be2e9db1e in term 3.
I20260709 13:17:46.887663 11258 leader_election.cc:290] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 3 election: Requested vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941)
I20260709 13:17:46.890719 11113 raft_consensus.cc:2468] T 2bf72bd1b7f841189a36dc8e9cc20b4c P ceb819e448e34d73b2cd02fdc2e3747c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e5b746c9d10411cb2e3948be2e9db1e in term 3.
I20260709 13:17:46.892509 11225 leader_election.cc:304] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e5b746c9d10411cb2e3948be2e9db1e, ceb819e448e34d73b2cd02fdc2e3747c; no voters: 
I20260709 13:17:46.893690 11476 raft_consensus.cc:2804] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:46.894193 11476 raft_consensus.cc:697] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e [term 3 LEADER]: Becoming Leader. State: Replica: 7e5b746c9d10411cb2e3948be2e9db1e, State: Running, Role: LEADER
I20260709 13:17:46.898175 11259 leader_election.cc:290] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 3 election: Requested vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941)
I20260709 13:17:46.898602 11183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f71e70f87441408c0353d089d9557d" candidate_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d"
I20260709 13:17:46.899339 11183 raft_consensus.cc:3055] T c4f71e70f87441408c0353d089d9557d P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:46.899716 11183 raft_consensus.cc:740] T c4f71e70f87441408c0353d089d9557d P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6fc0290ef4cf4ffa8c82c234ed04ff1d, State: Running, Role: LEADER
I20260709 13:17:46.895094 11476 consensus_queue.cc:237] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:46.900830 11183 consensus_queue.cc:260] T c4f71e70f87441408c0353d089d9557d P 6fc0290ef4cf4ffa8c82c234ed04ff1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:46.902423 11183 raft_consensus.cc:3060] T c4f71e70f87441408c0353d089d9557d P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:46.909145 11113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f71e70f87441408c0353d089d9557d" candidate_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ceb819e448e34d73b2cd02fdc2e3747c"
I20260709 13:17:46.909993 11113 raft_consensus.cc:3060] T c4f71e70f87441408c0353d089d9557d P ceb819e448e34d73b2cd02fdc2e3747c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:46.909025 11007 catalog_manager.cc:5697] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e reported cstate change: term changed from 2 to 3, leader changed from ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193) to 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195). New cstate: current_term: 3 leader_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:46.916448 11183 raft_consensus.cc:2468] T c4f71e70f87441408c0353d089d9557d P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e5b746c9d10411cb2e3948be2e9db1e in term 3.
I20260709 13:17:46.918761 11225 leader_election.cc:304] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, 7e5b746c9d10411cb2e3948be2e9db1e; no voters: 
I20260709 13:17:46.920208 11113 raft_consensus.cc:2468] T c4f71e70f87441408c0353d089d9557d P ceb819e448e34d73b2cd02fdc2e3747c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e5b746c9d10411cb2e3948be2e9db1e in term 3.
I20260709 13:17:46.922127 11476 raft_consensus.cc:2804] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:46.922755 11476 raft_consensus.cc:697] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e [term 3 LEADER]: Becoming Leader. State: Replica: 7e5b746c9d10411cb2e3948be2e9db1e, State: Running, Role: LEADER
I20260709 13:17:46.923705 11476 consensus_queue.cc:237] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:46.935065 11007 catalog_manager.cc:5697] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e reported cstate change: term changed from 2 to 3, leader changed from 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194) to 7e5b746c9d10411cb2e3948be2e9db1e (127.2.198.195). New cstate: current_term: 3 leader_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:47.082579 11183 raft_consensus.cc:1275] T 05b49fb53338498d94d1df63d6d809ef P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 3 FOLLOWER]: Refusing update from remote peer 7e5b746c9d10411cb2e3948be2e9db1e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:17:47.084206 11476 consensus_queue.cc:1048] T 05b49fb53338498d94d1df63d6d809ef P 7e5b746c9d10411cb2e3948be2e9db1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:47.095510 11113 raft_consensus.cc:1275] T 05b49fb53338498d94d1df63d6d809ef P ceb819e448e34d73b2cd02fdc2e3747c [term 3 FOLLOWER]: Refusing update from remote peer 7e5b746c9d10411cb2e3948be2e9db1e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:17:47.097505 11476 consensus_queue.cc:1048] T 05b49fb53338498d94d1df63d6d809ef P 7e5b746c9d10411cb2e3948be2e9db1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:47.238237 11113 raft_consensus.cc:1275] T e7e16d7d38af4781975f803c3d05e208 P ceb819e448e34d73b2cd02fdc2e3747c [term 3 FOLLOWER]: Refusing update from remote peer 7e5b746c9d10411cb2e3948be2e9db1e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:47.240048 11476 consensus_queue.cc:1048] T e7e16d7d38af4781975f803c3d05e208 P 7e5b746c9d10411cb2e3948be2e9db1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:47.252362 11183 raft_consensus.cc:1275] T e7e16d7d38af4781975f803c3d05e208 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 3 FOLLOWER]: Refusing update from remote peer 7e5b746c9d10411cb2e3948be2e9db1e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:47.254846 11476 consensus_queue.cc:1048] T e7e16d7d38af4781975f803c3d05e208 P 7e5b746c9d10411cb2e3948be2e9db1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:47.357402 11186 raft_consensus.cc:1275] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 3 FOLLOWER]: Refusing update from remote peer 7e5b746c9d10411cb2e3948be2e9db1e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:17:47.359403 11554 consensus_queue.cc:1048] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:47.369191 11113 raft_consensus.cc:1275] T 2bf72bd1b7f841189a36dc8e9cc20b4c P ceb819e448e34d73b2cd02fdc2e3747c [term 3 FOLLOWER]: Refusing update from remote peer 7e5b746c9d10411cb2e3948be2e9db1e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:17:47.374650 11554 consensus_queue.cc:1048] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:47.452173 11186 raft_consensus.cc:1275] T c4f71e70f87441408c0353d089d9557d P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 3 FOLLOWER]: Refusing update from remote peer 7e5b746c9d10411cb2e3948be2e9db1e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:47.453847 11476 consensus_queue.cc:1048] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:47.465531 11113 raft_consensus.cc:1275] T c4f71e70f87441408c0353d089d9557d P ceb819e448e34d73b2cd02fdc2e3747c [term 3 FOLLOWER]: Refusing update from remote peer 7e5b746c9d10411cb2e3948be2e9db1e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:47.468276 11534 consensus_queue.cc:1048] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:47.702688  2843 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:17:47.711150  2843 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:17:47.711831  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:47.720213  2843 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:17:47.720837  2843 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:48.755959  2843 tablet_server.cc:179] TabletServer@127.2.198.193:0 shutting down...
I20260709 13:17:48.794059  2843 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:48.795102  2843 tablet_replica.cc:333] T 1b8455bef8cb45b8b9cb5ff12454264f P ceb819e448e34d73b2cd02fdc2e3747c: stopping tablet replica
I20260709 13:17:48.796370  2843 raft_consensus.cc:2243] T 1b8455bef8cb45b8b9cb5ff12454264f P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:48.797029  2843 raft_consensus.cc:2272] T 1b8455bef8cb45b8b9cb5ff12454264f P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:48.799783  2843 tablet_replica.cc:333] T d0b8e0b882c143c5b45154837705e287 P ceb819e448e34d73b2cd02fdc2e3747c: stopping tablet replica
I20260709 13:17:48.800781  2843 raft_consensus.cc:2243] T d0b8e0b882c143c5b45154837705e287 P ceb819e448e34d73b2cd02fdc2e3747c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:48.801780  2843 raft_consensus.cc:2272] T d0b8e0b882c143c5b45154837705e287 P ceb819e448e34d73b2cd02fdc2e3747c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:48.804821 11151 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 9 similar messages]
I20260709 13:17:48.805049  2843 tablet_replica.cc:333] T b4c4141fdaa04cffb06507e0010fefae P ceb819e448e34d73b2cd02fdc2e3747c: stopping tablet replica
I20260709 13:17:48.806070  2843 raft_consensus.cc:2243] T b4c4141fdaa04cffb06507e0010fefae P ceb819e448e34d73b2cd02fdc2e3747c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:48.806691  2843 raft_consensus.cc:2272] T b4c4141fdaa04cffb06507e0010fefae P ceb819e448e34d73b2cd02fdc2e3747c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:48.809720  2843 tablet_replica.cc:333] T 05b49fb53338498d94d1df63d6d809ef P ceb819e448e34d73b2cd02fdc2e3747c: stopping tablet replica
I20260709 13:17:48.810729  2843 raft_consensus.cc:2243] T 05b49fb53338498d94d1df63d6d809ef P ceb819e448e34d73b2cd02fdc2e3747c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:48.811260  2843 raft_consensus.cc:2272] T 05b49fb53338498d94d1df63d6d809ef P ceb819e448e34d73b2cd02fdc2e3747c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:48.814574  2843 tablet_replica.cc:333] T 79e021e2ff374d78b82d53e7631dc83c P ceb819e448e34d73b2cd02fdc2e3747c: stopping tablet replica
W20260709 13:17:48.814641 11225 consensus_peers.cc:597] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e -> Peer ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307): Couldn't send request to peer ceb819e448e34d73b2cd02fdc2e3747c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:48.815312  2843 raft_consensus.cc:2243] T 79e021e2ff374d78b82d53e7631dc83c P ceb819e448e34d73b2cd02fdc2e3747c [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:17:48.815913 11151 consensus_peers.cc:597] T 1b8455bef8cb45b8b9cb5ff12454264f P 6fc0290ef4cf4ffa8c82c234ed04ff1d -> Peer ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307): Couldn't send request to peer ceb819e448e34d73b2cd02fdc2e3747c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:48.816728  2843 raft_consensus.cc:2272] T 79e021e2ff374d78b82d53e7631dc83c P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:48.820176  2843 tablet_replica.cc:333] T 7aae7b1e191e428d9abcb7c76f088181 P ceb819e448e34d73b2cd02fdc2e3747c: stopping tablet replica
I20260709 13:17:48.820850  2843 raft_consensus.cc:2243] T 7aae7b1e191e428d9abcb7c76f088181 P ceb819e448e34d73b2cd02fdc2e3747c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:48.821319  2843 raft_consensus.cc:2272] T 7aae7b1e191e428d9abcb7c76f088181 P ceb819e448e34d73b2cd02fdc2e3747c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:48.823477  2843 tablet_replica.cc:333] T 85ed2545e6bf44589a83b5a92d807ea0 P ceb819e448e34d73b2cd02fdc2e3747c: stopping tablet replica
I20260709 13:17:48.824225  2843 raft_consensus.cc:2243] T 85ed2545e6bf44589a83b5a92d807ea0 P ceb819e448e34d73b2cd02fdc2e3747c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:48.824692  2843 raft_consensus.cc:2272] T 85ed2545e6bf44589a83b5a92d807ea0 P ceb819e448e34d73b2cd02fdc2e3747c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:48.827091  2843 tablet_replica.cc:333] T 7e274b51306c4d09872f37009c6f5e1e P ceb819e448e34d73b2cd02fdc2e3747c: stopping tablet replica
I20260709 13:17:48.827736  2843 raft_consensus.cc:2243] T 7e274b51306c4d09872f37009c6f5e1e P ceb819e448e34d73b2cd02fdc2e3747c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:48.828644  2843 raft_consensus.cc:2272] T 7e274b51306c4d09872f37009c6f5e1e P ceb819e448e34d73b2cd02fdc2e3747c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:48.830989  2843 tablet_replica.cc:333] T e7e16d7d38af4781975f803c3d05e208 P ceb819e448e34d73b2cd02fdc2e3747c: stopping tablet replica
I20260709 13:17:48.831642  2843 raft_consensus.cc:2243] T e7e16d7d38af4781975f803c3d05e208 P ceb819e448e34d73b2cd02fdc2e3747c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:48.832070  2843 raft_consensus.cc:2272] T e7e16d7d38af4781975f803c3d05e208 P ceb819e448e34d73b2cd02fdc2e3747c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:48.834267  2843 tablet_replica.cc:333] T 6eab4df2be764be5b57dcd1fc08345fd P ceb819e448e34d73b2cd02fdc2e3747c: stopping tablet replica
I20260709 13:17:48.834865  2843 raft_consensus.cc:2243] T 6eab4df2be764be5b57dcd1fc08345fd P ceb819e448e34d73b2cd02fdc2e3747c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:48.835779  2843 raft_consensus.cc:2272] T 6eab4df2be764be5b57dcd1fc08345fd P ceb819e448e34d73b2cd02fdc2e3747c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:48.838017  2843 tablet_replica.cc:333] T c4f71e70f87441408c0353d089d9557d P ceb819e448e34d73b2cd02fdc2e3747c: stopping tablet replica
I20260709 13:17:48.838581  2843 raft_consensus.cc:2243] T c4f71e70f87441408c0353d089d9557d P ceb819e448e34d73b2cd02fdc2e3747c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:48.839092  2843 raft_consensus.cc:2272] T c4f71e70f87441408c0353d089d9557d P ceb819e448e34d73b2cd02fdc2e3747c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:48.841500  2843 tablet_replica.cc:333] T 2bf72bd1b7f841189a36dc8e9cc20b4c P ceb819e448e34d73b2cd02fdc2e3747c: stopping tablet replica
I20260709 13:17:48.842100  2843 raft_consensus.cc:2243] T 2bf72bd1b7f841189a36dc8e9cc20b4c P ceb819e448e34d73b2cd02fdc2e3747c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:48.842533  2843 raft_consensus.cc:2272] T 2bf72bd1b7f841189a36dc8e9cc20b4c P ceb819e448e34d73b2cd02fdc2e3747c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:48.844851  2843 tablet_replica.cc:333] T f184ae5efb4641d9b6442c2a743f1f81 P ceb819e448e34d73b2cd02fdc2e3747c: stopping tablet replica
I20260709 13:17:48.845381  2843 raft_consensus.cc:2243] T f184ae5efb4641d9b6442c2a743f1f81 P ceb819e448e34d73b2cd02fdc2e3747c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:48.846160  2843 raft_consensus.cc:2272] T f184ae5efb4641d9b6442c2a743f1f81 P ceb819e448e34d73b2cd02fdc2e3747c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:48.848453  2843 tablet_replica.cc:333] T 4309ede3f11d451ab65bbdfb178d98d1 P ceb819e448e34d73b2cd02fdc2e3747c: stopping tablet replica
I20260709 13:17:48.849083  2843 raft_consensus.cc:2243] T 4309ede3f11d451ab65bbdfb178d98d1 P ceb819e448e34d73b2cd02fdc2e3747c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:48.849615  2843 raft_consensus.cc:2272] T 4309ede3f11d451ab65bbdfb178d98d1 P ceb819e448e34d73b2cd02fdc2e3747c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:48.851893  2843 tablet_replica.cc:333] T deff9c42898e48bdaa4575ff88e733a6 P ceb819e448e34d73b2cd02fdc2e3747c: stopping tablet replica
I20260709 13:17:48.852435  2843 raft_consensus.cc:2243] T deff9c42898e48bdaa4575ff88e733a6 P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:48.852901  2843 raft_consensus.cc:2272] T deff9c42898e48bdaa4575ff88e733a6 P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:48.855131  2843 tablet_replica.cc:333] T 8b7700103ed8419c8e4b63058f7969f6 P ceb819e448e34d73b2cd02fdc2e3747c: stopping tablet replica
I20260709 13:17:48.855863  2843 raft_consensus.cc:2243] T 8b7700103ed8419c8e4b63058f7969f6 P ceb819e448e34d73b2cd02fdc2e3747c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:48.856791  2843 raft_consensus.cc:2272] T 8b7700103ed8419c8e4b63058f7969f6 P ceb819e448e34d73b2cd02fdc2e3747c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:48.859252  2843 tablet_replica.cc:333] T a13cc15140be4d119a2fee5acc480df1 P ceb819e448e34d73b2cd02fdc2e3747c: stopping tablet replica
I20260709 13:17:48.859891  2843 raft_consensus.cc:2243] T a13cc15140be4d119a2fee5acc480df1 P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:48.860334  2843 raft_consensus.cc:2272] T a13cc15140be4d119a2fee5acc480df1 P ceb819e448e34d73b2cd02fdc2e3747c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:48.862799  2843 tablet_replica.cc:333] T 66972c9ebce04c89a8e6b410dee75534 P ceb819e448e34d73b2cd02fdc2e3747c: stopping tablet replica
I20260709 13:17:48.863476  2843 raft_consensus.cc:2243] T 66972c9ebce04c89a8e6b410dee75534 P ceb819e448e34d73b2cd02fdc2e3747c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:48.864107  2843 raft_consensus.cc:2272] T 66972c9ebce04c89a8e6b410dee75534 P ceb819e448e34d73b2cd02fdc2e3747c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:48.867586 11225 consensus_peers.cc:597] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e -> Peer ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307): Couldn't send request to peer ceb819e448e34d73b2cd02fdc2e3747c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:48.869252 11225 consensus_peers.cc:597] T b4c4141fdaa04cffb06507e0010fefae P 7e5b746c9d10411cb2e3948be2e9db1e -> Peer ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307): Couldn't send request to peer ceb819e448e34d73b2cd02fdc2e3747c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:48.913298  2843 tablet_server.cc:196] TabletServer@127.2.198.193:0 shutdown complete.
W20260709 13:17:48.913368 11225 consensus_peers.cc:597] T e7e16d7d38af4781975f803c3d05e208 P 7e5b746c9d10411cb2e3948be2e9db1e -> Peer ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307): Couldn't send request to peer ceb819e448e34d73b2cd02fdc2e3747c. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:34307: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:48.928900 11151 consensus_peers.cc:597] T 85ed2545e6bf44589a83b5a92d807ea0 P 6fc0290ef4cf4ffa8c82c234ed04ff1d -> Peer ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307): Couldn't send request to peer ceb819e448e34d73b2cd02fdc2e3747c. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:34307: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:48.961762  2843 tablet_server.cc:179] TabletServer@127.2.198.194:0 shutting down...
W20260709 13:17:49.009101 11225 consensus_peers.cc:597] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e -> Peer 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941): Couldn't send request to peer 6fc0290ef4cf4ffa8c82c234ed04ff1d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:49.014461 11151 consensus_peers.cc:597] T 7aae7b1e191e428d9abcb7c76f088181 P 6fc0290ef4cf4ffa8c82c234ed04ff1d -> Peer ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307): Couldn't send request to peer ceb819e448e34d73b2cd02fdc2e3747c. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:34307: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:49.020685  2843 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:49.021746  2843 tablet_replica.cc:333] T d0b8e0b882c143c5b45154837705e287 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: stopping tablet replica
I20260709 13:17:49.022765  2843 raft_consensus.cc:2243] T d0b8e0b882c143c5b45154837705e287 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:49.023497  2843 raft_consensus.cc:2272] T d0b8e0b882c143c5b45154837705e287 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:49.025418 11225 consensus_peers.cc:597] T 05b49fb53338498d94d1df63d6d809ef P 7e5b746c9d10411cb2e3948be2e9db1e -> Peer 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941): Couldn't send request to peer 6fc0290ef4cf4ffa8c82c234ed04ff1d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:49.027073  2843 tablet_replica.cc:333] T 1b8455bef8cb45b8b9cb5ff12454264f P 6fc0290ef4cf4ffa8c82c234ed04ff1d: stopping tablet replica
I20260709 13:17:49.028263  2843 raft_consensus.cc:2243] T 1b8455bef8cb45b8b9cb5ff12454264f P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:17:49.028950 11151 consensus_peers.cc:597] T deff9c42898e48bdaa4575ff88e733a6 P 6fc0290ef4cf4ffa8c82c234ed04ff1d -> Peer ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307): Couldn't send request to peer ceb819e448e34d73b2cd02fdc2e3747c. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:34307: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:49.029511  2843 raft_consensus.cc:2272] T 1b8455bef8cb45b8b9cb5ff12454264f P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.033133  2843 tablet_replica.cc:333] T b4c4141fdaa04cffb06507e0010fefae P 6fc0290ef4cf4ffa8c82c234ed04ff1d: stopping tablet replica
I20260709 13:17:49.034066  2843 raft_consensus.cc:2243] T b4c4141fdaa04cffb06507e0010fefae P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:49.034665  2843 raft_consensus.cc:2272] T b4c4141fdaa04cffb06507e0010fefae P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.037690  2843 tablet_replica.cc:333] T 05b49fb53338498d94d1df63d6d809ef P 6fc0290ef4cf4ffa8c82c234ed04ff1d: stopping tablet replica
I20260709 13:17:49.038589  2843 raft_consensus.cc:2243] T 05b49fb53338498d94d1df63d6d809ef P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:49.039197  2843 raft_consensus.cc:2272] T 05b49fb53338498d94d1df63d6d809ef P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.042191  2843 tablet_replica.cc:333] T c4f71e70f87441408c0353d089d9557d P 6fc0290ef4cf4ffa8c82c234ed04ff1d: stopping tablet replica
I20260709 13:17:49.043073  2843 raft_consensus.cc:2243] T c4f71e70f87441408c0353d089d9557d P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:49.043619  2843 raft_consensus.cc:2272] T c4f71e70f87441408c0353d089d9557d P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.046706  2843 tablet_replica.cc:333] T 6eab4df2be764be5b57dcd1fc08345fd P 6fc0290ef4cf4ffa8c82c234ed04ff1d: stopping tablet replica
I20260709 13:17:49.047670  2843 raft_consensus.cc:2243] T 6eab4df2be764be5b57dcd1fc08345fd P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:49.048250  2843 raft_consensus.cc:2272] T 6eab4df2be764be5b57dcd1fc08345fd P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.051349  2843 tablet_replica.cc:333] T 79e021e2ff374d78b82d53e7631dc83c P 6fc0290ef4cf4ffa8c82c234ed04ff1d: stopping tablet replica
I20260709 13:17:49.052263  2843 raft_consensus.cc:2243] T 79e021e2ff374d78b82d53e7631dc83c P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:49.052891  2843 raft_consensus.cc:2272] T 79e021e2ff374d78b82d53e7631dc83c P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.056478  2843 tablet_replica.cc:333] T 66972c9ebce04c89a8e6b410dee75534 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: stopping tablet replica
W20260709 13:17:49.057588 11151 consensus_peers.cc:597] T a13cc15140be4d119a2fee5acc480df1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d -> Peer ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307): Couldn't send request to peer ceb819e448e34d73b2cd02fdc2e3747c. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:34307: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:49.057684  2843 raft_consensus.cc:2243] T 66972c9ebce04c89a8e6b410dee75534 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:17:49.058534 11225 consensus_peers.cc:597] T 4309ede3f11d451ab65bbdfb178d98d1 P 7e5b746c9d10411cb2e3948be2e9db1e -> Peer ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307): Couldn't send request to peer ceb819e448e34d73b2cd02fdc2e3747c. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:34307: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:49.059156  2843 raft_consensus.cc:2272] T 66972c9ebce04c89a8e6b410dee75534 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.062476  2843 tablet_replica.cc:333] T deff9c42898e48bdaa4575ff88e733a6 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: stopping tablet replica
I20260709 13:17:49.063403  2843 raft_consensus.cc:2243] T deff9c42898e48bdaa4575ff88e733a6 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:49.064498  2843 raft_consensus.cc:2272] T deff9c42898e48bdaa4575ff88e733a6 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.067556  2843 tablet_replica.cc:333] T a13cc15140be4d119a2fee5acc480df1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: stopping tablet replica
I20260709 13:17:49.068449  2843 raft_consensus.cc:2243] T a13cc15140be4d119a2fee5acc480df1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:49.069682  2843 raft_consensus.cc:2272] T a13cc15140be4d119a2fee5acc480df1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.073171  2843 tablet_replica.cc:333] T 8b7700103ed8419c8e4b63058f7969f6 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: stopping tablet replica
I20260709 13:17:49.074043  2843 raft_consensus.cc:2243] T 8b7700103ed8419c8e4b63058f7969f6 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:49.074661  2843 raft_consensus.cc:2272] T 8b7700103ed8419c8e4b63058f7969f6 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.077853  2843 tablet_replica.cc:333] T 7aae7b1e191e428d9abcb7c76f088181 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: stopping tablet replica
I20260709 13:17:49.078658  2843 raft_consensus.cc:2243] T 7aae7b1e191e428d9abcb7c76f088181 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:49.079769  2843 raft_consensus.cc:2272] T 7aae7b1e191e428d9abcb7c76f088181 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.082741  2843 tablet_replica.cc:333] T 85ed2545e6bf44589a83b5a92d807ea0 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: stopping tablet replica
I20260709 13:17:49.083515  2843 raft_consensus.cc:2243] T 85ed2545e6bf44589a83b5a92d807ea0 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:49.084833  2843 raft_consensus.cc:2272] T 85ed2545e6bf44589a83b5a92d807ea0 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.088402  2843 tablet_replica.cc:333] T 7e274b51306c4d09872f37009c6f5e1e P 6fc0290ef4cf4ffa8c82c234ed04ff1d: stopping tablet replica
I20260709 13:17:49.089259  2843 raft_consensus.cc:2243] T 7e274b51306c4d09872f37009c6f5e1e P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:49.089947  2843 raft_consensus.cc:2272] T 7e274b51306c4d09872f37009c6f5e1e P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.093237  2843 tablet_replica.cc:333] T e7e16d7d38af4781975f803c3d05e208 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: stopping tablet replica
I20260709 13:17:49.094106  2843 raft_consensus.cc:2243] T e7e16d7d38af4781975f803c3d05e208 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:49.094657  2843 raft_consensus.cc:2272] T e7e16d7d38af4781975f803c3d05e208 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.097839  2843 tablet_replica.cc:333] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 6fc0290ef4cf4ffa8c82c234ed04ff1d: stopping tablet replica
I20260709 13:17:49.098601  2843 raft_consensus.cc:2243] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:49.099197  2843 raft_consensus.cc:2272] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.102058  2843 tablet_replica.cc:333] T f184ae5efb4641d9b6442c2a743f1f81 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: stopping tablet replica
I20260709 13:17:49.102818  2843 raft_consensus.cc:2243] T f184ae5efb4641d9b6442c2a743f1f81 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:49.103375  2843 raft_consensus.cc:2272] T f184ae5efb4641d9b6442c2a743f1f81 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.106433  2843 tablet_replica.cc:333] T 4309ede3f11d451ab65bbdfb178d98d1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d: stopping tablet replica
I20260709 13:17:49.107126  2843 raft_consensus.cc:2243] T 4309ede3f11d451ab65bbdfb178d98d1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:49.107743  2843 raft_consensus.cc:2272] T 4309ede3f11d451ab65bbdfb178d98d1 P 6fc0290ef4cf4ffa8c82c234ed04ff1d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:49.118165 11225 consensus_peers.cc:597] T 05b49fb53338498d94d1df63d6d809ef P 7e5b746c9d10411cb2e3948be2e9db1e -> Peer ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307): Couldn't send request to peer ceb819e448e34d73b2cd02fdc2e3747c. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:34307: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:49.269186 11225 consensus_peers.cc:597] T 4309ede3f11d451ab65bbdfb178d98d1 P 7e5b746c9d10411cb2e3948be2e9db1e -> Peer 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941): Couldn't send request to peer 6fc0290ef4cf4ffa8c82c234ed04ff1d. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:42941: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:49.294634 11225 consensus_peers.cc:597] T e7e16d7d38af4781975f803c3d05e208 P 7e5b746c9d10411cb2e3948be2e9db1e -> Peer 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941): Couldn't send request to peer 6fc0290ef4cf4ffa8c82c234ed04ff1d. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:42941: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:49.308239 11225 consensus_peers.cc:597] T b4c4141fdaa04cffb06507e0010fefae P 7e5b746c9d10411cb2e3948be2e9db1e -> Peer 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941): Couldn't send request to peer 6fc0290ef4cf4ffa8c82c234ed04ff1d. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:42941: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:49.344347 11225 consensus_peers.cc:597] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e -> Peer 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941): Couldn't send request to peer 6fc0290ef4cf4ffa8c82c234ed04ff1d. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.194:42941: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:49.729066 11476 raft_consensus.cc:493] T d0b8e0b882c143c5b45154837705e287 P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ceb819e448e34d73b2cd02fdc2e3747c)
I20260709 13:17:49.729784 11476 raft_consensus.cc:515] T d0b8e0b882c143c5b45154837705e287 P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:49.732190 11476 leader_election.cc:290] T d0b8e0b882c143c5b45154837705e287 P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941)
W20260709 13:17:49.738262 11225 leader_election.cc:336] T d0b8e0b882c143c5b45154837705e287 P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307): Network error: Client connection negotiation failed: client connection to 127.2.198.193:34307: connect: Connection refused (error 111)
W20260709 13:17:49.739028 11225 leader_election.cc:336] T d0b8e0b882c143c5b45154837705e287 P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941): Network error: Client connection negotiation failed: client connection to 127.2.198.194:42941: connect: Connection refused (error 111)
I20260709 13:17:49.739387 11225 leader_election.cc:304] T d0b8e0b882c143c5b45154837705e287 P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e5b746c9d10411cb2e3948be2e9db1e; no voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, ceb819e448e34d73b2cd02fdc2e3747c
I20260709 13:17:49.740083 11476 raft_consensus.cc:2749] T d0b8e0b882c143c5b45154837705e287 P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:49.944340 11476 raft_consensus.cc:493] T 7e274b51306c4d09872f37009c6f5e1e P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ceb819e448e34d73b2cd02fdc2e3747c)
I20260709 13:17:49.944929 11476 raft_consensus.cc:515] T 7e274b51306c4d09872f37009c6f5e1e P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:49.946961 11476 leader_election.cc:290] T 7e274b51306c4d09872f37009c6f5e1e P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941)
W20260709 13:17:49.951066 11225 leader_election.cc:336] T 7e274b51306c4d09872f37009c6f5e1e P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307): Network error: Client connection negotiation failed: client connection to 127.2.198.193:34307: connect: Connection refused (error 111)
W20260709 13:17:49.951859 11225 leader_election.cc:336] T 7e274b51306c4d09872f37009c6f5e1e P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941): Network error: Client connection negotiation failed: client connection to 127.2.198.194:42941: connect: Connection refused (error 111)
I20260709 13:17:49.952181 11225 leader_election.cc:304] T 7e274b51306c4d09872f37009c6f5e1e P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e5b746c9d10411cb2e3948be2e9db1e; no voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, ceb819e448e34d73b2cd02fdc2e3747c
I20260709 13:17:49.952834 11476 raft_consensus.cc:2749] T 7e274b51306c4d09872f37009c6f5e1e P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:49.976918 11476 raft_consensus.cc:493] T 6eab4df2be764be5b57dcd1fc08345fd P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ceb819e448e34d73b2cd02fdc2e3747c)
I20260709 13:17:49.977424 11476 raft_consensus.cc:515] T 6eab4df2be764be5b57dcd1fc08345fd P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:49.979355 11476 leader_election.cc:290] T 6eab4df2be764be5b57dcd1fc08345fd P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941)
W20260709 13:17:49.983642 11225 leader_election.cc:336] T 6eab4df2be764be5b57dcd1fc08345fd P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307): Network error: Client connection negotiation failed: client connection to 127.2.198.193:34307: connect: Connection refused (error 111)
W20260709 13:17:49.984701 11225 leader_election.cc:336] T 6eab4df2be764be5b57dcd1fc08345fd P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941): Network error: Client connection negotiation failed: client connection to 127.2.198.194:42941: connect: Connection refused (error 111)
I20260709 13:17:49.985114 11225 leader_election.cc:304] T 6eab4df2be764be5b57dcd1fc08345fd P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e5b746c9d10411cb2e3948be2e9db1e; no voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, ceb819e448e34d73b2cd02fdc2e3747c
I20260709 13:17:49.985862 11476 raft_consensus.cc:2749] T 6eab4df2be764be5b57dcd1fc08345fd P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:49.992998 11476 raft_consensus.cc:493] T 8b7700103ed8419c8e4b63058f7969f6 P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ceb819e448e34d73b2cd02fdc2e3747c)
I20260709 13:17:49.993508 11476 raft_consensus.cc:515] T 8b7700103ed8419c8e4b63058f7969f6 P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } } peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } }
I20260709 13:17:49.995662 11476 leader_election.cc:290] T 8b7700103ed8419c8e4b63058f7969f6 P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941), ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307)
I20260709 13:17:49.996654 11476 raft_consensus.cc:493] T a13cc15140be4d119a2fee5acc480df1 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6fc0290ef4cf4ffa8c82c234ed04ff1d)
I20260709 13:17:49.997207 11476 raft_consensus.cc:515] T a13cc15140be4d119a2fee5acc480df1 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
W20260709 13:17:50.000171 11225 leader_election.cc:336] T 8b7700103ed8419c8e4b63058f7969f6 P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941): Network error: Client connection negotiation failed: client connection to 127.2.198.194:42941: connect: Connection refused (error 111)
I20260709 13:17:50.000320 11476 leader_election.cc:290] T a13cc15140be4d119a2fee5acc480df1 P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941)
W20260709 13:17:50.001755 11225 leader_election.cc:336] T 8b7700103ed8419c8e4b63058f7969f6 P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307): Network error: Client connection negotiation failed: client connection to 127.2.198.193:34307: connect: Connection refused (error 111)
I20260709 13:17:50.002202 11225 leader_election.cc:304] T 8b7700103ed8419c8e4b63058f7969f6 P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e5b746c9d10411cb2e3948be2e9db1e; no voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, ceb819e448e34d73b2cd02fdc2e3747c
I20260709 13:17:50.002822 11476 raft_consensus.cc:2749] T 8b7700103ed8419c8e4b63058f7969f6 P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:17:50.004706 11225 leader_election.cc:336] T a13cc15140be4d119a2fee5acc480df1 P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307): Network error: Client connection negotiation failed: client connection to 127.2.198.193:34307: connect: Connection refused (error 111)
W20260709 13:17:50.006646 11225 leader_election.cc:336] T a13cc15140be4d119a2fee5acc480df1 P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941): Network error: Client connection negotiation failed: client connection to 127.2.198.194:42941: connect: Connection refused (error 111)
I20260709 13:17:50.006999 11225 leader_election.cc:304] T a13cc15140be4d119a2fee5acc480df1 P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e5b746c9d10411cb2e3948be2e9db1e; no voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, ceb819e448e34d73b2cd02fdc2e3747c
I20260709 13:17:50.007637 11476 raft_consensus.cc:2749] T a13cc15140be4d119a2fee5acc480df1 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:50.039152 11476 raft_consensus.cc:493] T 66972c9ebce04c89a8e6b410dee75534 P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6fc0290ef4cf4ffa8c82c234ed04ff1d)
I20260709 13:17:50.039795 11476 raft_consensus.cc:515] T 66972c9ebce04c89a8e6b410dee75534 P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:50.041998 11476 leader_election.cc:290] T 66972c9ebce04c89a8e6b410dee75534 P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941)
W20260709 13:17:50.047489 11225 leader_election.cc:336] T 66972c9ebce04c89a8e6b410dee75534 P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307): Network error: Client connection negotiation failed: client connection to 127.2.198.193:34307: connect: Connection refused (error 111)
W20260709 13:17:50.048552 11225 leader_election.cc:336] T 66972c9ebce04c89a8e6b410dee75534 P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941): Network error: Client connection negotiation failed: client connection to 127.2.198.194:42941: connect: Connection refused (error 111)
I20260709 13:17:50.048940 11225 leader_election.cc:304] T 66972c9ebce04c89a8e6b410dee75534 P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e5b746c9d10411cb2e3948be2e9db1e; no voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, ceb819e448e34d73b2cd02fdc2e3747c
I20260709 13:17:50.049687 11476 raft_consensus.cc:2749] T 66972c9ebce04c89a8e6b410dee75534 P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:50.137557  2843 tablet_server.cc:196] TabletServer@127.2.198.194:0 shutdown complete.
I20260709 13:17:50.153028 11476 raft_consensus.cc:493] T f184ae5efb4641d9b6442c2a743f1f81 P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ceb819e448e34d73b2cd02fdc2e3747c)
I20260709 13:17:50.153803 11476 raft_consensus.cc:515] T f184ae5efb4641d9b6442c2a743f1f81 P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:50.155998 11476 leader_election.cc:290] T f184ae5efb4641d9b6442c2a743f1f81 P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941)
W20260709 13:17:50.160590 11225 leader_election.cc:336] T f184ae5efb4641d9b6442c2a743f1f81 P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307): Network error: Client connection negotiation failed: client connection to 127.2.198.193:34307: connect: Connection refused (error 111)
W20260709 13:17:50.161338 11225 leader_election.cc:336] T f184ae5efb4641d9b6442c2a743f1f81 P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941): Network error: Client connection negotiation failed: client connection to 127.2.198.194:42941: connect: Connection refused (error 111)
I20260709 13:17:50.161741 11225 leader_election.cc:304] T f184ae5efb4641d9b6442c2a743f1f81 P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e5b746c9d10411cb2e3948be2e9db1e; no voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, ceb819e448e34d73b2cd02fdc2e3747c
I20260709 13:17:50.162530 11476 raft_consensus.cc:2749] T f184ae5efb4641d9b6442c2a743f1f81 P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:50.181843  2843 tablet_server.cc:179] TabletServer@127.2.198.195:0 shutting down...
I20260709 13:17:50.182971 11476 raft_consensus.cc:493] T 79e021e2ff374d78b82d53e7631dc83c P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ceb819e448e34d73b2cd02fdc2e3747c)
I20260709 13:17:50.184805 11476 raft_consensus.cc:515] T 79e021e2ff374d78b82d53e7631dc83c P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb819e448e34d73b2cd02fdc2e3747c" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 34307 } } peers { permanent_uuid: "6fc0290ef4cf4ffa8c82c234ed04ff1d" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 42941 } } peers { permanent_uuid: "7e5b746c9d10411cb2e3948be2e9db1e" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 33049 } }
I20260709 13:17:50.186725 11476 leader_election.cc:290] T 79e021e2ff374d78b82d53e7631dc83c P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307), 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941)
W20260709 13:17:50.193617 11225 leader_election.cc:336] T 79e021e2ff374d78b82d53e7631dc83c P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ceb819e448e34d73b2cd02fdc2e3747c (127.2.198.193:34307): Network error: Client connection negotiation failed: client connection to 127.2.198.193:34307: connect: Connection refused (error 111)
W20260709 13:17:50.194303 11225 leader_election.cc:336] T 79e021e2ff374d78b82d53e7631dc83c P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6fc0290ef4cf4ffa8c82c234ed04ff1d (127.2.198.194:42941): Network error: Client connection negotiation failed: client connection to 127.2.198.194:42941: connect: Connection refused (error 111)
I20260709 13:17:50.194779 11225 leader_election.cc:304] T 79e021e2ff374d78b82d53e7631dc83c P 7e5b746c9d10411cb2e3948be2e9db1e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e5b746c9d10411cb2e3948be2e9db1e; no voters: 6fc0290ef4cf4ffa8c82c234ed04ff1d, ceb819e448e34d73b2cd02fdc2e3747c
I20260709 13:17:50.195626 11476 raft_consensus.cc:2749] T 79e021e2ff374d78b82d53e7631dc83c P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:50.220000  2843 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:50.220896  2843 tablet_replica.cc:333] T d0b8e0b882c143c5b45154837705e287 P 7e5b746c9d10411cb2e3948be2e9db1e: stopping tablet replica
I20260709 13:17:50.221657  2843 raft_consensus.cc:2243] T d0b8e0b882c143c5b45154837705e287 P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:50.222208  2843 raft_consensus.cc:2272] T d0b8e0b882c143c5b45154837705e287 P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.224565  2843 tablet_replica.cc:333] T b4c4141fdaa04cffb06507e0010fefae P 7e5b746c9d10411cb2e3948be2e9db1e: stopping tablet replica
I20260709 13:17:50.225201  2843 raft_consensus.cc:2243] T b4c4141fdaa04cffb06507e0010fefae P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:50.226177  2843 raft_consensus.cc:2272] T b4c4141fdaa04cffb06507e0010fefae P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.228299  2843 tablet_replica.cc:333] T 05b49fb53338498d94d1df63d6d809ef P 7e5b746c9d10411cb2e3948be2e9db1e: stopping tablet replica
I20260709 13:17:50.228951  2843 raft_consensus.cc:2243] T 05b49fb53338498d94d1df63d6d809ef P 7e5b746c9d10411cb2e3948be2e9db1e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:50.229765  2843 raft_consensus.cc:2272] T 05b49fb53338498d94d1df63d6d809ef P 7e5b746c9d10411cb2e3948be2e9db1e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.231892  2843 tablet_replica.cc:333] T 1b8455bef8cb45b8b9cb5ff12454264f P 7e5b746c9d10411cb2e3948be2e9db1e: stopping tablet replica
I20260709 13:17:50.232460  2843 raft_consensus.cc:2243] T 1b8455bef8cb45b8b9cb5ff12454264f P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:50.232969  2843 raft_consensus.cc:2272] T 1b8455bef8cb45b8b9cb5ff12454264f P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.235018  2843 tablet_replica.cc:333] T f184ae5efb4641d9b6442c2a743f1f81 P 7e5b746c9d10411cb2e3948be2e9db1e: stopping tablet replica
I20260709 13:17:50.235668  2843 raft_consensus.cc:2243] T f184ae5efb4641d9b6442c2a743f1f81 P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:50.236128  2843 raft_consensus.cc:2272] T f184ae5efb4641d9b6442c2a743f1f81 P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.238186  2843 tablet_replica.cc:333] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e: stopping tablet replica
I20260709 13:17:50.238786  2843 raft_consensus.cc:2243] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:50.239661  2843 raft_consensus.cc:2272] T 2bf72bd1b7f841189a36dc8e9cc20b4c P 7e5b746c9d10411cb2e3948be2e9db1e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.241886  2843 tablet_replica.cc:333] T 79e021e2ff374d78b82d53e7631dc83c P 7e5b746c9d10411cb2e3948be2e9db1e: stopping tablet replica
I20260709 13:17:50.242522  2843 raft_consensus.cc:2243] T 79e021e2ff374d78b82d53e7631dc83c P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:50.242928  2843 raft_consensus.cc:2272] T 79e021e2ff374d78b82d53e7631dc83c P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.245042  2843 tablet_replica.cc:333] T 8b7700103ed8419c8e4b63058f7969f6 P 7e5b746c9d10411cb2e3948be2e9db1e: stopping tablet replica
I20260709 13:17:50.245592  2843 raft_consensus.cc:2243] T 8b7700103ed8419c8e4b63058f7969f6 P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:50.245997  2843 raft_consensus.cc:2272] T 8b7700103ed8419c8e4b63058f7969f6 P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.248706  2843 tablet_replica.cc:333] T a13cc15140be4d119a2fee5acc480df1 P 7e5b746c9d10411cb2e3948be2e9db1e: stopping tablet replica
I20260709 13:17:50.249322  2843 raft_consensus.cc:2243] T a13cc15140be4d119a2fee5acc480df1 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:50.249886  2843 raft_consensus.cc:2272] T a13cc15140be4d119a2fee5acc480df1 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.252655  2843 tablet_replica.cc:333] T deff9c42898e48bdaa4575ff88e733a6 P 7e5b746c9d10411cb2e3948be2e9db1e: stopping tablet replica
I20260709 13:17:50.253166  2843 raft_consensus.cc:2243] T deff9c42898e48bdaa4575ff88e733a6 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:50.253602  2843 raft_consensus.cc:2272] T deff9c42898e48bdaa4575ff88e733a6 P 7e5b746c9d10411cb2e3948be2e9db1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.255679  2843 tablet_replica.cc:333] T 7e274b51306c4d09872f37009c6f5e1e P 7e5b746c9d10411cb2e3948be2e9db1e: stopping tablet replica
I20260709 13:17:50.256223  2843 raft_consensus.cc:2243] T 7e274b51306c4d09872f37009c6f5e1e P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:50.256631  2843 raft_consensus.cc:2272] T 7e274b51306c4d09872f37009c6f5e1e P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.258575  2843 tablet_replica.cc:333] T e7e16d7d38af4781975f803c3d05e208 P 7e5b746c9d10411cb2e3948be2e9db1e: stopping tablet replica
I20260709 13:17:50.259038  2843 raft_consensus.cc:2243] T e7e16d7d38af4781975f803c3d05e208 P 7e5b746c9d10411cb2e3948be2e9db1e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:50.259892  2843 raft_consensus.cc:2272] T e7e16d7d38af4781975f803c3d05e208 P 7e5b746c9d10411cb2e3948be2e9db1e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.261835  2843 tablet_replica.cc:333] T 6eab4df2be764be5b57dcd1fc08345fd P 7e5b746c9d10411cb2e3948be2e9db1e: stopping tablet replica
I20260709 13:17:50.262374  2843 raft_consensus.cc:2243] T 6eab4df2be764be5b57dcd1fc08345fd P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:50.262784  2843 raft_consensus.cc:2272] T 6eab4df2be764be5b57dcd1fc08345fd P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.264786  2843 tablet_replica.cc:333] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e: stopping tablet replica
I20260709 13:17:50.265262  2843 raft_consensus.cc:2243] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:50.266315  2843 raft_consensus.cc:2272] T c4f71e70f87441408c0353d089d9557d P 7e5b746c9d10411cb2e3948be2e9db1e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.268639  2843 tablet_replica.cc:333] T 7aae7b1e191e428d9abcb7c76f088181 P 7e5b746c9d10411cb2e3948be2e9db1e: stopping tablet replica
I20260709 13:17:50.269393  2843 raft_consensus.cc:2243] T 7aae7b1e191e428d9abcb7c76f088181 P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:50.269883  2843 raft_consensus.cc:2272] T 7aae7b1e191e428d9abcb7c76f088181 P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.271992  2843 tablet_replica.cc:333] T 85ed2545e6bf44589a83b5a92d807ea0 P 7e5b746c9d10411cb2e3948be2e9db1e: stopping tablet replica
I20260709 13:17:50.272487  2843 raft_consensus.cc:2243] T 85ed2545e6bf44589a83b5a92d807ea0 P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:50.272966  2843 raft_consensus.cc:2272] T 85ed2545e6bf44589a83b5a92d807ea0 P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.274958  2843 tablet_replica.cc:333] T 4309ede3f11d451ab65bbdfb178d98d1 P 7e5b746c9d10411cb2e3948be2e9db1e: stopping tablet replica
I20260709 13:17:50.275439  2843 raft_consensus.cc:2243] T 4309ede3f11d451ab65bbdfb178d98d1 P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:50.276315  2843 raft_consensus.cc:2272] T 4309ede3f11d451ab65bbdfb178d98d1 P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.278461  2843 tablet_replica.cc:333] T 66972c9ebce04c89a8e6b410dee75534 P 7e5b746c9d10411cb2e3948be2e9db1e: stopping tablet replica
I20260709 13:17:50.279069  2843 raft_consensus.cc:2243] T 66972c9ebce04c89a8e6b410dee75534 P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:50.279513  2843 raft_consensus.cc:2272] T 66972c9ebce04c89a8e6b410dee75534 P 7e5b746c9d10411cb2e3948be2e9db1e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.324736  2843 tablet_server.cc:196] TabletServer@127.2.198.195:0 shutdown complete.
I20260709 13:17:50.364276  2843 master.cc:562] Master@127.2.198.254:40735 shutting down...
I20260709 13:17:50.393637  2843 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 46ac69a322c84e148564f67454fb0dbb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:50.394335  2843 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 46ac69a322c84e148564f67454fb0dbb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.394719  2843 tablet_replica.cc:333] T 00000000000000000000000000000000 P 46ac69a322c84e148564f67454fb0dbb: stopping tablet replica
I20260709 13:17:50.417024  2843 master.cc:584] Master@127.2.198.254:40735 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (13818 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:17:50.477150  2843 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.198.254:44921
I20260709 13:17:50.478446  2843 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:50.484607 11581 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:50.486166 11584 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:50.486377 11582 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:50.486627  2843 server_base.cc:1061] running on GCE node
I20260709 13:17:50.487989  2843 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:50.488214  2843 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:50.488381  2843 hybrid_clock.cc:648] HybridClock initialized: now 1783603070488364 us; error 0 us; skew 500 ppm
I20260709 13:17:50.488925  2843 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:50.491415  2843 webserver.cc:533] Webserver started at http://127.2.198.254:38927/ using document root <none> and password file <none>
I20260709 13:17:50.492436  2843 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:50.492654  2843 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:50.492941  2843 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:50.494194  2843 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602804652623-2843-0/minicluster-data/master-0-root/instance:
uuid: "950cb04f8e1f4c369a09f8732652d08f"
format_stamp: "Formatted at 2026-07-09 13:17:50 on dist-test-slave-fc6v"
I20260709 13:17:50.498821  2843 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:17:50.502350 11589 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:50.503201  2843 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:17:50.503489  2843 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602804652623-2843-0/minicluster-data/master-0-root
uuid: "950cb04f8e1f4c369a09f8732652d08f"
format_stamp: "Formatted at 2026-07-09 13:17:50 on dist-test-slave-fc6v"
I20260709 13:17:50.503899  2843 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602804652623-2843-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602804652623-2843-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602804652623-2843-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:50.521252  2843 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:50.522625  2843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:50.565481  2843 rpc_server.cc:307] RPC server started. Bound to: 127.2.198.254:44921
I20260709 13:17:50.565580 11640 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.198.254:44921 every 8 connection(s)
I20260709 13:17:50.570034 11641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:50.581547 11641 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 950cb04f8e1f4c369a09f8732652d08f: Bootstrap starting.
I20260709 13:17:50.586800 11641 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 950cb04f8e1f4c369a09f8732652d08f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:50.591818 11641 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 950cb04f8e1f4c369a09f8732652d08f: No bootstrap required, opened a new log
I20260709 13:17:50.594543 11641 raft_consensus.cc:359] T 00000000000000000000000000000000 P 950cb04f8e1f4c369a09f8732652d08f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "950cb04f8e1f4c369a09f8732652d08f" member_type: VOTER }
I20260709 13:17:50.594993 11641 raft_consensus.cc:385] T 00000000000000000000000000000000 P 950cb04f8e1f4c369a09f8732652d08f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:50.595219 11641 raft_consensus.cc:740] T 00000000000000000000000000000000 P 950cb04f8e1f4c369a09f8732652d08f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 950cb04f8e1f4c369a09f8732652d08f, State: Initialized, Role: FOLLOWER
I20260709 13:17:50.595877 11641 consensus_queue.cc:260] T 00000000000000000000000000000000 P 950cb04f8e1f4c369a09f8732652d08f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "950cb04f8e1f4c369a09f8732652d08f" member_type: VOTER }
I20260709 13:17:50.596504 11641 raft_consensus.cc:399] T 00000000000000000000000000000000 P 950cb04f8e1f4c369a09f8732652d08f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:17:50.596750 11641 raft_consensus.cc:493] T 00000000000000000000000000000000 P 950cb04f8e1f4c369a09f8732652d08f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:17:50.597004 11641 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 950cb04f8e1f4c369a09f8732652d08f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:50.602969 11641 raft_consensus.cc:515] T 00000000000000000000000000000000 P 950cb04f8e1f4c369a09f8732652d08f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "950cb04f8e1f4c369a09f8732652d08f" member_type: VOTER }
I20260709 13:17:50.603591 11641 leader_election.cc:304] T 00000000000000000000000000000000 P 950cb04f8e1f4c369a09f8732652d08f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 950cb04f8e1f4c369a09f8732652d08f; no voters: 
I20260709 13:17:50.605067 11641 leader_election.cc:290] T 00000000000000000000000000000000 P 950cb04f8e1f4c369a09f8732652d08f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:17:50.605412 11644 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 950cb04f8e1f4c369a09f8732652d08f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:50.607193 11644 raft_consensus.cc:697] T 00000000000000000000000000000000 P 950cb04f8e1f4c369a09f8732652d08f [term 1 LEADER]: Becoming Leader. State: Replica: 950cb04f8e1f4c369a09f8732652d08f, State: Running, Role: LEADER
I20260709 13:17:50.607991 11644 consensus_queue.cc:237] T 00000000000000000000000000000000 P 950cb04f8e1f4c369a09f8732652d08f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "950cb04f8e1f4c369a09f8732652d08f" member_type: VOTER }
I20260709 13:17:50.608955 11641 sys_catalog.cc:565] T 00000000000000000000000000000000 P 950cb04f8e1f4c369a09f8732652d08f [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:17:50.613348 11645 sys_catalog.cc:455] T 00000000000000000000000000000000 P 950cb04f8e1f4c369a09f8732652d08f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "950cb04f8e1f4c369a09f8732652d08f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "950cb04f8e1f4c369a09f8732652d08f" member_type: VOTER } }
I20260709 13:17:50.614463 11645 sys_catalog.cc:458] T 00000000000000000000000000000000 P 950cb04f8e1f4c369a09f8732652d08f [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:50.615095 11646 sys_catalog.cc:455] T 00000000000000000000000000000000 P 950cb04f8e1f4c369a09f8732652d08f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 950cb04f8e1f4c369a09f8732652d08f. Latest consensus state: current_term: 1 leader_uuid: "950cb04f8e1f4c369a09f8732652d08f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "950cb04f8e1f4c369a09f8732652d08f" member_type: VOTER } }
I20260709 13:17:50.615832 11646 sys_catalog.cc:458] T 00000000000000000000000000000000 P 950cb04f8e1f4c369a09f8732652d08f [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:50.617350 11651 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:17:50.625584 11651 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:17:50.626821  2843 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:17:50.635589 11651 catalog_manager.cc:1383] Generated new cluster ID: 2c674dbb00d34527b0b37ce20b74fae7
I20260709 13:17:50.635916 11651 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:17:50.658179 11651 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:17:50.659742 11651 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:17:50.678548 11651 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 950cb04f8e1f4c369a09f8732652d08f: Generated new TSK 0
I20260709 13:17:50.679261 11651 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:17:50.693877  2843 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:50.700587 11662 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:50.701773 11663 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:50.703970 11665 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:50.704107  2843 server_base.cc:1061] running on GCE node
I20260709 13:17:50.705566  2843 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:50.705840  2843 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:50.706023  2843 hybrid_clock.cc:648] HybridClock initialized: now 1783603070705991 us; error 0 us; skew 500 ppm
I20260709 13:17:50.706598  2843 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:50.709928  2843 webserver.cc:533] Webserver started at http://127.2.198.193:46697/ using document root <none> and password file <none>
I20260709 13:17:50.710453  2843 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:50.710656  2843 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:50.710978  2843 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:50.712266  2843 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602804652623-2843-0/minicluster-data/ts-0-root/instance:
uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126"
format_stamp: "Formatted at 2026-07-09 13:17:50 on dist-test-slave-fc6v"
I20260709 13:17:50.717211  2843 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:17:50.720678 11670 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:50.721465  2843 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:17:50.721864  2843 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602804652623-2843-0/minicluster-data/ts-0-root
uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126"
format_stamp: "Formatted at 2026-07-09 13:17:50 on dist-test-slave-fc6v"
I20260709 13:17:50.722163  2843 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602804652623-2843-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602804652623-2843-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602804652623-2843-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:50.759910  2843 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:50.761324  2843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:50.762979  2843 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:50.765462  2843 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:50.765641  2843 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:50.765946  2843 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:50.766147  2843 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:50.811677  2843 rpc_server.cc:307] RPC server started. Bound to: 127.2.198.193:39519
I20260709 13:17:50.811786 11732 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.198.193:39519 every 8 connection(s)
I20260709 13:17:50.817380  2843 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:50.824795 11737 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:50.825783 11738 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:50.830351 11740 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:50.830474  2843 server_base.cc:1061] running on GCE node
I20260709 13:17:50.831748 11733 heartbeater.cc:344] Connected to a master server at 127.2.198.254:44921
I20260709 13:17:50.832283 11733 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:50.832806  2843 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:50.833139  2843 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:50.833288 11733 heartbeater.cc:507] Master 127.2.198.254:44921 requested a full tablet report, sending...
I20260709 13:17:50.833389  2843 hybrid_clock.cc:648] HybridClock initialized: now 1783603070833365 us; error 0 us; skew 500 ppm
I20260709 13:17:50.834378  2843 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:50.836130 11606 ts_manager.cc:194] Registered new tserver with Master: fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193:39519)
I20260709 13:17:50.837378  2843 webserver.cc:533] Webserver started at http://127.2.198.194:38073/ using document root <none> and password file <none>
I20260709 13:17:50.838155  2843 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:50.838418  2843 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:50.838721  2843 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:50.838932 11606 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36336
I20260709 13:17:50.840562  2843 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602804652623-2843-0/minicluster-data/ts-1-root/instance:
uuid: "838a3115bb3b43aa9d133a9e2867cb1e"
format_stamp: "Formatted at 2026-07-09 13:17:50 on dist-test-slave-fc6v"
I20260709 13:17:50.846076  2843 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.005s
I20260709 13:17:50.849515 11745 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:50.850301  2843 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:17:50.850597  2843 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602804652623-2843-0/minicluster-data/ts-1-root
uuid: "838a3115bb3b43aa9d133a9e2867cb1e"
format_stamp: "Formatted at 2026-07-09 13:17:50 on dist-test-slave-fc6v"
I20260709 13:17:50.850873  2843 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602804652623-2843-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602804652623-2843-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602804652623-2843-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:50.879098  2843 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:50.880528  2843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:50.882179  2843 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:50.884626  2843 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:50.884857  2843 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:50.885103  2843 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:50.885288  2843 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:50.933148  2843 rpc_server.cc:307] RPC server started. Bound to: 127.2.198.194:37031
I20260709 13:17:50.933301 11807 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.198.194:37031 every 8 connection(s)
I20260709 13:17:50.938416  2843 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:50.946473 11811 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:50.948367 11812 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:50.951509 11814 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:50.952726  2843 server_base.cc:1061] running on GCE node
I20260709 13:17:50.953507 11808 heartbeater.cc:344] Connected to a master server at 127.2.198.254:44921
I20260709 13:17:50.953948 11808 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:50.953999  2843 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:50.954375  2843 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:50.954586  2843 hybrid_clock.cc:648] HybridClock initialized: now 1783603070954559 us; error 0 us; skew 500 ppm
I20260709 13:17:50.954912 11808 heartbeater.cc:507] Master 127.2.198.254:44921 requested a full tablet report, sending...
I20260709 13:17:50.955302  2843 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:50.957545 11606 ts_manager.cc:194] Registered new tserver with Master: 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031)
I20260709 13:17:50.958581  2843 webserver.cc:533] Webserver started at http://127.2.198.195:38075/ using document root <none> and password file <none>
I20260709 13:17:50.959343  2843 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:50.959622  2843 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:50.959721 11606 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36344
I20260709 13:17:50.959995  2843 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:50.961656  2843 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602804652623-2843-0/minicluster-data/ts-2-root/instance:
uuid: "11579f7b06aa4eb4be4cd404f83aa8a9"
format_stamp: "Formatted at 2026-07-09 13:17:50 on dist-test-slave-fc6v"
I20260709 13:17:50.966694  2843 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 13:17:50.970551 11819 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:50.971405  2843 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:17:50.971812  2843 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602804652623-2843-0/minicluster-data/ts-2-root
uuid: "11579f7b06aa4eb4be4cd404f83aa8a9"
format_stamp: "Formatted at 2026-07-09 13:17:50 on dist-test-slave-fc6v"
I20260709 13:17:50.972157  2843 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602804652623-2843-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602804652623-2843-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskYqYyVf/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602804652623-2843-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:50.988497  2843 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:50.989833  2843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:50.991506  2843 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:50.993922  2843 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:50.994154  2843 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:50.994406  2843 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:50.994586  2843 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:51.041263  2843 rpc_server.cc:307] RPC server started. Bound to: 127.2.198.195:43253
I20260709 13:17:51.041369 11881 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.198.195:43253 every 8 connection(s)
I20260709 13:17:51.056864 11882 heartbeater.cc:344] Connected to a master server at 127.2.198.254:44921
I20260709 13:17:51.057376 11882 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:51.058095 11882 heartbeater.cc:507] Master 127.2.198.254:44921 requested a full tablet report, sending...
I20260709 13:17:51.060067 11606 ts_manager.cc:194] Registered new tserver with Master: 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253)
I20260709 13:17:51.060652  2843 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01579723s
I20260709 13:17:51.061982 11606 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36350
I20260709 13:17:51.088461 11606 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36354:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:17:51.091591 11606 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:17:51.171332 11698 tablet_service.cc:1511] Processing CreateTablet for tablet 8fd864b8209b45debd46cbde76e1e66e (DEFAULT_TABLE table=test-workload [id=8bbd36aafe3f4a939430519cd5e4a5e9]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:17:51.173056 11698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fd864b8209b45debd46cbde76e1e66e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.173202 11697 tablet_service.cc:1511] Processing CreateTablet for tablet 18ecbae8747a4d928473333988f89191 (DEFAULT_TABLE table=test-workload [id=8bbd36aafe3f4a939430519cd5e4a5e9]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:17:51.174853 11697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18ecbae8747a4d928473333988f89191. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.186479 11696 tablet_service.cc:1511] Processing CreateTablet for tablet e4fc1968ceff48fdb57d0c32ec0e48be (DEFAULT_TABLE table=test-workload [id=8bbd36aafe3f4a939430519cd5e4a5e9]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:17:51.188162 11696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4fc1968ceff48fdb57d0c32ec0e48be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.188793 11847 tablet_service.cc:1511] Processing CreateTablet for tablet 8fd864b8209b45debd46cbde76e1e66e (DEFAULT_TABLE table=test-workload [id=8bbd36aafe3f4a939430519cd5e4a5e9]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:17:51.205197 11847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fd864b8209b45debd46cbde76e1e66e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.206719 11771 tablet_service.cc:1511] Processing CreateTablet for tablet e4fc1968ceff48fdb57d0c32ec0e48be (DEFAULT_TABLE table=test-workload [id=8bbd36aafe3f4a939430519cd5e4a5e9]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:17:51.208736 11771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4fc1968ceff48fdb57d0c32ec0e48be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.208815 11772 tablet_service.cc:1511] Processing CreateTablet for tablet 18ecbae8747a4d928473333988f89191 (DEFAULT_TABLE table=test-workload [id=8bbd36aafe3f4a939430519cd5e4a5e9]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:17:51.210321 11772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18ecbae8747a4d928473333988f89191. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.189548 11846 tablet_service.cc:1511] Processing CreateTablet for tablet 18ecbae8747a4d928473333988f89191 (DEFAULT_TABLE table=test-workload [id=8bbd36aafe3f4a939430519cd5e4a5e9]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:17:51.212208 11846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18ecbae8747a4d928473333988f89191. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.191287 11844 tablet_service.cc:1511] Processing CreateTablet for tablet c2b0f9021628468991c5a4ef3ebade45 (DEFAULT_TABLE table=test-workload [id=8bbd36aafe3f4a939430519cd5e4a5e9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:17:51.214371 11844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2b0f9021628468991c5a4ef3ebade45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.192589 11773 tablet_service.cc:1511] Processing CreateTablet for tablet 8fd864b8209b45debd46cbde76e1e66e (DEFAULT_TABLE table=test-workload [id=8bbd36aafe3f4a939430519cd5e4a5e9]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:17:51.216545 11773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fd864b8209b45debd46cbde76e1e66e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.193081 11843 tablet_service.cc:1511] Processing CreateTablet for tablet 3a4012d4e7024b00bd58a041e3a07dcb (DEFAULT_TABLE table=test-workload [id=8bbd36aafe3f4a939430519cd5e4a5e9]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:17:51.218523 11843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a4012d4e7024b00bd58a041e3a07dcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.194892 11845 tablet_service.cc:1511] Processing CreateTablet for tablet e4fc1968ceff48fdb57d0c32ec0e48be (DEFAULT_TABLE table=test-workload [id=8bbd36aafe3f4a939430519cd5e4a5e9]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:17:51.220558 11845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4fc1968ceff48fdb57d0c32ec0e48be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.197944 11695 tablet_service.cc:1511] Processing CreateTablet for tablet c2b0f9021628468991c5a4ef3ebade45 (DEFAULT_TABLE table=test-workload [id=8bbd36aafe3f4a939430519cd5e4a5e9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:17:51.199793 11694 tablet_service.cc:1511] Processing CreateTablet for tablet 3a4012d4e7024b00bd58a041e3a07dcb (DEFAULT_TABLE table=test-workload [id=8bbd36aafe3f4a939430519cd5e4a5e9]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:17:51.201702 11842 tablet_service.cc:1511] Processing CreateTablet for tablet 5af25078161a4293851bc656e0eb8b22 (DEFAULT_TABLE table=test-workload [id=8bbd36aafe3f4a939430519cd5e4a5e9]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:17:51.203567 11841 tablet_service.cc:1511] Processing CreateTablet for tablet 83da4971ae24448e9dd2d458ad585340 (DEFAULT_TABLE table=test-workload [id=8bbd36aafe3f4a939430519cd5e4a5e9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:17:51.224622 11841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83da4971ae24448e9dd2d458ad585340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.226475 11842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5af25078161a4293851bc656e0eb8b22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.228405 11695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2b0f9021628468991c5a4ef3ebade45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.229537 11694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a4012d4e7024b00bd58a041e3a07dcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.232110 11693 tablet_service.cc:1511] Processing CreateTablet for tablet 5af25078161a4293851bc656e0eb8b22 (DEFAULT_TABLE table=test-workload [id=8bbd36aafe3f4a939430519cd5e4a5e9]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:17:51.234086 11693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5af25078161a4293851bc656e0eb8b22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.236979 11840 tablet_service.cc:1511] Processing CreateTablet for tablet 930ea8ac2d2c41819a1481a4b2e09b24 (DEFAULT_TABLE table=test-workload [id=8bbd36aafe3f4a939430519cd5e4a5e9]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:17:51.238525 11840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 930ea8ac2d2c41819a1481a4b2e09b24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.241052 11692 tablet_service.cc:1511] Processing CreateTablet for tablet 83da4971ae24448e9dd2d458ad585340 (DEFAULT_TABLE table=test-workload [id=8bbd36aafe3f4a939430519cd5e4a5e9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:17:51.242661 11692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83da4971ae24448e9dd2d458ad585340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.244758 11839 tablet_service.cc:1511] Processing CreateTablet for tablet 509909ca832c4367bb1c43c3f8bc21e1 (DEFAULT_TABLE table=test-workload [id=8bbd36aafe3f4a939430519cd5e4a5e9]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:17:51.245968 11691 tablet_service.cc:1511] Processing CreateTablet for tablet 509909ca832c4367bb1c43c3f8bc21e1 (DEFAULT_TABLE table=test-workload [id=8bbd36aafe3f4a939430519cd5e4a5e9]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:17:51.247395 11770 tablet_service.cc:1511] Processing CreateTablet for tablet c2b0f9021628468991c5a4ef3ebade45 (DEFAULT_TABLE table=test-workload [id=8bbd36aafe3f4a939430519cd5e4a5e9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:17:51.247390 11697 tablet_service.cc:1511] Processing CreateTablet for tablet 930ea8ac2d2c41819a1481a4b2e09b24 (DEFAULT_TABLE table=test-workload [id=8bbd36aafe3f4a939430519cd5e4a5e9]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:17:51.249102 11770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2b0f9021628468991c5a4ef3ebade45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.247382 11691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 509909ca832c4367bb1c43c3f8bc21e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.258200 11839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 509909ca832c4367bb1c43c3f8bc21e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.270238 11769 tablet_service.cc:1511] Processing CreateTablet for tablet 3a4012d4e7024b00bd58a041e3a07dcb (DEFAULT_TABLE table=test-workload [id=8bbd36aafe3f4a939430519cd5e4a5e9]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:17:51.272517 11769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a4012d4e7024b00bd58a041e3a07dcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.281966 11768 tablet_service.cc:1511] Processing CreateTablet for tablet 5af25078161a4293851bc656e0eb8b22 (DEFAULT_TABLE table=test-workload [id=8bbd36aafe3f4a939430519cd5e4a5e9]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:17:51.284250 11768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5af25078161a4293851bc656e0eb8b22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.297880 11767 tablet_service.cc:1511] Processing CreateTablet for tablet 83da4971ae24448e9dd2d458ad585340 (DEFAULT_TABLE table=test-workload [id=8bbd36aafe3f4a939430519cd5e4a5e9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:17:51.300078 11767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83da4971ae24448e9dd2d458ad585340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.309827 11766 tablet_service.cc:1511] Processing CreateTablet for tablet 930ea8ac2d2c41819a1481a4b2e09b24 (DEFAULT_TABLE table=test-workload [id=8bbd36aafe3f4a939430519cd5e4a5e9]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:17:51.312546 11766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 930ea8ac2d2c41819a1481a4b2e09b24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.317575 11765 tablet_service.cc:1511] Processing CreateTablet for tablet 509909ca832c4367bb1c43c3f8bc21e1 (DEFAULT_TABLE table=test-workload [id=8bbd36aafe3f4a939430519cd5e4a5e9]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:17:51.319165 11765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 509909ca832c4367bb1c43c3f8bc21e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.327615 11697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 930ea8ac2d2c41819a1481a4b2e09b24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.403062 11898 tablet_bootstrap.cc:492] T 509909ca832c4367bb1c43c3f8bc21e1 P 838a3115bb3b43aa9d133a9e2867cb1e: Bootstrap starting.
I20260709 13:17:51.403322 11897 tablet_bootstrap.cc:492] T 8fd864b8209b45debd46cbde76e1e66e P fcd7d1bb34ba477f8b4fb7fcf67b7126: Bootstrap starting.
I20260709 13:17:51.422770 11897 tablet_bootstrap.cc:654] T 8fd864b8209b45debd46cbde76e1e66e P fcd7d1bb34ba477f8b4fb7fcf67b7126: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.425536 11899 tablet_bootstrap.cc:492] T 930ea8ac2d2c41819a1481a4b2e09b24 P 11579f7b06aa4eb4be4cd404f83aa8a9: Bootstrap starting.
I20260709 13:17:51.440426 11899 tablet_bootstrap.cc:654] T 930ea8ac2d2c41819a1481a4b2e09b24 P 11579f7b06aa4eb4be4cd404f83aa8a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.446172 11898 tablet_bootstrap.cc:654] T 509909ca832c4367bb1c43c3f8bc21e1 P 838a3115bb3b43aa9d133a9e2867cb1e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.451686 11897 tablet_bootstrap.cc:492] T 8fd864b8209b45debd46cbde76e1e66e P fcd7d1bb34ba477f8b4fb7fcf67b7126: No bootstrap required, opened a new log
I20260709 13:17:51.452575 11897 ts_tablet_manager.cc:1403] T 8fd864b8209b45debd46cbde76e1e66e P fcd7d1bb34ba477f8b4fb7fcf67b7126: Time spent bootstrapping tablet: real 0.050s	user 0.005s	sys 0.010s
I20260709 13:17:51.455895 11899 tablet_bootstrap.cc:492] T 930ea8ac2d2c41819a1481a4b2e09b24 P 11579f7b06aa4eb4be4cd404f83aa8a9: No bootstrap required, opened a new log
I20260709 13:17:51.456314 11898 tablet_bootstrap.cc:492] T 509909ca832c4367bb1c43c3f8bc21e1 P 838a3115bb3b43aa9d133a9e2867cb1e: No bootstrap required, opened a new log
I20260709 13:17:51.456555 11899 ts_tablet_manager.cc:1403] T 930ea8ac2d2c41819a1481a4b2e09b24 P 11579f7b06aa4eb4be4cd404f83aa8a9: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.005s
I20260709 13:17:51.456921 11898 ts_tablet_manager.cc:1403] T 509909ca832c4367bb1c43c3f8bc21e1 P 838a3115bb3b43aa9d133a9e2867cb1e: Time spent bootstrapping tablet: real 0.054s	user 0.010s	sys 0.007s
I20260709 13:17:51.456535 11897 raft_consensus.cc:359] T 8fd864b8209b45debd46cbde76e1e66e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } }
I20260709 13:17:51.457523 11897 raft_consensus.cc:385] T 8fd864b8209b45debd46cbde76e1e66e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.457830 11897 raft_consensus.cc:740] T 8fd864b8209b45debd46cbde76e1e66e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd7d1bb34ba477f8b4fb7fcf67b7126, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.458546 11897 consensus_queue.cc:260] T 8fd864b8209b45debd46cbde76e1e66e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } }
I20260709 13:17:51.460765 11733 heartbeater.cc:499] Master 127.2.198.254:44921 was elected leader, sending a full tablet report...
I20260709 13:17:51.460573 11899 raft_consensus.cc:359] T 930ea8ac2d2c41819a1481a4b2e09b24 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:51.460841 11898 raft_consensus.cc:359] T 509909ca832c4367bb1c43c3f8bc21e1 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:51.461671 11899 raft_consensus.cc:385] T 930ea8ac2d2c41819a1481a4b2e09b24 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.461807 11898 raft_consensus.cc:385] T 509909ca832c4367bb1c43c3f8bc21e1 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.462107 11899 raft_consensus.cc:740] T 930ea8ac2d2c41819a1481a4b2e09b24 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11579f7b06aa4eb4be4cd404f83aa8a9, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.462211 11898 raft_consensus.cc:740] T 509909ca832c4367bb1c43c3f8bc21e1 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 838a3115bb3b43aa9d133a9e2867cb1e, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.463119 11899 consensus_queue.cc:260] T 930ea8ac2d2c41819a1481a4b2e09b24 P 11579f7b06aa4eb4be4cd404f83aa8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:51.465247 11897 ts_tablet_manager.cc:1434] T 8fd864b8209b45debd46cbde76e1e66e P fcd7d1bb34ba477f8b4fb7fcf67b7126: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:17:51.466590 11882 heartbeater.cc:499] Master 127.2.198.254:44921 was elected leader, sending a full tablet report...
I20260709 13:17:51.466675 11897 tablet_bootstrap.cc:492] T 18ecbae8747a4d928473333988f89191 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Bootstrap starting.
I20260709 13:17:51.467219 11899 ts_tablet_manager.cc:1434] T 930ea8ac2d2c41819a1481a4b2e09b24 P 11579f7b06aa4eb4be4cd404f83aa8a9: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.004s
I20260709 13:17:51.468422 11899 tablet_bootstrap.cc:492] T 8fd864b8209b45debd46cbde76e1e66e P 11579f7b06aa4eb4be4cd404f83aa8a9: Bootstrap starting.
I20260709 13:17:51.463124 11898 consensus_queue.cc:260] T 509909ca832c4367bb1c43c3f8bc21e1 P 838a3115bb3b43aa9d133a9e2867cb1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:51.477056 11899 tablet_bootstrap.cc:654] T 8fd864b8209b45debd46cbde76e1e66e P 11579f7b06aa4eb4be4cd404f83aa8a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.478120 11808 heartbeater.cc:499] Master 127.2.198.254:44921 was elected leader, sending a full tablet report...
I20260709 13:17:51.480473 11897 tablet_bootstrap.cc:654] T 18ecbae8747a4d928473333988f89191 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.485476 11898 ts_tablet_manager.cc:1434] T 509909ca832c4367bb1c43c3f8bc21e1 P 838a3115bb3b43aa9d133a9e2867cb1e: Time spent starting tablet: real 0.028s	user 0.013s	sys 0.000s
I20260709 13:17:51.489048 11898 tablet_bootstrap.cc:492] T 8fd864b8209b45debd46cbde76e1e66e P 838a3115bb3b43aa9d133a9e2867cb1e: Bootstrap starting.
I20260709 13:17:51.489616 11899 tablet_bootstrap.cc:492] T 8fd864b8209b45debd46cbde76e1e66e P 11579f7b06aa4eb4be4cd404f83aa8a9: No bootstrap required, opened a new log
I20260709 13:17:51.490209 11899 ts_tablet_manager.cc:1403] T 8fd864b8209b45debd46cbde76e1e66e P 11579f7b06aa4eb4be4cd404f83aa8a9: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.008s
I20260709 13:17:51.493569 11899 raft_consensus.cc:359] T 8fd864b8209b45debd46cbde76e1e66e P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } }
I20260709 13:17:51.494345 11899 raft_consensus.cc:385] T 8fd864b8209b45debd46cbde76e1e66e P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.494680 11899 raft_consensus.cc:740] T 8fd864b8209b45debd46cbde76e1e66e P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11579f7b06aa4eb4be4cd404f83aa8a9, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.495496 11899 consensus_queue.cc:260] T 8fd864b8209b45debd46cbde76e1e66e P 11579f7b06aa4eb4be4cd404f83aa8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } }
I20260709 13:17:51.497933 11899 ts_tablet_manager.cc:1434] T 8fd864b8209b45debd46cbde76e1e66e P 11579f7b06aa4eb4be4cd404f83aa8a9: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:17:51.498994 11899 tablet_bootstrap.cc:492] T 18ecbae8747a4d928473333988f89191 P 11579f7b06aa4eb4be4cd404f83aa8a9: Bootstrap starting.
I20260709 13:17:51.499768 11898 tablet_bootstrap.cc:654] T 8fd864b8209b45debd46cbde76e1e66e P 838a3115bb3b43aa9d133a9e2867cb1e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.506102 11899 tablet_bootstrap.cc:654] T 18ecbae8747a4d928473333988f89191 P 11579f7b06aa4eb4be4cd404f83aa8a9: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:51.546042 11883 tablet.cc:2406] T 8fd864b8209b45debd46cbde76e1e66e P 11579f7b06aa4eb4be4cd404f83aa8a9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:17:51.556273 11899 tablet_bootstrap.cc:492] T 18ecbae8747a4d928473333988f89191 P 11579f7b06aa4eb4be4cd404f83aa8a9: No bootstrap required, opened a new log
I20260709 13:17:51.557233 11899 ts_tablet_manager.cc:1403] T 18ecbae8747a4d928473333988f89191 P 11579f7b06aa4eb4be4cd404f83aa8a9: Time spent bootstrapping tablet: real 0.058s	user 0.039s	sys 0.017s
I20260709 13:17:51.557731 11904 raft_consensus.cc:493] T 930ea8ac2d2c41819a1481a4b2e09b24 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.558732 11897 tablet_bootstrap.cc:492] T 18ecbae8747a4d928473333988f89191 P fcd7d1bb34ba477f8b4fb7fcf67b7126: No bootstrap required, opened a new log
I20260709 13:17:51.557250 11898 tablet_bootstrap.cc:492] T 8fd864b8209b45debd46cbde76e1e66e P 838a3115bb3b43aa9d133a9e2867cb1e: No bootstrap required, opened a new log
I20260709 13:17:51.558576 11904 raft_consensus.cc:515] T 930ea8ac2d2c41819a1481a4b2e09b24 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:51.560360 11898 ts_tablet_manager.cc:1403] T 8fd864b8209b45debd46cbde76e1e66e P 838a3115bb3b43aa9d133a9e2867cb1e: Time spent bootstrapping tablet: real 0.072s	user 0.030s	sys 0.038s
I20260709 13:17:51.559522 11897 ts_tablet_manager.cc:1403] T 18ecbae8747a4d928473333988f89191 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Time spent bootstrapping tablet: real 0.093s	user 0.033s	sys 0.049s
I20260709 13:17:51.561375 11899 raft_consensus.cc:359] T 18ecbae8747a4d928473333988f89191 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:51.562398 11899 raft_consensus.cc:385] T 18ecbae8747a4d928473333988f89191 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.562777 11899 raft_consensus.cc:740] T 18ecbae8747a4d928473333988f89191 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11579f7b06aa4eb4be4cd404f83aa8a9, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.563898 11899 consensus_queue.cc:260] T 18ecbae8747a4d928473333988f89191 P 11579f7b06aa4eb4be4cd404f83aa8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:51.564361 11898 raft_consensus.cc:359] T 8fd864b8209b45debd46cbde76e1e66e P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } }
I20260709 13:17:51.565408 11898 raft_consensus.cc:385] T 8fd864b8209b45debd46cbde76e1e66e P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.565788 11898 raft_consensus.cc:740] T 8fd864b8209b45debd46cbde76e1e66e P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 838a3115bb3b43aa9d133a9e2867cb1e, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.566092 11897 raft_consensus.cc:359] T 18ecbae8747a4d928473333988f89191 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:51.566629 11898 consensus_queue.cc:260] T 8fd864b8209b45debd46cbde76e1e66e P 838a3115bb3b43aa9d133a9e2867cb1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } }
I20260709 13:17:51.566263 11904 leader_election.cc:290] T 930ea8ac2d2c41819a1481a4b2e09b24 P 11579f7b06aa4eb4be4cd404f83aa8a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193:39519), 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031)
I20260709 13:17:51.567453 11897 raft_consensus.cc:385] T 18ecbae8747a4d928473333988f89191 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.568007 11897 raft_consensus.cc:740] T 18ecbae8747a4d928473333988f89191 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd7d1bb34ba477f8b4fb7fcf67b7126, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.569229 11903 raft_consensus.cc:493] T 8fd864b8209b45debd46cbde76e1e66e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.569932 11903 raft_consensus.cc:515] T 8fd864b8209b45debd46cbde76e1e66e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } }
I20260709 13:17:51.577302 11898 ts_tablet_manager.cc:1434] T 8fd864b8209b45debd46cbde76e1e66e P 838a3115bb3b43aa9d133a9e2867cb1e: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:17:51.583848 11903 leader_election.cc:290] T 8fd864b8209b45debd46cbde76e1e66e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253), 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031)
I20260709 13:17:51.587198 11898 tablet_bootstrap.cc:492] T 18ecbae8747a4d928473333988f89191 P 838a3115bb3b43aa9d133a9e2867cb1e: Bootstrap starting.
I20260709 13:17:51.588712 11897 consensus_queue.cc:260] T 18ecbae8747a4d928473333988f89191 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:51.596573 11898 tablet_bootstrap.cc:654] T 18ecbae8747a4d928473333988f89191 P 838a3115bb3b43aa9d133a9e2867cb1e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.601547 11897 ts_tablet_manager.cc:1434] T 18ecbae8747a4d928473333988f89191 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260709 13:17:51.615461 11899 ts_tablet_manager.cc:1434] T 18ecbae8747a4d928473333988f89191 P 11579f7b06aa4eb4be4cd404f83aa8a9: Time spent starting tablet: real 0.058s	user 0.037s	sys 0.019s
I20260709 13:17:51.617070 11899 tablet_bootstrap.cc:492] T 3a4012d4e7024b00bd58a041e3a07dcb P 11579f7b06aa4eb4be4cd404f83aa8a9: Bootstrap starting.
W20260709 13:17:51.621155 11654 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:51.623281 11897 tablet_bootstrap.cc:492] T 509909ca832c4367bb1c43c3f8bc21e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Bootstrap starting.
I20260709 13:17:51.624708 11899 tablet_bootstrap.cc:654] T 3a4012d4e7024b00bd58a041e3a07dcb P 11579f7b06aa4eb4be4cd404f83aa8a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.645706 11783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd864b8209b45debd46cbde76e1e66e" candidate_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" is_pre_election: true
I20260709 13:17:51.646781 11783 raft_consensus.cc:2468] T 8fd864b8209b45debd46cbde76e1e66e P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd7d1bb34ba477f8b4fb7fcf67b7126 in term 0.
I20260709 13:17:51.648327 11674 leader_election.cc:304] T 8fd864b8209b45debd46cbde76e1e66e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 838a3115bb3b43aa9d133a9e2867cb1e, fcd7d1bb34ba477f8b4fb7fcf67b7126; no voters: 
I20260709 13:17:51.649406 11903 raft_consensus.cc:2804] T 8fd864b8209b45debd46cbde76e1e66e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:51.649837 11903 raft_consensus.cc:493] T 8fd864b8209b45debd46cbde76e1e66e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.650224 11903 raft_consensus.cc:3060] T 8fd864b8209b45debd46cbde76e1e66e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:51.654341 11708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930ea8ac2d2c41819a1481a4b2e09b24" candidate_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" is_pre_election: true
I20260709 13:17:51.655855 11783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930ea8ac2d2c41819a1481a4b2e09b24" candidate_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" is_pre_election: true
W20260709 13:17:51.656790 11823 leader_election.cc:343] T 930ea8ac2d2c41819a1481a4b2e09b24 P 11579f7b06aa4eb4be4cd404f83aa8a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193:39519): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:51.657882 11823 leader_election.cc:343] T 930ea8ac2d2c41819a1481a4b2e09b24 P 11579f7b06aa4eb4be4cd404f83aa8a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:51.658456 11823 leader_election.cc:304] T 930ea8ac2d2c41819a1481a4b2e09b24 P 11579f7b06aa4eb4be4cd404f83aa8a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11579f7b06aa4eb4be4cd404f83aa8a9; no voters: 838a3115bb3b43aa9d133a9e2867cb1e, fcd7d1bb34ba477f8b4fb7fcf67b7126
I20260709 13:17:51.659521 11898 tablet_bootstrap.cc:492] T 18ecbae8747a4d928473333988f89191 P 838a3115bb3b43aa9d133a9e2867cb1e: No bootstrap required, opened a new log
I20260709 13:17:51.659777 11911 raft_consensus.cc:2749] T 930ea8ac2d2c41819a1481a4b2e09b24 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:51.660281 11898 ts_tablet_manager.cc:1403] T 18ecbae8747a4d928473333988f89191 P 838a3115bb3b43aa9d133a9e2867cb1e: Time spent bootstrapping tablet: real 0.073s	user 0.020s	sys 0.039s
I20260709 13:17:51.659746 11903 raft_consensus.cc:515] T 8fd864b8209b45debd46cbde76e1e66e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } }
I20260709 13:17:51.662020 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd864b8209b45debd46cbde76e1e66e" candidate_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" is_pre_election: true
I20260709 13:17:51.663036 11857 raft_consensus.cc:2468] T 8fd864b8209b45debd46cbde76e1e66e P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd7d1bb34ba477f8b4fb7fcf67b7126 in term 0.
I20260709 13:17:51.664474 11783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd864b8209b45debd46cbde76e1e66e" candidate_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "838a3115bb3b43aa9d133a9e2867cb1e"
I20260709 13:17:51.664165 11898 raft_consensus.cc:359] T 18ecbae8747a4d928473333988f89191 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:51.665108 11898 raft_consensus.cc:385] T 18ecbae8747a4d928473333988f89191 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.665145 11783 raft_consensus.cc:3060] T 8fd864b8209b45debd46cbde76e1e66e P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:51.665647 11898 raft_consensus.cc:740] T 18ecbae8747a4d928473333988f89191 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 838a3115bb3b43aa9d133a9e2867cb1e, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.666674 11898 consensus_queue.cc:260] T 18ecbae8747a4d928473333988f89191 P 838a3115bb3b43aa9d133a9e2867cb1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:51.667007 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd864b8209b45debd46cbde76e1e66e" candidate_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9"
I20260709 13:17:51.667874 11857 raft_consensus.cc:3060] T 8fd864b8209b45debd46cbde76e1e66e P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:51.669952 11898 ts_tablet_manager.cc:1434] T 18ecbae8747a4d928473333988f89191 P 838a3115bb3b43aa9d133a9e2867cb1e: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:17:51.671370 11898 tablet_bootstrap.cc:492] T e4fc1968ceff48fdb57d0c32ec0e48be P 838a3115bb3b43aa9d133a9e2867cb1e: Bootstrap starting.
I20260709 13:17:51.677558 11903 leader_election.cc:290] T 8fd864b8209b45debd46cbde76e1e66e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 1 election: Requested vote from peers 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253), 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031)
I20260709 13:17:51.679632 11898 tablet_bootstrap.cc:654] T e4fc1968ceff48fdb57d0c32ec0e48be P 838a3115bb3b43aa9d133a9e2867cb1e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.679865 11783 raft_consensus.cc:2468] T 8fd864b8209b45debd46cbde76e1e66e P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd7d1bb34ba477f8b4fb7fcf67b7126 in term 1.
I20260709 13:17:51.681547 11674 leader_election.cc:304] T 8fd864b8209b45debd46cbde76e1e66e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 838a3115bb3b43aa9d133a9e2867cb1e, fcd7d1bb34ba477f8b4fb7fcf67b7126; no voters: 
I20260709 13:17:51.682636 11903 raft_consensus.cc:2804] T 8fd864b8209b45debd46cbde76e1e66e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:51.687374 11903 raft_consensus.cc:697] T 8fd864b8209b45debd46cbde76e1e66e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 LEADER]: Becoming Leader. State: Replica: fcd7d1bb34ba477f8b4fb7fcf67b7126, State: Running, Role: LEADER
I20260709 13:17:51.688463 11903 consensus_queue.cc:237] T 8fd864b8209b45debd46cbde76e1e66e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } }
I20260709 13:17:51.699226 11857 raft_consensus.cc:2468] T 8fd864b8209b45debd46cbde76e1e66e P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd7d1bb34ba477f8b4fb7fcf67b7126 in term 1.
I20260709 13:17:51.700681 11898 tablet_bootstrap.cc:492] T e4fc1968ceff48fdb57d0c32ec0e48be P 838a3115bb3b43aa9d133a9e2867cb1e: No bootstrap required, opened a new log
I20260709 13:17:51.700770 11897 tablet_bootstrap.cc:654] T 509909ca832c4367bb1c43c3f8bc21e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.701596 11898 ts_tablet_manager.cc:1403] T e4fc1968ceff48fdb57d0c32ec0e48be P 838a3115bb3b43aa9d133a9e2867cb1e: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.007s
I20260709 13:17:51.702531 11899 tablet_bootstrap.cc:492] T 3a4012d4e7024b00bd58a041e3a07dcb P 11579f7b06aa4eb4be4cd404f83aa8a9: No bootstrap required, opened a new log
I20260709 13:17:51.703187 11899 ts_tablet_manager.cc:1403] T 3a4012d4e7024b00bd58a041e3a07dcb P 11579f7b06aa4eb4be4cd404f83aa8a9: Time spent bootstrapping tablet: real 0.086s	user 0.034s	sys 0.042s
I20260709 13:17:51.704793 11604 catalog_manager.cc:5697] T 8fd864b8209b45debd46cbde76e1e66e P fcd7d1bb34ba477f8b4fb7fcf67b7126 reported cstate change: term changed from 0 to 1, leader changed from <none> to fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:51.705535 11898 raft_consensus.cc:359] T e4fc1968ceff48fdb57d0c32ec0e48be P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:51.706614 11898 raft_consensus.cc:385] T e4fc1968ceff48fdb57d0c32ec0e48be P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.707005 11898 raft_consensus.cc:740] T e4fc1968ceff48fdb57d0c32ec0e48be P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 838a3115bb3b43aa9d133a9e2867cb1e, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.707260 11899 raft_consensus.cc:359] T 3a4012d4e7024b00bd58a041e3a07dcb P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:51.708376 11899 raft_consensus.cc:385] T 3a4012d4e7024b00bd58a041e3a07dcb P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.708187 11898 consensus_queue.cc:260] T e4fc1968ceff48fdb57d0c32ec0e48be P 838a3115bb3b43aa9d133a9e2867cb1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:51.708854 11899 raft_consensus.cc:740] T 3a4012d4e7024b00bd58a041e3a07dcb P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11579f7b06aa4eb4be4cd404f83aa8a9, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.710103 11899 consensus_queue.cc:260] T 3a4012d4e7024b00bd58a041e3a07dcb P 11579f7b06aa4eb4be4cd404f83aa8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:51.713698 11898 ts_tablet_manager.cc:1434] T e4fc1968ceff48fdb57d0c32ec0e48be P 838a3115bb3b43aa9d133a9e2867cb1e: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:17:51.714949 11898 tablet_bootstrap.cc:492] T 930ea8ac2d2c41819a1481a4b2e09b24 P 838a3115bb3b43aa9d133a9e2867cb1e: Bootstrap starting.
I20260709 13:17:51.716318 11899 ts_tablet_manager.cc:1434] T 3a4012d4e7024b00bd58a041e3a07dcb P 11579f7b06aa4eb4be4cd404f83aa8a9: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.005s
I20260709 13:17:51.716343 11897 tablet_bootstrap.cc:492] T 509909ca832c4367bb1c43c3f8bc21e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126: No bootstrap required, opened a new log
I20260709 13:17:51.717345 11897 ts_tablet_manager.cc:1403] T 509909ca832c4367bb1c43c3f8bc21e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Time spent bootstrapping tablet: real 0.094s	user 0.021s	sys 0.002s
I20260709 13:17:51.717934 11899 tablet_bootstrap.cc:492] T 5af25078161a4293851bc656e0eb8b22 P 11579f7b06aa4eb4be4cd404f83aa8a9: Bootstrap starting.
I20260709 13:17:51.721591 11897 raft_consensus.cc:359] T 509909ca832c4367bb1c43c3f8bc21e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:51.722618 11897 raft_consensus.cc:385] T 509909ca832c4367bb1c43c3f8bc21e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.722875 11898 tablet_bootstrap.cc:654] T 930ea8ac2d2c41819a1481a4b2e09b24 P 838a3115bb3b43aa9d133a9e2867cb1e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.723048 11897 raft_consensus.cc:740] T 509909ca832c4367bb1c43c3f8bc21e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd7d1bb34ba477f8b4fb7fcf67b7126, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.724634 11897 consensus_queue.cc:260] T 509909ca832c4367bb1c43c3f8bc21e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:51.728160 11899 tablet_bootstrap.cc:654] T 5af25078161a4293851bc656e0eb8b22 P 11579f7b06aa4eb4be4cd404f83aa8a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.728169 11897 ts_tablet_manager.cc:1434] T 509909ca832c4367bb1c43c3f8bc21e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 13:17:51.730137 11897 tablet_bootstrap.cc:492] T 83da4971ae24448e9dd2d458ad585340 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Bootstrap starting.
I20260709 13:17:51.738456 11897 tablet_bootstrap.cc:654] T 83da4971ae24448e9dd2d458ad585340 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.753225 11898 tablet_bootstrap.cc:492] T 930ea8ac2d2c41819a1481a4b2e09b24 P 838a3115bb3b43aa9d133a9e2867cb1e: No bootstrap required, opened a new log
I20260709 13:17:51.753659 11897 tablet_bootstrap.cc:492] T 83da4971ae24448e9dd2d458ad585340 P fcd7d1bb34ba477f8b4fb7fcf67b7126: No bootstrap required, opened a new log
I20260709 13:17:51.754097 11898 ts_tablet_manager.cc:1403] T 930ea8ac2d2c41819a1481a4b2e09b24 P 838a3115bb3b43aa9d133a9e2867cb1e: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.010s
I20260709 13:17:51.754331 11897 ts_tablet_manager.cc:1403] T 83da4971ae24448e9dd2d458ad585340 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Time spent bootstrapping tablet: real 0.025s	user 0.021s	sys 0.000s
I20260709 13:17:51.756641 11899 tablet_bootstrap.cc:492] T 5af25078161a4293851bc656e0eb8b22 P 11579f7b06aa4eb4be4cd404f83aa8a9: No bootstrap required, opened a new log
I20260709 13:17:51.757284 11899 ts_tablet_manager.cc:1403] T 5af25078161a4293851bc656e0eb8b22 P 11579f7b06aa4eb4be4cd404f83aa8a9: Time spent bootstrapping tablet: real 0.040s	user 0.022s	sys 0.007s
I20260709 13:17:51.758082 11898 raft_consensus.cc:359] T 930ea8ac2d2c41819a1481a4b2e09b24 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:51.758414 11897 raft_consensus.cc:359] T 83da4971ae24448e9dd2d458ad585340 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:51.759099 11898 raft_consensus.cc:385] T 930ea8ac2d2c41819a1481a4b2e09b24 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.759356 11897 raft_consensus.cc:385] T 83da4971ae24448e9dd2d458ad585340 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.759471 11898 raft_consensus.cc:740] T 930ea8ac2d2c41819a1481a4b2e09b24 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 838a3115bb3b43aa9d133a9e2867cb1e, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.759987 11897 raft_consensus.cc:740] T 83da4971ae24448e9dd2d458ad585340 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd7d1bb34ba477f8b4fb7fcf67b7126, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.760593 11899 raft_consensus.cc:359] T 5af25078161a4293851bc656e0eb8b22 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:51.761269 11899 raft_consensus.cc:385] T 5af25078161a4293851bc656e0eb8b22 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.760528 11898 consensus_queue.cc:260] T 930ea8ac2d2c41819a1481a4b2e09b24 P 838a3115bb3b43aa9d133a9e2867cb1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:51.760926 11897 consensus_queue.cc:260] T 83da4971ae24448e9dd2d458ad585340 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:51.761616 11899 raft_consensus.cc:740] T 5af25078161a4293851bc656e0eb8b22 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11579f7b06aa4eb4be4cd404f83aa8a9, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.762478 11899 consensus_queue.cc:260] T 5af25078161a4293851bc656e0eb8b22 P 11579f7b06aa4eb4be4cd404f83aa8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:51.763712 11897 ts_tablet_manager.cc:1434] T 83da4971ae24448e9dd2d458ad585340 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 13:17:51.765033 11897 tablet_bootstrap.cc:492] T 5af25078161a4293851bc656e0eb8b22 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Bootstrap starting.
I20260709 13:17:51.766947 11898 ts_tablet_manager.cc:1434] T 930ea8ac2d2c41819a1481a4b2e09b24 P 838a3115bb3b43aa9d133a9e2867cb1e: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.003s
I20260709 13:17:51.768316 11898 tablet_bootstrap.cc:492] T c2b0f9021628468991c5a4ef3ebade45 P 838a3115bb3b43aa9d133a9e2867cb1e: Bootstrap starting.
I20260709 13:17:51.769933 11899 ts_tablet_manager.cc:1434] T 5af25078161a4293851bc656e0eb8b22 P 11579f7b06aa4eb4be4cd404f83aa8a9: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:17:51.771160 11899 tablet_bootstrap.cc:492] T e4fc1968ceff48fdb57d0c32ec0e48be P 11579f7b06aa4eb4be4cd404f83aa8a9: Bootstrap starting.
I20260709 13:17:51.773173 11897 tablet_bootstrap.cc:654] T 5af25078161a4293851bc656e0eb8b22 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.776696 11898 tablet_bootstrap.cc:654] T c2b0f9021628468991c5a4ef3ebade45 P 838a3115bb3b43aa9d133a9e2867cb1e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.787271 11897 tablet_bootstrap.cc:492] T 5af25078161a4293851bc656e0eb8b22 P fcd7d1bb34ba477f8b4fb7fcf67b7126: No bootstrap required, opened a new log
I20260709 13:17:51.787916 11899 tablet_bootstrap.cc:654] T e4fc1968ceff48fdb57d0c32ec0e48be P 11579f7b06aa4eb4be4cd404f83aa8a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.787911 11897 ts_tablet_manager.cc:1403] T 5af25078161a4293851bc656e0eb8b22 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.003s
I20260709 13:17:51.788125 11898 tablet_bootstrap.cc:492] T c2b0f9021628468991c5a4ef3ebade45 P 838a3115bb3b43aa9d133a9e2867cb1e: No bootstrap required, opened a new log
I20260709 13:17:51.789177 11898 ts_tablet_manager.cc:1403] T c2b0f9021628468991c5a4ef3ebade45 P 838a3115bb3b43aa9d133a9e2867cb1e: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.005s
I20260709 13:17:51.792092 11897 raft_consensus.cc:359] T 5af25078161a4293851bc656e0eb8b22 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:51.793076 11897 raft_consensus.cc:385] T 5af25078161a4293851bc656e0eb8b22 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.792649 11898 raft_consensus.cc:359] T c2b0f9021628468991c5a4ef3ebade45 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:51.793469 11897 raft_consensus.cc:740] T 5af25078161a4293851bc656e0eb8b22 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd7d1bb34ba477f8b4fb7fcf67b7126, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.793573 11898 raft_consensus.cc:385] T c2b0f9021628468991c5a4ef3ebade45 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.793999 11898 raft_consensus.cc:740] T c2b0f9021628468991c5a4ef3ebade45 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 838a3115bb3b43aa9d133a9e2867cb1e, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.794193 11899 tablet_bootstrap.cc:492] T e4fc1968ceff48fdb57d0c32ec0e48be P 11579f7b06aa4eb4be4cd404f83aa8a9: No bootstrap required, opened a new log
I20260709 13:17:51.794832 11899 ts_tablet_manager.cc:1403] T e4fc1968ceff48fdb57d0c32ec0e48be P 11579f7b06aa4eb4be4cd404f83aa8a9: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.005s
I20260709 13:17:51.794410 11897 consensus_queue.cc:260] T 5af25078161a4293851bc656e0eb8b22 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:51.794867 11898 consensus_queue.cc:260] T c2b0f9021628468991c5a4ef3ebade45 P 838a3115bb3b43aa9d133a9e2867cb1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:51.797506 11897 ts_tablet_manager.cc:1434] T 5af25078161a4293851bc656e0eb8b22 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.005s
I20260709 13:17:51.797919 11898 ts_tablet_manager.cc:1434] T c2b0f9021628468991c5a4ef3ebade45 P 838a3115bb3b43aa9d133a9e2867cb1e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:17:51.798707 11897 tablet_bootstrap.cc:492] T 930ea8ac2d2c41819a1481a4b2e09b24 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Bootstrap starting.
I20260709 13:17:51.799088 11898 tablet_bootstrap.cc:492] T 5af25078161a4293851bc656e0eb8b22 P 838a3115bb3b43aa9d133a9e2867cb1e: Bootstrap starting.
I20260709 13:17:51.802690 11899 raft_consensus.cc:359] T e4fc1968ceff48fdb57d0c32ec0e48be P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:51.803431 11899 raft_consensus.cc:385] T e4fc1968ceff48fdb57d0c32ec0e48be P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.803766 11899 raft_consensus.cc:740] T e4fc1968ceff48fdb57d0c32ec0e48be P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11579f7b06aa4eb4be4cd404f83aa8a9, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.804684 11899 consensus_queue.cc:260] T e4fc1968ceff48fdb57d0c32ec0e48be P 11579f7b06aa4eb4be4cd404f83aa8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:51.807303 11897 tablet_bootstrap.cc:654] T 930ea8ac2d2c41819a1481a4b2e09b24 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.807459 11899 ts_tablet_manager.cc:1434] T e4fc1968ceff48fdb57d0c32ec0e48be P 11579f7b06aa4eb4be4cd404f83aa8a9: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 13:17:51.808746 11899 tablet_bootstrap.cc:492] T 83da4971ae24448e9dd2d458ad585340 P 11579f7b06aa4eb4be4cd404f83aa8a9: Bootstrap starting.
I20260709 13:17:51.810806 11903 raft_consensus.cc:493] T 5af25078161a4293851bc656e0eb8b22 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.811380 11903 raft_consensus.cc:515] T 5af25078161a4293851bc656e0eb8b22 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:51.807307 11898 tablet_bootstrap.cc:654] T 5af25078161a4293851bc656e0eb8b22 P 838a3115bb3b43aa9d133a9e2867cb1e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.815994 11899 tablet_bootstrap.cc:654] T 83da4971ae24448e9dd2d458ad585340 P 11579f7b06aa4eb4be4cd404f83aa8a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.815965 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af25078161a4293851bc656e0eb8b22" candidate_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" is_pre_election: true
I20260709 13:17:51.816900 11857 raft_consensus.cc:2468] T 5af25078161a4293851bc656e0eb8b22 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd7d1bb34ba477f8b4fb7fcf67b7126 in term 0.
I20260709 13:17:51.818213 11783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af25078161a4293851bc656e0eb8b22" candidate_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" is_pre_election: true
I20260709 13:17:51.818670 11673 leader_election.cc:304] T 5af25078161a4293851bc656e0eb8b22 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11579f7b06aa4eb4be4cd404f83aa8a9, fcd7d1bb34ba477f8b4fb7fcf67b7126; no voters: 
I20260709 13:17:51.819926 11919 raft_consensus.cc:2804] T 5af25078161a4293851bc656e0eb8b22 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:51.820464 11919 raft_consensus.cc:493] T 5af25078161a4293851bc656e0eb8b22 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.820925 11919 raft_consensus.cc:3060] T 5af25078161a4293851bc656e0eb8b22 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:51.823961 11674 leader_election.cc:343] T 5af25078161a4293851bc656e0eb8b22 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:51.826869 11897 tablet_bootstrap.cc:492] T 930ea8ac2d2c41819a1481a4b2e09b24 P fcd7d1bb34ba477f8b4fb7fcf67b7126: No bootstrap required, opened a new log
I20260709 13:17:51.827436 11897 ts_tablet_manager.cc:1403] T 930ea8ac2d2c41819a1481a4b2e09b24 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Time spent bootstrapping tablet: real 0.029s	user 0.008s	sys 0.012s
I20260709 13:17:51.830808 11897 raft_consensus.cc:359] T 930ea8ac2d2c41819a1481a4b2e09b24 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:51.833822 11919 raft_consensus.cc:515] T 5af25078161a4293851bc656e0eb8b22 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:51.834761 11899 tablet_bootstrap.cc:492] T 83da4971ae24448e9dd2d458ad585340 P 11579f7b06aa4eb4be4cd404f83aa8a9: No bootstrap required, opened a new log
I20260709 13:17:51.835088 11903 leader_election.cc:290] T 5af25078161a4293851bc656e0eb8b22 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031), 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253)
I20260709 13:17:51.835345 11899 ts_tablet_manager.cc:1403] T 83da4971ae24448e9dd2d458ad585340 P 11579f7b06aa4eb4be4cd404f83aa8a9: Time spent bootstrapping tablet: real 0.027s	user 0.006s	sys 0.008s
I20260709 13:17:51.835714 11897 raft_consensus.cc:385] T 930ea8ac2d2c41819a1481a4b2e09b24 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.836160 11897 raft_consensus.cc:740] T 930ea8ac2d2c41819a1481a4b2e09b24 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd7d1bb34ba477f8b4fb7fcf67b7126, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.837031 11897 consensus_queue.cc:260] T 930ea8ac2d2c41819a1481a4b2e09b24 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:51.837734 11783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af25078161a4293851bc656e0eb8b22" candidate_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "838a3115bb3b43aa9d133a9e2867cb1e"
I20260709 13:17:51.838725 11899 raft_consensus.cc:359] T 83da4971ae24448e9dd2d458ad585340 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
W20260709 13:17:51.839396 11674 leader_election.cc:343] T 5af25078161a4293851bc656e0eb8b22 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:51.839485 11899 raft_consensus.cc:385] T 83da4971ae24448e9dd2d458ad585340 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.840152 11899 raft_consensus.cc:740] T 83da4971ae24448e9dd2d458ad585340 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11579f7b06aa4eb4be4cd404f83aa8a9, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.840982 11899 consensus_queue.cc:260] T 83da4971ae24448e9dd2d458ad585340 P 11579f7b06aa4eb4be4cd404f83aa8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:51.842567 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af25078161a4293851bc656e0eb8b22" candidate_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9"
I20260709 13:17:51.843490 11857 raft_consensus.cc:3060] T 5af25078161a4293851bc656e0eb8b22 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:51.843709 11899 ts_tablet_manager.cc:1434] T 83da4971ae24448e9dd2d458ad585340 P 11579f7b06aa4eb4be4cd404f83aa8a9: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.006s
I20260709 13:17:51.845098 11899 tablet_bootstrap.cc:492] T c2b0f9021628468991c5a4ef3ebade45 P 11579f7b06aa4eb4be4cd404f83aa8a9: Bootstrap starting.
I20260709 13:17:51.846079 11905 raft_consensus.cc:493] T 509909ca832c4367bb1c43c3f8bc21e1 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.846608 11905 raft_consensus.cc:515] T 509909ca832c4367bb1c43c3f8bc21e1 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:51.852355 11899 tablet_bootstrap.cc:654] T c2b0f9021628468991c5a4ef3ebade45 P 11579f7b06aa4eb4be4cd404f83aa8a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.853018 11905 leader_election.cc:290] T 509909ca832c4367bb1c43c3f8bc21e1 P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193:39519), 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253)
I20260709 13:17:51.839677 11897 ts_tablet_manager.cc:1434] T 930ea8ac2d2c41819a1481a4b2e09b24 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:17:51.856276 11905 raft_consensus.cc:493] T 18ecbae8747a4d928473333988f89191 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.856670 11897 tablet_bootstrap.cc:492] T e4fc1968ceff48fdb57d0c32ec0e48be P fcd7d1bb34ba477f8b4fb7fcf67b7126: Bootstrap starting.
I20260709 13:17:51.857007 11905 raft_consensus.cc:515] T 18ecbae8747a4d928473333988f89191 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:51.860297 11905 leader_election.cc:290] T 18ecbae8747a4d928473333988f89191 P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193:39519), 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253)
I20260709 13:17:51.852910 11919 leader_election.cc:290] T 5af25078161a4293851bc656e0eb8b22 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 1 election: Requested vote from peers 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031), 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253)
I20260709 13:17:51.865085 11897 tablet_bootstrap.cc:654] T e4fc1968ceff48fdb57d0c32ec0e48be P fcd7d1bb34ba477f8b4fb7fcf67b7126: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.865168 11857 raft_consensus.cc:2468] T 5af25078161a4293851bc656e0eb8b22 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd7d1bb34ba477f8b4fb7fcf67b7126 in term 1.
I20260709 13:17:51.867280 11673 leader_election.cc:304] T 5af25078161a4293851bc656e0eb8b22 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11579f7b06aa4eb4be4cd404f83aa8a9, fcd7d1bb34ba477f8b4fb7fcf67b7126; no voters: 838a3115bb3b43aa9d133a9e2867cb1e
I20260709 13:17:51.869174 11919 raft_consensus.cc:2804] T 5af25078161a4293851bc656e0eb8b22 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:51.881253 11919 raft_consensus.cc:697] T 5af25078161a4293851bc656e0eb8b22 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 LEADER]: Becoming Leader. State: Replica: fcd7d1bb34ba477f8b4fb7fcf67b7126, State: Running, Role: LEADER
I20260709 13:17:51.882689 11919 consensus_queue.cc:237] T 5af25078161a4293851bc656e0eb8b22 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:51.907943 11911 raft_consensus.cc:493] T e4fc1968ceff48fdb57d0c32ec0e48be P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.908954 11911 raft_consensus.cc:515] T e4fc1968ceff48fdb57d0c32ec0e48be P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:51.913892 11708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4fc1968ceff48fdb57d0c32ec0e48be" candidate_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" is_pre_election: true
W20260709 13:17:51.916224 11823 leader_election.cc:343] T e4fc1968ceff48fdb57d0c32ec0e48be P 11579f7b06aa4eb4be4cd404f83aa8a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193:39519): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:51.919483 11783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4fc1968ceff48fdb57d0c32ec0e48be" candidate_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" is_pre_election: true
I20260709 13:17:51.920522 11783 raft_consensus.cc:2468] T e4fc1968ceff48fdb57d0c32ec0e48be P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11579f7b06aa4eb4be4cd404f83aa8a9 in term 0.
I20260709 13:17:51.922461 11823 leader_election.cc:304] T e4fc1968ceff48fdb57d0c32ec0e48be P 11579f7b06aa4eb4be4cd404f83aa8a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11579f7b06aa4eb4be4cd404f83aa8a9, 838a3115bb3b43aa9d133a9e2867cb1e; no voters: fcd7d1bb34ba477f8b4fb7fcf67b7126
I20260709 13:17:51.923730 11904 raft_consensus.cc:2804] T e4fc1968ceff48fdb57d0c32ec0e48be P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:51.924261 11904 raft_consensus.cc:493] T e4fc1968ceff48fdb57d0c32ec0e48be P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.924853 11904 raft_consensus.cc:3060] T e4fc1968ceff48fdb57d0c32ec0e48be P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:51.931005 11911 leader_election.cc:290] T e4fc1968ceff48fdb57d0c32ec0e48be P 11579f7b06aa4eb4be4cd404f83aa8a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193:39519), 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031)
I20260709 13:17:51.938326 11606 catalog_manager.cc:5697] T 5af25078161a4293851bc656e0eb8b22 P fcd7d1bb34ba477f8b4fb7fcf67b7126 reported cstate change: term changed from 0 to 1, leader changed from <none> to fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:51.946681 11904 raft_consensus.cc:515] T e4fc1968ceff48fdb57d0c32ec0e48be P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:51.951665 11897 tablet_bootstrap.cc:492] T e4fc1968ceff48fdb57d0c32ec0e48be P fcd7d1bb34ba477f8b4fb7fcf67b7126: No bootstrap required, opened a new log
I20260709 13:17:51.960008 11919 raft_consensus.cc:493] T 18ecbae8747a4d928473333988f89191 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.960705 11919 raft_consensus.cc:515] T 18ecbae8747a4d928473333988f89191 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:51.962154 11897 ts_tablet_manager.cc:1403] T e4fc1968ceff48fdb57d0c32ec0e48be P fcd7d1bb34ba477f8b4fb7fcf67b7126: Time spent bootstrapping tablet: real 0.106s	user 0.016s	sys 0.024s
I20260709 13:17:51.964825 11919 leader_election.cc:290] T 18ecbae8747a4d928473333988f89191 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031), 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253)
I20260709 13:17:51.966290 11783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ecbae8747a4d928473333988f89191" candidate_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" is_pre_election: true
I20260709 13:17:51.969388 11904 leader_election.cc:290] T e4fc1968ceff48fdb57d0c32ec0e48be P 11579f7b06aa4eb4be4cd404f83aa8a9 [CANDIDATE]: Term 1 election: Requested vote from peers fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193:39519), 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031)
I20260709 13:17:51.969892 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ecbae8747a4d928473333988f89191" candidate_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" is_pre_election: true
I20260709 13:17:51.970501 11857 raft_consensus.cc:2468] T 18ecbae8747a4d928473333988f89191 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd7d1bb34ba477f8b4fb7fcf67b7126 in term 0.
I20260709 13:17:51.970594 11897 raft_consensus.cc:359] T e4fc1968ceff48fdb57d0c32ec0e48be P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:51.968237 11783 raft_consensus.cc:2468] T 18ecbae8747a4d928473333988f89191 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd7d1bb34ba477f8b4fb7fcf67b7126 in term 0.
I20260709 13:17:51.971400 11897 raft_consensus.cc:385] T e4fc1968ceff48fdb57d0c32ec0e48be P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.971778 11897 raft_consensus.cc:740] T e4fc1968ceff48fdb57d0c32ec0e48be P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd7d1bb34ba477f8b4fb7fcf67b7126, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.971812 11673 leader_election.cc:304] T 18ecbae8747a4d928473333988f89191 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11579f7b06aa4eb4be4cd404f83aa8a9, fcd7d1bb34ba477f8b4fb7fcf67b7126; no voters: 
I20260709 13:17:51.972924 11708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4fc1968ceff48fdb57d0c32ec0e48be" candidate_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126"
I20260709 13:17:51.973205 11919 raft_consensus.cc:2804] T 18ecbae8747a4d928473333988f89191 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:51.973721 11919 raft_consensus.cc:493] T 18ecbae8747a4d928473333988f89191 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.973017 11897 consensus_queue.cc:260] T e4fc1968ceff48fdb57d0c32ec0e48be P fcd7d1bb34ba477f8b4fb7fcf67b7126 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:51.974153 11919 raft_consensus.cc:3060] T 18ecbae8747a4d928473333988f89191 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:51.974442 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ecbae8747a4d928473333988f89191" candidate_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" is_pre_election: true
I20260709 13:17:51.975420 11708 raft_consensus.cc:3060] T e4fc1968ceff48fdb57d0c32ec0e48be P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:51.976045 11897 ts_tablet_manager.cc:1434] T e4fc1968ceff48fdb57d0c32ec0e48be P fcd7d1bb34ba477f8b4fb7fcf67b7126: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:17:51.975222 11856 raft_consensus.cc:2468] T 18ecbae8747a4d928473333988f89191 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 838a3115bb3b43aa9d133a9e2867cb1e in term 0.
I20260709 13:17:51.977216 11897 tablet_bootstrap.cc:492] T 3a4012d4e7024b00bd58a041e3a07dcb P fcd7d1bb34ba477f8b4fb7fcf67b7126: Bootstrap starting.
I20260709 13:17:51.977438 11748 leader_election.cc:304] T 18ecbae8747a4d928473333988f89191 P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11579f7b06aa4eb4be4cd404f83aa8a9, 838a3115bb3b43aa9d133a9e2867cb1e; no voters: 
I20260709 13:17:51.977662 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509909ca832c4367bb1c43c3f8bc21e1" candidate_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" is_pre_election: true
I20260709 13:17:51.978369 11905 raft_consensus.cc:2804] T 18ecbae8747a4d928473333988f89191 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:51.978757 11905 raft_consensus.cc:493] T 18ecbae8747a4d928473333988f89191 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.979105 11905 raft_consensus.cc:3060] T 18ecbae8747a4d928473333988f89191 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:51.979341 11783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4fc1968ceff48fdb57d0c32ec0e48be" candidate_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "838a3115bb3b43aa9d133a9e2867cb1e"
I20260709 13:17:51.980063 11783 raft_consensus.cc:3060] T e4fc1968ceff48fdb57d0c32ec0e48be P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:51.983701 11899 tablet_bootstrap.cc:492] T c2b0f9021628468991c5a4ef3ebade45 P 11579f7b06aa4eb4be4cd404f83aa8a9: No bootstrap required, opened a new log
W20260709 13:17:51.984009 11748 leader_election.cc:343] T 509909ca832c4367bb1c43c3f8bc21e1 P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:51.984285 11899 ts_tablet_manager.cc:1403] T c2b0f9021628468991c5a4ef3ebade45 P 11579f7b06aa4eb4be4cd404f83aa8a9: Time spent bootstrapping tablet: real 0.139s	user 0.023s	sys 0.067s
I20260709 13:17:51.985164 11898 tablet_bootstrap.cc:492] T 5af25078161a4293851bc656e0eb8b22 P 838a3115bb3b43aa9d133a9e2867cb1e: No bootstrap required, opened a new log
I20260709 13:17:51.985788 11898 ts_tablet_manager.cc:1403] T 5af25078161a4293851bc656e0eb8b22 P 838a3115bb3b43aa9d133a9e2867cb1e: Time spent bootstrapping tablet: real 0.187s	user 0.036s	sys 0.116s
I20260709 13:17:51.987461 11899 raft_consensus.cc:359] T c2b0f9021628468991c5a4ef3ebade45 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:51.988225 11899 raft_consensus.cc:385] T c2b0f9021628468991c5a4ef3ebade45 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.988536 11899 raft_consensus.cc:740] T c2b0f9021628468991c5a4ef3ebade45 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11579f7b06aa4eb4be4cd404f83aa8a9, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.989420 11899 consensus_queue.cc:260] T c2b0f9021628468991c5a4ef3ebade45 P 11579f7b06aa4eb4be4cd404f83aa8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:51.990857 11919 raft_consensus.cc:515] T 18ecbae8747a4d928473333988f89191 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:51.991926 11899 ts_tablet_manager.cc:1434] T c2b0f9021628468991c5a4ef3ebade45 P 11579f7b06aa4eb4be4cd404f83aa8a9: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:17:51.992974 11899 tablet_bootstrap.cc:492] T 509909ca832c4367bb1c43c3f8bc21e1 P 11579f7b06aa4eb4be4cd404f83aa8a9: Bootstrap starting.
I20260709 13:17:51.994364 11782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ecbae8747a4d928473333988f89191" candidate_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "838a3115bb3b43aa9d133a9e2867cb1e"
I20260709 13:17:51.995502 11708 raft_consensus.cc:2468] T e4fc1968ceff48fdb57d0c32ec0e48be P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11579f7b06aa4eb4be4cd404f83aa8a9 in term 1.
I20260709 13:17:51.999037 11899 tablet_bootstrap.cc:654] T 509909ca832c4367bb1c43c3f8bc21e1 P 11579f7b06aa4eb4be4cd404f83aa8a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.999722 11707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509909ca832c4367bb1c43c3f8bc21e1" candidate_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" is_pre_election: true
I20260709 13:17:52.000519 11707 raft_consensus.cc:2468] T 509909ca832c4367bb1c43c3f8bc21e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 838a3115bb3b43aa9d133a9e2867cb1e in term 0.
I20260709 13:17:52.001322 11903 raft_consensus.cc:493] T e4fc1968ceff48fdb57d0c32ec0e48be P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.002123 11823 leader_election.cc:304] T e4fc1968ceff48fdb57d0c32ec0e48be P 11579f7b06aa4eb4be4cd404f83aa8a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11579f7b06aa4eb4be4cd404f83aa8a9, fcd7d1bb34ba477f8b4fb7fcf67b7126; no voters: 
I20260709 13:17:52.002655 11898 raft_consensus.cc:359] T 5af25078161a4293851bc656e0eb8b22 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.003144 11904 raft_consensus.cc:2804] T e4fc1968ceff48fdb57d0c32ec0e48be P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:52.003237 11706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ecbae8747a4d928473333988f89191" candidate_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" is_pre_election: true
I20260709 13:17:52.003875 11904 raft_consensus.cc:697] T e4fc1968ceff48fdb57d0c32ec0e48be P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 LEADER]: Becoming Leader. State: Replica: 11579f7b06aa4eb4be4cd404f83aa8a9, State: Running, Role: LEADER
I20260709 13:17:52.001842 11903 raft_consensus.cc:515] T e4fc1968ceff48fdb57d0c32ec0e48be P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.004364 11706 raft_consensus.cc:2393] T 18ecbae8747a4d928473333988f89191 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 838a3115bb3b43aa9d133a9e2867cb1e in current term 1: Already voted for candidate fcd7d1bb34ba477f8b4fb7fcf67b7126 in this term.
I20260709 13:17:52.004509 11898 raft_consensus.cc:385] T 5af25078161a4293851bc656e0eb8b22 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:52.004982 11898 raft_consensus.cc:740] T 5af25078161a4293851bc656e0eb8b22 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 838a3115bb3b43aa9d133a9e2867cb1e, State: Initialized, Role: FOLLOWER
I20260709 13:17:52.004825 11904 consensus_queue.cc:237] T e4fc1968ceff48fdb57d0c32ec0e48be P 11579f7b06aa4eb4be4cd404f83aa8a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.006161 11898 consensus_queue.cc:260] T 5af25078161a4293851bc656e0eb8b22 P 838a3115bb3b43aa9d133a9e2867cb1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.010409 11903 leader_election.cc:290] T e4fc1968ceff48fdb57d0c32ec0e48be P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031), 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253)
I20260709 13:17:52.011116 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4fc1968ceff48fdb57d0c32ec0e48be" candidate_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" is_pre_election: true
I20260709 13:17:52.012192 11749 leader_election.cc:304] T 509909ca832c4367bb1c43c3f8bc21e1 P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 838a3115bb3b43aa9d133a9e2867cb1e, fcd7d1bb34ba477f8b4fb7fcf67b7126; no voters: 11579f7b06aa4eb4be4cd404f83aa8a9
I20260709 13:17:52.012318 11781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4fc1968ceff48fdb57d0c32ec0e48be" candidate_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" is_pre_election: true
I20260709 13:17:52.014957 11674 leader_election.cc:304] T e4fc1968ceff48fdb57d0c32ec0e48be P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd7d1bb34ba477f8b4fb7fcf67b7126; no voters: 11579f7b06aa4eb4be4cd404f83aa8a9, 838a3115bb3b43aa9d133a9e2867cb1e
I20260709 13:17:52.016783 11903 raft_consensus.cc:2749] T e4fc1968ceff48fdb57d0c32ec0e48be P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:52.004195 11897 tablet_bootstrap.cc:654] T 3a4012d4e7024b00bd58a041e3a07dcb P fcd7d1bb34ba477f8b4fb7fcf67b7126: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.996071 11905 raft_consensus.cc:515] T 18ecbae8747a4d928473333988f89191 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.023043 11782 raft_consensus.cc:2393] T 18ecbae8747a4d928473333988f89191 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fcd7d1bb34ba477f8b4fb7fcf67b7126 in current term 1: Already voted for candidate 838a3115bb3b43aa9d133a9e2867cb1e in this term.
I20260709 13:17:52.023869 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ecbae8747a4d928473333988f89191" candidate_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9"
I20260709 13:17:52.024535 11857 raft_consensus.cc:3060] T 18ecbae8747a4d928473333988f89191 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:52.025461 11783 raft_consensus.cc:2468] T e4fc1968ceff48fdb57d0c32ec0e48be P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11579f7b06aa4eb4be4cd404f83aa8a9 in term 1.
I20260709 13:17:52.029660 11905 leader_election.cc:290] T 18ecbae8747a4d928473333988f89191 P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 1 election: Requested vote from peers fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193:39519), 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253)
I20260709 13:17:52.030364 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ecbae8747a4d928473333988f89191" candidate_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9"
I20260709 13:17:52.041862 11603 catalog_manager.cc:5697] T e4fc1968ceff48fdb57d0c32ec0e48be P 11579f7b06aa4eb4be4cd404f83aa8a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195). New cstate: current_term: 1 leader_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:52.029127 11919 leader_election.cc:290] T 18ecbae8747a4d928473333988f89191 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 1 election: Requested vote from peers 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031), 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253)
I20260709 13:17:52.036101 11905 raft_consensus.cc:2804] T 509909ca832c4367bb1c43c3f8bc21e1 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:52.046870 11905 raft_consensus.cc:493] T 509909ca832c4367bb1c43c3f8bc21e1 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:52.047293 11905 raft_consensus.cc:3060] T 509909ca832c4367bb1c43c3f8bc21e1 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:52.056880 11943 raft_consensus.cc:493] T c2b0f9021628468991c5a4ef3ebade45 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.057490 11943 raft_consensus.cc:515] T c2b0f9021628468991c5a4ef3ebade45 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.058363 11898 ts_tablet_manager.cc:1434] T 5af25078161a4293851bc656e0eb8b22 P 838a3115bb3b43aa9d133a9e2867cb1e: Time spent starting tablet: real 0.072s	user 0.032s	sys 0.024s
I20260709 13:17:52.062767 11919 raft_consensus.cc:493] T 83da4971ae24448e9dd2d458ad585340 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.063616 11919 raft_consensus.cc:515] T 83da4971ae24448e9dd2d458ad585340 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.067451 11919 leader_election.cc:290] T 83da4971ae24448e9dd2d458ad585340 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031), 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253)
I20260709 13:17:52.067883 11857 raft_consensus.cc:2468] T 18ecbae8747a4d928473333988f89191 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd7d1bb34ba477f8b4fb7fcf67b7126 in term 1.
I20260709 13:17:52.062711 11898 tablet_bootstrap.cc:492] T 3a4012d4e7024b00bd58a041e3a07dcb P 838a3115bb3b43aa9d133a9e2867cb1e: Bootstrap starting.
I20260709 13:17:52.068763 11783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83da4971ae24448e9dd2d458ad585340" candidate_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" is_pre_election: true
I20260709 13:17:52.069726 11673 leader_election.cc:304] T 18ecbae8747a4d928473333988f89191 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11579f7b06aa4eb4be4cd404f83aa8a9, fcd7d1bb34ba477f8b4fb7fcf67b7126; no voters: 838a3115bb3b43aa9d133a9e2867cb1e
W20260709 13:17:52.070310 11674 leader_election.cc:343] T 83da4971ae24448e9dd2d458ad585340 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:52.071053 11919 raft_consensus.cc:2804] T 18ecbae8747a4d928473333988f89191 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:52.071651 11919 raft_consensus.cc:697] T 18ecbae8747a4d928473333988f89191 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 LEADER]: Becoming Leader. State: Replica: fcd7d1bb34ba477f8b4fb7fcf67b7126, State: Running, Role: LEADER
I20260709 13:17:52.071708 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83da4971ae24448e9dd2d458ad585340" candidate_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" is_pre_election: true
I20260709 13:17:52.072477 11856 raft_consensus.cc:2468] T 83da4971ae24448e9dd2d458ad585340 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd7d1bb34ba477f8b4fb7fcf67b7126 in term 0.
I20260709 13:17:52.072714 11919 consensus_queue.cc:237] T 18ecbae8747a4d928473333988f89191 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.073879 11673 leader_election.cc:304] T 83da4971ae24448e9dd2d458ad585340 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11579f7b06aa4eb4be4cd404f83aa8a9, fcd7d1bb34ba477f8b4fb7fcf67b7126; no voters: 838a3115bb3b43aa9d133a9e2867cb1e
I20260709 13:17:52.077556 11943 leader_election.cc:290] T c2b0f9021628468991c5a4ef3ebade45 P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193:39519), 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253)
W20260709 13:17:52.060070 11749 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.193:39519, user_credentials={real_user=slave}} blocked reactor thread for 48104.5us
I20260709 13:17:52.078707 11903 raft_consensus.cc:2804] T 83da4971ae24448e9dd2d458ad585340 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:52.079223 11903 raft_consensus.cc:493] T 83da4971ae24448e9dd2d458ad585340 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:52.079742 11903 raft_consensus.cc:3060] T 83da4971ae24448e9dd2d458ad585340 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:52.080226 11706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ecbae8747a4d928473333988f89191" candidate_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126"
I20260709 13:17:52.082640 11706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b0f9021628468991c5a4ef3ebade45" candidate_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" is_pre_election: true
I20260709 13:17:52.082477 11905 raft_consensus.cc:515] T 509909ca832c4367bb1c43c3f8bc21e1 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.084268 11749 leader_election.cc:304] T 18ecbae8747a4d928473333988f89191 P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 838a3115bb3b43aa9d133a9e2867cb1e; no voters: 11579f7b06aa4eb4be4cd404f83aa8a9, fcd7d1bb34ba477f8b4fb7fcf67b7126
I20260709 13:17:52.087477 11898 tablet_bootstrap.cc:654] T 3a4012d4e7024b00bd58a041e3a07dcb P 838a3115bb3b43aa9d133a9e2867cb1e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:52.087669 11938 consensus_queue.cc:1048] T 8fd864b8209b45debd46cbde76e1e66e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:52.088233 11943 raft_consensus.cc:2749] T 18ecbae8747a4d928473333988f89191 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:17:52.089649 11749 leader_election.cc:343] T c2b0f9021628468991c5a4ef3ebade45 P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193:39519): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:52.090528 11903 raft_consensus.cc:515] T 83da4971ae24448e9dd2d458ad585340 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.091137 11706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509909ca832c4367bb1c43c3f8bc21e1" candidate_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126"
I20260709 13:17:52.084753 11905 leader_election.cc:290] T 509909ca832c4367bb1c43c3f8bc21e1 P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 1 election: Requested vote from peers fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193:39519), 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253)
I20260709 13:17:52.091862 11706 raft_consensus.cc:3060] T 509909ca832c4367bb1c43c3f8bc21e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:52.084673 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b0f9021628468991c5a4ef3ebade45" candidate_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" is_pre_election: true
I20260709 13:17:52.086088 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509909ca832c4367bb1c43c3f8bc21e1" candidate_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9"
W20260709 13:17:52.095405 11748 leader_election.cc:343] T 509909ca832c4367bb1c43c3f8bc21e1 P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:52.095479 11857 raft_consensus.cc:2468] T c2b0f9021628468991c5a4ef3ebade45 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 838a3115bb3b43aa9d133a9e2867cb1e in term 0.
I20260709 13:17:52.097250 11748 leader_election.cc:304] T c2b0f9021628468991c5a4ef3ebade45 P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11579f7b06aa4eb4be4cd404f83aa8a9, 838a3115bb3b43aa9d133a9e2867cb1e; no voters: fcd7d1bb34ba477f8b4fb7fcf67b7126
I20260709 13:17:52.098492 11905 raft_consensus.cc:2804] T c2b0f9021628468991c5a4ef3ebade45 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:52.098881 11905 raft_consensus.cc:493] T c2b0f9021628468991c5a4ef3ebade45 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:52.099215 11905 raft_consensus.cc:3060] T c2b0f9021628468991c5a4ef3ebade45 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:52.099615 11783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83da4971ae24448e9dd2d458ad585340" candidate_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "838a3115bb3b43aa9d133a9e2867cb1e"
I20260709 13:17:52.100580 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83da4971ae24448e9dd2d458ad585340" candidate_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9"
W20260709 13:17:52.101151 11674 leader_election.cc:343] T 83da4971ae24448e9dd2d458ad585340 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:52.101538 11857 raft_consensus.cc:3060] T 83da4971ae24448e9dd2d458ad585340 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:52.104033 11706 raft_consensus.cc:2468] T 509909ca832c4367bb1c43c3f8bc21e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 838a3115bb3b43aa9d133a9e2867cb1e in term 1.
I20260709 13:17:52.105597 11943 raft_consensus.cc:493] T 930ea8ac2d2c41819a1481a4b2e09b24 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.106117 11943 raft_consensus.cc:515] T 930ea8ac2d2c41819a1481a4b2e09b24 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.106875 11899 tablet_bootstrap.cc:492] T 509909ca832c4367bb1c43c3f8bc21e1 P 11579f7b06aa4eb4be4cd404f83aa8a9: No bootstrap required, opened a new log
I20260709 13:17:52.107405 11899 ts_tablet_manager.cc:1403] T 509909ca832c4367bb1c43c3f8bc21e1 P 11579f7b06aa4eb4be4cd404f83aa8a9: Time spent bootstrapping tablet: real 0.115s	user 0.016s	sys 0.022s
I20260709 13:17:52.108394 11943 leader_election.cc:290] T 930ea8ac2d2c41819a1481a4b2e09b24 P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193:39519), 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253)
I20260709 13:17:52.109733 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930ea8ac2d2c41819a1481a4b2e09b24" candidate_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" is_pre_election: true
I20260709 13:17:52.110008 11708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930ea8ac2d2c41819a1481a4b2e09b24" candidate_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" is_pre_election: true
I20260709 13:17:52.110430 11855 raft_consensus.cc:2468] T 930ea8ac2d2c41819a1481a4b2e09b24 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 838a3115bb3b43aa9d133a9e2867cb1e in term 0.
I20260709 13:17:52.110632 11708 raft_consensus.cc:2468] T 930ea8ac2d2c41819a1481a4b2e09b24 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 838a3115bb3b43aa9d133a9e2867cb1e in term 0.
I20260709 13:17:52.112003 11748 leader_election.cc:304] T 930ea8ac2d2c41819a1481a4b2e09b24 P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11579f7b06aa4eb4be4cd404f83aa8a9, 838a3115bb3b43aa9d133a9e2867cb1e; no voters: 
I20260709 13:17:52.112515 11857 raft_consensus.cc:2468] T 83da4971ae24448e9dd2d458ad585340 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd7d1bb34ba477f8b4fb7fcf67b7126 in term 1.
I20260709 13:17:52.112058 11749 leader_election.cc:304] T 509909ca832c4367bb1c43c3f8bc21e1 P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 838a3115bb3b43aa9d133a9e2867cb1e, fcd7d1bb34ba477f8b4fb7fcf67b7126; no voters: 11579f7b06aa4eb4be4cd404f83aa8a9
I20260709 13:17:52.114219 11673 leader_election.cc:304] T 83da4971ae24448e9dd2d458ad585340 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11579f7b06aa4eb4be4cd404f83aa8a9, fcd7d1bb34ba477f8b4fb7fcf67b7126; no voters: 838a3115bb3b43aa9d133a9e2867cb1e
I20260709 13:17:52.115095 11899 raft_consensus.cc:359] T 509909ca832c4367bb1c43c3f8bc21e1 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.115783 11938 raft_consensus.cc:2804] T 83da4971ae24448e9dd2d458ad585340 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:52.116106 11941 raft_consensus.cc:2804] T 930ea8ac2d2c41819a1481a4b2e09b24 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:52.116324 11943 raft_consensus.cc:2804] T 509909ca832c4367bb1c43c3f8bc21e1 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:52.116693 11941 raft_consensus.cc:493] T 930ea8ac2d2c41819a1481a4b2e09b24 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:52.114823 11897 tablet_bootstrap.cc:492] T 3a4012d4e7024b00bd58a041e3a07dcb P fcd7d1bb34ba477f8b4fb7fcf67b7126: No bootstrap required, opened a new log
I20260709 13:17:52.117256 11941 raft_consensus.cc:3060] T 930ea8ac2d2c41819a1481a4b2e09b24 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:52.117592 11897 ts_tablet_manager.cc:1403] T 3a4012d4e7024b00bd58a041e3a07dcb P fcd7d1bb34ba477f8b4fb7fcf67b7126: Time spent bootstrapping tablet: real 0.141s	user 0.017s	sys 0.019s
I20260709 13:17:52.115855 11899 raft_consensus.cc:385] T 509909ca832c4367bb1c43c3f8bc21e1 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:52.119581 11899 raft_consensus.cc:740] T 509909ca832c4367bb1c43c3f8bc21e1 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11579f7b06aa4eb4be4cd404f83aa8a9, State: Initialized, Role: FOLLOWER
I20260709 13:17:52.121502 11897 raft_consensus.cc:359] T 3a4012d4e7024b00bd58a041e3a07dcb P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.122430 11897 raft_consensus.cc:385] T 3a4012d4e7024b00bd58a041e3a07dcb P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:52.122850 11897 raft_consensus.cc:740] T 3a4012d4e7024b00bd58a041e3a07dcb P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd7d1bb34ba477f8b4fb7fcf67b7126, State: Initialized, Role: FOLLOWER
I20260709 13:17:52.114948 11903 leader_election.cc:290] T 83da4971ae24448e9dd2d458ad585340 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 1 election: Requested vote from peers 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031), 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253)
I20260709 13:17:52.121650 11899 consensus_queue.cc:260] T 509909ca832c4367bb1c43c3f8bc21e1 P 11579f7b06aa4eb4be4cd404f83aa8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.127707 11904 raft_consensus.cc:493] T 3a4012d4e7024b00bd58a041e3a07dcb P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.128203 11904 raft_consensus.cc:515] T 3a4012d4e7024b00bd58a041e3a07dcb P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.127851 11897 consensus_queue.cc:260] T 3a4012d4e7024b00bd58a041e3a07dcb P fcd7d1bb34ba477f8b4fb7fcf67b7126 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.130378 11904 leader_election.cc:290] T 3a4012d4e7024b00bd58a041e3a07dcb P 11579f7b06aa4eb4be4cd404f83aa8a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193:39519), 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031)
I20260709 13:17:52.131187 11897 ts_tablet_manager.cc:1434] T 3a4012d4e7024b00bd58a041e3a07dcb P fcd7d1bb34ba477f8b4fb7fcf67b7126: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:17:52.136322 11706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4012d4e7024b00bd58a041e3a07dcb" candidate_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" is_pre_election: true
I20260709 13:17:52.136588 11783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4012d4e7024b00bd58a041e3a07dcb" candidate_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" is_pre_election: true
I20260709 13:17:52.137118 11706 raft_consensus.cc:2468] T 3a4012d4e7024b00bd58a041e3a07dcb P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11579f7b06aa4eb4be4cd404f83aa8a9 in term 0.
I20260709 13:17:52.137562 11898 tablet_bootstrap.cc:492] T 3a4012d4e7024b00bd58a041e3a07dcb P 838a3115bb3b43aa9d133a9e2867cb1e: No bootstrap required, opened a new log
I20260709 13:17:52.138402 11898 ts_tablet_manager.cc:1403] T 3a4012d4e7024b00bd58a041e3a07dcb P 838a3115bb3b43aa9d133a9e2867cb1e: Time spent bootstrapping tablet: real 0.078s	user 0.010s	sys 0.010s
I20260709 13:17:52.137952 11604 catalog_manager.cc:5697] T 18ecbae8747a4d928473333988f89191 P fcd7d1bb34ba477f8b4fb7fcf67b7126 reported cstate change: term changed from 0 to 1, leader changed from <none> to fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:52.138765 11823 leader_election.cc:304] T 3a4012d4e7024b00bd58a041e3a07dcb P 11579f7b06aa4eb4be4cd404f83aa8a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11579f7b06aa4eb4be4cd404f83aa8a9, fcd7d1bb34ba477f8b4fb7fcf67b7126; no voters: 
W20260709 13:17:52.139786 11823 leader_election.cc:343] T 3a4012d4e7024b00bd58a041e3a07dcb P 11579f7b06aa4eb4be4cd404f83aa8a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:52.140889 11904 raft_consensus.cc:2804] T 3a4012d4e7024b00bd58a041e3a07dcb P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:52.141336 11904 raft_consensus.cc:493] T 3a4012d4e7024b00bd58a041e3a07dcb P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:52.141693 11904 raft_consensus.cc:3060] T 3a4012d4e7024b00bd58a041e3a07dcb P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:52.145177 11898 raft_consensus.cc:359] T 3a4012d4e7024b00bd58a041e3a07dcb P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.146586 11898 raft_consensus.cc:385] T 3a4012d4e7024b00bd58a041e3a07dcb P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:52.147084 11898 raft_consensus.cc:740] T 3a4012d4e7024b00bd58a041e3a07dcb P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 838a3115bb3b43aa9d133a9e2867cb1e, State: Initialized, Role: FOLLOWER
I20260709 13:17:52.149720 11899 ts_tablet_manager.cc:1434] T 509909ca832c4367bb1c43c3f8bc21e1 P 11579f7b06aa4eb4be4cd404f83aa8a9: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 13:17:52.138823 11897 tablet_bootstrap.cc:492] T c2b0f9021628468991c5a4ef3ebade45 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Bootstrap starting.
I20260709 13:17:52.161760 11898 consensus_queue.cc:260] T 3a4012d4e7024b00bd58a041e3a07dcb P 838a3115bb3b43aa9d133a9e2867cb1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.131443 11941 raft_consensus.cc:515] T 930ea8ac2d2c41819a1481a4b2e09b24 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.164634 11938 raft_consensus.cc:697] T 83da4971ae24448e9dd2d458ad585340 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 LEADER]: Becoming Leader. State: Replica: fcd7d1bb34ba477f8b4fb7fcf67b7126, State: Running, Role: LEADER
I20260709 13:17:52.164952 11943 raft_consensus.cc:697] T 509909ca832c4367bb1c43c3f8bc21e1 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 LEADER]: Becoming Leader. State: Replica: 838a3115bb3b43aa9d133a9e2867cb1e, State: Running, Role: LEADER
I20260709 13:17:52.175334 11898 ts_tablet_manager.cc:1434] T 3a4012d4e7024b00bd58a041e3a07dcb P 838a3115bb3b43aa9d133a9e2867cb1e: Time spent starting tablet: real 0.036s	user 0.018s	sys 0.002s
I20260709 13:17:52.175371 11938 consensus_queue.cc:237] T 83da4971ae24448e9dd2d458ad585340 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.176622 11904 raft_consensus.cc:515] T 3a4012d4e7024b00bd58a041e3a07dcb P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.179872 11706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4012d4e7024b00bd58a041e3a07dcb" candidate_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126"
I20260709 13:17:52.180662 11706 raft_consensus.cc:3060] T 3a4012d4e7024b00bd58a041e3a07dcb P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:52.181269 11919 consensus_queue.cc:1048] T 8fd864b8209b45debd46cbde76e1e66e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [LEADER]: Connected to new peer: Peer: permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:52.183957 11941 leader_election.cc:290] T 930ea8ac2d2c41819a1481a4b2e09b24 P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 1 election: Requested vote from peers fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193:39519), 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253)
I20260709 13:17:52.184834 11708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930ea8ac2d2c41819a1481a4b2e09b24" candidate_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126"
I20260709 13:17:52.185091 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "930ea8ac2d2c41819a1481a4b2e09b24" candidate_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9"
I20260709 13:17:52.185514 11708 raft_consensus.cc:3060] T 930ea8ac2d2c41819a1481a4b2e09b24 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:52.185675 11857 raft_consensus.cc:3060] T 930ea8ac2d2c41819a1481a4b2e09b24 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:52.187515 11905 raft_consensus.cc:515] T c2b0f9021628468991c5a4ef3ebade45 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.188122 11943 consensus_queue.cc:237] T 509909ca832c4367bb1c43c3f8bc21e1 P 838a3115bb3b43aa9d133a9e2867cb1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.198089 11857 raft_consensus.cc:2468] T 930ea8ac2d2c41819a1481a4b2e09b24 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 838a3115bb3b43aa9d133a9e2867cb1e in term 1.
I20260709 13:17:52.199999 11748 leader_election.cc:304] T 930ea8ac2d2c41819a1481a4b2e09b24 P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11579f7b06aa4eb4be4cd404f83aa8a9, 838a3115bb3b43aa9d133a9e2867cb1e; no voters: 
I20260709 13:17:52.201277 11706 raft_consensus.cc:2468] T 3a4012d4e7024b00bd58a041e3a07dcb P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11579f7b06aa4eb4be4cd404f83aa8a9 in term 1.
I20260709 13:17:52.202771 11823 leader_election.cc:304] T 3a4012d4e7024b00bd58a041e3a07dcb P 11579f7b06aa4eb4be4cd404f83aa8a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11579f7b06aa4eb4be4cd404f83aa8a9, fcd7d1bb34ba477f8b4fb7fcf67b7126; no voters: 
I20260709 13:17:52.202224 11941 raft_consensus.cc:2804] T 930ea8ac2d2c41819a1481a4b2e09b24 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:52.204093 11911 raft_consensus.cc:2804] T 3a4012d4e7024b00bd58a041e3a07dcb P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:52.207041 11708 raft_consensus.cc:2468] T 930ea8ac2d2c41819a1481a4b2e09b24 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 838a3115bb3b43aa9d133a9e2867cb1e in term 1.
I20260709 13:17:52.205124 11941 raft_consensus.cc:697] T 930ea8ac2d2c41819a1481a4b2e09b24 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 LEADER]: Becoming Leader. State: Replica: 838a3115bb3b43aa9d133a9e2867cb1e, State: Running, Role: LEADER
I20260709 13:17:52.207525 11707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b0f9021628468991c5a4ef3ebade45" candidate_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126"
I20260709 13:17:52.210470 11905 leader_election.cc:290] T c2b0f9021628468991c5a4ef3ebade45 P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 1 election: Requested vote from peers fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193:39519), 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253)
I20260709 13:17:52.211747 11941 consensus_queue.cc:237] T 930ea8ac2d2c41819a1481a4b2e09b24 P 838a3115bb3b43aa9d133a9e2867cb1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.210130 11897 tablet_bootstrap.cc:654] T c2b0f9021628468991c5a4ef3ebade45 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:52.211928 11749 leader_election.cc:343] T c2b0f9021628468991c5a4ef3ebade45 P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193:39519): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:52.212276 11782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4012d4e7024b00bd58a041e3a07dcb" candidate_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "838a3115bb3b43aa9d133a9e2867cb1e"
I20260709 13:17:52.213045 11782 raft_consensus.cc:3060] T 3a4012d4e7024b00bd58a041e3a07dcb P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:52.208423 11898 tablet_bootstrap.cc:492] T 83da4971ae24448e9dd2d458ad585340 P 838a3115bb3b43aa9d133a9e2867cb1e: Bootstrap starting.
I20260709 13:17:52.222280 11782 raft_consensus.cc:2468] T 3a4012d4e7024b00bd58a041e3a07dcb P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11579f7b06aa4eb4be4cd404f83aa8a9 in term 1.
I20260709 13:17:52.223779 11897 tablet_bootstrap.cc:492] T c2b0f9021628468991c5a4ef3ebade45 P fcd7d1bb34ba477f8b4fb7fcf67b7126: No bootstrap required, opened a new log
I20260709 13:17:52.224246 11904 leader_election.cc:290] T 3a4012d4e7024b00bd58a041e3a07dcb P 11579f7b06aa4eb4be4cd404f83aa8a9 [CANDIDATE]: Term 1 election: Requested vote from peers fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193:39519), 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031)
I20260709 13:17:52.224874 11897 ts_tablet_manager.cc:1403] T c2b0f9021628468991c5a4ef3ebade45 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Time spent bootstrapping tablet: real 0.093s	user 0.011s	sys 0.003s
I20260709 13:17:52.225653 11911 raft_consensus.cc:697] T 3a4012d4e7024b00bd58a041e3a07dcb P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 LEADER]: Becoming Leader. State: Replica: 11579f7b06aa4eb4be4cd404f83aa8a9, State: Running, Role: LEADER
I20260709 13:17:52.226922 11911 consensus_queue.cc:237] T 3a4012d4e7024b00bd58a041e3a07dcb P 11579f7b06aa4eb4be4cd404f83aa8a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.227531 11897 raft_consensus.cc:359] T c2b0f9021628468991c5a4ef3ebade45 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.228458 11897 raft_consensus.cc:385] T c2b0f9021628468991c5a4ef3ebade45 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:52.228793 11897 raft_consensus.cc:740] T c2b0f9021628468991c5a4ef3ebade45 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd7d1bb34ba477f8b4fb7fcf67b7126, State: Initialized, Role: FOLLOWER
I20260709 13:17:52.229700 11897 consensus_queue.cc:260] T c2b0f9021628468991c5a4ef3ebade45 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.230990 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b0f9021628468991c5a4ef3ebade45" candidate_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9"
I20260709 13:17:52.233376 11857 raft_consensus.cc:3060] T c2b0f9021628468991c5a4ef3ebade45 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:52.231379 11898 tablet_bootstrap.cc:654] T 83da4971ae24448e9dd2d458ad585340 P 838a3115bb3b43aa9d133a9e2867cb1e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:52.232227 11897 ts_tablet_manager.cc:1434] T c2b0f9021628468991c5a4ef3ebade45 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:17:52.244618 11604 catalog_manager.cc:5697] T 509909ca832c4367bb1c43c3f8bc21e1 P 838a3115bb3b43aa9d133a9e2867cb1e reported cstate change: term changed from 0 to 1, leader changed from <none> to 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194). New cstate: current_term: 1 leader_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:52.255061 11898 tablet_bootstrap.cc:492] T 83da4971ae24448e9dd2d458ad585340 P 838a3115bb3b43aa9d133a9e2867cb1e: No bootstrap required, opened a new log
I20260709 13:17:52.251824 11857 raft_consensus.cc:2468] T c2b0f9021628468991c5a4ef3ebade45 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 838a3115bb3b43aa9d133a9e2867cb1e in term 1.
I20260709 13:17:52.255714 11898 ts_tablet_manager.cc:1403] T 83da4971ae24448e9dd2d458ad585340 P 838a3115bb3b43aa9d133a9e2867cb1e: Time spent bootstrapping tablet: real 0.048s	user 0.020s	sys 0.000s
I20260709 13:17:52.256349 11748 leader_election.cc:304] T c2b0f9021628468991c5a4ef3ebade45 P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11579f7b06aa4eb4be4cd404f83aa8a9, 838a3115bb3b43aa9d133a9e2867cb1e; no voters: fcd7d1bb34ba477f8b4fb7fcf67b7126
I20260709 13:17:52.257901 11943 raft_consensus.cc:2804] T c2b0f9021628468991c5a4ef3ebade45 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:52.258436 11943 raft_consensus.cc:697] T c2b0f9021628468991c5a4ef3ebade45 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 LEADER]: Becoming Leader. State: Replica: 838a3115bb3b43aa9d133a9e2867cb1e, State: Running, Role: LEADER
I20260709 13:17:52.259368 11943 consensus_queue.cc:237] T c2b0f9021628468991c5a4ef3ebade45 P 838a3115bb3b43aa9d133a9e2867cb1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.262122 11603 catalog_manager.cc:5697] T 3a4012d4e7024b00bd58a041e3a07dcb P 11579f7b06aa4eb4be4cd404f83aa8a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195). New cstate: current_term: 1 leader_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:52.259341 11898 raft_consensus.cc:359] T 83da4971ae24448e9dd2d458ad585340 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.264323 11898 raft_consensus.cc:385] T 83da4971ae24448e9dd2d458ad585340 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:52.264595 11898 raft_consensus.cc:740] T 83da4971ae24448e9dd2d458ad585340 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 838a3115bb3b43aa9d133a9e2867cb1e, State: Initialized, Role: FOLLOWER
I20260709 13:17:52.265280 11898 consensus_queue.cc:260] T 83da4971ae24448e9dd2d458ad585340 P 838a3115bb3b43aa9d133a9e2867cb1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.267462 11898 ts_tablet_manager.cc:1434] T 83da4971ae24448e9dd2d458ad585340 P 838a3115bb3b43aa9d133a9e2867cb1e: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.002s
I20260709 13:17:52.272553 11604 catalog_manager.cc:5697] T 930ea8ac2d2c41819a1481a4b2e09b24 P 838a3115bb3b43aa9d133a9e2867cb1e reported cstate change: term changed from 0 to 1, leader changed from <none> to 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194). New cstate: current_term: 1 leader_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:52.274173 11604 catalog_manager.cc:5697] T c2b0f9021628468991c5a4ef3ebade45 P 838a3115bb3b43aa9d133a9e2867cb1e reported cstate change: term changed from 0 to 1, leader changed from <none> to 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194). New cstate: current_term: 1 leader_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:52.283644 11606 catalog_manager.cc:5697] T 83da4971ae24448e9dd2d458ad585340 P fcd7d1bb34ba477f8b4fb7fcf67b7126 reported cstate change: term changed from 0 to 1, leader changed from <none> to fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:52.299369 11938 consensus_queue.cc:1048] T 5af25078161a4293851bc656e0eb8b22 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:52.309161 11783 raft_consensus.cc:3060] T 5af25078161a4293851bc656e0eb8b22 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:52.318810 11938 consensus_queue.cc:1048] T 5af25078161a4293851bc656e0eb8b22 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [LEADER]: Connected to new peer: Peer: permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:52.326596 11943 raft_consensus.cc:493] T 83da4971ae24448e9dd2d458ad585340 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.327157 11943 raft_consensus.cc:515] T 83da4971ae24448e9dd2d458ad585340 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.329586 11943 leader_election.cc:290] T 83da4971ae24448e9dd2d458ad585340 P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193:39519), 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253)
I20260709 13:17:52.330364 11706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83da4971ae24448e9dd2d458ad585340" candidate_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" is_pre_election: true
I20260709 13:17:52.330735 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83da4971ae24448e9dd2d458ad585340" candidate_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" is_pre_election: true
I20260709 13:17:52.331664 11857 raft_consensus.cc:2393] T 83da4971ae24448e9dd2d458ad585340 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 838a3115bb3b43aa9d133a9e2867cb1e in current term 1: Already voted for candidate fcd7d1bb34ba477f8b4fb7fcf67b7126 in this term.
I20260709 13:17:52.332669 11748 leader_election.cc:304] T 83da4971ae24448e9dd2d458ad585340 P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 838a3115bb3b43aa9d133a9e2867cb1e; no voters: 11579f7b06aa4eb4be4cd404f83aa8a9, fcd7d1bb34ba477f8b4fb7fcf67b7126
I20260709 13:17:52.333420 11943 raft_consensus.cc:3060] T 83da4971ae24448e9dd2d458ad585340 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:52.340479 11943 raft_consensus.cc:2749] T 83da4971ae24448e9dd2d458ad585340 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:52.371282 11857 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4fc1968ceff48fdb57d0c32ec0e48be"
dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9"
mode: GRACEFUL
new_leader_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126"
 from {username='slave'} at 127.0.0.1:54472
I20260709 13:17:52.372179 11857 raft_consensus.cc:606] T e4fc1968ceff48fdb57d0c32ec0e48be P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 LEADER]: Received request to transfer leadership to TS fcd7d1bb34ba477f8b4fb7fcf67b7126
I20260709 13:17:52.386215 11783 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c2b0f9021628468991c5a4ef3ebade45"
dest_uuid: "838a3115bb3b43aa9d133a9e2867cb1e"
mode: GRACEFUL
new_leader_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126"
 from {username='slave'} at 127.0.0.1:39002
I20260709 13:17:52.386795 11783 raft_consensus.cc:606] T c2b0f9021628468991c5a4ef3ebade45 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 LEADER]: Received request to transfer leadership to TS fcd7d1bb34ba477f8b4fb7fcf67b7126
I20260709 13:17:52.392372 11857 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a4012d4e7024b00bd58a041e3a07dcb"
dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9"
mode: GRACEFUL
new_leader_uuid: "838a3115bb3b43aa9d133a9e2867cb1e"
 from {username='slave'} at 127.0.0.1:54472
I20260709 13:17:52.392937 11857 raft_consensus.cc:606] T 3a4012d4e7024b00bd58a041e3a07dcb P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 LEADER]: Received request to transfer leadership to TS 838a3115bb3b43aa9d133a9e2867cb1e
I20260709 13:17:52.406662 11706 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5af25078161a4293851bc656e0eb8b22"
dest_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126"
mode: GRACEFUL
new_leader_uuid: "838a3115bb3b43aa9d133a9e2867cb1e"
 from {username='slave'} at 127.0.0.1:51162
I20260709 13:17:52.407282 11706 raft_consensus.cc:606] T 5af25078161a4293851bc656e0eb8b22 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 LEADER]: Received request to transfer leadership to TS 838a3115bb3b43aa9d133a9e2867cb1e
I20260709 13:17:52.412564 11706 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83da4971ae24448e9dd2d458ad585340"
dest_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126"
mode: GRACEFUL
new_leader_uuid: "838a3115bb3b43aa9d133a9e2867cb1e"
 from {username='slave'} at 127.0.0.1:51162
I20260709 13:17:52.413105 11706 raft_consensus.cc:606] T 83da4971ae24448e9dd2d458ad585340 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 LEADER]: Received request to transfer leadership to TS 838a3115bb3b43aa9d133a9e2867cb1e
I20260709 13:17:52.420723 11783 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "509909ca832c4367bb1c43c3f8bc21e1"
dest_uuid: "838a3115bb3b43aa9d133a9e2867cb1e"
mode: GRACEFUL
new_leader_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9"
 from {username='slave'} at 127.0.0.1:39002
I20260709 13:17:52.421415 11783 raft_consensus.cc:606] T 509909ca832c4367bb1c43c3f8bc21e1 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 LEADER]: Received request to transfer leadership to TS 11579f7b06aa4eb4be4cd404f83aa8a9
I20260709 13:17:52.422817 11911 consensus_queue.cc:1048] T e4fc1968ceff48fdb57d0c32ec0e48be P 11579f7b06aa4eb4be4cd404f83aa8a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:52.438366 11969 consensus_queue.cc:1048] T e4fc1968ceff48fdb57d0c32ec0e48be P 11579f7b06aa4eb4be4cd404f83aa8a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:52.448858 11904 raft_consensus.cc:993] T e4fc1968ceff48fdb57d0c32ec0e48be P 11579f7b06aa4eb4be4cd404f83aa8a9: : Instructing follower fcd7d1bb34ba477f8b4fb7fcf67b7126 to start an election
I20260709 13:17:52.449410 11904 raft_consensus.cc:1081] T e4fc1968ceff48fdb57d0c32ec0e48be P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 LEADER]: Signalling peer fcd7d1bb34ba477f8b4fb7fcf67b7126 to start an election
I20260709 13:17:52.451191 11706 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4fc1968ceff48fdb57d0c32ec0e48be"
dest_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126"
 from {username='slave'} at 127.0.0.1:51152
I20260709 13:17:52.451906 11706 raft_consensus.cc:493] T e4fc1968ceff48fdb57d0c32ec0e48be P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:52.452322 11706 raft_consensus.cc:3060] T e4fc1968ceff48fdb57d0c32ec0e48be P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.504635 11969 raft_consensus.cc:493] T 509909ca832c4367bb1c43c3f8bc21e1 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.507261 11969 raft_consensus.cc:515] T 509909ca832c4367bb1c43c3f8bc21e1 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.511662 11969 leader_election.cc:290] T 509909ca832c4367bb1c43c3f8bc21e1 P 11579f7b06aa4eb4be4cd404f83aa8a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193:39519), 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031)
I20260709 13:17:52.513832 11708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509909ca832c4367bb1c43c3f8bc21e1" candidate_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" is_pre_election: true
I20260709 13:17:52.514880 11938 consensus_queue.cc:1048] T 18ecbae8747a4d928473333988f89191 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [LEADER]: Connected to new peer: Peer: permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:52.515522 11708 raft_consensus.cc:2393] T 509909ca832c4367bb1c43c3f8bc21e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 11579f7b06aa4eb4be4cd404f83aa8a9 in current term 1: Already voted for candidate 838a3115bb3b43aa9d133a9e2867cb1e in this term.
I20260709 13:17:52.514976 11782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509909ca832c4367bb1c43c3f8bc21e1" candidate_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" is_pre_election: true
I20260709 13:17:52.517967 11823 leader_election.cc:304] T 509909ca832c4367bb1c43c3f8bc21e1 P 11579f7b06aa4eb4be4cd404f83aa8a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11579f7b06aa4eb4be4cd404f83aa8a9; no voters: 838a3115bb3b43aa9d133a9e2867cb1e, fcd7d1bb34ba477f8b4fb7fcf67b7126
I20260709 13:17:52.519956 11969 raft_consensus.cc:3060] T 509909ca832c4367bb1c43c3f8bc21e1 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:52.520804 11706 raft_consensus.cc:515] T e4fc1968ceff48fdb57d0c32ec0e48be P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.524341 11706 leader_election.cc:290] T e4fc1968ceff48fdb57d0c32ec0e48be P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 2 election: Requested vote from peers 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031), 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253)
I20260709 13:17:52.528800 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4fc1968ceff48fdb57d0c32ec0e48be" candidate_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9"
I20260709 13:17:52.529311 11783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4fc1968ceff48fdb57d0c32ec0e48be" candidate_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "838a3115bb3b43aa9d133a9e2867cb1e"
I20260709 13:17:52.529706 11857 raft_consensus.cc:3055] T e4fc1968ceff48fdb57d0c32ec0e48be P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:52.530213 11857 raft_consensus.cc:740] T e4fc1968ceff48fdb57d0c32ec0e48be P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 11579f7b06aa4eb4be4cd404f83aa8a9, State: Running, Role: LEADER
I20260709 13:17:52.530333 11783 raft_consensus.cc:3060] T e4fc1968ceff48fdb57d0c32ec0e48be P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.531971 11857 consensus_queue.cc:260] T e4fc1968ceff48fdb57d0c32ec0e48be P 11579f7b06aa4eb4be4cd404f83aa8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.534039 11903 raft_consensus.cc:493] T c2b0f9021628468991c5a4ef3ebade45 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.535012 11903 raft_consensus.cc:515] T c2b0f9021628468991c5a4ef3ebade45 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.535218 11857 raft_consensus.cc:3060] T e4fc1968ceff48fdb57d0c32ec0e48be P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.537814 11903 leader_election.cc:290] T c2b0f9021628468991c5a4ef3ebade45 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031), 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253)
I20260709 13:17:52.541539 11781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b0f9021628468991c5a4ef3ebade45" candidate_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" is_pre_election: true
I20260709 13:17:52.542786 11969 raft_consensus.cc:2749] T 509909ca832c4367bb1c43c3f8bc21e1 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:52.543882 11783 raft_consensus.cc:2468] T e4fc1968ceff48fdb57d0c32ec0e48be P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd7d1bb34ba477f8b4fb7fcf67b7126 in term 2.
I20260709 13:17:52.544086 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b0f9021628468991c5a4ef3ebade45" candidate_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" is_pre_election: true
I20260709 13:17:52.545105 11856 raft_consensus.cc:2393] T c2b0f9021628468991c5a4ef3ebade45 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcd7d1bb34ba477f8b4fb7fcf67b7126 in current term 1: Already voted for candidate 838a3115bb3b43aa9d133a9e2867cb1e in this term.
I20260709 13:17:52.546716 11674 leader_election.cc:304] T c2b0f9021628468991c5a4ef3ebade45 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd7d1bb34ba477f8b4fb7fcf67b7126; no voters: 11579f7b06aa4eb4be4cd404f83aa8a9, 838a3115bb3b43aa9d133a9e2867cb1e
I20260709 13:17:52.549543 11919 raft_consensus.cc:3060] T c2b0f9021628468991c5a4ef3ebade45 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:52.550140 11857 raft_consensus.cc:2468] T e4fc1968ceff48fdb57d0c32ec0e48be P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd7d1bb34ba477f8b4fb7fcf67b7126 in term 2.
I20260709 13:17:52.551720 11673 leader_election.cc:304] T e4fc1968ceff48fdb57d0c32ec0e48be P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11579f7b06aa4eb4be4cd404f83aa8a9, fcd7d1bb34ba477f8b4fb7fcf67b7126; no voters: 
I20260709 13:17:52.552881 11938 raft_consensus.cc:2804] T e4fc1968ceff48fdb57d0c32ec0e48be P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:52.553314 11948 consensus_queue.cc:1048] T 18ecbae8747a4d928473333988f89191 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:52.557657 11938 raft_consensus.cc:697] T e4fc1968ceff48fdb57d0c32ec0e48be P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 LEADER]: Becoming Leader. State: Replica: fcd7d1bb34ba477f8b4fb7fcf67b7126, State: Running, Role: LEADER
I20260709 13:17:52.559434 11938 consensus_queue.cc:237] T e4fc1968ceff48fdb57d0c32ec0e48be P fcd7d1bb34ba477f8b4fb7fcf67b7126 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.563952 11919 raft_consensus.cc:2749] T c2b0f9021628468991c5a4ef3ebade45 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:52.575857 11603 catalog_manager.cc:5697] T e4fc1968ceff48fdb57d0c32ec0e48be P fcd7d1bb34ba477f8b4fb7fcf67b7126 reported cstate change: term changed from 1 to 2, leader changed from 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195) to fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193). New cstate: current_term: 2 leader_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:52.586519 11943 consensus_queue.cc:1048] T 509909ca832c4367bb1c43c3f8bc21e1 P 838a3115bb3b43aa9d133a9e2867cb1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:52.604045 11952 consensus_queue.cc:1048] T 509909ca832c4367bb1c43c3f8bc21e1 P 838a3115bb3b43aa9d133a9e2867cb1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:52.606024 11943 consensus_queue.cc:1048] T 930ea8ac2d2c41819a1481a4b2e09b24 P 838a3115bb3b43aa9d133a9e2867cb1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:52.614944 11943 raft_consensus.cc:993] T 509909ca832c4367bb1c43c3f8bc21e1 P 838a3115bb3b43aa9d133a9e2867cb1e: : Instructing follower 11579f7b06aa4eb4be4cd404f83aa8a9 to start an election
I20260709 13:17:52.615563 11952 raft_consensus.cc:1081] T 509909ca832c4367bb1c43c3f8bc21e1 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 LEADER]: Signalling peer 11579f7b06aa4eb4be4cd404f83aa8a9 to start an election
I20260709 13:17:52.617700 11857 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "509909ca832c4367bb1c43c3f8bc21e1"
dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9"
 from {username='slave'} at 127.0.0.1:54470
I20260709 13:17:52.618681 11857 raft_consensus.cc:493] T 509909ca832c4367bb1c43c3f8bc21e1 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:52.624912 11943 consensus_queue.cc:1048] T 930ea8ac2d2c41819a1481a4b2e09b24 P 838a3115bb3b43aa9d133a9e2867cb1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:52.633330 11857 raft_consensus.cc:3060] T 509909ca832c4367bb1c43c3f8bc21e1 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.641047 11857 raft_consensus.cc:515] T 509909ca832c4367bb1c43c3f8bc21e1 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.643878 11857 leader_election.cc:290] T 509909ca832c4367bb1c43c3f8bc21e1 P 11579f7b06aa4eb4be4cd404f83aa8a9 [CANDIDATE]: Term 2 election: Requested vote from peers fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193:39519), 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031)
I20260709 13:17:52.646818 11782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509909ca832c4367bb1c43c3f8bc21e1" candidate_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "838a3115bb3b43aa9d133a9e2867cb1e"
I20260709 13:17:52.647992 11706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509909ca832c4367bb1c43c3f8bc21e1" candidate_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126"
I20260709 13:17:52.648815 11706 raft_consensus.cc:3060] T 509909ca832c4367bb1c43c3f8bc21e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.647527 11782 raft_consensus.cc:3055] T 509909ca832c4367bb1c43c3f8bc21e1 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:52.651692 11782 raft_consensus.cc:740] T 509909ca832c4367bb1c43c3f8bc21e1 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 838a3115bb3b43aa9d133a9e2867cb1e, State: Running, Role: LEADER
I20260709 13:17:52.652784 11782 consensus_queue.cc:260] T 509909ca832c4367bb1c43c3f8bc21e1 P 838a3115bb3b43aa9d133a9e2867cb1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.654335 11782 raft_consensus.cc:3060] T 509909ca832c4367bb1c43c3f8bc21e1 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.659035 11706 raft_consensus.cc:2468] T 509909ca832c4367bb1c43c3f8bc21e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11579f7b06aa4eb4be4cd404f83aa8a9 in term 2.
I20260709 13:17:52.660480 11823 leader_election.cc:304] T 509909ca832c4367bb1c43c3f8bc21e1 P 11579f7b06aa4eb4be4cd404f83aa8a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11579f7b06aa4eb4be4cd404f83aa8a9, fcd7d1bb34ba477f8b4fb7fcf67b7126; no voters: 
I20260709 13:17:52.661489 11911 raft_consensus.cc:2804] T 509909ca832c4367bb1c43c3f8bc21e1 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:52.661960 11911 raft_consensus.cc:697] T 509909ca832c4367bb1c43c3f8bc21e1 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 2 LEADER]: Becoming Leader. State: Replica: 11579f7b06aa4eb4be4cd404f83aa8a9, State: Running, Role: LEADER
I20260709 13:17:52.663050 11911 consensus_queue.cc:237] T 509909ca832c4367bb1c43c3f8bc21e1 P 11579f7b06aa4eb4be4cd404f83aa8a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.664237 11782 raft_consensus.cc:2468] T 509909ca832c4367bb1c43c3f8bc21e1 P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11579f7b06aa4eb4be4cd404f83aa8a9 in term 2.
I20260709 13:17:52.668536 11911 consensus_queue.cc:1048] T 3a4012d4e7024b00bd58a041e3a07dcb P 11579f7b06aa4eb4be4cd404f83aa8a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:52.671161 11603 catalog_manager.cc:5697] T 509909ca832c4367bb1c43c3f8bc21e1 P 11579f7b06aa4eb4be4cd404f83aa8a9 reported cstate change: term changed from 1 to 2, leader changed from 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194) to 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195). New cstate: current_term: 2 leader_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:52.675025 11919 consensus_queue.cc:1048] T 83da4971ae24448e9dd2d458ad585340 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [LEADER]: Connected to new peer: Peer: permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:52.682845 11969 raft_consensus.cc:993] T 3a4012d4e7024b00bd58a041e3a07dcb P 11579f7b06aa4eb4be4cd404f83aa8a9: : Instructing follower 838a3115bb3b43aa9d133a9e2867cb1e to start an election
I20260709 13:17:52.683759 11904 raft_consensus.cc:1081] T 3a4012d4e7024b00bd58a041e3a07dcb P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 LEADER]: Signalling peer 838a3115bb3b43aa9d133a9e2867cb1e to start an election
I20260709 13:17:52.685932 11782 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3a4012d4e7024b00bd58a041e3a07dcb"
dest_uuid: "838a3115bb3b43aa9d133a9e2867cb1e"
 from {username='slave'} at 127.0.0.1:39000
I20260709 13:17:52.686565 11782 raft_consensus.cc:493] T 3a4012d4e7024b00bd58a041e3a07dcb P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:52.686744 11919 raft_consensus.cc:993] T 83da4971ae24448e9dd2d458ad585340 P fcd7d1bb34ba477f8b4fb7fcf67b7126: : Instructing follower 838a3115bb3b43aa9d133a9e2867cb1e to start an election
I20260709 13:17:52.687021 11782 raft_consensus.cc:3060] T 3a4012d4e7024b00bd58a041e3a07dcb P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.687492 11948 raft_consensus.cc:1081] T 83da4971ae24448e9dd2d458ad585340 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 LEADER]: Signalling peer 838a3115bb3b43aa9d133a9e2867cb1e to start an election
I20260709 13:17:52.690130 11781 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "83da4971ae24448e9dd2d458ad585340"
dest_uuid: "838a3115bb3b43aa9d133a9e2867cb1e"
 from {username='slave'} at 127.0.0.1:38990
I20260709 13:17:52.690584 11781 raft_consensus.cc:493] T 83da4971ae24448e9dd2d458ad585340 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:52.690861 11781 raft_consensus.cc:3060] T 83da4971ae24448e9dd2d458ad585340 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.695940 11904 consensus_queue.cc:1048] T 3a4012d4e7024b00bd58a041e3a07dcb P 11579f7b06aa4eb4be4cd404f83aa8a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:52.705590 11919 consensus_queue.cc:1048] T 83da4971ae24448e9dd2d458ad585340 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:52.708796 11782 raft_consensus.cc:515] T 3a4012d4e7024b00bd58a041e3a07dcb P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.711876 11782 leader_election.cc:290] T 3a4012d4e7024b00bd58a041e3a07dcb P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 2 election: Requested vote from peers fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193:39519), 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253)
I20260709 13:17:52.714740 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4012d4e7024b00bd58a041e3a07dcb" candidate_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9"
I20260709 13:17:52.715624 11857 raft_consensus.cc:3055] T 3a4012d4e7024b00bd58a041e3a07dcb P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:52.715358 11781 raft_consensus.cc:515] T 83da4971ae24448e9dd2d458ad585340 P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.716179 11857 raft_consensus.cc:740] T 3a4012d4e7024b00bd58a041e3a07dcb P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 11579f7b06aa4eb4be4cd404f83aa8a9, State: Running, Role: LEADER
I20260709 13:17:52.716691 11783 raft_consensus.cc:1240] T 83da4971ae24448e9dd2d458ad585340 P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 FOLLOWER]: Rejecting Update request from peer fcd7d1bb34ba477f8b4fb7fcf67b7126 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:52.717778 11857 consensus_queue.cc:260] T 3a4012d4e7024b00bd58a041e3a07dcb P 11579f7b06aa4eb4be4cd404f83aa8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.720417 11857 raft_consensus.cc:3060] T 3a4012d4e7024b00bd58a041e3a07dcb P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.721897 11919 consensus_queue.cc:1059] T 83da4971ae24448e9dd2d458ad585340 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:52.722993 11948 raft_consensus.cc:3055] T 83da4971ae24448e9dd2d458ad585340 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:52.722962 11706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4012d4e7024b00bd58a041e3a07dcb" candidate_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126"
I20260709 13:17:52.723577 11948 raft_consensus.cc:740] T 83da4971ae24448e9dd2d458ad585340 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fcd7d1bb34ba477f8b4fb7fcf67b7126, State: Running, Role: LEADER
I20260709 13:17:52.724639 11707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83da4971ae24448e9dd2d458ad585340" candidate_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126"
I20260709 13:17:52.724795 11948 consensus_queue.cc:260] T 83da4971ae24448e9dd2d458ad585340 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.725901 11948 raft_consensus.cc:3060] T 83da4971ae24448e9dd2d458ad585340 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.726303 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83da4971ae24448e9dd2d458ad585340" candidate_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9"
I20260709 13:17:52.728420 11781 leader_election.cc:290] T 83da4971ae24448e9dd2d458ad585340 P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 2 election: Requested vote from peers fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193:39519), 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253)
I20260709 13:17:52.733318 11857 raft_consensus.cc:2468] T 3a4012d4e7024b00bd58a041e3a07dcb P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 838a3115bb3b43aa9d133a9e2867cb1e in term 2.
I20260709 13:17:52.735137 11748 leader_election.cc:304] T 3a4012d4e7024b00bd58a041e3a07dcb P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11579f7b06aa4eb4be4cd404f83aa8a9, 838a3115bb3b43aa9d133a9e2867cb1e; no voters: fcd7d1bb34ba477f8b4fb7fcf67b7126
I20260709 13:17:52.736858 11952 raft_consensus.cc:2804] T 3a4012d4e7024b00bd58a041e3a07dcb P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:52.737361 11952 raft_consensus.cc:697] T 3a4012d4e7024b00bd58a041e3a07dcb P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 LEADER]: Becoming Leader. State: Replica: 838a3115bb3b43aa9d133a9e2867cb1e, State: Running, Role: LEADER
I20260709 13:17:52.738461 11952 consensus_queue.cc:237] T 3a4012d4e7024b00bd58a041e3a07dcb P 838a3115bb3b43aa9d133a9e2867cb1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.751042 11707 raft_consensus.cc:2468] T 83da4971ae24448e9dd2d458ad585340 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 838a3115bb3b43aa9d133a9e2867cb1e in term 2.
I20260709 13:17:52.752115 11604 catalog_manager.cc:5697] T 3a4012d4e7024b00bd58a041e3a07dcb P 838a3115bb3b43aa9d133a9e2867cb1e reported cstate change: term changed from 1 to 2, leader changed from 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195) to 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194). New cstate: current_term: 2 leader_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:52.753418 11749 leader_election.cc:304] T 83da4971ae24448e9dd2d458ad585340 P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 838a3115bb3b43aa9d133a9e2867cb1e, fcd7d1bb34ba477f8b4fb7fcf67b7126; no voters: 11579f7b06aa4eb4be4cd404f83aa8a9
I20260709 13:17:52.754524 11952 raft_consensus.cc:2804] T 83da4971ae24448e9dd2d458ad585340 P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:52.755026 11952 raft_consensus.cc:697] T 83da4971ae24448e9dd2d458ad585340 P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 LEADER]: Becoming Leader. State: Replica: 838a3115bb3b43aa9d133a9e2867cb1e, State: Running, Role: LEADER
I20260709 13:17:52.755968 11952 consensus_queue.cc:237] T 83da4971ae24448e9dd2d458ad585340 P 838a3115bb3b43aa9d133a9e2867cb1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.767314 11604 catalog_manager.cc:5697] T 83da4971ae24448e9dd2d458ad585340 P 838a3115bb3b43aa9d133a9e2867cb1e reported cstate change: term changed from 1 to 2, leader changed from fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193) to 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194). New cstate: current_term: 2 leader_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:52.856083 11952 consensus_queue.cc:1048] T c2b0f9021628468991c5a4ef3ebade45 P 838a3115bb3b43aa9d133a9e2867cb1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:52.864233 11941 raft_consensus.cc:993] T c2b0f9021628468991c5a4ef3ebade45 P 838a3115bb3b43aa9d133a9e2867cb1e: : Instructing follower fcd7d1bb34ba477f8b4fb7fcf67b7126 to start an election
I20260709 13:17:52.864814 11941 raft_consensus.cc:1081] T c2b0f9021628468991c5a4ef3ebade45 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 LEADER]: Signalling peer fcd7d1bb34ba477f8b4fb7fcf67b7126 to start an election
I20260709 13:17:52.867398 11941 consensus_queue.cc:1048] T c2b0f9021628468991c5a4ef3ebade45 P 838a3115bb3b43aa9d133a9e2867cb1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:52.867697 11708 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c2b0f9021628468991c5a4ef3ebade45"
dest_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126"
 from {username='slave'} at 127.0.0.1:51154
I20260709 13:17:52.868422 11708 raft_consensus.cc:493] T c2b0f9021628468991c5a4ef3ebade45 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:52.868852 11708 raft_consensus.cc:3060] T c2b0f9021628468991c5a4ef3ebade45 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.880028 11919 raft_consensus.cc:993] T 5af25078161a4293851bc656e0eb8b22 P fcd7d1bb34ba477f8b4fb7fcf67b7126: : Instructing follower 838a3115bb3b43aa9d133a9e2867cb1e to start an election
I20260709 13:17:52.880751 11919 raft_consensus.cc:1081] T 5af25078161a4293851bc656e0eb8b22 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 LEADER]: Signalling peer 838a3115bb3b43aa9d133a9e2867cb1e to start an election
I20260709 13:17:52.882791 11781 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5af25078161a4293851bc656e0eb8b22"
dest_uuid: "838a3115bb3b43aa9d133a9e2867cb1e"
 from {username='slave'} at 127.0.0.1:38990
I20260709 13:17:52.883401 11781 raft_consensus.cc:493] T 5af25078161a4293851bc656e0eb8b22 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:52.883837 11781 raft_consensus.cc:3060] T 5af25078161a4293851bc656e0eb8b22 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.884196 11708 raft_consensus.cc:515] T c2b0f9021628468991c5a4ef3ebade45 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.888247 11708 leader_election.cc:290] T c2b0f9021628468991c5a4ef3ebade45 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 2 election: Requested vote from peers 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031), 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253)
I20260709 13:17:52.888947 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b0f9021628468991c5a4ef3ebade45" candidate_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9"
I20260709 13:17:52.890177 11857 raft_consensus.cc:3060] T c2b0f9021628468991c5a4ef3ebade45 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.892339 11782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b0f9021628468991c5a4ef3ebade45" candidate_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "838a3115bb3b43aa9d133a9e2867cb1e"
I20260709 13:17:52.893077 11782 raft_consensus.cc:3055] T c2b0f9021628468991c5a4ef3ebade45 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:52.893441 11782 raft_consensus.cc:740] T c2b0f9021628468991c5a4ef3ebade45 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 838a3115bb3b43aa9d133a9e2867cb1e, State: Running, Role: LEADER
I20260709 13:17:52.894457 11782 consensus_queue.cc:260] T c2b0f9021628468991c5a4ef3ebade45 P 838a3115bb3b43aa9d133a9e2867cb1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.894634 11781 raft_consensus.cc:515] T 5af25078161a4293851bc656e0eb8b22 P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.895980 11782 raft_consensus.cc:3060] T c2b0f9021628468991c5a4ef3ebade45 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.897141 11781 leader_election.cc:290] T 5af25078161a4293851bc656e0eb8b22 P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 2 election: Requested vote from peers fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193:39519), 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253)
I20260709 13:17:52.897886 11708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af25078161a4293851bc656e0eb8b22" candidate_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126"
I20260709 13:17:52.898550 11708 raft_consensus.cc:3055] T 5af25078161a4293851bc656e0eb8b22 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:52.898873 11708 raft_consensus.cc:740] T 5af25078161a4293851bc656e0eb8b22 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fcd7d1bb34ba477f8b4fb7fcf67b7126, State: Running, Role: LEADER
I20260709 13:17:52.898862 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af25078161a4293851bc656e0eb8b22" candidate_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9"
I20260709 13:17:52.899828 11856 raft_consensus.cc:3060] T 5af25078161a4293851bc656e0eb8b22 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.900342 11857 raft_consensus.cc:2468] T c2b0f9021628468991c5a4ef3ebade45 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd7d1bb34ba477f8b4fb7fcf67b7126 in term 2.
I20260709 13:17:52.900326 11708 consensus_queue.cc:260] T 5af25078161a4293851bc656e0eb8b22 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.902064 11708 raft_consensus.cc:3060] T 5af25078161a4293851bc656e0eb8b22 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.905351 11782 raft_consensus.cc:2468] T c2b0f9021628468991c5a4ef3ebade45 P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd7d1bb34ba477f8b4fb7fcf67b7126 in term 2.
I20260709 13:17:52.905471 11673 leader_election.cc:304] T c2b0f9021628468991c5a4ef3ebade45 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11579f7b06aa4eb4be4cd404f83aa8a9, fcd7d1bb34ba477f8b4fb7fcf67b7126; no voters: 
I20260709 13:17:52.906461 11948 raft_consensus.cc:2804] T c2b0f9021628468991c5a4ef3ebade45 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:52.907018 11948 raft_consensus.cc:697] T c2b0f9021628468991c5a4ef3ebade45 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 LEADER]: Becoming Leader. State: Replica: fcd7d1bb34ba477f8b4fb7fcf67b7126, State: Running, Role: LEADER
I20260709 13:17:52.908092 11948 consensus_queue.cc:237] T c2b0f9021628468991c5a4ef3ebade45 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.912154 11708 raft_consensus.cc:2468] T 5af25078161a4293851bc656e0eb8b22 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 838a3115bb3b43aa9d133a9e2867cb1e in term 2.
I20260709 13:17:52.912892 11856 raft_consensus.cc:2468] T 5af25078161a4293851bc656e0eb8b22 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 838a3115bb3b43aa9d133a9e2867cb1e in term 2.
I20260709 13:17:52.913511 11749 leader_election.cc:304] T 5af25078161a4293851bc656e0eb8b22 P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 838a3115bb3b43aa9d133a9e2867cb1e, fcd7d1bb34ba477f8b4fb7fcf67b7126; no voters: 
I20260709 13:17:52.914564 11983 raft_consensus.cc:2804] T 5af25078161a4293851bc656e0eb8b22 P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:52.915014 11983 raft_consensus.cc:697] T 5af25078161a4293851bc656e0eb8b22 P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 LEADER]: Becoming Leader. State: Replica: 838a3115bb3b43aa9d133a9e2867cb1e, State: Running, Role: LEADER
I20260709 13:17:52.916090 11983 consensus_queue.cc:237] T 5af25078161a4293851bc656e0eb8b22 P 838a3115bb3b43aa9d133a9e2867cb1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:52.918236 11604 catalog_manager.cc:5697] T c2b0f9021628468991c5a4ef3ebade45 P fcd7d1bb34ba477f8b4fb7fcf67b7126 reported cstate change: term changed from 1 to 2, leader changed from 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194) to fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193). New cstate: current_term: 2 leader_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:52.925033 11606 catalog_manager.cc:5697] T 5af25078161a4293851bc656e0eb8b22 P 838a3115bb3b43aa9d133a9e2867cb1e reported cstate change: term changed from 1 to 2, leader changed from fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193) to 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194). New cstate: current_term: 2 leader_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:52.969143 11856 raft_consensus.cc:1275] T e4fc1968ceff48fdb57d0c32ec0e48be P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 2 FOLLOWER]: Refusing update from remote peer fcd7d1bb34ba477f8b4fb7fcf67b7126: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:52.970638 11948 consensus_queue.cc:1048] T e4fc1968ceff48fdb57d0c32ec0e48be P fcd7d1bb34ba477f8b4fb7fcf67b7126 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:52.980629 11782 raft_consensus.cc:1275] T e4fc1968ceff48fdb57d0c32ec0e48be P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 FOLLOWER]: Refusing update from remote peer fcd7d1bb34ba477f8b4fb7fcf67b7126: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:52.982366 11948 consensus_queue.cc:1048] T e4fc1968ceff48fdb57d0c32ec0e48be P fcd7d1bb34ba477f8b4fb7fcf67b7126 [LEADER]: Connected to new peer: Peer: permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:53.133992 11708 raft_consensus.cc:3060] T 3a4012d4e7024b00bd58a041e3a07dcb P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:53.141515 11708 raft_consensus.cc:1275] T 3a4012d4e7024b00bd58a041e3a07dcb P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 FOLLOWER]: Refusing update from remote peer 838a3115bb3b43aa9d133a9e2867cb1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:53.142786 11983 consensus_queue.cc:1048] T 3a4012d4e7024b00bd58a041e3a07dcb P 838a3115bb3b43aa9d133a9e2867cb1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:53.150794 11856 raft_consensus.cc:1275] T 3a4012d4e7024b00bd58a041e3a07dcb P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 2 FOLLOWER]: Refusing update from remote peer 838a3115bb3b43aa9d133a9e2867cb1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:53.153059 11943 consensus_queue.cc:1048] T 3a4012d4e7024b00bd58a041e3a07dcb P 838a3115bb3b43aa9d133a9e2867cb1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:53.183257 11708 raft_consensus.cc:1275] T 509909ca832c4367bb1c43c3f8bc21e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 FOLLOWER]: Refusing update from remote peer 11579f7b06aa4eb4be4cd404f83aa8a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:53.184669 11904 consensus_queue.cc:1048] T 509909ca832c4367bb1c43c3f8bc21e1 P 11579f7b06aa4eb4be4cd404f83aa8a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:53.187670 11782 raft_consensus.cc:1275] T 509909ca832c4367bb1c43c3f8bc21e1 P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 FOLLOWER]: Refusing update from remote peer 11579f7b06aa4eb4be4cd404f83aa8a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:53.189508 11969 consensus_queue.cc:1048] T 509909ca832c4367bb1c43c3f8bc21e1 P 11579f7b06aa4eb4be4cd404f83aa8a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:53.270529 11856 raft_consensus.cc:3060] T 83da4971ae24448e9dd2d458ad585340 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:53.276983 11856 raft_consensus.cc:1275] T 83da4971ae24448e9dd2d458ad585340 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 2 FOLLOWER]: Refusing update from remote peer 838a3115bb3b43aa9d133a9e2867cb1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:53.278395 11943 consensus_queue.cc:1048] T 83da4971ae24448e9dd2d458ad585340 P 838a3115bb3b43aa9d133a9e2867cb1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:53.287431 11708 raft_consensus.cc:1275] T 83da4971ae24448e9dd2d458ad585340 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 FOLLOWER]: Refusing update from remote peer 838a3115bb3b43aa9d133a9e2867cb1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:53.289086 11943 consensus_queue.cc:1048] T 83da4971ae24448e9dd2d458ad585340 P 838a3115bb3b43aa9d133a9e2867cb1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:53.291812 11782 raft_consensus.cc:1275] T c2b0f9021628468991c5a4ef3ebade45 P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 FOLLOWER]: Refusing update from remote peer fcd7d1bb34ba477f8b4fb7fcf67b7126: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:53.294679 11948 consensus_queue.cc:1048] T c2b0f9021628468991c5a4ef3ebade45 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [LEADER]: Connected to new peer: Peer: permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:53.305312 11856 raft_consensus.cc:1275] T c2b0f9021628468991c5a4ef3ebade45 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 2 FOLLOWER]: Refusing update from remote peer fcd7d1bb34ba477f8b4fb7fcf67b7126: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:53.307055 11919 consensus_queue.cc:1048] T c2b0f9021628468991c5a4ef3ebade45 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:53.309849 11708 raft_consensus.cc:1275] T 5af25078161a4293851bc656e0eb8b22 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 FOLLOWER]: Refusing update from remote peer 838a3115bb3b43aa9d133a9e2867cb1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:53.313370 11943 consensus_queue.cc:1048] T 5af25078161a4293851bc656e0eb8b22 P 838a3115bb3b43aa9d133a9e2867cb1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:53.321420 11857 raft_consensus.cc:1275] T 5af25078161a4293851bc656e0eb8b22 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 2 FOLLOWER]: Refusing update from remote peer 838a3115bb3b43aa9d133a9e2867cb1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:53.323021 11952 consensus_queue.cc:1048] T 5af25078161a4293851bc656e0eb8b22 P 838a3115bb3b43aa9d133a9e2867cb1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:55.455267 11604 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36366:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:17:55.457981 11604 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:17:55.513846 11695 tablet_service.cc:1511] Processing CreateTablet for tablet 3fa6178098a140f09c25be5cf185e48e (DEFAULT_TABLE table=soft_deleted_table [id=e37c9278bfd544b0934775465c42347c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:17:55.515249 11767 tablet_service.cc:1511] Processing CreateTablet for tablet 3fa6178098a140f09c25be5cf185e48e (DEFAULT_TABLE table=soft_deleted_table [id=e37c9278bfd544b0934775465c42347c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:17:55.515980 11695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fa6178098a140f09c25be5cf185e48e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.517103 11767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fa6178098a140f09c25be5cf185e48e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.516764 11844 tablet_service.cc:1511] Processing CreateTablet for tablet 3fa6178098a140f09c25be5cf185e48e (DEFAULT_TABLE table=soft_deleted_table [id=e37c9278bfd544b0934775465c42347c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:17:55.518368 11844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fa6178098a140f09c25be5cf185e48e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.520328 11694 tablet_service.cc:1511] Processing CreateTablet for tablet 793c97394cd142e9b2f9a301b2698075 (DEFAULT_TABLE table=soft_deleted_table [id=e37c9278bfd544b0934775465c42347c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:17:55.521816 11694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 793c97394cd142e9b2f9a301b2698075. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.520336 11769 tablet_service.cc:1511] Processing CreateTablet for tablet 793c97394cd142e9b2f9a301b2698075 (DEFAULT_TABLE table=soft_deleted_table [id=e37c9278bfd544b0934775465c42347c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:17:55.524197 11839 tablet_service.cc:1511] Processing CreateTablet for tablet 793c97394cd142e9b2f9a301b2698075 (DEFAULT_TABLE table=soft_deleted_table [id=e37c9278bfd544b0934775465c42347c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:17:55.525206 11769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 793c97394cd142e9b2f9a301b2698075. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.525705 11839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 793c97394cd142e9b2f9a301b2698075. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.546789 11999 tablet_bootstrap.cc:492] T 3fa6178098a140f09c25be5cf185e48e P fcd7d1bb34ba477f8b4fb7fcf67b7126: Bootstrap starting.
I20260709 13:17:55.550997 12000 tablet_bootstrap.cc:492] T 3fa6178098a140f09c25be5cf185e48e P 11579f7b06aa4eb4be4cd404f83aa8a9: Bootstrap starting.
I20260709 13:17:55.556145 11695 tablet_service.cc:1511] Processing CreateTablet for tablet afbf296b986b46aa9283a2dfe0f8fc13 (DEFAULT_TABLE table=soft_deleted_table [id=e37c9278bfd544b0934775465c42347c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:17:55.557821 11695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afbf296b986b46aa9283a2dfe0f8fc13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.558477 11999 tablet_bootstrap.cc:654] T 3fa6178098a140f09c25be5cf185e48e P fcd7d1bb34ba477f8b4fb7fcf67b7126: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.560267 12000 tablet_bootstrap.cc:654] T 3fa6178098a140f09c25be5cf185e48e P 11579f7b06aa4eb4be4cd404f83aa8a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.567728 12001 tablet_bootstrap.cc:492] T 3fa6178098a140f09c25be5cf185e48e P 838a3115bb3b43aa9d133a9e2867cb1e: Bootstrap starting.
I20260709 13:17:55.572641 11767 tablet_service.cc:1511] Processing CreateTablet for tablet afbf296b986b46aa9283a2dfe0f8fc13 (DEFAULT_TABLE table=soft_deleted_table [id=e37c9278bfd544b0934775465c42347c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:17:55.573776 12000 tablet_bootstrap.cc:492] T 3fa6178098a140f09c25be5cf185e48e P 11579f7b06aa4eb4be4cd404f83aa8a9: No bootstrap required, opened a new log
I20260709 13:17:55.574153 11767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afbf296b986b46aa9283a2dfe0f8fc13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.574491 12000 ts_tablet_manager.cc:1403] T 3fa6178098a140f09c25be5cf185e48e P 11579f7b06aa4eb4be4cd404f83aa8a9: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.011s
I20260709 13:17:55.574970 11999 tablet_bootstrap.cc:492] T 3fa6178098a140f09c25be5cf185e48e P fcd7d1bb34ba477f8b4fb7fcf67b7126: No bootstrap required, opened a new log
I20260709 13:17:55.575591 11999 ts_tablet_manager.cc:1403] T 3fa6178098a140f09c25be5cf185e48e P fcd7d1bb34ba477f8b4fb7fcf67b7126: Time spent bootstrapping tablet: real 0.029s	user 0.006s	sys 0.012s
I20260709 13:17:55.578382 12000 raft_consensus.cc:359] T 3fa6178098a140f09c25be5cf185e48e P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:55.578753 11999 raft_consensus.cc:359] T 3fa6178098a140f09c25be5cf185e48e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:55.579370 12000 raft_consensus.cc:385] T 3fa6178098a140f09c25be5cf185e48e P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.579523 11999 raft_consensus.cc:385] T 3fa6178098a140f09c25be5cf185e48e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.580013 12000 raft_consensus.cc:740] T 3fa6178098a140f09c25be5cf185e48e P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11579f7b06aa4eb4be4cd404f83aa8a9, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.581040 12000 consensus_queue.cc:260] T 3fa6178098a140f09c25be5cf185e48e P 11579f7b06aa4eb4be4cd404f83aa8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:55.584884 12001 tablet_bootstrap.cc:654] T 3fa6178098a140f09c25be5cf185e48e P 838a3115bb3b43aa9d133a9e2867cb1e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.585472 11844 tablet_service.cc:1511] Processing CreateTablet for tablet afbf296b986b46aa9283a2dfe0f8fc13 (DEFAULT_TABLE table=soft_deleted_table [id=e37c9278bfd544b0934775465c42347c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:17:55.586989 11844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afbf296b986b46aa9283a2dfe0f8fc13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.587332 12000 ts_tablet_manager.cc:1434] T 3fa6178098a140f09c25be5cf185e48e P 11579f7b06aa4eb4be4cd404f83aa8a9: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:17:55.580032 11999 raft_consensus.cc:740] T 3fa6178098a140f09c25be5cf185e48e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd7d1bb34ba477f8b4fb7fcf67b7126, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.589301 11999 consensus_queue.cc:260] T 3fa6178098a140f09c25be5cf185e48e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:55.592995 11999 ts_tablet_manager.cc:1434] T 3fa6178098a140f09c25be5cf185e48e P fcd7d1bb34ba477f8b4fb7fcf67b7126: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.005s
I20260709 13:17:55.594199 11999 tablet_bootstrap.cc:492] T afbf296b986b46aa9283a2dfe0f8fc13 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Bootstrap starting.
I20260709 13:17:55.600052 11768 tablet_service.cc:1511] Processing CreateTablet for tablet 3a4cfaf3eb3649dda1cd4ec67714625c (DEFAULT_TABLE table=soft_deleted_table [id=e37c9278bfd544b0934775465c42347c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:17:55.601619 11768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a4cfaf3eb3649dda1cd4ec67714625c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.601768 12001 tablet_bootstrap.cc:492] T 3fa6178098a140f09c25be5cf185e48e P 838a3115bb3b43aa9d133a9e2867cb1e: No bootstrap required, opened a new log
I20260709 13:17:55.602406 12001 ts_tablet_manager.cc:1403] T 3fa6178098a140f09c25be5cf185e48e P 838a3115bb3b43aa9d133a9e2867cb1e: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.004s
I20260709 13:17:55.603243 11999 tablet_bootstrap.cc:654] T afbf296b986b46aa9283a2dfe0f8fc13 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.604393 11841 tablet_service.cc:1511] Processing CreateTablet for tablet 3a4cfaf3eb3649dda1cd4ec67714625c (DEFAULT_TABLE table=soft_deleted_table [id=e37c9278bfd544b0934775465c42347c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:17:55.605997 11841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a4cfaf3eb3649dda1cd4ec67714625c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.606362 12001 raft_consensus.cc:359] T 3fa6178098a140f09c25be5cf185e48e P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:55.607359 12001 raft_consensus.cc:385] T 3fa6178098a140f09c25be5cf185e48e P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.607771 12001 raft_consensus.cc:740] T 3fa6178098a140f09c25be5cf185e48e P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 838a3115bb3b43aa9d133a9e2867cb1e, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.608994 12001 consensus_queue.cc:260] T 3fa6178098a140f09c25be5cf185e48e P 838a3115bb3b43aa9d133a9e2867cb1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:55.628862 11696 tablet_service.cc:1511] Processing CreateTablet for tablet 033d9618f252438383673646b087b3e2 (DEFAULT_TABLE table=soft_deleted_table [id=e37c9278bfd544b0934775465c42347c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:17:55.630430 11696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 033d9618f252438383673646b087b3e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.645519 12001 ts_tablet_manager.cc:1434] T 3fa6178098a140f09c25be5cf185e48e P 838a3115bb3b43aa9d133a9e2867cb1e: Time spent starting tablet: real 0.043s	user 0.011s	sys 0.000s
I20260709 13:17:55.647316 12001 tablet_bootstrap.cc:492] T 793c97394cd142e9b2f9a301b2698075 P 838a3115bb3b43aa9d133a9e2867cb1e: Bootstrap starting.
I20260709 13:17:55.650843 12000 tablet_bootstrap.cc:492] T 793c97394cd142e9b2f9a301b2698075 P 11579f7b06aa4eb4be4cd404f83aa8a9: Bootstrap starting.
I20260709 13:17:55.653349 11695 tablet_service.cc:1511] Processing CreateTablet for tablet 3a4cfaf3eb3649dda1cd4ec67714625c (DEFAULT_TABLE table=soft_deleted_table [id=e37c9278bfd544b0934775465c42347c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:17:55.654803 11695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a4cfaf3eb3649dda1cd4ec67714625c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.655869 11769 tablet_service.cc:1511] Processing CreateTablet for tablet 033d9618f252438383673646b087b3e2 (DEFAULT_TABLE table=soft_deleted_table [id=e37c9278bfd544b0934775465c42347c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:17:55.657354 11769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 033d9618f252438383673646b087b3e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.659607 12000 tablet_bootstrap.cc:654] T 793c97394cd142e9b2f9a301b2698075 P 11579f7b06aa4eb4be4cd404f83aa8a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.669126 12001 tablet_bootstrap.cc:654] T 793c97394cd142e9b2f9a301b2698075 P 838a3115bb3b43aa9d133a9e2867cb1e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.674192 11987 raft_consensus.cc:493] T 3fa6178098a140f09c25be5cf185e48e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.679126 11999 tablet_bootstrap.cc:492] T afbf296b986b46aa9283a2dfe0f8fc13 P fcd7d1bb34ba477f8b4fb7fcf67b7126: No bootstrap required, opened a new log
I20260709 13:17:55.679836 11999 ts_tablet_manager.cc:1403] T afbf296b986b46aa9283a2dfe0f8fc13 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Time spent bootstrapping tablet: real 0.086s	user 0.016s	sys 0.028s
I20260709 13:17:55.674880 11839 tablet_service.cc:1511] Processing CreateTablet for tablet 033d9618f252438383673646b087b3e2 (DEFAULT_TABLE table=soft_deleted_table [id=e37c9278bfd544b0934775465c42347c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:17:55.680667 11694 tablet_service.cc:1511] Processing CreateTablet for tablet 394623997b07477aa1f4616ad07fd3b5 (DEFAULT_TABLE table=soft_deleted_table [id=e37c9278bfd544b0934775465c42347c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:17:55.681236 11839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 033d9618f252438383673646b087b3e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.682103 11694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 394623997b07477aa1f4616ad07fd3b5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:17:55.684389 11654 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:55.679477 11987 raft_consensus.cc:515] T 3fa6178098a140f09c25be5cf185e48e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:55.687192 11766 tablet_service.cc:1511] Processing CreateTablet for tablet 394623997b07477aa1f4616ad07fd3b5 (DEFAULT_TABLE table=soft_deleted_table [id=e37c9278bfd544b0934775465c42347c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:17:55.688817 11766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 394623997b07477aa1f4616ad07fd3b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.690287 11782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa6178098a140f09c25be5cf185e48e" candidate_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" is_pre_election: true
I20260709 13:17:55.690547 11691 tablet_service.cc:1511] Processing CreateTablet for tablet 10853738200240bb93ca91ed7d97566e (DEFAULT_TABLE table=soft_deleted_table [id=e37c9278bfd544b0934775465c42347c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:17:55.691032 11782 raft_consensus.cc:2468] T 3fa6178098a140f09c25be5cf185e48e P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd7d1bb34ba477f8b4fb7fcf67b7126 in term 0.
I20260709 13:17:55.692643 11691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10853738200240bb93ca91ed7d97566e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.707279 11840 tablet_service.cc:1511] Processing CreateTablet for tablet 10853738200240bb93ca91ed7d97566e (DEFAULT_TABLE table=soft_deleted_table [id=e37c9278bfd544b0934775465c42347c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:17:55.708917 11840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10853738200240bb93ca91ed7d97566e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.694629 11674 leader_election.cc:304] T 3fa6178098a140f09c25be5cf185e48e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 838a3115bb3b43aa9d133a9e2867cb1e, fcd7d1bb34ba477f8b4fb7fcf67b7126; no voters: 
I20260709 13:17:55.688833 11845 tablet_service.cc:1511] Processing CreateTablet for tablet 394623997b07477aa1f4616ad07fd3b5 (DEFAULT_TABLE table=soft_deleted_table [id=e37c9278bfd544b0934775465c42347c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:17:55.697122 11987 leader_election.cc:290] T 3fa6178098a140f09c25be5cf185e48e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031), 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253)
I20260709 13:17:55.716787 11845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 394623997b07477aa1f4616ad07fd3b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.718472 11987 raft_consensus.cc:2804] T 3fa6178098a140f09c25be5cf185e48e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:55.718989 11987 raft_consensus.cc:493] T 3fa6178098a140f09c25be5cf185e48e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.698369 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa6178098a140f09c25be5cf185e48e" candidate_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" is_pre_election: true
I20260709 13:17:55.703306 11770 tablet_service.cc:1511] Processing CreateTablet for tablet 10853738200240bb93ca91ed7d97566e (DEFAULT_TABLE table=soft_deleted_table [id=e37c9278bfd544b0934775465c42347c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:17:55.723454 11856 raft_consensus.cc:2468] T 3fa6178098a140f09c25be5cf185e48e P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd7d1bb34ba477f8b4fb7fcf67b7126 in term 0.
I20260709 13:17:55.724651 11770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10853738200240bb93ca91ed7d97566e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.719404 11987 raft_consensus.cc:3060] T 3fa6178098a140f09c25be5cf185e48e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:55.743943 11696 tablet_service.cc:1511] Processing CreateTablet for tablet 9de688862796441d936411ed5e7c42e1 (DEFAULT_TABLE table=soft_deleted_table [id=e37c9278bfd544b0934775465c42347c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:17:55.746110 11696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9de688862796441d936411ed5e7c42e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.683537 11999 raft_consensus.cc:359] T afbf296b986b46aa9283a2dfe0f8fc13 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:55.748029 11999 raft_consensus.cc:385] T afbf296b986b46aa9283a2dfe0f8fc13 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.748382 11999 raft_consensus.cc:740] T afbf296b986b46aa9283a2dfe0f8fc13 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd7d1bb34ba477f8b4fb7fcf67b7126, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.749398 11999 consensus_queue.cc:260] T afbf296b986b46aa9283a2dfe0f8fc13 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:55.752146 11999 ts_tablet_manager.cc:1434] T afbf296b986b46aa9283a2dfe0f8fc13 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Time spent starting tablet: real 0.072s	user 0.008s	sys 0.001s
I20260709 13:17:55.753335 11999 tablet_bootstrap.cc:492] T 793c97394cd142e9b2f9a301b2698075 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Bootstrap starting.
I20260709 13:17:55.781257 11844 tablet_service.cc:1511] Processing CreateTablet for tablet 9de688862796441d936411ed5e7c42e1 (DEFAULT_TABLE table=soft_deleted_table [id=e37c9278bfd544b0934775465c42347c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:17:55.783605 11844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9de688862796441d936411ed5e7c42e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.785933 11693 tablet_service.cc:1511] Processing CreateTablet for tablet de5865b982f344e29ffc3453ec63ad46 (DEFAULT_TABLE table=soft_deleted_table [id=e37c9278bfd544b0934775465c42347c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:17:55.787400 11693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de5865b982f344e29ffc3453ec63ad46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.789037 11840 tablet_service.cc:1511] Processing CreateTablet for tablet de5865b982f344e29ffc3453ec63ad46 (DEFAULT_TABLE table=soft_deleted_table [id=e37c9278bfd544b0934775465c42347c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:17:55.790377 11840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de5865b982f344e29ffc3453ec63ad46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.793776 11767 tablet_service.cc:1511] Processing CreateTablet for tablet 9de688862796441d936411ed5e7c42e1 (DEFAULT_TABLE table=soft_deleted_table [id=e37c9278bfd544b0934775465c42347c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:17:55.795567 11767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9de688862796441d936411ed5e7c42e1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:17:55.775889 11674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.198.194:37031, user_credentials={real_user=slave}} blocked reactor thread for 81354.4us
I20260709 13:17:55.798238 11999 tablet_bootstrap.cc:654] T 793c97394cd142e9b2f9a301b2698075 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.815367 11771 tablet_service.cc:1511] Processing CreateTablet for tablet de5865b982f344e29ffc3453ec63ad46 (DEFAULT_TABLE table=soft_deleted_table [id=e37c9278bfd544b0934775465c42347c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:17:55.817994 11771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de5865b982f344e29ffc3453ec63ad46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.818446 11987 raft_consensus.cc:515] T 3fa6178098a140f09c25be5cf185e48e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:55.824829 11987 leader_election.cc:290] T 3fa6178098a140f09c25be5cf185e48e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 1 election: Requested vote from peers 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031), 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253)
I20260709 13:17:55.830170 11987 raft_consensus.cc:493] T afbf296b986b46aa9283a2dfe0f8fc13 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.830689 11987 raft_consensus.cc:515] T afbf296b986b46aa9283a2dfe0f8fc13 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:55.831096 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa6178098a140f09c25be5cf185e48e" candidate_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9"
I20260709 13:17:55.831856 11856 raft_consensus.cc:3060] T 3fa6178098a140f09c25be5cf185e48e P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:55.833132 11987 leader_election.cc:290] T afbf296b986b46aa9283a2dfe0f8fc13 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031), 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253)
I20260709 13:17:55.837653 12001 tablet_bootstrap.cc:492] T 793c97394cd142e9b2f9a301b2698075 P 838a3115bb3b43aa9d133a9e2867cb1e: No bootstrap required, opened a new log
I20260709 13:17:55.838078 12000 tablet_bootstrap.cc:492] T 793c97394cd142e9b2f9a301b2698075 P 11579f7b06aa4eb4be4cd404f83aa8a9: No bootstrap required, opened a new log
I20260709 13:17:55.838277 12001 ts_tablet_manager.cc:1403] T 793c97394cd142e9b2f9a301b2698075 P 838a3115bb3b43aa9d133a9e2867cb1e: Time spent bootstrapping tablet: real 0.191s	user 0.014s	sys 0.009s
I20260709 13:17:55.838994 12000 ts_tablet_manager.cc:1403] T 793c97394cd142e9b2f9a301b2698075 P 11579f7b06aa4eb4be4cd404f83aa8a9: Time spent bootstrapping tablet: real 0.188s	user 0.022s	sys 0.022s
I20260709 13:17:55.852393 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afbf296b986b46aa9283a2dfe0f8fc13" candidate_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" is_pre_election: true
I20260709 13:17:55.856966 12000 raft_consensus.cc:359] T 793c97394cd142e9b2f9a301b2698075 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:55.857851 12000 raft_consensus.cc:385] T 793c97394cd142e9b2f9a301b2698075 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.858151 12000 raft_consensus.cc:740] T 793c97394cd142e9b2f9a301b2698075 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11579f7b06aa4eb4be4cd404f83aa8a9, State: Initialized, Role: FOLLOWER
W20260709 13:17:55.859454 11674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.194:37031, user_credentials={real_user=slave}} blocked reactor thread for 56258.9us
I20260709 13:17:55.860486 12001 raft_consensus.cc:359] T 793c97394cd142e9b2f9a301b2698075 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:55.861279 12001 raft_consensus.cc:385] T 793c97394cd142e9b2f9a301b2698075 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.861627 12001 raft_consensus.cc:740] T 793c97394cd142e9b2f9a301b2698075 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 838a3115bb3b43aa9d133a9e2867cb1e, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.858976 12000 consensus_queue.cc:260] T 793c97394cd142e9b2f9a301b2698075 P 11579f7b06aa4eb4be4cd404f83aa8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:55.862406 12001 consensus_queue.cc:260] T 793c97394cd142e9b2f9a301b2698075 P 838a3115bb3b43aa9d133a9e2867cb1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
W20260709 13:17:55.854496 11673 leader_election.cc:343] T afbf296b986b46aa9283a2dfe0f8fc13 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:55.864406 11782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa6178098a140f09c25be5cf185e48e" candidate_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "838a3115bb3b43aa9d133a9e2867cb1e"
I20260709 13:17:55.864763 12000 ts_tablet_manager.cc:1434] T 793c97394cd142e9b2f9a301b2698075 P 11579f7b06aa4eb4be4cd404f83aa8a9: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:17:55.864970 11782 raft_consensus.cc:3060] T 3fa6178098a140f09c25be5cf185e48e P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:55.868396 11781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afbf296b986b46aa9283a2dfe0f8fc13" candidate_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" is_pre_election: true
I20260709 13:17:55.872164 11856 raft_consensus.cc:2468] T 3fa6178098a140f09c25be5cf185e48e P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd7d1bb34ba477f8b4fb7fcf67b7126 in term 1.
I20260709 13:17:55.877609 11673 leader_election.cc:304] T 3fa6178098a140f09c25be5cf185e48e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11579f7b06aa4eb4be4cd404f83aa8a9, fcd7d1bb34ba477f8b4fb7fcf67b7126; no voters: 
I20260709 13:17:55.878609 12006 raft_consensus.cc:2804] T 3fa6178098a140f09c25be5cf185e48e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:55.879108 12006 raft_consensus.cc:697] T 3fa6178098a140f09c25be5cf185e48e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 LEADER]: Becoming Leader. State: Replica: fcd7d1bb34ba477f8b4fb7fcf67b7126, State: Running, Role: LEADER
I20260709 13:17:55.879999 12006 consensus_queue.cc:237] T 3fa6178098a140f09c25be5cf185e48e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:55.888072 11999 tablet_bootstrap.cc:492] T 793c97394cd142e9b2f9a301b2698075 P fcd7d1bb34ba477f8b4fb7fcf67b7126: No bootstrap required, opened a new log
I20260709 13:17:55.888718 11999 ts_tablet_manager.cc:1403] T 793c97394cd142e9b2f9a301b2698075 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Time spent bootstrapping tablet: real 0.136s	user 0.020s	sys 0.020s
I20260709 13:17:55.882907 11782 raft_consensus.cc:2468] T 3fa6178098a140f09c25be5cf185e48e P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd7d1bb34ba477f8b4fb7fcf67b7126 in term 1.
W20260709 13:17:55.893564 11674 leader_election.cc:343] T afbf296b986b46aa9283a2dfe0f8fc13 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:55.894193 12000 tablet_bootstrap.cc:492] T afbf296b986b46aa9283a2dfe0f8fc13 P 11579f7b06aa4eb4be4cd404f83aa8a9: Bootstrap starting.
I20260709 13:17:55.898653 11674 leader_election.cc:304] T afbf296b986b46aa9283a2dfe0f8fc13 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcd7d1bb34ba477f8b4fb7fcf67b7126; no voters: 11579f7b06aa4eb4be4cd404f83aa8a9, 838a3115bb3b43aa9d133a9e2867cb1e
I20260709 13:17:55.897650 12001 ts_tablet_manager.cc:1434] T 793c97394cd142e9b2f9a301b2698075 P 838a3115bb3b43aa9d133a9e2867cb1e: Time spent starting tablet: real 0.050s	user 0.002s	sys 0.005s
I20260709 13:17:55.905067 12013 raft_consensus.cc:2749] T afbf296b986b46aa9283a2dfe0f8fc13 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:55.908187 11999 raft_consensus.cc:359] T 793c97394cd142e9b2f9a301b2698075 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:55.909104 11999 raft_consensus.cc:385] T 793c97394cd142e9b2f9a301b2698075 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.909456 11999 raft_consensus.cc:740] T 793c97394cd142e9b2f9a301b2698075 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd7d1bb34ba477f8b4fb7fcf67b7126, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.910287 11999 consensus_queue.cc:260] T 793c97394cd142e9b2f9a301b2698075 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:55.912882 12000 tablet_bootstrap.cc:654] T afbf296b986b46aa9283a2dfe0f8fc13 P 11579f7b06aa4eb4be4cd404f83aa8a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.913036 11999 ts_tablet_manager.cc:1434] T 793c97394cd142e9b2f9a301b2698075 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.001s
I20260709 13:17:55.914193 11999 tablet_bootstrap.cc:492] T 033d9618f252438383673646b087b3e2 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Bootstrap starting.
I20260709 13:17:55.921726 11999 tablet_bootstrap.cc:654] T 033d9618f252438383673646b087b3e2 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.928087 12000 tablet_bootstrap.cc:492] T afbf296b986b46aa9283a2dfe0f8fc13 P 11579f7b06aa4eb4be4cd404f83aa8a9: No bootstrap required, opened a new log
I20260709 13:17:55.928687 12000 ts_tablet_manager.cc:1403] T afbf296b986b46aa9283a2dfe0f8fc13 P 11579f7b06aa4eb4be4cd404f83aa8a9: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.008s
I20260709 13:17:55.928946 12001 tablet_bootstrap.cc:492] T afbf296b986b46aa9283a2dfe0f8fc13 P 838a3115bb3b43aa9d133a9e2867cb1e: Bootstrap starting.
I20260709 13:17:55.932336 12000 raft_consensus.cc:359] T afbf296b986b46aa9283a2dfe0f8fc13 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:55.933112 12000 raft_consensus.cc:385] T afbf296b986b46aa9283a2dfe0f8fc13 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.933441 12000 raft_consensus.cc:740] T afbf296b986b46aa9283a2dfe0f8fc13 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11579f7b06aa4eb4be4cd404f83aa8a9, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.934535 11999 tablet_bootstrap.cc:492] T 033d9618f252438383673646b087b3e2 P fcd7d1bb34ba477f8b4fb7fcf67b7126: No bootstrap required, opened a new log
I20260709 13:17:55.934306 12000 consensus_queue.cc:260] T afbf296b986b46aa9283a2dfe0f8fc13 P 11579f7b06aa4eb4be4cd404f83aa8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:55.935194 11999 ts_tablet_manager.cc:1403] T 033d9618f252438383673646b087b3e2 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.007s
I20260709 13:17:55.937371 12001 tablet_bootstrap.cc:654] T afbf296b986b46aa9283a2dfe0f8fc13 P 838a3115bb3b43aa9d133a9e2867cb1e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.938802 11999 raft_consensus.cc:359] T 033d9618f252438383673646b087b3e2 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:55.939930 11999 raft_consensus.cc:385] T 033d9618f252438383673646b087b3e2 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.940243 11999 raft_consensus.cc:740] T 033d9618f252438383673646b087b3e2 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd7d1bb34ba477f8b4fb7fcf67b7126, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.939426 11605 catalog_manager.cc:5697] T 3fa6178098a140f09c25be5cf185e48e P fcd7d1bb34ba477f8b4fb7fcf67b7126 reported cstate change: term changed from 0 to 1, leader changed from <none> to fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:55.941560 11999 consensus_queue.cc:260] T 033d9618f252438383673646b087b3e2 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:55.945169 11999 ts_tablet_manager.cc:1434] T 033d9618f252438383673646b087b3e2 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 13:17:55.945741 12000 ts_tablet_manager.cc:1434] T afbf296b986b46aa9283a2dfe0f8fc13 P 11579f7b06aa4eb4be4cd404f83aa8a9: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.002s
I20260709 13:17:55.947814 11999 tablet_bootstrap.cc:492] T 9de688862796441d936411ed5e7c42e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Bootstrap starting.
I20260709 13:17:55.953750 12000 tablet_bootstrap.cc:492] T 10853738200240bb93ca91ed7d97566e P 11579f7b06aa4eb4be4cd404f83aa8a9: Bootstrap starting.
I20260709 13:17:55.961220 11999 tablet_bootstrap.cc:654] T 9de688862796441d936411ed5e7c42e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.967826 12000 tablet_bootstrap.cc:654] T 10853738200240bb93ca91ed7d97566e P 11579f7b06aa4eb4be4cd404f83aa8a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.969559 12001 tablet_bootstrap.cc:492] T afbf296b986b46aa9283a2dfe0f8fc13 P 838a3115bb3b43aa9d133a9e2867cb1e: No bootstrap required, opened a new log
I20260709 13:17:55.970111 12001 ts_tablet_manager.cc:1403] T afbf296b986b46aa9283a2dfe0f8fc13 P 838a3115bb3b43aa9d133a9e2867cb1e: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.025s
I20260709 13:17:55.973407 12001 raft_consensus.cc:359] T afbf296b986b46aa9283a2dfe0f8fc13 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:55.974270 12001 raft_consensus.cc:385] T afbf296b986b46aa9283a2dfe0f8fc13 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.974419 12000 tablet_bootstrap.cc:492] T 10853738200240bb93ca91ed7d97566e P 11579f7b06aa4eb4be4cd404f83aa8a9: No bootstrap required, opened a new log
I20260709 13:17:55.974650 12001 raft_consensus.cc:740] T afbf296b986b46aa9283a2dfe0f8fc13 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 838a3115bb3b43aa9d133a9e2867cb1e, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.975111 11999 tablet_bootstrap.cc:492] T 9de688862796441d936411ed5e7c42e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126: No bootstrap required, opened a new log
I20260709 13:17:55.975150 12000 ts_tablet_manager.cc:1403] T 10853738200240bb93ca91ed7d97566e P 11579f7b06aa4eb4be4cd404f83aa8a9: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.008s
I20260709 13:17:55.975829 11999 ts_tablet_manager.cc:1403] T 9de688862796441d936411ed5e7c42e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.008s
I20260709 13:17:55.975682 12001 consensus_queue.cc:260] T afbf296b986b46aa9283a2dfe0f8fc13 P 838a3115bb3b43aa9d133a9e2867cb1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:55.978404 12001 ts_tablet_manager.cc:1434] T afbf296b986b46aa9283a2dfe0f8fc13 P 838a3115bb3b43aa9d133a9e2867cb1e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:17:55.978510 12000 raft_consensus.cc:359] T 10853738200240bb93ca91ed7d97566e P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:55.979287 12000 raft_consensus.cc:385] T 10853738200240bb93ca91ed7d97566e P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.979607 12000 raft_consensus.cc:740] T 10853738200240bb93ca91ed7d97566e P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11579f7b06aa4eb4be4cd404f83aa8a9, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.979614 12001 tablet_bootstrap.cc:492] T 3a4cfaf3eb3649dda1cd4ec67714625c P 838a3115bb3b43aa9d133a9e2867cb1e: Bootstrap starting.
I20260709 13:17:55.979385 11999 raft_consensus.cc:359] T 9de688862796441d936411ed5e7c42e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:55.980335 11999 raft_consensus.cc:385] T 9de688862796441d936411ed5e7c42e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.980687 11999 raft_consensus.cc:740] T 9de688862796441d936411ed5e7c42e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd7d1bb34ba477f8b4fb7fcf67b7126, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.980567 12000 consensus_queue.cc:260] T 10853738200240bb93ca91ed7d97566e P 11579f7b06aa4eb4be4cd404f83aa8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:55.983162 12000 ts_tablet_manager.cc:1434] T 10853738200240bb93ca91ed7d97566e P 11579f7b06aa4eb4be4cd404f83aa8a9: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:17:55.984423 11999 consensus_queue.cc:260] T 9de688862796441d936411ed5e7c42e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:55.987125 11999 ts_tablet_manager.cc:1434] T 9de688862796441d936411ed5e7c42e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:17:55.988420 12000 tablet_bootstrap.cc:492] T 394623997b07477aa1f4616ad07fd3b5 P 11579f7b06aa4eb4be4cd404f83aa8a9: Bootstrap starting.
I20260709 13:17:55.988508 12001 tablet_bootstrap.cc:654] T 3a4cfaf3eb3649dda1cd4ec67714625c P 838a3115bb3b43aa9d133a9e2867cb1e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.991731 11999 tablet_bootstrap.cc:492] T 10853738200240bb93ca91ed7d97566e P fcd7d1bb34ba477f8b4fb7fcf67b7126: Bootstrap starting.
I20260709 13:17:56.001040 12000 tablet_bootstrap.cc:654] T 394623997b07477aa1f4616ad07fd3b5 P 11579f7b06aa4eb4be4cd404f83aa8a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:56.002246 11999 tablet_bootstrap.cc:654] T 10853738200240bb93ca91ed7d97566e P fcd7d1bb34ba477f8b4fb7fcf67b7126: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:56.015832 12001 tablet_bootstrap.cc:492] T 3a4cfaf3eb3649dda1cd4ec67714625c P 838a3115bb3b43aa9d133a9e2867cb1e: No bootstrap required, opened a new log
I20260709 13:17:56.016450 11999 tablet_bootstrap.cc:492] T 10853738200240bb93ca91ed7d97566e P fcd7d1bb34ba477f8b4fb7fcf67b7126: No bootstrap required, opened a new log
I20260709 13:17:56.016475 12001 ts_tablet_manager.cc:1403] T 3a4cfaf3eb3649dda1cd4ec67714625c P 838a3115bb3b43aa9d133a9e2867cb1e: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.026s
I20260709 13:17:56.017392 11999 ts_tablet_manager.cc:1403] T 10853738200240bb93ca91ed7d97566e P fcd7d1bb34ba477f8b4fb7fcf67b7126: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.006s
I20260709 13:17:56.020766 12000 tablet_bootstrap.cc:492] T 394623997b07477aa1f4616ad07fd3b5 P 11579f7b06aa4eb4be4cd404f83aa8a9: No bootstrap required, opened a new log
I20260709 13:17:56.021458 12000 ts_tablet_manager.cc:1403] T 394623997b07477aa1f4616ad07fd3b5 P 11579f7b06aa4eb4be4cd404f83aa8a9: Time spent bootstrapping tablet: real 0.037s	user 0.006s	sys 0.014s
I20260709 13:17:56.021093 11999 raft_consensus.cc:359] T 10853738200240bb93ca91ed7d97566e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.021958 11999 raft_consensus.cc:385] T 10853738200240bb93ca91ed7d97566e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:56.022313 11999 raft_consensus.cc:740] T 10853738200240bb93ca91ed7d97566e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd7d1bb34ba477f8b4fb7fcf67b7126, State: Initialized, Role: FOLLOWER
I20260709 13:17:56.022939 12001 raft_consensus.cc:359] T 3a4cfaf3eb3649dda1cd4ec67714625c P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.023280 11999 consensus_queue.cc:260] T 10853738200240bb93ca91ed7d97566e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.023953 12001 raft_consensus.cc:385] T 3a4cfaf3eb3649dda1cd4ec67714625c P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:56.024361 12001 raft_consensus.cc:740] T 3a4cfaf3eb3649dda1cd4ec67714625c P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 838a3115bb3b43aa9d133a9e2867cb1e, State: Initialized, Role: FOLLOWER
I20260709 13:17:56.025326 12000 raft_consensus.cc:359] T 394623997b07477aa1f4616ad07fd3b5 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.026132 11999 ts_tablet_manager.cc:1434] T 10853738200240bb93ca91ed7d97566e P fcd7d1bb34ba477f8b4fb7fcf67b7126: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:17:56.026144 12000 raft_consensus.cc:385] T 394623997b07477aa1f4616ad07fd3b5 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:56.026933 12000 raft_consensus.cc:740] T 394623997b07477aa1f4616ad07fd3b5 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11579f7b06aa4eb4be4cd404f83aa8a9, State: Initialized, Role: FOLLOWER
I20260709 13:17:56.026671 12001 consensus_queue.cc:260] T 3a4cfaf3eb3649dda1cd4ec67714625c P 838a3115bb3b43aa9d133a9e2867cb1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.028477 12000 consensus_queue.cc:260] T 394623997b07477aa1f4616ad07fd3b5 P 11579f7b06aa4eb4be4cd404f83aa8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.029464 12001 ts_tablet_manager.cc:1434] T 3a4cfaf3eb3649dda1cd4ec67714625c P 838a3115bb3b43aa9d133a9e2867cb1e: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:17:56.030104 11999 tablet_bootstrap.cc:492] T 3a4cfaf3eb3649dda1cd4ec67714625c P fcd7d1bb34ba477f8b4fb7fcf67b7126: Bootstrap starting.
I20260709 13:17:56.033779 12001 tablet_bootstrap.cc:492] T 033d9618f252438383673646b087b3e2 P 838a3115bb3b43aa9d133a9e2867cb1e: Bootstrap starting.
I20260709 13:17:56.036976 11999 tablet_bootstrap.cc:654] T 3a4cfaf3eb3649dda1cd4ec67714625c P fcd7d1bb34ba477f8b4fb7fcf67b7126: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:56.039002 12000 ts_tablet_manager.cc:1434] T 394623997b07477aa1f4616ad07fd3b5 P 11579f7b06aa4eb4be4cd404f83aa8a9: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:17:56.040428 12000 tablet_bootstrap.cc:492] T 033d9618f252438383673646b087b3e2 P 11579f7b06aa4eb4be4cd404f83aa8a9: Bootstrap starting.
I20260709 13:17:56.041966 12001 tablet_bootstrap.cc:654] T 033d9618f252438383673646b087b3e2 P 838a3115bb3b43aa9d133a9e2867cb1e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:56.043798 11969 raft_consensus.cc:493] T 394623997b07477aa1f4616ad07fd3b5 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.044354 11969 raft_consensus.cc:515] T 394623997b07477aa1f4616ad07fd3b5 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.046761 11969 leader_election.cc:290] T 394623997b07477aa1f4616ad07fd3b5 P 11579f7b06aa4eb4be4cd404f83aa8a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193:39519), 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031)
I20260709 13:17:56.051218 11707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394623997b07477aa1f4616ad07fd3b5" candidate_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" is_pre_election: true
I20260709 13:17:56.051489 11782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394623997b07477aa1f4616ad07fd3b5" candidate_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" is_pre_election: true
W20260709 13:17:56.055516 11823 leader_election.cc:343] T 394623997b07477aa1f4616ad07fd3b5 P 11579f7b06aa4eb4be4cd404f83aa8a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:56.056622 11823 leader_election.cc:343] T 394623997b07477aa1f4616ad07fd3b5 P 11579f7b06aa4eb4be4cd404f83aa8a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193:39519): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:56.057063 11823 leader_election.cc:304] T 394623997b07477aa1f4616ad07fd3b5 P 11579f7b06aa4eb4be4cd404f83aa8a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11579f7b06aa4eb4be4cd404f83aa8a9; no voters: 838a3115bb3b43aa9d133a9e2867cb1e, fcd7d1bb34ba477f8b4fb7fcf67b7126
I20260709 13:17:56.058430 11969 raft_consensus.cc:2749] T 394623997b07477aa1f4616ad07fd3b5 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:56.061908 11943 raft_consensus.cc:493] T afbf296b986b46aa9283a2dfe0f8fc13 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.062565 11943 raft_consensus.cc:515] T afbf296b986b46aa9283a2dfe0f8fc13 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.064914 12000 tablet_bootstrap.cc:654] T 033d9618f252438383673646b087b3e2 P 11579f7b06aa4eb4be4cd404f83aa8a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:56.065551 11943 leader_election.cc:290] T afbf296b986b46aa9283a2dfe0f8fc13 P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193:39519), 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253)
I20260709 13:17:56.066267 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afbf296b986b46aa9283a2dfe0f8fc13" candidate_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" is_pre_election: true
I20260709 13:17:56.067014 11856 raft_consensus.cc:2468] T afbf296b986b46aa9283a2dfe0f8fc13 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 838a3115bb3b43aa9d133a9e2867cb1e in term 0.
I20260709 13:17:56.067437 11707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afbf296b986b46aa9283a2dfe0f8fc13" candidate_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" is_pre_election: true
I20260709 13:17:56.068441 11748 leader_election.cc:304] T afbf296b986b46aa9283a2dfe0f8fc13 P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11579f7b06aa4eb4be4cd404f83aa8a9, 838a3115bb3b43aa9d133a9e2867cb1e; no voters: 
I20260709 13:17:56.068442 11707 raft_consensus.cc:2468] T afbf296b986b46aa9283a2dfe0f8fc13 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 838a3115bb3b43aa9d133a9e2867cb1e in term 0.
I20260709 13:17:56.071141 11943 raft_consensus.cc:2804] T afbf296b986b46aa9283a2dfe0f8fc13 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:56.073164 11943 raft_consensus.cc:493] T afbf296b986b46aa9283a2dfe0f8fc13 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.073532 11943 raft_consensus.cc:3060] T afbf296b986b46aa9283a2dfe0f8fc13 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.079214 12001 tablet_bootstrap.cc:492] T 033d9618f252438383673646b087b3e2 P 838a3115bb3b43aa9d133a9e2867cb1e: No bootstrap required, opened a new log
I20260709 13:17:56.080472 12001 ts_tablet_manager.cc:1403] T 033d9618f252438383673646b087b3e2 P 838a3115bb3b43aa9d133a9e2867cb1e: Time spent bootstrapping tablet: real 0.047s	user 0.017s	sys 0.020s
I20260709 13:17:56.081216 11999 tablet_bootstrap.cc:492] T 3a4cfaf3eb3649dda1cd4ec67714625c P fcd7d1bb34ba477f8b4fb7fcf67b7126: No bootstrap required, opened a new log
I20260709 13:17:56.081874 11999 ts_tablet_manager.cc:1403] T 3a4cfaf3eb3649dda1cd4ec67714625c P fcd7d1bb34ba477f8b4fb7fcf67b7126: Time spent bootstrapping tablet: real 0.053s	user 0.024s	sys 0.018s
I20260709 13:17:56.083972 11943 raft_consensus.cc:515] T afbf296b986b46aa9283a2dfe0f8fc13 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.084800 12001 raft_consensus.cc:359] T 033d9618f252438383673646b087b3e2 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.085227 11999 raft_consensus.cc:359] T 3a4cfaf3eb3649dda1cd4ec67714625c P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.085851 12001 raft_consensus.cc:385] T 033d9618f252438383673646b087b3e2 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:56.086181 11999 raft_consensus.cc:385] T 3a4cfaf3eb3649dda1cd4ec67714625c P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:56.086362 12001 raft_consensus.cc:740] T 033d9618f252438383673646b087b3e2 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 838a3115bb3b43aa9d133a9e2867cb1e, State: Initialized, Role: FOLLOWER
I20260709 13:17:56.086786 11999 raft_consensus.cc:740] T 3a4cfaf3eb3649dda1cd4ec67714625c P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd7d1bb34ba477f8b4fb7fcf67b7126, State: Initialized, Role: FOLLOWER
I20260709 13:17:56.087239 11707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afbf296b986b46aa9283a2dfe0f8fc13" candidate_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126"
I20260709 13:17:56.087939 11707 raft_consensus.cc:3060] T afbf296b986b46aa9283a2dfe0f8fc13 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.087594 12001 consensus_queue.cc:260] T 033d9618f252438383673646b087b3e2 P 838a3115bb3b43aa9d133a9e2867cb1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.090834 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afbf296b986b46aa9283a2dfe0f8fc13" candidate_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9"
I20260709 13:17:56.091532 11856 raft_consensus.cc:3060] T afbf296b986b46aa9283a2dfe0f8fc13 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.087965 11999 consensus_queue.cc:260] T 3a4cfaf3eb3649dda1cd4ec67714625c P fcd7d1bb34ba477f8b4fb7fcf67b7126 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.092932 12001 ts_tablet_manager.cc:1434] T 033d9618f252438383673646b087b3e2 P 838a3115bb3b43aa9d133a9e2867cb1e: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:17:56.093914 11999 ts_tablet_manager.cc:1434] T 3a4cfaf3eb3649dda1cd4ec67714625c P fcd7d1bb34ba477f8b4fb7fcf67b7126: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:17:56.094074 12001 tablet_bootstrap.cc:492] T 394623997b07477aa1f4616ad07fd3b5 P 838a3115bb3b43aa9d133a9e2867cb1e: Bootstrap starting.
I20260709 13:17:56.097483 11999 tablet_bootstrap.cc:492] T 394623997b07477aa1f4616ad07fd3b5 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Bootstrap starting.
I20260709 13:17:56.098717 12009 raft_consensus.cc:493] T 3a4cfaf3eb3649dda1cd4ec67714625c P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.099265 12009 raft_consensus.cc:515] T 3a4cfaf3eb3649dda1cd4ec67714625c P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.101526 12009 leader_election.cc:290] T 3a4cfaf3eb3649dda1cd4ec67714625c P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193:39519), 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253)
I20260709 13:17:56.090785 12000 tablet_bootstrap.cc:492] T 033d9618f252438383673646b087b3e2 P 11579f7b06aa4eb4be4cd404f83aa8a9: No bootstrap required, opened a new log
I20260709 13:17:56.102738 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4cfaf3eb3649dda1cd4ec67714625c" candidate_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" is_pre_election: true
I20260709 13:17:56.103288 11708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4cfaf3eb3649dda1cd4ec67714625c" candidate_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" is_pre_election: true
I20260709 13:17:56.104065 11708 raft_consensus.cc:2468] T 3a4cfaf3eb3649dda1cd4ec67714625c P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 838a3115bb3b43aa9d133a9e2867cb1e in term 0.
W20260709 13:17:56.104472 11748 leader_election.cc:343] T 3a4cfaf3eb3649dda1cd4ec67714625c P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:56.104861 12001 tablet_bootstrap.cc:654] T 394623997b07477aa1f4616ad07fd3b5 P 838a3115bb3b43aa9d133a9e2867cb1e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:56.105544 11856 raft_consensus.cc:2468] T afbf296b986b46aa9283a2dfe0f8fc13 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 838a3115bb3b43aa9d133a9e2867cb1e in term 1.
I20260709 13:17:56.106670 11999 tablet_bootstrap.cc:654] T 394623997b07477aa1f4616ad07fd3b5 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:56.109134 11969 raft_consensus.cc:493] T 10853738200240bb93ca91ed7d97566e P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.106992 12000 ts_tablet_manager.cc:1403] T 033d9618f252438383673646b087b3e2 P 11579f7b06aa4eb4be4cd404f83aa8a9: Time spent bootstrapping tablet: real 0.067s	user 0.011s	sys 0.011s
I20260709 13:17:56.090929 11943 leader_election.cc:290] T afbf296b986b46aa9283a2dfe0f8fc13 P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 1 election: Requested vote from peers fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193:39519), 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253)
I20260709 13:17:56.109288 11749 leader_election.cc:304] T 3a4cfaf3eb3649dda1cd4ec67714625c P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 838a3115bb3b43aa9d133a9e2867cb1e, fcd7d1bb34ba477f8b4fb7fcf67b7126; no voters: 11579f7b06aa4eb4be4cd404f83aa8a9
I20260709 13:17:56.111363 11748 leader_election.cc:304] T afbf296b986b46aa9283a2dfe0f8fc13 P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11579f7b06aa4eb4be4cd404f83aa8a9, 838a3115bb3b43aa9d133a9e2867cb1e; no voters: 
I20260709 13:17:56.112350 12009 raft_consensus.cc:2804] T 3a4cfaf3eb3649dda1cd4ec67714625c P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:56.109848 11969 raft_consensus.cc:515] T 10853738200240bb93ca91ed7d97566e P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.112752 12009 raft_consensus.cc:493] T 3a4cfaf3eb3649dda1cd4ec67714625c P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.113152 12009 raft_consensus.cc:3060] T 3a4cfaf3eb3649dda1cd4ec67714625c P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.114542 11969 leader_election.cc:290] T 10853738200240bb93ca91ed7d97566e P 11579f7b06aa4eb4be4cd404f83aa8a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193:39519), 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031)
I20260709 13:17:56.117079 11782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10853738200240bb93ca91ed7d97566e" candidate_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" is_pre_election: true
I20260709 13:17:56.110884 12006 raft_consensus.cc:493] T 793c97394cd142e9b2f9a301b2698075 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.118593 12006 raft_consensus.cc:515] T 793c97394cd142e9b2f9a301b2698075 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.118650 12000 raft_consensus.cc:359] T 033d9618f252438383673646b087b3e2 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
W20260709 13:17:56.119851 11823 leader_election.cc:343] T 10853738200240bb93ca91ed7d97566e P 11579f7b06aa4eb4be4cd404f83aa8a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:56.119891 12000 raft_consensus.cc:385] T 033d9618f252438383673646b087b3e2 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:56.120709 12000 raft_consensus.cc:740] T 033d9618f252438383673646b087b3e2 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11579f7b06aa4eb4be4cd404f83aa8a9, State: Initialized, Role: FOLLOWER
I20260709 13:17:56.121989 12000 consensus_queue.cc:260] T 033d9618f252438383673646b087b3e2 P 11579f7b06aa4eb4be4cd404f83aa8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.122558 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793c97394cd142e9b2f9a301b2698075" candidate_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" is_pre_election: true
I20260709 13:17:56.120940 12006 leader_election.cc:290] T 793c97394cd142e9b2f9a301b2698075 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031), 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253)
I20260709 13:17:56.123157 11781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793c97394cd142e9b2f9a301b2698075" candidate_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" is_pre_election: true
I20260709 13:17:56.123463 11856 raft_consensus.cc:2468] T 793c97394cd142e9b2f9a301b2698075 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd7d1bb34ba477f8b4fb7fcf67b7126 in term 0.
I20260709 13:17:56.123915 11781 raft_consensus.cc:2468] T 793c97394cd142e9b2f9a301b2698075 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd7d1bb34ba477f8b4fb7fcf67b7126 in term 0.
I20260709 13:17:56.124953 11999 tablet_bootstrap.cc:492] T 394623997b07477aa1f4616ad07fd3b5 P fcd7d1bb34ba477f8b4fb7fcf67b7126: No bootstrap required, opened a new log
I20260709 13:17:56.124977 11673 leader_election.cc:304] T 793c97394cd142e9b2f9a301b2698075 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11579f7b06aa4eb4be4cd404f83aa8a9, fcd7d1bb34ba477f8b4fb7fcf67b7126; no voters: 
I20260709 13:17:56.125808 11999 ts_tablet_manager.cc:1403] T 394623997b07477aa1f4616ad07fd3b5 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.000s
I20260709 13:17:56.126559 12013 raft_consensus.cc:493] T 033d9618f252438383673646b087b3e2 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.127063 12013 raft_consensus.cc:515] T 033d9618f252438383673646b087b3e2 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.129339 12013 leader_election.cc:290] T 033d9618f252438383673646b087b3e2 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031), 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253)
I20260709 13:17:56.129107 11999 raft_consensus.cc:359] T 394623997b07477aa1f4616ad07fd3b5 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.129866 11999 raft_consensus.cc:385] T 394623997b07477aa1f4616ad07fd3b5 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:56.130178 11999 raft_consensus.cc:740] T 394623997b07477aa1f4616ad07fd3b5 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd7d1bb34ba477f8b4fb7fcf67b7126, State: Initialized, Role: FOLLOWER
I20260709 13:17:56.120997 11708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10853738200240bb93ca91ed7d97566e" candidate_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" is_pre_election: true
I20260709 13:17:56.131022 11708 raft_consensus.cc:2468] T 10853738200240bb93ca91ed7d97566e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11579f7b06aa4eb4be4cd404f83aa8a9 in term 0.
I20260709 13:17:56.130916 11999 consensus_queue.cc:260] T 394623997b07477aa1f4616ad07fd3b5 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.131234 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033d9618f252438383673646b087b3e2" candidate_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" is_pre_election: true
I20260709 13:17:56.132542 11823 leader_election.cc:304] T 10853738200240bb93ca91ed7d97566e P 11579f7b06aa4eb4be4cd404f83aa8a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11579f7b06aa4eb4be4cd404f83aa8a9, fcd7d1bb34ba477f8b4fb7fcf67b7126; no voters: 838a3115bb3b43aa9d133a9e2867cb1e
I20260709 13:17:56.129880 12013 raft_consensus.cc:2804] T 793c97394cd142e9b2f9a301b2698075 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:56.133342 11999 ts_tablet_manager.cc:1434] T 394623997b07477aa1f4616ad07fd3b5 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:17:56.133142 11781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033d9618f252438383673646b087b3e2" candidate_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" is_pre_election: true
I20260709 13:17:56.133740 12013 raft_consensus.cc:493] T 793c97394cd142e9b2f9a301b2698075 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.133828 11969 raft_consensus.cc:2804] T 10853738200240bb93ca91ed7d97566e P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:56.134199 12013 raft_consensus.cc:3060] T 793c97394cd142e9b2f9a301b2698075 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.134466 11999 tablet_bootstrap.cc:492] T de5865b982f344e29ffc3453ec63ad46 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Bootstrap starting.
I20260709 13:17:56.134341 11969 raft_consensus.cc:493] T 10853738200240bb93ca91ed7d97566e P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.136972 11969 raft_consensus.cc:3060] T 10853738200240bb93ca91ed7d97566e P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.138839 11857 raft_consensus.cc:2468] T 033d9618f252438383673646b087b3e2 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd7d1bb34ba477f8b4fb7fcf67b7126 in term 0.
I20260709 13:17:56.133973 11781 raft_consensus.cc:2468] T 033d9618f252438383673646b087b3e2 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd7d1bb34ba477f8b4fb7fcf67b7126 in term 0.
I20260709 13:17:56.141067 11674 leader_election.cc:304] T 033d9618f252438383673646b087b3e2 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 838a3115bb3b43aa9d133a9e2867cb1e, fcd7d1bb34ba477f8b4fb7fcf67b7126; no voters: 
I20260709 13:17:56.142153 12006 raft_consensus.cc:2804] T 033d9618f252438383673646b087b3e2 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:56.142546 12006 raft_consensus.cc:493] T 033d9618f252438383673646b087b3e2 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.142915 12006 raft_consensus.cc:3060] T 033d9618f252438383673646b087b3e2 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.144066 11943 raft_consensus.cc:2804] T afbf296b986b46aa9283a2dfe0f8fc13 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:56.147809 11707 raft_consensus.cc:2468] T afbf296b986b46aa9283a2dfe0f8fc13 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 838a3115bb3b43aa9d133a9e2867cb1e in term 1.
I20260709 13:17:56.152869 11943 raft_consensus.cc:697] T afbf296b986b46aa9283a2dfe0f8fc13 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 LEADER]: Becoming Leader. State: Replica: 838a3115bb3b43aa9d133a9e2867cb1e, State: Running, Role: LEADER
I20260709 13:17:56.147341 11999 tablet_bootstrap.cc:654] T de5865b982f344e29ffc3453ec63ad46 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:56.153942 11943 consensus_queue.cc:237] T afbf296b986b46aa9283a2dfe0f8fc13 P 838a3115bb3b43aa9d133a9e2867cb1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.151295 11969 raft_consensus.cc:515] T 10853738200240bb93ca91ed7d97566e P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.162094 11707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10853738200240bb93ca91ed7d97566e" candidate_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126"
I20260709 13:17:56.164265 11707 raft_consensus.cc:3060] T 10853738200240bb93ca91ed7d97566e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.166950 11781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10853738200240bb93ca91ed7d97566e" candidate_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "838a3115bb3b43aa9d133a9e2867cb1e"
I20260709 13:17:56.168217 12000 ts_tablet_manager.cc:1434] T 033d9618f252438383673646b087b3e2 P 11579f7b06aa4eb4be4cd404f83aa8a9: Time spent starting tablet: real 0.058s	user 0.013s	sys 0.000s
W20260709 13:17:56.168572 11823 leader_election.cc:343] T 10853738200240bb93ca91ed7d97566e P 11579f7b06aa4eb4be4cd404f83aa8a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:56.169894 12000 tablet_bootstrap.cc:492] T 9de688862796441d936411ed5e7c42e1 P 11579f7b06aa4eb4be4cd404f83aa8a9: Bootstrap starting.
I20260709 13:17:56.172156 12009 raft_consensus.cc:515] T 3a4cfaf3eb3649dda1cd4ec67714625c P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.173523 12013 raft_consensus.cc:515] T 793c97394cd142e9b2f9a301b2698075 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.177887 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4cfaf3eb3649dda1cd4ec67714625c" candidate_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9"
I20260709 13:17:56.151300 12006 raft_consensus.cc:515] T 033d9618f252438383673646b087b3e2 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.175952 11708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4cfaf3eb3649dda1cd4ec67714625c" candidate_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126"
I20260709 13:17:56.179294 11708 raft_consensus.cc:3060] T 3a4cfaf3eb3649dda1cd4ec67714625c P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:56.179527 11748 leader_election.cc:343] T 3a4cfaf3eb3649dda1cd4ec67714625c P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:56.183048 11781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793c97394cd142e9b2f9a301b2698075" candidate_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "838a3115bb3b43aa9d133a9e2867cb1e"
I20260709 13:17:56.183733 11781 raft_consensus.cc:3060] T 793c97394cd142e9b2f9a301b2698075 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.185096 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793c97394cd142e9b2f9a301b2698075" candidate_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9"
I20260709 13:17:56.185748 11857 raft_consensus.cc:3060] T 793c97394cd142e9b2f9a301b2698075 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.207484 11782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033d9618f252438383673646b087b3e2" candidate_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "838a3115bb3b43aa9d133a9e2867cb1e"
I20260709 13:17:56.208424 11782 raft_consensus.cc:3060] T 033d9618f252438383673646b087b3e2 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.183043 12013 leader_election.cc:290] T 793c97394cd142e9b2f9a301b2698075 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 1 election: Requested vote from peers 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031), 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253)
I20260709 13:17:56.220567 12009 leader_election.cc:290] T 3a4cfaf3eb3649dda1cd4ec67714625c P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 1 election: Requested vote from peers fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193:39519), 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253)
I20260709 13:17:56.222515 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033d9618f252438383673646b087b3e2" candidate_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9"
I20260709 13:17:56.223266 11856 raft_consensus.cc:3060] T 033d9618f252438383673646b087b3e2 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.224941 11999 tablet_bootstrap.cc:492] T de5865b982f344e29ffc3453ec63ad46 P fcd7d1bb34ba477f8b4fb7fcf67b7126: No bootstrap required, opened a new log
I20260709 13:17:56.225525 11999 ts_tablet_manager.cc:1403] T de5865b982f344e29ffc3453ec63ad46 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Time spent bootstrapping tablet: real 0.091s	user 0.023s	sys 0.010s
I20260709 13:17:56.229511 11999 raft_consensus.cc:359] T de5865b982f344e29ffc3453ec63ad46 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.230505 11999 raft_consensus.cc:385] T de5865b982f344e29ffc3453ec63ad46 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:56.230859 11999 raft_consensus.cc:740] T de5865b982f344e29ffc3453ec63ad46 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd7d1bb34ba477f8b4fb7fcf67b7126, State: Initialized, Role: FOLLOWER
I20260709 13:17:56.232548 11969 leader_election.cc:290] T 10853738200240bb93ca91ed7d97566e P 11579f7b06aa4eb4be4cd404f83aa8a9 [CANDIDATE]: Term 1 election: Requested vote from peers fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193:39519), 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031)
I20260709 13:17:56.235951 12000 tablet_bootstrap.cc:654] T 9de688862796441d936411ed5e7c42e1 P 11579f7b06aa4eb4be4cd404f83aa8a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:56.234362 11856 raft_consensus.cc:2468] T 033d9618f252438383673646b087b3e2 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd7d1bb34ba477f8b4fb7fcf67b7126 in term 1.
I20260709 13:17:56.233868 11603 catalog_manager.cc:5697] T afbf296b986b46aa9283a2dfe0f8fc13 P 838a3115bb3b43aa9d133a9e2867cb1e reported cstate change: term changed from 0 to 1, leader changed from <none> to 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194). New cstate: current_term: 1 leader_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:56.236919 11999 consensus_queue.cc:260] T de5865b982f344e29ffc3453ec63ad46 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.238627 11673 leader_election.cc:304] T 033d9618f252438383673646b087b3e2 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11579f7b06aa4eb4be4cd404f83aa8a9, fcd7d1bb34ba477f8b4fb7fcf67b7126; no voters: 
I20260709 13:17:56.240823 12008 raft_consensus.cc:2804] T 033d9618f252438383673646b087b3e2 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:56.241474 12008 raft_consensus.cc:697] T 033d9618f252438383673646b087b3e2 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 LEADER]: Becoming Leader. State: Replica: fcd7d1bb34ba477f8b4fb7fcf67b7126, State: Running, Role: LEADER
I20260709 13:17:56.242620 12008 consensus_queue.cc:237] T 033d9618f252438383673646b087b3e2 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.232411 11782 raft_consensus.cc:2468] T 033d9618f252438383673646b087b3e2 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd7d1bb34ba477f8b4fb7fcf67b7126 in term 1.
I20260709 13:17:56.236979 12001 tablet_bootstrap.cc:492] T 394623997b07477aa1f4616ad07fd3b5 P 838a3115bb3b43aa9d133a9e2867cb1e: No bootstrap required, opened a new log
I20260709 13:17:56.250522 12001 ts_tablet_manager.cc:1403] T 394623997b07477aa1f4616ad07fd3b5 P 838a3115bb3b43aa9d133a9e2867cb1e: Time spent bootstrapping tablet: real 0.157s	user 0.033s	sys 0.060s
I20260709 13:17:56.234480 12006 leader_election.cc:290] T 033d9618f252438383673646b087b3e2 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 1 election: Requested vote from peers 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031), 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253)
I20260709 13:17:56.254484 11999 ts_tablet_manager.cc:1434] T de5865b982f344e29ffc3453ec63ad46 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.001s
I20260709 13:17:56.255932 12001 raft_consensus.cc:359] T 394623997b07477aa1f4616ad07fd3b5 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.257031 12001 raft_consensus.cc:385] T 394623997b07477aa1f4616ad07fd3b5 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:56.257395 12001 raft_consensus.cc:740] T 394623997b07477aa1f4616ad07fd3b5 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 838a3115bb3b43aa9d133a9e2867cb1e, State: Initialized, Role: FOLLOWER
I20260709 13:17:56.258219 12001 consensus_queue.cc:260] T 394623997b07477aa1f4616ad07fd3b5 P 838a3115bb3b43aa9d133a9e2867cb1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.249457 11707 raft_consensus.cc:2468] T 10853738200240bb93ca91ed7d97566e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11579f7b06aa4eb4be4cd404f83aa8a9 in term 1.
I20260709 13:17:56.260231 11823 leader_election.cc:304] T 10853738200240bb93ca91ed7d97566e P 11579f7b06aa4eb4be4cd404f83aa8a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11579f7b06aa4eb4be4cd404f83aa8a9, fcd7d1bb34ba477f8b4fb7fcf67b7126; no voters: 838a3115bb3b43aa9d133a9e2867cb1e
I20260709 13:17:56.262224 11969 raft_consensus.cc:2804] T 10853738200240bb93ca91ed7d97566e P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:56.262722 11969 raft_consensus.cc:697] T 10853738200240bb93ca91ed7d97566e P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 LEADER]: Becoming Leader. State: Replica: 11579f7b06aa4eb4be4cd404f83aa8a9, State: Running, Role: LEADER
I20260709 13:17:56.263640 11969 consensus_queue.cc:237] T 10853738200240bb93ca91ed7d97566e P 11579f7b06aa4eb4be4cd404f83aa8a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.269562 12001 ts_tablet_manager.cc:1434] T 394623997b07477aa1f4616ad07fd3b5 P 838a3115bb3b43aa9d133a9e2867cb1e: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.002s
I20260709 13:17:56.271118 12001 tablet_bootstrap.cc:492] T 10853738200240bb93ca91ed7d97566e P 838a3115bb3b43aa9d133a9e2867cb1e: Bootstrap starting.
I20260709 13:17:56.279495 12001 tablet_bootstrap.cc:654] T 10853738200240bb93ca91ed7d97566e P 838a3115bb3b43aa9d133a9e2867cb1e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:56.278636 11602 catalog_manager.cc:5697] T 10853738200240bb93ca91ed7d97566e P 11579f7b06aa4eb4be4cd404f83aa8a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195). New cstate: current_term: 1 leader_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:56.286924 12000 tablet_bootstrap.cc:492] T 9de688862796441d936411ed5e7c42e1 P 11579f7b06aa4eb4be4cd404f83aa8a9: No bootstrap required, opened a new log
I20260709 13:17:56.287483 12000 ts_tablet_manager.cc:1403] T 9de688862796441d936411ed5e7c42e1 P 11579f7b06aa4eb4be4cd404f83aa8a9: Time spent bootstrapping tablet: real 0.118s	user 0.043s	sys 0.029s
I20260709 13:17:56.287866 12001 tablet_bootstrap.cc:492] T 10853738200240bb93ca91ed7d97566e P 838a3115bb3b43aa9d133a9e2867cb1e: No bootstrap required, opened a new log
I20260709 13:17:56.288494 12001 ts_tablet_manager.cc:1403] T 10853738200240bb93ca91ed7d97566e P 838a3115bb3b43aa9d133a9e2867cb1e: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.002s
I20260709 13:17:56.291026 12000 raft_consensus.cc:359] T 9de688862796441d936411ed5e7c42e1 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.291923 12000 raft_consensus.cc:385] T 9de688862796441d936411ed5e7c42e1 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:56.291747 12001 raft_consensus.cc:359] T 10853738200240bb93ca91ed7d97566e P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.292279 12000 raft_consensus.cc:740] T 9de688862796441d936411ed5e7c42e1 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11579f7b06aa4eb4be4cd404f83aa8a9, State: Initialized, Role: FOLLOWER
I20260709 13:17:56.292651 12001 raft_consensus.cc:385] T 10853738200240bb93ca91ed7d97566e P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:56.293095 12001 raft_consensus.cc:740] T 10853738200240bb93ca91ed7d97566e P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 838a3115bb3b43aa9d133a9e2867cb1e, State: Initialized, Role: FOLLOWER
I20260709 13:17:56.293162 12000 consensus_queue.cc:260] T 9de688862796441d936411ed5e7c42e1 P 11579f7b06aa4eb4be4cd404f83aa8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.294739 12001 consensus_queue.cc:260] T 10853738200240bb93ca91ed7d97566e P 838a3115bb3b43aa9d133a9e2867cb1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.296815 12000 ts_tablet_manager.cc:1434] T 9de688862796441d936411ed5e7c42e1 P 11579f7b06aa4eb4be4cd404f83aa8a9: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:17:56.297250 12001 ts_tablet_manager.cc:1434] T 10853738200240bb93ca91ed7d97566e P 838a3115bb3b43aa9d133a9e2867cb1e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:17:56.297291 11708 raft_consensus.cc:2468] T 3a4cfaf3eb3649dda1cd4ec67714625c P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 838a3115bb3b43aa9d133a9e2867cb1e in term 1.
I20260709 13:17:56.297977 12000 tablet_bootstrap.cc:492] T 3a4cfaf3eb3649dda1cd4ec67714625c P 11579f7b06aa4eb4be4cd404f83aa8a9: Bootstrap starting.
I20260709 13:17:56.290823 11604 catalog_manager.cc:5697] T 033d9618f252438383673646b087b3e2 P fcd7d1bb34ba477f8b4fb7fcf67b7126 reported cstate change: term changed from 0 to 1, leader changed from <none> to fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:56.299095 11781 raft_consensus.cc:2468] T 793c97394cd142e9b2f9a301b2698075 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd7d1bb34ba477f8b4fb7fcf67b7126 in term 1.
I20260709 13:17:56.298324 12001 tablet_bootstrap.cc:492] T de5865b982f344e29ffc3453ec63ad46 P 838a3115bb3b43aa9d133a9e2867cb1e: Bootstrap starting.
I20260709 13:17:56.305265 11674 leader_election.cc:304] T 793c97394cd142e9b2f9a301b2698075 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 838a3115bb3b43aa9d133a9e2867cb1e, fcd7d1bb34ba477f8b4fb7fcf67b7126; no voters: 
I20260709 13:17:56.306008 12000 tablet_bootstrap.cc:654] T 3a4cfaf3eb3649dda1cd4ec67714625c P 11579f7b06aa4eb4be4cd404f83aa8a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:56.306216 12008 raft_consensus.cc:2804] T 793c97394cd142e9b2f9a301b2698075 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:56.306773 12008 raft_consensus.cc:697] T 793c97394cd142e9b2f9a301b2698075 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 LEADER]: Becoming Leader. State: Replica: fcd7d1bb34ba477f8b4fb7fcf67b7126, State: Running, Role: LEADER
I20260709 13:17:56.300395 11749 leader_election.cc:304] T 3a4cfaf3eb3649dda1cd4ec67714625c P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 838a3115bb3b43aa9d133a9e2867cb1e, fcd7d1bb34ba477f8b4fb7fcf67b7126; no voters: 11579f7b06aa4eb4be4cd404f83aa8a9
I20260709 13:17:56.307950 12008 consensus_queue.cc:237] T 793c97394cd142e9b2f9a301b2698075 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.306691 12006 raft_consensus.cc:493] T 9de688862796441d936411ed5e7c42e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.300491 11857 raft_consensus.cc:2468] T 793c97394cd142e9b2f9a301b2698075 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd7d1bb34ba477f8b4fb7fcf67b7126 in term 1.
I20260709 13:17:56.310793 12006 raft_consensus.cc:515] T 9de688862796441d936411ed5e7c42e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.313081 12006 leader_election.cc:290] T 9de688862796441d936411ed5e7c42e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031), 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253)
I20260709 13:17:56.313628 11943 raft_consensus.cc:2804] T 3a4cfaf3eb3649dda1cd4ec67714625c P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:56.316628 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9de688862796441d936411ed5e7c42e1" candidate_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" is_pre_election: true
I20260709 13:17:56.317399 11856 raft_consensus.cc:2468] T 9de688862796441d936411ed5e7c42e1 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd7d1bb34ba477f8b4fb7fcf67b7126 in term 0.
I20260709 13:17:56.317440 11781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9de688862796441d936411ed5e7c42e1" candidate_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" is_pre_election: true
I20260709 13:17:56.318482 11943 raft_consensus.cc:697] T 3a4cfaf3eb3649dda1cd4ec67714625c P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 LEADER]: Becoming Leader. State: Replica: 838a3115bb3b43aa9d133a9e2867cb1e, State: Running, Role: LEADER
I20260709 13:17:56.318904 11673 leader_election.cc:304] T 9de688862796441d936411ed5e7c42e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11579f7b06aa4eb4be4cd404f83aa8a9, fcd7d1bb34ba477f8b4fb7fcf67b7126; no voters: 
I20260709 13:17:56.319463 12001 tablet_bootstrap.cc:654] T de5865b982f344e29ffc3453ec63ad46 P 838a3115bb3b43aa9d133a9e2867cb1e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:56.320474 12013 raft_consensus.cc:2804] T 9de688862796441d936411ed5e7c42e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:56.319761 11943 consensus_queue.cc:237] T 3a4cfaf3eb3649dda1cd4ec67714625c P 838a3115bb3b43aa9d133a9e2867cb1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.320938 12013 raft_consensus.cc:493] T 9de688862796441d936411ed5e7c42e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.321354 12013 raft_consensus.cc:3060] T 9de688862796441d936411ed5e7c42e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:56.324681 11674 leader_election.cc:343] T 9de688862796441d936411ed5e7c42e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:56.339437 12000 tablet_bootstrap.cc:492] T 3a4cfaf3eb3649dda1cd4ec67714625c P 11579f7b06aa4eb4be4cd404f83aa8a9: No bootstrap required, opened a new log
I20260709 13:17:56.341096 12000 ts_tablet_manager.cc:1403] T 3a4cfaf3eb3649dda1cd4ec67714625c P 11579f7b06aa4eb4be4cd404f83aa8a9: Time spent bootstrapping tablet: real 0.043s	user 0.008s	sys 0.026s
I20260709 13:17:56.345371 12000 raft_consensus.cc:359] T 3a4cfaf3eb3649dda1cd4ec67714625c P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.346385 12000 raft_consensus.cc:385] T 3a4cfaf3eb3649dda1cd4ec67714625c P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:56.346760 12000 raft_consensus.cc:740] T 3a4cfaf3eb3649dda1cd4ec67714625c P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11579f7b06aa4eb4be4cd404f83aa8a9, State: Initialized, Role: FOLLOWER
I20260709 13:17:56.347752 12000 consensus_queue.cc:260] T 3a4cfaf3eb3649dda1cd4ec67714625c P 11579f7b06aa4eb4be4cd404f83aa8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.350724 12000 ts_tablet_manager.cc:1434] T 3a4cfaf3eb3649dda1cd4ec67714625c P 11579f7b06aa4eb4be4cd404f83aa8a9: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:17:56.354175 12000 tablet_bootstrap.cc:492] T de5865b982f344e29ffc3453ec63ad46 P 11579f7b06aa4eb4be4cd404f83aa8a9: Bootstrap starting.
I20260709 13:17:56.362339 12000 tablet_bootstrap.cc:654] T de5865b982f344e29ffc3453ec63ad46 P 11579f7b06aa4eb4be4cd404f83aa8a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:56.362213 12013 raft_consensus.cc:515] T 9de688862796441d936411ed5e7c42e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.366418 11781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9de688862796441d936411ed5e7c42e1" candidate_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "838a3115bb3b43aa9d133a9e2867cb1e"
I20260709 13:17:56.368070 12029 raft_consensus.cc:493] T 394623997b07477aa1f4616ad07fd3b5 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:56.368351 11674 leader_election.cc:343] T 9de688862796441d936411ed5e7c42e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:56.369990 12029 raft_consensus.cc:515] T 394623997b07477aa1f4616ad07fd3b5 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.371728 12001 tablet_bootstrap.cc:492] T de5865b982f344e29ffc3453ec63ad46 P 838a3115bb3b43aa9d133a9e2867cb1e: No bootstrap required, opened a new log
I20260709 13:17:56.372316 12001 ts_tablet_manager.cc:1403] T de5865b982f344e29ffc3453ec63ad46 P 838a3115bb3b43aa9d133a9e2867cb1e: Time spent bootstrapping tablet: real 0.074s	user 0.024s	sys 0.021s
I20260709 13:17:56.372390 12029 leader_election.cc:290] T 394623997b07477aa1f4616ad07fd3b5 P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193:39519), 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253)
I20260709 13:17:56.373126 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9de688862796441d936411ed5e7c42e1" candidate_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9"
I20260709 13:17:56.373780 11857 raft_consensus.cc:3060] T 9de688862796441d936411ed5e7c42e1 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.375916 12001 raft_consensus.cc:359] T de5865b982f344e29ffc3453ec63ad46 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.376754 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394623997b07477aa1f4616ad07fd3b5" candidate_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" is_pre_election: true
I20260709 13:17:56.376936 12001 raft_consensus.cc:385] T de5865b982f344e29ffc3453ec63ad46 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:56.377462 12001 raft_consensus.cc:740] T de5865b982f344e29ffc3453ec63ad46 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 838a3115bb3b43aa9d133a9e2867cb1e, State: Initialized, Role: FOLLOWER
I20260709 13:17:56.377549 11856 raft_consensus.cc:2468] T 394623997b07477aa1f4616ad07fd3b5 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 838a3115bb3b43aa9d133a9e2867cb1e in term 0.
I20260709 13:17:56.378479 12001 consensus_queue.cc:260] T de5865b982f344e29ffc3453ec63ad46 P 838a3115bb3b43aa9d133a9e2867cb1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.378957 11748 leader_election.cc:304] T 394623997b07477aa1f4616ad07fd3b5 P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11579f7b06aa4eb4be4cd404f83aa8a9, 838a3115bb3b43aa9d133a9e2867cb1e; no voters: 
I20260709 13:17:56.381242 11943 raft_consensus.cc:2804] T 394623997b07477aa1f4616ad07fd3b5 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:56.381659 11943 raft_consensus.cc:493] T 394623997b07477aa1f4616ad07fd3b5 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.381286 11708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394623997b07477aa1f4616ad07fd3b5" candidate_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" is_pre_election: true
I20260709 13:17:56.382004 11943 raft_consensus.cc:3060] T 394623997b07477aa1f4616ad07fd3b5 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.382355 11708 raft_consensus.cc:2468] T 394623997b07477aa1f4616ad07fd3b5 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 838a3115bb3b43aa9d133a9e2867cb1e in term 0.
I20260709 13:17:56.383759 12013 leader_election.cc:290] T 9de688862796441d936411ed5e7c42e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 1 election: Requested vote from peers 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031), 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253)
I20260709 13:17:56.384302 12001 ts_tablet_manager.cc:1434] T de5865b982f344e29ffc3453ec63ad46 P 838a3115bb3b43aa9d133a9e2867cb1e: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:17:56.369342 11602 catalog_manager.cc:5697] T 3a4cfaf3eb3649dda1cd4ec67714625c P 838a3115bb3b43aa9d133a9e2867cb1e reported cstate change: term changed from 0 to 1, leader changed from <none> to 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194). New cstate: current_term: 1 leader_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:56.384435 12013 raft_consensus.cc:493] T 394623997b07477aa1f4616ad07fd3b5 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.367479 11604 catalog_manager.cc:5697] T 793c97394cd142e9b2f9a301b2698075 P fcd7d1bb34ba477f8b4fb7fcf67b7126 reported cstate change: term changed from 0 to 1, leader changed from <none> to fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:56.388562 12013 raft_consensus.cc:515] T 394623997b07477aa1f4616ad07fd3b5 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.391506 11781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394623997b07477aa1f4616ad07fd3b5" candidate_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" is_pre_election: true
I20260709 13:17:56.394340 11857 raft_consensus.cc:2468] T 9de688862796441d936411ed5e7c42e1 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd7d1bb34ba477f8b4fb7fcf67b7126 in term 1.
I20260709 13:17:56.394902 11943 raft_consensus.cc:515] T 394623997b07477aa1f4616ad07fd3b5 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.396057 12013 leader_election.cc:290] T 394623997b07477aa1f4616ad07fd3b5 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031), 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253)
I20260709 13:17:56.401319 11673 leader_election.cc:304] T 9de688862796441d936411ed5e7c42e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11579f7b06aa4eb4be4cd404f83aa8a9, fcd7d1bb34ba477f8b4fb7fcf67b7126; no voters: 838a3115bb3b43aa9d133a9e2867cb1e
I20260709 13:17:56.402352 11781 raft_consensus.cc:2393] T 394623997b07477aa1f4616ad07fd3b5 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcd7d1bb34ba477f8b4fb7fcf67b7126 in current term 1: Already voted for candidate 838a3115bb3b43aa9d133a9e2867cb1e in this term.
I20260709 13:17:56.402626 12013 raft_consensus.cc:2804] T 9de688862796441d936411ed5e7c42e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:56.403230 12013 raft_consensus.cc:697] T 9de688862796441d936411ed5e7c42e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 LEADER]: Becoming Leader. State: Replica: fcd7d1bb34ba477f8b4fb7fcf67b7126, State: Running, Role: LEADER
I20260709 13:17:56.403774 11943 leader_election.cc:290] T 394623997b07477aa1f4616ad07fd3b5 P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 1 election: Requested vote from peers fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193:39519), 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253)
I20260709 13:17:56.404469 11708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394623997b07477aa1f4616ad07fd3b5" candidate_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126"
I20260709 13:17:56.396780 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394623997b07477aa1f4616ad07fd3b5" candidate_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" is_pre_election: true
I20260709 13:17:56.405107 11708 raft_consensus.cc:3060] T 394623997b07477aa1f4616ad07fd3b5 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.405305 11856 raft_consensus.cc:2468] T 394623997b07477aa1f4616ad07fd3b5 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcd7d1bb34ba477f8b4fb7fcf67b7126 in term 0.
I20260709 13:17:56.406414 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394623997b07477aa1f4616ad07fd3b5" candidate_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9"
I20260709 13:17:56.406984 11857 raft_consensus.cc:3060] T 394623997b07477aa1f4616ad07fd3b5 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.408987 12000 tablet_bootstrap.cc:492] T de5865b982f344e29ffc3453ec63ad46 P 11579f7b06aa4eb4be4cd404f83aa8a9: No bootstrap required, opened a new log
I20260709 13:17:56.409883 11673 leader_election.cc:304] T 394623997b07477aa1f4616ad07fd3b5 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11579f7b06aa4eb4be4cd404f83aa8a9, fcd7d1bb34ba477f8b4fb7fcf67b7126; no voters: 
I20260709 13:17:56.404201 12013 consensus_queue.cc:237] T 9de688862796441d936411ed5e7c42e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.413839 12000 ts_tablet_manager.cc:1403] T de5865b982f344e29ffc3453ec63ad46 P 11579f7b06aa4eb4be4cd404f83aa8a9: Time spent bootstrapping tablet: real 0.060s	user 0.025s	sys 0.020s
I20260709 13:17:56.417142 12000 raft_consensus.cc:359] T de5865b982f344e29ffc3453ec63ad46 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.417819 12000 raft_consensus.cc:385] T de5865b982f344e29ffc3453ec63ad46 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:56.418102 12000 raft_consensus.cc:740] T de5865b982f344e29ffc3453ec63ad46 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11579f7b06aa4eb4be4cd404f83aa8a9, State: Initialized, Role: FOLLOWER
I20260709 13:17:56.418929 12000 consensus_queue.cc:260] T de5865b982f344e29ffc3453ec63ad46 P 11579f7b06aa4eb4be4cd404f83aa8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.421219 12000 ts_tablet_manager.cc:1434] T de5865b982f344e29ffc3453ec63ad46 P 11579f7b06aa4eb4be4cd404f83aa8a9: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:17:56.424533 11708 raft_consensus.cc:2468] T 394623997b07477aa1f4616ad07fd3b5 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 838a3115bb3b43aa9d133a9e2867cb1e in term 1.
I20260709 13:17:56.385850 12001 tablet_bootstrap.cc:492] T 9de688862796441d936411ed5e7c42e1 P 838a3115bb3b43aa9d133a9e2867cb1e: Bootstrap starting.
I20260709 13:17:56.425213 12008 raft_consensus.cc:2764] T 394623997b07477aa1f4616ad07fd3b5 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:17:56.426151 11749 leader_election.cc:304] T 394623997b07477aa1f4616ad07fd3b5 P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 838a3115bb3b43aa9d133a9e2867cb1e, fcd7d1bb34ba477f8b4fb7fcf67b7126; no voters: 
I20260709 13:17:56.427167 12029 raft_consensus.cc:2804] T 394623997b07477aa1f4616ad07fd3b5 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:56.427667 12029 raft_consensus.cc:697] T 394623997b07477aa1f4616ad07fd3b5 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 LEADER]: Becoming Leader. State: Replica: 838a3115bb3b43aa9d133a9e2867cb1e, State: Running, Role: LEADER
I20260709 13:17:56.428550 12029 consensus_queue.cc:237] T 394623997b07477aa1f4616ad07fd3b5 P 838a3115bb3b43aa9d133a9e2867cb1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.439105 12001 tablet_bootstrap.cc:654] T 9de688862796441d936411ed5e7c42e1 P 838a3115bb3b43aa9d133a9e2867cb1e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:56.443784 11943 raft_consensus.cc:493] T de5865b982f344e29ffc3453ec63ad46 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.444648 11943 raft_consensus.cc:515] T de5865b982f344e29ffc3453ec63ad46 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.448593 11708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5865b982f344e29ffc3453ec63ad46" candidate_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" is_pre_election: true
I20260709 13:17:56.449536 11708 raft_consensus.cc:2468] T de5865b982f344e29ffc3453ec63ad46 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 838a3115bb3b43aa9d133a9e2867cb1e in term 0.
I20260709 13:17:56.449612 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5865b982f344e29ffc3453ec63ad46" candidate_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" is_pre_election: true
I20260709 13:17:56.450398 11856 raft_consensus.cc:2468] T de5865b982f344e29ffc3453ec63ad46 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 838a3115bb3b43aa9d133a9e2867cb1e in term 0.
I20260709 13:17:56.451764 11749 leader_election.cc:304] T de5865b982f344e29ffc3453ec63ad46 P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 838a3115bb3b43aa9d133a9e2867cb1e, fcd7d1bb34ba477f8b4fb7fcf67b7126; no voters: 
I20260709 13:17:56.452708 12009 raft_consensus.cc:2804] T de5865b982f344e29ffc3453ec63ad46 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:56.453064 12009 raft_consensus.cc:493] T de5865b982f344e29ffc3453ec63ad46 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.453459 12009 raft_consensus.cc:3060] T de5865b982f344e29ffc3453ec63ad46 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.453527 11857 raft_consensus.cc:2468] T 394623997b07477aa1f4616ad07fd3b5 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 838a3115bb3b43aa9d133a9e2867cb1e in term 1.
I20260709 13:17:56.454866 11943 leader_election.cc:290] T de5865b982f344e29ffc3453ec63ad46 P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193:39519), 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253)
I20260709 13:17:56.460995 12001 tablet_bootstrap.cc:492] T 9de688862796441d936411ed5e7c42e1 P 838a3115bb3b43aa9d133a9e2867cb1e: No bootstrap required, opened a new log
I20260709 13:17:56.461592 12001 ts_tablet_manager.cc:1403] T 9de688862796441d936411ed5e7c42e1 P 838a3115bb3b43aa9d133a9e2867cb1e: Time spent bootstrapping tablet: real 0.076s	user 0.022s	sys 0.006s
I20260709 13:17:56.463514 11605 catalog_manager.cc:5697] T 394623997b07477aa1f4616ad07fd3b5 P 838a3115bb3b43aa9d133a9e2867cb1e reported cstate change: term changed from 0 to 1, leader changed from <none> to 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194). New cstate: current_term: 1 leader_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:56.464727 12001 raft_consensus.cc:359] T 9de688862796441d936411ed5e7c42e1 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.465477 12001 raft_consensus.cc:385] T 9de688862796441d936411ed5e7c42e1 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:56.465767 12001 raft_consensus.cc:740] T 9de688862796441d936411ed5e7c42e1 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 838a3115bb3b43aa9d133a9e2867cb1e, State: Initialized, Role: FOLLOWER
I20260709 13:17:56.466208 12009 raft_consensus.cc:515] T de5865b982f344e29ffc3453ec63ad46 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.466495 12001 consensus_queue.cc:260] T 9de688862796441d936411ed5e7c42e1 P 838a3115bb3b43aa9d133a9e2867cb1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.467161 12008 consensus_queue.cc:1048] T 3fa6178098a140f09c25be5cf185e48e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [LEADER]: Connected to new peer: Peer: permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:56.469103 12008 consensus_queue.cc:1048] T 3fa6178098a140f09c25be5cf185e48e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:56.469348 12001 ts_tablet_manager.cc:1434] T 9de688862796441d936411ed5e7c42e1 P 838a3115bb3b43aa9d133a9e2867cb1e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:17:56.469803 11708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5865b982f344e29ffc3453ec63ad46" candidate_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126"
I20260709 13:17:56.470466 11708 raft_consensus.cc:3060] T de5865b982f344e29ffc3453ec63ad46 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.470606 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5865b982f344e29ffc3453ec63ad46" candidate_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9"
I20260709 13:17:56.471256 11857 raft_consensus.cc:3060] T de5865b982f344e29ffc3453ec63ad46 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.470834 12009 leader_election.cc:290] T de5865b982f344e29ffc3453ec63ad46 P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 1 election: Requested vote from peers fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193:39519), 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253)
I20260709 13:17:56.479727 11857 raft_consensus.cc:2468] T de5865b982f344e29ffc3453ec63ad46 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 838a3115bb3b43aa9d133a9e2867cb1e in term 1.
I20260709 13:17:56.480926 11748 leader_election.cc:304] T de5865b982f344e29ffc3453ec63ad46 P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11579f7b06aa4eb4be4cd404f83aa8a9, 838a3115bb3b43aa9d133a9e2867cb1e; no voters: 
I20260709 13:17:56.481721 12009 raft_consensus.cc:2804] T de5865b982f344e29ffc3453ec63ad46 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:56.482370 12009 raft_consensus.cc:697] T de5865b982f344e29ffc3453ec63ad46 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 LEADER]: Becoming Leader. State: Replica: 838a3115bb3b43aa9d133a9e2867cb1e, State: Running, Role: LEADER
I20260709 13:17:56.483314 12009 consensus_queue.cc:237] T de5865b982f344e29ffc3453ec63ad46 P 838a3115bb3b43aa9d133a9e2867cb1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.487393 11943 raft_consensus.cc:493] T 9de688862796441d936411ed5e7c42e1 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.487964 11943 raft_consensus.cc:515] T 9de688862796441d936411ed5e7c42e1 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.490141 11943 leader_election.cc:290] T 9de688862796441d936411ed5e7c42e1 P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193:39519), 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253)
I20260709 13:17:56.491268 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9de688862796441d936411ed5e7c42e1" candidate_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" is_pre_election: true
I20260709 13:17:56.491703 11707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9de688862796441d936411ed5e7c42e1" candidate_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" is_pre_election: true
I20260709 13:17:56.492166 11857 raft_consensus.cc:2393] T 9de688862796441d936411ed5e7c42e1 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 838a3115bb3b43aa9d133a9e2867cb1e in current term 1: Already voted for candidate fcd7d1bb34ba477f8b4fb7fcf67b7126 in this term.
I20260709 13:17:56.493403 11749 leader_election.cc:304] T 9de688862796441d936411ed5e7c42e1 P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 838a3115bb3b43aa9d133a9e2867cb1e; no voters: 11579f7b06aa4eb4be4cd404f83aa8a9, fcd7d1bb34ba477f8b4fb7fcf67b7126
I20260709 13:17:56.494125 12029 raft_consensus.cc:3060] T 9de688862796441d936411ed5e7c42e1 P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.494287 11708 raft_consensus.cc:2468] T de5865b982f344e29ffc3453ec63ad46 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 838a3115bb3b43aa9d133a9e2867cb1e in term 1.
I20260709 13:17:56.487293 11605 catalog_manager.cc:5697] T 9de688862796441d936411ed5e7c42e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126 reported cstate change: term changed from 0 to 1, leader changed from <none> to fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193). New cstate: current_term: 1 leader_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:56.504101 12029 raft_consensus.cc:2749] T 9de688862796441d936411ed5e7c42e1 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:56.520488 11602 catalog_manager.cc:5697] T de5865b982f344e29ffc3453ec63ad46 P 838a3115bb3b43aa9d133a9e2867cb1e reported cstate change: term changed from 0 to 1, leader changed from <none> to 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194). New cstate: current_term: 1 leader_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:56.578341 12029 consensus_queue.cc:1048] T afbf296b986b46aa9283a2dfe0f8fc13 P 838a3115bb3b43aa9d133a9e2867cb1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:56.588734 11943 consensus_queue.cc:1048] T afbf296b986b46aa9283a2dfe0f8fc13 P 838a3115bb3b43aa9d133a9e2867cb1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:56.659137 11969 raft_consensus.cc:493] T 3a4cfaf3eb3649dda1cd4ec67714625c P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.659852 11969 raft_consensus.cc:515] T 3a4cfaf3eb3649dda1cd4ec67714625c P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.661877 11969 leader_election.cc:290] T 3a4cfaf3eb3649dda1cd4ec67714625c P 11579f7b06aa4eb4be4cd404f83aa8a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193:39519), 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031)
I20260709 13:17:56.662910 11708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4cfaf3eb3649dda1cd4ec67714625c" candidate_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" is_pre_election: true
I20260709 13:17:56.662925 11781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4cfaf3eb3649dda1cd4ec67714625c" candidate_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" is_pre_election: true
I20260709 13:17:56.663885 11708 raft_consensus.cc:2393] T 3a4cfaf3eb3649dda1cd4ec67714625c P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 11579f7b06aa4eb4be4cd404f83aa8a9 in current term 1: Already voted for candidate 838a3115bb3b43aa9d133a9e2867cb1e in this term.
I20260709 13:17:56.664937 11823 leader_election.cc:304] T 3a4cfaf3eb3649dda1cd4ec67714625c P 11579f7b06aa4eb4be4cd404f83aa8a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11579f7b06aa4eb4be4cd404f83aa8a9; no voters: 838a3115bb3b43aa9d133a9e2867cb1e, fcd7d1bb34ba477f8b4fb7fcf67b7126
I20260709 13:17:56.665249 12013 consensus_queue.cc:1048] T 033d9618f252438383673646b087b3e2 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [LEADER]: Connected to new peer: Peer: permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:56.665670 11969 raft_consensus.cc:3060] T 3a4cfaf3eb3649dda1cd4ec67714625c P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.669380 11781 raft_consensus.cc:3060] T 10853738200240bb93ca91ed7d97566e P 838a3115bb3b43aa9d133a9e2867cb1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.674190 11969 raft_consensus.cc:2749] T 3a4cfaf3eb3649dda1cd4ec67714625c P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:56.681872 11969 consensus_queue.cc:1048] T 10853738200240bb93ca91ed7d97566e P 11579f7b06aa4eb4be4cd404f83aa8a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:56.684207 12006 consensus_queue.cc:1048] T 033d9618f252438383673646b087b3e2 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:56.700642 11969 consensus_queue.cc:1048] T 10853738200240bb93ca91ed7d97566e P 11579f7b06aa4eb4be4cd404f83aa8a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:56.735294 11781 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afbf296b986b46aa9283a2dfe0f8fc13"
dest_uuid: "838a3115bb3b43aa9d133a9e2867cb1e"
mode: GRACEFUL
new_leader_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126"
 from {username='slave'} at 127.0.0.1:39002
I20260709 13:17:56.736002 11781 raft_consensus.cc:606] T afbf296b986b46aa9283a2dfe0f8fc13 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 LEADER]: Received request to transfer leadership to TS fcd7d1bb34ba477f8b4fb7fcf67b7126
I20260709 13:17:56.741291 11781 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a4cfaf3eb3649dda1cd4ec67714625c"
dest_uuid: "838a3115bb3b43aa9d133a9e2867cb1e"
mode: GRACEFUL
new_leader_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126"
 from {username='slave'} at 127.0.0.1:39002
I20260709 13:17:56.741814 11781 raft_consensus.cc:606] T 3a4cfaf3eb3649dda1cd4ec67714625c P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 LEADER]: Received request to transfer leadership to TS fcd7d1bb34ba477f8b4fb7fcf67b7126
I20260709 13:17:56.746659 11708 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "033d9618f252438383673646b087b3e2"
dest_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126"
mode: GRACEFUL
new_leader_uuid: "838a3115bb3b43aa9d133a9e2867cb1e"
 from {username='slave'} at 127.0.0.1:51162
I20260709 13:17:56.747229 11708 raft_consensus.cc:606] T 033d9618f252438383673646b087b3e2 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 LEADER]: Received request to transfer leadership to TS 838a3115bb3b43aa9d133a9e2867cb1e
I20260709 13:17:56.753705 12013 consensus_queue.cc:1048] T 793c97394cd142e9b2f9a301b2698075 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:56.755488 11856 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10853738200240bb93ca91ed7d97566e"
dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9"
mode: GRACEFUL
new_leader_uuid: "838a3115bb3b43aa9d133a9e2867cb1e"
 from {username='slave'} at 127.0.0.1:54472
I20260709 13:17:56.756852 11856 raft_consensus.cc:606] T 10853738200240bb93ca91ed7d97566e P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 LEADER]: Received request to transfer leadership to TS 838a3115bb3b43aa9d133a9e2867cb1e
I20260709 13:17:56.759840 11943 consensus_queue.cc:1048] T 3a4cfaf3eb3649dda1cd4ec67714625c P 838a3115bb3b43aa9d133a9e2867cb1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:56.763079 11708 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9de688862796441d936411ed5e7c42e1"
dest_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126"
mode: GRACEFUL
new_leader_uuid: "838a3115bb3b43aa9d133a9e2867cb1e"
 from {username='slave'} at 127.0.0.1:51162
I20260709 13:17:56.763759 11708 raft_consensus.cc:606] T 9de688862796441d936411ed5e7c42e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 LEADER]: Received request to transfer leadership to TS 838a3115bb3b43aa9d133a9e2867cb1e
I20260709 13:17:56.769932 11781 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de5865b982f344e29ffc3453ec63ad46"
dest_uuid: "838a3115bb3b43aa9d133a9e2867cb1e"
mode: GRACEFUL
new_leader_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9"
 from {username='slave'} at 127.0.0.1:39002
I20260709 13:17:56.770578 11781 raft_consensus.cc:606] T de5865b982f344e29ffc3453ec63ad46 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 LEADER]: Received request to transfer leadership to TS 11579f7b06aa4eb4be4cd404f83aa8a9
I20260709 13:17:56.776942 12008 consensus_queue.cc:1048] T 793c97394cd142e9b2f9a301b2698075 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [LEADER]: Connected to new peer: Peer: permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:56.784153 11943 consensus_queue.cc:1048] T 3a4cfaf3eb3649dda1cd4ec67714625c P 838a3115bb3b43aa9d133a9e2867cb1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:56.798472 12029 raft_consensus.cc:993] T 3a4cfaf3eb3649dda1cd4ec67714625c P 838a3115bb3b43aa9d133a9e2867cb1e: : Instructing follower fcd7d1bb34ba477f8b4fb7fcf67b7126 to start an election
I20260709 13:17:56.798990 12029 raft_consensus.cc:1081] T 3a4cfaf3eb3649dda1cd4ec67714625c P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 LEADER]: Signalling peer fcd7d1bb34ba477f8b4fb7fcf67b7126 to start an election
I20260709 13:17:56.800791 11708 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3a4cfaf3eb3649dda1cd4ec67714625c"
dest_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126"
 from {username='slave'} at 127.0.0.1:51154
I20260709 13:17:56.801394 11708 raft_consensus.cc:493] T 3a4cfaf3eb3649dda1cd4ec67714625c P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:56.802474 11708 raft_consensus.cc:3060] T 3a4cfaf3eb3649dda1cd4ec67714625c P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:56.809839 11708 raft_consensus.cc:515] T 3a4cfaf3eb3649dda1cd4ec67714625c P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.811811 11708 leader_election.cc:290] T 3a4cfaf3eb3649dda1cd4ec67714625c P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 2 election: Requested vote from peers 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031), 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253)
I20260709 13:17:56.813009 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4cfaf3eb3649dda1cd4ec67714625c" candidate_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9"
I20260709 13:17:56.813793 11857 raft_consensus.cc:3060] T 3a4cfaf3eb3649dda1cd4ec67714625c P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:56.814147 11781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4cfaf3eb3649dda1cd4ec67714625c" candidate_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "838a3115bb3b43aa9d133a9e2867cb1e"
I20260709 13:17:56.814851 11781 raft_consensus.cc:3055] T 3a4cfaf3eb3649dda1cd4ec67714625c P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:56.815114 11781 raft_consensus.cc:740] T 3a4cfaf3eb3649dda1cd4ec67714625c P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 838a3115bb3b43aa9d133a9e2867cb1e, State: Running, Role: LEADER
I20260709 13:17:56.815918 11781 consensus_queue.cc:260] T 3a4cfaf3eb3649dda1cd4ec67714625c P 838a3115bb3b43aa9d133a9e2867cb1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.816954 11781 raft_consensus.cc:3060] T 3a4cfaf3eb3649dda1cd4ec67714625c P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:56.820860 11857 raft_consensus.cc:2468] T 3a4cfaf3eb3649dda1cd4ec67714625c P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd7d1bb34ba477f8b4fb7fcf67b7126 in term 2.
I20260709 13:17:56.821905 11673 leader_election.cc:304] T 3a4cfaf3eb3649dda1cd4ec67714625c P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11579f7b06aa4eb4be4cd404f83aa8a9, fcd7d1bb34ba477f8b4fb7fcf67b7126; no voters: 
I20260709 13:17:56.822643 12008 raft_consensus.cc:2804] T 3a4cfaf3eb3649dda1cd4ec67714625c P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:56.823050 12008 raft_consensus.cc:697] T 3a4cfaf3eb3649dda1cd4ec67714625c P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 LEADER]: Becoming Leader. State: Replica: fcd7d1bb34ba477f8b4fb7fcf67b7126, State: Running, Role: LEADER
I20260709 13:17:56.823081 11781 raft_consensus.cc:2468] T 3a4cfaf3eb3649dda1cd4ec67714625c P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd7d1bb34ba477f8b4fb7fcf67b7126 in term 2.
I20260709 13:17:56.823947 12008 consensus_queue.cc:237] T 3a4cfaf3eb3649dda1cd4ec67714625c P fcd7d1bb34ba477f8b4fb7fcf67b7126 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.831269 11605 catalog_manager.cc:5697] T 3a4cfaf3eb3649dda1cd4ec67714625c P fcd7d1bb34ba477f8b4fb7fcf67b7126 reported cstate change: term changed from 1 to 2, leader changed from 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194) to fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193). New cstate: current_term: 2 leader_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:56.835762 12029 consensus_queue.cc:1048] T 394623997b07477aa1f4616ad07fd3b5 P 838a3115bb3b43aa9d133a9e2867cb1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:56.843091 12008 consensus_queue.cc:1048] T 9de688862796441d936411ed5e7c42e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:56.849514 11943 consensus_queue.cc:1048] T 394623997b07477aa1f4616ad07fd3b5 P 838a3115bb3b43aa9d133a9e2867cb1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:56.866967 12008 consensus_queue.cc:1048] T 9de688862796441d936411ed5e7c42e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [LEADER]: Connected to new peer: Peer: permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:56.886978 12008 raft_consensus.cc:993] T 9de688862796441d936411ed5e7c42e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126: : Instructing follower 838a3115bb3b43aa9d133a9e2867cb1e to start an election
I20260709 13:17:56.887514 12008 raft_consensus.cc:1081] T 9de688862796441d936411ed5e7c42e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 LEADER]: Signalling peer 838a3115bb3b43aa9d133a9e2867cb1e to start an election
I20260709 13:17:56.890202 11782 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9de688862796441d936411ed5e7c42e1"
dest_uuid: "838a3115bb3b43aa9d133a9e2867cb1e"
 from {username='slave'} at 127.0.0.1:38990
I20260709 13:17:56.890841 11782 raft_consensus.cc:493] T 9de688862796441d936411ed5e7c42e1 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:56.891214 11782 raft_consensus.cc:3060] T 9de688862796441d936411ed5e7c42e1 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:56.896972 11782 raft_consensus.cc:515] T 9de688862796441d936411ed5e7c42e1 P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.898181 11781 raft_consensus.cc:1240] T 9de688862796441d936411ed5e7c42e1 P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 FOLLOWER]: Rejecting Update request from peer fcd7d1bb34ba477f8b4fb7fcf67b7126 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:56.899654 12006 consensus_queue.cc:1059] T 9de688862796441d936411ed5e7c42e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:56.900305 11708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9de688862796441d936411ed5e7c42e1" candidate_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126"
I20260709 13:17:56.900483 12006 raft_consensus.cc:3055] T 9de688862796441d936411ed5e7c42e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:56.900689 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9de688862796441d936411ed5e7c42e1" candidate_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9"
I20260709 13:17:56.901005 12006 raft_consensus.cc:740] T 9de688862796441d936411ed5e7c42e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fcd7d1bb34ba477f8b4fb7fcf67b7126, State: Running, Role: LEADER
I20260709 13:17:56.901371 11857 raft_consensus.cc:3060] T 9de688862796441d936411ed5e7c42e1 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:56.901580 11782 leader_election.cc:290] T 9de688862796441d936411ed5e7c42e1 P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 2 election: Requested vote from peers fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193:39519), 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253)
I20260709 13:17:56.901961 12006 consensus_queue.cc:260] T 9de688862796441d936411ed5e7c42e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.903497 12006 raft_consensus.cc:3060] T 9de688862796441d936411ed5e7c42e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:56.908684 11857 raft_consensus.cc:2468] T 9de688862796441d936411ed5e7c42e1 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 838a3115bb3b43aa9d133a9e2867cb1e in term 2.
I20260709 13:17:56.909899 11748 leader_election.cc:304] T 9de688862796441d936411ed5e7c42e1 P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11579f7b06aa4eb4be4cd404f83aa8a9, 838a3115bb3b43aa9d133a9e2867cb1e; no voters: 
I20260709 13:17:56.910678 12029 raft_consensus.cc:2804] T 9de688862796441d936411ed5e7c42e1 P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:56.911216 12029 raft_consensus.cc:697] T 9de688862796441d936411ed5e7c42e1 P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 LEADER]: Becoming Leader. State: Replica: 838a3115bb3b43aa9d133a9e2867cb1e, State: Running, Role: LEADER
I20260709 13:17:56.912098 12029 consensus_queue.cc:237] T 9de688862796441d936411ed5e7c42e1 P 838a3115bb3b43aa9d133a9e2867cb1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.918048 11708 raft_consensus.cc:2468] T 9de688862796441d936411ed5e7c42e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 838a3115bb3b43aa9d133a9e2867cb1e in term 2.
I20260709 13:17:56.920240 11605 catalog_manager.cc:5697] T 9de688862796441d936411ed5e7c42e1 P 838a3115bb3b43aa9d133a9e2867cb1e reported cstate change: term changed from 1 to 2, leader changed from fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193) to 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194). New cstate: current_term: 2 leader_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:56.958287 12029 consensus_queue.cc:1048] T de5865b982f344e29ffc3453ec63ad46 P 838a3115bb3b43aa9d133a9e2867cb1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:56.959257 11943 consensus_queue.cc:1048] T de5865b982f344e29ffc3453ec63ad46 P 838a3115bb3b43aa9d133a9e2867cb1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:56.972872 12009 raft_consensus.cc:993] T de5865b982f344e29ffc3453ec63ad46 P 838a3115bb3b43aa9d133a9e2867cb1e: : Instructing follower 11579f7b06aa4eb4be4cd404f83aa8a9 to start an election
I20260709 13:17:56.973407 12009 raft_consensus.cc:1081] T de5865b982f344e29ffc3453ec63ad46 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 LEADER]: Signalling peer 11579f7b06aa4eb4be4cd404f83aa8a9 to start an election
I20260709 13:17:56.975656 11855 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de5865b982f344e29ffc3453ec63ad46"
dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9"
 from {username='slave'} at 127.0.0.1:54470
I20260709 13:17:56.976617 11855 raft_consensus.cc:493] T de5865b982f344e29ffc3453ec63ad46 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:56.977046 11855 raft_consensus.cc:3060] T de5865b982f344e29ffc3453ec63ad46 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:56.985074 11855 raft_consensus.cc:515] T de5865b982f344e29ffc3453ec63ad46 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.987121 11855 leader_election.cc:290] T de5865b982f344e29ffc3453ec63ad46 P 11579f7b06aa4eb4be4cd404f83aa8a9 [CANDIDATE]: Term 2 election: Requested vote from peers fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193:39519), 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031)
I20260709 13:17:56.987884 11708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5865b982f344e29ffc3453ec63ad46" candidate_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126"
I20260709 13:17:56.988322 11782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5865b982f344e29ffc3453ec63ad46" candidate_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "838a3115bb3b43aa9d133a9e2867cb1e"
I20260709 13:17:56.988588 11708 raft_consensus.cc:3060] T de5865b982f344e29ffc3453ec63ad46 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:56.988979 11782 raft_consensus.cc:3055] T de5865b982f344e29ffc3453ec63ad46 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:56.989293 11782 raft_consensus.cc:740] T de5865b982f344e29ffc3453ec63ad46 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 838a3115bb3b43aa9d133a9e2867cb1e, State: Running, Role: LEADER
I20260709 13:17:56.990140 11782 consensus_queue.cc:260] T de5865b982f344e29ffc3453ec63ad46 P 838a3115bb3b43aa9d133a9e2867cb1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:56.991446 11782 raft_consensus.cc:3060] T de5865b982f344e29ffc3453ec63ad46 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:56.996217 11708 raft_consensus.cc:2468] T de5865b982f344e29ffc3453ec63ad46 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11579f7b06aa4eb4be4cd404f83aa8a9 in term 2.
I20260709 13:17:56.997455 11823 leader_election.cc:304] T de5865b982f344e29ffc3453ec63ad46 P 11579f7b06aa4eb4be4cd404f83aa8a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11579f7b06aa4eb4be4cd404f83aa8a9, fcd7d1bb34ba477f8b4fb7fcf67b7126; no voters: 
I20260709 13:17:56.998263 11969 raft_consensus.cc:2804] T de5865b982f344e29ffc3453ec63ad46 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:56.998680 11969 raft_consensus.cc:697] T de5865b982f344e29ffc3453ec63ad46 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 2 LEADER]: Becoming Leader. State: Replica: 11579f7b06aa4eb4be4cd404f83aa8a9, State: Running, Role: LEADER
I20260709 13:17:56.999142 11782 raft_consensus.cc:2468] T de5865b982f344e29ffc3453ec63ad46 P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11579f7b06aa4eb4be4cd404f83aa8a9 in term 2.
I20260709 13:17:56.999481 11969 consensus_queue.cc:237] T de5865b982f344e29ffc3453ec63ad46 P 11579f7b06aa4eb4be4cd404f83aa8a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:57.006387 11603 catalog_manager.cc:5697] T de5865b982f344e29ffc3453ec63ad46 P 11579f7b06aa4eb4be4cd404f83aa8a9 reported cstate change: term changed from 1 to 2, leader changed from 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194) to 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195). New cstate: current_term: 2 leader_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:57.163308 12029 raft_consensus.cc:993] T afbf296b986b46aa9283a2dfe0f8fc13 P 838a3115bb3b43aa9d133a9e2867cb1e: : Instructing follower fcd7d1bb34ba477f8b4fb7fcf67b7126 to start an election
I20260709 13:17:57.164705 11943 raft_consensus.cc:1081] T afbf296b986b46aa9283a2dfe0f8fc13 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 LEADER]: Signalling peer fcd7d1bb34ba477f8b4fb7fcf67b7126 to start an election
I20260709 13:17:57.168779 11708 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "afbf296b986b46aa9283a2dfe0f8fc13"
dest_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126"
 from {username='slave'} at 127.0.0.1:51154
I20260709 13:17:57.169526 11708 raft_consensus.cc:493] T afbf296b986b46aa9283a2dfe0f8fc13 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:57.170039 11708 raft_consensus.cc:3060] T afbf296b986b46aa9283a2dfe0f8fc13 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:57.177233 12013 raft_consensus.cc:993] T 033d9618f252438383673646b087b3e2 P fcd7d1bb34ba477f8b4fb7fcf67b7126: : Instructing follower 838a3115bb3b43aa9d133a9e2867cb1e to start an election
I20260709 13:17:57.177858 12006 raft_consensus.cc:1081] T 033d9618f252438383673646b087b3e2 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 LEADER]: Signalling peer 838a3115bb3b43aa9d133a9e2867cb1e to start an election
I20260709 13:17:57.177309 11708 raft_consensus.cc:515] T afbf296b986b46aa9283a2dfe0f8fc13 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:57.179998 11708 leader_election.cc:290] T afbf296b986b46aa9283a2dfe0f8fc13 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 2 election: Requested vote from peers 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031), 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253)
I20260709 13:17:57.180306 11781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afbf296b986b46aa9283a2dfe0f8fc13" candidate_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "838a3115bb3b43aa9d133a9e2867cb1e"
I20260709 13:17:57.179627 11782 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "033d9618f252438383673646b087b3e2"
dest_uuid: "838a3115bb3b43aa9d133a9e2867cb1e"
 from {username='slave'} at 127.0.0.1:38990
I20260709 13:17:57.180600 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afbf296b986b46aa9283a2dfe0f8fc13" candidate_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9"
I20260709 13:17:57.180980 11781 raft_consensus.cc:3055] T afbf296b986b46aa9283a2dfe0f8fc13 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:57.181120 11782 raft_consensus.cc:493] T 033d9618f252438383673646b087b3e2 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:57.181311 11855 raft_consensus.cc:3060] T afbf296b986b46aa9283a2dfe0f8fc13 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:57.181461 11781 raft_consensus.cc:740] T afbf296b986b46aa9283a2dfe0f8fc13 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 838a3115bb3b43aa9d133a9e2867cb1e, State: Running, Role: LEADER
I20260709 13:17:57.181651 11782 raft_consensus.cc:3060] T 033d9618f252438383673646b087b3e2 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:57.182574 11781 consensus_queue.cc:260] T afbf296b986b46aa9283a2dfe0f8fc13 P 838a3115bb3b43aa9d133a9e2867cb1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:57.184072 11781 raft_consensus.cc:3060] T afbf296b986b46aa9283a2dfe0f8fc13 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:57.187927 11855 raft_consensus.cc:2468] T afbf296b986b46aa9283a2dfe0f8fc13 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd7d1bb34ba477f8b4fb7fcf67b7126 in term 2.
I20260709 13:17:57.189149 11673 leader_election.cc:304] T afbf296b986b46aa9283a2dfe0f8fc13 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11579f7b06aa4eb4be4cd404f83aa8a9, fcd7d1bb34ba477f8b4fb7fcf67b7126; no voters: 
I20260709 13:17:57.189926 12006 raft_consensus.cc:2804] T afbf296b986b46aa9283a2dfe0f8fc13 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:57.189608 11782 raft_consensus.cc:515] T 033d9618f252438383673646b087b3e2 P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:57.190507 12006 raft_consensus.cc:697] T afbf296b986b46aa9283a2dfe0f8fc13 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 LEADER]: Becoming Leader. State: Replica: fcd7d1bb34ba477f8b4fb7fcf67b7126, State: Running, Role: LEADER
I20260709 13:17:57.191653 11781 raft_consensus.cc:2468] T afbf296b986b46aa9283a2dfe0f8fc13 P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcd7d1bb34ba477f8b4fb7fcf67b7126 in term 2.
I20260709 13:17:57.191778 12006 consensus_queue.cc:237] T afbf296b986b46aa9283a2dfe0f8fc13 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:57.193048 11708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033d9618f252438383673646b087b3e2" candidate_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126"
I20260709 13:17:57.193589 11708 raft_consensus.cc:3055] T 033d9618f252438383673646b087b3e2 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:57.193796 11708 raft_consensus.cc:740] T 033d9618f252438383673646b087b3e2 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fcd7d1bb34ba477f8b4fb7fcf67b7126, State: Running, Role: LEADER
I20260709 13:17:57.194525 11708 consensus_queue.cc:260] T 033d9618f252438383673646b087b3e2 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:57.195430 11708 raft_consensus.cc:3060] T 033d9618f252438383673646b087b3e2 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:57.195523 11782 leader_election.cc:290] T 033d9618f252438383673646b087b3e2 P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 2 election: Requested vote from peers fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193:39519), 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253)
I20260709 13:17:57.195441 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033d9618f252438383673646b087b3e2" candidate_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9"
I20260709 13:17:57.197019 11855 raft_consensus.cc:3060] T 033d9618f252438383673646b087b3e2 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:57.202586 11708 raft_consensus.cc:2468] T 033d9618f252438383673646b087b3e2 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 838a3115bb3b43aa9d133a9e2867cb1e in term 2.
I20260709 13:17:57.203959 11749 leader_election.cc:304] T 033d9618f252438383673646b087b3e2 P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 838a3115bb3b43aa9d133a9e2867cb1e, fcd7d1bb34ba477f8b4fb7fcf67b7126; no voters: 
I20260709 13:17:57.205149 12029 raft_consensus.cc:2804] T 033d9618f252438383673646b087b3e2 P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:57.201612 11605 catalog_manager.cc:5697] T afbf296b986b46aa9283a2dfe0f8fc13 P fcd7d1bb34ba477f8b4fb7fcf67b7126 reported cstate change: term changed from 1 to 2, leader changed from 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194) to fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193). New cstate: current_term: 2 leader_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:57.205396 11855 raft_consensus.cc:2468] T 033d9618f252438383673646b087b3e2 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 838a3115bb3b43aa9d133a9e2867cb1e in term 2.
I20260709 13:17:57.205705 12029 raft_consensus.cc:697] T 033d9618f252438383673646b087b3e2 P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 LEADER]: Becoming Leader. State: Replica: 838a3115bb3b43aa9d133a9e2867cb1e, State: Running, Role: LEADER
I20260709 13:17:57.206600 12029 consensus_queue.cc:237] T 033d9618f252438383673646b087b3e2 P 838a3115bb3b43aa9d133a9e2867cb1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:57.214998 11603 catalog_manager.cc:5697] T 033d9618f252438383673646b087b3e2 P 838a3115bb3b43aa9d133a9e2867cb1e reported cstate change: term changed from 1 to 2, leader changed from fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193) to 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194). New cstate: current_term: 2 leader_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:57.234088 12028 raft_consensus.cc:993] T 10853738200240bb93ca91ed7d97566e P 11579f7b06aa4eb4be4cd404f83aa8a9: : Instructing follower 838a3115bb3b43aa9d133a9e2867cb1e to start an election
I20260709 13:17:57.234562 11969 raft_consensus.cc:1081] T 10853738200240bb93ca91ed7d97566e P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 LEADER]: Signalling peer 838a3115bb3b43aa9d133a9e2867cb1e to start an election
I20260709 13:17:57.236112 11782 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "10853738200240bb93ca91ed7d97566e"
dest_uuid: "838a3115bb3b43aa9d133a9e2867cb1e"
 from {username='slave'} at 127.0.0.1:39000
I20260709 13:17:57.236675 11782 raft_consensus.cc:493] T 10853738200240bb93ca91ed7d97566e P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:57.237039 11782 raft_consensus.cc:3060] T 10853738200240bb93ca91ed7d97566e P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:57.243571 11782 raft_consensus.cc:515] T 10853738200240bb93ca91ed7d97566e P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:57.245405 11782 leader_election.cc:290] T 10853738200240bb93ca91ed7d97566e P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 2 election: Requested vote from peers fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193:39519), 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195:43253)
I20260709 13:17:57.246135 11708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10853738200240bb93ca91ed7d97566e" candidate_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126"
I20260709 13:17:57.246558 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10853738200240bb93ca91ed7d97566e" candidate_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9"
I20260709 13:17:57.246918 11708 raft_consensus.cc:3060] T 10853738200240bb93ca91ed7d97566e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:57.247241 11855 raft_consensus.cc:3055] T 10853738200240bb93ca91ed7d97566e P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:57.247583 11855 raft_consensus.cc:740] T 10853738200240bb93ca91ed7d97566e P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 11579f7b06aa4eb4be4cd404f83aa8a9, State: Running, Role: LEADER
I20260709 13:17:57.248384 11855 consensus_queue.cc:260] T 10853738200240bb93ca91ed7d97566e P 11579f7b06aa4eb4be4cd404f83aa8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:57.249449 11855 raft_consensus.cc:3060] T 10853738200240bb93ca91ed7d97566e P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:57.252687 11708 raft_consensus.cc:2468] T 10853738200240bb93ca91ed7d97566e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 838a3115bb3b43aa9d133a9e2867cb1e in term 2.
I20260709 13:17:57.254076 11749 leader_election.cc:304] T 10853738200240bb93ca91ed7d97566e P 838a3115bb3b43aa9d133a9e2867cb1e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 838a3115bb3b43aa9d133a9e2867cb1e, fcd7d1bb34ba477f8b4fb7fcf67b7126; no voters: 
I20260709 13:17:57.254881 12029 raft_consensus.cc:2804] T 10853738200240bb93ca91ed7d97566e P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:57.255345 12029 raft_consensus.cc:697] T 10853738200240bb93ca91ed7d97566e P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 LEADER]: Becoming Leader. State: Replica: 838a3115bb3b43aa9d133a9e2867cb1e, State: Running, Role: LEADER
I20260709 13:17:57.256040 11855 raft_consensus.cc:2468] T 10853738200240bb93ca91ed7d97566e P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 838a3115bb3b43aa9d133a9e2867cb1e in term 2.
I20260709 13:17:57.256204 12029 consensus_queue.cc:237] T 10853738200240bb93ca91ed7d97566e P 838a3115bb3b43aa9d133a9e2867cb1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:17:57.264235 11603 catalog_manager.cc:5697] T 10853738200240bb93ca91ed7d97566e P 838a3115bb3b43aa9d133a9e2867cb1e reported cstate change: term changed from 1 to 2, leader changed from 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195) to 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194). New cstate: current_term: 2 leader_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:57.341243 11855 raft_consensus.cc:1275] T 3a4cfaf3eb3649dda1cd4ec67714625c P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 2 FOLLOWER]: Refusing update from remote peer fcd7d1bb34ba477f8b4fb7fcf67b7126: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:57.342432 12006 consensus_queue.cc:1048] T 3a4cfaf3eb3649dda1cd4ec67714625c P fcd7d1bb34ba477f8b4fb7fcf67b7126 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:57.350553 11782 raft_consensus.cc:1275] T 3a4cfaf3eb3649dda1cd4ec67714625c P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 FOLLOWER]: Refusing update from remote peer fcd7d1bb34ba477f8b4fb7fcf67b7126: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:57.352605 12008 consensus_queue.cc:1048] T 3a4cfaf3eb3649dda1cd4ec67714625c P fcd7d1bb34ba477f8b4fb7fcf67b7126 [LEADER]: Connected to new peer: Peer: permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:57.410413 11782 raft_consensus.cc:1275] T de5865b982f344e29ffc3453ec63ad46 P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 FOLLOWER]: Refusing update from remote peer 11579f7b06aa4eb4be4cd404f83aa8a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:57.411855 11969 consensus_queue.cc:1048] T de5865b982f344e29ffc3453ec63ad46 P 11579f7b06aa4eb4be4cd404f83aa8a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:57.419652 11708 raft_consensus.cc:1275] T de5865b982f344e29ffc3453ec63ad46 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 FOLLOWER]: Refusing update from remote peer 11579f7b06aa4eb4be4cd404f83aa8a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:57.421865 12068 consensus_queue.cc:1048] T de5865b982f344e29ffc3453ec63ad46 P 11579f7b06aa4eb4be4cd404f83aa8a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:57.437410 11855 raft_consensus.cc:1275] T 9de688862796441d936411ed5e7c42e1 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 2 FOLLOWER]: Refusing update from remote peer 838a3115bb3b43aa9d133a9e2867cb1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:57.439303 12029 consensus_queue.cc:1048] T 9de688862796441d936411ed5e7c42e1 P 838a3115bb3b43aa9d133a9e2867cb1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:57.448464 11708 raft_consensus.cc:1275] T 9de688862796441d936411ed5e7c42e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 FOLLOWER]: Refusing update from remote peer 838a3115bb3b43aa9d133a9e2867cb1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:57.449998 12009 consensus_queue.cc:1048] T 9de688862796441d936411ed5e7c42e1 P 838a3115bb3b43aa9d133a9e2867cb1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:57.594717 11782 raft_consensus.cc:1275] T afbf296b986b46aa9283a2dfe0f8fc13 P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 FOLLOWER]: Refusing update from remote peer fcd7d1bb34ba477f8b4fb7fcf67b7126: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:57.596139 12012 consensus_queue.cc:1048] T afbf296b986b46aa9283a2dfe0f8fc13 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [LEADER]: Connected to new peer: Peer: permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:57.605492 11855 raft_consensus.cc:1275] T afbf296b986b46aa9283a2dfe0f8fc13 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 2 FOLLOWER]: Refusing update from remote peer fcd7d1bb34ba477f8b4fb7fcf67b7126: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:57.607065 12012 consensus_queue.cc:1048] T afbf296b986b46aa9283a2dfe0f8fc13 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:57.620057 11855 raft_consensus.cc:1275] T 033d9618f252438383673646b087b3e2 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 2 FOLLOWER]: Refusing update from remote peer 838a3115bb3b43aa9d133a9e2867cb1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:57.621362 11943 consensus_queue.cc:1048] T 033d9618f252438383673646b087b3e2 P 838a3115bb3b43aa9d133a9e2867cb1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:57.629351 11707 raft_consensus.cc:1275] T 033d9618f252438383673646b087b3e2 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 FOLLOWER]: Refusing update from remote peer 838a3115bb3b43aa9d133a9e2867cb1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:57.631111 12069 consensus_queue.cc:1048] T 033d9618f252438383673646b087b3e2 P 838a3115bb3b43aa9d133a9e2867cb1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:57.676499 11707 raft_consensus.cc:1275] T 10853738200240bb93ca91ed7d97566e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 FOLLOWER]: Refusing update from remote peer 838a3115bb3b43aa9d133a9e2867cb1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:57.677771 12069 consensus_queue.cc:1048] T 10853738200240bb93ca91ed7d97566e P 838a3115bb3b43aa9d133a9e2867cb1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:57.685520 11855 raft_consensus.cc:1275] T 10853738200240bb93ca91ed7d97566e P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 2 FOLLOWER]: Refusing update from remote peer 838a3115bb3b43aa9d133a9e2867cb1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:57.687150 11943 consensus_queue.cc:1048] T 10853738200240bb93ca91ed7d97566e P 838a3115bb3b43aa9d133a9e2867cb1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:59.777410 11605 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36366:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:17:59.800540 11605 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36366:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:17:59.928130  2843 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:17:59.925657 11673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:43253, user_credentials={real_user=slave}} blocked reactor thread for 47413.4us
W20260709 13:18:00.049896 11748 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.198.195:43253, user_credentials={real_user=slave}} blocked reactor thread for 69440.9us
I20260709 13:18:00.066466 12123 tablet.cc:1724] T 033d9618f252438383673646b087b3e2 P 838a3115bb3b43aa9d133a9e2867cb1e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:18:00.100793 12109 log.cc:927] Time spent T 3fa6178098a140f09c25be5cf185e48e P 838a3115bb3b43aa9d133a9e2867cb1e: Append to log took a long time: real 0.118s	user 0.000s	sys 0.003s
I20260709 13:18:00.108191 12128 tablet.cc:1724] T 3fa6178098a140f09c25be5cf185e48e P 11579f7b06aa4eb4be4cd404f83aa8a9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:00.108099 12130 tablet.cc:1724] T 3a4cfaf3eb3649dda1cd4ec67714625c P fcd7d1bb34ba477f8b4fb7fcf67b7126: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:18:00.114929 12112 log.cc:927] Time spent T 394623997b07477aa1f4616ad07fd3b5 P 11579f7b06aa4eb4be4cd404f83aa8a9: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:18:00.116617 12127 tablet.cc:1724] T 3fa6178098a140f09c25be5cf185e48e P fcd7d1bb34ba477f8b4fb7fcf67b7126: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:18:00.169761 12118 log.cc:927] Time spent T 10853738200240bb93ca91ed7d97566e P fcd7d1bb34ba477f8b4fb7fcf67b7126: Append to log took a long time: real 0.104s	user 0.002s	sys 0.000s
I20260709 13:18:00.161013 12131 tablet.cc:1724] T 793c97394cd142e9b2f9a301b2698075 P 11579f7b06aa4eb4be4cd404f83aa8a9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:00.177350 11781 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5af25078161a4293851bc656e0eb8b22"
dest_uuid: "838a3115bb3b43aa9d133a9e2867cb1e"
mode: GRACEFUL
new_leader_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9"
 from {username='slave'} at 127.0.0.1:39014
I20260709 13:18:00.178231 11781 raft_consensus.cc:606] T 5af25078161a4293851bc656e0eb8b22 P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 LEADER]: Received request to transfer leadership to TS 11579f7b06aa4eb4be4cd404f83aa8a9
I20260709 13:18:00.192847 12134 tablet.cc:1724] T 3a4cfaf3eb3649dda1cd4ec67714625c P 838a3115bb3b43aa9d133a9e2867cb1e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:00.218215 12138 tablet.cc:1724] T 3fa6178098a140f09c25be5cf185e48e P 838a3115bb3b43aa9d133a9e2867cb1e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:00.218281 12141 tablet.cc:1724] T 033d9618f252438383673646b087b3e2 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:00.228459 12139 tablet.cc:1724] T afbf296b986b46aa9283a2dfe0f8fc13 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:00.263713 12115 raft_consensus.cc:993] T 5af25078161a4293851bc656e0eb8b22 P 838a3115bb3b43aa9d133a9e2867cb1e: : Instructing follower 11579f7b06aa4eb4be4cd404f83aa8a9 to start an election
I20260709 13:18:00.269377 12119 raft_consensus.cc:1081] T 5af25078161a4293851bc656e0eb8b22 P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 LEADER]: Signalling peer 11579f7b06aa4eb4be4cd404f83aa8a9 to start an election
I20260709 13:18:00.270695 12123 tablet.cc:1724] T 10853738200240bb93ca91ed7d97566e P 838a3115bb3b43aa9d133a9e2867cb1e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:00.244117 12130 tablet.cc:1724] T 793c97394cd142e9b2f9a301b2698075 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:00.260555 12128 tablet.cc:1724] T 033d9618f252438383673646b087b3e2 P 11579f7b06aa4eb4be4cd404f83aa8a9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:00.283041 12138 tablet.cc:1724] T 793c97394cd142e9b2f9a301b2698075 P 838a3115bb3b43aa9d133a9e2867cb1e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:00.292492 11851 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5af25078161a4293851bc656e0eb8b22"
dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9"
 from {username='slave'} at 127.0.0.1:54470
I20260709 13:18:00.293337 11851 raft_consensus.cc:493] T 5af25078161a4293851bc656e0eb8b22 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:00.293730 11851 raft_consensus.cc:3060] T 5af25078161a4293851bc656e0eb8b22 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:00.297531 12127 tablet.cc:1724] T 10853738200240bb93ca91ed7d97566e P fcd7d1bb34ba477f8b4fb7fcf67b7126: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:00.301321 12140 tablet.cc:1724] T afbf296b986b46aa9283a2dfe0f8fc13 P 838a3115bb3b43aa9d133a9e2867cb1e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:00.303036 11851 raft_consensus.cc:515] T 5af25078161a4293851bc656e0eb8b22 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:18:00.307968 11851 leader_election.cc:290] T 5af25078161a4293851bc656e0eb8b22 P 11579f7b06aa4eb4be4cd404f83aa8a9 [CANDIDATE]: Term 3 election: Requested vote from peers fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193:39519), 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031)
I20260709 13:18:00.313282 11707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af25078161a4293851bc656e0eb8b22" candidate_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126"
I20260709 13:18:00.323884 11707 raft_consensus.cc:3060] T 5af25078161a4293851bc656e0eb8b22 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:00.320295 12131 tablet.cc:1724] T 394623997b07477aa1f4616ad07fd3b5 P 11579f7b06aa4eb4be4cd404f83aa8a9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:00.231426 12143 tablet.cc:1724] T 3a4cfaf3eb3649dda1cd4ec67714625c P 11579f7b06aa4eb4be4cd404f83aa8a9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:00.331900 11780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af25078161a4293851bc656e0eb8b22" candidate_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "838a3115bb3b43aa9d133a9e2867cb1e"
I20260709 13:18:00.333029 11780 raft_consensus.cc:3055] T 5af25078161a4293851bc656e0eb8b22 P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:00.333467 11780 raft_consensus.cc:740] T 5af25078161a4293851bc656e0eb8b22 P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 838a3115bb3b43aa9d133a9e2867cb1e, State: Running, Role: LEADER
I20260709 13:18:00.337889 11780 consensus_queue.cc:260] T 5af25078161a4293851bc656e0eb8b22 P 838a3115bb3b43aa9d133a9e2867cb1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:18:00.351912 11780 raft_consensus.cc:3060] T 5af25078161a4293851bc656e0eb8b22 P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:00.350766 11707 raft_consensus.cc:2468] T 5af25078161a4293851bc656e0eb8b22 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11579f7b06aa4eb4be4cd404f83aa8a9 in term 3.
I20260709 13:18:00.355185 11823 leader_election.cc:304] T 5af25078161a4293851bc656e0eb8b22 P 11579f7b06aa4eb4be4cd404f83aa8a9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11579f7b06aa4eb4be4cd404f83aa8a9, fcd7d1bb34ba477f8b4fb7fcf67b7126; no voters: 
I20260709 13:18:00.357581 11969 raft_consensus.cc:2804] T 5af25078161a4293851bc656e0eb8b22 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:00.359534 11969 raft_consensus.cc:697] T 5af25078161a4293851bc656e0eb8b22 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 3 LEADER]: Becoming Leader. State: Replica: 11579f7b06aa4eb4be4cd404f83aa8a9, State: Running, Role: LEADER
I20260709 13:18:00.359856 12146 tablet.cc:1724] T afbf296b986b46aa9283a2dfe0f8fc13 P 11579f7b06aa4eb4be4cd404f83aa8a9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:00.360532 11969 consensus_queue.cc:237] T 5af25078161a4293851bc656e0eb8b22 P 11579f7b06aa4eb4be4cd404f83aa8a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:18:00.356124 12134 tablet.cc:1724] T 394623997b07477aa1f4616ad07fd3b5 P 838a3115bb3b43aa9d133a9e2867cb1e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:00.373209 12141 tablet.cc:1724] T de5865b982f344e29ffc3453ec63ad46 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:00.376914 11708 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c2b0f9021628468991c5a4ef3ebade45"
dest_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126"
mode: GRACEFUL
new_leader_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9"
 from {username='slave'} at 127.0.0.1:51176
I20260709 13:18:00.379206 11708 raft_consensus.cc:606] T c2b0f9021628468991c5a4ef3ebade45 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 LEADER]: Received request to transfer leadership to TS 11579f7b06aa4eb4be4cd404f83aa8a9
I20260709 13:18:00.380856  2843 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:18:00.381606  2843 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:00.382951 12128 tablet.cc:1724] T de5865b982f344e29ffc3453ec63ad46 P 11579f7b06aa4eb4be4cd404f83aa8a9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:00.383275 12131 tablet.cc:1724] T 10853738200240bb93ca91ed7d97566e P 11579f7b06aa4eb4be4cd404f83aa8a9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:00.391182 12138 tablet.cc:1724] T de5865b982f344e29ffc3453ec63ad46 P 838a3115bb3b43aa9d133a9e2867cb1e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:00.391605 12139 tablet.cc:1724] T 9de688862796441d936411ed5e7c42e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:00.384531 12143 tablet.cc:1724] T 9de688862796441d936411ed5e7c42e1 P 11579f7b06aa4eb4be4cd404f83aa8a9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:00.398320 11780 raft_consensus.cc:2468] T 5af25078161a4293851bc656e0eb8b22 P 838a3115bb3b43aa9d133a9e2867cb1e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11579f7b06aa4eb4be4cd404f83aa8a9 in term 3.
I20260709 13:18:00.407421 12123 tablet.cc:1724] T 9de688862796441d936411ed5e7c42e1 P 838a3115bb3b43aa9d133a9e2867cb1e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:00.422741 11602 catalog_manager.cc:5697] T 5af25078161a4293851bc656e0eb8b22 P 11579f7b06aa4eb4be4cd404f83aa8a9 reported cstate change: term changed from 2 to 3, leader changed from 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194) to 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195). New cstate: current_term: 3 leader_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:00.419584 12127 tablet.cc:1724] T 394623997b07477aa1f4616ad07fd3b5 P fcd7d1bb34ba477f8b4fb7fcf67b7126: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:00.457314 11603 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 950cb04f8e1f4c369a09f8732652d08f: soft_deleted_table [id=e37c9278bfd544b0934775465c42347c] alter complete (version 1)
I20260709 13:18:00.670025 12100 raft_consensus.cc:993] T c2b0f9021628468991c5a4ef3ebade45 P fcd7d1bb34ba477f8b4fb7fcf67b7126: : Instructing follower 11579f7b06aa4eb4be4cd404f83aa8a9 to start an election
I20260709 13:18:00.670773 12099 raft_consensus.cc:1081] T c2b0f9021628468991c5a4ef3ebade45 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 LEADER]: Signalling peer 11579f7b06aa4eb4be4cd404f83aa8a9 to start an election
I20260709 13:18:00.672324 11855 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c2b0f9021628468991c5a4ef3ebade45"
dest_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9"
 from {username='slave'} at 127.0.0.1:54456
I20260709 13:18:00.672819 11855 raft_consensus.cc:493] T c2b0f9021628468991c5a4ef3ebade45 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:00.673166 11855 raft_consensus.cc:3060] T c2b0f9021628468991c5a4ef3ebade45 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:00.679131 11855 raft_consensus.cc:515] T c2b0f9021628468991c5a4ef3ebade45 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:18:00.681020 11855 leader_election.cc:290] T c2b0f9021628468991c5a4ef3ebade45 P 11579f7b06aa4eb4be4cd404f83aa8a9 [CANDIDATE]: Term 3 election: Requested vote from peers fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193:39519), 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031)
I20260709 13:18:00.682022 11708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b0f9021628468991c5a4ef3ebade45" candidate_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126"
I20260709 13:18:00.682767 11708 raft_consensus.cc:3055] T c2b0f9021628468991c5a4ef3ebade45 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:00.683082 11708 raft_consensus.cc:740] T c2b0f9021628468991c5a4ef3ebade45 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fcd7d1bb34ba477f8b4fb7fcf67b7126, State: Running, Role: LEADER
I20260709 13:18:00.683282 11782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b0f9021628468991c5a4ef3ebade45" candidate_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "838a3115bb3b43aa9d133a9e2867cb1e"
I20260709 13:18:00.683960 11782 raft_consensus.cc:3060] T c2b0f9021628468991c5a4ef3ebade45 P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:00.683876 11708 consensus_queue.cc:260] T c2b0f9021628468991c5a4ef3ebade45 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:18:00.685525 11708 raft_consensus.cc:3060] T c2b0f9021628468991c5a4ef3ebade45 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:00.690822 11782 raft_consensus.cc:2468] T c2b0f9021628468991c5a4ef3ebade45 P 838a3115bb3b43aa9d133a9e2867cb1e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11579f7b06aa4eb4be4cd404f83aa8a9 in term 3.
I20260709 13:18:00.691565 11708 raft_consensus.cc:2468] T c2b0f9021628468991c5a4ef3ebade45 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11579f7b06aa4eb4be4cd404f83aa8a9 in term 3.
I20260709 13:18:00.692101 11823 leader_election.cc:304] T c2b0f9021628468991c5a4ef3ebade45 P 11579f7b06aa4eb4be4cd404f83aa8a9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11579f7b06aa4eb4be4cd404f83aa8a9, 838a3115bb3b43aa9d133a9e2867cb1e; no voters: 
I20260709 13:18:00.692992 11969 raft_consensus.cc:2804] T c2b0f9021628468991c5a4ef3ebade45 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:00.693612 11969 raft_consensus.cc:697] T c2b0f9021628468991c5a4ef3ebade45 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 3 LEADER]: Becoming Leader. State: Replica: 11579f7b06aa4eb4be4cd404f83aa8a9, State: Running, Role: LEADER
I20260709 13:18:00.694516 11969 consensus_queue.cc:237] T c2b0f9021628468991c5a4ef3ebade45 P 11579f7b06aa4eb4be4cd404f83aa8a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } }
I20260709 13:18:00.703490 11602 catalog_manager.cc:5697] T c2b0f9021628468991c5a4ef3ebade45 P 11579f7b06aa4eb4be4cd404f83aa8a9 reported cstate change: term changed from 2 to 3, leader changed from fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193) to 11579f7b06aa4eb4be4cd404f83aa8a9 (127.2.198.195). New cstate: current_term: 3 leader_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11579f7b06aa4eb4be4cd404f83aa8a9" member_type: VOTER last_known_addr { host: "127.2.198.195" port: 43253 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:00.957458 11782 raft_consensus.cc:1275] T 5af25078161a4293851bc656e0eb8b22 P 838a3115bb3b43aa9d133a9e2867cb1e [term 3 FOLLOWER]: Refusing update from remote peer 11579f7b06aa4eb4be4cd404f83aa8a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:00.958789 11969 consensus_queue.cc:1048] T 5af25078161a4293851bc656e0eb8b22 P 11579f7b06aa4eb4be4cd404f83aa8a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:00.970471 11708 raft_consensus.cc:1275] T 5af25078161a4293851bc656e0eb8b22 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 3 FOLLOWER]: Refusing update from remote peer 11579f7b06aa4eb4be4cd404f83aa8a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:00.972359 11969 consensus_queue.cc:1048] T 5af25078161a4293851bc656e0eb8b22 P 11579f7b06aa4eb4be4cd404f83aa8a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:01.156606 11782 raft_consensus.cc:1275] T c2b0f9021628468991c5a4ef3ebade45 P 838a3115bb3b43aa9d133a9e2867cb1e [term 3 FOLLOWER]: Refusing update from remote peer 11579f7b06aa4eb4be4cd404f83aa8a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:01.157935 11969 consensus_queue.cc:1048] T c2b0f9021628468991c5a4ef3ebade45 P 11579f7b06aa4eb4be4cd404f83aa8a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "838a3115bb3b43aa9d133a9e2867cb1e" member_type: VOTER last_known_addr { host: "127.2.198.194" port: 37031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:01.170032 11708 raft_consensus.cc:1275] T c2b0f9021628468991c5a4ef3ebade45 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 3 FOLLOWER]: Refusing update from remote peer 11579f7b06aa4eb4be4cd404f83aa8a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:01.172806 12159 consensus_queue.cc:1048] T c2b0f9021628468991c5a4ef3ebade45 P 11579f7b06aa4eb4be4cd404f83aa8a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcd7d1bb34ba477f8b4fb7fcf67b7126" member_type: VOTER last_known_addr { host: "127.2.198.193" port: 39519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:01.447412  2843 tablet_server.cc:179] TabletServer@127.2.198.193:0 shutting down...
I20260709 13:18:01.487098  2843 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:01.488165  2843 tablet_replica.cc:333] T 394623997b07477aa1f4616ad07fd3b5 P fcd7d1bb34ba477f8b4fb7fcf67b7126: stopping tablet replica
I20260709 13:18:01.489311  2843 raft_consensus.cc:2243] T 394623997b07477aa1f4616ad07fd3b5 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.489859  2843 raft_consensus.cc:2272] T 394623997b07477aa1f4616ad07fd3b5 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.492252  2843 tablet_replica.cc:333] T 3a4cfaf3eb3649dda1cd4ec67714625c P fcd7d1bb34ba477f8b4fb7fcf67b7126: stopping tablet replica
I20260709 13:18:01.493068  2843 raft_consensus.cc:2243] T 3a4cfaf3eb3649dda1cd4ec67714625c P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:01.493983  2843 raft_consensus.cc:2272] T 3a4cfaf3eb3649dda1cd4ec67714625c P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.496315  2843 tablet_replica.cc:333] T 10853738200240bb93ca91ed7d97566e P fcd7d1bb34ba477f8b4fb7fcf67b7126: stopping tablet replica
I20260709 13:18:01.496922  2843 raft_consensus.cc:2243] T 10853738200240bb93ca91ed7d97566e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.497359  2843 raft_consensus.cc:2272] T 10853738200240bb93ca91ed7d97566e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.499428  2843 tablet_replica.cc:333] T 9de688862796441d936411ed5e7c42e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126: stopping tablet replica
I20260709 13:18:01.500147  2843 raft_consensus.cc:2243] T 9de688862796441d936411ed5e7c42e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.500590  2843 raft_consensus.cc:2272] T 9de688862796441d936411ed5e7c42e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.502709  2843 tablet_replica.cc:333] T 033d9618f252438383673646b087b3e2 P fcd7d1bb34ba477f8b4fb7fcf67b7126: stopping tablet replica
I20260709 13:18:01.503283  2843 raft_consensus.cc:2243] T 033d9618f252438383673646b087b3e2 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.503816  2843 raft_consensus.cc:2272] T 033d9618f252438383673646b087b3e2 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.505905  2843 tablet_replica.cc:333] T 3fa6178098a140f09c25be5cf185e48e P fcd7d1bb34ba477f8b4fb7fcf67b7126: stopping tablet replica
I20260709 13:18:01.506595  2843 raft_consensus.cc:2243] T 3fa6178098a140f09c25be5cf185e48e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:01.507493  2843 raft_consensus.cc:2272] T 3fa6178098a140f09c25be5cf185e48e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.509702  2843 tablet_replica.cc:333] T afbf296b986b46aa9283a2dfe0f8fc13 P fcd7d1bb34ba477f8b4fb7fcf67b7126: stopping tablet replica
I20260709 13:18:01.510474  2843 raft_consensus.cc:2243] T afbf296b986b46aa9283a2dfe0f8fc13 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:01.511689  2843 raft_consensus.cc:2272] T afbf296b986b46aa9283a2dfe0f8fc13 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.514137  2843 tablet_replica.cc:333] T c2b0f9021628468991c5a4ef3ebade45 P fcd7d1bb34ba477f8b4fb7fcf67b7126: stopping tablet replica
I20260709 13:18:01.514751  2843 raft_consensus.cc:2243] T c2b0f9021628468991c5a4ef3ebade45 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.515152  2843 raft_consensus.cc:2272] T c2b0f9021628468991c5a4ef3ebade45 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.517920  2843 tablet_replica.cc:333] T de5865b982f344e29ffc3453ec63ad46 P fcd7d1bb34ba477f8b4fb7fcf67b7126: stopping tablet replica
I20260709 13:18:01.518491  2843 raft_consensus.cc:2243] T de5865b982f344e29ffc3453ec63ad46 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.518911  2843 raft_consensus.cc:2272] T de5865b982f344e29ffc3453ec63ad46 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.520978  2843 tablet_replica.cc:333] T 18ecbae8747a4d928473333988f89191 P fcd7d1bb34ba477f8b4fb7fcf67b7126: stopping tablet replica
I20260709 13:18:01.521500  2843 raft_consensus.cc:2243] T 18ecbae8747a4d928473333988f89191 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:01.522305  2843 raft_consensus.cc:2272] T 18ecbae8747a4d928473333988f89191 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.524678  2843 tablet_replica.cc:333] T e4fc1968ceff48fdb57d0c32ec0e48be P fcd7d1bb34ba477f8b4fb7fcf67b7126: stopping tablet replica
I20260709 13:18:01.525315  2843 raft_consensus.cc:2243] T e4fc1968ceff48fdb57d0c32ec0e48be P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:01.526237  2843 raft_consensus.cc:2272] T e4fc1968ceff48fdb57d0c32ec0e48be P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.528606  2843 tablet_replica.cc:333] T 83da4971ae24448e9dd2d458ad585340 P fcd7d1bb34ba477f8b4fb7fcf67b7126: stopping tablet replica
I20260709 13:18:01.529192  2843 raft_consensus.cc:2243] T 83da4971ae24448e9dd2d458ad585340 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.529596  2843 raft_consensus.cc:2272] T 83da4971ae24448e9dd2d458ad585340 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.531747  2843 tablet_replica.cc:333] T 930ea8ac2d2c41819a1481a4b2e09b24 P fcd7d1bb34ba477f8b4fb7fcf67b7126: stopping tablet replica
I20260709 13:18:01.532308  2843 raft_consensus.cc:2243] T 930ea8ac2d2c41819a1481a4b2e09b24 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.532721  2843 raft_consensus.cc:2272] T 930ea8ac2d2c41819a1481a4b2e09b24 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.534960  2843 tablet_replica.cc:333] T 509909ca832c4367bb1c43c3f8bc21e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126: stopping tablet replica
I20260709 13:18:01.535499  2843 raft_consensus.cc:2243] T 509909ca832c4367bb1c43c3f8bc21e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.535985  2843 raft_consensus.cc:2272] T 509909ca832c4367bb1c43c3f8bc21e1 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.537997  2843 tablet_replica.cc:333] T 5af25078161a4293851bc656e0eb8b22 P fcd7d1bb34ba477f8b4fb7fcf67b7126: stopping tablet replica
I20260709 13:18:01.538488  2843 raft_consensus.cc:2243] T 5af25078161a4293851bc656e0eb8b22 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.538906  2843 raft_consensus.cc:2272] T 5af25078161a4293851bc656e0eb8b22 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.542222  2843 tablet_replica.cc:333] T 3a4012d4e7024b00bd58a041e3a07dcb P fcd7d1bb34ba477f8b4fb7fcf67b7126: stopping tablet replica
I20260709 13:18:01.542976  2843 raft_consensus.cc:2243] T 3a4012d4e7024b00bd58a041e3a07dcb P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.543534  2843 raft_consensus.cc:2272] T 3a4012d4e7024b00bd58a041e3a07dcb P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.546253  2843 tablet_replica.cc:333] T 793c97394cd142e9b2f9a301b2698075 P fcd7d1bb34ba477f8b4fb7fcf67b7126: stopping tablet replica
I20260709 13:18:01.546799  2843 raft_consensus.cc:2243] T 793c97394cd142e9b2f9a301b2698075 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:01.547724  2843 raft_consensus.cc:2272] T 793c97394cd142e9b2f9a301b2698075 P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.549765  2843 tablet_replica.cc:333] T 8fd864b8209b45debd46cbde76e1e66e P fcd7d1bb34ba477f8b4fb7fcf67b7126: stopping tablet replica
I20260709 13:18:01.550243  2843 raft_consensus.cc:2243] T 8fd864b8209b45debd46cbde76e1e66e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:01.551067  2843 raft_consensus.cc:2272] T 8fd864b8209b45debd46cbde76e1e66e P fcd7d1bb34ba477f8b4fb7fcf67b7126 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:01.571110 11823 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 54 similar messages]
W20260709 13:18:01.575915 11823 consensus_peers.cc:597] T c2b0f9021628468991c5a4ef3ebade45 P 11579f7b06aa4eb4be4cd404f83aa8a9 -> Peer fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193:39519): Couldn't send request to peer fcd7d1bb34ba477f8b4fb7fcf67b7126. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:01.589570 11823 consensus_peers.cc:597] T 5af25078161a4293851bc656e0eb8b22 P 11579f7b06aa4eb4be4cd404f83aa8a9 -> Peer fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193:39519): Couldn't send request to peer fcd7d1bb34ba477f8b4fb7fcf67b7126. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39519: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:01.597538  2843 tablet_server.cc:196] TabletServer@127.2.198.193:0 shutdown complete.
I20260709 13:18:01.638147  2843 tablet_server.cc:179] TabletServer@127.2.198.194:0 shutting down...
W20260709 13:18:01.672012 11749 consensus_peers.cc:597] T 930ea8ac2d2c41819a1481a4b2e09b24 P 838a3115bb3b43aa9d133a9e2867cb1e -> Peer fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193:39519): Couldn't send request to peer fcd7d1bb34ba477f8b4fb7fcf67b7126. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39519: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:01.676517 11749 consensus_peers.cc:597] T 10853738200240bb93ca91ed7d97566e P 838a3115bb3b43aa9d133a9e2867cb1e -> Peer fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193:39519): Couldn't send request to peer fcd7d1bb34ba477f8b4fb7fcf67b7126. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39519: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:01.681978  2843 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:01.682937  2843 tablet_replica.cc:333] T 9de688862796441d936411ed5e7c42e1 P 838a3115bb3b43aa9d133a9e2867cb1e: stopping tablet replica
I20260709 13:18:01.683764  2843 raft_consensus.cc:2243] T 9de688862796441d936411ed5e7c42e1 P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:01.684883  2843 raft_consensus.cc:2272] T 9de688862796441d936411ed5e7c42e1 P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.687193  2843 tablet_replica.cc:333] T 10853738200240bb93ca91ed7d97566e P 838a3115bb3b43aa9d133a9e2867cb1e: stopping tablet replica
I20260709 13:18:01.687942  2843 raft_consensus.cc:2243] T 10853738200240bb93ca91ed7d97566e P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:01.688875  2843 raft_consensus.cc:2272] T 10853738200240bb93ca91ed7d97566e P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.691175  2843 tablet_replica.cc:333] T 394623997b07477aa1f4616ad07fd3b5 P 838a3115bb3b43aa9d133a9e2867cb1e: stopping tablet replica
I20260709 13:18:01.691939  2843 raft_consensus.cc:2243] T 394623997b07477aa1f4616ad07fd3b5 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:01.692833  2843 raft_consensus.cc:2272] T 394623997b07477aa1f4616ad07fd3b5 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.695058  2843 tablet_replica.cc:333] T 033d9618f252438383673646b087b3e2 P 838a3115bb3b43aa9d133a9e2867cb1e: stopping tablet replica
I20260709 13:18:01.695837  2843 raft_consensus.cc:2243] T 033d9618f252438383673646b087b3e2 P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:01.696699  2843 raft_consensus.cc:2272] T 033d9618f252438383673646b087b3e2 P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.698853  2843 tablet_replica.cc:333] T 3a4cfaf3eb3649dda1cd4ec67714625c P 838a3115bb3b43aa9d133a9e2867cb1e: stopping tablet replica
I20260709 13:18:01.699497  2843 raft_consensus.cc:2243] T 3a4cfaf3eb3649dda1cd4ec67714625c P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.700074  2843 raft_consensus.cc:2272] T 3a4cfaf3eb3649dda1cd4ec67714625c P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.702142  2843 tablet_replica.cc:333] T 8fd864b8209b45debd46cbde76e1e66e P 838a3115bb3b43aa9d133a9e2867cb1e: stopping tablet replica
I20260709 13:18:01.702778  2843 raft_consensus.cc:2243] T 8fd864b8209b45debd46cbde76e1e66e P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.703266  2843 raft_consensus.cc:2272] T 8fd864b8209b45debd46cbde76e1e66e P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.705642  2843 tablet_replica.cc:333] T 793c97394cd142e9b2f9a301b2698075 P 838a3115bb3b43aa9d133a9e2867cb1e: stopping tablet replica
I20260709 13:18:01.706362  2843 raft_consensus.cc:2243] T 793c97394cd142e9b2f9a301b2698075 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.706854  2843 raft_consensus.cc:2272] T 793c97394cd142e9b2f9a301b2698075 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.708989  2843 tablet_replica.cc:333] T 83da4971ae24448e9dd2d458ad585340 P 838a3115bb3b43aa9d133a9e2867cb1e: stopping tablet replica
I20260709 13:18:01.709599  2843 raft_consensus.cc:2243] T 83da4971ae24448e9dd2d458ad585340 P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:01.710516  2843 raft_consensus.cc:2272] T 83da4971ae24448e9dd2d458ad585340 P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.713121  2843 tablet_replica.cc:333] T 5af25078161a4293851bc656e0eb8b22 P 838a3115bb3b43aa9d133a9e2867cb1e: stopping tablet replica
I20260709 13:18:01.713742  2843 raft_consensus.cc:2243] T 5af25078161a4293851bc656e0eb8b22 P 838a3115bb3b43aa9d133a9e2867cb1e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.714215  2843 raft_consensus.cc:2272] T 5af25078161a4293851bc656e0eb8b22 P 838a3115bb3b43aa9d133a9e2867cb1e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.717221  2843 tablet_replica.cc:333] T 509909ca832c4367bb1c43c3f8bc21e1 P 838a3115bb3b43aa9d133a9e2867cb1e: stopping tablet replica
I20260709 13:18:01.717908  2843 raft_consensus.cc:2243] T 509909ca832c4367bb1c43c3f8bc21e1 P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.718425  2843 raft_consensus.cc:2272] T 509909ca832c4367bb1c43c3f8bc21e1 P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.721110  2843 tablet_replica.cc:333] T 930ea8ac2d2c41819a1481a4b2e09b24 P 838a3115bb3b43aa9d133a9e2867cb1e: stopping tablet replica
I20260709 13:18:01.721901  2843 raft_consensus.cc:2243] T 930ea8ac2d2c41819a1481a4b2e09b24 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:01.722855  2843 raft_consensus.cc:2272] T 930ea8ac2d2c41819a1481a4b2e09b24 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.725162  2843 tablet_replica.cc:333] T afbf296b986b46aa9283a2dfe0f8fc13 P 838a3115bb3b43aa9d133a9e2867cb1e: stopping tablet replica
I20260709 13:18:01.725754  2843 raft_consensus.cc:2243] T afbf296b986b46aa9283a2dfe0f8fc13 P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.726244  2843 raft_consensus.cc:2272] T afbf296b986b46aa9283a2dfe0f8fc13 P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.728355  2843 tablet_replica.cc:333] T 3fa6178098a140f09c25be5cf185e48e P 838a3115bb3b43aa9d133a9e2867cb1e: stopping tablet replica
I20260709 13:18:01.729049  2843 raft_consensus.cc:2243] T 3fa6178098a140f09c25be5cf185e48e P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.729594  2843 raft_consensus.cc:2272] T 3fa6178098a140f09c25be5cf185e48e P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.731530  2843 tablet_replica.cc:333] T 3a4012d4e7024b00bd58a041e3a07dcb P 838a3115bb3b43aa9d133a9e2867cb1e: stopping tablet replica
I20260709 13:18:01.732165  2843 raft_consensus.cc:2243] T 3a4012d4e7024b00bd58a041e3a07dcb P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:01.733021  2843 raft_consensus.cc:2272] T 3a4012d4e7024b00bd58a041e3a07dcb P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:01.734732 11823 consensus_peers.cc:597] T 509909ca832c4367bb1c43c3f8bc21e1 P 11579f7b06aa4eb4be4cd404f83aa8a9 -> Peer 838a3115bb3b43aa9d133a9e2867cb1e (127.2.198.194:37031): Couldn't send request to peer 838a3115bb3b43aa9d133a9e2867cb1e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:01.735353  2843 tablet_replica.cc:333] T de5865b982f344e29ffc3453ec63ad46 P 838a3115bb3b43aa9d133a9e2867cb1e: stopping tablet replica
I20260709 13:18:01.736105  2843 raft_consensus.cc:2243] T de5865b982f344e29ffc3453ec63ad46 P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.736598  2843 raft_consensus.cc:2272] T de5865b982f344e29ffc3453ec63ad46 P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.738610  2843 tablet_replica.cc:333] T e4fc1968ceff48fdb57d0c32ec0e48be P 838a3115bb3b43aa9d133a9e2867cb1e: stopping tablet replica
I20260709 13:18:01.739197  2843 raft_consensus.cc:2243] T e4fc1968ceff48fdb57d0c32ec0e48be P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.739677  2843 raft_consensus.cc:2272] T e4fc1968ceff48fdb57d0c32ec0e48be P 838a3115bb3b43aa9d133a9e2867cb1e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.742415  2843 tablet_replica.cc:333] T 18ecbae8747a4d928473333988f89191 P 838a3115bb3b43aa9d133a9e2867cb1e: stopping tablet replica
I20260709 13:18:01.743261  2843 raft_consensus.cc:2243] T 18ecbae8747a4d928473333988f89191 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.743827  2843 raft_consensus.cc:2272] T 18ecbae8747a4d928473333988f89191 P 838a3115bb3b43aa9d133a9e2867cb1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.746140  2843 tablet_replica.cc:333] T c2b0f9021628468991c5a4ef3ebade45 P 838a3115bb3b43aa9d133a9e2867cb1e: stopping tablet replica
I20260709 13:18:01.746659  2843 raft_consensus.cc:2243] T c2b0f9021628468991c5a4ef3ebade45 P 838a3115bb3b43aa9d133a9e2867cb1e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.747138  2843 raft_consensus.cc:2272] T c2b0f9021628468991c5a4ef3ebade45 P 838a3115bb3b43aa9d133a9e2867cb1e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.796587  2843 tablet_server.cc:196] TabletServer@127.2.198.194:0 shutdown complete.
W20260709 13:18:01.800946 11823 consensus_peers.cc:597] T de5865b982f344e29ffc3453ec63ad46 P 11579f7b06aa4eb4be4cd404f83aa8a9 -> Peer fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193:39519): Couldn't send request to peer fcd7d1bb34ba477f8b4fb7fcf67b7126. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39519: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:01.823205 11823 consensus_peers.cc:597] T 509909ca832c4367bb1c43c3f8bc21e1 P 11579f7b06aa4eb4be4cd404f83aa8a9 -> Peer fcd7d1bb34ba477f8b4fb7fcf67b7126 (127.2.198.193:39519): Couldn't send request to peer fcd7d1bb34ba477f8b4fb7fcf67b7126. Status: Network error: Client connection negotiation failed: client connection to 127.2.198.193:39519: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:01.843025  2843 tablet_server.cc:179] TabletServer@127.2.198.195:0 shutting down...
I20260709 13:18:01.874955  2843 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:01.875809  2843 tablet_replica.cc:333] T 3a4cfaf3eb3649dda1cd4ec67714625c P 11579f7b06aa4eb4be4cd404f83aa8a9: stopping tablet replica
I20260709 13:18:01.876576  2843 raft_consensus.cc:2243] T 3a4cfaf3eb3649dda1cd4ec67714625c P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.877156  2843 raft_consensus.cc:2272] T 3a4cfaf3eb3649dda1cd4ec67714625c P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.879412  2843 tablet_replica.cc:333] T 033d9618f252438383673646b087b3e2 P 11579f7b06aa4eb4be4cd404f83aa8a9: stopping tablet replica
I20260709 13:18:01.880079  2843 raft_consensus.cc:2243] T 033d9618f252438383673646b087b3e2 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.880566  2843 raft_consensus.cc:2272] T 033d9618f252438383673646b087b3e2 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.882586  2843 tablet_replica.cc:333] T 394623997b07477aa1f4616ad07fd3b5 P 11579f7b06aa4eb4be4cd404f83aa8a9: stopping tablet replica
I20260709 13:18:01.883189  2843 raft_consensus.cc:2243] T 394623997b07477aa1f4616ad07fd3b5 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.883702  2843 raft_consensus.cc:2272] T 394623997b07477aa1f4616ad07fd3b5 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.885777  2843 tablet_replica.cc:333] T 9de688862796441d936411ed5e7c42e1 P 11579f7b06aa4eb4be4cd404f83aa8a9: stopping tablet replica
I20260709 13:18:01.886368  2843 raft_consensus.cc:2243] T 9de688862796441d936411ed5e7c42e1 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.886829  2843 raft_consensus.cc:2272] T 9de688862796441d936411ed5e7c42e1 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.888841  2843 tablet_replica.cc:333] T 10853738200240bb93ca91ed7d97566e P 11579f7b06aa4eb4be4cd404f83aa8a9: stopping tablet replica
I20260709 13:18:01.889418  2843 raft_consensus.cc:2243] T 10853738200240bb93ca91ed7d97566e P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.889886  2843 raft_consensus.cc:2272] T 10853738200240bb93ca91ed7d97566e P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.891914  2843 tablet_replica.cc:333] T 8fd864b8209b45debd46cbde76e1e66e P 11579f7b06aa4eb4be4cd404f83aa8a9: stopping tablet replica
I20260709 13:18:01.892546  2843 raft_consensus.cc:2243] T 8fd864b8209b45debd46cbde76e1e66e P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.892987  2843 raft_consensus.cc:2272] T 8fd864b8209b45debd46cbde76e1e66e P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.895110  2843 tablet_replica.cc:333] T 793c97394cd142e9b2f9a301b2698075 P 11579f7b06aa4eb4be4cd404f83aa8a9: stopping tablet replica
I20260709 13:18:01.895746  2843 raft_consensus.cc:2243] T 793c97394cd142e9b2f9a301b2698075 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.896196  2843 raft_consensus.cc:2272] T 793c97394cd142e9b2f9a301b2698075 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.898185  2843 tablet_replica.cc:333] T 83da4971ae24448e9dd2d458ad585340 P 11579f7b06aa4eb4be4cd404f83aa8a9: stopping tablet replica
I20260709 13:18:01.898793  2843 raft_consensus.cc:2243] T 83da4971ae24448e9dd2d458ad585340 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.899264  2843 raft_consensus.cc:2272] T 83da4971ae24448e9dd2d458ad585340 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.901361  2843 tablet_replica.cc:333] T c2b0f9021628468991c5a4ef3ebade45 P 11579f7b06aa4eb4be4cd404f83aa8a9: stopping tablet replica
I20260709 13:18:01.901952  2843 raft_consensus.cc:2243] T c2b0f9021628468991c5a4ef3ebade45 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:18:01.902824  2843 raft_consensus.cc:2272] T c2b0f9021628468991c5a4ef3ebade45 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.905401  2843 tablet_replica.cc:333] T de5865b982f344e29ffc3453ec63ad46 P 11579f7b06aa4eb4be4cd404f83aa8a9: stopping tablet replica
I20260709 13:18:01.906075  2843 raft_consensus.cc:2243] T de5865b982f344e29ffc3453ec63ad46 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:01.906912  2843 raft_consensus.cc:2272] T de5865b982f344e29ffc3453ec63ad46 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.908923  2843 tablet_replica.cc:333] T 18ecbae8747a4d928473333988f89191 P 11579f7b06aa4eb4be4cd404f83aa8a9: stopping tablet replica
I20260709 13:18:01.909502  2843 raft_consensus.cc:2243] T 18ecbae8747a4d928473333988f89191 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.909943  2843 raft_consensus.cc:2272] T 18ecbae8747a4d928473333988f89191 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.912101  2843 tablet_replica.cc:333] T e4fc1968ceff48fdb57d0c32ec0e48be P 11579f7b06aa4eb4be4cd404f83aa8a9: stopping tablet replica
I20260709 13:18:01.912657  2843 raft_consensus.cc:2243] T e4fc1968ceff48fdb57d0c32ec0e48be P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.913118  2843 raft_consensus.cc:2272] T e4fc1968ceff48fdb57d0c32ec0e48be P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.915225  2843 tablet_replica.cc:333] T 5af25078161a4293851bc656e0eb8b22 P 11579f7b06aa4eb4be4cd404f83aa8a9: stopping tablet replica
I20260709 13:18:01.915855  2843 raft_consensus.cc:2243] T 5af25078161a4293851bc656e0eb8b22 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:18:01.916725  2843 raft_consensus.cc:2272] T 5af25078161a4293851bc656e0eb8b22 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.919131  2843 tablet_replica.cc:333] T afbf296b986b46aa9283a2dfe0f8fc13 P 11579f7b06aa4eb4be4cd404f83aa8a9: stopping tablet replica
I20260709 13:18:01.919813  2843 raft_consensus.cc:2243] T afbf296b986b46aa9283a2dfe0f8fc13 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.920296  2843 raft_consensus.cc:2272] T afbf296b986b46aa9283a2dfe0f8fc13 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.922164  2843 tablet_replica.cc:333] T 3fa6178098a140f09c25be5cf185e48e P 11579f7b06aa4eb4be4cd404f83aa8a9: stopping tablet replica
I20260709 13:18:01.922696  2843 raft_consensus.cc:2243] T 3fa6178098a140f09c25be5cf185e48e P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.923152  2843 raft_consensus.cc:2272] T 3fa6178098a140f09c25be5cf185e48e P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.925083  2843 tablet_replica.cc:333] T 3a4012d4e7024b00bd58a041e3a07dcb P 11579f7b06aa4eb4be4cd404f83aa8a9: stopping tablet replica
I20260709 13:18:01.925593  2843 raft_consensus.cc:2243] T 3a4012d4e7024b00bd58a041e3a07dcb P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.926049  2843 raft_consensus.cc:2272] T 3a4012d4e7024b00bd58a041e3a07dcb P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.928269  2843 tablet_replica.cc:333] T 509909ca832c4367bb1c43c3f8bc21e1 P 11579f7b06aa4eb4be4cd404f83aa8a9: stopping tablet replica
I20260709 13:18:01.928766  2843 raft_consensus.cc:2243] T 509909ca832c4367bb1c43c3f8bc21e1 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:01.929625  2843 raft_consensus.cc:2272] T 509909ca832c4367bb1c43c3f8bc21e1 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.931850  2843 tablet_replica.cc:333] T 930ea8ac2d2c41819a1481a4b2e09b24 P 11579f7b06aa4eb4be4cd404f83aa8a9: stopping tablet replica
I20260709 13:18:01.932353  2843 raft_consensus.cc:2243] T 930ea8ac2d2c41819a1481a4b2e09b24 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.932801  2843 raft_consensus.cc:2272] T 930ea8ac2d2c41819a1481a4b2e09b24 P 11579f7b06aa4eb4be4cd404f83aa8a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.965456  2843 tablet_server.cc:196] TabletServer@127.2.198.195:0 shutdown complete.
I20260709 13:18:02.000905  2843 master.cc:562] Master@127.2.198.254:44921 shutting down...
I20260709 13:18:02.025281  2843 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 950cb04f8e1f4c369a09f8732652d08f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:02.025923  2843 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 950cb04f8e1f4c369a09f8732652d08f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:02.026233  2843 tablet_replica.cc:333] T 00000000000000000000000000000000 P 950cb04f8e1f4c369a09f8732652d08f: stopping tablet replica
I20260709 13:18:02.048564  2843 master.cc:584] Master@127.2.198.254:44921 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (11626 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (25445 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (277272 ms total)
[  PASSED  ] 8 tests.
I20260709 13:18:02.106824  2843 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 442 messages since previous log ~15 seconds ago
I20260709 13:18:02.107118  2843 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 442 messages since previous log ~15 seconds ago
I20260709 13:18:02.107323  2843 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 439 messages since previous log ~15 seconds ago
I20260709 13:18:02.107550  2843 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~36 seconds ago
I20260709 13:18:02.107757  2843 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~36 seconds ago
I20260709 13:18:02.107964  2843 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/master/catalog_manager.cc:4755: suppressed but not reported on 1 messages since previous log ~81 seconds ago
I20260709 13:18:02.108171  2843 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 4 messages since previous log ~167 seconds ago
I20260709 13:18:02.108462  2843 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 6 messages since previous log ~0 seconds ago
I20260709 13:18:02.108681  2843 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~10 seconds ago
